2020-11-12T17:04:13.223 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-12T17:04:13.225 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --block --lock --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} --archive /home/teuthworker/archive/yuriw-2020-11-12_17:03:16-rados-octopus-distro-basic-smithi/5616029 --name yuriw-2020-11-12_17:03:16-rados-octopus-distro-basic-smithi --owner scheduled_yuriw@teuthology -- /tmp/teuthology-worker.66emj2fv.tmp 2020-11-12T17:04:13.267 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-12T17:04:13.327 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2020-11-12_17:03:16-rados-octopus-distro-basic-smithi/5616029 branch: octopus description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} email: ceph-qa@ceph.io first_in_suite: false job_id: '5616029' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2020-11-12_17:03:16-rados-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: octopus ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 2 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd inject bad map crc probability: 0.1 osd map cache size: 1 osd max backfills: 6 osd max markdown count: 1000 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub during recovery: false osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - failed to encode map - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - osd_map_cache_size - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request mon_bind_msgr2: false sha1: 31d4e76d0d584790763b4b1146b29ea4cfc2e9af ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 31d4e76d0d584790763b4b1146b29ea4cfc2e9af thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: 31d4e76d0d584790763b4b1146b29ea4cfc2e9af owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 31d4e76d0d584790763b4b1146b29ea4cfc2e9af sleep_before_teardown: 0 suite: rados suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_octopus/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 31d4e76d0d584790763b4b1146b29ea4cfc2e9af tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: chance_pgnum_grow: 0.25 chance_pgnum_shrink: 0.25 chance_pgpnum_fix: 0.25 chance_test_map_discontinuity: 2 timeout: 1800 - full_sequential: - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 teuthology_branch: master timestamp: 2020-11-12_17:03:16 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.24845 2020-11-12T17:04:13.328 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_octopus/qa; will attempt to use it 2020-11-12T17:04:13.328 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_octopus/qa/tasks 2020-11-12T17:04:13.329 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-12T17:04:13.330 INFO:teuthology.task.internal:Checking packages... 2020-11-12T17:04:13.350 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '31d4e76d0d584790763b4b1146b29ea4cfc2e9af' 2020-11-12T17:04:13.351 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-12T17:04:13.351 INFO:teuthology.packaging:ref: None 2020-11-12T17:04:13.351 INFO:teuthology.packaging:tag: None 2020-11-12T17:04:13.352 INFO:teuthology.packaging:branch: octopus 2020-11-12T17:04:13.352 INFO:teuthology.packaging:sha1: 31d4e76d0d584790763b4b1146b29ea4cfc2e9af 2020-11-12T17:04:13.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2020-11-12T17:04:13.702 INFO:teuthology.task.internal:Found packages for ceph version 15.2.5-585-g31d4e76d-1bionic 2020-11-12T17:04:13.702 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-12T17:04:13.712 INFO:teuthology.task.internal:no buildpackages task found 2020-11-12T17:04:13.713 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-12T17:04:13.752 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-12T17:04:13.753 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-12T17:04:13.804 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:04:23.821 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:04:33.839 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:04:43.854 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:04:53.871 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:05:03.887 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:05:13.902 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:05:23.919 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:05:33.935 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:05:43.950 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:05:53.967 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:06:03.983 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:06:13.999 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:06:24.015 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:06:34.032 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:06:44.048 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:06:54.073 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:07:04.092 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:07:14.109 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:07:24.127 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:07:34.144 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:07:44.162 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-12T17:07:54.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:08:04.195 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-12T17:08:14.211 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_yuriw@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/yuriw-2020-11-12_17:03:16-rados-octopus-distro-basic-smithi/5616029'} 2020-11-12T17:08:14.236 DEBUG:teuthology.lock.ops:locked ubuntu@smithi036.front.sepia.ceph.com, ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:08:14.298 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad2385cb70>, signals=[15]) 2020-11-12T17:08:14.529 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of ubuntu 18.04 2020-11-12T17:08:14.553 INFO:teuthology.provision.fog.smithi205:Scheduling deploy of ubuntu 18.04 2020-11-12T17:08:15.122 INFO:teuthology.orchestra.console:Power off smithi036 2020-11-12T17:08:15.123 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-12T17:08:15.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:15.363 INFO:teuthology.orchestra.console:Power off smithi205 2020-11-12T17:08:15.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi205.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-12T17:08:15.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi205.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:19.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:19.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi205.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:23.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:23.497 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2020-11-12T17:08:23.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi205.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:23.599 INFO:teuthology.orchestra.console:Power on smithi036 2020-11-12T17:08:23.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-12T17:08:23.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:27.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi205.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:27.644 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:27.846 INFO:teuthology.orchestra.console:Power off for smithi205 completed 2020-11-12T17:08:27.947 INFO:teuthology.orchestra.console:Power on smithi205 2020-11-12T17:08:27.947 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi205.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-12T17:08:27.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi205.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:31.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:31.970 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2020-11-12T17:08:31.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi205.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-12T17:08:32.071 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2020-11-12T17:08:32.207 INFO:teuthology.orchestra.console:Power on for smithi205 completed 2020-11-12T17:08:32.309 INFO:teuthology.provision.fog.smithi205:Waiting for deploy to finish 2020-11-12T17:11:03.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:11:12.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:11:21.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:11:30.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:11:33.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:11:39.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:11:42.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:11:48.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:11:51.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:11:57.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:12:00.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:12:09.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:12:18.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:12:27.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:12:59.462 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-12T17:13:03.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:03.982 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-12T17:13:04.008 INFO:teuthology.orchestra.run.smithi036:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-12T17:13:04.327 INFO:teuthology.provision.fog.smithi036:Node is ready 2020-11-12T17:13:04.327 INFO:teuthology.orchestra.run.smithi036:> hostname 2020-11-12T17:13:04.376 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2020-11-12T17:13:04.377 INFO:teuthology.orchestra.run.smithi036:> grep smithi036.front.sepia.ceph.com /etc/hosts 2020-11-12T17:13:04.429 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2020-11-12T17:13:04.429 INFO:teuthology.orchestra.run.smithi036:> sudo hostname smithi036 2020-11-12T17:13:04.595 INFO:teuthology.orchestra.run.smithi036:> sudo sed -i -e 's/smithi036.front.sepia.ceph.com/smithi036/g' /etc/hosts 2020-11-12T17:13:04.611 INFO:teuthology.orchestra.run.smithi036:> sudo sed -i -e 's/172.21.15.36/172.21.15.36/g' /etc/hosts 2020-11-12T17:13:04.668 INFO:teuthology.orchestra.run.smithi036:> sudo sed -i -e 's/smithi036.front.sepia.ceph.com/smithi036/g' /etc/hostname 2020-11-12T17:13:04.724 INFO:teuthology.orchestra.run.smithi036:> sudo hostname smithi036 2020-11-12T17:13:04.779 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2020-11-12T17:13:04.782 DEBUG:teuthology.parallel:result is None 2020-11-12T17:13:05.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:05.498 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-12T17:13:11.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:11.541 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-12T17:13:17.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:17.590 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-12T17:13:23.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:23.603 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-12T17:13:29.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:29.754 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-12T17:13:29.754 INFO:teuthology.orchestra.run.smithi205:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-12T17:13:30.116 INFO:teuthology.provision.fog.smithi205:Node is ready 2020-11-12T17:13:30.116 INFO:teuthology.orchestra.run.smithi205:> hostname 2020-11-12T17:13:30.164 INFO:teuthology.orchestra.run.smithi205.stdout:smithi205.front.sepia.ceph.com 2020-11-12T17:13:30.165 INFO:teuthology.orchestra.run.smithi205:> grep smithi205.front.sepia.ceph.com /etc/hosts 2020-11-12T17:13:30.213 INFO:teuthology.orchestra.run.smithi205.stdout:172.21.15.205 smithi205.front.sepia.ceph.com smithi205 2020-11-12T17:13:30.214 INFO:teuthology.orchestra.run.smithi205:> sudo hostname smithi205 2020-11-12T17:13:30.335 INFO:teuthology.orchestra.run.smithi205:> sudo sed -i -e 's/smithi205.front.sepia.ceph.com/smithi205/g' /etc/hosts 2020-11-12T17:13:30.351 INFO:teuthology.orchestra.run.smithi205:> sudo sed -i -e 's/172.21.15.205/172.21.15.205/g' /etc/hosts 2020-11-12T17:13:30.410 INFO:teuthology.orchestra.run.smithi205:> sudo sed -i -e 's/smithi205.front.sepia.ceph.com/smithi205/g' /etc/hostname 2020-11-12T17:13:30.466 INFO:teuthology.orchestra.run.smithi205:> sudo hostname smithi205 2020-11-12T17:13:30.519 INFO:teuthology.provision.fog.smithi205:Deploy complete! 2020-11-12T17:13:30.520 DEBUG:teuthology.parallel:result is None 2020-11-12T17:13:30.684 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2020-11-12T17:13:30.685 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-12T17:13:30.701 INFO:teuthology.lock.ops:Checking smithi205.front.sepia.ceph.com 2020-11-12T17:13:30.702 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-12T17:13:30.720 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2020-11-12T17:13:30.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:13:30.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:30.795 INFO:teuthology.orchestra.run.smithi036:> true 2020-11-12T17:13:31.039 INFO:teuthology.orchestra.run.smithi036:> uname -m 2020-11-12T17:13:31.087 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2020-11-12T17:13:31.088 INFO:teuthology.orchestra.run.smithi036:> cat /etc/os-release 2020-11-12T17:13:31.136 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Ubuntu" 2020-11-12T17:13:31.136 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-12T17:13:31.136 INFO:teuthology.orchestra.run.smithi036.stdout:ID=ubuntu 2020-11-12T17:13:31.136 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE=debian 2020-11-12T17:13:31.137 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-12T17:13:31.137 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="18.04" 2020-11-12T17:13:31.137 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-12T17:13:31.137 INFO:teuthology.orchestra.run.smithi036.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-12T17:13:31.137 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-12T17:13:31.137 INFO:teuthology.orchestra.run.smithi036.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-12T17:13:31.137 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_CODENAME=bionic 2020-11-12T17:13:31.138 INFO:teuthology.orchestra.run.smithi036.stdout:UBUNTU_CODENAME=bionic 2020-11-12T17:13:31.139 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2020-11-12T17:13:31.157 INFO:teuthology.lock.ops:Updating [smithi205.front.sepia.ceph.com]: set os type and version on server 2020-11-12T17:13:31.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:13:31.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:31.280 INFO:teuthology.orchestra.run.smithi205:> true 2020-11-12T17:13:31.475 INFO:teuthology.orchestra.run.smithi205:> uname -m 2020-11-12T17:13:31.524 INFO:teuthology.orchestra.run.smithi205.stdout:x86_64 2020-11-12T17:13:31.525 INFO:teuthology.orchestra.run.smithi205:> cat /etc/os-release 2020-11-12T17:13:31.571 INFO:teuthology.orchestra.run.smithi205.stdout:NAME="Ubuntu" 2020-11-12T17:13:31.572 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-12T17:13:31.572 INFO:teuthology.orchestra.run.smithi205.stdout:ID=ubuntu 2020-11-12T17:13:31.572 INFO:teuthology.orchestra.run.smithi205.stdout:ID_LIKE=debian 2020-11-12T17:13:31.572 INFO:teuthology.orchestra.run.smithi205.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-12T17:13:31.572 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION_ID="18.04" 2020-11-12T17:13:31.573 INFO:teuthology.orchestra.run.smithi205.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-12T17:13:31.573 INFO:teuthology.orchestra.run.smithi205.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-12T17:13:31.573 INFO:teuthology.orchestra.run.smithi205.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-12T17:13:31.573 INFO:teuthology.orchestra.run.smithi205.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-12T17:13:31.573 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION_CODENAME=bionic 2020-11-12T17:13:31.573 INFO:teuthology.orchestra.run.smithi205.stdout:UBUNTU_CODENAME=bionic 2020-11-12T17:13:31.574 INFO:teuthology.lock.ops:Updating smithi205.front.sepia.ceph.com on lock server 2020-11-12T17:13:31.591 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-11-12T17:13:31.626 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOY4MgcE3Uno2fwpGNu0is8BtcD9Hptvku+hEnkZ1fQw6B3UgCa9tzt6zJuSJV1prqs1p7x3oQArEIqyztjjgupeZzKQgFi9rTNfGAasBk3zH9Ont1BvYwLBFegD/thNe+vtCMciYVPTJ4FPmOpzgPqw3jnTnctdnrx7uKQNYiKsr9sYGP6x+1t+uXBIv5qOH3AFeV4HUwInrYgr4fN23eSpTJCAz13mXFAHJ9rE4q5YM4waf8Ep/p7TpLCWtUS4zEwAOZW3HElN4eoSrAQcNAGJy0cZ/iWBTKwZ7y5dtgTHiXVAZPdu+zC50WrWsCEYgPGjxwKi6mGCxGBRASAfsL smithi205.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZIjzLIHjjt+jceT1/Q66iwK0mQwlp4cD1U+dXJcqUx3VA5nJGv651fF3Mv9f2Nln1SuLEu/q36DVu2OBycIimTjyxXvhuAvDQ/8RIeSko48N+L/vxNwdWrbmVRfjiIEW3VEAmvWRrtVgnaIbNQGmdzXCHojMgVhiQs+0qqD6wFufdtaf1/iARoGaozEFIN4IyhevVT9c7w3b9CtIF97ej6Eqq8xbLfSEFxS4XlG6uu6ygEL+gLdQaQpOWPicp1PkvihowebEJxqKY6MZwqJz9teCkwTjXJb0dqUou/9N4BMnoCl2FsvoC5QxucUgWNpqaDY+NlhLu4vuTcWEzxi0Z 2020-11-12T17:13:31.627 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-12T17:13:31.690 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-12T17:13:31.697 INFO:teuthology.task.internal:Saving configuration 2020-11-12T17:13:31.718 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-12T17:13:31.748 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-12T17:13:31.775 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-12 17:08:14.221079', 'description': '/home/teuthworker/archive/yuriw-2020-11-12_17:03:16-rados-octopus-distro-basic-smithi/5616029', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE9Ag1wmeCCE0Wy6cO62zHQFjX+ngnAnsY7b30pIVkWu', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi036.front.sepia.ceph.com'} 2020-11-12T17:13:31.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-12 17:08:14.221101', 'description': '/home/teuthworker/archive/yuriw-2020-11-12_17:03:16-rados-octopus-distro-basic-smithi/5616029', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOe0KUJ+v+uVYnPzpeDnKCe+HeQ0p6W+rMfVMI7Hihfr', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi205.front.sepia.ceph.com'} 2020-11-12T17:13:31.809 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-12T17:13:31.822 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-11-12T17:13:31.822 INFO:teuthology.task.internal:roles: ubuntu@smithi205.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-11-12T17:13:31.823 INFO:teuthology.run_tasks:Running task console_log... 2020-11-12T17:13:31.950 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad27404e18>, signals=[15]) 2020-11-12T17:13:31.951 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-12T17:13:31.963 INFO:teuthology.task.internal:Opening connections... 2020-11-12T17:13:31.963 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:13:31.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:32.053 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:13:32.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:13:32.132 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-12T17:13:32.141 INFO:teuthology.orchestra.run.smithi036:> uname -m 2020-11-12T17:13:32.262 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2020-11-12T17:13:32.263 INFO:teuthology.orchestra.run.smithi036:> cat /etc/os-release 2020-11-12T17:13:32.315 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Ubuntu" 2020-11-12T17:13:32.315 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-12T17:13:32.315 INFO:teuthology.orchestra.run.smithi036.stdout:ID=ubuntu 2020-11-12T17:13:32.316 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE=debian 2020-11-12T17:13:32.316 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-12T17:13:32.316 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="18.04" 2020-11-12T17:13:32.316 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-12T17:13:32.316 INFO:teuthology.orchestra.run.smithi036.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-12T17:13:32.316 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-12T17:13:32.316 INFO:teuthology.orchestra.run.smithi036.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-12T17:13:32.316 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_CODENAME=bionic 2020-11-12T17:13:32.317 INFO:teuthology.orchestra.run.smithi036.stdout:UBUNTU_CODENAME=bionic 2020-11-12T17:13:32.317 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2020-11-12T17:13:32.333 INFO:teuthology.orchestra.run.smithi205:> uname -m 2020-11-12T17:13:32.340 INFO:teuthology.orchestra.run.smithi205.stdout:x86_64 2020-11-12T17:13:32.341 INFO:teuthology.orchestra.run.smithi205:> cat /etc/os-release 2020-11-12T17:13:32.387 INFO:teuthology.orchestra.run.smithi205.stdout:NAME="Ubuntu" 2020-11-12T17:13:32.388 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-12T17:13:32.388 INFO:teuthology.orchestra.run.smithi205.stdout:ID=ubuntu 2020-11-12T17:13:32.388 INFO:teuthology.orchestra.run.smithi205.stdout:ID_LIKE=debian 2020-11-12T17:13:32.388 INFO:teuthology.orchestra.run.smithi205.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-12T17:13:32.388 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION_ID="18.04" 2020-11-12T17:13:32.388 INFO:teuthology.orchestra.run.smithi205.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-12T17:13:32.388 INFO:teuthology.orchestra.run.smithi205.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-12T17:13:32.389 INFO:teuthology.orchestra.run.smithi205.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-12T17:13:32.389 INFO:teuthology.orchestra.run.smithi205.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-12T17:13:32.389 INFO:teuthology.orchestra.run.smithi205.stdout:VERSION_CODENAME=bionic 2020-11-12T17:13:32.389 INFO:teuthology.orchestra.run.smithi205.stdout:UBUNTU_CODENAME=bionic 2020-11-12T17:13:32.389 INFO:teuthology.lock.ops:Updating smithi205.front.sepia.ceph.com on lock server 2020-11-12T17:13:32.403 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-12T17:13:32.453 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-12T17:13:32.475 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-12T17:13:32.476 INFO:teuthology.orchestra.run.smithi036:> test '!' -e /home/ubuntu/cephtest 2020-11-12T17:13:32.480 INFO:teuthology.orchestra.run.smithi205:> test '!' -e /home/ubuntu/cephtest 2020-11-12T17:13:32.485 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-12T17:13:32.549 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-12T17:13:32.550 INFO:teuthology.orchestra.run.smithi036:> test -z $(ls -A /var/lib/ceph) 2020-11-12T17:13:32.553 INFO:teuthology.orchestra.run.smithi205:> test -z $(ls -A /var/lib/ceph) 2020-11-12T17:13:32.561 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-12T17:13:32.614 INFO:teuthology.run_tasks:Running task kernel... 2020-11-12T17:13:32.641 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2020-11-12T17:13:32.642 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-11-12T17:13:32.642 INFO:teuthology.orchestra.run.smithi036:> uname -r 2020-11-12T17:13:32.648 INFO:teuthology.orchestra.run.smithi036.stdout:4.15.0-122-generic 2020-11-12T17:13:32.649 INFO:teuthology.task.kernel:Running kernel on smithi036: 4.15.0-122-generic 2020-11-12T17:13:32.649 INFO:teuthology.orchestra.run.smithi036:> sudo apt-get clean 2020-11-12T17:13:32.789 INFO:teuthology.orchestra.run.smithi036:> sudo apt-get update 2020-11-12T17:13:33.125 INFO:teuthology.orchestra.run.smithi036.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-11-12T17:13:33.195 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-12T17:13:33.210 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-11-12T17:13:33.470 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-11-12T17:13:33.605 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [860 kB] 2020-11-12T17:13:33.739 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,155 kB] 2020-11-12T17:13:33.972 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,425 kB] 2020-11-12T17:13:34.072 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [280 kB] 2020-11-12T17:13:34.088 INFO:teuthology.orchestra.run.smithi036.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [173 kB] 2020-11-12T17:13:34.097 INFO:teuthology.orchestra.run.smithi036.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [22.7 kB] 2020-11-12T17:13:34.098 INFO:teuthology.orchestra.run.smithi036.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,088 kB] 2020-11-12T17:13:34.147 INFO:teuthology.orchestra.run.smithi036.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [966 kB] 2020-11-12T17:13:34.152 INFO:teuthology.orchestra.run.smithi036.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,752 kB] 2020-11-12T17:13:34.173 INFO:teuthology.orchestra.run.smithi036.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [243 kB] 2020-11-12T17:13:34.181 INFO:teuthology.orchestra.run.smithi036.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [13.3 kB] 2020-11-12T17:13:34.181 INFO:teuthology.orchestra.run.smithi036.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,808 B] 2020-11-12T17:13:34.182 INFO:teuthology.orchestra.run.smithi036.stdout:Get:17 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [2,996 B] 2020-11-12T17:13:34.276 INFO:teuthology.orchestra.run.smithi036.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [371 kB] 2020-11-12T17:13:34.297 INFO:teuthology.orchestra.run.smithi036.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [190 kB] 2020-11-12T17:13:34.305 INFO:teuthology.orchestra.run.smithi036.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [25.3 kB] 2020-11-12T17:13:34.305 INFO:teuthology.orchestra.run.smithi036.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,546 kB] 2020-11-12T17:13:34.350 INFO:teuthology.orchestra.run.smithi036.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,692 kB] 2020-11-12T17:13:34.402 INFO:teuthology.orchestra.run.smithi036.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [355 kB] 2020-11-12T17:13:34.408 INFO:teuthology.orchestra.run.smithi036.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [32.3 kB] 2020-11-12T17:13:34.409 INFO:teuthology.orchestra.run.smithi036.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [12.9 kB] 2020-11-12T17:13:34.409 INFO:teuthology.orchestra.run.smithi036.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,012 B] 2020-11-12T17:13:35.766 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 12.5 MB in 3s (4,638 kB/s) 2020-11-12T17:13:37.212 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2020-11-12T17:13:37.260 INFO:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-12T17:13:37.342 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2020-11-12T17:13:37.580 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2020-11-12T17:13:37.581 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2020-11-12T17:13:37.663 INFO:teuthology.orchestra.run.smithi036.stderr:E: Unable to locate package linux-image-current-generic 2020-11-12T17:13:37.664 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-12T17:13:37.665 INFO:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-12T17:13:37.745 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2020-11-12T17:13:37.994 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2020-11-12T17:13:37.995 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2020-11-12T17:13:38.179 INFO:teuthology.orchestra.run.smithi036.stdout:The following additional packages will be installed: 2020-11-12T17:13:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: linux-generic linux-headers-4.15.0-123 linux-headers-4.15.0-123-generic 2020-11-12T17:13:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: linux-headers-generic linux-image-4.15.0-123-generic 2020-11-12T17:13:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: linux-modules-4.15.0-123-generic linux-modules-extra-4.15.0-123-generic 2020-11-12T17:13:38.182 INFO:teuthology.orchestra.run.smithi036.stdout:Suggested packages: 2020-11-12T17:13:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-11-12T17:13:38.182 INFO:teuthology.orchestra.run.smithi036.stdout:Recommended packages: 2020-11-12T17:13:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: thermald 2020-11-12T17:13:38.218 INFO:teuthology.orchestra.run.smithi036.stdout:The following NEW packages will be installed: 2020-11-12T17:13:38.218 INFO:teuthology.orchestra.run.smithi036.stdout: linux-headers-4.15.0-123 linux-headers-4.15.0-123-generic 2020-11-12T17:13:38.219 INFO:teuthology.orchestra.run.smithi036.stdout: linux-image-4.15.0-123-generic linux-modules-4.15.0-123-generic 2020-11-12T17:13:38.219 INFO:teuthology.orchestra.run.smithi036.stdout: linux-modules-extra-4.15.0-123-generic 2020-11-12T17:13:38.221 INFO:teuthology.orchestra.run.smithi036.stdout:The following packages will be upgraded: 2020-11-12T17:13:38.221 INFO:teuthology.orchestra.run.smithi036.stdout: linux-generic linux-headers-generic linux-image-generic 2020-11-12T17:13:38.396 INFO:teuthology.orchestra.run.smithi036.stdout:3 upgraded, 5 newly installed, 0 to remove and 14 not upgraded. 2020-11-12T17:13:38.396 INFO:teuthology.orchestra.run.smithi036.stdout:Need to get 66.0 MB of archives. 2020-11-12T17:13:38.396 INFO:teuthology.orchestra.run.smithi036.stdout:After this operation, 333 MB of additional disk space will be used. 2020-11-12T17:13:38.396 INFO:teuthology.orchestra.run.smithi036.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-123-generic amd64 4.15.0-123.126 [13.1 MB] 2020-11-12T17:13:39.390 INFO:teuthology.orchestra.run.smithi036.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-123-generic amd64 4.15.0-123.126 [8,012 kB] 2020-11-12T17:13:39.650 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-123-generic amd64 4.15.0-123.126 [32.8 MB] 2020-11-12T17:13:40.857 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.123.110 [1,872 B] 2020-11-12T17:13:40.858 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.123.110 [2,644 B] 2020-11-12T17:13:40.859 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-123 all 4.15.0-123.126 [10.9 MB] 2020-11-12T17:13:41.168 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-123-generic amd64 4.15.0-123.126 [1,105 kB] 2020-11-12T17:13:41.199 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.123.110 [2,544 B] 2020-11-12T17:13:41.678 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 66.0 MB in 3s (22.3 MB/s) 2020-11-12T17:13:41.831 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-modules-4.15.0-123-generic. 2020-11-12T17:13:41.870 INFO:teuthology.orchestra.run.smithi036.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102071 files and directories currently installed.) 2020-11-12T17:13:41.873 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../0-linux-modules-4.15.0-123-generic_4.15.0-123.126_amd64.deb ... 2020-11-12T17:13:41.925 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-modules-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:13:43.517 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-image-4.15.0-123-generic. 2020-11-12T17:13:43.529 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../1-linux-image-4.15.0-123-generic_4.15.0-123.126_amd64.deb ... 2020-11-12T17:13:43.621 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-image-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:13:44.104 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-123-generic. 2020-11-12T17:13:44.116 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-123-generic_4.15.0-123.126_amd64.deb ... 2020-11-12T17:13:44.145 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-modules-extra-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:13:47.937 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../3-linux-generic_4.15.0.123.110_amd64.deb ... 2020-11-12T17:13:48.064 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-generic (4.15.0.123.110) over (4.15.0.122.109) ... 2020-11-12T17:13:48.381 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.123.110_amd64.deb ... 2020-11-12T17:13:48.517 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-image-generic (4.15.0.123.110) over (4.15.0.122.109) ... 2020-11-12T17:13:48.836 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-headers-4.15.0-123. 2020-11-12T17:13:48.849 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../5-linux-headers-4.15.0-123_4.15.0-123.126_all.deb ... 2020-11-12T17:13:48.878 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-headers-4.15.0-123 (4.15.0-123.126) ... 2020-11-12T17:13:54.097 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-headers-4.15.0-123-generic. 2020-11-12T17:13:54.118 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../6-linux-headers-4.15.0-123-generic_4.15.0-123.126_amd64.deb ... 2020-11-12T17:13:54.155 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-headers-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:13:57.098 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.123.110_amd64.deb ... 2020-11-12T17:13:57.222 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-headers-generic (4.15.0.123.110) over (4.15.0.122.109) ... 2020-11-12T17:13:57.551 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-modules-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:13:58.139 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-image-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:13:58.582 INFO:teuthology.orchestra.run.smithi036.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-123-generic 2020-11-12T17:13:58.582 INFO:teuthology.orchestra.run.smithi036.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-123-generic 2020-11-12T17:13:58.724 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-headers-4.15.0-123 (4.15.0-123.126) ... 2020-11-12T17:13:58.842 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-modules-extra-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:13:59.344 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-headers-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:13:59.454 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-image-generic (4.15.0.123.110) ... 2020-11-12T17:13:59.579 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-headers-generic (4.15.0.123.110) ... 2020-11-12T17:13:59.709 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-generic (4.15.0.123.110) ... 2020-11-12T17:13:59.818 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for linux-image-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:00.006 INFO:teuthology.orchestra.run.smithi036.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-11-12T17:14:00.006 INFO:teuthology.orchestra.run.smithi036.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-123-generic 2020-11-12T17:14:15.781 INFO:teuthology.orchestra.run.smithi036.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-11-12T17:14:16.260 INFO:teuthology.orchestra.run.smithi036.stdout:Sourcing file `/etc/default/grub' 2020-11-12T17:14:16.261 INFO:teuthology.orchestra.run.smithi036.stdout:Generating grub configuration file ... 2020-11-12T17:14:16.261 INFO:teuthology.orchestra.run.smithi036.stdout:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-12T17:14:16.262 INFO:teuthology.orchestra.run.smithi036.stdout:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-12T17:14:16.456 INFO:teuthology.orchestra.run.smithi036.stdout:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2020-11-12T17:14:16.486 INFO:teuthology.orchestra.run.smithi036.stdout:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2020-11-12T17:14:17.878 INFO:teuthology.orchestra.run.smithi036.stdout:done 2020-11-12T17:14:18.317 INFO:teuthology.orchestra.run.smithi036:> dpkg -s linux-image-generic 2020-11-12T17:14:18.343 INFO:teuthology.orchestra.run.smithi036.stdout:Package: linux-image-generic 2020-11-12T17:14:18.343 INFO:teuthology.orchestra.run.smithi036.stdout:Status: install ok installed 2020-11-12T17:14:18.343 INFO:teuthology.orchestra.run.smithi036.stdout:Priority: optional 2020-11-12T17:14:18.343 INFO:teuthology.orchestra.run.smithi036.stdout:Section: kernel 2020-11-12T17:14:18.344 INFO:teuthology.orchestra.run.smithi036.stdout:Installed-Size: 16 2020-11-12T17:14:18.344 INFO:teuthology.orchestra.run.smithi036.stdout:Maintainer: Ubuntu Kernel Team 2020-11-12T17:14:18.344 INFO:teuthology.orchestra.run.smithi036.stdout:Architecture: amd64 2020-11-12T17:14:18.344 INFO:teuthology.orchestra.run.smithi036.stdout:Source: linux-meta 2020-11-12T17:14:18.344 INFO:teuthology.orchestra.run.smithi036.stdout:Version: 4.15.0.123.110 2020-11-12T17:14:18.344 INFO:teuthology.orchestra.run.smithi036.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-12T17:14:18.344 INFO:teuthology.orchestra.run.smithi036.stdout:Depends: linux-image-4.15.0-123-generic, linux-modules-extra-4.15.0-123-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-12T17:14:18.345 INFO:teuthology.orchestra.run.smithi036.stdout:Recommends: thermald 2020-11-12T17:14:18.345 INFO:teuthology.orchestra.run.smithi036.stdout:Description: Generic Linux kernel image 2020-11-12T17:14:18.345 INFO:teuthology.orchestra.run.smithi036.stdout: This package will always depend on the latest generic kernel image 2020-11-12T17:14:18.345 INFO:teuthology.orchestra.run.smithi036.stdout: available. 2020-11-12T17:14:18.345 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-122-generic Expected: 4.15.0-123-generic 2020-11-12T17:14:18.346 INFO:teuthology.orchestra.run.smithi205:> uname -r 2020-11-12T17:14:18.352 INFO:teuthology.orchestra.run.smithi205.stdout:4.15.0-122-generic 2020-11-12T17:14:18.352 INFO:teuthology.task.kernel:Running kernel on smithi205: 4.15.0-122-generic 2020-11-12T17:14:18.353 INFO:teuthology.orchestra.run.smithi205:> sudo apt-get clean 2020-11-12T17:14:18.580 INFO:teuthology.orchestra.run.smithi205:> sudo apt-get update 2020-11-12T17:14:18.787 INFO:teuthology.orchestra.run.smithi205.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-11-12T17:14:18.916 INFO:teuthology.orchestra.run.smithi205.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-12T17:14:18.990 INFO:teuthology.orchestra.run.smithi205.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-11-12T17:14:19.115 INFO:teuthology.orchestra.run.smithi205.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [860 kB] 2020-11-12T17:14:19.206 INFO:teuthology.orchestra.run.smithi205.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,425 kB] 2020-11-12T17:14:19.230 INFO:teuthology.orchestra.run.smithi205.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [280 kB] 2020-11-12T17:14:19.233 INFO:teuthology.orchestra.run.smithi205.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [173 kB] 2020-11-12T17:14:19.235 INFO:teuthology.orchestra.run.smithi205.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [22.7 kB] 2020-11-12T17:14:19.242 INFO:teuthology.orchestra.run.smithi205.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [966 kB] 2020-11-12T17:14:19.247 INFO:teuthology.orchestra.run.smithi205.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,088 kB] 2020-11-12T17:14:19.260 INFO:teuthology.orchestra.run.smithi205.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [243 kB] 2020-11-12T17:14:19.264 INFO:teuthology.orchestra.run.smithi205.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [13.3 kB] 2020-11-12T17:14:19.264 INFO:teuthology.orchestra.run.smithi205.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,808 B] 2020-11-12T17:14:19.264 INFO:teuthology.orchestra.run.smithi205.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [2,996 B] 2020-11-12T17:14:19.269 INFO:teuthology.orchestra.run.smithi205.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-11-12T17:14:19.403 INFO:teuthology.orchestra.run.smithi205.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,155 kB] 2020-11-12T17:14:19.740 INFO:teuthology.orchestra.run.smithi205.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,752 kB] 2020-11-12T17:14:19.833 INFO:teuthology.orchestra.run.smithi205.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [371 kB] 2020-11-12T17:14:19.843 INFO:teuthology.orchestra.run.smithi205.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [190 kB] 2020-11-12T17:14:19.850 INFO:teuthology.orchestra.run.smithi205.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [25.3 kB] 2020-11-12T17:14:19.851 INFO:teuthology.orchestra.run.smithi205.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,546 kB] 2020-11-12T17:14:19.907 INFO:teuthology.orchestra.run.smithi205.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,692 kB] 2020-11-12T17:14:19.935 INFO:teuthology.orchestra.run.smithi205.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [355 kB] 2020-11-12T17:14:19.955 INFO:teuthology.orchestra.run.smithi205.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [12.9 kB] 2020-11-12T17:14:19.956 INFO:teuthology.orchestra.run.smithi205.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [32.3 kB] 2020-11-12T17:14:19.956 INFO:teuthology.orchestra.run.smithi205.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,012 B] 2020-11-12T17:14:20.860 INFO:teuthology.orchestra.run.smithi205.stdout:Fetched 12.5 MB in 2s (6,245 kB/s) 2020-11-12T17:14:22.232 INFO:teuthology.orchestra.run.smithi205.stdout:Reading package lists... 2020-11-12T17:14:22.280 INFO:teuthology.orchestra.run.smithi205:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-12T17:14:22.360 INFO:teuthology.orchestra.run.smithi205.stdout:Reading package lists... 2020-11-12T17:14:22.595 INFO:teuthology.orchestra.run.smithi205.stdout:Building dependency tree... 2020-11-12T17:14:22.595 INFO:teuthology.orchestra.run.smithi205.stdout:Reading state information... 2020-11-12T17:14:22.674 INFO:teuthology.orchestra.run.smithi205.stderr:E: Unable to locate package linux-image-current-generic 2020-11-12T17:14:22.675 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-12T17:14:22.675 INFO:teuthology.orchestra.run.smithi205:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-12T17:14:22.753 INFO:teuthology.orchestra.run.smithi205.stdout:Reading package lists... 2020-11-12T17:14:22.980 INFO:teuthology.orchestra.run.smithi205.stdout:Building dependency tree... 2020-11-12T17:14:22.980 INFO:teuthology.orchestra.run.smithi205.stdout:Reading state information... 2020-11-12T17:14:23.151 INFO:teuthology.orchestra.run.smithi205.stdout:The following additional packages will be installed: 2020-11-12T17:14:23.152 INFO:teuthology.orchestra.run.smithi205.stdout: linux-generic linux-headers-4.15.0-123 linux-headers-4.15.0-123-generic 2020-11-12T17:14:23.152 INFO:teuthology.orchestra.run.smithi205.stdout: linux-headers-generic linux-image-4.15.0-123-generic 2020-11-12T17:14:23.152 INFO:teuthology.orchestra.run.smithi205.stdout: linux-modules-4.15.0-123-generic linux-modules-extra-4.15.0-123-generic 2020-11-12T17:14:23.153 INFO:teuthology.orchestra.run.smithi205.stdout:Suggested packages: 2020-11-12T17:14:23.153 INFO:teuthology.orchestra.run.smithi205.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-11-12T17:14:23.154 INFO:teuthology.orchestra.run.smithi205.stdout:Recommended packages: 2020-11-12T17:14:23.154 INFO:teuthology.orchestra.run.smithi205.stdout: thermald 2020-11-12T17:14:23.185 INFO:teuthology.orchestra.run.smithi205.stdout:The following NEW packages will be installed: 2020-11-12T17:14:23.185 INFO:teuthology.orchestra.run.smithi205.stdout: linux-headers-4.15.0-123 linux-headers-4.15.0-123-generic 2020-11-12T17:14:23.185 INFO:teuthology.orchestra.run.smithi205.stdout: linux-image-4.15.0-123-generic linux-modules-4.15.0-123-generic 2020-11-12T17:14:23.186 INFO:teuthology.orchestra.run.smithi205.stdout: linux-modules-extra-4.15.0-123-generic 2020-11-12T17:14:23.187 INFO:teuthology.orchestra.run.smithi205.stdout:The following packages will be upgraded: 2020-11-12T17:14:23.187 INFO:teuthology.orchestra.run.smithi205.stdout: linux-generic linux-headers-generic linux-image-generic 2020-11-12T17:14:23.371 INFO:teuthology.orchestra.run.smithi205.stdout:3 upgraded, 5 newly installed, 0 to remove and 14 not upgraded. 2020-11-12T17:14:23.371 INFO:teuthology.orchestra.run.smithi205.stdout:Need to get 66.0 MB of archives. 2020-11-12T17:14:23.372 INFO:teuthology.orchestra.run.smithi205.stdout:After this operation, 333 MB of additional disk space will be used. 2020-11-12T17:14:23.372 INFO:teuthology.orchestra.run.smithi205.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-123-generic amd64 4.15.0-123.126 [13.1 MB] 2020-11-12T17:14:24.535 INFO:teuthology.orchestra.run.smithi205.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-123-generic amd64 4.15.0-123.126 [8,012 kB] 2020-11-12T17:14:24.816 INFO:teuthology.orchestra.run.smithi205.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-123-generic amd64 4.15.0-123.126 [32.8 MB] 2020-11-12T17:14:25.786 INFO:teuthology.orchestra.run.smithi205.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.123.110 [1,872 B] 2020-11-12T17:14:25.788 INFO:teuthology.orchestra.run.smithi205.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.123.110 [2,644 B] 2020-11-12T17:14:25.788 INFO:teuthology.orchestra.run.smithi205.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-123 all 4.15.0-123.126 [10.9 MB] 2020-11-12T17:14:26.082 INFO:teuthology.orchestra.run.smithi205.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-123-generic amd64 4.15.0-123.126 [1,105 kB] 2020-11-12T17:14:26.121 INFO:teuthology.orchestra.run.smithi205.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.123.110 [2,544 B] 2020-11-12T17:14:26.597 INFO:teuthology.orchestra.run.smithi205.stdout:Fetched 66.0 MB in 3s (22.6 MB/s) 2020-11-12T17:14:26.760 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package linux-modules-4.15.0-123-generic. 2020-11-12T17:14:26.801 INFO:teuthology.orchestra.run.smithi205.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102071 files and directories currently installed.) 2020-11-12T17:14:26.804 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../0-linux-modules-4.15.0-123-generic_4.15.0-123.126_amd64.deb ... 2020-11-12T17:14:26.863 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking linux-modules-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:28.480 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package linux-image-4.15.0-123-generic. 2020-11-12T17:14:28.492 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../1-linux-image-4.15.0-123-generic_4.15.0-123.126_amd64.deb ... 2020-11-12T17:14:28.582 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking linux-image-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:29.108 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-123-generic. 2020-11-12T17:14:29.120 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-123-generic_4.15.0-123.126_amd64.deb ... 2020-11-12T17:14:29.157 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking linux-modules-extra-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:32.803 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../3-linux-generic_4.15.0.123.110_amd64.deb ... 2020-11-12T17:14:32.916 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking linux-generic (4.15.0.123.110) over (4.15.0.122.109) ... 2020-11-12T17:14:33.211 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.123.110_amd64.deb ... 2020-11-12T17:14:33.333 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking linux-image-generic (4.15.0.123.110) over (4.15.0.122.109) ... 2020-11-12T17:14:33.645 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package linux-headers-4.15.0-123. 2020-11-12T17:14:33.658 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../5-linux-headers-4.15.0-123_4.15.0-123.126_all.deb ... 2020-11-12T17:14:33.694 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking linux-headers-4.15.0-123 (4.15.0-123.126) ... 2020-11-12T17:14:38.624 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package linux-headers-4.15.0-123-generic. 2020-11-12T17:14:38.646 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../6-linux-headers-4.15.0-123-generic_4.15.0-123.126_amd64.deb ... 2020-11-12T17:14:38.674 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking linux-headers-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:41.535 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.123.110_amd64.deb ... 2020-11-12T17:14:41.656 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking linux-headers-generic (4.15.0.123.110) over (4.15.0.122.109) ... 2020-11-12T17:14:41.982 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up linux-modules-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:42.569 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up linux-image-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:43.004 INFO:teuthology.orchestra.run.smithi205.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-123-generic 2020-11-12T17:14:43.004 INFO:teuthology.orchestra.run.smithi205.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-123-generic 2020-11-12T17:14:43.138 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up linux-headers-4.15.0-123 (4.15.0-123.126) ... 2020-11-12T17:14:43.283 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up linux-modules-extra-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:43.809 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up linux-headers-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:43.918 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up linux-image-generic (4.15.0.123.110) ... 2020-11-12T17:14:44.038 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up linux-headers-generic (4.15.0.123.110) ... 2020-11-12T17:14:44.164 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up linux-generic (4.15.0.123.110) ... 2020-11-12T17:14:44.374 INFO:teuthology.orchestra.run.smithi205.stdout:Processing triggers for linux-image-4.15.0-123-generic (4.15.0-123.126) ... 2020-11-12T17:14:44.562 INFO:teuthology.orchestra.run.smithi205.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-11-12T17:14:44.562 INFO:teuthology.orchestra.run.smithi205.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-123-generic 2020-11-12T17:14:59.580 INFO:teuthology.orchestra.run.smithi205.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-11-12T17:14:59.601 INFO:teuthology.orchestra.run.smithi205.stdout:Sourcing file `/etc/default/grub' 2020-11-12T17:14:59.616 INFO:teuthology.orchestra.run.smithi205.stdout:Generating grub configuration file ... 2020-11-12T17:15:00.015 INFO:teuthology.orchestra.run.smithi205.stdout:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-12T17:15:00.056 INFO:teuthology.orchestra.run.smithi205.stdout:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-12T17:15:00.493 INFO:teuthology.orchestra.run.smithi205.stdout:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2020-11-12T17:15:00.526 INFO:teuthology.orchestra.run.smithi205.stdout:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2020-11-12T17:15:01.949 INFO:teuthology.orchestra.run.smithi205.stdout:done 2020-11-12T17:15:02.398 INFO:teuthology.orchestra.run.smithi205:> dpkg -s linux-image-generic 2020-11-12T17:15:02.464 INFO:teuthology.orchestra.run.smithi205.stdout:Package: linux-image-generic 2020-11-12T17:15:02.465 INFO:teuthology.orchestra.run.smithi205.stdout:Status: install ok installed 2020-11-12T17:15:02.465 INFO:teuthology.orchestra.run.smithi205.stdout:Priority: optional 2020-11-12T17:15:02.465 INFO:teuthology.orchestra.run.smithi205.stdout:Section: kernel 2020-11-12T17:15:02.466 INFO:teuthology.orchestra.run.smithi205.stdout:Installed-Size: 16 2020-11-12T17:15:02.466 INFO:teuthology.orchestra.run.smithi205.stdout:Maintainer: Ubuntu Kernel Team 2020-11-12T17:15:02.466 INFO:teuthology.orchestra.run.smithi205.stdout:Architecture: amd64 2020-11-12T17:15:02.467 INFO:teuthology.orchestra.run.smithi205.stdout:Source: linux-meta 2020-11-12T17:15:02.467 INFO:teuthology.orchestra.run.smithi205.stdout:Version: 4.15.0.123.110 2020-11-12T17:15:02.467 INFO:teuthology.orchestra.run.smithi205.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-12T17:15:02.468 INFO:teuthology.orchestra.run.smithi205.stdout:Depends: linux-image-4.15.0-123-generic, linux-modules-extra-4.15.0-123-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-12T17:15:02.468 INFO:teuthology.orchestra.run.smithi205.stdout:Recommends: thermald 2020-11-12T17:15:02.468 INFO:teuthology.orchestra.run.smithi205.stdout:Description: Generic Linux kernel image 2020-11-12T17:15:02.468 INFO:teuthology.orchestra.run.smithi205.stdout: This package will always depend on the latest generic kernel image 2020-11-12T17:15:02.469 INFO:teuthology.orchestra.run.smithi205.stdout: available. 2020-11-12T17:15:02.469 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-122-generic Expected: 4.15.0-123-generic 2020-11-12T17:15:02.471 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-11-12T17:15:02.471 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-11-12T17:15:02.471 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-11-12T17:15:02.472 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-11-12T17:15:02.472 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi036.front.sepia.ceph.com, path=None, version=distro) 2020-11-12T17:15:02.473 INFO:teuthology.orchestra.run.smithi036:> sudo apt-get clean 2020-11-12T17:15:02.522 INFO:teuthology.orchestra.run.smithi036:> sudo apt-get update 2020-11-12T17:15:02.767 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-12T17:15:02.882 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-12T17:15:02.961 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-12T17:15:03.039 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-12T17:15:04.702 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2020-11-12T17:15:05.319 INFO:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-12T17:15:05.407 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2020-11-12T17:15:05.652 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2020-11-12T17:15:05.653 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2020-11-12T17:15:05.736 INFO:teuthology.orchestra.run.smithi036.stderr:E: Unable to locate package linux-image-current-generic 2020-11-12T17:15:07.783 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-12T17:15:07.784 INFO:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-12T17:15:07.876 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2020-11-12T17:15:08.142 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2020-11-12T17:15:08.143 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2020-11-12T17:15:08.364 INFO:teuthology.orchestra.run.smithi036.stdout:linux-image-generic is already the newest version (4.15.0.123.110). 2020-11-12T17:15:08.364 INFO:teuthology.orchestra.run.smithi036.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2020-11-12T17:15:08.365 INFO:teuthology.orchestra.run.smithi036:> dpkg -s linux-image-generic 2020-11-12T17:15:08.388 INFO:teuthology.orchestra.run.smithi036.stdout:Package: linux-image-generic 2020-11-12T17:15:08.389 INFO:teuthology.orchestra.run.smithi036.stdout:Status: install ok installed 2020-11-12T17:15:08.389 INFO:teuthology.orchestra.run.smithi036.stdout:Priority: optional 2020-11-12T17:15:08.389 INFO:teuthology.orchestra.run.smithi036.stdout:Section: kernel 2020-11-12T17:15:08.389 INFO:teuthology.orchestra.run.smithi036.stdout:Installed-Size: 16 2020-11-12T17:15:08.389 INFO:teuthology.orchestra.run.smithi036.stdout:Maintainer: Ubuntu Kernel Team 2020-11-12T17:15:08.390 INFO:teuthology.orchestra.run.smithi036.stdout:Architecture: amd64 2020-11-12T17:15:08.391 INFO:teuthology.orchestra.run.smithi036.stdout:Source: linux-meta 2020-11-12T17:15:08.391 INFO:teuthology.orchestra.run.smithi036.stdout:Version: 4.15.0.123.110 2020-11-12T17:15:08.391 INFO:teuthology.orchestra.run.smithi036.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-12T17:15:08.392 INFO:teuthology.orchestra.run.smithi036.stdout:Depends: linux-image-4.15.0-123-generic, linux-modules-extra-4.15.0-123-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-12T17:15:08.392 INFO:teuthology.orchestra.run.smithi036.stdout:Recommends: thermald 2020-11-12T17:15:08.393 INFO:teuthology.orchestra.run.smithi036.stdout:Description: Generic Linux kernel image 2020-11-12T17:15:08.393 INFO:teuthology.orchestra.run.smithi036.stdout: This package will always depend on the latest generic kernel image 2020-11-12T17:15:08.393 INFO:teuthology.orchestra.run.smithi036.stdout: available. 2020-11-12T17:15:08.399 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:15:08.435 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.zlXPDUHzyV 2020-11-12T17:15:08.437 INFO:teuthology.orchestra.run.smithi036:> sudo cp /boot/grub/grub.cfg /tmp/tmp.zlXPDUHzyV 2020-11-12T17:15:08.490 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.zlXPDUHzyV 2020-11-12T17:15:08.631 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.zlXPDUHzyV is 8KB 2020-11-12T17:15:08.691 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.zlXPDUHzyV 2020-11-12T17:15:08.700 INFO:teuthology.orchestra.run.smithi036:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-11-12T17:15:08.774 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-12T17:15:08.777 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-12T17:15:08.777 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-12T17:15:08.838 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-12T17:15:08.882 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-12T17:15:08.891 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-12T17:15:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:93 bytes copied, 0.0380127 s, 2.4 kB/s 2020-11-12T17:15:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-12T17:15:08.899 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-123-generic 2020-11-12T17:15:08.900 INFO:teuthology.orchestra.run.smithi036:> sudo update-grub 2020-11-12T17:15:10.108 INFO:teuthology.orchestra.run.smithi036.stderr:Sourcing file `/etc/default/grub' 2020-11-12T17:15:10.130 INFO:teuthology.orchestra.run.smithi036.stderr:Generating grub configuration file ... 2020-11-12T17:15:10.362 INFO:teuthology.orchestra.run.smithi036.stderr:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-12T17:15:10.373 INFO:teuthology.orchestra.run.smithi036.stderr:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-12T17:15:10.659 INFO:teuthology.orchestra.run.smithi036.stderr:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2020-11-12T17:15:10.672 INFO:teuthology.orchestra.run.smithi036.stderr:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2020-11-12T17:15:11.834 INFO:teuthology.orchestra.run.smithi036.stderr:done 2020-11-12T17:15:11.835 INFO:teuthology.orchestra.run.smithi036:> sudo shutdown -r now 2020-11-12T17:15:11.838 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-11-12T17:15:11.838 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi205.front.sepia.ceph.com, path=None, version=distro) 2020-11-12T17:15:11.838 INFO:teuthology.orchestra.run.smithi205:> sudo apt-get clean 2020-11-12T17:15:11.896 INFO:teuthology.orchestra.run.smithi205:> sudo apt-get update 2020-11-12T17:15:12.146 INFO:teuthology.orchestra.run.smithi205.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-12T17:15:12.147 INFO:teuthology.orchestra.run.smithi205.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-12T17:15:12.214 INFO:teuthology.orchestra.run.smithi205.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-12T17:15:12.294 INFO:teuthology.orchestra.run.smithi205.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-12T17:15:13.997 INFO:teuthology.orchestra.run.smithi205.stdout:Reading package lists... 2020-11-12T17:15:14.044 INFO:teuthology.orchestra.run.smithi205:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-12T17:15:14.171 INFO:teuthology.orchestra.run.smithi205.stdout:Reading package lists... 2020-11-12T17:15:14.407 INFO:teuthology.orchestra.run.smithi205.stdout:Building dependency tree... 2020-11-12T17:15:14.408 INFO:teuthology.orchestra.run.smithi205.stdout:Reading state information... 2020-11-12T17:15:14.487 INFO:teuthology.orchestra.run.smithi205.stderr:E: Unable to locate package linux-image-current-generic 2020-11-12T17:15:14.489 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-12T17:15:14.489 INFO:teuthology.orchestra.run.smithi205:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-12T17:15:14.567 INFO:teuthology.orchestra.run.smithi205.stdout:Reading package lists... 2020-11-12T17:15:14.807 INFO:teuthology.orchestra.run.smithi205.stdout:Building dependency tree... 2020-11-12T17:15:14.807 INFO:teuthology.orchestra.run.smithi205.stdout:Reading state information... 2020-11-12T17:15:15.004 INFO:teuthology.orchestra.run.smithi205.stdout:linux-image-generic is already the newest version (4.15.0.123.110). 2020-11-12T17:15:15.005 INFO:teuthology.orchestra.run.smithi205.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2020-11-12T17:15:15.006 INFO:teuthology.orchestra.run.smithi205:> dpkg -s linux-image-generic 2020-11-12T17:15:15.028 INFO:teuthology.orchestra.run.smithi205.stdout:Package: linux-image-generic 2020-11-12T17:15:15.028 INFO:teuthology.orchestra.run.smithi205.stdout:Status: install ok installed 2020-11-12T17:15:15.029 INFO:teuthology.orchestra.run.smithi205.stdout:Priority: optional 2020-11-12T17:15:15.029 INFO:teuthology.orchestra.run.smithi205.stdout:Section: kernel 2020-11-12T17:15:15.040 INFO:teuthology.orchestra.run.smithi205.stdout:Installed-Size: 16 2020-11-12T17:15:15.040 INFO:teuthology.orchestra.run.smithi205.stdout:Maintainer: Ubuntu Kernel Team 2020-11-12T17:15:15.040 INFO:teuthology.orchestra.run.smithi205.stdout:Architecture: amd64 2020-11-12T17:15:15.041 INFO:teuthology.orchestra.run.smithi205.stdout:Source: linux-meta 2020-11-12T17:15:15.041 INFO:teuthology.orchestra.run.smithi205.stdout:Version: 4.15.0.123.110 2020-11-12T17:15:15.041 INFO:teuthology.orchestra.run.smithi205.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-12T17:15:15.041 INFO:teuthology.orchestra.run.smithi205.stdout:Depends: linux-image-4.15.0-123-generic, linux-modules-extra-4.15.0-123-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-12T17:15:15.042 INFO:teuthology.orchestra.run.smithi205.stdout:Recommends: thermald 2020-11-12T17:15:15.042 INFO:teuthology.orchestra.run.smithi205.stdout:Description: Generic Linux kernel image 2020-11-12T17:15:15.042 INFO:teuthology.orchestra.run.smithi205.stdout: This package will always depend on the latest generic kernel image 2020-11-12T17:15:15.043 INFO:teuthology.orchestra.run.smithi205.stdout: available. 2020-11-12T17:15:15.043 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:15:15.077 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.l1FQaAQBnE 2020-11-12T17:15:15.077 INFO:teuthology.orchestra.run.smithi205:> sudo cp /boot/grub/grub.cfg /tmp/tmp.l1FQaAQBnE 2020-11-12T17:15:15.132 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.l1FQaAQBnE 2020-11-12T17:15:15.252 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.l1FQaAQBnE is 8KB 2020-11-12T17:15:15.305 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.l1FQaAQBnE 2020-11-12T17:15:15.315 INFO:teuthology.orchestra.run.smithi205:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-11-12T17:15:15.375 INFO:teuthology.orchestra.run.smithi205:> set -ex 2020-11-12T17:15:15.377 INFO:teuthology.orchestra.run.smithi205:> sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-12T17:15:15.377 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-12T17:15:15.422 INFO:teuthology.orchestra.run.smithi205.stderr:+ sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-12T17:15:15.436 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records in 2020-11-12T17:15:15.437 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records out 2020-11-12T17:15:15.437 INFO:teuthology.orchestra.run.smithi205.stderr:93 bytes copied, 3.2018e-05 s, 2.9 MB/s 2020-11-12T17:15:15.437 INFO:teuthology.orchestra.run.smithi205.stderr:+ sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-12T17:15:15.451 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-123-generic 2020-11-12T17:15:15.451 INFO:teuthology.orchestra.run.smithi205:> sudo update-grub 2020-11-12T17:15:16.786 INFO:teuthology.orchestra.run.smithi205.stderr:Sourcing file `/etc/default/grub' 2020-11-12T17:15:16.802 INFO:teuthology.orchestra.run.smithi205.stderr:Generating grub configuration file ... 2020-11-12T17:15:17.050 INFO:teuthology.orchestra.run.smithi205.stderr:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-12T17:15:17.063 INFO:teuthology.orchestra.run.smithi205.stderr:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-12T17:15:17.411 INFO:teuthology.orchestra.run.smithi205.stderr:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2020-11-12T17:15:17.424 INFO:teuthology.orchestra.run.smithi205.stderr:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2020-11-12T17:15:18.583 INFO:teuthology.orchestra.run.smithi205.stderr:done 2020-11-12T17:15:18.595 INFO:teuthology.orchestra.run.smithi205:> sudo shutdown -r now 2020-11-12T17:15:48.627 INFO:teuthology.misc:Re-opening connections... 2020-11-12T17:15:48.657 INFO:teuthology.misc:trying to connect to ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:15:48.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:15:48.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:16:48.699 DEBUG:teuthology.orchestra.remote:timed out 2020-11-12T17:16:48.745 INFO:teuthology.misc:trying to connect to ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:16:48.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:16:48.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:16:49.761 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.205 2020-11-12T17:16:49.762 DEBUG:teuthology.misc:waited 61.10432410240173 2020-11-12T17:16:50.763 INFO:teuthology.misc:trying to connect to ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:16:50.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:16:50.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:16:50.941 INFO:teuthology.orchestra.run.smithi036:> true 2020-11-12T17:16:51.349 DEBUG:teuthology.misc:waited 62.691856384277344 2020-11-12T17:16:52.351 INFO:teuthology.misc:trying to connect to ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:16:52.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:16:52.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:16:52.354 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.205 2020-11-12T17:16:52.355 DEBUG:teuthology.misc:waited 63.69740962982178 2020-11-12T17:16:53.357 INFO:teuthology.misc:trying to connect to ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:16:53.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:16:53.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:16:53.361 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.205 2020-11-12T17:16:53.361 DEBUG:teuthology.misc:waited 64.70398569107056 2020-11-12T17:16:54.370 INFO:teuthology.misc:trying to connect to ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:16:54.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:16:54.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:16:54.621 INFO:teuthology.orchestra.run.smithi205:> true 2020-11-12T17:16:56.001 DEBUG:teuthology.misc:waited 67.34401226043701 2020-11-12T17:16:57.003 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-11-12T17:16:57.003 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-123-generic"... 2020-11-12T17:16:57.004 INFO:teuthology.orchestra.run.smithi036:> uname -r 2020-11-12T17:16:57.011 INFO:teuthology.orchestra.run.smithi036.stdout:4.15.0-123-generic 2020-11-12T17:16:57.011 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-123-generic vs 4.15.0-123-generic 2020-11-12T17:16:57.012 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-11-12T17:16:57.012 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2020-11-12T17:16:57.012 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-11-12T17:16:57.013 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.15.0-123-generic"... 2020-11-12T17:16:57.013 INFO:teuthology.orchestra.run.smithi205:> uname -r 2020-11-12T17:16:57.026 INFO:teuthology.orchestra.run.smithi205.stdout:4.15.0-123-generic 2020-11-12T17:16:57.027 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-123-generic vs 4.15.0-123-generic 2020-11-12T17:16:57.028 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-11-12T17:16:57.028 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2020-11-12T17:16:58.031 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-11-12T17:16:58.034 INFO:teuthology.orchestra.run.smithi036:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-12T17:16:58.082 INFO:teuthology.orchestra.run.smithi036.stdout:ttyS1 2020-11-12T17:16:58.101 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-11-12T17:16:58.108 INFO:teuthology.orchestra.run.smithi205:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-12T17:16:58.207 INFO:teuthology.orchestra.run.smithi205.stdout:ttyS1 2020-11-12T17:16:58.235 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-12T17:16:58.259 INFO:teuthology.task.internal:Creating test directory... 2020-11-12T17:16:58.268 INFO:teuthology.orchestra.run.smithi036:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-12T17:16:58.273 INFO:teuthology.orchestra.run.smithi205:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-12T17:16:58.284 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-12T17:16:58.294 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-12T17:16:58.315 INFO:teuthology.task.internal:Creating archive directory... 2020-11-12T17:16:58.317 INFO:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-12T17:16:58.328 INFO:teuthology.orchestra.run.smithi205:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-12T17:16:58.353 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-12T17:16:58.370 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-12T17:16:58.371 INFO:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-12T17:16:58.383 INFO:teuthology.orchestra.run.smithi205:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-12T17:16:58.423 INFO:teuthology.orchestra.run.smithi205.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-12T17:16:58.423 INFO:teuthology.orchestra.run.smithi205.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-12T17:16:58.423 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-12T17:16:58.424 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-12T17:16:58.425 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-12T17:16:58.440 INFO:teuthology.task.internal:Configuring sudo... 2020-11-12T17:16:58.441 INFO:teuthology.orchestra.run.smithi036:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-12T17:16:58.471 INFO:teuthology.orchestra.run.smithi205:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-12T17:16:58.499 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-12T17:16:58.554 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-12T17:16:58.555 INFO:teuthology.orchestra.run.smithi036:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-12T17:16:58.558 INFO:teuthology.orchestra.run.smithi205:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-12T17:16:58.567 INFO:teuthology.orchestra.run.smithi036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-12T17:16:58.620 INFO:teuthology.orchestra.run.smithi036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-12T17:16:58.671 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-12T17:16:58.680 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-12T17:16:58.722 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-12T17:16:58.767 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-12T17:16:58.767 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-12T17:16:58.767 INFO:teuthology.orchestra.run.smithi036.stderr:152 bytes copied, 0.0174014 s, 8.7 kB/s 2020-11-12T17:16:58.767 INFO:teuthology.orchestra.run.smithi205:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-12T17:16:58.786 INFO:teuthology.orchestra.run.smithi205:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-12T17:16:58.839 INFO:teuthology.orchestra.run.smithi205:> set -ex 2020-11-12T17:16:58.840 INFO:teuthology.orchestra.run.smithi205:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-12T17:16:58.901 INFO:teuthology.orchestra.run.smithi205.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-12T17:16:58.931 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records in 2020-11-12T17:16:58.931 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records out 2020-11-12T17:16:58.932 INFO:teuthology.orchestra.run.smithi205.stderr:152 bytes copied, 3.1242e-05 s, 4.9 MB/s 2020-11-12T17:16:58.939 INFO:teuthology.orchestra.run.smithi036:> sudo service rsyslog restart 2020-11-12T17:16:58.949 INFO:teuthology.orchestra.run.smithi205:> sudo service rsyslog restart 2020-11-12T17:16:59.019 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-12T17:16:59.041 INFO:teuthology.task.internal:Starting timer... 2020-11-12T17:16:59.042 INFO:teuthology.run_tasks:Running task pcp... 2020-11-12T17:16:59.142 INFO:teuthology.run_tasks:Running task selinux... 2020-11-12T17:16:59.166 DEBUG:teuthology.task.selinux:Excluding smithi036: OS 'ubuntu' does not support SELinux 2020-11-12T17:16:59.168 DEBUG:teuthology.task.selinux:Excluding smithi205: OS 'ubuntu' does not support SELinux 2020-11-12T17:16:59.168 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-12T17:16:59.168 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-11-12T17:16:59.168 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-12T17:16:59.169 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-12T17:16:59.206 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-11-12T17:16:59.209 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-12T17:16:59.247 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-12T17:16:59.267 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi036.front.sepia.ceph.com,smithi205.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-12T17:16:59.735 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-12T17:17:01.414 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-12T17:17:05.055 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-12T17:17:05.116 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:05 +0000 (0:00:00.200) 0:00:00.200 ***** 2020-11-12T17:17:05.148 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:05 +0000 (0:00:00.035) 0:00:00.236 ***** 2020-11-12T17:17:07.179 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi036.front.sepia.ceph.com] 2020-11-12T17:17:07.279 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:07 +0000 (0:00:02.129) 0:00:02.365 ***** 2020-11-12T17:17:07.468 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] 2020-11-12T17:17:07.470 INFO:teuthology.task.ansible.out: 2020-11-12T17:17:07.619 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:07 +0000 (0:00:00.342) 0:00:02.707 ***** 2020-11-12T17:17:07.705 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-11-12T17:17:07.707 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-12T17:17:07.752 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:07 +0000 (0:00:00.133) 0:00:02.841 ***** 2020-11-12T17:17:07.770 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-12T17:17:07.811 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:07 +0000 (0:00:00.049) 0:00:02.890 ***** 2020-11-12T17:17:08.259 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** changed: [smithi205.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-12T17:17:08.326 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:08 +0000 (0:00:00.521) 0:00:03.411 ***** 2020-11-12T17:17:08.334 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-12T17:17:08.373 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:08 +0000 (0:00:00.049) 0:00:03.460 ***** 2020-11-12T17:17:08.681 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.070246", "end": "2020-11-12 17:17:08.652144", "rc": 0, "start": "2020-11-12 17:17:08.581898", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-11-12T17:17:08.752 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:08 +0000 (0:00:00.380) 0:00:03.840 ***** 2020-11-12T17:17:08.768 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.085949", "end": "2020-11-12 17:17:08.181201", "rc": 0, "start": "2020-11-12 17:17:08.095252", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-11-12T17:17:08.841 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:08 +0000 (0:00:00.088) 0:00:03.929 ***** 2020-11-12T17:17:09.066 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi205.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-12T17:17:09.116 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:09 +0000 (0:00:00.271) 0:00:04.201 ***** 2020-11-12T17:17:09.163 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:09 +0000 (0:00:00.045) 0:00:04.246 ***** 2020-11-12T17:17:10.157 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605201429.1969168-253595100877747/source", "state": "file", "uid": 0} 2020-11-12T17:17:10.201 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:10 +0000 (0:00:01.042) 0:00:05.289 ***** 2020-11-12T17:17:10.210 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605201429.1376944-245105252844686/source", "state": "file", "uid": 0} 2020-11-12T17:17:10.303 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:10 +0000 (0:00:00.101) 0:00:05.390 ***** 2020-11-12T17:17:10.546 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-11-12T17:17:10.548 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1 2020-11-12T17:17:10.549 INFO:teuthology.task.ansible.out:cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P 2020-11-12T17:17:10.553 INFO:teuthology.task.ansible.out:2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-12T17:17:10.702 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-12T17:17:10.710 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-12T17:17:10.870 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:10 +0000 (0:00:00.567) 0:00:05.958 ***** 2020-11-12T17:17:10.952 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:10 +0000 (0:00:00.046) 0:00:06.005 ***** 2020-11-12T17:17:11.662 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-11-12T17:17:11.664 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] 2020-11-12T17:17:11.733 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] 2020-11-12T17:17:11.796 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Thursday 12 November 2020 17:17:11 +0000 (0:00:00.879) 0:00:06.884 ***** 2020-11-12T17:17:11.905 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:11 +0000 (0:00:00.108) 0:00:06.993 ***** 2020-11-12T17:17:12.332 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi036.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.255132", "end": "2020-11-12 17:17:12.294146", "rc": 0, "start": "2020-11-12 17:17:12.039014", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-12T17:17:12.373 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.467) 0:00:07.461 ***** 2020-11-12T17:17:12.382 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.202288", "end": "2020-11-12 17:17:12.338806", "rc": 0, "start": "2020-11-12 17:17:12.136518", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-12T17:17:12.433 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.057) 0:00:07.519 ***** 2020-11-12T17:17:12.534 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014466", "end": "2020-11-12 17:17:12.500774", "failed_when_result": false, "rc": 0, "start": "2020-11-12 17:17:12.486308", "stderr": "", "stderr_lines": [], "stdout": "f76e9e239faceca753ffd443c97bd3654ebef2d1", "stdout_lines": ["f76e9e239faceca753ffd443c97bd3654ebef2d1"]} 2020-11-12T17:17:12.566 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.135) 0:00:07.654 ***** 2020-11-12T17:17:12.596 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:12.633 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.066) 0:00:07.721 ***** 2020-11-12T17:17:12.661 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-12T17:17:12.678 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:12.695 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.061) 0:00:07.783 ***** 2020-11-12T17:17:12.710 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.102023", "end": "2020-11-12 17:17:12.165808", "failed_when_result": false, "rc": 0, "start": "2020-11-12 17:17:12.063785", "stderr": "", "stderr_lines": [], "stdout": "f76e9e239faceca753ffd443c97bd3654ebef2d1", "stdout_lines": ["f76e9e239faceca753ffd443c97bd3654ebef2d1"]} 2020-11-12T17:17:12.755 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.060) 0:00:07.843 ***** 2020-11-12T17:17:12.762 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:12.800 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.044) 0:00:07.888 ***** 2020-11-12T17:17:12.807 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-12T17:17:12.809 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:12.859 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.058) 0:00:07.947 ***** 2020-11-12T17:17:12.866 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-12T17:17:12.868 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:12.904 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.045) 0:00:07.992 ***** 2020-11-12T17:17:12.912 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:12.956 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:12 +0000 (0:00:00.050) 0:00:08.043 ***** 2020-11-12T17:17:12.963 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:13.016 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:13 +0000 (0:00:00.056) 0:00:08.100 ***** 2020-11-12T17:17:13.020 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-12T17:17:13.022 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:13.060 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:13 +0000 (0:00:00.048) 0:00:08.148 ***** 2020-11-12T17:17:13.110 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:13.166 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:13 +0000 (0:00:00.105) 0:00:08.254 ***** 2020-11-12T17:17:13.195 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-12T17:17:13.243 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:13 +0000 (0:00:00.076) 0:00:08.331 ***** 2020-11-12T17:17:13.250 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:13.298 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:13 +0000 (0:00:00.049) 0:00:08.380 ***** 2020-11-12T17:17:13.431 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-11-12T17:17:13.433 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-12T17:17:13.476 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:13 +0000 (0:00:00.180) 0:00:08.561 ***** 2020-11-12T17:17:13.483 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-12T17:17:13.494 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-11-12T17:17:13.646 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-11-12T17:17:13.688 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-11-12T17:17:13.787 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-11-12T17:17:13.820 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-11-12T17:17:13.922 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-11-12T17:17:13.964 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-11-12T17:17:14.073 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-11-12T17:17:14.120 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-11-12T17:17:14.209 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-11-12T17:17:14.268 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-11-12T17:17:14.350 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-11-12T17:17:14.407 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-11-12T17:17:14.497 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-11-12T17:17:14.542 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-11-12T17:17:14.640 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-11-12T17:17:14.674 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-11-12T17:17:14.772 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-11-12T17:17:14.820 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-11-12T17:17:14.914 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-11-12T17:17:14.948 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-11-12T17:17:15.046 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-11-12T17:17:15.094 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-11-12T17:17:15.203 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-11-12T17:17:15.236 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-11-12T17:17:15.326 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-11-12T17:17:15.380 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-11-12T17:17:15.470 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-11-12T17:17:15.521 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-11-12T17:17:15.616 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-11-12T17:17:15.658 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-11-12T17:17:15.750 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-11-12T17:17:15.793 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-11-12T17:17:15.880 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-11-12T17:17:15.939 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-11-12T17:17:16.029 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-11-12T17:17:16.085 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-11-12T17:17:16.174 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-11-12T17:17:16.229 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-11-12T17:17:16.314 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-11-12T17:17:16.368 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-11-12T17:17:16.455 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-11-12T17:17:16.521 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-11-12T17:17:16.598 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-11-12T17:17:16.664 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-11-12T17:17:16.730 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-11-12T17:17:16.812 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-11-12T17:17:16.892 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-11-12T17:17:17.006 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-11-12T17:17:17.045 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-11-12T17:17:17.173 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-11-12T17:17:17.223 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-11-12T17:17:17.321 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-11-12T17:17:17.402 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-11-12T17:17:17.489 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-11-12T17:17:17.564 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-11-12T17:17:17.691 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-11-12T17:17:17.830 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-11-12T17:17:17.957 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-11-12T17:17:18.100 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-11-12T17:17:18.184 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-11-12T17:17:18.278 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-11-12T17:17:18.329 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-11-12T17:17:18.448 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-11-12T17:17:18.520 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-11-12T17:17:18.609 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-11-12T17:17:18.687 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-11-12T17:17:18.782 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-11-12T17:17:18.876 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-11-12T17:17:18.933 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-11-12T17:17:19.036 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-11-12T17:17:19.121 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-11-12T17:17:19.197 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-11-12T17:17:19.300 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-11-12T17:17:19.386 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-11-12T17:17:19.507 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-11-12T17:17:19.582 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-11-12T17:17:19.655 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-11-12T17:17:19.721 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-11-12T17:17:19.809 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-11-12T17:17:19.874 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-11-12T17:17:19.942 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-11-12T17:17:20.096 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-11-12T17:17:20.262 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-11-12T17:17:20.403 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-11-12T17:17:20.533 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-11-12T17:17:20.690 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-11-12T17:17:20.834 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-11-12T17:17:20.996 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-11-12T17:17:21.045 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-11-12T17:17:21.143 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-11-12T17:17:21.213 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-11-12T17:17:21.286 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-11-12T17:17:21.359 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-11-12T17:17:21.507 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-11-12T17:17:21.652 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-11-12T17:17:21.797 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-11-12T17:17:22.449 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-11-12T17:17:22.588 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-11-12T17:17:22.635 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-11-12T17:17:22.734 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-11-12T17:17:22.771 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-11-12T17:17:22.924 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-11-12T17:17:22.972 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-11-12T17:17:23.071 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-11-12T17:17:23.126 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-11-12T17:17:23.233 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-11-12T17:17:23.297 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-11-12T17:17:23.445 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-11-12T17:17:23.571 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-11-12T17:17:23.697 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-11-12T17:17:23.834 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-11-12T17:17:23.971 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-11-12T17:17:24.081 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-11-12T17:17:24.108 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-11-12T17:17:24.224 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-11-12T17:17:24.253 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-11-12T17:17:24.404 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-11-12T17:17:24.420 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-11-12T17:17:24.592 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-11-12T17:17:24.742 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-11-12T17:17:24.792 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-11-12T17:17:24.915 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-11-12T17:17:24.988 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-11-12T17:17:25.074 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-11-12T17:17:25.152 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-11-12T17:17:25.212 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-11-12T17:17:25.287 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-11-12T17:17:25.289 INFO:teuthology.task.ansible.out: 2020-11-12T17:17:25.354 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-11-12T17:17:25.452 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-11-12T17:17:25.487 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-11-12T17:17:25.589 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-11-12T17:17:25.657 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-11-12T17:17:25.736 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-11-12T17:17:25.786 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-11-12T17:17:25.875 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-11-12T17:17:25.943 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-11-12T17:17:26.026 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-11-12T17:17:26.082 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-11-12T17:17:26.170 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-11-12T17:17:26.235 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-11-12T17:17:26.339 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-11-12T17:17:26.468 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-11-12T17:17:26.469 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-11-12T17:17:26.600 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-11-12T17:17:26.627 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-11-12T17:17:26.777 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-11-12T17:17:26.779 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-11-12T17:17:26.911 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-11-12T17:17:26.984 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-11-12T17:17:27.073 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-11-12T17:17:27.129 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-11-12T17:17:27.217 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-11-12T17:17:27.281 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-11-12T17:17:27.369 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-11-12T17:17:27.373 INFO:teuthology.task.ansible.out: 2020-11-12T17:17:27.409 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-11-12T17:17:27.498 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-11-12T17:17:27.575 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-11-12T17:17:27.655 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-11-12T17:17:27.736 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-11-12T17:17:27.817 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-11-12T17:17:27.894 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-11-12T17:17:27.929 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-11-12T17:17:28.048 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-11-12T17:17:28.086 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-11-12T17:17:28.186 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-11-12T17:17:28.962 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-11-12T17:17:29.068 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-11-12T17:17:29.092 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-11-12T17:17:29.214 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-11-12T17:17:29.282 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-11-12T17:17:29.369 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-11-12T17:17:29.496 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-11-12T17:17:29.633 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-11-12T17:17:29.730 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-11-12T17:17:29.776 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-11-12T17:17:29.920 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-11-12T17:17:29.946 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-11-12T17:17:30.168 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-11-12T17:17:30.304 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-11-12T17:17:30.447 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-11-12T17:17:30.607 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-11-12T17:17:30.750 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-11-12T17:17:30.762 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-11-12T17:17:30.912 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-11-12T17:17:30.937 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-11-12T17:17:31.081 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-11-12T17:17:31.130 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-11-12T17:17:31.235 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-11-12T17:17:31.313 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-11-12T17:17:31.441 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-11-12T17:17:31.486 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-11-12T17:17:31.572 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-11-12T17:17:31.627 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-11-12T17:17:31.713 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-11-12T17:17:31.755 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-11-12T17:17:31.758 INFO:teuthology.task.ansible.out: 2020-11-12T17:17:31.845 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-11-12T17:17:31.921 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-11-12T17:17:31.992 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-11-12T17:17:32.082 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-11-12T17:17:32.150 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-11-12T17:17:32.235 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-11-12T17:17:32.329 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-11-12T17:17:32.394 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-11-12T17:17:32.451 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-11-12T17:17:32.575 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-11-12T17:17:32.618 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-11-12T17:17:32.717 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-11-12T17:17:32.774 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-11-12T17:17:32.863 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-11-12T17:17:32.918 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-11-12T17:17:33.022 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-11-12T17:17:33.075 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-11-12T17:17:33.213 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-11-12T17:17:33.370 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-11-12T17:17:33.414 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-11-12T17:17:33.532 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-11-12T17:17:34.920 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-11-12T17:17:35.068 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-11-12T17:17:35.196 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-11-12T17:17:35.335 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-11-12T17:17:35.491 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2020-11-12T17:17:35.523 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-11-12T17:17:35.656 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2020-11-12T17:17:35.717 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-11-12T17:17:35.727 INFO:teuthology.task.ansible.out: 2020-11-12T17:17:35.811 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2020-11-12T17:17:36.000 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-11-12T17:17:36.031 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-11-12T17:17:36.162 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2020-11-12T17:17:36.202 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-11-12T17:17:36.310 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2020-11-12T17:17:36.356 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-11-12T17:17:36.467 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2020-11-12T17:17:36.480 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-11-12T17:17:36.622 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2020-11-12T17:17:36.635 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-11-12T17:17:36.637 INFO:teuthology.task.ansible.out: 2020-11-12T17:17:36.772 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2020-11-12T17:17:36.791 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-11-12T17:17:36.939 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2020-11-12T17:17:36.949 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-11-12T17:17:37.076 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2020-11-12T17:17:37.123 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2020-11-12T17:17:37.235 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2020-11-12T17:17:37.279 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2020-11-12T17:17:37.427 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2020-11-12T17:17:37.482 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2020-11-12T17:17:37.560 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2020-11-12T17:17:37.654 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2020-11-12T17:17:37.741 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2020-11-12T17:17:37.804 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2020-11-12T17:17:37.875 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2020-11-12T17:17:37.953 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2020-11-12T17:17:38.029 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2020-11-12T17:17:38.110 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2020-11-12T17:17:38.178 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2020-11-12T17:17:38.243 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2020-11-12T17:17:38.341 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2020-11-12T17:17:38.406 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2020-11-12T17:17:38.535 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2020-11-12T17:17:38.587 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2020-11-12T17:17:38.728 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2020-11-12T17:17:38.902 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2020-11-12T17:17:39.036 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2020-11-12T17:17:39.189 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2020-11-12T17:17:39.190 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dorinda", "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "name": "dorinda", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-11-12T17:17:39.334 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2020-11-12T17:17:39.484 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2020-11-12T17:17:39.666 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2020-11-12T17:17:39.769 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-11-12T17:17:39.875 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2020-11-12T17:17:39.938 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:39 +0000 (0:00:26.465) 0:00:35.026 ***** 2020-11-12T17:17:39.994 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-12T17:17:40.065 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:40 +0000 (0:00:00.113) 0:00:35.139 ***** TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2020-11-12T17:17:40.137 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-12T17:17:40.142 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2020-11-12T17:17:40.145 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2020-11-12T17:17:40.148 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2020-11-12T17:17:40.150 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkK 2020-11-12T17:17:40.154 INFO:teuthology.task.ansible.out:ztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 2020-11-12T17:17:40.156 INFO:teuthology.task.ansible.out:HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg 2020-11-12T17:17:40.174 INFO:teuthology.task.ansible.out:e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6 2020-11-12T17:17:40.174 INFO:teuthology.task.ansible.out:d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df 2020-11-12T17:17:40.177 INFO:teuthology.task.ansible.out:79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+ 2020-11-12T17:17:40.180 INFO:teuthology.task.ansible.out:7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b 2020-11-12T17:17:40.182 INFO:teuthology.task.ansible.out:0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/ 2020-11-12T17:17:40.184 INFO:teuthology.task.ansible.out:nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelope 2020-11-12T17:17:40.189 INFO:teuthology.task.ansible.out:z", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0 2020-11-12T17:17:40.192 INFO:teuthology.task.ansible.out:dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa9 2020-11-12T17:17:40.217 INFO:teuthology.task.ansible.out:8b5771a1b90741fbfc908cad93ef09a14"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}]}, "changed": false} 2020-11-12T17:17:40.244 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:40 +0000 (0:00:00.192) 0:00:35.332 ***** 2020-11-12T17:17:40.711 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-12T17:17:40.715 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dorinda", "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "name": "dorinda", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-11-12T17:17:41.318 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2020-11-12T17:17:41.597 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:41 +0000 (0:00:01.353) 0:00:36.685 ***** 2020-11-12T17:17:41.655 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-12T17:17:41.773 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:41 +0000 (0:00:00.175) 0:00:36.861 ***** 2020-11-12T17:17:41.854 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi205.front.sepia.ceph.com -> localhost] => {"after": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "attempts": 1, "before": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "changed": false, "remote_url_changed": false} 2020-11-12T17:17:41.903 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:41 +0000 (0:00:00.129) 0:00:36.990 ***** 2020-11-12T17:17:41.916 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-12T17:17:41.920 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2020-11-12T17:17:41.924 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2020-11-12T17:17:41.932 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2020-11-12T17:17:41.936 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkK 2020-11-12T17:17:41.939 INFO:teuthology.task.ansible.out:ztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 2020-11-12T17:17:41.941 INFO:teuthology.task.ansible.out:HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg 2020-11-12T17:17:41.947 INFO:teuthology.task.ansible.out:e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6 2020-11-12T17:17:41.947 INFO:teuthology.task.ansible.out:d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df 2020-11-12T17:17:41.950 INFO:teuthology.task.ansible.out:79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+ 2020-11-12T17:17:41.954 INFO:teuthology.task.ansible.out:7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b 2020-11-12T17:17:41.957 INFO:teuthology.task.ansible.out:0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/ 2020-11-12T17:17:41.964 INFO:teuthology.task.ansible.out:nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl 2020-11-12T17:17:41.970 INFO:teuthology.task.ansible.out:", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361b 2020-11-12T17:17:41.978 INFO:teuthology.task.ansible.out:cbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "o 2020-11-12T17:17:42.003 INFO:teuthology.task.ansible.out:vpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}]}, "changed": false} 2020-11-12T17:17:42.062 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:42 +0000 (0:00:00.154) 0:00:37.145 ***** 2020-11-12T17:17:42.189 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-11-12T17:17:42.420 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-11-12T17:17:42.621 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-11-12T17:17:42.822 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-11-12T17:17:42.850 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-11-12T17:17:42.994 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-11-12T17:17:43.242 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi036.front.sepia.ceph.com -> localhost] => {"after": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "attempts": 1, "before": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "changed": false, "remote_url_changed": false} 2020-11-12T17:17:43.323 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:17:43 +0000 (0:00:01.265) 0:00:38.411 ***** 2020-11-12T17:17:43.350 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-12T17:17:43.354 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-11-12T17:17:43.363 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-11-12T17:17:43.466 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-11-12T17:17:43.556 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-11-12T17:17:43.666 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-11-12T17:17:43.772 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-11-12T17:17:43.836 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-11-12T17:17:43.870 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:43.988 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-11-12T17:17:44.086 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-11-12T17:17:44.088 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-11-12T17:17:44.201 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-11-12T17:17:44.210 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-11-12T17:17:44.335 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2020-11-12T17:17:44.339 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2020-11-12T17:17:44.402 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:44.414 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} skipping: [smi 2020-11-12T17:17:44.418 INFO:teuthology.task.ansible.out:thi205.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:44.547 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-11-12T17:17:44.601 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-11-12T17:17:44.603 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-11-12T17:17:44.720 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-11-12T17:17:44.731 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-11-12T17:17:44.797 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-11-12T17:17:44.891 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-11-12T17:17:44.993 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-11-12T17:17:45.099 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-11-12T17:17:45.168 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1s 2020-11-12T17:17:45.171 INFO:teuthology.task.ansible.out:cr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:45.289 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-11-12T17:17:45.350 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-11-12T17:17:45.355 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-11-12T17:17:45.450 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-11-12T17:17:45.529 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2020-11-12T17:17:45.532 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2020-11-12T17:17:45.610 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:45.629 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR 2020-11-12T17:17:45.632 INFO:teuthology.task.ansible.out:5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:17:45.810 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-11-12T17:17:45.831 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-11-12T17:17:46.003 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-11-12T17:17:46.011 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3 2020-11-12T17:17:46.018 INFO:teuthology.task.ansible.out:d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key 2020-11-12T17:17:46.021 INFO:teuthology.task.ansible.out:_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-11-12T17:17:46.194 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-11-12T17:17:46.242 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-11-12T17:17:46.245 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-11-12T17:17:46.367 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-11-12T17:17:46.477 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-11-12T17:17:46.566 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-11-12T17:17:46.637 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-11-12T17:17:46.741 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-11-12T17:17:46.842 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-11-12T17:17:46.845 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-11-12T17:17:46.934 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-11-12T17:17:47.012 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-11-12T17:17:47.057 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-11-12T17:17:47.166 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-11-12T17:17:47.206 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-11-12T17:17:47.208 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-11-12T17:17:47.314 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-11-12T17:17:47.386 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-11-12T17:17:47.390 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-11-12T17:17:47.490 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-11-12T17:17:47.569 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-11-12T17:17:47.638 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-11-12T17:17:47.717 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-11-12T17:17:47.784 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-11-12T17:17:47.786 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-11-12T17:17:47.855 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-11-12T17:17:47.857 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-11-12T17:17:47.948 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-11-12T17:17:48.003 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-11-12T17:17:48.074 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-11-12T17:17:48.155 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-11-12T17:17:48.220 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-11-12T17:17:48.298 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-11-12T17:17:48.418 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-11-12T17:17:48.480 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-11-12T17:17:48.585 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-11-12T17:17:48.640 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-11-12T17:17:48.730 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-11-12T17:17:48.804 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-11-12T17:17:48.809 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-11-12T17:17:48.882 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-11-12T17:17:48.967 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-11-12T17:17:49.070 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-11-12T17:17:49.124 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-11-12T17:17:49.195 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-11-12T17:17:49.273 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-11-12T17:17:49.351 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-11-12T17:17:49.354 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-11-12T17:17:49.448 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-11-12T17:17:49.581 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-11-12T17:17:49.584 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-11-12T17:17:49.633 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-11-12T17:17:49.742 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-11-12T17:17:49.842 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-11-12T17:17:49.982 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-11-12T17:17:50.110 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-11-12T17:17:50.174 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-11-12T17:17:50.286 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-11-12T17:17:50.328 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-11-12T17:17:50.335 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-11-12T17:17:50.447 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-11-12T17:17:50.490 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-11-12T17:17:50.492 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-11-12T17:17:50.493 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-11-12T17:17:50.624 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-11-12T17:17:50.630 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-11-12T17:17:50.682 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-11-12T17:17:50.772 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-11-12T17:17:50.774 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-11-12T17:17:50.838 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-11-12T17:17:50.936 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-11-12T17:17:51.032 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-11-12T17:17:51.094 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-11-12T17:17:51.151 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-11-12T17:17:51.245 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-11-12T17:17:51.305 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-11-12T17:17:51.390 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-11-12T17:17:51.393 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-11-12T17:17:51.454 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-11-12T17:17:51.456 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-11-12T17:17:51.548 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-11-12T17:17:51.564 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-11-12T17:17:51.574 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-11-12T17:17:51.629 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-11-12T17:17:51.722 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-11-12T17:17:51.814 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-11-12T17:17:51.871 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-11-12T17:17:51.983 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-11-12T17:17:51.992 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-11-12T17:17:52.020 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-11-12T17:17:52.112 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-11-12T17:17:52.195 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-11-12T17:17:52.258 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-11-12T17:17:52.346 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-11-12T17:17:52.413 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-11-12T17:17:52.415 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-11-12T17:17:52.506 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-11-12T17:17:52.508 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-11-12T17:17:52.552 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-11-12T17:17:52.660 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-11-12T17:17:52.727 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-11-12T17:17:52.827 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-11-12T17:17:52.889 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-11-12T17:17:53.018 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-11-12T17:17:53.025 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-11-12T17:17:53.079 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-11-12T17:17:53.170 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-11-12T17:17:53.224 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-11-12T17:17:53.329 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-11-12T17:17:53.365 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-11-12T17:17:53.475 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-11-12T17:17:53.478 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-11-12T17:17:53.509 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-11-12T17:17:53.640 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-11-12T17:17:53.672 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-11-12T17:17:53.775 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-11-12T17:17:53.800 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-11-12T17:17:53.949 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-11-12T17:17:54.009 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-11-12T17:17:54.080 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-11-12T17:17:54.148 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-11-12T17:17:54.309 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-11-12T17:17:54.510 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-11-12T17:17:54.582 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-11-12T17:17:54.679 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-11-12T17:17:54.776 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-11-12T17:17:54.872 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-11-12T17:17:54.919 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-11-12T17:17:55.020 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-11-12T17:17:55.063 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-11-12T17:17:55.155 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-11-12T17:17:55.234 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-11-12T17:17:55.303 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-11-12T17:17:55.390 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-11-12T17:17:55.436 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-11-12T17:17:55.536 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-11-12T17:17:55.568 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-11-12T17:17:55.682 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-11-12T17:17:55.734 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2020-11-12T17:17:55.739 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-11-12T17:17:55.831 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-11-12T17:17:55.864 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-11-12T17:17:56.007 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-11-12T17:17:56.043 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-11-12T17:17:56.052 INFO:teuthology.task.ansible.out: 2020-11-12T17:17:56.158 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-11-12T17:17:56.235 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-11-12T17:17:56.330 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-11-12T17:17:56.398 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-11-12T17:17:56.491 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-11-12T17:17:56.547 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-11-12T17:17:56.550 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-11-12T17:17:56.645 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-11-12T17:17:56.693 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-11-12T17:17:56.695 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-11-12T17:17:56.849 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-11-12T17:17:56.899 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-11-12T17:17:56.990 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-11-12T17:17:57.076 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-11-12T17:17:57.156 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2020-11-12T17:17:57.158 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-11-12T17:17:57.247 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-11-12T17:17:57.312 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-11-12T17:17:57.430 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-11-12T17:17:57.492 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-11-12T17:17:57.587 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-11-12T17:17:57.631 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-11-12T17:17:57.726 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-11-12T17:17:57.799 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-11-12T17:17:57.868 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-11-12T17:17:57.942 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-11-12T17:17:57.952 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-11-12T17:17:58.055 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2020-11-12T17:17:58.057 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-11-12T17:17:58.100 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-11-12T17:17:58.102 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-11-12T17:17:58.218 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-11-12T17:17:58.270 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-11-12T17:17:58.430 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-11-12T17:17:58.498 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-11-12T17:17:58.581 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-11-12T17:17:58.639 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-11-12T17:17:58.757 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-11-12T17:17:58.795 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-11-12T17:17:58.935 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-11-12T17:17:58.960 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-11-12T17:17:59.101 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-11-12T17:17:59.103 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-11-12T17:17:59.251 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-11-12T17:17:59.254 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-11-12T17:17:59.267 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-11-12T17:17:59.412 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-11-12T17:17:59.438 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2020-11-12T17:17:59.439 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-11-12T17:17:59.578 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-11-12T17:17:59.618 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-11-12T17:17:59.734 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-11-12T17:17:59.773 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-11-12T17:17:59.895 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-11-12T17:17:59.970 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-11-12T17:18:00.058 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-11-12T17:18:00.154 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-11-12T17:18:00.232 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-11-12T17:18:00.310 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-11-12T17:18:00.495 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-11-12T17:18:00.552 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-11-12T17:18:00.606 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-11-12T17:18:00.608 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-11-12T17:18:00.708 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-11-12T17:18:00.764 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-11-12T17:18:00.845 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-11-12T17:18:00.927 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-11-12T17:18:01.005 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-11-12T17:18:01.075 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-11-12T17:18:01.180 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-11-12T17:18:01.227 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-11-12T17:18:01.324 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-11-12T17:18:01.390 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-11-12T17:18:01.502 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-11-12T17:18:01.561 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-11-12T17:18:01.687 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-11-12T17:18:01.755 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-11-12T17:18:01.884 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-11-12T17:18:01.951 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-11-12T17:18:02.033 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-11-12T17:18:02.119 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-11-12T17:18:02.167 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-11-12T17:18:02.290 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-11-12T17:18:02.338 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2020-11-12T17:18:02.340 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-11-12T17:18:02.427 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-11-12T17:18:02.494 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-11-12T17:18:02.572 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-11-12T17:18:02.621 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-11-12T17:18:02.718 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-11-12T17:18:02.786 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-11-12T17:18:02.856 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-11-12T17:18:02.930 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2020-11-12T17:18:02.991 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-11-12T17:18:03.058 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2020-11-12T17:18:03.145 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-11-12T17:18:03.213 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2020-11-12T17:18:03.293 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-11-12T17:18:03.375 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2020-11-12T17:18:03.469 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-11-12T17:18:03.490 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2020-11-12T17:18:03.592 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2020-11-12T17:18:03.594 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-11-12T17:18:03.637 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2020-11-12T17:18:03.723 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-11-12T17:18:03.768 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2020-11-12T17:18:03.866 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-11-12T17:18:03.922 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2020-11-12T17:18:04.034 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-11-12T17:18:04.074 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2020-11-12T17:18:04.212 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2020-11-12T17:18:04.245 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2020-11-12T17:18:04.360 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2020-11-12T17:18:04.402 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCi/D/4aW9zznIgklcFOMxAIVSMDeSnlU7oIBAvHnABokWyJBC+/FEjFVFmJV/z5J7j8EYxOFl+nzVITpXRmAdote1gGVCJmO7p7tSvsb6ZcAsWFGeZuZLoByG7Bw4WQ3uM4AH10Dd3W5ET7SS4qv9BspGqGlJs+qGE8idTW3Hs17mGS6vF3/3wzCmWVDXUEcygqNDmYINgrw4MT/LzvRGDrh2lfoL7gKkHhCozAffOia5a1rbGfAiptAeOa3PzufoOhglfxdZ+R2Ox485a6ez0y5Nc8cjO2AR3kNVgsjna3ehrsuHmWKi+yB06C+x7gwgFqfwsbo4eIWlIb0a0s3wz dorindabassey@gmail.com", "key_options": null, "keyfile": "/home/dorinda/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dorinda", "validate_certs": true} 2020-11-12T17:18:04.524 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2020-11-12T17:18:04.558 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2020-11-12T17:18:04.681 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:04 +0000 (0:00:21.351) 0:00:59.762 ***** 2020-11-12T17:18:04.695 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2020-11-12T17:18:04.759 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:04.836 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166a 2020-11-12T17:18:04.838 INFO:teuthology.task.ansible.out:f59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: 2020-11-12T17:18:04.841 INFO:teuthology.task.ansible.out: [smithi205.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:04.846 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2020-11-12T17:18:04.856 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.006 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2020-11-12T17:18:05.010 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-11-12T17:18:05.036 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.045 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.146 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2020-11-12T17:18:05.194 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-11-12T17:18:05.322 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2020-11-12T17:18:05.341 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi205.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-11-12T17:18:05.352 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.394 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.396 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.419 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.421 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.455 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-12T17:18:05.457 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2020-11-12T17:18:05.469 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-12T17:18:05.471 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.481 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.500 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.534 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.538 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.562 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.571 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.590 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.597 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.610 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2020-11-12T17:18:05.640 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.643 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.679 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.695 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.740 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.766 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.777 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.795 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCi/D/4aW9zznIgklcFOMxAIVSMDeSnlU7oIBAvHnABokWyJBC+/FEjFVFmJV/z5J7j8EYxOFl+nzVITpXRmAdote1gGVCJmO7p7tSvsb6ZcAsWFGeZuZLoByG7Bw4WQ3uM4AH10Dd3W5ET7SS4qv9BspGqGlJs+qGE8idTW3Hs17mGS6vF3/3wzCmWVDXUEcygqNDmYINgrw4MT/LzvRGDrh2lfoL7gKkHhCozAffOia5a1rbGfAiptAeOa3PzufoOhglfxdZ+R2Ox485a6ez0y5Nc8cjO2AR3kNVgsjna3ehrsuHmWKi+yB06C+x7gwgFqfwsbo4eIWlIb0a0s3wz dorindabassey@gmail.com", "key_options": null, "keyfile": "/home/dorinda/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dorinda", "validate_certs": true} 2020-11-12T17:18:05.810 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.820 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.832 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.843 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.862 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.883 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.908 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.927 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.949 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.956 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.971 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:05.982 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2020-11-12T17:18:06.082 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.084 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.100 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.154 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:06 +0000 (0:00:01.450) 0:01:01.213 ***** skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f930 2020-11-12T17:18:06.157 INFO:teuthology.task.ansible.out:5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.163 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.171 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.207 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (i 2020-11-12T17:18:06.209 INFO:teuthology.task.ansible.out:tem={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.228 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.234 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.247 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/ 2020-11-12T17:18:06.254 INFO:teuthology.task.ansible.out:1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, 2020-11-12T17:18:06.259 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.268 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "c 2020-11-12T17:18:06.276 INFO:teuthology.task.ansible.out:hanged": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.284 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.297 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.320 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.334 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.343 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.353 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.365 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.383 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.391 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.403 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.416 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.432 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.449 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c 2020-11-12T17:18:06.452 INFO:teuthology.task.ansible.out:4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.463 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.476 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.498 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.512 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.516 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.527 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.538 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.545 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.583 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.600 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.620 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.634 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1Pq 2020-11-12T17:18:06.640 INFO:teuthology.task.ansible.out:A5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-11-12T17:18:06.659 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.668 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.671 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.710 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.718 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.738 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.749 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.761 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.770 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.772 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.790 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", " 2020-11-12T17:18:06.794 INFO:teuthology.task.ansible.out:ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-11-12T17:18:06.800 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.814 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.826 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.850 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95z 2020-11-12T17:18:06.934 INFO:teuthology.task.ansible.out:uBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec 2020-11-12T17:18:06.937 INFO:teuthology.task.ansible.out:3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} Thursday 12 November 2020 17:18:06 +0000 (0:00:00.803) 0:01:02.017 ***** 2020-11-12T17:18:06.942 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyu 2020-11-12T17:18:06.944 INFO:teuthology.task.ansible.out:riw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9 2020-11-12T17:18:06.946 INFO:teuthology.task.ansible.out:+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.956 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:06.963 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.003 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:06 +0000 (0:00:00.073) 0:01:02.090 ***** 2020-11-12T17:18:07.015 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee0 2020-11-12T17:18:07.022 INFO:teuthology.task.ansible.out:41dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.042 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.088 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.090 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.122 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.127 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.144 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.155 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.167 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.178 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.191 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.194 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.224 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.238 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.240 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi205.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.252 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.263 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.287 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.289 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.299 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.314 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.350 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi205.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": 2020-11-12T17:18:07.354 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-12T17:18:07.421 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.423 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.425 INFO:teuthology.task.ansible.out: skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.427 INFO:teuthology.task.ansible.out: skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.429 INFO:teuthology.task.ansible.out: skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.443 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.467 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.478 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.486 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-12T17:18:07.490 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-11-12T17:18:07.497 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-12T17:18:07.500 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.511 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.533 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.546 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.558 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.581 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.591 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.606 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.619 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.621 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi205.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-11-12T17:18:07.631 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-12T17:18:07.633 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.633 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.645 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.656 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.669 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.679 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.683 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.698 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.706 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.717 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.719 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.737 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.743 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.755 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.782 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.798 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi205.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-11-12T17:18:07.805 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.821 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.830 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.846 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.855 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.867 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.872 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.897 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.905 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.908 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.934 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.945 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi205.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-11-12T17:18:07.957 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.967 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.981 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:07.995 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:08.006 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:08.018 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:08.098 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:08 +0000 (0:00:01.089) 0:01:03.180 ***** 2020-11-12T17:18:08.107 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-12T17:18:08.110 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-11-12T17:18:08.148 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:08.185 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:08 +0000 (0:00:00.091) 0:01:03.271 ***** 2020-11-12T17:18:08.208 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-12T17:18:08.210 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-11-12T17:18:08.348 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2020-11-12T17:18:08.372 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-11-12T17:18:08.482 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-11-12T17:18:08.517 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-11-12T17:18:08.615 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-11-12T17:18:08.637 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-11-12T17:18:08.740 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-11-12T17:18:08.784 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-11-12T17:18:08.882 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-11-12T17:18:08.916 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-11-12T17:18:09.012 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-11-12T17:18:09.050 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-11-12T17:18:09.155 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-11-12T17:18:09.169 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-11-12T17:18:09.296 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-11-12T17:18:09.318 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-11-12T17:18:09.443 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-11-12T17:18:09.465 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2020-11-12T17:18:09.578 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-11-12T17:18:09.589 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-11-12T17:18:09.726 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-11-12T17:18:09.738 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-11-12T17:18:09.857 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-11-12T17:18:09.890 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-11-12T17:18:09.990 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-11-12T17:18:10.038 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-11-12T17:18:10.043 INFO:teuthology.task.ansible.out: 2020-11-12T17:18:10.162 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-11-12T17:18:10.190 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-11-12T17:18:10.308 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-11-12T17:18:10.332 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-11-12T17:18:10.466 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-11-12T17:18:10.499 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-11-12T17:18:10.625 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-11-12T17:18:10.671 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-11-12T17:18:10.775 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-11-12T17:18:10.828 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-11-12T17:18:10.927 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-11-12T17:18:10.993 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-11-12T17:18:11.039 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-11-12T17:18:11.119 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-11-12T17:18:11.182 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-11-12T17:18:11.270 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-11-12T17:18:11.330 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-11-12T17:18:11.431 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-11-12T17:18:11.474 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-11-12T17:18:11.568 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-11-12T17:18:11.615 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-11-12T17:18:11.677 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-11-12T17:18:11.753 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-11-12T17:18:11.810 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-11-12T17:18:11.882 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-11-12T17:18:11.935 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-11-12T17:18:12.008 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-11-12T17:18:12.083 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-11-12T17:18:12.145 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-11-12T17:18:12.218 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-11-12T17:18:12.272 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2020-11-12T17:18:12.339 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-11-12T17:18:12.421 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-11-12T17:18:12.478 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-11-12T17:18:12.576 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-11-12T17:18:12.613 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-11-12T17:18:12.710 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-11-12T17:18:12.757 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-11-12T17:18:12.854 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-11-12T17:18:12.879 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-11-12T17:18:12.983 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-11-12T17:18:13.033 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-11-12T17:18:13.114 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-11-12T17:18:13.194 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-11-12T17:18:13.260 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-11-12T17:18:13.326 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-11-12T17:18:13.402 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-11-12T17:18:13.465 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2020-11-12T17:18:13.532 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2020-11-12T17:18:13.605 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-11-12T17:18:13.670 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2020-11-12T17:18:13.738 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:13 +0000 (0:00:05.550) 0:01:08.822 ***** 2020-11-12T17:18:13.753 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-11-12T17:18:13.909 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-11-12T17:18:14.062 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-11-12T17:18:14.212 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-11-12T17:18:14.275 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "7058a4a5caaffbbf4cc3cd1573412c26", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605201493.7596989-161492312501312/source", "state": "file", "uid": 0} 2020-11-12T17:18:14.317 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:14 +0000 (0:00:00.582) 0:01:09.405 ***** 2020-11-12T17:18:14.346 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-12T17:18:14.348 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => { "msg": "Host smithi205.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-11-12T17:18:14.390 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:14 +0000 (0:00:00.073) 0:01:09.478 ***** 2020-11-12T17:18:14.402 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi036.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-11-12T17:18:14.439 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi205.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-11-12T17:18:14.476 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:14 +0000 (0:00:00.084) 0:01:09.562 ***** 2020-11-12T17:18:14.508 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:14.554 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:14 +0000 (0:00:00.078) 0:01:09.641 ***** 2020-11-12T17:18:14.562 INFO:teuthology.task.ansible.out: 2020-11-12T17:18:14.564 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** 2020-11-12T17:18:14.564 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-11-12T17:18:14.579 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:14.616 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:14 +0000 (0:00:00.063) 0:01:09.704 ***** 2020-11-12T17:18:14.646 INFO:teuthology.task.ansible.out: 2020-11-12T17:18:14.650 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** ok: [smithi036.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:14.697 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:14 +0000 (0:00:00.080) 0:01:09.785 ***** 2020-11-12T17:18:14.728 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-12T17:18:14.733 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:14.774 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:14 +0000 (0:00:00.075) 0:01:09.861 ***** 2020-11-12T17:18:14.793 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi036.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2020-11-12T17:18:14.851 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:14.887 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:14 +0000 (0:00:00.114) 0:01:09.975 ***** 2020-11-12T17:18:14.931 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-12T17:18:14.937 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:14.983 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:14 +0000 (0:00:00.090) 0:01:10.066 ***** 2020-11-12T17:18:14.992 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-12T17:18:15.000 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2020-11-12T17:18:15.024 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:15.057 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.078) 0:01:10.144 ***** 2020-11-12T17:18:15.091 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.033) 0:01:10.178 ***** 2020-11-12T17:18:15.128 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-12T17:18:15.131 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:15.164 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.074) 0:01:10.252 ***** 2020-11-12T17:18:15.214 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-12T17:18:15.216 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi205.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:15.269 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.104) 0:01:10.357 ***** 2020-11-12T17:18:15.324 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:15.363 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.094) 0:01:10.451 ***** 2020-11-12T17:18:15.401 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:15.435 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.072) 0:01:10.523 ***** 2020-11-12T17:18:15.481 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi205.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:15.529 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.093) 0:01:10.617 ***** 2020-11-12T17:18:15.536 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-12T17:18:15.538 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "7058a4a5caaffbbf4cc3cd1573412c26", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605201495.0811527-37349936822006/source", "state": "file", "uid": 0} 2020-11-12T17:18:15.575 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.045) 0:01:10.663 ***** 2020-11-12T17:18:15.583 INFO:teuthology.task.ansible.out: 2020-11-12T17:18:15.585 INFO:teuthology.task.ansible.out:TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:15.634 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.059) 0:01:10.723 ***** 2020-11-12T17:18:15.643 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-12T17:18:15.645 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => { "msg": "Host smithi036.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-11-12T17:18:15.683 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.047) 0:01:10.770 ***** 2020-11-12T17:18:15.693 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi205.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:15.742 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.057) 0:01:10.828 ***** 2020-11-12T17:18:15.756 INFO:teuthology.task.ansible.out: 2020-11-12T17:18:15.767 INFO:teuthology.task.ansible.out:TASK [common : Including major version specific variables.] ******************** ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-11-12T17:18:15.807 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.066) 0:01:10.895 ***** 2020-11-12T17:18:15.830 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:15.862 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.054) 0:01:10.950 ***** 2020-11-12T17:18:15.870 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-12T17:18:15.872 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:15.913 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.051) 0:01:11.001 ***** 2020-11-12T17:18:15.926 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:15.965 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:15 +0000 (0:00:00.051) 0:01:11.053 ***** 2020-11-12T17:18:15.974 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-12T17:18:15.976 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.012 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.047) 0:01:11.100 ***** 2020-11-12T17:18:16.019 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-12T17:18:16.021 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.065 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.052) 0:01:11.152 ***** 2020-11-12T17:18:16.073 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.112 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.046) 0:01:11.199 ***** 2020-11-12T17:18:16.135 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.173 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.062) 0:01:11.261 ***** 2020-11-12T17:18:16.183 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.228 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.050) 0:01:11.311 ***** 2020-11-12T17:18:16.233 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi205.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:16.276 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.053) 0:01:11.364 ***** 2020-11-12T17:18:16.284 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.331 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.054) 0:01:11.419 ***** 2020-11-12T17:18:16.417 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 12 November 2020 17:18:16 +0000 (0:00:00.048) 0:01:11.467 ***** TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.427 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.047) 0:01:11.515 ***** 2020-11-12T17:18:16.437 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-12T17:18:16.482 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 12 November 2020 17:18:16 +0000 (0:00:00.048) 0:01:11.563 ***** TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.534 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.055) 0:01:11.619 ***** 2020-11-12T17:18:16.548 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.598 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.064) 0:01:11.683 ***** 2020-11-12T17:18:16.606 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.647 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.051) 0:01:11.734 ***** 2020-11-12T17:18:16.657 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.714 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.062) 0:01:11.797 ***** 2020-11-12T17:18:16.727 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-12T17:18:16.732 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:16.783 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.070) 0:01:11.868 ***** 2020-11-12T17:18:16.788 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.839 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.059) 0:01:11.927 ***** 2020-11-12T17:18:16.858 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.904 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.064) 0:01:11.991 ***** 2020-11-12T17:18:16.911 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:16.954 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:16 +0000 (0:00:00.051) 0:01:12.043 ***** 2020-11-12T17:18:16.967 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.015 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.060) 0:01:12.103 ***** 2020-11-12T17:18:17.023 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-12T17:18:17.026 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:17.080 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.064) 0:01:12.168 ***** 2020-11-12T17:18:17.104 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:17.148 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.055) 0:01:12.224 ***** 2020-11-12T17:18:17.153 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.194 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.053) 0:01:12.278 ***** 2020-11-12T17:18:17.198 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.242 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.052) 0:01:12.330 ***** 2020-11-12T17:18:17.249 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-12T17:18:17.251 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.299 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.055) 0:01:12.385 ***** 2020-11-12T17:18:17.306 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:17.343 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.045) 0:01:12.431 ***** 2020-11-12T17:18:17.364 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-12T17:18:17.367 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.412 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.067) 0:01:12.499 ***** 2020-11-12T17:18:17.421 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-12T17:18:17.422 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.473 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.062) 0:01:12.561 ***** 2020-11-12T17:18:17.481 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-12T17:18:17.483 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.520 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.047) 0:01:12.608 ***** 2020-11-12T17:18:17.531 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.567 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.046) 0:01:12.655 ***** 2020-11-12T17:18:17.576 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi205.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.614 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.045) 0:01:12.701 ***** 2020-11-12T17:18:17.620 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-12T17:18:17.622 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.671 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.058) 0:01:12.759 ***** 2020-11-12T17:18:17.680 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.725 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.054) 0:01:12.814 ***** 2020-11-12T17:18:17.734 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-12T17:18:17.740 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.771 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.045) 0:01:12.859 ***** 2020-11-12T17:18:17.812 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-12T17:18:17.814 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:17.847 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.075) 0:01:12.935 ***** 2020-11-12T17:18:17.885 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.921 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.073) 0:01:13.008 ***** 2020-11-12T17:18:17.953 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:17.988 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:17 +0000 (0:00:00.067) 0:01:13.076 ***** 2020-11-12T17:18:18.016 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-12T17:18:18.018 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.051 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.062) 0:01:13.138 ***** 2020-11-12T17:18:18.082 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-12T17:18:18.084 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.196778", "end": "2020-11-12 17:18:17.603878", "rc": 0, "start": "2020-11-12 17:18:17.407100", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.120 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.070) 0:01:13.208 ***** 2020-11-12T17:18:18.162 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.039) 0:01:13.248 ***** 2020-11-12T17:18:18.167 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-12T17:18:18.170 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.212 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.050) 0:01:13.298 ***** 2020-11-12T17:18:18.219 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-12T17:18:18.220 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.260 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.049) 0:01:13.348 ***** 2020-11-12T17:18:18.267 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-12T17:18:18.269 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.313 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.052) 0:01:13.401 ***** 2020-11-12T17:18:18.320 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-12T17:18:18.322 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.362 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.049) 0:01:13.450 ***** 2020-11-12T17:18:18.370 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:18.405 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.043) 0:01:13.493 ***** 2020-11-12T17:18:18.415 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.458 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.052) 0:01:13.546 ***** 2020-11-12T17:18:18.470 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.521 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.063) 0:01:13.609 ***** 2020-11-12T17:18:18.536 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.584 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.061) 0:01:13.671 ***** 2020-11-12T17:18:18.595 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.642 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.058) 0:01:13.730 ***** 2020-11-12T17:18:18.655 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.702 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.055) 0:01:13.786 ***** 2020-11-12T17:18:18.706 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-12T17:18:18.709 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.748 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.049) 0:01:13.836 ***** 2020-11-12T17:18:18.755 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-12T17:18:18.757 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.815 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.063) 0:01:13.899 ***** 2020-11-12T17:18:18.822 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.823 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.886 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.068) 0:01:13.968 ***** 2020-11-12T17:18:18.902 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:18.950 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:18 +0000 (0:00:00.067) 0:01:14.035 ***** 2020-11-12T17:18:18.959 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi036.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:19.008 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.060) 0:01:14.096 ***** 2020-11-12T17:18:19.051 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:19.090 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.082) 0:01:14.178 ***** 2020-11-12T17:18:19.279 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-12T17:18:19.281 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.042775", "end": "2020-11-12 17:18:19.255115", "rc": 0, "start": "2020-11-12 17:18:19.212340", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-12T17:18:19.323 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.232) 0:01:14.411 ***** 2020-11-12T17:18:19.361 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:19.410 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.086) 0:01:14.497 ***** 2020-11-12T17:18:19.439 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-12T17:18:19.441 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:19.482 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.072) 0:01:14.569 ***** 2020-11-12T17:18:19.515 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:19.549 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.065) 0:01:14.635 ***** 2020-11-12T17:18:19.588 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:19.625 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.077) 0:01:14.713 ***** 2020-11-12T17:18:19.659 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-12T17:18:19.665 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:19.708 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.082) 0:01:14.795 ***** 2020-11-12T17:18:19.744 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:19.779 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.071) 0:01:14.867 ***** 2020-11-12T17:18:19.820 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:19.867 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:19 +0000 (0:00:00.077) 0:01:14.945 ***** 2020-11-12T17:18:19.975 INFO:teuthology.task.ansible.out: 2020-11-12T17:18:19.976 INFO:teuthology.task.ansible.out:TASK [common : Set the hardware clock] ***************************************** changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.889097", "end": "2020-11-12 17:18:19.500382", "rc": 0, "start": "2020-11-12 17:18:18.611285", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:18:20.017 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:20 +0000 (0:00:00.158) 0:01:15.104 ***** 2020-11-12T17:18:20.046 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-12T17:18:20.048 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:20.086 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:20 +0000 (0:00:00.069) 0:01:15.174 ***** 2020-11-12T17:18:20.271 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.041764", "end": "2020-11-12 17:18:19.798808", "rc": 0, "start": "2020-11-12 17:18:19.757044", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:18:20.310 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:20 +0000 (0:00:00.222) 0:01:15.397 ***** 2020-11-12T17:18:20.539 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.527801", "end": "2020-11-12 17:18:20.500406", "rc": 0, "start": "2020-11-12 17:18:19.972605", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:18:20.582 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:20 +0000 (0:00:00.269) 0:01:15.666 ***** 2020-11-12T17:18:20.634 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:20.671 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:20 +0000 (0:00:00.092) 0:01:15.759 ***** 2020-11-12T17:18:20.852 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-12T17:18:20.855 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.042391", "end": "2020-11-12 17:18:20.826926", "rc": 0, "start": "2020-11-12 17:18:20.784535", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:18:20.900 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:20 +0000 (0:00:00.229) 0:01:15.988 ***** 2020-11-12T17:18:24.144 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-12T17:18:24.146 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:18:24.182 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:24 +0000 (0:00:03.281) 0:01:19.270 ***** 2020-11-12T17:18:24.573 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:18:24.609 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:24 +0000 (0:00:00.426) 0:01:19.697 ***** 2020-11-12T17:18:25.042 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:18:25.093 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:25 +0000 (0:00:00.484) 0:01:20.181 ***** 2020-11-12T17:18:25.124 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-12T17:18:25.126 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:25.170 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:25 +0000 (0:00:00.076) 0:01:20.258 ***** 2020-11-12T17:18:25.516 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:18:25.564 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:25 +0000 (0:00:00.394) 0:01:20.653 ***** 2020-11-12T17:18:25.594 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:25.632 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:25 +0000 (0:00:00.067) 0:01:20.720 ***** 2020-11-12T17:18:25.814 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-12T17:18:25.816 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-11-12T17:18:25.852 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:25 +0000 (0:00:00.220) 0:01:20.940 ***** 2020-11-12T17:18:25.965 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-11-12T17:18:26.005 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:25 +0000 (0:00:00.147) 0:01:21.087 ***** 2020-11-12T17:18:26.683 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-12T17:18:26.685 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:18:26.720 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:26 +0000 (0:00:00.720) 0:01:21.808 ***** 2020-11-12T17:18:26.875 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:18:26.912 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:26 +0000 (0:00:00.191) 0:01:22.000 ***** 2020-11-12T17:18:27.101 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-12T17:18:27.103 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-11-12T17:18:27.277 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-11-12T17:18:27.402 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-11-12T17:18:27.607 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-11-12T17:18:27.695 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-11-12T17:18:27.734 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:27 +0000 (0:00:00.821) 0:01:22.822 ***** 2020-11-12T17:18:27.860 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-12T17:18:27.861 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-11-12T17:18:27.898 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:27 +0000 (0:00:00.163) 0:01:22.986 ***** 2020-11-12T17:18:27.905 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-12T17:18:27.907 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-11-12T17:18:27.955 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:27 +0000 (0:00:00.057) 0:01:23.043 ***** 2020-11-12T17:18:28.100 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-12T17:18:28.102 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-11-12T17:18:28.159 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:28 +0000 (0:00:00.203) 0:01:23.247 ***** 2020-11-12T17:18:28.230 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-12T17:18:28.232 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-11-12T17:18:28.495 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-11-12T17:18:28.539 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-11-12T17:18:28.797 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-11-12T17:18:28.831 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-11-12T17:18:28.873 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:28 +0000 (0:00:00.714) 0:01:23.961 ***** 2020-11-12T17:18:28.915 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-12T17:18:28.916 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-11-12T17:18:28.951 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:28 +0000 (0:00:00.077) 0:01:24.039 ***** 2020-11-12T17:18:28.980 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-12T17:18:28.983 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.021 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.069) 0:01:24.109 ***** 2020-11-12T17:18:29.050 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-12T17:18:29.052 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:29.101 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.079) 0:01:24.189 ***** 2020-11-12T17:18:29.109 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-12T17:18:29.112 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-11-12T17:18:29.153 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.051) 0:01:24.241 ***** 2020-11-12T17:18:29.162 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-12T17:18:29.164 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.176 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.178 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.213 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.060) 0:01:24.301 ***** 2020-11-12T17:18:29.220 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-12T17:18:29.223 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-11-12T17:18:29.259 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.045) 0:01:24.347 ***** 2020-11-12T17:18:29.268 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.304 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.044) 0:01:24.392 ***** 2020-11-12T17:18:29.311 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-12T17:18:29.314 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.348 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.044) 0:01:24.436 ***** 2020-11-12T17:18:29.382 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-12T17:18:29.384 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:29.420 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.071) 0:01:24.508 ***** 2020-11-12T17:18:29.460 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.474 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.485 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.497 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.532 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.112) 0:01:24.620 ***** 2020-11-12T17:18:29.574 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-12T17:18:29.575 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:29.623 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:29 +0000 (0:00:00.090) 0:01:24.711 ***** 2020-11-12T17:18:30.224 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-12T17:18:30.226 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:18:30.260 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:30 +0000 (0:00:00.637) 0:01:25.348 ***** 2020-11-12T17:18:30.544 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:18:30.594 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:30 +0000 (0:00:00.333) 0:01:25.681 ***** 2020-11-12T17:18:30.604 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-12T17:18:30.606 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-11-12T17:18:30.646 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:30 +0000 (0:00:00.052) 0:01:25.734 ***** 2020-11-12T17:18:30.931 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-11-12T17:18:30.973 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:30 +0000 (0:00:00.326) 0:01:26.061 ***** 2020-11-12T17:18:30.982 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-12T17:18:30.984 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-11-12T17:18:31.029 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.055) 0:01:26.117 ***** 2020-11-12T17:18:31.165 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-12T17:18:31.167 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-11-12T17:18:31.285 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-11-12T17:18:31.331 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.302) 0:01:26.419 ***** 2020-11-12T17:18:31.339 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-12T17:18:31.341 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-11-12T17:18:31.376 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.045) 0:01:26.464 ***** 2020-11-12T17:18:31.385 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:31.427 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.050) 0:01:26.515 ***** 2020-11-12T17:18:31.457 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-12T17:18:31.459 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:31.499 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.072) 0:01:26.587 ***** 2020-11-12T17:18:31.548 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-12T17:18:31.549 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-11-12T17:18:31.559 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-12T17:18:31.561 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:31.609 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.109) 0:01:26.697 ***** 2020-11-12T17:18:31.674 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-12T17:18:31.699 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-11-12T17:18:31.732 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.122) 0:01:26.820 ***** 2020-11-12T17:18:31.777 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-12T17:18:31.781 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:31.828 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.096) 0:01:26.916 ***** 2020-11-12T17:18:31.871 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-12T17:18:31.919 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.090) 0:01:27.007 ***** 2020-11-12T17:18:31.960 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-12T17:18:31.962 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:31.999 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:31 +0000 (0:00:00.079) 0:01:27.087 ***** 2020-11-12T17:18:32.006 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-12T17:18:32.008 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-11-12T17:18:32.048 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:32 +0000 (0:00:00.049) 0:01:27.136 ***** 2020-11-12T17:18:32.378 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-11-12T17:18:32.416 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:32 +0000 (0:00:00.368) 0:01:27.505 ***** 2020-11-12T17:18:32.752 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-12T17:18:32.762 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-11-12 17:16:41 UTC", "ActiveEnterTimestampMonotonic": "20371387", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target systemd-journald.socket system.slice var-run.mount remote-fs.target basic.target systemd-tmpfiles-setup.service sysinit.target network.target local-fs.target time-sync.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-11-12 17:16:41 UTC", "AssertTimestampMonotonic": "20370748", "Before": "plymouth-quit.service getty@tty1.service shutdown.target multi-user.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-11-12 17:16:41 UTC", "ConditionTimestampMonotonic": "20370748", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-11-12T17:18:32.764 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1243", "ExecMainStartTimestamp": "Thu 2020-11-12 17:16:41 UTC", "ExecMainStartTimestampMonotonic": "20371363", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2020-11-12 17:16:41 UTC] ; stop_time=[n/a] ; pid=1243 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-11-12 17:16:41 UTC", "InactiveExitTimestampMonotonic": "20371387", "InvocationID": "5d81a75f9b3c42eb98265d1334bf983c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-11-12T17:18:32.765 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1243", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-11-12T17:18:32.767 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-11-12 17:16:41 UTC", "StateChangeTimestampMonotonic": "20371387", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-11-12 17:16:41 UTC", "WatchdogTimestampMonotonic": "20371386", "WatchdogUSec": "0"}} ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-11-12 17:16:53 UTC", "ActiveEnterTimestampMonotonic": "18007441", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket systemd-tmpfiles-setup.service local-fs.target basic.target sysinit.target remote-fs.target system.slice -.mount networ 2020-11-12T17:18:32.769 INFO:teuthology.task.ansible.out:k.target nss-lookup.target var-run.mount time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-11-12 17:16:53 UTC", "AssertTimestampMonotonic": "18005911", "Before": "getty@tty1.service xdm.service multi-user.target shutdown.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-11-12 17:16:53 UTC", "ConditionTimestampMonotonic": "18005910", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1288", "ExecMainStartTimestamp": "Thu 2020-11-12 17:16:53 UTC", "ExecMai 2020-11-12T17:18:32.771 INFO:teuthology.task.ansible.out:nStartTimestampMonotonic": "18007399", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2020-11-12 17:16:53 UTC] ; stop_time=[n/a] ; pid=1288 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-11-12 17:16:53 UTC", "InactiveExitTimestampMonotonic": "18007441", "InvocationID": "706d3ca823514a6fa006a84c2ebf4e38", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft 2020-11-12T17:18:32.772 INFO:teuthology.task.ansible.out:": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1288", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDi 2020-11-12T17:18:32.773 INFO:teuthology.task.ansible.out:rectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "St 2020-11-12T17:18:32.775 INFO:teuthology.task.ansible.out:artLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-11-12 17:16:53 UTC", "StateChangeTimestampMonotonic": "18007441", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-11-12 17:16:53 UTC", "WatchdogTimestampMonotonic": "18007440", "WatchdogUSec": "0"}} 2020-11-12T17:18:32.815 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:32 +0000 (0:00:00.398) 0:01:27.903 ***** 2020-11-12T17:18:32.854 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:32 +0000 (0:00:00.039) 0:01:27.942 ***** 2020-11-12T17:18:32.863 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:32.908 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:32 +0000 (0:00:00.052) 0:01:27.995 ***** 2020-11-12T17:18:32.920 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:32.957 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:32 +0000 (0:00:00.049) 0:01:28.045 ***** 2020-11-12T17:18:32.964 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-12T17:18:32.966 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.015 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.057) 0:01:28.103 ***** 2020-11-12T17:18:33.026 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.079 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.064) 0:01:28.167 ***** 2020-11-12T17:18:33.088 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.133 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.053) 0:01:28.221 ***** 2020-11-12T17:18:33.143 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.194 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.060) 0:01:28.282 ***** 2020-11-12T17:18:33.202 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.254 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.058) 0:01:28.341 ***** 2020-11-12T17:18:33.271 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.311 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.058) 0:01:28.399 ***** 2020-11-12T17:18:33.318 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-12T17:18:33.320 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.369 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.058) 0:01:28.457 ***** 2020-11-12T17:18:33.377 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.414 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.044) 0:01:28.502 ***** 2020-11-12T17:18:33.420 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-12T17:18:33.422 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.460 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.046) 0:01:28.548 ***** 2020-11-12T17:18:33.469 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.508 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.045) 0:01:28.594 ***** 2020-11-12T17:18:33.515 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-12T17:18:33.517 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.563 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.057) 0:01:28.652 ***** 2020-11-12T17:18:33.573 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.611 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.047) 0:01:28.699 ***** 2020-11-12T17:18:33.618 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-12T17:18:33.619 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.678 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.056) 0:01:28.755 ***** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.723 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.056) 0:01:28.811 ***** 2020-11-12T17:18:33.736 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.794 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.070) 0:01:28.881 ***** 2020-11-12T17:18:33.805 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:33.843 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:33 +0000 (0:00:00.049) 0:01:28.931 ***** 2020-11-12T17:18:33.987 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:34.019 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.176) 0:01:29.107 ***** 2020-11-12T17:18:34.027 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:34.066 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.047) 0:01:29.154 ***** 2020-11-12T17:18:34.073 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-12T17:18:34.074 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-11-12T17:18:34.116 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.049) 0:01:29.203 ***** 2020-11-12T17:18:34.124 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-11-12T17:18:34.175 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.060) 0:01:29.264 ***** 2020-11-12T17:18:34.187 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-12T17:18:34.190 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-11-12T17:18:34.243 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.067) 0:01:29.332 ***** 2020-11-12T17:18:34.254 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-11-12T17:18:34.291 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.047) 0:01:29.379 ***** 2020-11-12T17:18:34.308 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-12T17:18:34.310 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-11-12T17:18:34.357 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.066) 0:01:29.445 ***** 2020-11-12T17:18:34.367 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-11-12T17:18:34.426 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.067) 0:01:29.513 ***** 2020-11-12T17:18:34.436 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-12T17:18:34.479 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.053) 0:01:29.567 ***** 2020-11-12T17:18:34.488 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-12T17:18:34.525 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.045) 0:01:29.613 ***** 2020-11-12T17:18:34.616 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-12T17:18:34.617 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-12T17:18:34.653 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.128) 0:01:29.741 ***** 2020-11-12T17:18:34.661 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-12T17:18:34.701 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.048) 0:01:29.789 ***** 2020-11-12T17:18:34.794 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-12T17:18:34.796 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "name": "ubuntu", "state": "present", "system": false} 2020-11-12T17:18:34.830 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.129) 0:01:29.918 ***** 2020-11-12T17:18:34.848 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "name": "ubuntu", "state": "present", "system": false} 2020-11-12T17:18:34.883 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.052) 0:01:29.971 ***** 2020-11-12T17:18:34.891 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:34.946 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.062) 0:01:30.034 ***** 2020-11-12T17:18:34.954 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:34.992 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:34 +0000 (0:00:00.045) 0:01:30.079 ***** 2020-11-12T17:18:34.998 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-12T17:18:35.000 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:35.037 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:35 +0000 (0:00:00.045) 0:01:30.124 ***** 2020-11-12T17:18:35.045 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:35.083 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:35 +0000 (0:00:00.046) 0:01:30.171 ***** 2020-11-12T17:18:35.198 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-12T17:18:35.200 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-11-12T17:18:35.234 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:35 +0000 (0:00:00.150) 0:01:30.322 ***** 2020-11-12T17:18:35.258 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-11-12T17:18:35.300 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:35 +0000 (0:00:00.066) 0:01:30.388 ***** 2020-11-12T17:18:35.651 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-11-12T17:18:35.702 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:35 +0000 (0:00:00.400) 0:01:30.789 ***** 2020-11-12T17:18:35.711 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-11-12T17:18:35.751 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:35 +0000 (0:00:00.047) 0:01:30.837 ***** 2020-11-12T17:18:35.756 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-12T17:18:35.758 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi036"}, "changed": false} 2020-11-12T17:18:35.800 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:35 +0000 (0:00:00.050) 0:01:30.888 ***** 2020-11-12T17:18:35.808 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi205"}, "changed": false} 2020-11-12T17:18:35.849 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:35 +0000 (0:00:00.049) 0:01:30.937 ***** 2020-11-12T17:18:36.684 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-12T17:18:36.686 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi036.front.sepia.ceph.com", "ansible_hostname": "smithi036", "ansible_nodename": "smithi036"}, "changed": true, "name": "smithi036"} changed: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi205.front.sepia.ceph.com", "ansible_hostname": "smithi205", "ansible_nodename": "smithi205"}, "changed": true, "name": "smithi205"} 2020-11-12T17:18:36.721 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:36 +0000 (0:00:00.871) 0:01:31.808 ***** 2020-11-12T17:18:36.754 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:36 +0000 (0:00:00.033) 0:01:31.842 ***** 2020-11-12T17:18:37.061 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-12T17:18:37.063 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-11-12T17:18:37.096 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:37 +0000 (0:00:00.342) 0:01:32.185 ***** 2020-11-12T17:18:37.104 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-11-12T17:18:37.149 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:37 +0000 (0:00:00.052) 0:01:32.237 ***** 2020-11-12T17:18:37.432 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-12T17:18:37.435 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-11-12T17:18:37.480 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:37 +0000 (0:00:00.331) 0:01:32.568 ***** 2020-11-12T17:18:37.498 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-11-12T17:18:37.541 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:37 +0000 (0:00:00.057) 0:01:32.626 ***** 2020-11-12T17:18:38.001 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-12T17:18:38.003 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-12T17:18:38.045 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.506) 0:01:33.133 ***** 2020-11-12T17:18:38.066 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-12T17:18:38.104 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.059) 0:01:33.192 ***** 2020-11-12T17:18:38.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-12T17:18:38.115 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.150 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.046) 0:01:33.238 ***** 2020-11-12T17:18:38.162 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.199 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.048) 0:01:33.287 ***** 2020-11-12T17:18:38.208 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-12T17:18:38.210 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.251 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.051) 0:01:33.339 ***** 2020-11-12T17:18:38.259 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.299 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.048) 0:01:33.387 ***** 2020-11-12T17:18:38.308 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.347 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.048) 0:01:33.435 ***** 2020-11-12T17:18:38.355 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.391 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.043) 0:01:33.479 ***** 2020-11-12T17:18:38.398 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-12T17:18:38.400 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.452 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.061) 0:01:33.540 ***** 2020-11-12T17:18:38.461 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.504 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.052) 0:01:33.593 ***** 2020-11-12T17:18:38.514 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-12T17:18:38.516 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.566 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.061) 0:01:33.654 ***** 2020-11-12T17:18:38.574 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.612 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.045) 0:01:33.700 ***** 2020-11-12T17:18:38.619 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-12T17:18:38.621 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.659 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.047) 0:01:33.747 ***** 2020-11-12T17:18:38.666 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.703 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.044) 0:01:33.792 ***** 2020-11-12T17:18:38.710 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-12T17:18:38.712 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.753 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.049) 0:01:33.841 ***** 2020-11-12T17:18:38.761 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.796 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.043) 0:01:33.884 ***** 2020-11-12T17:18:38.805 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-12T17:18:38.805 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.845 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.049) 0:01:33.934 ***** 2020-11-12T17:18:38.853 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:38.889 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.043) 0:01:33.977 ***** 2020-11-12T17:18:38.896 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-12T17:18:38.932 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.042) 0:01:34.020 ***** 2020-11-12T17:18:38.976 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:38 +0000 (0:00:00.043) 0:01:34.064 ***** 2020-11-12T17:18:38.983 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-12T17:18:39.030 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.054) 0:01:34.118 ***** 2020-11-12T17:18:39.077 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.047) 0:01:34.165 ***** 2020-11-12T17:18:39.085 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-12T17:18:39.119 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.042) 0:01:34.208 ***** 2020-11-12T17:18:39.166 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.046) 0:01:34.254 ***** 2020-11-12T17:18:39.178 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.227 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.060) 0:01:34.315 ***** 2020-11-12T17:18:39.238 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.288 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.061) 0:01:34.376 ***** 2020-11-12T17:18:39.298 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.300 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.339 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.051) 0:01:34.427 ***** 2020-11-12T17:18:39.348 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.349 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.396 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.056) 0:01:34.484 ***** 2020-11-12T17:18:39.404 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.454 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.058) 0:01:34.542 ***** 2020-11-12T17:18:39.464 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.499 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.044) 0:01:34.587 ***** 2020-11-12T17:18:39.507 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:18:39.509 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.543 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.043) 0:01:34.631 ***** 2020-11-12T17:18:39.551 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.587 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.043) 0:01:34.675 ***** 2020-11-12T17:18:39.593 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.639 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.051) 0:01:34.727 ***** 2020-11-12T17:18:39.649 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.697 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.057) 0:01:34.785 ***** 2020-11-12T17:18:39.703 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-12T17:18:39.705 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.751 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.053) 0:01:34.839 ***** 2020-11-12T17:18:39.761 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.801 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.049) 0:01:34.888 ***** 2020-11-12T17:18:39.810 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-12T17:18:39.812 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.858 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.057) 0:01:34.946 ***** 2020-11-12T17:18:39.869 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.916 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.058) 0:01:35.004 ***** 2020-11-12T17:18:39.923 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-12T17:18:39.925 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:39.968 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:39 +0000 (0:00:00.051) 0:01:35.056 ***** 2020-11-12T17:18:39.976 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.016 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.048) 0:01:35.104 ***** 2020-11-12T17:18:40.023 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-12T17:18:40.025 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.059 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.043) 0:01:35.147 ***** 2020-11-12T17:18:40.067 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.104 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.044) 0:01:35.192 ***** 2020-11-12T17:18:40.112 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.152 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.047) 0:01:35.240 ***** 2020-11-12T17:18:40.160 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.200 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.048) 0:01:35.288 ***** 2020-11-12T17:18:40.210 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-12T17:18:40.212 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.249 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.048) 0:01:35.337 ***** 2020-11-12T17:18:40.256 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.292 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.043) 0:01:35.381 ***** 2020-11-12T17:18:40.300 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-12T17:18:40.301 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.337 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.044) 0:01:35.425 ***** 2020-11-12T17:18:40.345 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.383 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.045) 0:01:35.471 ***** 2020-11-12T17:18:40.390 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-12T17:18:40.392 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.426 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.042) 0:01:35.514 ***** 2020-11-12T17:18:40.433 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.468 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.042) 0:01:35.556 ***** 2020-11-12T17:18:40.475 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-12T17:18:40.477 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.515 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.046) 0:01:35.603 ***** 2020-11-12T17:18:40.525 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.576 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.061) 0:01:35.664 ***** 2020-11-12T17:18:40.593 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-12T17:18:40.594 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.636 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.059) 0:01:35.724 ***** 2020-11-12T17:18:40.645 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.681 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.045) 0:01:35.770 ***** 2020-11-12T17:18:40.688 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-12T17:18:40.690 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.727 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.045) 0:01:35.815 ***** 2020-11-12T17:18:40.735 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.772 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.044) 0:01:35.860 ***** 2020-11-12T17:18:40.779 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-12T17:18:40.781 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.815 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.043) 0:01:35.903 ***** 2020-11-12T17:18:40.830 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.863 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.048) 0:01:35.952 ***** 2020-11-12T17:18:40.870 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-12T17:18:40.872 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.912 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.048) 0:01:36.000 ***** 2020-11-12T17:18:40.922 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:40.959 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.046) 0:01:36.047 ***** 2020-11-12T17:18:40.965 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-12T17:18:40.967 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:41.002 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:40 +0000 (0:00:00.043) 0:01:36.090 ***** 2020-11-12T17:18:41.010 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:41.054 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.051) 0:01:36.142 ***** 2020-11-12T17:18:41.064 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-12T17:18:41.066 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:41.101 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.046) 0:01:36.189 ***** 2020-11-12T17:18:41.108 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:41.146 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.045) 0:01:36.234 ***** 2020-11-12T17:18:41.155 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:41.194 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.047) 0:01:36.282 ***** 2020-11-12T17:18:41.202 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:41.241 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.047) 0:01:36.330 ***** 2020-11-12T17:18:41.248 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-12T17:18:41.250 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:41.293 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.051) 0:01:36.381 ***** 2020-11-12T17:18:41.349 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 12 November 2020 17:18:41 +0000 (0:00:00.052) 0:01:36.433 ***** 2020-11-12T17:18:41.436 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-12T17:18:41.439 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005202", "end": "2020-11-12 17:18:41.422631", "rc": 0, "start": "2020-11-12 17:18:41.417429", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:18:41.476 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.127) 0:01:36.560 ***** 2020-11-12T17:18:41.494 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005081", "end": "2020-11-12 17:18:41.040317", "rc": 0, "start": "2020-11-12 17:18:41.035236", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:18:41.532 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.058) 0:01:36.619 ***** 2020-11-12T17:18:41.538 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-12T17:18:41.577 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.046) 0:01:36.665 ***** 2020-11-12T17:18:41.620 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.042) 0:01:36.708 ***** 2020-11-12T17:18:41.927 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-12T17:18:41.929 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-11-12T17:18:41.976 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:41 +0000 (0:00:00.356) 0:01:37.064 ***** 2020-11-12T17:18:41.986 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-11-12T17:18:42.023 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:42 +0000 (0:00:00.046) 0:01:37.111 ***** 2020-11-12T17:18:42.029 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-12T17:18:42.031 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:42.067 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:42 +0000 (0:00:00.044) 0:01:37.155 ***** 2020-11-12T17:18:42.076 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:42.112 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:42 +0000 (0:00:00.044) 0:01:37.200 ***** 2020-11-12T17:18:43.346 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-12T17:18:43.348 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-11-12T17:18:43.352 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-11-12T17:18:44.267 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-11-12T17:18:44.303 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:44 +0000 (0:00:02.190) 0:01:39.391 ***** 2020-11-12T17:18:44.323 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-11-12T17:18:44.364 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:44 +0000 (0:00:00.061) 0:01:39.452 ***** 2020-11-12T17:18:45.218 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:18:45.255 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:45 +0000 (0:00:00.891) 0:01:40.343 ***** 2020-11-12T17:18:45.283 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-12T17:18:45.319 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:45 +0000 (0:00:00.063) 0:01:40.407 ***** 2020-11-12T17:18:45.326 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-12T17:18:45.328 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:18:45.362 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:45 +0000 (0:00:00.043) 0:01:40.451 ***** 2020-11-12T17:18:45.390 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-12T17:18:45.427 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:45 +0000 (0:00:00.064) 0:01:40.515 ***** 2020-11-12T17:18:45.488 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-12T17:18:45.489 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034210", "end": "2020-11-12 17:18:45.032483", "rc": 0, "start": "2020-11-12 17:18:44.998273", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:18:45.530 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:45 +0000 (0:00:00.103) 0:01:40.618 ***** 2020-11-12T17:18:45.601 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.036801", "end": "2020-11-12 17:18:45.580413", "rc": 0, "start": "2020-11-12 17:18:45.543612", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:18:45.638 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:45 +0000 (0:00:00.107) 0:01:40.726 ***** 2020-11-12T17:18:48.552 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-12T17:18:48.553 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:18:48.594 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:48 +0000 (0:00:02.955) 0:01:43.682 ***** 2020-11-12T17:18:50.006 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:18:50.043 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:50 +0000 (0:00:01.448) 0:01:45.131 ***** 2020-11-12T17:18:58.735 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-12T17:18:58.737 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137600 files and directorie 2020-11-12T17:18:58.739 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2020-11-12T17:18:58.741 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137600 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-12T17:18:58.782 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:58 +0000 (0:00:08.738) 0:01:53.870 ***** 2020-11-12T17:18:59.697 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:18:59.736 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:59 +0000 (0:00:00.954) 0:01:54.824 ***** 2020-11-12T17:18:59.766 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-12T17:18:59.768 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:18:59.807 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:18:59 +0000 (0:00:00.071) 0:01:54.895 ***** 2020-11-12T17:19:00.216 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-12T17:19:00.218 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137600 files and directorie 2020-11-12T17:19:00.219 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2020-11-12T17:19:00.221 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137600 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-12T17:19:00.268 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:00 +0000 (0:00:00.460) 0:01:55.356 ***** 2020-11-12T17:19:01.144 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:19:01.178 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:01 +0000 (0:00:00.910) 0:01:56.266 ***** 2020-11-12T17:19:01.207 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:01.256 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:01 +0000 (0:00:00.078) 0:01:56.345 ***** 2020-11-12T17:19:09.214 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-12T17:19:09.215 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]\nFetched 10.4 MB in 2s (6429 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2020-11-12T17:19:09.217 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137458 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2020-11-12T17:19:09.218 INFO:teuthology.task.ansible.out:u1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]", "Fetched 10.4 MB in 2s (6429 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2020-11-12T17:19:09.220 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137458 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-12T17:19:09.263 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:09 +0000 (0:00:08.006) 0:02:04.351 ***** 2020-11-12T17:19:10.192 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-12T17:19:10.194 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:19:10.229 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:10 +0000 (0:00:00.965) 0:02:05.317 ***** 2020-11-12T17:19:10.355 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-11-12T17:19:10.407 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:10 +0000 (0:00:00.177) 0:02:05.495 ***** 2020-11-12T17:19:10.447 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:10.483 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:10 +0000 (0:00:00.074) 0:02:05.570 ***** 2020-11-12T17:19:10.632 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-11-12T17:19:10.672 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:10 +0000 (0:00:00.190) 0:02:05.760 ***** 2020-11-12T17:19:10.874 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-12T17:19:10.876 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]\nFetched 10.4 MB in 2s (5759 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2020-11-12T17:19:10.878 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137458 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2020-11-12T17:19:10.879 INFO:teuthology.task.ansible.out:u1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]", "Fetched 10.4 MB in 2s (5759 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2020-11-12T17:19:10.881 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137458 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-12T17:19:10.913 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:10 +0000 (0:00:00.240) 0:02:06.001 ***** 2020-11-12T17:19:11.016 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-12T17:19:11.018 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-11-12T17:19:11.060 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:11 +0000 (0:00:00.146) 0:02:06.148 ***** 2020-11-12T17:19:11.218 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-12T17:19:11.220 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1234, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-12T17:19:11.254 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:11 +0000 (0:00:00.194) 0:02:06.342 ***** 2020-11-12T17:19:11.393 INFO:teuthology.task.ansible.out: 2020-11-12T17:19:11.395 INFO:teuthology.task.ansible.out:TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-12T17:19:11.431 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:11 +0000 (0:00:00.176) 0:02:06.519 ***** 2020-11-12T17:19:11.730 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-12T17:19:11.732 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2020-11-12 17:16:41 UTC", "ActiveEnterTimestampMonotonic": "20852757", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount systemd-journald.socket sysinit.target remote-fs.target network.target basic.target nss-lookup.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-11-12 17:16:41 UTC", "AssertTimestampMonotonic": "20370044", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-11-12 17:16:41 UTC", "ConditionTimestampMonotonic": "20370044", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-11-12T17:19:11.734 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1316", "ExecMainStartTimestamp": "Thu 2020-11-12 17:16:41 UTC", "ExecMainStartTimestampMonotonic": "20852745", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-11-12 17:16:41 UTC", "InactiveExitTimestampMonotonic": "20370703", "InvocationID": "664491e684c047219b8e5c5fb885c1ec", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-11-12T17:19:11.736 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1316", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-11-12T17:19:11.738 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-11-12 17:16:41 UTC", "StateChangeTimestampMonotonic": "20852757", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-11-12 17:16:41 UTC", "WatchdogTimestampMonotonic": "20852755", "WatchdogUSec": "0"}} 2020-11-12T17:19:11.775 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:11 +0000 (0:00:00.343) 0:02:06.863 ***** 2020-11-12T17:19:11.814 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-12T17:19:11.816 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:11.855 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:11 +0000 (0:00:00.079) 0:02:06.943 ***** 2020-11-12T17:19:11.897 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:11 +0000 (0:00:00.041) 0:02:06.985 ***** 2020-11-12T17:19:11.906 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-12T17:19:11.908 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:11.950 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:11 +0000 (0:00:00.053) 0:02:07.038 ***** 2020-11-12T17:19:11.991 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-12T17:19:11.993 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.029 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.079) 0:02:07.117 ***** 2020-11-12T17:19:12.042 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-11-12T17:19:12.087 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.057) 0:02:07.174 ***** 2020-11-12T17:19:12.094 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-12T17:19:12.096 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.133 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.047) 0:02:07.222 ***** 2020-11-12T17:19:12.141 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-12T17:19:12.143 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.180 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.046) 0:02:07.268 ***** 2020-11-12T17:19:12.188 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-12T17:19:12.189 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.226 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.045) 0:02:07.314 ***** 2020-11-12T17:19:12.254 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-12T17:19:12.256 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.296 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.066) 0:02:07.381 ***** 2020-11-12T17:19:12.330 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-11-12T17:19:12.363 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.069) 0:02:07.450 ***** 2020-11-12T17:19:12.418 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 12 November 2020 17:19:12 +0000 (0:00:00.044) 0:02:07.495 ***** 2020-11-12T17:19:12.454 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.486 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.079) 0:02:07.574 ***** 2020-11-12T17:19:12.515 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.554 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.067) 0:02:07.642 ***** 2020-11-12T17:19:12.587 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.621 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.066) 0:02:07.709 ***** 2020-11-12T17:19:12.651 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-12T17:19:12.653 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.687 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.065) 0:02:07.775 ***** 2020-11-12T17:19:12.695 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-12T17:19:12.697 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-11-12T17:19:12.733 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.046) 0:02:07.821 ***** 2020-11-12T17:19:12.739 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-12T17:19:12.741 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.779 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.046) 0:02:07.868 ***** 2020-11-12T17:19:12.808 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.842 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.062) 0:02:07.930 ***** 2020-11-12T17:19:12.873 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-12T17:19:12.875 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.908 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.065) 0:02:07.996 ***** 2020-11-12T17:19:12.915 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-12T17:19:12.917 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1234, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-12T17:19:12.952 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.044) 0:02:08.040 ***** 2020-11-12T17:19:12.959 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-12T17:19:12.961 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:12.998 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:12 +0000 (0:00:00.044) 0:02:08.085 ***** 2020-11-12T17:19:13.026 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-12T17:19:13.028 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.068 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.070) 0:02:08.156 ***** 2020-11-12T17:19:13.096 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-12T17:19:13.099 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.131 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.063) 0:02:08.219 ***** 2020-11-12T17:19:13.164 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.033) 0:02:08.252 ***** 2020-11-12T17:19:13.171 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-12T17:19:13.173 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.210 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.045) 0:02:08.298 ***** 2020-11-12T17:19:13.240 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.298 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.087) 0:02:08.386 ***** 2020-11-12T17:19:13.332 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.374 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.076) 0:02:08.462 ***** 2020-11-12T17:19:13.402 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.449 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.074) 0:02:08.537 ***** 2020-11-12T17:19:13.475 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2020-11-12 17:16:54 UTC", "ActiveEnterTimestampMonotonic": "18445198", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket sysinit.target -.mount remote-fs.target network.target systemd-tmpfiles-setup.service system.slice basic.target nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-11-12 17:16:53 UTC", "AssertTimestampMonotonic": "18004840", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-11-12 17:16:53 UTC", "ConditionTimestampMonotonic": "18004840", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", 2020-11-12T17:19:13.478 INFO:teuthology.task.ansible.out:"Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1351", "ExecMainStartTimestamp": "Thu 2020-11-12 17:16:54 UTC", "ExecMainStartTimestampMonotonic": "18445187", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-11-12 17:16:53 UTC", "InactiveExitTimestampMonotonic": "18005849", "InvocationID": "84e60cb9cd8e49b1b0f0bf654af30084", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA 2020-11-12T17:19:13.480 INFO:teuthology.task.ansible.out:": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1351", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", 2020-11-12T17:19:13.482 INFO:teuthology.task.ansible.out: "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-11-12 17:16:54 UTC", "StateChangeTimestampMonotonic": "18445198", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-11-12 17:16:54 UTC", "WatchdogTimestampMonotonic": "18445197", "WatchdogUSec": "0"}} 2020-11-12T17:19:13.512 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.063) 0:02:08.600 ***** 2020-11-12T17:19:13.523 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.560 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.047) 0:02:08.648 ***** 2020-11-12T17:19:13.569 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.605 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.045) 0:02:08.693 ***** 2020-11-12T17:19:13.613 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.654 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.048) 0:02:08.742 ***** 2020-11-12T17:19:13.663 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.708 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.053) 0:02:08.796 ***** 2020-11-12T17:19:13.715 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-12T17:19:13.717 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.765 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.057) 0:02:08.853 ***** 2020-11-12T17:19:13.794 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.820 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.054) 0:02:08.908 ***** 2020-11-12T17:19:13.828 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-12T17:19:13.831 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.869 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.049) 0:02:08.957 ***** 2020-11-12T17:19:13.883 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:13.930 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.060) 0:02:09.018 ***** 2020-11-12T17:19:13.941 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-12T17:19:13.945 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.001 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:13 +0000 (0:00:00.068) 0:02:09.087 ***** 2020-11-12T17:19:14.009 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-12T17:19:14.011 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.064 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.064) 0:02:09.152 ***** 2020-11-12T17:19:14.095 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-12T17:19:14.096 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.158 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.094) 0:02:09.246 ***** 2020-11-12T17:19:14.169 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-12T17:19:14.171 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-11-12T17:19:14.210 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.051) 0:02:09.298 ***** 2020-11-12T17:19:14.221 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.262 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.051) 0:02:09.350 ***** 2020-11-12T17:19:14.292 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-12T17:19:14.294 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.339 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.076) 0:02:09.426 ***** 2020-11-12T17:19:14.378 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.413 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.074) 0:02:09.501 ***** 2020-11-12T17:19:14.443 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-12T17:19:14.445 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.484 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.068) 0:02:09.570 ***** 2020-11-12T17:19:14.522 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.572 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.090) 0:02:09.660 ***** 2020-11-12T17:19:14.580 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-12T17:19:14.582 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-11-12T17:19:14.633 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.060) 0:02:09.721 ***** 2020-11-12T17:19:14.644 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.679 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.046) 0:02:09.767 ***** 2020-11-12T17:19:14.686 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.724 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.045) 0:02:09.812 ***** 2020-11-12T17:19:14.735 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-12T17:19:14.737 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.783 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.058) 0:02:09.871 ***** 2020-11-12T17:19:14.812 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-12T17:19:14.814 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.849 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.066) 0:02:09.937 ***** 2020-11-12T17:19:14.877 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-12T17:19:14.879 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:14.917 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.067) 0:02:10.005 ***** 2020-11-12T17:19:14.959 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-12T17:19:14.961 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.002 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:14 +0000 (0:00:00.084) 0:02:10.090 ***** 2020-11-12T17:19:15.030 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-12T17:19:15.031 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.074 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.072) 0:02:10.162 ***** 2020-11-12T17:19:15.092 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-12T17:19:15.094 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-11-12T17:19:15.130 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.055) 0:02:10.218 ***** 2020-11-12T17:19:15.139 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-12T17:19:15.140 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.177 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.046) 0:02:10.265 ***** 2020-11-12T17:19:15.205 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-12T17:19:15.207 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.244 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.067) 0:02:10.332 ***** 2020-11-12T17:19:15.272 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-12T17:19:15.274 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.311 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.067) 0:02:10.399 ***** 2020-11-12T17:19:15.341 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.381 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.069) 0:02:10.469 ***** 2020-11-12T17:19:15.410 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.449 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.066) 0:02:10.535 ***** 2020-11-12T17:19:15.478 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-12T17:19:15.480 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.517 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.070) 0:02:10.605 ***** 2020-11-12T17:19:15.558 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.040) 0:02:10.646 ***** 2020-11-12T17:19:15.587 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-12T17:19:15.590 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.631 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.072) 0:02:10.719 ***** 2020-11-12T17:19:15.658 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-12T17:19:15.660 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.695 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.063) 0:02:10.782 ***** 2020-11-12T17:19:15.723 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:15.757 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.062) 0:02:10.845 ***** 2020-11-12T17:19:15.864 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-12T17:19:15.865 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-11-12T17:19:15.903 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.145) 0:02:10.991 ***** 2020-11-12T17:19:15.923 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-12T17:19:15.926 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-11-12T17:19:15.963 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:15 +0000 (0:00:00.060) 0:02:11.051 ***** 2020-11-12T17:19:16.048 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-12T17:19:16.050 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-12T17:19:16.092 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.129) 0:02:11.181 ***** 2020-11-12T17:19:16.131 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-12T17:19:16.133 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.166 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.073) 0:02:11.255 ***** 2020-11-12T17:19:16.199 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-12T17:19:16.200 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.234 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.067) 0:02:11.322 ***** 2020-11-12T17:19:16.264 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-12T17:19:16.266 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.303 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.069) 0:02:11.392 ***** 2020-11-12T17:19:16.323 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-12T17:19:16.325 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-11-12T17:19:16.370 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.066) 0:02:11.458 ***** 2020-11-12T17:19:16.380 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-12T17:19:16.382 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.415 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.044) 0:02:11.503 ***** 2020-11-12T17:19:16.424 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-12T17:19:16.425 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.464 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.048) 0:02:11.552 ***** 2020-11-12T17:19:16.471 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-12T17:19:16.473 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.510 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.045) 0:02:11.598 ***** 2020-11-12T17:19:16.539 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-12T17:19:16.586 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.076) 0:02:11.674 ***** 2020-11-12T17:19:16.637 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-12T17:19:16.639 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.650 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.661 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.663 INFO:teuthology.task.ansible.out: 2020-11-12T17:19:16.674 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.686 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-12T17:19:16.697 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.699 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.710 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.721 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.733 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:16.823 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} Thursday 12 November 2020 17:19:16 +0000 (0:00:00.201) 0:02:11.876 ***** TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-11-12T17:19:16.842 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:16 +0000 (0:00:00.053) 0:02:11.930 ***** 2020-11-12T17:19:17.031 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-12T17:19:17.032 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003892", "end": "2020-11-12 17:19:16.996686", "rc": 0, "start": "2020-11-12 17:19:16.992794", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-12T17:19:17.076 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:17 +0000 (0:00:00.233) 0:02:12.164 ***** 2020-11-12T17:19:17.114 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:17.161 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:17 +0000 (0:00:00.085) 0:02:12.249 ***** 2020-11-12T17:19:17.202 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-12T17:19:17.204 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:17.255 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:17 +0000 (0:00:00.093) 0:02:12.343 ***** 2020-11-12T17:19:17.288 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-12T17:19:17.290 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:17.330 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:17 +0000 (0:00:00.074) 0:02:12.418 ***** 2020-11-12T17:19:17.370 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-12T17:19:17.410 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-11-12T17:19:17.411 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:17 +0000 (0:00:00.081) 0:02:12.499 ***** 2020-11-12T17:19:17.736 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-12T17:19:17.738 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-11-12T17:19:17.774 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:17 +0000 (0:00:00.363) 0:02:12.862 ***** 2020-11-12T17:19:17.915 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-12T17:19:17.917 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-12T17:19:17.959 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:17 +0000 (0:00:00.184) 0:02:13.047 ***** 2020-11-12T17:19:17.986 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-12T17:19:17.988 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.022 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.062) 0:02:13.110 ***** 2020-11-12T17:19:18.059 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-12T17:19:18.061 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.114 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.092) 0:02:13.202 ***** 2020-11-12T17:19:18.143 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-12T17:19:18.144 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.177 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.062) 0:02:13.265 ***** 2020-11-12T17:19:18.205 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-12T17:19:18.207 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.239 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.062) 0:02:13.327 ***** 2020-11-12T17:19:18.256 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-12T17:19:18.258 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:19:18.290 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.050) 0:02:13.378 ***** 2020-11-12T17:19:18.297 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-12T17:19:18.299 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.332 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.042) 0:02:13.421 ***** 2020-11-12T17:19:18.340 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-12T17:19:18.342 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.375 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.042) 0:02:13.463 ***** 2020-11-12T17:19:18.382 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:18.384 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-12T17:19:18.420 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.044) 0:02:13.508 ***** 2020-11-12T17:19:18.427 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-12T17:19:18.428 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'block_used': 13750320, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226344788, 'size_available': 927108251648, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149512, 'block_size': 4096, 'inode_available': 60905464}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226344788, "block_size": 4096, "block_total": 240095108, "block_used": 13750320, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905464, "inode_total": 61054976, "inode_used": 149512, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927108251648, "size_total": 983429562368, "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}} 2020-11-12T17:19:18.466 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.046) 0:02:13.554 ***** 2020-11-12T17:19:18.474 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-12T17:19:18.476 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.487 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.488 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.500 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.511 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.523 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-12T17:19:18.534 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.536 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.546 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.558 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.559 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.570 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.572 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.582 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.627 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.160) 0:02:13.715 ***** 2020-11-12T17:19:18.634 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-12T17:19:18.636 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011292", "end": "2020-11-12 17:19:18.592409", "rc": 0, "start": "2020-11-12 17:19:18.581117", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:18.674 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.045) 0:02:13.760 ***** 2020-11-12T17:19:18.758 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi036.front.sepia.ceph.com] => (item={'block_used': 13750320, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226344788, 'size_available': 927108251648, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149512, 'block_size': 4096, 'inode_available': 60905464}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226344788, "block_size": 4096, "block_total": 240095108, "block_used": 13750320, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905464, "inode_total": 61054976, "inode_used": 149512, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927108251648, "size_total": 983429562368, "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}, "skip_reason": "Conditional result was False"} Thursday 12 November 2020 17:19:18 +0000 (0:00:00.077) 0:02:13.837 ***** 2020-11-12T17:19:18.778 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-12T17:19:18.812 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.063) 0:02:13.901 ***** 2020-11-12T17:19:18.863 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-12T17:19:18.865 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004100", "end": "2020-11-12 17:19:18.833903", "rc": 0, "start": "2020-11-12 17:19:18.829803", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.909 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.096) 0:02:13.997 ***** 2020-11-12T17:19:18.937 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-12T17:19:18.939 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:18.975 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:18 +0000 (0:00:00.066) 0:02:14.063 ***** 2020-11-12T17:19:19.013 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-12T17:19:19.015 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:19.047 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:19 +0000 (0:00:00.072) 0:02:14.135 ***** 2020-11-12T17:19:19.075 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-12T17:19:19.077 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:19.124 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:19 +0000 (0:00:00.077) 0:02:14.212 ***** 2020-11-12T17:19:20.038 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-12T17:19:20.040 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:19:20.076 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:20 +0000 (0:00:00.951) 0:02:15.164 ***** 2020-11-12T17:19:20.104 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-12T17:19:20.106 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:20.140 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:20 +0000 (0:00:00.063) 0:02:15.228 ***** 2020-11-12T17:19:20.189 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-12T17:19:20.191 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item={'block_used': 13750321, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226344787, 'size_available': 927108247552, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149511, 'block_size': 4096, 'inode_available': 60905465}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226344787, "block_size": 4096, "block_total": 240095108, "block_used": 13750321, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905465, "inode_total": 61054976, "inode_used": 149511, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927108247552, "size_total": 983429562368, "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}} 2020-11-12T17:19:20.229 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:20 +0000 (0:00:00.089) 0:02:15.318 ***** 2020-11-12T17:19:20.374 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-12T17:19:20.375 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009664", "end": "2020-11-12 17:19:19.932368", "rc": 0, "start": "2020-11-12 17:19:19.922704", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:20.408 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:20 +0000 (0:00:00.178) 0:02:15.496 ***** 2020-11-12T17:19:20.447 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-12T17:19:20.449 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'block_used': 13750321, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226344787, 'size_available': 927108247552, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149511, 'block_size': 4096, 'inode_available': 60905465}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226344787, "block_size": 4096, "block_total": 240095108, "block_used": 13750321, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905465, "inode_total": 61054976, "inode_used": 149511, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927108247552, "size_total": 983429562368, "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:20.485 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:20 +0000 (0:00:00.076) 0:02:15.573 ***** 2020-11-12T17:19:20.522 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-12T17:19:20.563 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:20 +0000 (0:00:00.077) 0:02:15.651 ***** 2020-11-12T17:19:20.612 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-12T17:19:20.614 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:21.068 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZorlTQeCOpq98Fn4hFPXz93dasmjqiV2Y'], 'uuids': ['731e3b71-6821-42c8-8317-abbb91c66904']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:02.070368", "end": "2020-11-12 17:19:21.034193", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZorlTQeCOpq98Fn4hFPXz93dasmjqiV2Y"], "labels": [], "masters": [], "uuids": ["731e3b71-6821-42c8-8317-abbb91c66904"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:18.963825", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:21.080 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:21.081 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:22.340 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZ7fug4U4NggWuQOCcMIi8gqnBNFEa5dcH'], 'uuids': ['393e7582-2dd6-4f54-a13a-9408e5bbce56']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.133643", "end": "2020-11-12 17:19:22.316256", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZ7fug4U4NggWuQOCcMIi8gqnBNFEa5dcH"], "labels": [], "masters": [], "uuids": ["393e7582-2dd6-4f54-a13a-9408e5bbce56"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:21.182613", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:22.352 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS', 'wwn-0x5000c500871b68bf'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'wwn-0x5000c500871b68bf-part1'], 'uuids': ['1e9a17af-0168-46be-b05d-6a296317ab15']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b68bf', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J2QS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS", "wwn-0x5000c500871b68bf"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1", "wwn-0x5000c500871b68bf-part1"], "labels": [], "masters": [], "uuids": ["1e9a17af-0168-46be-b05d-6a296317ab15"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2QS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b68bf"}}, "skip_reason": 2020-11-12T17:19:22.354 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-12T17:19:22.395 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYygBPUwpvlgLBkuwG7mtH6XotWrQ2q4ek'], 'uuids': ['cf586515-65bf-4f6b-9e26-bf0fa720969b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.655774", "end": "2020-11-12 17:19:21.947406", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYygBPUwpvlgLBkuwG7mtH6XotWrQ2q4ek"], "labels": [], "masters": [], "uuids": ["cf586515-65bf-4f6b-9e26-bf0fa720969b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:20.291632", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:22.424 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:23.643 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-94TLL7-SzFA-h3HL-FmEG-oJzl-M2yH-PCpoUb', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN', 'nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.172098", "end": "2020-11-12 17:19:23.620644", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-94TLL7-SzFA-h3HL-FmEG-oJzl-M2yH-PCpoUb", "nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN", "nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:22.448546", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-12T17:19:23.645 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:23.656 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:23.669 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:23.671 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYnfqMC0ek560A1hlpKDsJQj8BreV8G0W5'], 'uuids': ['49560ce9-64b8-4de1-aa97-afd956aa6da5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.134432", "end": "2020-11-12 17:19:23.224626", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYnfqMC0ek560A1hlpKDsJQj8BreV8G0W5"], "labels": [], "masters": [], "uuids": ["49560ce9-64b8-4de1-aa97-afd956aa6da5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:22.090194", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:23.684 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNFQ', 'wwn-0x5000c500929415fe'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNFQ-part1', 'wwn-0x5000c500929415fe-part1'], 'uuids': ['1e9a17af-0168-46be-b05d-6a296317ab15']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500929415fe', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XNFQ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNFQ", "wwn-0x5000c500929415fe"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNFQ-part1", "wwn-0x5000c500929415fe-part1"], "labels": [], "masters": [], "uuids": ["1e9a17af-0168-46be-b05d-6a296317ab15"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNFQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929415fe"}}, "skip_reason": 2020-11-12T17:19:23.685 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-12T17:19:24.944 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZcKR9lzL4uQR304gm6VnJpbnizFePWZPD'], 'uuids': ['ebae4450-1b08-475e-887b-b8f174829ef5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.155409", "end": "2020-11-12 17:19:24.916056", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZcKR9lzL4uQR304gm6VnJpbnizFePWZPD"], "labels": [], "masters": [], "uuids": ["ebae4450-1b08-475e-887b-b8f174829ef5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:23.760647", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:24.956 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:24.968 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:25.119 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-SV8A1v-Sum2-Nlhf-c2VR-uLKk-FwXy-LL2LpK', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233004E400BGN', 'nvme-nvme.8086-43564654363233333030344534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.313106", "end": "2020-11-12 17:19:24.676349", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-SV8A1v-Sum2-Nlhf-c2VR-uLKk-FwXy-LL2LpK", "nvme-INTEL_SSDPEDMD400G4_CVFT6233004E400BGN", "nvme-nvme.8086-43564654363233333030344534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:23.363243", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-12T17:19:25.121 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:25.141 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:25.153 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:26.198 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZWktC1rYdepOwK38GfELcP4uccg4yHsAD'], 'uuids': ['c832285f-9836-489d-aacb-056fa9bb3630']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.116181", "end": "2020-11-12 17:19:26.174776", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZWktC1rYdepOwK38GfELcP4uccg4yHsAD"], "labels": [], "masters": [], "uuids": ["c832285f-9836-489d-aacb-056fa9bb3630"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:25.058595", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:26.209 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:26.578 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYgiYlqrLEXVTWWfYlTeCdtMd3ASBpILNV'], 'uuids': ['ef10c9a3-04a2-4005-8fe9-2583cde6a06f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.312709", "end": "2020-11-12 17:19:26.145102", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYgiYlqrLEXVTWWfYlTeCdtMd3ASBpILNV"], "labels": [], "masters": [], "uuids": ["ef10c9a3-04a2-4005-8fe9-2583cde6a06f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:24.832393", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:26.590 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:26.601 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:27.456 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZf2dTkRkgE9NpU4ekh9tvRV4APvHoojUt'], 'uuids': ['f0b1ce4f-93ad-418b-ba5d-ae3a8cba3b5d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.129782", "end": "2020-11-12 17:19:27.432996", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZf2dTkRkgE9NpU4ekh9tvRV4APvHoojUt"], "labels": [], "masters": [], "uuids": ["f0b1ce4f-93ad-418b-ba5d-ae3a8cba3b5d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:26.303214", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:27.501 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:27 +0000 (0:00:06.938) 0:02:22.589 ***** 2020-11-12T17:19:27.551 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-12T17:19:27.553 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:27.826 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZorlTQeCOpq98Fn4hFPXz93dasmjqiV2Y'], 'uuids': ['731e3b71-6821-42c8-8317-abbb91c66904']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.151921", "end": "2020-11-12 17:19:27.800352", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZorlTQeCOpq98Fn4hFPXz93dasmjqiV2Y"], "labels": [], "masters": [], "uuids": ["731e3b71-6821-42c8-8317-abbb91c66904"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:27.648431", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147537 s, 782 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147537 s, 782 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:27.838 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:27.849 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:28.045 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-12T17:19:28.047 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYmTS8mnlQIEJAYPSEVncEKsBEmLRVUPSU'], 'uuids': ['e20637db-33e3-40b7-867e-33409ab70081']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.318847", "end": "2020-11-12 17:19:27.611256", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYmTS8mnlQIEJAYPSEVncEKsBEmLRVUPSU"], "labels": [], "masters": [], "uuids": ["e20637db-33e3-40b7-867e-33409ab70081"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:26.292409", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:28.057 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:28.143 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-12T17:19:28.144 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZ7fug4U4NggWuQOCcMIi8gqnBNFEa5dcH'], 'uuids': ['393e7582-2dd6-4f54-a13a-9408e5bbce56']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.155358", "end": "2020-11-12 17:19:28.119316", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZ7fug4U4NggWuQOCcMIi8gqnBNFEa5dcH"], "labels": [], "masters": [], "uuids": ["393e7582-2dd6-4f54-a13a-9408e5bbce56"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:27.963958", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150524 s, 766 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150524 s, 766 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:28.155 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS', 'wwn-0x5000c500871b68bf'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'wwn-0x5000c500871b68bf-part1'], 'uuids': ['1e9a17af-0168-46be-b05d-6a296317ab15']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b68bf', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J2QS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS", "wwn-0x5000c500871b68bf"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1", "wwn-0x5000c500871b68bf-part1"], "labels": [], "masters": [], "uuids": ["1e9a17af-0168-46be-b05d-6a296317ab15"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2QS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b68bf"}}, "skip_reason": 2020-11-12T17:19:28.157 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-12T17:19:28.334 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-94TLL7-SzFA-h3HL-FmEG-oJzl-M2yH-PCpoUb', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN', 'nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054457", "end": "2020-11-12 17:19:28.308239", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-94TLL7-SzFA-h3HL-FmEG-oJzl-M2yH-PCpoUb", "nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN", "nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:28.253782", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0497536 s, 2.3 GB/s", "std 2020-11-12T17:19:28.336 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0497536 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:28.346 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:28.347 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:28.611 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZcKR9lzL4uQR304gm6VnJpbnizFePWZPD'], 'uuids': ['ebae4450-1b08-475e-887b-b8f174829ef5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.143549", "end": "2020-11-12 17:19:28.586325", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZcKR9lzL4uQR304gm6VnJpbnizFePWZPD"], "labels": [], "masters": [], "uuids": ["ebae4450-1b08-475e-887b-b8f174829ef5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:28.442776", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140835 s, 819 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140835 s, 819 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:28.623 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:28.634 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:28.919 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZWktC1rYdepOwK38GfELcP4uccg4yHsAD'], 'uuids': ['c832285f-9836-489d-aacb-056fa9bb3630']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.167588", "end": "2020-11-12 17:19:28.894056", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZWktC1rYdepOwK38GfELcP4uccg4yHsAD"], "labels": [], "masters": [], "uuids": ["c832285f-9836-489d-aacb-056fa9bb3630"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:28.726468", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.163933 s, 704 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.163933 s, 704 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:28.932 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:29.216 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZf2dTkRkgE9NpU4ekh9tvRV4APvHoojUt'], 'uuids': ['f0b1ce4f-93ad-418b-ba5d-ae3a8cba3b5d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.159148", "end": "2020-11-12 17:19:29.192122", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-l4KI7ZOo8MzgV129icOW3raXTw0VDYFZf2dTkRkgE9NpU4ekh9tvRV4APvHoojUt"], "labels": [], "masters": [], "uuids": ["f0b1ce4f-93ad-418b-ba5d-ae3a8cba3b5d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:29.032974", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154424 s, 747 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154424 s, 747 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:29.276 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:29 +0000 (0:00:01.774) 0:02:24.364 ***** 2020-11-12T17:19:29.475 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-12T17:19:29.477 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYM7DVKrygUnvdR7PknKflne4XYN0QjEov'], 'uuids': ['198f992b-97a5-4e13-89c3-1c44d724ff4a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.298863", "end": "2020-11-12 17:19:29.038287", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYM7DVKrygUnvdR7PknKflne4XYN0QjEov"], "labels": [], "masters": [], "uuids": ["198f992b-97a5-4e13-89c3-1c44d724ff4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:27.739424", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-12T17:19:29.522 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:29 +0000 (0:00:00.245) 0:02:24.610 ***** 2020-11-12T17:19:29.550 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-12T17:19:29.552 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.130839", "end": "2020-11-12 17:19:29.520422", "rc": 0, "start": "2020-11-12 17:19:29.389583", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:29.590 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:29 +0000 (0:00:00.068) 0:02:24.678 ***** 2020-11-12T17:19:29.599 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-12T17:19:29.601 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:29.791 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-12T17:19:29.793 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049823", "end": "2020-11-12 17:19:29.762814", "rc": 0, "start": "2020-11-12 17:19:29.712991", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:29.827 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:29 +0000 (0:00:00.236) 0:02:24.915 ***** 2020-11-12T17:19:29.857 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-12T17:19:29.859 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYygBPUwpvlgLBkuwG7mtH6XotWrQ2q4ek'], 'uuids': ['cf586515-65bf-4f6b-9e26-bf0fa720969b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.153400", "end": "2020-11-12 17:19:29.410482", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYygBPUwpvlgLBkuwG7mtH6XotWrQ2q4ek"], "labels": [], "masters": [], "uuids": ["cf586515-65bf-4f6b-9e26-bf0fa720969b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:29.257082", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14863 s, 776 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14863 s, 776 MB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Remove physical volumes] ************************************** TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 2020-11-12T17:19:29.861 INFO:teuthology.task.ansible.out: 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:29.897 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:29 +0000 (0:00:00.069) 0:02:24.985 ***** 2020-11-12T17:19:29.905 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:29.927 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-12T17:19:29.929 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:29.967 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:29 +0000 (0:00:00.070) 0:02:25.055 ***** 2020-11-12T17:19:29.994 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-12T17:19:29.997 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.029 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.061) 0:02:25.117 ***** 2020-11-12T17:19:30.060 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-12T17:19:30.062 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.097 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.067) 0:02:25.185 ***** 2020-11-12T17:19:30.124 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.161 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.063) 0:02:25.249 ***** 2020-11-12T17:19:30.171 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-12T17:19:30.174 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYnfqMC0ek560A1hlpKDsJQj8BreV8G0W5'], 'uuids': ['49560ce9-64b8-4de1-aa97-afd956aa6da5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.158296", "end": "2020-11-12 17:19:29.719641", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYnfqMC0ek560A1hlpKDsJQj8BreV8G0W5"], "labels": [], "masters": [], "uuids": ["49560ce9-64b8-4de1-aa97-afd956aa6da5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:29.561345", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153611 s, 751 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153611 s, 751 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:30.175 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNFQ', 'wwn-0x5000c500929415fe'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'links': {'masters': [], 'labels': 2020-11-12T17:19:30.176 INFO:teuthology.task.ansible.out: [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNFQ-part1', 'wwn-0x5000c500929415fe-part1'], 'uuids': ['1e9a17af-0168-46be-b05d-6a296317ab15']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500929415fe', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XNFQ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNFQ", "wwn-0x5000c500929415fe"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNFQ-part1", "wwn-0x5000c500929415fe-part1"], "labels": [], "masters": [], "uuids": ["1e9a17af-0168-46be-b05d-6a296317ab15"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNFQ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929415fe"}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.292 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-12T17:19:30.294 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-12T17:19:30.329 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.168) 0:02:25.417 ***** 2020-11-12T17:19:30.348 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-12T17:19:30.349 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-SV8A1v-Sum2-Nlhf-c2VR-uLKk-FwXy-LL2LpK', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233004E400BGN', 'nvme-nvme.8086-43564654363233333030344534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054889", "end": "2020-11-12 17:19:29.911687", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-SV8A1v-Sum2-Nlhf-c2VR-uLKk-FwXy-LL2LpK", "nvme-INTEL_SSDPEDMD400G4_CVFT6233004E400BGN", "nvme-nvme.8086-43564654363233333030344534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:29.856798", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0503245 s, 2.3 GB/s", "std 2020-11-12T17:19:30.351 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0503245 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:30.361 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.373 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.374 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-12T17:19:30.375 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'block_used': 13750320, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226344788, 'size_available': 927108251648, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149512, 'block_size': 4096, 'inode_available': 60905464}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226344788, "block_size": 4096, "block_total": 240095108, "block_used": 13750320, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905464, "inode_total": 61054976, "inode_used": 149512, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927108251648, "size_total": 983429562368, "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.419 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.089) 0:02:25.507 ***** 2020-11-12T17:19:30.450 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-12T17:19:30.452 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.490 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.071) 0:02:25.578 ***** 2020-11-12T17:19:30.519 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.554 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.063) 0:02:25.642 ***** 2020-11-12T17:19:30.582 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:30.584 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.617 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.062) 0:02:25.705 ***** 2020-11-12T17:19:30.646 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-12T17:19:30.647 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-12T17:19:30.648 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYgiYlqrLEXVTWWfYlTeCdtMd3ASBpILNV'], 'uuids': ['ef10c9a3-04a2-4005-8fe9-2583cde6a06f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.146811", "end": "2020-11-12 17:19:30.212332", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYgiYlqrLEXVTWWfYlTeCdtMd3ASBpILNV"], "labels": [], "masters": [], "uuids": ["ef10c9a3-04a2-4005-8fe9-2583cde6a06f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:30.065521", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14423 s, 800 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14423 s, 800 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:30.700 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.082) 0:02:25.788 ***** 2020-11-12T17:19:30.710 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.712 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.735 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.778 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.078) 0:02:25.866 ***** 2020-11-12T17:19:30.807 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:30.841 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:30 +0000 (0:00:00.063) 0:02:25.929 ***** 2020-11-12T17:19:30.967 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-12T17:19:30.969 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYmTS8mnlQIEJAYPSEVncEKsBEmLRVUPSU'], 'uuids': ['e20637db-33e3-40b7-867e-33409ab70081']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.161856", "end": "2020-11-12 17:19:30.526405", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYmTS8mnlQIEJAYPSEVncEKsBEmLRVUPSU"], "labels": [], "masters": [], "uuids": ["e20637db-33e3-40b7-867e-33409ab70081"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:30.364549", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157148 s, 734 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157148 s, 734 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:30.980 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:31.255 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYM7DVKrygUnvdR7PknKflne4XYN0QjEov'], 'uuids': ['198f992b-97a5-4e13-89c3-1c44d724ff4a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.157535", "end": "2020-11-12 17:19:30.817758", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Lq035Q52H3LtUnbB8UkcMHrxyCKUKMxYM7DVKrygUnvdR7PknKflne4XYN0QjEov"], "labels": [], "masters": [], "uuids": ["198f992b-97a5-4e13-89c3-1c44d724ff4a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-12 17:19:30.660223", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152672 s, 755 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152672 s, 755 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:31.299 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:31 +0000 (0:00:00.458) 0:02:26.387 ***** 2020-11-12T17:19:31.478 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-12T17:19:31.480 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-12T17:19:31.535 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:31 +0000 (0:00:00.235) 0:02:26.623 ***** 2020-11-12T17:19:31.581 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-12T17:19:31.583 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.131736", "end": "2020-11-12 17:19:31.136305", "rc": 0, "start": "2020-11-12 17:19:31.004569", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:31.619 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:31 +0000 (0:00:00.083) 0:02:26.706 ***** 2020-11-12T17:19:31.805 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-12T17:19:31.807 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.050205", "end": "2020-11-12 17:19:31.370328", "rc": 0, "start": "2020-11-12 17:19:31.320123", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:31.841 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:31 +0000 (0:00:00.222) 0:02:26.929 ***** 2020-11-12T17:19:31.868 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-12T17:19:31.912 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:31 +0000 (0:00:00.071) 0:02:27.001 ***** 2020-11-12T17:19:31.951 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-12T17:19:31.953 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:31.989 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:31 +0000 (0:00:00.076) 0:02:27.077 ***** 2020-11-12T17:19:32.016 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-12T17:19:32.018 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.053 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.064) 0:02:27.141 ***** 2020-11-12T17:19:32.081 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-12T17:19:32.082 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.119 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.065) 0:02:27.207 ***** 2020-11-12T17:19:32.127 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-12T17:19:32.128 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-12T17:19:32.150 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-12T17:19:32.152 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.184 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.065) 0:02:27.272 ***** 2020-11-12T17:19:32.308 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi205.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-12T17:19:32.347 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.162) 0:02:27.435 ***** 2020-11-12T17:19:32.374 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-12T17:19:32.376 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-12T17:19:32.386 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-12T17:19:32.388 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'block_used': 13750321, 'uuid': '1e9a17af-0168-46be-b05d-6a296317ab15', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226344787, 'size_available': 927108247552, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149511, 'block_size': 4096, 'inode_available': 60905465}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226344787, "block_size": 4096, "block_total": 240095108, "block_used": 13750321, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905465, "inode_total": 61054976, "inode_used": 149511, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927108247552, "size_total": 983429562368, "uuid": "1e9a17af-0168-46be-b05d-6a296317ab15"}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.424 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.077) 0:02:27.512 ***** 2020-11-12T17:19:32.451 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-12T17:19:32.459 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.488 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.064) 0:02:27.576 ***** 2020-11-12T17:19:32.516 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:32.518 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.551 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.062) 0:02:27.639 ***** 2020-11-12T17:19:32.578 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:32.580 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.612 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.061) 0:02:27.700 ***** 2020-11-12T17:19:32.630 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-12T17:19:32.632 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-12T17:19:32.642 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-12T17:19:32.644 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.676 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.064) 0:02:27.764 ***** 2020-11-12T17:19:32.704 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-12T17:19:32.705 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.737 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.061) 0:02:27.826 ***** 2020-11-12T17:19:32.765 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-12T17:19:32.767 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:32.799 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:32 +0000 (0:00:00.061) 0:02:27.887 ***** 2020-11-12T17:19:32.879 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-12T17:19:33.103 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-12T17:19:33.151 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:33 +0000 (0:00:00.351) 0:02:28.239 ***** 2020-11-12T17:19:33.199 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-12T17:19:33.201 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-12T17:19:33.237 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:33 +0000 (0:00:00.086) 0:02:28.325 ***** 2020-11-12T17:19:33.286 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-12T17:19:33.288 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-12T17:19:33.323 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:33 +0000 (0:00:00.085) 0:02:28.411 ***** 2020-11-12T17:19:33.487 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-12T17:19:33.488 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-12T17:19:33.541 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-12T17:19:33.542 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-12T17:19:33.594 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-12T17:19:33.596 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-12T17:19:33.707 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-12T17:19:33.782 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-12T17:19:33.783 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-12T17:19:33.825 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-12T17:19:33.826 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-12T17:19:33.836 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:33.886 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:33 +0000 (0:00:00.562) 0:02:28.974 ***** 2020-11-12T17:19:34.023 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-12T17:19:34.025 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-11-12T17:19:34.061 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:34 +0000 (0:00:00.174) 0:02:29.148 ***** 2020-11-12T17:19:34.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-12T17:19:34.101 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-12T17:19:34.135 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:34 +0000 (0:00:00.075) 0:02:29.223 ***** 2020-11-12T17:19:34.268 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-12T17:19:34.270 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-12T17:19:34.520 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-12T17:19:34.556 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:34 +0000 (0:00:00.420) 0:02:29.644 ***** 2020-11-12T17:19:34.626 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-12T17:19:34.628 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true} 2020-11-12T17:19:34.665 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:34 +0000 (0:00:00.108) 0:02:29.753 ***** 2020-11-12T17:19:34.694 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-12T17:19:34.695 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-12T17:19:34.735 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:34 +0000 (0:00:00.070) 0:02:29.823 ***** 2020-11-12T17:19:34.884 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-12T17:19:34.886 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-12T17:19:35.004 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-12T17:19:35.121 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-12T17:19:35.143 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-12T17:19:35.144 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-12T17:19:35.182 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:35 +0000 (0:00:00.446) 0:02:30.270 ***** 2020-11-12T17:19:35.253 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-12T17:19:35.255 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-12T17:19:35.265 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:35.305 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:35 +0000 (0:00:00.122) 0:02:30.393 ***** 2020-11-12T17:19:35.323 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-12T17:19:35.324 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-11-12T17:19:35.362 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:35 +0000 (0:00:00.057) 0:02:30.450 ***** 2020-11-12T17:19:35.444 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-12T17:19:35.445 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-11-12T17:19:35.484 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:35 +0000 (0:00:00.121) 0:02:30.572 ***** 2020-11-12T17:19:35.504 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-12T17:19:35.506 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-11-12T17:19:35.540 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:35 +0000 (0:00:00.055) 0:02:30.628 ***** 2020-11-12T17:19:35.547 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-12T17:19:35.584 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:35 +0000 (0:00:00.044) 0:02:30.672 ***** 2020-11-12T17:19:35.803 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-12T17:19:35.805 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"changed": true} 2020-11-12T17:19:35.842 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:35 +0000 (0:00:00.257) 0:02:30.930 ***** 2020-11-12T17:19:35.880 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-12T17:19:35.882 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-11-12T17:19:35.916 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:35 +0000 (0:00:00.074) 0:02:31.004 ***** 2020-11-12T17:19:36.062 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-12T17:19:36.064 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-12T17:19:36.098 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:36 +0000 (0:00:00.181) 0:02:31.186 ***** 2020-11-12T17:19:36.241 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-12T17:19:36.242 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-11-12T17:19:36.279 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:36 +0000 (0:00:00.180) 0:02:31.367 ***** 2020-11-12T17:19:36.285 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-12T17:19:36.287 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-11-12T17:19:36.323 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:36 +0000 (0:00:00.044) 0:02:31.411 ***** 2020-11-12T17:19:36.416 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-12T17:19:36.418 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-11-12T17:19:36.468 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:36 +0000 (0:00:00.144) 0:02:31.556 ***** 2020-11-12T17:19:36.813 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-12T17:19:36.815 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-11-12T17:19:36.854 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:36 +0000 (0:00:00.385) 0:02:31.942 ***** 2020-11-12T17:19:37.192 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-12T17:19:37.194 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-11-12T17:19:37.226 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:37 +0000 (0:00:00.372) 0:02:32.315 ***** 2020-11-12T17:19:37.243 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-12T17:19:37.245 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:19:37.280 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:37 +0000 (0:00:00.053) 0:02:32.368 ***** 2020-11-12T17:19:37.467 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-12T17:19:37.469 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.048066", "end": "2020-11-12 17:19:37.444568", "rc": 0, "start": "2020-11-12 17:19:37.396502", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-11-12T17:19:37.505 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:37 +0000 (0:00:00.225) 0:02:32.593 ***** 2020-11-12T17:19:37.544 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:37.578 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:37 +0000 (0:00:00.072) 0:02:32.666 ***** 2020-11-12T17:19:37.606 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-12T17:19:37.608 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:37.641 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:37 +0000 (0:00:00.062) 0:02:32.729 ***** 2020-11-12T17:19:38.139 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-12T17:19:38.140 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:19:38.181 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:38 +0000 (0:00:00.539) 0:02:33.269 ***** 2020-11-12T17:19:38.369 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-12T17:19:38.370 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.043242", "end": "2020-11-12 17:19:37.933488", "rc": 0, "start": "2020-11-12 17:19:37.890246", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-11-12T17:19:38.404 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:38 +0000 (0:00:00.223) 0:02:33.492 ***** 2020-11-12T17:19:38.431 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-12T17:19:38.433 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:38.469 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:38 +0000 (0:00:00.065) 0:02:33.557 ***** 2020-11-12T17:19:38.497 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:38.535 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:38 +0000 (0:00:00.066) 0:02:33.623 ***** 2020-11-12T17:19:38.542 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-12T17:19:38.544 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:19:38.580 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:38 +0000 (0:00:00.043) 0:02:33.667 ***** 2020-11-12T17:19:38.608 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-12T17:19:38.610 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:38.651 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:38 +0000 (0:00:00.071) 0:02:33.739 ***** 2020-11-12T17:19:38.987 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-12T17:19:38.989 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-11-12T17:19:39.022 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:39 +0000 (0:00:00.371) 0:02:34.110 ***** 2020-11-12T17:19:39.054 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-12T17:19:39.056 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:39.089 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:39 +0000 (0:00:00.066) 0:02:34.177 ***** 2020-11-12T17:19:39.289 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-12T17:19:39.290 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-11-12 17:16:48 UTC", "ActiveEnterTimestampMonotonic": "26630727", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target sysinit.target basic.target systemd-journald.socket systemd-tmpfiles-setup.service -.mount system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-11-12 17:16:40 UTC", "AssertTimestampMonotonic": "20148963", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-11-12 17:16:40 UTC", "ConditionTimestampMonotonic": "20148963", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-11-12T17:19:39.292 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1743", "ExecMainStartTimestamp": "Thu 2020-11-12 17:16:48 UTC", "ExecMainStartTimestampMonotonic": "26630715", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-11-12 17:16:40 UTC", "InactiveExitTimestampMonotonic": "20149677", "InvocationID": "cad760620fcb4c358b02d02d87eeb02d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-11-12T17:19:39.294 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1743", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-11-12 17:16:48 UTC", "S 2020-11-12T17:19:39.302 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "26630727", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-11-12 17:16:48 UTC", "WatchdogTimestampMonotonic": "26630726", "WatchdogUSec": "0"}} 2020-11-12T17:19:39.328 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:39 +0000 (0:00:00.238) 0:02:34.416 ***** 2020-11-12T17:19:39.356 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:39.358 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-12T17:19:39.393 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:39 +0000 (0:00:00.065) 0:02:34.481 ***** 2020-11-12T17:19:39.420 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:39.422 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:39.463 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:39 +0000 (0:00:00.069) 0:02:34.551 ***** 2020-11-12T17:19:39.472 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-12T17:19:39.473 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:19:39.507 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:39 +0000 (0:00:00.044) 0:02:34.595 ***** 2020-11-12T17:19:39.514 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-12T17:19:39.515 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:39.552 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:39 +0000 (0:00:00.044) 0:02:34.640 ***** 2020-11-12T17:19:39.559 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-12T17:19:39.560 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:39.595 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:39 +0000 (0:00:00.043) 0:02:34.683 ***** 2020-11-12T17:19:39.910 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-12T17:19:39.912 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-11-12T17:19:39.950 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:39 +0000 (0:00:00.355) 0:02:35.038 ***** 2020-11-12T17:19:39.978 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-12T17:19:39.980 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:40.012 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:40 +0000 (0:00:00.062) 0:02:35.100 ***** 2020-11-12T17:19:40.232 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-12T17:19:40.234 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-11-12 17:16:59 UTC", "ActiveEnterTimestampMonotonic": "24227805", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket system.slice -.mount network.target basic.target sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-11-12 17:16:53 UTC", "AssertTimestampMonotonic": "17616084", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-11-12 17:16:53 UTC", "ConditionTimestampMonotonic": "17616083", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-11-12T17:19:40.236 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1980", "ExecMainStartTimestamp": "Thu 2020-11-12 17:16:59 UTC", "ExecMainStartTimestampMonotonic": "24227756", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-11-12 17:16:53 UTC", "InactiveExitTimestampMonotonic": "17616918", "InvocationID": "65c4c832dbc34252bf9add9636811397", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-11-12T17:19:40.238 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1980", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-11-12 17:16:59 UTC", "S 2020-11-12T17:19:40.239 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "24227805", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-11-12 17:16:59 UTC", "WatchdogTimestampMonotonic": "24227802", "WatchdogUSec": "0"}} 2020-11-12T17:19:40.272 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:40 +0000 (0:00:00.259) 0:02:35.360 ***** 2020-11-12T17:19:40.301 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:40.303 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-12T17:19:40.353 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:40 +0000 (0:00:00.081) 0:02:35.441 ***** 2020-11-12T17:19:40.380 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:40.382 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:40.419 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:40 +0000 (0:00:00.065) 0:02:35.507 ***** 2020-11-12T17:19:40.458 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-12T17:19:40.460 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:40.499 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:40 +0000 (0:00:00.079) 0:02:35.587 ***** 2020-11-12T17:19:40.506 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-12T17:19:40.508 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1605201215, "cache_updated": false, "changed": false} 2020-11-12T17:19:40.555 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:40 +0000 (0:00:00.056) 0:02:35.644 ***** 2020-11-12T17:19:40.599 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-12T17:19:40.601 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:40.636 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:40 +0000 (0:00:00.080) 0:02:35.725 ***** 2020-11-12T17:19:40.770 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-12T17:19:40.772 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-11-12T17:19:40.807 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:40 +0000 (0:00:00.170) 0:02:35.895 ***** 2020-11-12T17:19:41.139 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-12T17:19:41.141 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-11-12T17:19:41.174 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:41 +0000 (0:00:00.367) 0:02:36.263 ***** 2020-11-12T17:19:41.383 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-12T17:19:41.385 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"cache_update_time": 1605201260, "cache_updated": false, "changed": false} 2020-11-12T17:19:41.429 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:41 +0000 (0:00:00.254) 0:02:36.517 ***** 2020-11-12T17:19:41.469 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:41.516 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:41 +0000 (0:00:00.086) 0:02:36.604 ***** 2020-11-12T17:19:41.792 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-12T17:19:41.794 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-11-12T17:19:41.832 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:41 +0000 (0:00:00.316) 0:02:36.920 ***** 2020-11-12T17:19:42.228 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-12T17:19:42.230 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-12T17:19:42.265 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:42 +0000 (0:00:00.432) 0:02:37.353 ***** 2020-11-12T17:19:42.275 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-12T17:19:42.277 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-11-12T17:19:42.319 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:42 +0000 (0:00:00.054) 0:02:37.407 ***** 2020-11-12T17:19:42.798 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-12T17:19:42.800 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false} 2020-11-12T17:19:42.836 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:42 +0000 (0:00:00.517) 0:02:37.925 ***** 2020-11-12T17:19:42.878 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-11-12T17:19:42.917 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:42 +0000 (0:00:00.080) 0:02:38.005 ***** 2020-11-12T17:19:43.063 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-12T17:19:43.065 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1605201162.2999496, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1605201162.2959497, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 8056, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1605201162.2959497, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "3017472389", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-11-12T17:19:43.110 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:43 +0000 (0:00:00.192) 0:02:38.197 ***** 2020-11-12T17:19:43.118 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-12T17:19:43.120 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-12T17:19:43.163 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:43 +0000 (0:00:00.053) 0:02:38.251 ***** 2020-11-12T17:19:43.372 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-12T17:19:43.374 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-11-12T17:19:43.414 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:43 +0000 (0:00:00.250) 0:02:38.502 ***** 2020-11-12T17:19:43.442 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-12T17:19:43.444 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-12T17:19:43.501 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:43 +0000 (0:00:00.087) 0:02:38.589 ***** 2020-11-12T17:19:43.533 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:43.571 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:43 +0000 (0:00:00.069) 0:02:38.659 ***** 2020-11-12T17:19:43.683 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-12T17:19:43.685 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false} 2020-11-12T17:19:43.720 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:43 +0000 (0:00:00.148) 0:02:38.808 ***** 2020-11-12T17:19:43.727 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-12T17:19:43.729 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-12T17:19:43.765 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:43 +0000 (0:00:00.045) 0:02:38.853 ***** 2020-11-12T17:19:43.775 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-12T17:19:43.777 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-12T17:19:43.818 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:43 +0000 (0:00:00.052) 0:02:38.906 ***** 2020-11-12T17:19:43.892 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-12T17:19:43.893 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-12T17:19:43.931 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:43 +0000 (0:00:00.112) 0:02:39.019 ***** 2020-11-12T17:19:43.959 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:43.960 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-12T17:19:43.960 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1605201197.842561, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1605201197.838559, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 8056, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1605201197.838559, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3017472389", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-11-12T17:19:44.008 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.077) 0:02:39.096 ***** 2020-11-12T17:19:44.047 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.038) 0:02:39.134 ***** 2020-11-12T17:19:44.054 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-12T17:19:44.056 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.067 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.068 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.106 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.059) 0:02:39.195 ***** 2020-11-12T17:19:44.145 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-12T17:19:44.147 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.158 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.169 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.204 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.097) 0:02:39.292 ***** 2020-11-12T17:19:44.211 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-12T17:19:44.213 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-11-12T17:19:44.246 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.042) 0:02:39.334 ***** 2020-11-12T17:19:44.253 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:44.255 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.294 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.047) 0:02:39.382 ***** 2020-11-12T17:19:44.302 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-12T17:19:44.303 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-12T17:19:44.338 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.043) 0:02:39.426 ***** 2020-11-12T17:19:44.345 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-12T17:19:44.347 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.388 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.049) 0:02:39.476 ***** 2020-11-12T17:19:44.395 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-12T17:19:44.397 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.431 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.042) 0:02:39.519 ***** 2020-11-12T17:19:44.439 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-12T17:19:44.441 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.477 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.045) 0:02:39.565 ***** 2020-11-12T17:19:44.504 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-12T17:19:44.506 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.538 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.060) 0:02:39.626 ***** 2020-11-12T17:19:44.565 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-12T17:19:44.567 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi205.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-12T17:19:44.602 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.064) 0:02:39.690 ***** 2020-11-12T17:19:44.634 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.032) 0:02:39.722 ***** 2020-11-12T17:19:44.641 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-12T17:19:44.643 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.684 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.049) 0:02:39.772 ***** 2020-11-12T17:19:44.725 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-12T17:19:44.727 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.765 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.080) 0:02:39.853 ***** 2020-11-12T17:19:44.772 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-12T17:19:44.774 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-12T17:19:44.811 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.046) 0:02:39.899 ***** 2020-11-12T17:19:44.821 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-12T17:19:44.823 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.869 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.057) 0:02:39.957 ***** 2020-11-12T17:19:44.879 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-12T17:19:44.881 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.918 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:44 +0000 (0:00:00.048) 0:02:40.006 ***** 2020-11-12T17:19:44.967 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-12T17:19:44.969 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi205.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.979 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:44.981 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.020 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.101) 0:02:40.108 ***** 2020-11-12T17:19:45.038 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-12T17:19:45.039 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010976", "end": "2020-11-12 17:19:44.999781", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-12 17:19:44.988805", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:45.062 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-12T17:19:45.064 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.073 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.074 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.076 INFO:teuthology.task.ansible.out: skipping: [smithi205.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.087 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.123 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.103) 0:02:40.211 ***** 2020-11-12T17:19:45.150 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-12T17:19:45.151 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.188 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.064) 0:02:40.276 ***** 2020-11-12T17:19:45.195 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-12T17:19:45.197 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006071", "end": "2020-11-12 17:19:45.126948", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-12 17:19:45.120877", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:45.218 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.252 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.064) 0:02:40.340 ***** 2020-11-12T17:19:45.269 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-12T17:19:45.271 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005548", "end": "2020-11-12 17:19:45.247112", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-12 17:19:45.241564", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:45.281 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-12T17:19:45.283 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.332 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.080) 0:02:40.420 ***** 2020-11-12T17:19:45.360 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-12T17:19:45.362 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.395 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.062) 0:02:40.483 ***** 2020-11-12T17:19:45.422 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-12T17:19:45.424 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.029857", "end": "2020-11-12 17:19:45.396335", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-12 17:19:45.366478", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:45.424 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-12T17:19:45.425 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.459 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.063) 0:02:40.547 ***** 2020-11-12T17:19:45.495 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.036) 0:02:40.583 ***** 2020-11-12T17:19:45.502 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-12T17:19:45.542 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.047) 0:02:40.630 ***** 2020-11-12T17:19:45.549 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-12T17:19:45.551 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.592 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.049) 0:02:40.680 ***** 2020-11-12T17:19:45.630 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-12T17:19:45.632 INFO:teuthology.task.ansible.out:skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.668 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.075) 0:02:40.756 ***** 2020-11-12T17:19:45.675 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-12T17:19:45.677 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-11-12T17:19:45.715 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi205.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-12T17:19:45.769 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:45 +0000 (0:00:00.100) 0:02:40.857 ***** 2020-11-12T17:19:45.932 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-12T17:19:45.933 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011151", "end": "2020-11-12 17:19:45.491435", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-12 17:19:45.480284", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:46.054 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006071", "end": "2020-11-12 17:19:45.624536", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-12 17:19:45.618465", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:46.179 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005571", "end": "2020-11-12 17:19:45.745511", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-12 17:19:45.739940", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:46.378 INFO:teuthology.task.ansible.out:ok: [smithi205.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.083071", "end": "2020-11-12 17:19:45.946888", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-12 17:19:45.863817", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-12T17:19:46.415 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:46 +0000 (0:00:00.646) 0:02:41.503 ***** 2020-11-12T17:19:46.442 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-12T17:19:46.476 INFO:teuthology.task.ansible.out:Thursday 12 November 2020 17:19:46 +0000 (0:00:00.060) 0:02:41.564 ***** 2020-11-12T17:19:46.607 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-12T17:19:46.609 INFO:teuthology.task.ansible.out:changed: [smithi205.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-11-12T17:19:46.708 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-11-12T17:19:46.712 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-11-12T17:19:46.714 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-11-12T17:19:46.716 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-11-12T17:19:46.717 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi036.front.sepia.ceph.com : ok=114 changed=31 unreachable=0 failed=0 skipped=175 rescued=0 ignored=0 smithi205.front.sepia.ceph.com : ok=114 changed=31 unreachable=0 failed=0 skipped=175 rescued=0 ignored=0 Thursday 12 November 2020 17:19:46 +0000 (0:00:00.240) 0:02:41.805 ***** =============================================================================== users : Create all admin users with sudo access. ----------------------- 26.46s users : Update authorized_keys using the keys repo --------------------- 21.35s testnode : Ensure packages are not present. ----------------------------- 8.74s testnode : Install packages --------------------------------------------- 8.01s testnode : Zap all non-root disks --------------------------------------- 6.94s users : Remove revoked users -------------------------------------------- 5.55s common : Update apt cache ----------------------------------------------- 3.28s testnode : Update apt cache. -------------------------------------------- 2.96s testnode : Install apt keys --------------------------------------------- 2.19s Gathering Facts --------------------------------------------------------- 2.13s users : Clone the keys repo --------------------------------------------- 1.27s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 1.04s testnode : Make sure apt dependencies are installed --------------------- 0.95s testnode : Upgrade packages --------------------------------------------- 0.91s testnode : Install python-apt ------------------------------------------- 0.89s Gathering Facts --------------------------------------------------------- 0.88s testnode : Set the system's hostname ------------------------------------ 0.87s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.82s users 2020-11-12T17:19:46.719 INFO:teuthology.task.ansible.out:: Update authorized_keys for each user with literal keys ---------- 0.80s common : Make sure smartmontools is installed --------------------------- 0.72s 2020-11-12T17:19:47.127 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi036.front.sepia.ceph.com'), Remote(name='ubuntu@smithi205.front.sepia.ceph.com')] 2020-11-12T17:19:47.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:19:47.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:19:47.256 INFO:teuthology.orchestra.run.smithi036:> true 2020-11-12T17:19:47.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-12T17:19:47.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi205.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-12T17:19:47.520 INFO:teuthology.orchestra.run.smithi205:> true 2020-11-12T17:19:47.719 INFO:teuthology.run_tasks:Running task clock... 2020-11-12T17:19:47.729 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-12T17:19:47.730 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-12T17:19:47.730 INFO:teuthology.orchestra.run.smithi036:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-12T17:19:47.779 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-11-12T17:19:47.780 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: Command line: ntpd -gq 2020-11-12T17:19:47.782 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: proto: precision = 0.130 usec (-23) 2020-11-12T17:19:47.783 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-12T17:19:47.783 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: restrict ::: KOD does nothing without LIMITED. 2020-11-12T17:19:47.783 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: Listen and drop on 0 v6wildcard [::]:123 2020-11-12T17:19:47.784 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-11-12T17:19:47.784 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: Listen normally on 2 lo 127.0.0.1:123 2020-11-12T17:19:47.784 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: Listen normally on 3 ens1f0 172.21.15.36:123 2020-11-12T17:19:47.784 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: Listen normally on 4 lo [::1]:123 2020-11-12T17:19:47.785 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2542%3]:123 2020-11-12T17:19:47.785 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:47 ntpd[7834]: Listening on routing socket on fd #22 for interface updates 2020-11-12T17:19:47.785 INFO:teuthology.orchestra.run.smithi036.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-12T17:19:47.786 INFO:teuthology.orchestra.run.smithi036.stderr:restrict ::: KOD does nothing without LIMITED. 2020-11-12T17:19:50.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:50 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:50.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:50 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:50.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:50 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:50.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:50 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:50.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:50 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:50.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:50 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:50.782 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:50 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:50.782 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:50 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:51.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:51 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:51.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:51 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:51.782 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:51 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:51.782 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:51 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:51.782 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:51 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:51.782 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:51 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:51.782 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:51 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:51.782 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:51 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:52 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:52 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:52.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:52 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:52.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:52 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:52.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:52 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:52.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:52 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:52.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:52 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:52.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:52 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:53.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:53 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:53.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:53 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:53.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:53 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:53.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:53 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:53.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:53 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:53.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:53 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:53.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:53 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:53.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:53 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:54.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:54 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:54.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:54 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:54.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:54 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:54.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:54 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:54.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:54 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:54.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:54 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:54.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:54 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:54.782 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:54 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:55.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:55 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:55.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:55 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:55.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:55 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:55.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:55 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:55.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:55 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:55.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:55 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:55.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:55 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:55.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:55 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:56.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:56 ntpd[7834]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:56.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:56 ntpd[7834]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:56.780 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:56 ntpd[7834]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:56.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:56 ntpd[7834]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:56.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:56 ntpd[7834]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-11-12T17:19:56.781 INFO:teuthology.orchestra.run.smithi036.stderr:12 Nov 17:19:56 ntpd[7834]: can't open /var/log/ntpstats/loopstats.20201112: Permission denied 2020-11-12T17:19:56.781 INFO:teuthology.orchestra.run.smithi036.stdout:12 Nov 17:19:56 ntpd[7834]: ntpd: time slew -0.003540 s 2020-11-12T17:19:56.781 INFO:teuthology.orchestra.run.smithi036.stdout:ntpd: time slew -0.003540s 2020-11-12T17:19:56.833 INFO:teuthology.orchestra.run.smithi036.stdout: remote refid st t when poll reach delay offset jitter 2020-11-12T17:19:56.848 INFO:teuthology.orchestra.run.smithi036.stdout:============================================================================== 2020-11-12T17:19:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-12T17:19:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-12T17:19:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-12T17:19:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-12T17:19:56.849 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-12T17:19:56.849 INFO:teuthology.orchestra.run.smithi205:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-12T17:19:56.907 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-11-12T17:19:56.907 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: Command line: ntpd -gq 2020-11-12T17:19:56.907 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: proto: precision = 0.123 usec (-23) 2020-11-12T17:19:56.909 INFO:teuthology.orchestra.run.smithi205.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-12T17:19:56.909 INFO:teuthology.orchestra.run.smithi205.stderr:restrict ::: KOD does nothing without LIMITED. 2020-11-12T17:19:56.909 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-12T17:19:56.909 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: restrict ::: KOD does nothing without LIMITED. 2020-11-12T17:19:56.909 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: Listen and drop on 0 v6wildcard [::]:123 2020-11-12T17:19:56.909 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-11-12T17:19:56.910 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: Listen normally on 2 lo 127.0.0.1:123 2020-11-12T17:19:56.910 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: Listen normally on 3 enp3s0f1 172.21.15.205:123 2020-11-12T17:19:56.910 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: Listen normally on 4 lo [::1]:123 2020-11-12T17:19:56.910 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7313%5]:123 2020-11-12T17:19:56.910 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:19:56 ntpd[7968]: Listening on routing socket on fd #22 for interface updates 2020-11-12T17:19:57.913 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:57.914 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:57.914 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:57.914 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:57.915 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:57.915 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:57.915 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:57.916 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:57.916 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:57.916 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:57.916 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:57.917 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:57 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:58.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:58 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:58.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:58 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:58.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:58 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:58.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:58 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:59.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:59.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:59.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:59.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:59.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:59.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:59.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:59.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:19:59.908 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:19:59.908 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:19:59.908 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:19:59.908 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:19:59 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:20:00.905 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:00 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:20:00.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:00 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:20:00.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:00 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:20:00.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:00 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:20:01.905 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:20:01.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:20:01.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:20:01.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:20:01.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:20:01.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:20:01.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:20:01.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:20:01.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:20:01.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:20:01.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:20:01.907 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:01 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:20:02.905 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:02 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:20:02.905 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:02 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:20:02.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:02 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:20:02.906 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:02 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:20:03.904 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:03 ntpd[7968]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-12T17:20:03.904 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:03 ntpd[7968]: can't open /var/log/ntpstats/rawstats.20201112: Permission denied 2020-11-12T17:20:03.905 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:03 ntpd[7968]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-12T17:20:03.905 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:03 ntpd[7968]: can't open /var/log/ntpstats/peerstats.20201112: Permission denied 2020-11-12T17:20:03.905 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:03 ntpd[7968]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-11-12T17:20:03.905 INFO:teuthology.orchestra.run.smithi205.stderr:12 Nov 17:20:03 ntpd[7968]: can't open /var/log/ntpstats/loopstats.20201112: Permission denied 2020-11-12T17:20:03.906 INFO:teuthology.orchestra.run.smithi205.stdout:12 Nov 17:20:03 ntpd[7968]: ntpd: time set +0.394051 s 2020-11-12T17:20:03.906 INFO:teuthology.orchestra.run.smithi205.stdout:ntpd: time set +0.394051s 2020-11-12T17:20:04.045 INFO:teuthology.orchestra.run.smithi205.stdout: remote refid st t when poll reach delay offset jitter 2020-11-12T17:20:04.045 INFO:teuthology.orchestra.run.smithi205.stdout:============================================================================== 2020-11-12T17:20:04.045 INFO:teuthology.orchestra.run.smithi205.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-12T17:20:04.045 INFO:teuthology.orchestra.run.smithi205.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-12T17:20:04.046 INFO:teuthology.orchestra.run.smithi205.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-12T17:20:04.046 INFO:teuthology.orchestra.run.smithi205.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-12T17:20:04.046 INFO:teuthology.run_tasks:Running task install... 2020-11-12T17:20:04.059 DEBUG:teuthology.task.install:project ceph 2020-11-12T17:20:04.061 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af'}} 2020-11-12T17:20:04.061 DEBUG:teuthology.task.install:config {'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af'} 2020-11-12T17:20:04.062 INFO:teuthology.task.install:Using flavor: basic 2020-11-12T17:20:04.073 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-12T17:20:04.074 INFO:teuthology.task.install:extra packages: [] 2020-11-12T17:20:04.076 INFO:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2020-11-12T17:20:04.131 INFO:teuthology.orchestra.run.smithi036.stdout:Ubuntu 2020-11-12T17:20:04.138 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-12T17:20:04.138 INFO:teuthology.orchestra.run.smithi205:> sudo lsb_release -is 2020-11-12T17:20:04.140 INFO:teuthology.orchestra.run.smithi036:> sudo apt-key list | grep Ceph 2020-11-12T17:20:04.192 INFO:teuthology.orchestra.run.smithi205.stdout:Ubuntu 2020-11-12T17:20:04.197 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-12T17:20:04.198 INFO:teuthology.orchestra.run.smithi205:> sudo apt-key list | grep Ceph 2020-11-12T17:20:04.239 INFO:teuthology.orchestra.run.smithi036.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-11-12T17:20:04.295 INFO:teuthology.orchestra.run.smithi205.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-11-12T17:20:04.326 INFO:teuthology.orchestra.run.smithi036.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-11-12T17:20:04.326 INFO:teuthology.orchestra.run.smithi036.stdout:uid [ unknown] Ceph.com (release key) 2020-11-12T17:20:04.331 INFO:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2020-11-12T17:20:04.347 INFO:teuthology.orchestra.run.smithi205.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-11-12T17:20:04.347 INFO:teuthology.orchestra.run.smithi205.stdout:uid [ unknown] Ceph.com (release key) 2020-11-12T17:20:04.349 INFO:teuthology.orchestra.run.smithi205:> sudo lsb_release -is 2020-11-12T17:20:04.388 INFO:teuthology.orchestra.run.smithi036.stdout:Ubuntu 2020-11-12T17:20:04.394 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-12T17:20:04.394 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2020-11-12T17:20:04.401 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=31d4e76d0d584790763b4b1146b29ea4cfc2e9af 2020-11-12T17:20:04.411 INFO:teuthology.orchestra.run.smithi205.stdout:Ubuntu 2020-11-12T17:20:04.412 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-12T17:20:04.412 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2020-11-12T17:20:04.413 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=31d4e76d0d584790763b4b1146b29ea4cfc2e9af 2020-11-12T17:20:05.010 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default/ 2020-11-12T17:20:05.011 INFO:teuthology.task.install.deb:Package version is 15.2.5-585-g31d4e76d-1bionic 2020-11-12T17:20:05.029 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default/ 2020-11-12T17:20:05.029 INFO:teuthology.task.install.deb:Package version is 15.2.5-585-g31d4e76d-1bionic 2020-11-12T17:20:05.218 INFO:teuthology.orchestra.run.smithi205:> set -ex 2020-11-12T17:20:05.219 INFO:teuthology.orchestra.run.smithi205:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-12T17:20:05.224 INFO:teuthology.orchestra.run.smithi205.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-12T17:20:05.232 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records in 2020-11-12T17:20:05.232 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records out 2020-11-12T17:20:05.232 INFO:teuthology.orchestra.run.smithi205.stderr:143 bytes copied, 7.1287e-05 s, 2.0 MB/s 2020-11-12T17:20:05.233 INFO:teuthology.orchestra.run.smithi205:> sudo apt-get update 2020-11-12T17:20:05.259 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-12T17:20:05.260 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-12T17:20:05.266 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-12T17:20:05.275 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-12T17:20:05.275 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-12T17:20:05.276 INFO:teuthology.orchestra.run.smithi036.stderr:143 bytes copied, 7.157e-05 s, 2.0 MB/s 2020-11-12T17:20:05.277 INFO:teuthology.orchestra.run.smithi036:> sudo apt-get update 2020-11-12T17:20:05.542 INFO:teuthology.orchestra.run.smithi205.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-12T17:20:05.542 INFO:teuthology.orchestra.run.smithi205.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-12T17:20:05.583 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-12T17:20:05.583 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-12T17:20:05.587 INFO:teuthology.orchestra.run.smithi205.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic InRelease 2020-11-12T17:20:05.610 INFO:teuthology.orchestra.run.smithi205.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-12T17:20:05.631 INFO:teuthology.orchestra.run.smithi205.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-11-12T17:20:05.638 INFO:teuthology.orchestra.run.smithi036.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic InRelease 2020-11-12T17:20:05.653 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-12T17:20:05.675 INFO:teuthology.orchestra.run.smithi205.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic Release.gpg 2020-11-12T17:20:05.716 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-11-12T17:20:05.716 INFO:teuthology.orchestra.run.smithi205.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-12T17:20:05.718 INFO:teuthology.orchestra.run.smithi205.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2020-11-12T17:20:05.724 INFO:teuthology.orchestra.run.smithi036.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic Release.gpg 2020-11-12T17:20:05.732 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-12T17:20:05.767 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2020-11-12T17:20:05.782 INFO:teuthology.orchestra.run.smithi205.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,086 B] 2020-11-12T17:20:05.829 INFO:teuthology.orchestra.run.smithi036.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,086 B] 2020-11-12T17:20:06.142 INFO:teuthology.orchestra.run.smithi205.stdout:Fetched 26.6 kB in 1s (37.4 kB/s) 2020-11-12T17:20:06.199 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 26.6 kB in 1s (37.4 kB/s) 2020-11-12T17:20:07.373 INFO:teuthology.orchestra.run.smithi205.stdout:Reading package lists... 2020-11-12T17:20:07.423 INFO:teuthology.orchestra.run.smithi205:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.5-585-g31d4e76d-1bionic cephadm=15.2.5-585-g31d4e76d-1bionic ceph-mds=15.2.5-585-g31d4e76d-1bionic ceph-mgr=15.2.5-585-g31d4e76d-1bionic ceph-common=15.2.5-585-g31d4e76d-1bionic ceph-fuse=15.2.5-585-g31d4e76d-1bionic ceph-test=15.2.5-585-g31d4e76d-1bionic radosgw=15.2.5-585-g31d4e76d-1bionic python3-rados=15.2.5-585-g31d4e76d-1bionic python3-rgw=15.2.5-585-g31d4e76d-1bionic python3-cephfs=15.2.5-585-g31d4e76d-1bionic python3-rbd=15.2.5-585-g31d4e76d-1bionic libcephfs2=15.2.5-585-g31d4e76d-1bionic libcephfs-dev=15.2.5-585-g31d4e76d-1bionic librados2=15.2.5-585-g31d4e76d-1bionic librbd1=15.2.5-585-g31d4e76d-1bionic rbd-fuse=15.2.5-585-g31d4e76d-1bionic 2020-11-12T17:20:07.470 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2020-11-12T17:20:07.502 INFO:teuthology.orchestra.run.smithi205.stdout:Reading package lists... 2020-11-12T17:20:07.518 INFO:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.5-585-g31d4e76d-1bionic cephadm=15.2.5-585-g31d4e76d-1bionic ceph-mds=15.2.5-585-g31d4e76d-1bionic ceph-mgr=15.2.5-585-g31d4e76d-1bionic ceph-common=15.2.5-585-g31d4e76d-1bionic ceph-fuse=15.2.5-585-g31d4e76d-1bionic ceph-test=15.2.5-585-g31d4e76d-1bionic radosgw=15.2.5-585-g31d4e76d-1bionic python3-rados=15.2.5-585-g31d4e76d-1bionic python3-rgw=15.2.5-585-g31d4e76d-1bionic python3-cephfs=15.2.5-585-g31d4e76d-1bionic python3-rbd=15.2.5-585-g31d4e76d-1bionic libcephfs2=15.2.5-585-g31d4e76d-1bionic libcephfs-dev=15.2.5-585-g31d4e76d-1bionic librados2=15.2.5-585-g31d4e76d-1bionic librbd1=15.2.5-585-g31d4e76d-1bionic rbd-fuse=15.2.5-585-g31d4e76d-1bionic 2020-11-12T17:20:07.596 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2020-11-12T17:20:07.731 INFO:teuthology.orchestra.run.smithi205.stdout:Building dependency tree... 2020-11-12T17:20:07.732 INFO:teuthology.orchestra.run.smithi205.stdout:Reading state information... 2020-11-12T17:20:07.854 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2020-11-12T17:20:07.855 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2020-11-12T17:20:07.895 INFO:teuthology.orchestra.run.smithi205.stdout:The following additional packages will be installed: 2020-11-12T17:20:07.895 INFO:teuthology.orchestra.run.smithi205.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-11-12T17:20:07.895 INFO:teuthology.orchestra.run.smithi205.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-11-12T17:20:07.897 INFO:teuthology.orchestra.run.smithi205.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2020-11-12T17:20:07.897 INFO:teuthology.orchestra.run.smithi205.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-11-12T17:20:07.897 INFO:teuthology.orchestra.run.smithi205.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2020-11-12T17:20:07.897 INFO:teuthology.orchestra.run.smithi205.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-11-12T17:20:07.897 INFO:teuthology.orchestra.run.smithi205.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-11-12T17:20:07.897 INFO:teuthology.orchestra.run.smithi205.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-11-12T17:20:07.898 INFO:teuthology.orchestra.run.smithi205.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2020-11-12T17:20:07.898 INFO:teuthology.orchestra.run.smithi205.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-11-12T17:20:07.898 INFO:teuthology.orchestra.run.smithi205.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-11-12T17:20:07.898 INFO:teuthology.orchestra.run.smithi205.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-11-12T17:20:07.898 INFO:teuthology.orchestra.run.smithi205.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-11-12T17:20:07.898 INFO:teuthology.orchestra.run.smithi205.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-11-12T17:20:07.898 INFO:teuthology.orchestra.run.smithi205.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-11-12T17:20:07.899 INFO:teuthology.orchestra.run.smithi205.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-11-12T17:20:07.899 INFO:teuthology.orchestra.run.smithi205.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-11-12T17:20:07.899 INFO:teuthology.orchestra.run.smithi205.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-11-12T17:20:07.899 INFO:teuthology.orchestra.run.smithi205.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-11-12T17:20:07.899 INFO:teuthology.orchestra.run.smithi205.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-11-12T17:20:07.899 INFO:teuthology.orchestra.run.smithi205.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-11-12T17:20:07.899 INFO:teuthology.orchestra.run.smithi205.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-11-12T17:20:07.899 INFO:teuthology.orchestra.run.smithi205.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-11-12T17:20:07.900 INFO:teuthology.orchestra.run.smithi205.stdout:Suggested packages: 2020-11-12T17:20:07.900 INFO:teuthology.orchestra.run.smithi205.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-11-12T17:20:07.900 INFO:teuthology.orchestra.run.smithi205.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-11-12T17:20:07.900 INFO:teuthology.orchestra.run.smithi205.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-11-12T17:20:07.901 INFO:teuthology.orchestra.run.smithi205.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-11-12T17:20:07.901 INFO:teuthology.orchestra.run.smithi205.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-11-12T17:20:07.901 INFO:teuthology.orchestra.run.smithi205.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-11-12T17:20:07.901 INFO:teuthology.orchestra.run.smithi205.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-11-12T17:20:07.901 INFO:teuthology.orchestra.run.smithi205.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-11-12T17:20:07.901 INFO:teuthology.orchestra.run.smithi205.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-11-12T17:20:07.901 INFO:teuthology.orchestra.run.smithi205.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-11-12T17:20:07.902 INFO:teuthology.orchestra.run.smithi205.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-11-12T17:20:07.902 INFO:teuthology.orchestra.run.smithi205.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-11-12T17:20:07.902 INFO:teuthology.orchestra.run.smithi205.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-11-12T17:20:07.902 INFO:teuthology.orchestra.run.smithi205.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-11-12T17:20:07.902 INFO:teuthology.orchestra.run.smithi205.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-11-12T17:20:08.000 INFO:teuthology.orchestra.run.smithi205.stdout:The following NEW packages will be installed: 2020-11-12T17:20:08.000 INFO:teuthology.orchestra.run.smithi205.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-11-12T17:20:08.001 INFO:teuthology.orchestra.run.smithi205.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-11-12T17:20:08.001 INFO:teuthology.orchestra.run.smithi205.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-11-12T17:20:08.001 INFO:teuthology.orchestra.run.smithi205.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2020-11-12T17:20:08.001 INFO:teuthology.orchestra.run.smithi205.stdout: libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-11-12T17:20:08.002 INFO:teuthology.orchestra.run.smithi205.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2020-11-12T17:20:08.003 INFO:teuthology.orchestra.run.smithi205.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2020-11-12T17:20:08.003 INFO:teuthology.orchestra.run.smithi205.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-11-12T17:20:08.003 INFO:teuthology.orchestra.run.smithi205.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2020-11-12T17:20:08.003 INFO:teuthology.orchestra.run.smithi205.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2020-11-12T17:20:08.003 INFO:teuthology.orchestra.run.smithi205.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2020-11-12T17:20:08.003 INFO:teuthology.orchestra.run.smithi205.stdout: python3-httplib2 python3-jinja2 python3-joblib python3-json-pointer 2020-11-12T17:20:08.004 INFO:teuthology.orchestra.run.smithi205.stdout: python3-jsonpatch python3-jwt python3-kubernetes python3-logutils 2020-11-12T17:20:08.004 INFO:teuthology.orchestra.run.smithi205.stdout: python3-lxml python3-mako python3-markupsafe python3-matplotlib 2020-11-12T17:20:08.004 INFO:teuthology.orchestra.run.smithi205.stdout: python3-monotonic python3-numpy python3-oauth2client python3-olefile 2020-11-12T17:20:08.004 INFO:teuthology.orchestra.run.smithi205.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2020-11-12T17:20:08.004 INFO:teuthology.orchestra.run.smithi205.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py 2020-11-12T17:20:08.004 INFO:teuthology.orchestra.run.smithi205.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2020-11-12T17:20:08.004 INFO:teuthology.orchestra.run.smithi205.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-11-12T17:20:08.004 INFO:teuthology.orchestra.run.smithi205.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-11-12T17:20:08.005 INFO:teuthology.orchestra.run.smithi205.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-11-12T17:20:08.005 INFO:teuthology.orchestra.run.smithi205.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-11-12T17:20:08.005 INFO:teuthology.orchestra.run.smithi205.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-11-12T17:20:08.005 INFO:teuthology.orchestra.run.smithi205.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-11-12T17:20:08.005 INFO:teuthology.orchestra.run.smithi205.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-11-12T17:20:08.005 INFO:teuthology.orchestra.run.smithi205.stdout:The following packages will be upgraded: 2020-11-12T17:20:08.006 INFO:teuthology.orchestra.run.smithi205.stdout: librados2 librbd1 2020-11-12T17:20:08.030 INFO:teuthology.orchestra.run.smithi036.stdout:The following additional packages will be installed: 2020-11-12T17:20:08.031 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-11-12T17:20:08.031 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-11-12T17:20:08.031 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2020-11-12T17:20:08.031 INFO:teuthology.orchestra.run.smithi036.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-11-12T17:20:08.031 INFO:teuthology.orchestra.run.smithi036.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2020-11-12T17:20:08.032 INFO:teuthology.orchestra.run.smithi036.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-11-12T17:20:08.032 INFO:teuthology.orchestra.run.smithi036.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-11-12T17:20:08.032 INFO:teuthology.orchestra.run.smithi036.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-11-12T17:20:08.032 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2020-11-12T17:20:08.032 INFO:teuthology.orchestra.run.smithi036.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-11-12T17:20:08.032 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-11-12T17:20:08.032 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-11-12T17:20:08.033 INFO:teuthology.orchestra.run.smithi036.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-11-12T17:20:08.033 INFO:teuthology.orchestra.run.smithi036.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-11-12T17:20:08.033 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-11-12T17:20:08.033 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-11-12T17:20:08.033 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2020-11-12T17:20:08.033 INFO:teuthology.orchestra.run.smithi036.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-11-12T17:20:08.034 INFO:teuthology.orchestra.run.smithi036.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-11-12T17:20:08.034 INFO:teuthology.orchestra.run.smithi036.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-11-12T17:20:08.034 INFO:teuthology.orchestra.run.smithi036.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-11-12T17:20:08.034 INFO:teuthology.orchestra.run.smithi036.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-11-12T17:20:08.034 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-11-12T17:20:08.035 INFO:teuthology.orchestra.run.smithi036.stdout:Suggested packages: 2020-11-12T17:20:08.035 INFO:teuthology.orchestra.run.smithi036.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-11-12T17:20:08.035 INFO:teuthology.orchestra.run.smithi036.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-11-12T17:20:08.035 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-11-12T17:20:08.035 INFO:teuthology.orchestra.run.smithi036.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-11-12T17:20:08.036 INFO:teuthology.orchestra.run.smithi036.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-11-12T17:20:08.036 INFO:teuthology.orchestra.run.smithi036.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-11-12T17:20:08.036 INFO:teuthology.orchestra.run.smithi036.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-11-12T17:20:08.036 INFO:teuthology.orchestra.run.smithi036.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-11-12T17:20:08.036 INFO:teuthology.orchestra.run.smithi036.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-11-12T17:20:08.036 INFO:teuthology.orchestra.run.smithi036.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-11-12T17:20:08.036 INFO:teuthology.orchestra.run.smithi036.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-11-12T17:20:08.037 INFO:teuthology.orchestra.run.smithi036.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-11-12T17:20:08.037 INFO:teuthology.orchestra.run.smithi036.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-11-12T17:20:08.037 INFO:teuthology.orchestra.run.smithi036.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-11-12T17:20:08.037 INFO:teuthology.orchestra.run.smithi036.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-11-12T17:20:08.140 INFO:teuthology.orchestra.run.smithi036.stdout:The following NEW packages will be installed: 2020-11-12T17:20:08.170 INFO:teuthology.orchestra.run.smithi036.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-11-12T17:20:08.171 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-11-12T17:20:08.171 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-11-12T17:20:08.171 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2020-11-12T17:20:08.172 INFO:teuthology.orchestra.run.smithi205.stdout:2 upgraded, 111 newly installed, 0 to remove and 14 not upgraded. 2020-11-12T17:20:08.173 INFO:teuthology.orchestra.run.smithi205.stdout:Need to get 156 MB of archives. 2020-11-12T17:20:08.173 INFO:teuthology.orchestra.run.smithi205.stdout:After this operation, 724 MB of additional disk space will be used. 2020-11-12T17:20:08.173 INFO:teuthology.orchestra.run.smithi205.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.5-585-g31d4e76d-1bionic [1,633 kB] 2020-11-12T17:20:08.173 INFO:teuthology.orchestra.run.smithi036.stdout: libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-11-12T17:20:08.173 INFO:teuthology.orchestra.run.smithi036.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2020-11-12T17:20:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2020-11-12T17:20:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-11-12T17:20:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2020-11-12T17:20:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2020-11-12T17:20:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2020-11-12T17:20:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: python3-httplib2 python3-jinja2 python3-joblib python3-json-pointer 2020-11-12T17:20:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jsonpatch python3-jwt python3-kubernetes python3-logutils 2020-11-12T17:20:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: python3-lxml python3-mako python3-markupsafe python3-matplotlib 2020-11-12T17:20:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: python3-monotonic python3-numpy python3-oauth2client python3-olefile 2020-11-12T17:20:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2020-11-12T17:20:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py 2020-11-12T17:20:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2020-11-12T17:20:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-11-12T17:20:08.176 INFO:teuthology.orchestra.run.smithi036.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-11-12T17:20:08.176 INFO:teuthology.orchestra.run.smithi036.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-11-12T17:20:08.176 INFO:teuthology.orchestra.run.smithi036.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-11-12T17:20:08.176 INFO:teuthology.orchestra.run.smithi036.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-11-12T17:20:08.176 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-11-12T17:20:08.176 INFO:teuthology.orchestra.run.smithi036.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-11-12T17:20:08.176 INFO:teuthology.orchestra.run.smithi036.stdout:The following packages will be upgraded: 2020-11-12T17:20:08.177 INFO:teuthology.orchestra.run.smithi036.stdout: librados2 librbd1 2020-11-12T17:20:08.196 INFO:teuthology.orchestra.run.smithi205.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-11-12T17:20:08.273 INFO:teuthology.orchestra.run.smithi205.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-11-12T17:20:08.317 INFO:teuthology.orchestra.run.smithi036.stdout:2 upgraded, 111 newly installed, 0 to remove and 14 not upgraded. 2020-11-12T17:20:08.317 INFO:teuthology.orchestra.run.smithi036.stdout:Need to get 156 MB of archives. 2020-11-12T17:20:08.317 INFO:teuthology.orchestra.run.smithi036.stdout:After this operation, 724 MB of additional disk space will be used. 2020-11-12T17:20:08.318 INFO:teuthology.orchestra.run.smithi036.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.5-585-g31d4e76d-1bionic [1,633 kB] 2020-11-12T17:20:08.332 INFO:teuthology.orchestra.run.smithi036.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-11-12T17:20:08.412 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-11-12T17:20:08.476 INFO:teuthology.orchestra.run.smithi205.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.5-585-g31d4e76d-1bionic [3,057 kB] 2020-11-12T17:20:08.521 INFO:teuthology.orchestra.run.smithi205.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-11-12T17:20:08.531 INFO:teuthology.orchestra.run.smithi205.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-11-12T17:20:08.540 INFO:teuthology.orchestra.run.smithi205.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-11-12T17:20:08.645 INFO:teuthology.orchestra.run.smithi205.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-11-12T17:20:08.664 INFO:teuthology.orchestra.run.smithi205.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-11-12T17:20:08.671 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-11-12T17:20:08.678 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-11-12T17:20:08.684 INFO:teuthology.orchestra.run.smithi205.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-11-12T17:20:08.722 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-11-12T17:20:08.771 INFO:teuthology.orchestra.run.smithi205.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-11-12T17:20:08.773 INFO:teuthology.orchestra.run.smithi205.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-11-12T17:20:08.776 INFO:teuthology.orchestra.run.smithi205.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-11-12T17:20:08.777 INFO:teuthology.orchestra.run.smithi205.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2020-11-12T17:20:08.785 INFO:teuthology.orchestra.run.smithi205.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-11-12T17:20:08.786 INFO:teuthology.orchestra.run.smithi205.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-11-12T17:20:08.786 INFO:teuthology.orchestra.run.smithi205.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-11-12T17:20:08.789 INFO:teuthology.orchestra.run.smithi205.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-11-12T17:20:08.789 INFO:teuthology.orchestra.run.smithi205.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-11-12T17:20:08.822 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-11-12T17:20:08.822 INFO:teuthology.orchestra.run.smithi205.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.5-585-g31d4e76d-1bionic [436 kB] 2020-11-12T17:20:08.825 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-11-12T17:20:08.842 INFO:teuthology.orchestra.run.smithi036.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.5-585-g31d4e76d-1bionic [3,057 kB] 2020-11-12T17:20:08.851 INFO:teuthology.orchestra.run.smithi036.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-11-12T17:20:08.853 INFO:teuthology.orchestra.run.smithi205.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.5-585-g31d4e76d-1bionic [331 kB] 2020-11-12T17:20:08.853 INFO:teuthology.orchestra.run.smithi205.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-11-12T17:20:08.857 INFO:teuthology.orchestra.run.smithi036.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-11-12T17:20:08.863 INFO:teuthology.orchestra.run.smithi036.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-11-12T17:20:08.869 INFO:teuthology.orchestra.run.smithi205.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-11-12T17:20:08.871 INFO:teuthology.orchestra.run.smithi205.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-11-12T17:20:08.871 INFO:teuthology.orchestra.run.smithi205.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-11-12T17:20:08.873 INFO:teuthology.orchestra.run.smithi205.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-11-12T17:20:08.875 INFO:teuthology.orchestra.run.smithi205.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-11-12T17:20:08.877 INFO:teuthology.orchestra.run.smithi205.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-11-12T17:20:08.877 INFO:teuthology.orchestra.run.smithi205.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.5-585-g31d4e76d-1bionic [20.7 kB] 2020-11-12T17:20:08.878 INFO:teuthology.orchestra.run.smithi205.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.5-585-g31d4e76d-1bionic [133 kB] 2020-11-12T17:20:08.880 INFO:teuthology.orchestra.run.smithi036.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-11-12T17:20:08.880 INFO:teuthology.orchestra.run.smithi205.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-11-12T17:20:08.880 INFO:teuthology.orchestra.run.smithi205.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-11-12T17:20:08.883 INFO:teuthology.orchestra.run.smithi205.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.5-585-g31d4e76d-1bionic [27.8 kB] 2020-11-12T17:20:08.884 INFO:teuthology.orchestra.run.smithi205.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.5-585-g31d4e76d-1bionic [312 kB] 2020-11-12T17:20:08.886 INFO:teuthology.orchestra.run.smithi036.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2020-11-12T17:20:08.907 INFO:teuthology.orchestra.run.smithi205.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.5-585-g31d4e76d-1bionic [2,889 kB] 2020-11-12T17:20:08.911 INFO:teuthology.orchestra.run.smithi036.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-11-12T17:20:08.916 INFO:teuthology.orchestra.run.smithi036.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-11-12T17:20:08.918 INFO:teuthology.orchestra.run.smithi036.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-11-12T17:20:08.932 INFO:teuthology.orchestra.run.smithi205.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-11-12T17:20:08.933 INFO:teuthology.orchestra.run.smithi036.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-11-12T17:20:08.982 INFO:teuthology.orchestra.run.smithi205.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-11-12T17:20:08.983 INFO:teuthology.orchestra.run.smithi205.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-11-12T17:20:08.984 INFO:teuthology.orchestra.run.smithi205.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-11-12T17:20:08.988 INFO:teuthology.orchestra.run.smithi205.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-11-12T17:20:08.993 INFO:teuthology.orchestra.run.smithi036.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-11-12T17:20:08.994 INFO:teuthology.orchestra.run.smithi036.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-11-12T17:20:08.994 INFO:teuthology.orchestra.run.smithi036.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-11-12T17:20:08.996 INFO:teuthology.orchestra.run.smithi205.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-11-12T17:20:08.997 INFO:teuthology.orchestra.run.smithi036.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-11-12T17:20:08.997 INFO:teuthology.orchestra.run.smithi036.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-11-12T17:20:08.998 INFO:teuthology.orchestra.run.smithi036.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-11-12T17:20:09.000 INFO:teuthology.orchestra.run.smithi205.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-11-12T17:20:09.001 INFO:teuthology.orchestra.run.smithi205.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-11-12T17:20:09.001 INFO:teuthology.orchestra.run.smithi205.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-11-12T17:20:09.074 INFO:teuthology.orchestra.run.smithi036.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-11-12T17:20:09.087 INFO:teuthology.orchestra.run.smithi205.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-11-12T17:20:09.087 INFO:teuthology.orchestra.run.smithi036.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-11-12T17:20:09.087 INFO:teuthology.orchestra.run.smithi036.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-11-12T17:20:09.087 INFO:teuthology.orchestra.run.smithi036.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-11-12T17:20:09.095 INFO:teuthology.orchestra.run.smithi205.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-11-12T17:20:09.098 INFO:teuthology.orchestra.run.smithi205.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.5-585-g31d4e76d-1bionic [99.3 kB] 2020-11-12T17:20:09.101 INFO:teuthology.orchestra.run.smithi205.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.5-585-g31d4e76d-1bionic [337 kB] 2020-11-12T17:20:09.112 INFO:teuthology.orchestra.run.smithi205.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.5-585-g31d4e76d-1bionic [18.8 MB] 2020-11-12T17:20:09.152 INFO:teuthology.orchestra.run.smithi036.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-11-12T17:20:09.153 INFO:teuthology.orchestra.run.smithi036.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-11-12T17:20:09.153 INFO:teuthology.orchestra.run.smithi036.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-11-12T17:20:09.155 INFO:teuthology.orchestra.run.smithi036.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-11-12T17:20:09.157 INFO:teuthology.orchestra.run.smithi036.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-11-12T17:20:09.166 INFO:teuthology.orchestra.run.smithi036.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-11-12T17:20:09.232 INFO:teuthology.orchestra.run.smithi036.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-11-12T17:20:09.233 INFO:teuthology.orchestra.run.smithi036.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-11-12T17:20:09.233 INFO:teuthology.orchestra.run.smithi036.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-11-12T17:20:09.294 INFO:teuthology.orchestra.run.smithi036.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.5-585-g31d4e76d-1bionic [436 kB] 2020-11-12T17:20:09.320 INFO:teuthology.orchestra.run.smithi036.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-11-12T17:20:09.320 INFO:teuthology.orchestra.run.smithi036.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-11-12T17:20:09.377 INFO:teuthology.orchestra.run.smithi036.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.5-585-g31d4e76d-1bionic [331 kB] 2020-11-12T17:20:09.441 INFO:teuthology.orchestra.run.smithi205.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-11-12T17:20:09.442 INFO:teuthology.orchestra.run.smithi205.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-11-12T17:20:09.442 INFO:teuthology.orchestra.run.smithi205.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-11-12T17:20:09.442 INFO:teuthology.orchestra.run.smithi036.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.5-585-g31d4e76d-1bionic [20.7 kB] 2020-11-12T17:20:09.443 INFO:teuthology.orchestra.run.smithi036.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.5-585-g31d4e76d-1bionic [133 kB] 2020-11-12T17:20:09.443 INFO:teuthology.orchestra.run.smithi036.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.5-585-g31d4e76d-1bionic [27.8 kB] 2020-11-12T17:20:09.443 INFO:teuthology.orchestra.run.smithi036.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.5-585-g31d4e76d-1bionic [312 kB] 2020-11-12T17:20:09.474 INFO:teuthology.orchestra.run.smithi036.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.5-585-g31d4e76d-1bionic [2,889 kB] 2020-11-12T17:20:09.499 INFO:teuthology.orchestra.run.smithi205.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-11-12T17:20:09.500 INFO:teuthology.orchestra.run.smithi205.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-11-12T17:20:09.501 INFO:teuthology.orchestra.run.smithi205.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-11-12T17:20:09.502 INFO:teuthology.orchestra.run.smithi205.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-11-12T17:20:09.502 INFO:teuthology.orchestra.run.smithi205.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-11-12T17:20:09.503 INFO:teuthology.orchestra.run.smithi205.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-11-12T17:20:09.503 INFO:teuthology.orchestra.run.smithi205.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-11-12T17:20:09.581 INFO:teuthology.orchestra.run.smithi205.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-11-12T17:20:09.583 INFO:teuthology.orchestra.run.smithi205.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-11-12T17:20:09.588 INFO:teuthology.orchestra.run.smithi205.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-11-12T17:20:09.589 INFO:teuthology.orchestra.run.smithi205.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-11-12T17:20:09.600 INFO:teuthology.orchestra.run.smithi036.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-11-12T17:20:09.661 INFO:teuthology.orchestra.run.smithi205.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-11-12T17:20:09.661 INFO:teuthology.orchestra.run.smithi205.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-11-12T17:20:09.662 INFO:teuthology.orchestra.run.smithi205.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-11-12T17:20:09.666 INFO:teuthology.orchestra.run.smithi205.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-11-12T17:20:09.675 INFO:teuthology.orchestra.run.smithi205.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-11-12T17:20:09.676 INFO:teuthology.orchestra.run.smithi205.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-11-12T17:20:09.700 INFO:teuthology.orchestra.run.smithi036.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-11-12T17:20:09.702 INFO:teuthology.orchestra.run.smithi036.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-11-12T17:20:09.715 INFO:teuthology.orchestra.run.smithi036.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-11-12T17:20:09.715 INFO:teuthology.orchestra.run.smithi036.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-11-12T17:20:09.715 INFO:teuthology.orchestra.run.smithi036.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-11-12T17:20:09.716 INFO:teuthology.orchestra.run.smithi036.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-11-12T17:20:09.717 INFO:teuthology.orchestra.run.smithi036.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-11-12T17:20:09.717 INFO:teuthology.orchestra.run.smithi036.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-11-12T17:20:09.718 INFO:teuthology.orchestra.run.smithi036.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-11-12T17:20:09.741 INFO:teuthology.orchestra.run.smithi205.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-11-12T17:20:09.747 INFO:teuthology.orchestra.run.smithi205.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-11-12T17:20:09.755 INFO:teuthology.orchestra.run.smithi205.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-11-12T17:20:09.757 INFO:teuthology.orchestra.run.smithi205.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-11-12T17:20:09.781 INFO:teuthology.orchestra.run.smithi036.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-11-12T17:20:09.805 INFO:teuthology.orchestra.run.smithi036.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-11-12T17:20:09.813 INFO:teuthology.orchestra.run.smithi036.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-11-12T17:20:09.813 INFO:teuthology.orchestra.run.smithi036.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-11-12T17:20:09.816 INFO:teuthology.orchestra.run.smithi036.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-11-12T17:20:09.816 INFO:teuthology.orchestra.run.smithi036.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-11-12T17:20:09.816 INFO:teuthology.orchestra.run.smithi036.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-11-12T17:20:09.817 INFO:teuthology.orchestra.run.smithi036.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-11-12T17:20:09.819 INFO:teuthology.orchestra.run.smithi036.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-11-12T17:20:09.820 INFO:teuthology.orchestra.run.smithi205.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-11-12T17:20:09.821 INFO:teuthology.orchestra.run.smithi205.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-11-12T17:20:09.821 INFO:teuthology.orchestra.run.smithi205.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-11-12T17:20:09.823 INFO:teuthology.orchestra.run.smithi205.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-11-12T17:20:09.828 INFO:teuthology.orchestra.run.smithi205.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-11-12T17:20:09.829 INFO:teuthology.orchestra.run.smithi205.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-11-12T17:20:09.860 INFO:teuthology.orchestra.run.smithi036.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-11-12T17:20:09.866 INFO:teuthology.orchestra.run.smithi036.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.5-585-g31d4e76d-1bionic [99.3 kB] 2020-11-12T17:20:09.869 INFO:teuthology.orchestra.run.smithi036.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.5-585-g31d4e76d-1bionic [337 kB] 2020-11-12T17:20:09.901 INFO:teuthology.orchestra.run.smithi036.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-11-12T17:20:09.902 INFO:teuthology.orchestra.run.smithi205.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-11-12T17:20:09.902 INFO:teuthology.orchestra.run.smithi205.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-11-12T17:20:09.903 INFO:teuthology.orchestra.run.smithi205.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-11-12T17:20:09.905 INFO:teuthology.orchestra.run.smithi036.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-11-12T17:20:09.912 INFO:teuthology.orchestra.run.smithi036.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-11-12T17:20:09.915 INFO:teuthology.orchestra.run.smithi036.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-11-12T17:20:09.916 INFO:teuthology.orchestra.run.smithi036.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-11-12T17:20:09.917 INFO:teuthology.orchestra.run.smithi036.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-11-12T17:20:09.917 INFO:teuthology.orchestra.run.smithi036.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-11-12T17:20:09.918 INFO:teuthology.orchestra.run.smithi036.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-11-12T17:20:09.921 INFO:teuthology.orchestra.run.smithi205.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-11-12T17:20:09.929 INFO:teuthology.orchestra.run.smithi036.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.5-585-g31d4e76d-1bionic [18.8 MB] 2020-11-12T17:20:09.939 INFO:teuthology.orchestra.run.smithi036.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-11-12T17:20:09.980 INFO:teuthology.orchestra.run.smithi205.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-11-12T17:20:09.980 INFO:teuthology.orchestra.run.smithi205.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-11-12T17:20:10.000 INFO:teuthology.orchestra.run.smithi036.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-11-12T17:20:10.000 INFO:teuthology.orchestra.run.smithi036.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-11-12T17:20:10.002 INFO:teuthology.orchestra.run.smithi036.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-11-12T17:20:10.007 INFO:teuthology.orchestra.run.smithi036.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-11-12T17:20:10.027 INFO:teuthology.orchestra.run.smithi036.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-11-12T17:20:10.028 INFO:teuthology.orchestra.run.smithi036.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-11-12T17:20:10.028 INFO:teuthology.orchestra.run.smithi036.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-11-12T17:20:10.081 INFO:teuthology.orchestra.run.smithi205.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-11-12T17:20:10.081 INFO:teuthology.orchestra.run.smithi205.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-11-12T17:20:10.082 INFO:teuthology.orchestra.run.smithi205.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-11-12T17:20:10.086 INFO:teuthology.orchestra.run.smithi205.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-11-12T17:20:10.086 INFO:teuthology.orchestra.run.smithi205.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-11-12T17:20:10.087 INFO:teuthology.orchestra.run.smithi205.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-11-12T17:20:10.087 INFO:teuthology.orchestra.run.smithi205.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-11-12T17:20:10.089 INFO:teuthology.orchestra.run.smithi205.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-11-12T17:20:10.138 INFO:teuthology.orchestra.run.smithi205.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-11-12T17:20:10.144 INFO:teuthology.orchestra.run.smithi205.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.5-585-g31d4e76d-1bionic [5,169 kB] 2020-11-12T17:20:10.171 INFO:teuthology.orchestra.run.smithi036.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-11-12T17:20:10.242 INFO:teuthology.orchestra.run.smithi036.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-11-12T17:20:10.243 INFO:teuthology.orchestra.run.smithi036.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-11-12T17:20:10.248 INFO:teuthology.orchestra.run.smithi036.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-11-12T17:20:10.248 INFO:teuthology.orchestra.run.smithi036.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-11-12T17:20:10.249 INFO:teuthology.orchestra.run.smithi036.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-11-12T17:20:10.253 INFO:teuthology.orchestra.run.smithi036.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-11-12T17:20:10.254 INFO:teuthology.orchestra.run.smithi036.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-11-12T17:20:10.255 INFO:teuthology.orchestra.run.smithi036.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-11-12T17:20:10.451 INFO:teuthology.orchestra.run.smithi205.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.5-585-g31d4e76d-1bionic [148 kB] 2020-11-12T17:20:10.452 INFO:teuthology.orchestra.run.smithi205.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.5-585-g31d4e76d-1bionic [1,282 kB] 2020-11-12T17:20:10.480 INFO:teuthology.orchestra.run.smithi205.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.5-585-g31d4e76d-1bionic [5,943 kB] 2020-11-12T17:20:10.788 INFO:teuthology.orchestra.run.smithi205.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.5-585-g31d4e76d-1bionic [22.7 MB] 2020-11-12T17:20:11.983 INFO:teuthology.orchestra.run.smithi205.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.5-585-g31d4e76d-1bionic [3,876 B] 2020-11-12T17:20:11.984 INFO:teuthology.orchestra.run.smithi205.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.5-585-g31d4e76d-1bionic [515 kB] 2020-11-12T17:20:11.996 INFO:teuthology.orchestra.run.smithi205.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.5-585-g31d4e76d-1bionic [1,851 kB] 2020-11-12T17:20:12.085 INFO:teuthology.orchestra.run.smithi205.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.5-585-g31d4e76d-1bionic [51.3 kB] 2020-11-12T17:20:12.087 INFO:teuthology.orchestra.run.smithi205.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.5-585-g31d4e76d-1bionic [55.3 kB] 2020-11-12T17:20:12.090 INFO:teuthology.orchestra.run.smithi205.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.5-585-g31d4e76d-1bionic [3,177 kB] 2020-11-12T17:20:12.190 INFO:teuthology.orchestra.run.smithi036.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.5-585-g31d4e76d-1bionic [5,169 kB] 2020-11-12T17:20:12.273 INFO:teuthology.orchestra.run.smithi205.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.5-585-g31d4e76d-1bionic [34.2 kB] 2020-11-12T17:20:12.294 INFO:teuthology.orchestra.run.smithi205.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.5-585-g31d4e76d-1bionic [7,889 kB] 2020-11-12T17:20:12.673 INFO:teuthology.orchestra.run.smithi205.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.5-585-g31d4e76d-1bionic [3,996 B] 2020-11-12T17:20:12.673 INFO:teuthology.orchestra.run.smithi205.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.5-585-g31d4e76d-1bionic [22.4 kB] 2020-11-12T17:20:12.674 INFO:teuthology.orchestra.run.smithi205.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.5-585-g31d4e76d-1bionic [43.9 MB] 2020-11-12T17:20:12.846 INFO:teuthology.orchestra.run.smithi036.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.5-585-g31d4e76d-1bionic [148 kB] 2020-11-12T17:20:12.850 INFO:teuthology.orchestra.run.smithi036.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.5-585-g31d4e76d-1bionic [1,282 kB] 2020-11-12T17:20:12.989 INFO:teuthology.orchestra.run.smithi036.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.5-585-g31d4e76d-1bionic [5,943 kB] 2020-11-12T17:20:13.628 INFO:teuthology.orchestra.run.smithi036.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.5-585-g31d4e76d-1bionic [22.7 MB] 2020-11-12T17:20:14.771 INFO:teuthology.orchestra.run.smithi205.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.5-585-g31d4e76d-1bionic [17.9 kB] 2020-11-12T17:20:14.772 INFO:teuthology.orchestra.run.smithi205.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.5-585-g31d4e76d-1bionic [8,845 kB] 2020-11-12T17:20:15.192 INFO:teuthology.orchestra.run.smithi205.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.5-585-g31d4e76d-1bionic [62.5 kB] 2020-11-12T17:20:15.474 INFO:teuthology.orchestra.run.smithi036.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.5-585-g31d4e76d-1bionic [3,876 B] 2020-11-12T17:20:15.496 INFO:teuthology.orchestra.run.smithi036.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.5-585-g31d4e76d-1bionic [515 kB] 2020-11-12T17:20:15.498 INFO:teuthology.orchestra.run.smithi036.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.5-585-g31d4e76d-1bionic [1,851 kB] 2020-11-12T17:20:15.550 INFO:teuthology.orchestra.run.smithi036.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.5-585-g31d4e76d-1bionic [51.3 kB] 2020-11-12T17:20:15.551 INFO:teuthology.orchestra.run.smithi036.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.5-585-g31d4e76d-1bionic [55.3 kB] 2020-11-12T17:20:15.552 INFO:teuthology.orchestra.run.smithi036.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.5-585-g31d4e76d-1bionic [3,177 kB] 2020-11-12T17:20:15.663 INFO:teuthology.orchestra.run.smithi036.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.5-585-g31d4e76d-1bionic [34.2 kB] 2020-11-12T17:20:15.664 INFO:teuthology.orchestra.run.smithi036.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.5-585-g31d4e76d-1bionic [7,889 kB] 2020-11-12T17:20:15.890 INFO:teuthology.orchestra.run.smithi205.stdout:Fetched 156 MB in 7s (21.8 MB/s) 2020-11-12T17:20:15.930 INFO:teuthology.orchestra.run.smithi036.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.5-585-g31d4e76d-1bionic [3,996 B] 2020-11-12T17:20:15.931 INFO:teuthology.orchestra.run.smithi036.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.5-585-g31d4e76d-1bionic [22.4 kB] 2020-11-12T17:20:15.931 INFO:teuthology.orchestra.run.smithi036.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.5-585-g31d4e76d-1bionic [43.9 MB] 2020-11-12T17:20:16.042 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-uritemplate. 2020-11-12T17:20:16.086 INFO:teuthology.orchestra.run.smithi205.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137601 files and directories currently installed.) 2020-11-12T17:20:16.090 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-11-12T17:20:16.132 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-11-12T17:20:16.467 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-11-12T17:20:16.482 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-11-12T17:20:16.564 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-12T17:20:16.898 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../002-librbd1_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:17.033 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking librbd1 (15.2.5-585-g31d4e76d-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-12T17:20:17.400 INFO:teuthology.orchestra.run.smithi036.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.5-585-g31d4e76d-1bionic [17.9 kB] 2020-11-12T17:20:17.401 INFO:teuthology.orchestra.run.smithi036.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.5-585-g31d4e76d-1bionic [8,845 kB] 2020-11-12T17:20:17.553 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../003-librados2_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:17.655 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking librados2 (15.2.5-585-g31d4e76d-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-12T17:20:17.699 INFO:teuthology.orchestra.run.smithi036.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/octopus/31d4e76d0d584790763b4b1146b29ea4cfc2e9af/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.5-585-g31d4e76d-1bionic [62.5 kB] 2020-11-12T17:20:18.317 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package libcephfs2. 2020-11-12T17:20:18.331 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../004-libcephfs2_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:18.376 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking libcephfs2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:18.422 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 156 MB in 10s (16.4 MB/s) 2020-11-12T17:20:18.550 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-uritemplate. 2020-11-12T17:20:18.602 INFO:teuthology.orchestra.run.smithi036.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137601 files and directories currently installed.) 2020-11-12T17:20:18.605 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-11-12T17:20:18.648 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-11-12T17:20:18.663 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-rados. 2020-11-12T17:20:18.678 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../005-python3-rados_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:18.720 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-rados (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:18.988 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-11-12T17:20:19.002 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-11-12T17:20:19.058 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-11-12T17:20:19.074 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../006-python3-ceph-argparse_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:19.076 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-12T17:20:19.117 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-ceph-argparse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:19.414 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-cephfs. 2020-11-12T17:20:19.428 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../007-python3-cephfs_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:19.447 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../002-librbd1_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:19.465 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-cephfs (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:19.593 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librbd1 (15.2.5-585-g31d4e76d-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-12T17:20:19.761 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-ceph-common. 2020-11-12T17:20:19.775 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../008-python3-ceph-common_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:19.824 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-ceph-common (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:20.118 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../003-librados2_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:20.134 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-prettytable. 2020-11-12T17:20:20.149 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2020-11-12T17:20:20.192 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-11-12T17:20:20.248 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librados2 (15.2.5-585-g31d4e76d-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-12T17:20:20.493 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-rbd. 2020-11-12T17:20:20.507 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../010-python3-rbd_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:20.551 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-rbd (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:20.861 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-11-12T17:20:20.875 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-11-12T17:20:20.891 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libcephfs2. 2020-11-12T17:20:20.906 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../004-libcephfs2_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:20.920 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-12T17:20:20.942 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libcephfs2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:21.231 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-11-12T17:20:21.245 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rados. 2020-11-12T17:20:21.245 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-11-12T17:20:21.259 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../005-python3-rados_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:21.290 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-11-12T17:20:21.303 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rados (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:21.625 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-11-12T17:20:21.626 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package librgw2. 2020-11-12T17:20:21.639 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../006-python3-ceph-argparse_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:21.639 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../013-librgw2_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:21.667 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-ceph-argparse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:21.675 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking librgw2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:22.098 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cephfs. 2020-11-12T17:20:22.112 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../007-python3-cephfs_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:22.148 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cephfs (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:22.203 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-rgw. 2020-11-12T17:20:22.217 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../014-python3-rgw_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:22.261 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-rgw (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:22.455 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-ceph-common. 2020-11-12T17:20:22.469 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../008-python3-ceph-common_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:22.513 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-ceph-common (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:22.564 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-11-12T17:20:22.580 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-11-12T17:20:22.614 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-12T17:20:22.816 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-prettytable. 2020-11-12T17:20:22.830 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2020-11-12T17:20:22.892 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-11-12T17:20:22.925 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-11-12T17:20:22.939 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2020-11-12T17:20:22.984 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-11-12T17:20:23.184 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rbd. 2020-11-12T17:20:23.199 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../010-python3-rbd_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:23.244 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rbd (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:23.361 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package liboath0. 2020-11-12T17:20:23.374 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2020-11-12T17:20:23.419 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-11-12T17:20:23.596 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-11-12T17:20:23.610 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-11-12T17:20:23.655 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-12T17:20:23.725 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package libradosstriper1. 2020-11-12T17:20:23.740 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../018-libradosstriper1_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:23.783 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking libradosstriper1 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:23.991 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-11-12T17:20:24.006 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-11-12T17:20:24.050 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-11-12T17:20:24.211 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-common. 2020-11-12T17:20:24.230 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../019-ceph-common_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:24.270 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-common (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:24.386 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package librgw2. 2020-11-12T17:20:24.402 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../013-librgw2_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:24.436 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librgw2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:24.946 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rgw. 2020-11-12T17:20:24.961 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../014-python3-rgw_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:25.006 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rgw (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:25.324 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-11-12T17:20:25.338 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-11-12T17:20:25.383 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-12T17:20:25.677 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-11-12T17:20:25.700 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2020-11-12T17:20:25.727 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-11-12T17:20:26.072 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package liboath0. 2020-11-12T17:20:26.075 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-base. 2020-11-12T17:20:26.086 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2020-11-12T17:20:26.088 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../020-ceph-base_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:26.135 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-base (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:26.139 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-11-12T17:20:26.472 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libradosstriper1. 2020-11-12T17:20:26.488 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../018-libradosstriper1_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:26.533 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libradosstriper1 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:26.945 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-common. 2020-11-12T17:20:26.960 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../019-ceph-common_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:26.995 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-common (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:27.033 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-dateutil. 2020-11-12T17:20:27.047 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../021-python3-dateutil_2.6.1-1_all.deb ... 2020-11-12T17:20:27.084 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-11-12T17:20:27.413 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-asn1crypto. 2020-11-12T17:20:27.427 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../022-python3-asn1crypto_0.24.0-1_all.deb ... 2020-11-12T17:20:27.463 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-11-12T17:20:27.782 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-cffi-backend. 2020-11-12T17:20:27.797 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../023-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-11-12T17:20:27.840 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-11-12T17:20:28.155 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-cryptography. 2020-11-12T17:20:28.171 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../024-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2020-11-12T17:20:28.214 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2020-11-12T17:20:28.616 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-openssl. 2020-11-12T17:20:28.630 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../025-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-11-12T17:20:28.675 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-11-12T17:20:28.833 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-base. 2020-11-12T17:20:28.850 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../020-ceph-base_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:28.901 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-base (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:28.942 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-11-12T17:20:28.958 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:29.001 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mgr-modules-core (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:29.386 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-bcrypt. 2020-11-12T17:20:29.401 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-11-12T17:20:29.444 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-11-12T17:20:29.731 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-cherrypy3. 2020-11-12T17:20:29.743 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-2_all.deb ... 2020-11-12T17:20:29.765 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-dateutil. 2020-11-12T17:20:29.774 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../021-python3-dateutil_2.6.1-1_all.deb ... 2020-11-12T17:20:29.780 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-11-12T17:20:29.826 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-11-12T17:20:30.156 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-asn1crypto. 2020-11-12T17:20:30.170 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../022-python3-asn1crypto_0.24.0-1_all.deb ... 2020-11-12T17:20:30.215 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-11-12T17:20:30.507 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cffi-backend. 2020-11-12T17:20:30.521 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../023-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-11-12T17:20:30.560 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-11-12T17:20:30.609 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-jwt. 2020-11-12T17:20:30.623 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../029-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-11-12T17:20:30.668 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-11-12T17:20:30.889 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cryptography. 2020-11-12T17:20:30.903 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../024-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2020-11-12T17:20:30.946 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2020-11-12T17:20:30.984 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-logutils. 2020-11-12T17:20:30.998 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-5_all.deb ... 2020-11-12T17:20:31.040 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-11-12T17:20:31.343 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-markupsafe. 2020-11-12T17:20:31.359 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../031-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-11-12T17:20:31.395 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-openssl. 2020-11-12T17:20:31.401 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-11-12T17:20:31.410 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../025-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-11-12T17:20:31.454 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-11-12T17:20:31.722 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-11-12T17:20:31.737 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:31.737 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-mako. 2020-11-12T17:20:31.751 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../032-python3-mako_1.0.7+ds1-1_all.deb ... 2020-11-12T17:20:31.774 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-modules-core (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:31.787 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-11-12T17:20:32.132 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-simplegeneric. 2020-11-12T17:20:32.139 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-bcrypt. 2020-11-12T17:20:32.146 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-1_all.deb ... 2020-11-12T17:20:32.153 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-11-12T17:20:32.190 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-11-12T17:20:32.198 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-11-12T17:20:32.477 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-singledispatch. 2020-11-12T17:20:32.490 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-11-12T17:20:32.525 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cherrypy3. 2020-11-12T17:20:32.535 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-11-12T17:20:32.540 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-2_all.deb ... 2020-11-12T17:20:32.584 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-11-12T17:20:32.838 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-webob. 2020-11-12T17:20:32.851 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../035-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-11-12T17:20:32.887 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-11-12T17:20:32.955 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-jwt. 2020-11-12T17:20:32.968 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../029-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-11-12T17:20:33.010 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-11-12T17:20:33.198 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-bs4. 2020-11-12T17:20:33.215 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../036-python3-bs4_4.6.0-1_all.deb ... 2020-11-12T17:20:33.257 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-11-12T17:20:33.410 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-logutils. 2020-11-12T17:20:33.426 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-5_all.deb ... 2020-11-12T17:20:33.585 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-waitress. 2020-11-12T17:20:33.593 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-11-12T17:20:33.601 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../037-python3-waitress_1.0.1-1_all.deb ... 2020-11-12T17:20:33.643 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-11-12T17:20:33.931 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-markupsafe. 2020-11-12T17:20:33.945 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../031-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-11-12T17:20:33.971 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-tempita. 2020-11-12T17:20:33.987 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../038-python3-tempita_0.5.2-2_all.deb ... 2020-11-12T17:20:33.988 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-11-12T17:20:34.030 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-11-12T17:20:34.283 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-mako. 2020-11-12T17:20:34.299 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../032-python3-mako_1.0.7+ds1-1_all.deb ... 2020-11-12T17:20:34.332 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-paste. 2020-11-12T17:20:34.341 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-11-12T17:20:34.346 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../039-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-11-12T17:20:34.391 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-12T17:20:34.677 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-simplegeneric. 2020-11-12T17:20:34.693 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-1_all.deb ... 2020-11-12T17:20:34.736 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-11-12T17:20:34.742 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-11-12T17:20:34.757 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-11-12T17:20:34.803 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-11-12T17:20:35.047 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-singledispatch. 2020-11-12T17:20:35.062 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-11-12T17:20:35.114 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-11-12T17:20:35.115 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pastedeploy. 2020-11-12T17:20:35.129 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../041-python3-pastedeploy_1.5.2-4_all.deb ... 2020-11-12T17:20:35.174 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-11-12T17:20:35.425 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-webob. 2020-11-12T17:20:35.439 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../035-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-11-12T17:20:35.475 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-11-12T17:20:35.504 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-webtest. 2020-11-12T17:20:35.518 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../042-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-11-12T17:20:35.563 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-11-12T17:20:35.811 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-bs4. 2020-11-12T17:20:35.827 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../036-python3-bs4_4.6.0-1_all.deb ... 2020-11-12T17:20:35.878 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-11-12T17:20:35.906 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pecan. 2020-11-12T17:20:35.919 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../043-python3-pecan_1.2.1-2_all.deb ... 2020-11-12T17:20:35.951 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-11-12T17:20:36.214 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-waitress. 2020-11-12T17:20:36.229 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../037-python3-waitress_1.0.1-1_all.deb ... 2020-11-12T17:20:36.273 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-11-12T17:20:36.314 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-werkzeug. 2020-11-12T17:20:36.327 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../044-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-11-12T17:20:36.374 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-11-12T17:20:36.576 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-tempita. 2020-11-12T17:20:36.591 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../038-python3-tempita_0.5.2-2_all.deb ... 2020-11-12T17:20:36.634 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-11-12T17:20:36.764 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mgr. 2020-11-12T17:20:36.778 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../045-ceph-mgr_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:36.822 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mgr (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:36.945 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-paste. 2020-11-12T17:20:36.961 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../039-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-11-12T17:20:37.004 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-12T17:20:37.345 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-11-12T17:20:37.346 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mon. 2020-11-12T17:20:37.358 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../040-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-11-12T17:20:37.359 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../046-ceph-mon_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:37.395 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-11-12T17:20:37.396 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mon (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:37.756 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pastedeploy. 2020-11-12T17:20:37.770 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../041-python3-pastedeploy_1.5.2-4_all.deb ... 2020-11-12T17:20:37.814 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-11-12T17:20:38.172 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-webtest. 2020-11-12T17:20:38.193 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../042-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-11-12T17:20:38.239 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-11-12T17:20:38.345 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-osd. 2020-11-12T17:20:38.358 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../047-ceph-osd_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:38.402 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-osd (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:39.373 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pecan. 2020-11-12T17:20:39.388 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../043-python3-pecan_1.2.1-2_all.deb ... 2020-11-12T17:20:39.431 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-11-12T17:20:39.796 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-werkzeug. 2020-11-12T17:20:39.812 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../044-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-11-12T17:20:39.849 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-11-12T17:20:40.239 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr. 2020-11-12T17:20:40.254 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../045-ceph-mgr_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:40.323 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:40.336 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph. 2020-11-12T17:20:40.352 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../048-ceph_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:40.396 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:40.824 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mon. 2020-11-12T17:20:40.840 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../046-ceph-mon_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:40.882 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mon (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:41.416 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-fuse. 2020-11-12T17:20:41.430 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../049-ceph-fuse_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:41.476 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-fuse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:41.807 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-osd. 2020-11-12T17:20:41.823 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../047-ceph-osd_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:41.874 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-osd (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:41.885 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mds. 2020-11-12T17:20:41.898 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../050-ceph-mds_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:41.944 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mds (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:42.433 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package cephadm. 2020-11-12T17:20:42.448 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../051-cephadm_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:42.493 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking cephadm (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:42.799 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-jinja2. 2020-11-12T17:20:42.824 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../052-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-11-12T17:20:42.860 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-11-12T17:20:43.219 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-11-12T17:20:43.232 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../053-ceph-mgr-cephadm_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:43.278 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mgr-cephadm (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:43.605 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-repoze.lru. 2020-11-12T17:20:43.622 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../054-python3-repoze.lru_0.7-1_all.deb ... 2020-11-12T17:20:43.663 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-11-12T17:20:43.799 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph. 2020-11-12T17:20:43.815 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../048-ceph_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:43.869 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:43.974 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-routes. 2020-11-12T17:20:43.988 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../055-python3-routes_2.4.1-1_all.deb ... 2020-11-12T17:20:44.024 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-11-12T17:20:44.197 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-fuse. 2020-11-12T17:20:44.213 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../049-ceph-fuse_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:44.257 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-fuse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:44.338 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-11-12T17:20:44.352 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:44.390 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mgr-dashboard (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:44.654 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mds. 2020-11-12T17:20:44.669 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../050-ceph-mds_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:44.714 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mds (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:45.248 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package cephadm. 2020-11-12T17:20:45.262 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../051-cephadm_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:45.301 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking cephadm (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:45.377 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-11-12T17:20:45.391 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:45.435 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:45.623 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-jinja2. 2020-11-12T17:20:45.637 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../052-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-11-12T17:20:45.681 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-11-12T17:20:45.754 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-numpy. 2020-11-12T17:20:45.770 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../058-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-11-12T17:20:45.813 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-11-12T17:20:46.079 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-11-12T17:20:46.093 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../053-ceph-mgr-cephadm_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:46.138 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-cephadm (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:46.460 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-decorator. 2020-11-12T17:20:46.474 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../059-python3-decorator_4.1.2-1_all.deb ... 2020-11-12T17:20:46.484 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-repoze.lru. 2020-11-12T17:20:46.500 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../054-python3-repoze.lru_0.7-1_all.deb ... 2020-11-12T17:20:46.519 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-11-12T17:20:46.542 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-11-12T17:20:46.846 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-routes. 2020-11-12T17:20:46.861 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../055-python3-routes_2.4.1-1_all.deb ... 2020-11-12T17:20:46.905 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-11-12T17:20:46.914 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-scipy. 2020-11-12T17:20:46.927 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../060-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-11-12T17:20:46.972 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-11-12T17:20:47.227 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-11-12T17:20:47.241 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:47.293 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-dashboard (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:48.193 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-11-12T17:20:48.210 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../061-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-11-12T17:20:48.253 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-11-12T17:20:48.318 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-11-12T17:20:48.335 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:48.376 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:48.701 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-joblib. 2020-11-12T17:20:48.718 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../062-python3-joblib_0.11-1_all.deb ... 2020-11-12T17:20:48.755 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-joblib (0.11-1) ... 2020-11-12T17:20:48.763 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-numpy. 2020-11-12T17:20:48.778 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../058-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-11-12T17:20:48.821 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-11-12T17:20:49.108 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-sklearn. 2020-11-12T17:20:49.124 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../063-python3-sklearn_0.19.1-3_all.deb ... 2020-11-12T17:20:49.167 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-11-12T17:20:49.402 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-decorator. 2020-11-12T17:20:49.419 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../059-python3-decorator_4.1.2-1_all.deb ... 2020-11-12T17:20:49.460 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-11-12T17:20:49.702 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-11-12T17:20:49.717 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../064-ceph-mgr-diskprediction-local_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:49.761 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:49.805 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-scipy. 2020-11-12T17:20:49.820 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../060-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-11-12T17:20:49.863 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-11-12T17:20:50.906 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-monotonic. 2020-11-12T17:20:50.923 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../065-python3-monotonic_1.1-2_all.deb ... 2020-11-12T17:20:50.965 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-11-12T17:20:51.013 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-11-12T17:20:51.027 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../061-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-11-12T17:20:51.071 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-11-12T17:20:51.308 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-fasteners. 2020-11-12T17:20:51.323 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../066-python3-fasteners_0.12.0-3_all.deb ... 2020-11-12T17:20:51.369 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-11-12T17:20:51.571 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-joblib. 2020-11-12T17:20:51.586 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../062-python3-joblib_0.11-1_all.deb ... 2020-11-12T17:20:51.630 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-joblib (0.11-1) ... 2020-11-12T17:20:51.711 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-httplib2. 2020-11-12T17:20:51.726 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../067-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-11-12T17:20:51.770 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-12T17:20:52.009 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-sklearn. 2020-11-12T17:20:52.025 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../063-python3-sklearn_0.19.1-3_all.deb ... 2020-11-12T17:20:52.127 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pyasn1. 2020-11-12T17:20:52.142 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../068-python3-pyasn1_0.4.2-3_all.deb ... 2020-11-12T17:20:52.187 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-11-12T17:20:52.207 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-11-12T17:20:52.538 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-11-12T17:20:52.552 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../069-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-11-12T17:20:52.596 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-11-12T17:20:52.714 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-11-12T17:20:52.729 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../064-ceph-mgr-diskprediction-local_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:52.773 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:52.918 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-rsa. 2020-11-12T17:20:52.933 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../070-python3-rsa_3.4.2-1_all.deb ... 2020-11-12T17:20:52.977 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-11-12T17:20:53.322 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-11-12T17:20:53.338 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../071-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-11-12T17:20:53.381 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-12T17:20:53.843 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-oauth2client. 2020-11-12T17:20:53.857 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../072-python3-oauth2client_4.1.2-3_all.deb ... 2020-11-12T17:20:53.902 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-11-12T17:20:53.913 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-monotonic. 2020-11-12T17:20:53.929 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../065-python3-monotonic_1.1-2_all.deb ... 2020-11-12T17:20:53.972 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-11-12T17:20:54.244 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-setuptools. 2020-11-12T17:20:54.260 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../073-python3-setuptools_39.0.1-2_all.deb ... 2020-11-12T17:20:54.303 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-11-12T17:20:54.304 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-fasteners. 2020-11-12T17:20:54.322 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../066-python3-fasteners_0.12.0-3_all.deb ... 2020-11-12T17:20:54.388 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-11-12T17:20:54.680 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-websocket. 2020-11-12T17:20:54.696 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../074-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-11-12T17:20:54.731 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-httplib2. 2020-11-12T17:20:54.739 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-11-12T17:20:54.744 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../067-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-11-12T17:20:54.792 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-12T17:20:55.073 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-kubernetes. 2020-11-12T17:20:55.087 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../075-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-11-12T17:20:55.096 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyasn1. 2020-11-12T17:20:55.110 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../068-python3-pyasn1_0.4.2-3_all.deb ... 2020-11-12T17:20:55.133 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-11-12T17:20:55.155 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-11-12T17:20:55.521 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-11-12T17:20:55.537 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../069-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-11-12T17:20:55.552 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-11-12T17:20:55.565 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:55.580 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-11-12T17:20:55.610 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mgr-k8sevents (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:55.919 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rsa. 2020-11-12T17:20:55.929 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-json-pointer. 2020-11-12T17:20:55.934 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../070-python3-rsa_3.4.2-1_all.deb ... 2020-11-12T17:20:55.943 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../077-python3-json-pointer_1.10-1_all.deb ... 2020-11-12T17:20:55.978 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-11-12T17:20:55.989 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-11-12T17:20:56.289 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-11-12T17:20:56.305 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../071-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-11-12T17:20:56.338 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-jsonpatch. 2020-11-12T17:20:56.339 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-12T17:20:56.355 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../078-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-11-12T17:20:56.401 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-11-12T17:20:56.709 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-11-12T17:20:56.723 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../079-ceph-mgr-rook_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:56.769 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-mgr-rook (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:56.818 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-oauth2client. 2020-11-12T17:20:56.835 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../072-python3-oauth2client_4.1.2-3_all.deb ... 2020-11-12T17:20:56.868 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-11-12T17:20:57.132 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package libonig4:amd64. 2020-11-12T17:20:57.146 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../080-libonig4_6.7.0-1_amd64.deb ... 2020-11-12T17:20:57.245 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-setuptools. 2020-11-12T17:20:57.259 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../073-python3-setuptools_39.0.1-2_all.deb ... 2020-11-12T17:20:57.294 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-11-12T17:20:57.311 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-11-12T17:20:57.644 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package libjq1:amd64. 2020-11-12T17:20:57.660 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../081-libjq1_1.5+dfsg-2_amd64.deb ... 2020-11-12T17:20:57.702 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-11-12T17:20:57.707 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-websocket. 2020-11-12T17:20:57.722 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../074-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-11-12T17:20:57.766 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-11-12T17:20:57.980 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package jq. 2020-11-12T17:20:57.994 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../082-jq_1.5+dfsg-2_amd64.deb ... 2020-11-12T17:20:58.046 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-11-12T17:20:58.097 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-kubernetes. 2020-11-12T17:20:58.113 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../075-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-11-12T17:20:58.156 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-11-12T17:20:58.314 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package socat. 2020-11-12T17:20:58.329 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../083-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-11-12T17:20:58.375 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-11-12T17:20:58.573 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-11-12T17:20:58.587 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:20:58.632 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-k8sevents (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:58.761 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-11-12T17:20:58.779 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../084-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-11-12T17:20:58.820 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-12T17:20:59.081 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package xmlstarlet. 2020-11-12T17:20:59.096 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2_amd64.deb ... 2020-11-12T17:20:59.139 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-11-12T17:20:59.413 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-json-pointer. 2020-11-12T17:20:59.429 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../077-python3-json-pointer_1.10-1_all.deb ... 2020-11-12T17:20:59.471 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-11-12T17:20:59.485 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package ceph-test. 2020-11-12T17:20:59.502 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../086-ceph-test_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:20:59.543 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking ceph-test (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:20:59.833 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-jsonpatch. 2020-11-12T17:20:59.849 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../078-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-11-12T17:20:59.904 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-11-12T17:21:00.266 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-11-12T17:21:00.280 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../079-ceph-mgr-rook_15.2.5-585-g31d4e76d-1bionic_all.deb ... 2020-11-12T17:21:00.325 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-rook (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:00.692 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libonig4:amd64. 2020-11-12T17:21:00.706 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../080-libonig4_6.7.0-1_amd64.deb ... 2020-11-12T17:21:00.839 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-11-12T17:21:01.194 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libjq1:amd64. 2020-11-12T17:21:01.211 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../081-libjq1_1.5+dfsg-2_amd64.deb ... 2020-11-12T17:21:01.255 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-11-12T17:21:01.558 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package jq. 2020-11-12T17:21:01.573 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../082-jq_1.5+dfsg-2_amd64.deb ... 2020-11-12T17:21:01.616 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-11-12T17:21:01.880 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package socat. 2020-11-12T17:21:01.899 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../083-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-11-12T17:21:01.939 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-11-12T17:21:02.325 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-11-12T17:21:02.339 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../084-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-11-12T17:21:02.384 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-12T17:21:02.670 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package xmlstarlet. 2020-11-12T17:21:02.685 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2_amd64.deb ... 2020-11-12T17:21:02.728 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-11-12T17:21:02.856 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package libcephfs-dev. 2020-11-12T17:21:02.868 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../087-libcephfs-dev_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:21:02.913 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking libcephfs-dev (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:03.057 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-test. 2020-11-12T17:21:03.073 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../086-ceph-test_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:21:03.116 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-test (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:03.182 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package nvme-cli. 2020-11-12T17:21:03.198 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../088-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-11-12T17:21:03.240 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-11-12T17:21:03.604 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python-attr. 2020-11-12T17:21:03.620 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../089-python-attr_17.4.0-2_all.deb ... 2020-11-12T17:21:03.655 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python-attr (17.4.0-2) ... 2020-11-12T17:21:03.976 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python-funcsigs. 2020-11-12T17:21:03.993 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../090-python-funcsigs_1.0.2-4_all.deb ... 2020-11-12T17:21:04.036 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-11-12T17:21:04.308 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python-pluggy. 2020-11-12T17:21:04.324 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../091-python-pluggy_0.6.0-1_all.deb ... 2020-11-12T17:21:04.366 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-11-12T17:21:04.652 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python-py. 2020-11-12T17:21:04.668 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../092-python-py_1.5.2-1_all.deb ... 2020-11-12T17:21:04.712 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python-py (1.5.2-1) ... 2020-11-12T17:21:05.048 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python-pytest. 2020-11-12T17:21:05.063 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../093-python-pytest_3.3.2-2_all.deb ... 2020-11-12T17:21:05.107 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-11-12T17:21:05.466 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-attr. 2020-11-12T17:21:05.480 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../094-python3-attr_17.4.0-2_all.deb ... 2020-11-12T17:21:05.525 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-11-12T17:21:05.823 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-cycler. 2020-11-12T17:21:05.840 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../095-python3-cycler_0.10.0-1_all.deb ... 2020-11-12T17:21:05.882 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-11-12T17:21:06.202 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-webencodings. 2020-11-12T17:21:06.218 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../096-python3-webencodings_0.5-2_all.deb ... 2020-11-12T17:21:06.261 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-11-12T17:21:06.444 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libcephfs-dev. 2020-11-12T17:21:06.459 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../087-libcephfs-dev_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:21:06.502 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libcephfs-dev (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:06.574 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-html5lib. 2020-11-12T17:21:06.589 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../097-python3-html5lib_0.999999999-1_all.deb ... 2020-11-12T17:21:06.642 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-11-12T17:21:06.767 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package nvme-cli. 2020-11-12T17:21:06.782 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../088-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-11-12T17:21:06.835 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-11-12T17:21:06.990 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-11-12T17:21:07.006 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../098-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-11-12T17:21:07.054 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-12T17:21:07.213 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-attr. 2020-11-12T17:21:07.227 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../089-python-attr_17.4.0-2_all.deb ... 2020-11-12T17:21:07.272 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-attr (17.4.0-2) ... 2020-11-12T17:21:07.549 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pyparsing. 2020-11-12T17:21:07.563 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../099-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-11-12T17:21:07.578 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-funcsigs. 2020-11-12T17:21:07.592 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../090-python-funcsigs_1.0.2-4_all.deb ... 2020-11-12T17:21:07.616 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-11-12T17:21:07.636 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-11-12T17:21:07.951 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-tz. 2020-11-12T17:21:07.966 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../100-python3-tz_2018.3-2_all.deb ... 2020-11-12T17:21:07.979 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-pluggy. 2020-11-12T17:21:07.994 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../091-python-pluggy_0.6.0-1_all.deb ... 2020-11-12T17:21:08.009 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-tz (2018.3-2) ... 2020-11-12T17:21:08.070 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-11-12T17:21:08.319 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-matplotlib. 2020-11-12T17:21:08.332 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../101-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-11-12T17:21:08.372 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-py. 2020-11-12T17:21:08.377 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-11-12T17:21:08.386 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../092-python-py_1.5.2-1_all.deb ... 2020-11-12T17:21:08.431 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-py (1.5.2-1) ... 2020-11-12T17:21:08.781 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-pytest. 2020-11-12T17:21:08.812 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../093-python-pytest_3.3.2-2_all.deb ... 2020-11-12T17:21:08.840 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-11-12T17:21:09.066 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-olefile. 2020-11-12T17:21:09.082 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../102-python3-olefile_0.45.1-1_all.deb ... 2020-11-12T17:21:09.124 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-11-12T17:21:09.198 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-attr. 2020-11-12T17:21:09.214 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../094-python3-attr_17.4.0-2_all.deb ... 2020-11-12T17:21:09.257 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-11-12T17:21:09.436 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pastescript. 2020-11-12T17:21:09.453 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-2_all.deb ... 2020-11-12T17:21:09.502 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-11-12T17:21:09.596 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cycler. 2020-11-12T17:21:09.611 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../095-python3-cycler_0.10.0-1_all.deb ... 2020-11-12T17:21:09.655 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-11-12T17:21:09.858 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pil:amd64. 2020-11-12T17:21:09.874 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../104-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-11-12T17:21:09.916 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-11-12T17:21:09.984 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-webencodings. 2020-11-12T17:21:09.998 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../096-python3-webencodings_0.5-2_all.deb ... 2020-11-12T17:21:10.044 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-11-12T17:21:10.305 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pluggy. 2020-11-12T17:21:10.319 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../105-python3-pluggy_0.6.0-1_all.deb ... 2020-11-12T17:21:10.359 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-html5lib. 2020-11-12T17:21:10.372 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-11-12T17:21:10.376 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../097-python3-html5lib_0.999999999-1_all.deb ... 2020-11-12T17:21:10.417 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-11-12T17:21:10.650 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-py. 2020-11-12T17:21:10.682 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../106-python3-py_1.5.2-1_all.deb ... 2020-11-12T17:21:10.700 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-py (1.5.2-1) ... 2020-11-12T17:21:10.785 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-11-12T17:21:10.801 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../098-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-11-12T17:21:10.846 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-12T17:21:11.020 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pyinotify. 2020-11-12T17:21:11.035 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1_all.deb ... 2020-11-12T17:21:11.079 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-11-12T17:21:11.315 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyparsing. 2020-11-12T17:21:11.341 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../099-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-11-12T17:21:11.373 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-11-12T17:21:11.393 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-pytest. 2020-11-12T17:21:11.407 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../108-python3-pytest_3.3.2-2_all.deb ... 2020-11-12T17:21:11.451 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-11-12T17:21:11.700 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-tz. 2020-11-12T17:21:11.716 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../100-python3-tz_2018.3-2_all.deb ... 2020-11-12T17:21:11.758 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-tz (2018.3-2) ... 2020-11-12T17:21:11.788 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-simplejson. 2020-11-12T17:21:11.805 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../109-python3-simplejson_3.13.2-1_amd64.deb ... 2020-11-12T17:21:11.846 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-11-12T17:21:12.110 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-matplotlib. 2020-11-12T17:21:12.126 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../101-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-11-12T17:21:12.177 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-11-12T17:21:12.191 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package python3-tk:amd64. 2020-11-12T17:21:12.208 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../110-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-11-12T17:21:12.249 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-11-12T17:21:12.709 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package radosgw. 2020-11-12T17:21:12.722 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../111-radosgw_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:21:12.766 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking radosgw (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:13.009 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-olefile. 2020-11-12T17:21:13.023 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../102-python3-olefile_0.45.1-1_all.deb ... 2020-11-12T17:21:13.100 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-11-12T17:21:13.412 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pastescript. 2020-11-12T17:21:13.427 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-2_all.deb ... 2020-11-12T17:21:13.478 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-11-12T17:21:13.693 INFO:teuthology.orchestra.run.smithi205.stdout:Selecting previously unselected package rbd-fuse. 2020-11-12T17:21:13.708 INFO:teuthology.orchestra.run.smithi205.stdout:Preparing to unpack .../112-rbd-fuse_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:21:13.742 INFO:teuthology.orchestra.run.smithi205.stdout:Unpacking rbd-fuse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:13.853 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pil:amd64. 2020-11-12T17:21:13.869 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../104-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-11-12T17:21:13.919 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-11-12T17:21:14.046 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-11-12T17:21:14.257 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pluggy. 2020-11-12T17:21:14.270 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../105-python3-pluggy_0.6.0-1_all.deb ... 2020-11-12T17:21:14.306 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-11-12T17:21:14.339 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-11-12T17:21:14.601 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-py. 2020-11-12T17:21:14.615 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../106-python3-py_1.5.2-1_all.deb ... 2020-11-12T17:21:14.659 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-py (1.5.2-1) ... 2020-11-12T17:21:14.694 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-11-12T17:21:14.820 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-12T17:21:14.925 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyinotify. 2020-11-12T17:21:14.943 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1_all.deb ... 2020-11-12T17:21:14.975 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-11-12T17:21:15.288 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pytest. 2020-11-12T17:21:15.302 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../108-python3-pytest_3.3.2-2_all.deb ... 2020-11-12T17:21:15.368 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-11-12T17:21:15.422 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-11-12T17:21:15.717 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-simplejson. 2020-11-12T17:21:15.731 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../109-python3-simplejson_3.13.2-1_amd64.deb ... 2020-11-12T17:21:15.775 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-11-12T17:21:15.807 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-11-12T17:21:16.084 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-webencodings (0.5-2) ... 2020-11-12T17:21:16.120 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-tk:amd64. 2020-11-12T17:21:16.134 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../110-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-11-12T17:21:16.182 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-11-12T17:21:16.376 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python-attr (17.4.0-2) ... 2020-11-12T17:21:16.572 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-11-12T17:21:16.644 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package radosgw. 2020-11-12T17:21:16.659 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../111-radosgw_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:21:16.698 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-py (1.5.2-1) ... 2020-11-12T17:21:16.702 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking radosgw (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:17.042 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-11-12T17:21:17.386 INFO:teuthology.orchestra.run.smithi205.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-11-12T17:21:17.678 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-11-12T17:21:17.679 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package rbd-fuse. 2020-11-12T17:21:17.696 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../112-rbd-fuse_15.2.5-585-g31d4e76d-1bionic_amd64.deb ... 2020-11-12T17:21:17.739 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking rbd-fuse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:17.987 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-ceph-argparse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:18.054 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-11-12T17:21:18.288 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-11-12T17:21:18.382 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-11-12T17:21:18.589 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-11-12T17:21:18.719 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-11-12T17:21:18.784 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-11-12T17:21:18.910 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-12T17:21:19.538 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-11-12T17:21:19.638 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-11-12T17:21:19.939 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-11-12T17:21:19.956 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-11-12T17:21:20.249 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python-py (1.5.2-1) ... 2020-11-12T17:21:20.261 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-webencodings (0.5-2) ... 2020-11-12T17:21:20.475 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-11-12T17:21:20.562 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-attr (17.4.0-2) ... 2020-11-12T17:21:20.764 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-11-12T17:21:20.818 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-11-12T17:21:20.890 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-py (1.5.2-1) ... 2020-11-12T17:21:20.891 INFO:teuthology.orchestra.run.smithi205.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-11-12T17:21:21.128 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-11-12T17:21:21.241 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-11-12T17:21:21.242 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-11-12T17:21:21.435 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-11-12T17:21:21.579 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-11-12T17:21:21.844 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-11-12T17:21:21.894 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-11-12T17:21:22.129 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-11-12T17:21:22.212 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-ceph-argparse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:22.422 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-11-12T17:21:22.543 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-11-12T17:21:22.781 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-11-12T17:21:22.861 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-11-12T17:21:22.987 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-11-12T17:21:23.116 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-11-12T17:21:23.392 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up cephadm (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:23.948 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-11-12T17:21:24.023 INFO:teuthology.orchestra.run.smithi205.stdout:Adding system user cephadm....done 2020-11-12T17:21:24.170 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-11-12T17:21:24.266 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-11-12T17:21:24.446 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-12T17:21:24.564 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-py (1.5.2-1) ... 2020-11-12T17:21:24.572 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-11-12T17:21:24.698 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-11-12T17:21:24.797 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-11-12T17:21:25.049 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-11-12T17:21:25.143 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-11-12T17:21:25.233 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-11-12T17:21:25.342 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-11-12T17:21:25.462 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-11-12T17:21:25.478 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-11-12T17:21:25.604 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-11-12T17:21:25.772 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-ceph-common (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:25.831 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-11-12T17:21:26.082 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-monotonic (1.1-2) ... 2020-11-12T17:21:26.140 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-11-12T17:21:26.366 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-12T17:21:26.466 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-11-12T17:21:26.542 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-11-12T17:21:26.784 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-11-12T17:21:26.852 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-11-12T17:21:27.177 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-11-12T17:21:27.211 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-11-12T17:21:27.284 INFO:teuthology.orchestra.run.smithi205.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-11-12T17:21:27.332 INFO:teuthology.orchestra.run.smithi205.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-11-12T17:21:27.510 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-11-12T17:21:27.572 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-11-12T17:21:27.803 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up cephadm (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:27.875 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-12T17:21:28.168 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-11-12T17:21:28.429 INFO:teuthology.orchestra.run.smithi036.stdout:Adding system user cephadm....done 2020-11-12T17:21:28.519 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-attr (17.4.0-2) ... 2020-11-12T17:21:28.627 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-11-12T17:21:28.787 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-11-12T17:21:28.911 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-12T17:21:28.971 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-12T17:21:29.037 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-11-12T17:21:29.167 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-11-12T17:21:29.382 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-11-12T17:21:29.471 INFO:teuthology.orchestra.run.smithi205.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-11-12T17:21:29.716 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up liboath0 (2.6.1-1) ... 2020-11-12T17:21:29.893 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-12T17:21:29.901 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-11-12T17:21:30.019 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-11-12T17:21:30.203 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-11-12T17:21:30.290 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-11-12T17:21:30.329 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-11-12T17:21:30.416 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-11-12T17:21:30.680 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-ceph-common (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:30.801 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-12T17:21:30.935 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-11-12T17:21:31.236 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-tz (2018.3-2) ... 2020-11-12T17:21:31.240 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-monotonic (1.1-2) ... 2020-11-12T17:21:31.512 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-11-12T17:21:31.550 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-12T17:21:31.692 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-11-12T17:21:31.780 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-11-12T17:21:32.056 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-11-12T17:21:32.073 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-joblib (0.11-1) ... 2020-11-12T17:21:32.432 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-11-12T17:21:32.449 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-routes (2.4.1-1) ... 2020-11-12T17:21:32.539 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-11-12T17:21:32.579 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-11-12T17:21:32.731 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-11-12T17:21:32.809 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-11-12T17:21:33.032 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-11-12T17:21:33.142 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-12T17:21:33.350 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2020-11-12T17:21:33.428 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-11-12T17:21:33.718 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-11-12T17:21:33.763 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-attr (17.4.0-2) ... 2020-11-12T17:21:34.011 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up jq (1.5+dfsg-2) ... 2020-11-12T17:21:34.098 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-11-12T17:21:34.159 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-11-12T17:21:34.291 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-12T17:21:34.713 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-11-12T17:21:34.802 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-11-12T17:21:35.048 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up liboath0 (2.6.1-1) ... 2020-11-12T17:21:35.225 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-12T17:21:35.290 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-12T17:21:35.351 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-11-12T17:21:35.608 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-11-12T17:21:35.661 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-11-12T17:21:35.795 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-11-12T17:21:35.942 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-11-12T17:21:36.071 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-11-12T17:21:36.205 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-12T17:21:36.339 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-11-12T17:21:36.454 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python-pytest (3.3.2-2) ... 2020-11-12T17:21:36.628 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-tz (2018.3-2) ... 2020-11-12T17:21:36.710 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-11-12T17:21:36.879 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-11-12T17:21:36.929 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-11-12T17:21:37.222 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-11-12T17:21:37.432 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up librados2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:37.532 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-joblib (0.11-1) ... 2020-11-12T17:21:37.560 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-11-12T17:21:37.857 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up libcephfs2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:37.900 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-routes (2.4.1-1) ... 2020-11-12T17:21:38.003 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up libcephfs-dev (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:38.114 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-rados (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:38.210 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-11-12T17:21:38.241 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-11-12T17:21:38.519 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-11-12T17:21:38.538 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-11-12T17:21:38.840 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2020-11-12T17:21:38.852 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-11-12T17:21:39.209 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-11-12T17:21:39.211 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-11-12T17:21:39.521 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up jq (1.5+dfsg-2) ... 2020-11-12T17:21:39.659 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-11-12T17:21:40.149 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-11-12T17:21:40.890 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-12T17:21:41.006 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-11-12T17:21:41.217 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-11-12T17:21:41.311 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up libradosstriper1 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:41.421 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-cephfs (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:41.556 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-11-12T17:21:41.683 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-11-12T17:21:41.710 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up librgw2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:41.825 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-fuse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:42.033 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-12T17:21:42.033 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-12T17:21:42.065 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-pytest (3.3.2-2) ... 2020-11-12T17:21:42.335 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up librbd1 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:42.343 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-11-12T17:21:42.453 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-11-12T17:21:42.470 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-11-12T17:21:42.546 INFO:teuthology.orchestra.run.smithi205.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-11-12T17:21:42.584 INFO:teuthology.orchestra.run.smithi205.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-11-12T17:21:42.609 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librados2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:42.738 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-11-12T17:21:42.892 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-11-12T17:21:43.063 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libcephfs2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:43.190 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libcephfs-dev (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:43.327 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rados (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:43.454 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-11-12T17:21:43.585 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mgr-modules-core (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:43.704 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-11-12T17:21:43.781 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-11-12T17:21:44.006 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-rgw (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:44.103 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-11-12T17:21:44.140 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up rbd-fuse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:44.266 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up python3-rbd (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:44.394 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-common (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:44.437 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-11-12T17:21:44.913 INFO:teuthology.orchestra.run.smithi205.stdout:Adding group ceph....done 2020-11-12T17:21:45.307 INFO:teuthology.orchestra.run.smithi205.stdout:Adding system user ceph....done 2020-11-12T17:21:45.437 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-11-12T17:21:45.466 INFO:teuthology.orchestra.run.smithi205.stdout:Setting system user ceph properties....done 2020-11-12T17:21:45.628 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-11-12T17:21:45.854 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-11-12T17:21:46.147 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up radosgw (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:46.342 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-11-12T17:21:46.382 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-12T17:21:46.382 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-12T17:21:46.659 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libradosstriper1 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:46.782 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cephfs (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:46.841 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-test (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:46.967 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-base (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:47.104 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librgw2 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:47.230 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-fuse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:47.390 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-11-12T17:21:47.446 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-12T17:21:47.446 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-12T17:21:47.677 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mgr (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:47.761 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librbd1 (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:47.872 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-11-12T17:21:47.892 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-12T17:21:47.892 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-12T17:21:47.946 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-11-12T17:21:47.977 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-11-12T17:21:48.203 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mgr-diskprediction-local (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:48.296 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-11-12T17:21:48.338 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-osd (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:48.757 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-12T17:21:48.758 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-12T17:21:48.946 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-modules-core (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:49.048 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mgr-cephadm (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:49.049 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-11-12T17:21:49.190 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:49.341 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mgr-rook (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:49.377 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rgw (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:49.483 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mds (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:49.502 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up rbd-fuse (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:49.628 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rbd (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:49.704 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-12T17:21:49.705 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-12T17:21:49.763 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-common (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:49.976 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mon (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:50.192 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-12T17:21:50.193 INFO:teuthology.orchestra.run.smithi205.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-12T17:21:50.356 INFO:teuthology.orchestra.run.smithi036.stdout:Adding group ceph....done 2020-11-12T17:21:50.469 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mgr-k8sevents (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:50.602 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph-mgr-dashboard (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:50.745 INFO:teuthology.orchestra.run.smithi205.stdout:Setting up ceph (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:50.764 INFO:teuthology.orchestra.run.smithi036.stdout:Adding system user ceph....done 2020-11-12T17:21:50.872 INFO:teuthology.orchestra.run.smithi205.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-11-12T17:21:50.951 INFO:teuthology.orchestra.run.smithi036.stdout:Setting system user ceph properties....done 2020-11-12T17:21:51.073 INFO:teuthology.orchestra.run.smithi205.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-11-12T17:21:51.177 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-11-12T17:21:51.353 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-11-12T17:21:51.657 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up radosgw (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:51.906 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-12T17:21:51.907 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-12T17:21:52.325 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-test (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:52.451 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-base (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:52.791 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-11-12T17:21:53.077 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:53.143 INFO:teuthology.orchestra.run.smithi205.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-11-12T17:21:53.187 INFO:teuthology.orchestra.run.smithi205.stdout:ureadahead will be reprofiled on next reboot 2020-11-12T17:21:53.244 INFO:teuthology.orchestra.run.smithi205.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2020-11-12T17:21:53.293 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-12T17:21:53.293 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-12T17:21:53.569 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-diskprediction-local (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:53.679 INFO:teuthology.orchestra.run.smithi205.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-11-12T17:21:53.683 DEBUG:teuthology.parallel:result is None 2020-11-12T17:21:53.712 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-osd (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:54.174 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-12T17:21:54.175 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-12T17:21:54.488 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-cephadm (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:54.640 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:54.765 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-rook (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:54.891 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mds (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:55.115 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-12T17:21:55.115 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-12T17:21:55.411 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mon (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:55.634 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-12T17:21:55.634 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-12T17:21:55.937 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-k8sevents (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:56.063 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-dashboard (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:56.205 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph (15.2.5-585-g31d4e76d-1bionic) ... 2020-11-12T17:21:56.332 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-11-12T17:21:56.541 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-11-12T17:21:58.661 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-11-12T17:21:58.703 INFO:teuthology.orchestra.run.smithi036.stdout:ureadahead will be reprofiled on next reboot 2020-11-12T17:21:58.761 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2020-11-12T17:21:59.238 INFO:teuthology.orchestra.run.smithi036.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-11-12T17:21:59.240 DEBUG:teuthology.parallel:result is None 2020-11-12T17:21:59.242 INFO:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2020-11-12T17:21:59.335 INFO:teuthology.orchestra.run.smithi036.stdout:Ubuntu 2020-11-12T17:21:59.340 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-12T17:21:59.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=31d4e76d0d584790763b4b1146b29ea4cfc2e9af 2020-11-12T17:21:59.520 INFO:teuthology.orchestra.run.smithi036:> dpkg-query -W -f '${Version}' ceph 2020-11-12T17:21:59.545 INFO:teuthology.orchestra.run.smithi036.stdout:15.2.5-585-g31d4e76d-1bionic 2020-11-12T17:21:59.547 INFO:teuthology.packaging:The installed version of ceph is 15.2.5-585-g31d4e76d-1bionic 2020-11-12T17:21:59.548 INFO:teuthology.task.install:The correct ceph version 15.2.5-585-g31d4e76d-1bionic is installed. 2020-11-12T17:21:59.549 INFO:teuthology.orchestra.run.smithi205:> sudo lsb_release -is 2020-11-12T17:21:59.606 INFO:teuthology.orchestra.run.smithi205.stdout:Ubuntu 2020-11-12T17:21:59.611 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-12T17:21:59.612 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=31d4e76d0d584790763b4b1146b29ea4cfc2e9af 2020-11-12T17:21:59.786 INFO:teuthology.orchestra.run.smithi205:> dpkg-query -W -f '${Version}' ceph 2020-11-12T17:21:59.810 INFO:teuthology.orchestra.run.smithi205.stdout:15.2.5-585-g31d4e76d-1bionic 2020-11-12T17:21:59.811 INFO:teuthology.packaging:The installed version of ceph is 15.2.5-585-g31d4e76d-1bionic 2020-11-12T17:21:59.811 INFO:teuthology.task.install:The correct ceph version 15.2.5-585-g31d4e76d-1bionic is installed. 2020-11-12T17:21:59.813 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-12T17:21:59.815 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-12T17:21:59.815 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-12T17:21:59.820 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-12T17:21:59.830 INFO:teuthology.orchestra.run.smithi036.stderr:24+1 records in 2020-11-12T17:21:59.830 INFO:teuthology.orchestra.run.smithi036.stderr:24+1 records out 2020-11-12T17:21:59.830 INFO:teuthology.orchestra.run.smithi036.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000218744 s, 57.9 MB/s 2020-11-12T17:21:59.831 INFO:teuthology.orchestra.run.smithi205:> set -ex 2020-11-12T17:21:59.832 INFO:teuthology.orchestra.run.smithi205:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-12T17:21:59.856 INFO:teuthology.orchestra.run.smithi205.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-12T17:21:59.865 INFO:teuthology.orchestra.run.smithi205.stderr:24+1 records in 2020-11-12T17:21:59.866 INFO:teuthology.orchestra.run.smithi205.stderr:24+1 records out 2020-11-12T17:21:59.866 INFO:teuthology.orchestra.run.smithi205.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000220563 s, 57.4 MB/s 2020-11-12T17:21:59.867 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-12T17:21:59.868 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-12T17:21:59.868 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/usr/bin/daemon-helper 2020-11-12T17:21:59.879 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-12T17:21:59.888 INFO:teuthology.orchestra.run.smithi036.stderr:5+1 records in 2020-11-12T17:21:59.889 INFO:teuthology.orchestra.run.smithi036.stderr:5+1 records out 2020-11-12T17:21:59.889 INFO:teuthology.orchestra.run.smithi036.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 7.6283e-05 s, 40.1 MB/s 2020-11-12T17:21:59.890 INFO:teuthology.orchestra.run.smithi036:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-12T17:21:59.944 INFO:teuthology.orchestra.run.smithi205:> set -ex 2020-11-12T17:21:59.945 INFO:teuthology.orchestra.run.smithi205:> sudo dd of=/usr/bin/daemon-helper 2020-11-12T17:21:59.949 INFO:teuthology.orchestra.run.smithi205.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-12T17:21:59.959 INFO:teuthology.orchestra.run.smithi205.stderr:5+1 records in 2020-11-12T17:21:59.959 INFO:teuthology.orchestra.run.smithi205.stderr:5+1 records out 2020-11-12T17:21:59.960 INFO:teuthology.orchestra.run.smithi205.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 9.8433e-05 s, 31.1 MB/s 2020-11-12T17:21:59.961 INFO:teuthology.orchestra.run.smithi205:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-12T17:22:00.018 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-12T17:22:00.019 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-12T17:22:00.020 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-12T17:22:00.030 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-12T17:22:00.072 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-12T17:22:00.072 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-12T17:22:00.072 INFO:teuthology.orchestra.run.smithi036.stderr:299 bytes copied, 0.0349276 s, 8.6 kB/s 2020-11-12T17:22:00.073 INFO:teuthology.orchestra.run.smithi036:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-12T17:22:00.129 INFO:teuthology.orchestra.run.smithi205:> set -ex 2020-11-12T17:22:00.130 INFO:teuthology.orchestra.run.smithi205:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-12T17:22:00.135 INFO:teuthology.orchestra.run.smithi205.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-12T17:22:00.144 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records in 2020-11-12T17:22:00.144 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records out 2020-11-12T17:22:00.144 INFO:teuthology.orchestra.run.smithi205.stderr:299 bytes copied, 6.9463e-05 s, 4.3 MB/s 2020-11-12T17:22:00.145 INFO:teuthology.orchestra.run.smithi205:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-12T17:22:00.204 INFO:teuthology.run_tasks:Running task ceph... 2020-11-12T17:22:00.387 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-12T17:22:00.388 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 777 /var/log/ceph 2020-11-12T17:22:00.390 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 777 /var/log/ceph 2020-11-12T17:22:00.405 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-12T17:22:00.405 INFO:teuthology.orchestra.run.smithi036:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-12T17:22:00.445 INFO:teuthology.orchestra.run.smithi205:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-12T17:22:00.475 INFO:tasks.ceph:Creating extra log directories... 2020-11-12T17:22:00.475 INFO:teuthology.orchestra.run.smithi036:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-12T17:22:00.505 INFO:teuthology.orchestra.run.smithi205:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-12T17:22:00.533 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-12T17:22:00.534 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2020-11-12T17:22:00.534 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2020-11-12_17:03:16-rados-octopus-distro-basic-smithi/5616029', 'branch': 'octopus', 'description': 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5616029', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2020-11-12_17:03:16-rados-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '18.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'mon_bind_msgr2': False, 'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_octopus/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'mon_bind_msgr2': False, 'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af', 'cluster': 'ceph'}}, {'thrashosds': {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}]}], 'teuthology_branch': 'master', 'timestamp': '2020-11-12_17:03:16', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.24845', 'targets': {'smithi036.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOY4MgcE3Uno2fwpGNu0is8BtcD9Hptvku+hEnkZ1fQw6B3UgCa9tzt6zJuSJV1prqs1p7x3oQArEIqyztjjgupeZzKQgFi9rTNfGAasBk3zH9Ont1BvYwLBFegD/thNe+vtCMciYVPTJ4FPmOpzgPqw3jnTnctdnrx7uKQNYiKsr9sYGP6x+1t+uXBIv5qOH3AFeV4HUwInrYgr4fN23eSpTJCAz13mXFAHJ9rE4q5YM4waf8Ep/p7TpLCWtUS4zEwAOZW3HElN4eoSrAQcNAGJy0cZ/iWBTKwZ7y5dtgTHiXVAZPdu+zC50WrWsCEYgPGjxwKi6mGCxGBRASAfsL', 'smithi205.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZIjzLIHjjt+jceT1/Q66iwK0mQwlp4cD1U+dXJcqUx3VA5nJGv651fF3Mv9f2Nln1SuLEu/q36DVu2OBycIimTjyxXvhuAvDQ/8RIeSko48N+L/vxNwdWrbmVRfjiIEW3VEAmvWRrtVgnaIbNQGmdzXCHojMgVhiQs+0qqD6wFufdtaf1/iARoGaozEFIN4IyhevVT9c7w3b9CtIF97ej6Eqq8xbLfSEFxS4XlG6uu6ygEL+gLdQaQpOWPicp1PkvihowebEJxqKY6MZwqJz9teCkwTjXJb0dqUou/9N4BMnoCl2FsvoC5QxucUgWNpqaDY+NlhLu4vuTcWEzxi0Z'}} 2020-11-12T17:22:00.536 INFO:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-12T17:22:00.561 INFO:teuthology.orchestra.run.smithi205:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-12T17:22:00.581 INFO:teuthology.orchestra.run.smithi036:> sudo install -d -m0777 -- /var/run/ceph 2020-11-12T17:22:00.609 INFO:teuthology.orchestra.run.smithi205:> sudo install -d -m0777 -- /var/run/ceph 2020-11-12T17:22:00.639 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-12T17:22:00.640 INFO:teuthology.orchestra.run.smithi036:> dd if=/scratch_devs of=/dev/stdout 2020-11-12T17:22:00.668 INFO:teuthology.orchestra.run.smithi036.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-12T17:22:00.729 INFO:teuthology.orchestra.run.smithi036.stdout:/dev/vg_nvme/lv_1 2020-11-12T17:22:00.730 INFO:teuthology.orchestra.run.smithi036.stdout:/dev/vg_nvme/lv_2 2020-11-12T17:22:00.730 INFO:teuthology.orchestra.run.smithi036.stdout:/dev/vg_nvme/lv_3 2020-11-12T17:22:00.730 INFO:teuthology.orchestra.run.smithi036.stdout:/dev/vg_nvme/lv_4 2020-11-12T17:22:00.730 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-12T17:22:00.731 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-12T17:22:00.731 INFO:teuthology.orchestra.run.smithi036.stderr:72 bytes copied, 0.000160025 s, 450 kB/s 2020-11-12T17:22:00.731 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-12T17:22:00.731 INFO:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-12T17:22:00.778 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-12T17:22:00.778 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-12T17:22:00.778 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 341 Links: 1 2020-11-12T17:22:00.779 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-12T17:22:00.779 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2020-11-12 17:19:32.225879218 +0000 2020-11-12T17:22:00.779 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2020-11-12 17:19:32.105879219 +0000 2020-11-12T17:22:00.779 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2020-11-12 17:19:32.105879219 +0000 2020-11-12T17:22:00.779 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2020-11-12T17:22:00.787 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2020-11-12T17:22:00.788 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2020-11-12T17:22:00.788 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000414294 s, 1.2 MB/s 2020-11-12T17:22:00.792 INFO:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-12T17:22:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-12T17:22:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-12T17:22:00.842 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 348 Links: 1 2020-11-12T17:22:00.842 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-12T17:22:00.843 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2020-11-12 17:19:32.481879215 +0000 2020-11-12T17:22:00.843 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2020-11-12 17:19:32.377879216 +0000 2020-11-12T17:22:00.843 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2020-11-12 17:19:32.377879216 +0000 2020-11-12T17:22:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2020-11-12T17:22:00.852 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2020-11-12T17:22:00.852 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2020-11-12T17:22:00.852 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000384687 s, 1.3 MB/s 2020-11-12T17:22:00.856 INFO:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-12T17:22:00.906 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-12T17:22:00.907 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-12T17:22:00.907 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 354 Links: 1 2020-11-12T17:22:00.907 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-12T17:22:00.907 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2020-11-12 17:19:32.729879212 +0000 2020-11-12T17:22:00.907 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2020-11-12 17:19:32.653879213 +0000 2020-11-12T17:22:00.907 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2020-11-12 17:19:32.653879213 +0000 2020-11-12T17:22:00.907 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2020-11-12T17:22:00.916 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2020-11-12T17:22:00.916 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2020-11-12T17:22:00.916 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000336651 s, 1.5 MB/s 2020-11-12T17:22:00.921 INFO:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-12T17:22:00.974 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-12T17:22:00.974 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-12T17:22:00.975 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 360 Links: 1 2020-11-12T17:22:00.975 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-12T17:22:00.975 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2020-11-12 17:19:32.989879210 +0000 2020-11-12T17:22:00.975 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2020-11-12 17:19:32.865879211 +0000 2020-11-12T17:22:00.975 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2020-11-12 17:19:32.865879211 +0000 2020-11-12T17:22:00.975 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2020-11-12T17:22:00.984 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2020-11-12T17:22:00.984 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2020-11-12T17:22:00.985 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000405696 s, 1.3 MB/s 2020-11-12T17:22:00.988 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:00.989 INFO:teuthology.orchestra.run.smithi205:> set -ex 2020-11-12T17:22:00.989 INFO:teuthology.orchestra.run.smithi205:> dd if=/scratch_devs of=/dev/stdout 2020-11-12T17:22:00.994 INFO:teuthology.orchestra.run.smithi205.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-12T17:22:00.995 INFO:teuthology.orchestra.run.smithi205.stdout:/dev/vg_nvme/lv_1 2020-11-12T17:22:00.995 INFO:teuthology.orchestra.run.smithi205.stdout:/dev/vg_nvme/lv_2 2020-11-12T17:22:00.995 INFO:teuthology.orchestra.run.smithi205.stdout:/dev/vg_nvme/lv_3 2020-11-12T17:22:00.996 INFO:teuthology.orchestra.run.smithi205.stdout:/dev/vg_nvme/lv_4 2020-11-12T17:22:00.996 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records in 2020-11-12T17:22:00.996 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records out 2020-11-12T17:22:00.996 INFO:teuthology.orchestra.run.smithi205.stderr:72 bytes copied, 0.000158707 s, 454 kB/s 2020-11-12T17:22:00.996 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-12T17:22:00.997 INFO:teuthology.orchestra.run.smithi205:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-12T17:22:01.042 INFO:teuthology.orchestra.run.smithi205.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-12T17:22:01.043 INFO:teuthology.orchestra.run.smithi205.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-12T17:22:01.043 INFO:teuthology.orchestra.run.smithi205.stdout:Device: 6h/6d Inode: 341 Links: 1 2020-11-12T17:22:01.043 INFO:teuthology.orchestra.run.smithi205.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-12T17:22:01.043 INFO:teuthology.orchestra.run.smithi205.stdout:Access: 2020-11-12 17:19:33.240517691 +0000 2020-11-12T17:22:01.044 INFO:teuthology.orchestra.run.smithi205.stdout:Modify: 2020-11-12 17:19:33.136465693 +0000 2020-11-12T17:22:01.044 INFO:teuthology.orchestra.run.smithi205.stdout:Change: 2020-11-12 17:19:33.136465693 +0000 2020-11-12T17:22:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: Birth: - 2020-11-12T17:22:01.052 INFO:teuthology.orchestra.run.smithi205.stderr:1+0 records in 2020-11-12T17:22:01.053 INFO:teuthology.orchestra.run.smithi205.stderr:1+0 records out 2020-11-12T17:22:01.053 INFO:teuthology.orchestra.run.smithi205.stderr:512 bytes copied, 0.000336441 s, 1.5 MB/s 2020-11-12T17:22:01.057 INFO:teuthology.orchestra.run.smithi205:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-12T17:22:01.107 INFO:teuthology.orchestra.run.smithi205.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-12T17:22:01.107 INFO:teuthology.orchestra.run.smithi205.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-12T17:22:01.107 INFO:teuthology.orchestra.run.smithi205.stdout:Device: 6h/6d Inode: 348 Links: 1 2020-11-12T17:22:01.107 INFO:teuthology.orchestra.run.smithi205.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-12T17:22:01.107 INFO:teuthology.orchestra.run.smithi205.stdout:Access: 2020-11-12 17:19:33.468631687 +0000 2020-11-12T17:22:01.108 INFO:teuthology.orchestra.run.smithi205.stdout:Modify: 2020-11-12 17:19:33.376585688 +0000 2020-11-12T17:22:01.108 INFO:teuthology.orchestra.run.smithi205.stdout:Change: 2020-11-12 17:19:33.376585688 +0000 2020-11-12T17:22:01.108 INFO:teuthology.orchestra.run.smithi205.stdout: Birth: - 2020-11-12T17:22:01.116 INFO:teuthology.orchestra.run.smithi205.stderr:1+0 records in 2020-11-12T17:22:01.116 INFO:teuthology.orchestra.run.smithi205.stderr:1+0 records out 2020-11-12T17:22:01.116 INFO:teuthology.orchestra.run.smithi205.stderr:512 bytes copied, 0.000360805 s, 1.4 MB/s 2020-11-12T17:22:01.120 INFO:teuthology.orchestra.run.smithi205:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-12T17:22:01.170 INFO:teuthology.orchestra.run.smithi205.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-12T17:22:01.170 INFO:teuthology.orchestra.run.smithi205.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-12T17:22:01.170 INFO:teuthology.orchestra.run.smithi205.stdout:Device: 6h/6d Inode: 354 Links: 1 2020-11-12T17:22:01.171 INFO:teuthology.orchestra.run.smithi205.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-12T17:22:01.171 INFO:teuthology.orchestra.run.smithi205.stdout:Access: 2020-11-12 17:19:33.608701683 +0000 2020-11-12T17:22:01.171 INFO:teuthology.orchestra.run.smithi205.stdout:Modify: 2020-11-12 17:19:33.604699684 +0000 2020-11-12T17:22:01.171 INFO:teuthology.orchestra.run.smithi205.stdout:Change: 2020-11-12 17:19:33.604699684 +0000 2020-11-12T17:22:01.171 INFO:teuthology.orchestra.run.smithi205.stdout: Birth: - 2020-11-12T17:22:01.180 INFO:teuthology.orchestra.run.smithi205.stderr:1+0 records in 2020-11-12T17:22:01.180 INFO:teuthology.orchestra.run.smithi205.stderr:1+0 records out 2020-11-12T17:22:01.180 INFO:teuthology.orchestra.run.smithi205.stderr:512 bytes copied, 0.000389607 s, 1.3 MB/s 2020-11-12T17:22:01.184 INFO:teuthology.orchestra.run.smithi205:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-12T17:22:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-12T17:22:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-12T17:22:01.235 INFO:teuthology.orchestra.run.smithi205.stdout:Device: 6h/6d Inode: 360 Links: 1 2020-11-12T17:22:01.235 INFO:teuthology.orchestra.run.smithi205.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-12T17:22:01.235 INFO:teuthology.orchestra.run.smithi205.stdout:Access: 2020-11-12 17:19:33.972883674 +0000 2020-11-12T17:22:01.235 INFO:teuthology.orchestra.run.smithi205.stdout:Modify: 2020-11-12 17:19:33.864829677 +0000 2020-11-12T17:22:01.236 INFO:teuthology.orchestra.run.smithi205.stdout:Change: 2020-11-12 17:19:33.864829677 +0000 2020-11-12T17:22:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: Birth: - 2020-11-12T17:22:01.244 INFO:teuthology.orchestra.run.smithi205.stderr:1+0 records in 2020-11-12T17:22:01.244 INFO:teuthology.orchestra.run.smithi205.stderr:1+0 records out 2020-11-12T17:22:01.244 INFO:teuthology.orchestra.run.smithi205.stderr:512 bytes copied, 0.000337434 s, 1.5 MB/s 2020-11-12T17:22:01.247 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:01.248 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi036.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi205.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-11-12T17:22:01.248 INFO:tasks.ceph:Generating config... 2020-11-12T17:22:01.260 INFO:tasks.ceph:[osd] debug monc = 20 2020-11-12T17:22:01.260 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-11-12T17:22:01.261 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2020-11-12T17:22:01.261 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2020-11-12T17:22:01.261 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-11-12T17:22:01.262 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-11-12T17:22:01.262 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-11-12T17:22:01.263 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-12T17:22:01.263 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-12T17:22:01.263 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-12T17:22:01.264 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-12T17:22:01.264 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-11-12T17:22:01.264 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-11-12T17:22:01.264 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-11-12T17:22:01.265 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-11-12T17:22:01.265 INFO:tasks.ceph:[osd] osd backoff on peering = True 2020-11-12T17:22:01.265 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2020-11-12T17:22:01.265 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2020-11-12T17:22:01.266 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-11-12T17:22:01.266 INFO:tasks.ceph:[osd] osd inject bad map crc probability = 0.1 2020-11-12T17:22:01.266 INFO:tasks.ceph:[osd] osd map cache size = 1 2020-11-12T17:22:01.266 INFO:tasks.ceph:[osd] osd max backfills = 6 2020-11-12T17:22:01.266 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2020-11-12T17:22:01.267 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-11-12T17:22:01.267 INFO:tasks.ceph:[osd] osd op queue = debug_random 2020-11-12T17:22:01.267 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2020-11-12T17:22:01.267 INFO:tasks.ceph:[osd] osd scrub during recovery = False 2020-11-12T17:22:01.268 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2020-11-12T17:22:01.268 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2020-11-12T17:22:01.268 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-11-12T17:22:01.268 INFO:tasks.ceph:[client.0] debug ms = 1 2020-11-12T17:22:01.268 INFO:tasks.ceph:[client.0] debug objecter = 20 2020-11-12T17:22:01.269 INFO:tasks.ceph:[client.0] debug rados = 20 2020-11-12T17:22:01.269 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-11-12T17:22:01.269 INFO:tasks.ceph:[global] ms bind msgr2 = False 2020-11-12T17:22:01.269 INFO:tasks.ceph:[global] ms inject delay max = 1 2020-11-12T17:22:01.269 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2020-11-12T17:22:01.270 INFO:tasks.ceph:[global] ms inject delay type = osd 2020-11-12T17:22:01.270 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2020-11-12T17:22:01.270 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2020-11-12T17:22:01.270 INFO:tasks.ceph:[global] ms type = async 2020-11-12T17:22:01.270 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2020-11-12T17:22:01.271 INFO:tasks.ceph:[global] osd_pool_default_size = 2 2020-11-12T17:22:01.271 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-12T17:22:01.271 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-12T17:22:01.271 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-12T17:22:01.271 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-12T17:22:01.272 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-12T17:22:01.272 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2020-11-12T17:22:01.272 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2020-11-12T17:22:01.272 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2020-11-12T17:22:01.272 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2020-11-12T17:22:01.273 INFO:tasks.ceph:[mon] paxos service trim min = 10 2020-11-12T17:22:01.277 INFO:tasks.ceph:Setting up mon.a... 2020-11-12T17:22:01.277 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-12T17:22:01.310 INFO:teuthology.orchestra.run.smithi036.stdout:creating /etc/ceph/ceph.keyring 2020-11-12T17:22:01.313 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-12T17:22:01.390 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-12T17:22:01.446 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.36:6789]'), ('mon.c', '[v1:172.21.15.36:6790]'), ('mon.b', '[v1:172.21.15.205:6789]')] 2020-11-12T17:22:01.447 INFO:teuthology.orchestra.run.smithi036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --addv a '[v1:172.21.15.36:6789]' --addv c '[v1:172.21.15.36:6790]' --addv b '[v1:172.21.15.205:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:01.521 INFO:teuthology.orchestra.run.smithi036.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:01.522 INFO:teuthology.orchestra.run.smithi036.stdout:monmaptool: generated fsid 8c8a6bcc-49d4-47d1-904f-e20798ef8e1f 2020-11-12T17:22:01.522 INFO:teuthology.orchestra.run.smithi036.stdout:epoch 0 2020-11-12T17:22:01.523 INFO:teuthology.orchestra.run.smithi036.stdout:fsid 8c8a6bcc-49d4-47d1-904f-e20798ef8e1f 2020-11-12T17:22:01.523 INFO:teuthology.orchestra.run.smithi036.stdout:last_changed 2020-11-12T17:22:01.521232+0000 2020-11-12T17:22:01.523 INFO:teuthology.orchestra.run.smithi036.stdout:created 2020-11-12T17:22:01.521232+0000 2020-11-12T17:22:01.524 INFO:teuthology.orchestra.run.smithi036.stdout:min_mon_release 0 (unknown) 2020-11-12T17:22:01.524 INFO:teuthology.orchestra.run.smithi036.stdout:0: v1:172.21.15.36:6789/0 mon.a 2020-11-12T17:22:01.524 INFO:teuthology.orchestra.run.smithi036.stdout:1: v1:172.21.15.205:6789/0 mon.b 2020-11-12T17:22:01.524 INFO:teuthology.orchestra.run.smithi036.stdout:2: v1:172.21.15.36:6790/0 mon.c 2020-11-12T17:22:01.525 INFO:teuthology.orchestra.run.smithi036.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-12T17:22:01.526 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8c8a6bcc-49d4-47d1-904f-e20798ef8e1f... 2020-11-12T17:22:01.529 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-12T17:22:01.569 INFO:teuthology.orchestra.run.smithi205:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-12T17:22:01.599 INFO:teuthology.orchestra.run.smithi036.stdout:[global] 2020-11-12T17:22:01.599 INFO:teuthology.orchestra.run.smithi036.stdout: chdir = "" 2020-11-12T17:22:01.599 INFO:teuthology.orchestra.run.smithi036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-12T17:22:01.599 INFO:teuthology.orchestra.run.smithi036.stdout: auth supported = cephx 2020-11-12T17:22:01.600 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.600 INFO:teuthology.orchestra.run.smithi036.stdout: filestore xattr use omap = true 2020-11-12T17:22:01.600 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.600 INFO:teuthology.orchestra.run.smithi036.stdout: mon clock drift allowed = 1.000 2020-11-12T17:22:01.600 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.600 INFO:teuthology.orchestra.run.smithi036.stdout: osd crush chooseleaf type = 0 2020-11-12T17:22:01.600 INFO:teuthology.orchestra.run.smithi036.stdout: auth debug = true 2020-11-12T17:22:01.601 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.601 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on old message = true 2020-11-12T17:22:01.601 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on bug = true 2020-11-12T17:22:01.601 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.601 INFO:teuthology.orchestra.run.smithi036.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-12T17:22:01.601 INFO:teuthology.orchestra.run.smithi036.stdout: mon pg warn max object skew = 0 2020-11-12T17:22:01.601 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.601 INFO:teuthology.orchestra.run.smithi036.stdout: # disable pg_autoscaler by default for new pools 2020-11-12T17:22:01.602 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-12T17:22:01.602 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.602 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default size = 2 2020-11-12T17:22:01.602 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.602 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow primary affinity = true 2020-11-12T17:22:01.602 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow pg remap = true 2020-11-12T17:22:01.603 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on legacy crush tunables = false 2020-11-12T17:22:01.603 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on crush straw calc version zero = false 2020-11-12T17:22:01.603 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on no sortbitwise = false 2020-11-12T17:22:01.603 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on osd down out interval zero = false 2020-11-12T17:22:01.603 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on too few osds = false 2020-11-12T17:22:01.603 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-12T17:22:01.603 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-12T17:22:01.604 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.604 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-12T17:22:01.604 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.604 INFO:teuthology.orchestra.run.smithi036.stdout: osd default data pool replay window = 5 2020-11-12T17:22:01.604 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.604 INFO:teuthology.orchestra.run.smithi036.stdout: mon allow pool delete = true 2020-11-12T17:22:01.604 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.605 INFO:teuthology.orchestra.run.smithi036.stdout: mon cluster log file level = debug 2020-11-12T17:22:01.605 INFO:teuthology.orchestra.run.smithi036.stdout: debug asserts on shutdown = true 2020-11-12T17:22:01.605 INFO:teuthology.orchestra.run.smithi036.stdout: mon host = "[v1:172.21.15.36:6789],[v1:172.21.15.36:6790],[v1:172.21.15.205:6789]" 2020-11-12T17:22:01.605 INFO:teuthology.orchestra.run.smithi036.stdout: mon client directed command retry = 5 2020-11-12T17:22:01.605 INFO:teuthology.orchestra.run.smithi036.stdout: ms bind msgr2 = False 2020-11-12T17:22:01.606 INFO:teuthology.orchestra.run.smithi036.stdout: ms inject delay max = 1 2020-11-12T17:22:01.606 INFO:teuthology.orchestra.run.smithi036.stdout: ms inject delay probability = 0.005 2020-11-12T17:22:01.606 INFO:teuthology.orchestra.run.smithi036.stdout: ms inject delay type = osd 2020-11-12T17:22:01.606 INFO:teuthology.orchestra.run.smithi036.stdout: ms inject internal delays = 0.002 2020-11-12T17:22:01.607 INFO:teuthology.orchestra.run.smithi036.stdout: ms inject socket failures = 2500 2020-11-12T17:22:01.607 INFO:teuthology.orchestra.run.smithi036.stdout: ms type = async 2020-11-12T17:22:01.607 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_min_size = 2 2020-11-12T17:22:01.607 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_size = 2 2020-11-12T17:22:01.608 INFO:teuthology.orchestra.run.smithi036.stdout: fsid = 8c8a6bcc-49d4-47d1-904f-e20798ef8e1f 2020-11-12T17:22:01.608 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.608 INFO:teuthology.orchestra.run.smithi036.stdout:[osd] 2020-11-12T17:22:01.608 INFO:teuthology.orchestra.run.smithi036.stdout: osd journal size = 100 2020-11-12T17:22:01.609 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.609 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub load threshold = 5.0 2020-11-12T17:22:01.609 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub max interval = 120 2020-11-12T17:22:01.609 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.610 INFO:teuthology.orchestra.run.smithi036.stdout: osd recover clone overlap = true 2020-11-12T17:22:01.610 INFO:teuthology.orchestra.run.smithi036.stdout: osd recovery max chunk = 1048576 2020-11-12T17:22:01.610 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.610 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug shutdown = true 2020-11-12T17:22:01.611 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug op order = true 2020-11-12T17:22:01.611 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify stray on activate = true 2020-11-12T17:22:01.611 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.611 INFO:teuthology.orchestra.run.smithi036.stdout: osd open classes on start = true 2020-11-12T17:22:01.612 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug pg log writeout = true 2020-11-12T17:22:01.612 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.612 INFO:teuthology.orchestra.run.smithi036.stdout: osd deep scrub update digest min age = 30 2020-11-12T17:22:01.612 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.613 INFO:teuthology.orchestra.run.smithi036.stdout: osd map max advance = 10 2020-11-12T17:22:01.613 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.613 INFO:teuthology.orchestra.run.smithi036.stdout: journal zero on create = true 2020-11-12T17:22:01.614 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.614 INFO:teuthology.orchestra.run.smithi036.stdout: filestore ondisk finisher threads = 3 2020-11-12T17:22:01.614 INFO:teuthology.orchestra.run.smithi036.stdout: filestore apply finisher threads = 3 2020-11-12T17:22:01.614 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.615 INFO:teuthology.orchestra.run.smithi036.stdout: bdev debug aio = true 2020-11-12T17:22:01.615 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug misdirected ops = true 2020-11-12T17:22:01.615 INFO:teuthology.orchestra.run.smithi036.stdout: debug monc = 20 2020-11-12T17:22:01.615 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore block size = 96636764160 2020-11-12T17:22:01.616 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore compression algorithm = zstd 2020-11-12T17:22:01.616 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore compression mode = aggressive 2020-11-12T17:22:01.616 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore fsck on mount = True 2020-11-12T17:22:01.616 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluefs = 20 2020-11-12T17:22:01.616 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluestore = 20 2020-11-12T17:22:01.617 INFO:teuthology.orchestra.run.smithi036.stdout: debug filestore = 20 2020-11-12T17:22:01.617 INFO:teuthology.orchestra.run.smithi036.stdout: debug journal = 20 2020-11-12T17:22:01.617 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 20 2020-11-12T17:22:01.617 INFO:teuthology.orchestra.run.smithi036.stdout: debug osd = 25 2020-11-12T17:22:01.617 INFO:teuthology.orchestra.run.smithi036.stdout: debug rocksdb = 10 2020-11-12T17:22:01.617 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd backfillfull_ratio = 0.85 2020-11-12T17:22:01.617 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd full ratio = 0.9 2020-11-12T17:22:01.618 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd nearfull ratio = 0.8 2020-11-12T17:22:01.618 INFO:teuthology.orchestra.run.smithi036.stdout: osd backoff on peering = True 2020-11-12T17:22:01.618 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify cached snaps = True 2020-11-12T17:22:01.618 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify missing on start = True 2020-11-12T17:22:01.618 INFO:teuthology.orchestra.run.smithi036.stdout: osd failsafe full ratio = 0.95 2020-11-12T17:22:01.618 INFO:teuthology.orchestra.run.smithi036.stdout: osd inject bad map crc probability = 0.1 2020-11-12T17:22:01.618 INFO:teuthology.orchestra.run.smithi036.stdout: osd map cache size = 1 2020-11-12T17:22:01.619 INFO:teuthology.orchestra.run.smithi036.stdout: osd max backfills = 6 2020-11-12T17:22:01.619 INFO:teuthology.orchestra.run.smithi036.stdout: osd max markdown count = 1000 2020-11-12T17:22:01.619 INFO:teuthology.orchestra.run.smithi036.stdout: osd objectstore = bluestore 2020-11-12T17:22:01.619 INFO:teuthology.orchestra.run.smithi036.stdout: osd op queue = debug_random 2020-11-12T17:22:01.619 INFO:teuthology.orchestra.run.smithi036.stdout: osd op queue cut off = debug_random 2020-11-12T17:22:01.619 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub during recovery = False 2020-11-12T17:22:01.620 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub min interval = 60 2020-11-12T17:22:01.620 INFO:teuthology.orchestra.run.smithi036.stdout: osd shutdown pgref assert = True 2020-11-12T17:22:01.620 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.620 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr] 2020-11-12T17:22:01.620 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2020-11-12T17:22:01.620 INFO:teuthology.orchestra.run.smithi036.stdout: debug mgr = 20 2020-11-12T17:22:01.621 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2020-11-12T17:22:01.621 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2020-11-12T17:22:01.621 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2020-11-12T17:22:01.621 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2020-11-12T17:22:01.621 INFO:teuthology.orchestra.run.smithi036.stdout: mgr/telemetry/nag = false 2020-11-12T17:22:01.621 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.621 INFO:teuthology.orchestra.run.smithi036.stdout:[mon] 2020-11-12T17:22:01.622 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2020-11-12T17:22:01.622 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2020-11-12T17:22:01.622 INFO:teuthology.orchestra.run.smithi036.stdout: debug paxos = 20 2020-11-12T17:22:01.622 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2020-11-12T17:22:01.622 INFO:teuthology.orchestra.run.smithi036.stdout: mon data avail warn = 5 2020-11-12T17:22:01.622 INFO:teuthology.orchestra.run.smithi036.stdout: mon mgr mkfs grace = 240 2020-11-12T17:22:01.622 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2020-11-12T17:22:01.623 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd reporter subtree level = osd 2020-11-12T17:22:01.623 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd prime pg temp = true 2020-11-12T17:22:01.623 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2020-11-12T17:22:01.623 INFO:teuthology.orchestra.run.smithi036.stdout: mon min osdmap epochs = 50 2020-11-12T17:22:01.623 INFO:teuthology.orchestra.run.smithi036.stdout: mon osdmap full prune interval = 2 2020-11-12T17:22:01.623 INFO:teuthology.orchestra.run.smithi036.stdout: mon osdmap full prune min = 15 2020-11-12T17:22:01.623 INFO:teuthology.orchestra.run.smithi036.stdout: mon osdmap full prune txsize = 2 2020-11-12T17:22:01.624 INFO:teuthology.orchestra.run.smithi036.stdout: paxos service trim min = 10 2020-11-12T17:22:01.624 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:01.624 INFO:teuthology.orchestra.run.smithi036.stdout:[client] 2020-11-12T17:22:01.624 INFO:teuthology.orchestra.run.smithi036.stdout: rgw cache enabled = true 2020-11-12T17:22:01.624 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable ops log = true 2020-11-12T17:22:01.624 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable usage log = true 2020-11-12T17:22:01.624 INFO:teuthology.orchestra.run.smithi036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-12T17:22:01.625 INFO:teuthology.orchestra.run.smithi036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-12T17:22:01.625 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.a] 2020-11-12T17:22:01.625 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.c] 2020-11-12T17:22:01.625 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.b] 2020-11-12T17:22:01.625 INFO:teuthology.orchestra.run.smithi036.stdout:[client.0] 2020-11-12T17:22:01.625 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2020-11-12T17:22:01.626 INFO:teuthology.orchestra.run.smithi036.stdout: debug objecter = 20 2020-11-12T17:22:01.626 INFO:teuthology.orchestra.run.smithi036.stdout: debug rados = 20 2020-11-12T17:22:01.628 INFO:teuthology.orchestra.run.smithi205.stdout:[global] 2020-11-12T17:22:01.628 INFO:teuthology.orchestra.run.smithi205.stdout: chdir = "" 2020-11-12T17:22:01.628 INFO:teuthology.orchestra.run.smithi205.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-12T17:22:01.628 INFO:teuthology.orchestra.run.smithi205.stdout: auth supported = cephx 2020-11-12T17:22:01.628 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.628 INFO:teuthology.orchestra.run.smithi205.stdout: filestore xattr use omap = true 2020-11-12T17:22:01.629 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.629 INFO:teuthology.orchestra.run.smithi205.stdout: mon clock drift allowed = 1.000 2020-11-12T17:22:01.629 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.629 INFO:teuthology.orchestra.run.smithi205.stdout: osd crush chooseleaf type = 0 2020-11-12T17:22:01.629 INFO:teuthology.orchestra.run.smithi205.stdout: auth debug = true 2020-11-12T17:22:01.629 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.629 INFO:teuthology.orchestra.run.smithi205.stdout: ms die on old message = true 2020-11-12T17:22:01.630 INFO:teuthology.orchestra.run.smithi205.stdout: ms die on bug = true 2020-11-12T17:22:01.630 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.630 INFO:teuthology.orchestra.run.smithi205.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-12T17:22:01.630 INFO:teuthology.orchestra.run.smithi205.stdout: mon pg warn max object skew = 0 2020-11-12T17:22:01.630 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.630 INFO:teuthology.orchestra.run.smithi205.stdout: # disable pg_autoscaler by default for new pools 2020-11-12T17:22:01.631 INFO:teuthology.orchestra.run.smithi205.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-12T17:22:01.631 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.631 INFO:teuthology.orchestra.run.smithi205.stdout: osd pool default size = 2 2020-11-12T17:22:01.631 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.631 INFO:teuthology.orchestra.run.smithi205.stdout: mon osd allow primary affinity = true 2020-11-12T17:22:01.631 INFO:teuthology.orchestra.run.smithi205.stdout: mon osd allow pg remap = true 2020-11-12T17:22:01.631 INFO:teuthology.orchestra.run.smithi205.stdout: mon warn on legacy crush tunables = false 2020-11-12T17:22:01.632 INFO:teuthology.orchestra.run.smithi205.stdout: mon warn on crush straw calc version zero = false 2020-11-12T17:22:01.632 INFO:teuthology.orchestra.run.smithi205.stdout: mon warn on no sortbitwise = false 2020-11-12T17:22:01.632 INFO:teuthology.orchestra.run.smithi205.stdout: mon warn on osd down out interval zero = false 2020-11-12T17:22:01.632 INFO:teuthology.orchestra.run.smithi205.stdout: mon warn on too few osds = false 2020-11-12T17:22:01.632 INFO:teuthology.orchestra.run.smithi205.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-12T17:22:01.632 INFO:teuthology.orchestra.run.smithi205.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-12T17:22:01.632 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.633 INFO:teuthology.orchestra.run.smithi205.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-12T17:22:01.633 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.633 INFO:teuthology.orchestra.run.smithi205.stdout: osd default data pool replay window = 5 2020-11-12T17:22:01.633 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.633 INFO:teuthology.orchestra.run.smithi205.stdout: mon allow pool delete = true 2020-11-12T17:22:01.633 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.633 INFO:teuthology.orchestra.run.smithi205.stdout: mon cluster log file level = debug 2020-11-12T17:22:01.634 INFO:teuthology.orchestra.run.smithi205.stdout: debug asserts on shutdown = true 2020-11-12T17:22:01.634 INFO:teuthology.orchestra.run.smithi205.stdout: mon host = "[v1:172.21.15.36:6789],[v1:172.21.15.36:6790],[v1:172.21.15.205:6789]" 2020-11-12T17:22:01.634 INFO:teuthology.orchestra.run.smithi205.stdout: mon client directed command retry = 5 2020-11-12T17:22:01.634 INFO:teuthology.orchestra.run.smithi205.stdout: ms bind msgr2 = False 2020-11-12T17:22:01.634 INFO:teuthology.orchestra.run.smithi205.stdout: ms inject delay max = 1 2020-11-12T17:22:01.634 INFO:teuthology.orchestra.run.smithi205.stdout: ms inject delay probability = 0.005 2020-11-12T17:22:01.634 INFO:teuthology.orchestra.run.smithi205.stdout: ms inject delay type = osd 2020-11-12T17:22:01.635 INFO:teuthology.orchestra.run.smithi205.stdout: ms inject internal delays = 0.002 2020-11-12T17:22:01.635 INFO:teuthology.orchestra.run.smithi205.stdout: ms inject socket failures = 2500 2020-11-12T17:22:01.635 INFO:teuthology.orchestra.run.smithi205.stdout: ms type = async 2020-11-12T17:22:01.635 INFO:teuthology.orchestra.run.smithi205.stdout: osd_pool_default_min_size = 2 2020-11-12T17:22:01.635 INFO:teuthology.orchestra.run.smithi205.stdout: osd_pool_default_size = 2 2020-11-12T17:22:01.635 INFO:teuthology.orchestra.run.smithi205.stdout: fsid = 8c8a6bcc-49d4-47d1-904f-e20798ef8e1f 2020-11-12T17:22:01.635 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.636 INFO:teuthology.orchestra.run.smithi205.stdout:[osd] 2020-11-12T17:22:01.636 INFO:teuthology.orchestra.run.smithi205.stdout: osd journal size = 100 2020-11-12T17:22:01.636 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.636 INFO:teuthology.orchestra.run.smithi205.stdout: osd scrub load threshold = 5.0 2020-11-12T17:22:01.636 INFO:teuthology.orchestra.run.smithi205.stdout: osd scrub max interval = 120 2020-11-12T17:22:01.636 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.636 INFO:teuthology.orchestra.run.smithi205.stdout: osd recover clone overlap = true 2020-11-12T17:22:01.637 INFO:teuthology.orchestra.run.smithi205.stdout: osd recovery max chunk = 1048576 2020-11-12T17:22:01.637 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.637 INFO:teuthology.orchestra.run.smithi205.stdout: osd debug shutdown = true 2020-11-12T17:22:01.637 INFO:teuthology.orchestra.run.smithi205.stdout: osd debug op order = true 2020-11-12T17:22:01.637 INFO:teuthology.orchestra.run.smithi205.stdout: osd debug verify stray on activate = true 2020-11-12T17:22:01.637 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.637 INFO:teuthology.orchestra.run.smithi205.stdout: osd open classes on start = true 2020-11-12T17:22:01.638 INFO:teuthology.orchestra.run.smithi205.stdout: osd debug pg log writeout = true 2020-11-12T17:22:01.638 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.638 INFO:teuthology.orchestra.run.smithi205.stdout: osd deep scrub update digest min age = 30 2020-11-12T17:22:01.638 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.638 INFO:teuthology.orchestra.run.smithi205.stdout: osd map max advance = 10 2020-11-12T17:22:01.638 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.638 INFO:teuthology.orchestra.run.smithi205.stdout: journal zero on create = true 2020-11-12T17:22:01.639 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.639 INFO:teuthology.orchestra.run.smithi205.stdout: filestore ondisk finisher threads = 3 2020-11-12T17:22:01.639 INFO:teuthology.orchestra.run.smithi205.stdout: filestore apply finisher threads = 3 2020-11-12T17:22:01.639 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.639 INFO:teuthology.orchestra.run.smithi205.stdout: bdev debug aio = true 2020-11-12T17:22:01.639 INFO:teuthology.orchestra.run.smithi205.stdout: osd debug misdirected ops = true 2020-11-12T17:22:01.639 INFO:teuthology.orchestra.run.smithi205.stdout: debug monc = 20 2020-11-12T17:22:01.640 INFO:teuthology.orchestra.run.smithi205.stdout: bluestore block size = 96636764160 2020-11-12T17:22:01.640 INFO:teuthology.orchestra.run.smithi205.stdout: bluestore compression algorithm = zstd 2020-11-12T17:22:01.640 INFO:teuthology.orchestra.run.smithi205.stdout: bluestore compression mode = aggressive 2020-11-12T17:22:01.640 INFO:teuthology.orchestra.run.smithi205.stdout: bluestore fsck on mount = True 2020-11-12T17:22:01.640 INFO:teuthology.orchestra.run.smithi205.stdout: debug bluefs = 20 2020-11-12T17:22:01.640 INFO:teuthology.orchestra.run.smithi205.stdout: debug bluestore = 20 2020-11-12T17:22:01.640 INFO:teuthology.orchestra.run.smithi205.stdout: debug filestore = 20 2020-11-12T17:22:01.641 INFO:teuthology.orchestra.run.smithi205.stdout: debug journal = 20 2020-11-12T17:22:01.641 INFO:teuthology.orchestra.run.smithi205.stdout: debug ms = 20 2020-11-12T17:22:01.641 INFO:teuthology.orchestra.run.smithi205.stdout: debug osd = 25 2020-11-12T17:22:01.641 INFO:teuthology.orchestra.run.smithi205.stdout: debug rocksdb = 10 2020-11-12T17:22:01.641 INFO:teuthology.orchestra.run.smithi205.stdout: mon osd backfillfull_ratio = 0.85 2020-11-12T17:22:01.641 INFO:teuthology.orchestra.run.smithi205.stdout: mon osd full ratio = 0.9 2020-11-12T17:22:01.641 INFO:teuthology.orchestra.run.smithi205.stdout: mon osd nearfull ratio = 0.8 2020-11-12T17:22:01.641 INFO:teuthology.orchestra.run.smithi205.stdout: osd backoff on peering = True 2020-11-12T17:22:01.642 INFO:teuthology.orchestra.run.smithi205.stdout: osd debug verify cached snaps = True 2020-11-12T17:22:01.642 INFO:teuthology.orchestra.run.smithi205.stdout: osd debug verify missing on start = True 2020-11-12T17:22:01.642 INFO:teuthology.orchestra.run.smithi205.stdout: osd failsafe full ratio = 0.95 2020-11-12T17:22:01.642 INFO:teuthology.orchestra.run.smithi205.stdout: osd inject bad map crc probability = 0.1 2020-11-12T17:22:01.642 INFO:teuthology.orchestra.run.smithi205.stdout: osd map cache size = 1 2020-11-12T17:22:01.642 INFO:teuthology.orchestra.run.smithi205.stdout: osd max backfills = 6 2020-11-12T17:22:01.642 INFO:teuthology.orchestra.run.smithi205.stdout: osd max markdown count = 1000 2020-11-12T17:22:01.643 INFO:teuthology.orchestra.run.smithi205.stdout: osd objectstore = bluestore 2020-11-12T17:22:01.643 INFO:teuthology.orchestra.run.smithi205.stdout: osd op queue = debug_random 2020-11-12T17:22:01.643 INFO:teuthology.orchestra.run.smithi205.stdout: osd op queue cut off = debug_random 2020-11-12T17:22:01.643 INFO:teuthology.orchestra.run.smithi205.stdout: osd scrub during recovery = False 2020-11-12T17:22:01.643 INFO:teuthology.orchestra.run.smithi205.stdout: osd scrub min interval = 60 2020-11-12T17:22:01.643 INFO:teuthology.orchestra.run.smithi205.stdout: osd shutdown pgref assert = True 2020-11-12T17:22:01.644 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.644 INFO:teuthology.orchestra.run.smithi205.stdout:[mgr] 2020-11-12T17:22:01.644 INFO:teuthology.orchestra.run.smithi205.stdout: debug ms = 1 2020-11-12T17:22:01.644 INFO:teuthology.orchestra.run.smithi205.stdout: debug mgr = 20 2020-11-12T17:22:01.644 INFO:teuthology.orchestra.run.smithi205.stdout: debug mon = 20 2020-11-12T17:22:01.644 INFO:teuthology.orchestra.run.smithi205.stdout: debug auth = 20 2020-11-12T17:22:01.644 INFO:teuthology.orchestra.run.smithi205.stdout: mon reweight min pgs per osd = 4 2020-11-12T17:22:01.644 INFO:teuthology.orchestra.run.smithi205.stdout: mon reweight min bytes per osd = 10 2020-11-12T17:22:01.645 INFO:teuthology.orchestra.run.smithi205.stdout: mgr/telemetry/nag = false 2020-11-12T17:22:01.645 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.645 INFO:teuthology.orchestra.run.smithi205.stdout:[mon] 2020-11-12T17:22:01.645 INFO:teuthology.orchestra.run.smithi205.stdout: debug ms = 1 2020-11-12T17:22:01.645 INFO:teuthology.orchestra.run.smithi205.stdout: debug mon = 20 2020-11-12T17:22:01.645 INFO:teuthology.orchestra.run.smithi205.stdout: debug paxos = 20 2020-11-12T17:22:01.646 INFO:teuthology.orchestra.run.smithi205.stdout: debug auth = 20 2020-11-12T17:22:01.646 INFO:teuthology.orchestra.run.smithi205.stdout: mon data avail warn = 5 2020-11-12T17:22:01.647 INFO:teuthology.orchestra.run.smithi205.stdout: mon mgr mkfs grace = 240 2020-11-12T17:22:01.647 INFO:teuthology.orchestra.run.smithi205.stdout: mon reweight min pgs per osd = 4 2020-11-12T17:22:01.647 INFO:teuthology.orchestra.run.smithi205.stdout: mon osd reporter subtree level = osd 2020-11-12T17:22:01.648 INFO:teuthology.orchestra.run.smithi205.stdout: mon osd prime pg temp = true 2020-11-12T17:22:01.648 INFO:teuthology.orchestra.run.smithi205.stdout: mon reweight min bytes per osd = 10 2020-11-12T17:22:01.648 INFO:teuthology.orchestra.run.smithi205.stdout: mon min osdmap epochs = 50 2020-11-12T17:22:01.648 INFO:teuthology.orchestra.run.smithi205.stdout: mon osdmap full prune interval = 2 2020-11-12T17:22:01.648 INFO:teuthology.orchestra.run.smithi205.stdout: mon osdmap full prune min = 15 2020-11-12T17:22:01.648 INFO:teuthology.orchestra.run.smithi205.stdout: mon osdmap full prune txsize = 2 2020-11-12T17:22:01.649 INFO:teuthology.orchestra.run.smithi205.stdout: paxos service trim min = 10 2020-11-12T17:22:01.649 INFO:teuthology.orchestra.run.smithi205.stdout: 2020-11-12T17:22:01.649 INFO:teuthology.orchestra.run.smithi205.stdout:[client] 2020-11-12T17:22:01.649 INFO:teuthology.orchestra.run.smithi205.stdout: rgw cache enabled = true 2020-11-12T17:22:01.649 INFO:teuthology.orchestra.run.smithi205.stdout: rgw enable ops log = true 2020-11-12T17:22:01.649 INFO:teuthology.orchestra.run.smithi205.stdout: rgw enable usage log = true 2020-11-12T17:22:01.650 INFO:teuthology.orchestra.run.smithi205.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-12T17:22:01.650 INFO:teuthology.orchestra.run.smithi205.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-12T17:22:01.650 INFO:teuthology.orchestra.run.smithi205.stdout:[mon.a] 2020-11-12T17:22:01.650 INFO:teuthology.orchestra.run.smithi205.stdout:[mon.c] 2020-11-12T17:22:01.650 INFO:teuthology.orchestra.run.smithi205.stdout:[mon.b] 2020-11-12T17:22:01.650 INFO:teuthology.orchestra.run.smithi205.stdout:[client.0] 2020-11-12T17:22:01.651 INFO:teuthology.orchestra.run.smithi205.stdout: debug ms = 1 2020-11-12T17:22:01.651 INFO:teuthology.orchestra.run.smithi205.stdout: debug objecter = 20 2020-11-12T17:22:01.651 INFO:teuthology.orchestra.run.smithi205.stdout: debug rados = 20 2020-11-12T17:22:01.651 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-12T17:22:01.652 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-12T17:22:01.717 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-12T17:22:01.728 DEBUG:teuthology.orchestra.remote:smithi036:/etc/ceph/ceph.keyring is 206B 2020-11-12T17:22:01.746 DEBUG:teuthology.orchestra.remote:smithi036:/home/ubuntu/cephtest/ceph.monmap is 274B 2020-11-12T17:22:01.771 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:22:01.772 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-12T17:22:01.772 INFO:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-12T17:22:01.773 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-12T17:22:01.778 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-12T17:22:01.787 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-12T17:22:01.788 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-12T17:22:01.788 INFO:teuthology.orchestra.run.smithi036.stderr:206 bytes copied, 0.000137834 s, 1.5 MB/s 2020-11-12T17:22:01.788 INFO:teuthology.orchestra.run.smithi036.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-12T17:22:01.798 INFO:teuthology.orchestra.run.smithi036:> set -ex 2020-11-12T17:22:01.799 INFO:teuthology.orchestra.run.smithi036:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:01.843 INFO:teuthology.orchestra.run.smithi036.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:01.845 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records in 2020-11-12T17:22:01.845 INFO:teuthology.orchestra.run.smithi036.stderr:0+1 records out 2020-11-12T17:22:01.845 INFO:teuthology.orchestra.run.smithi036.stderr:274 bytes copied, 0.00013399 s, 2.0 MB/s 2020-11-12T17:22:01.846 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:22:01.846 INFO:teuthology.orchestra.run.smithi205:> set -ex 2020-11-12T17:22:01.846 INFO:teuthology.orchestra.run.smithi205:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-12T17:22:01.847 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-12T17:22:01.851 INFO:teuthology.orchestra.run.smithi205.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-12T17:22:01.860 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records in 2020-11-12T17:22:01.861 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records out 2020-11-12T17:22:01.861 INFO:teuthology.orchestra.run.smithi205.stderr:206 bytes copied, 7.2984e-05 s, 2.8 MB/s 2020-11-12T17:22:01.862 INFO:teuthology.orchestra.run.smithi205.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-12T17:22:01.871 INFO:teuthology.orchestra.run.smithi205:> set -ex 2020-11-12T17:22:01.871 INFO:teuthology.orchestra.run.smithi205:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:01.916 INFO:teuthology.orchestra.run.smithi205.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:01.944 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records in 2020-11-12T17:22:01.944 INFO:teuthology.orchestra.run.smithi205.stderr:0+1 records out 2020-11-12T17:22:01.945 INFO:teuthology.orchestra.run.smithi205.stderr:274 bytes copied, 7.832e-05 s, 3.5 MB/s 2020-11-12T17:22:01.945 INFO:tasks.ceph:Setting up mon nodes... 2020-11-12T17:22:01.945 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-12T17:22:01.946 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-12T17:22:01.988 INFO:teuthology.orchestra.run.smithi036.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-12T17:22:01.990 INFO:teuthology.orchestra.run.smithi205:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-12T17:22:02.032 INFO:teuthology.orchestra.run.smithi205.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-12T17:22:02.035 INFO:tasks.ceph:Setting up mds nodes... 2020-11-12T17:22:02.035 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-12T17:22:02.036 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-12T17:22:02.071 INFO:teuthology.orchestra.run.smithi036.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-12T17:22:02.084 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-11-12T17:22:02.119 INFO:teuthology.orchestra.run.smithi205.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-11-12T17:22:02.131 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-12T17:22:02.135 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi036.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi205.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-11-12T17:22:02.136 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-12T17:22:02.152 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:02.152 INFO:tasks.ceph:role: osd.0 2020-11-12T17:22:02.153 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:22:02.153 INFO:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-12T17:22:02.666 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-12T17:22:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-12T17:22:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-12T17:22:02.667 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-12T17:22:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2020-11-12T17:22:02.667 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-12T17:22:02.667 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-12T17:22:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-12T17:22:02.668 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-12T17:22:02.669 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2020-11-12T17:22:02.669 INFO:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-12T17:22:02.746 INFO:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-12T17:22:02.757 INFO:teuthology.orchestra.run.smithi036.stderr:sudo: /sbin/restorecon: command not found 2020-11-12T17:22:02.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:22:02.758 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-12T17:22:02.815 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:02.815 INFO:tasks.ceph:role: osd.1 2020-11-12T17:22:02.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:22:02.816 INFO:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-12T17:22:03.323 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-12T17:22:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-12T17:22:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-12T17:22:03.323 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-12T17:22:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2020-11-12T17:22:03.324 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-12T17:22:03.324 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-12T17:22:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-12T17:22:03.324 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-12T17:22:03.325 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2020-11-12T17:22:03.325 INFO:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-11-12T17:22:03.396 INFO:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-12T17:22:03.409 INFO:teuthology.orchestra.run.smithi036.stderr:sudo: /sbin/restorecon: command not found 2020-11-12T17:22:03.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:22:03.410 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-12T17:22:03.467 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:03.467 INFO:tasks.ceph:role: osd.2 2020-11-12T17:22:03.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:22:03.468 INFO:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-12T17:22:03.953 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-12T17:22:03.953 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-12T17:22:03.953 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-12T17:22:03.953 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-12T17:22:03.954 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2020-11-12T17:22:03.954 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-12T17:22:03.954 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-12T17:22:03.954 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-12T17:22:03.954 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-12T17:22:03.955 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2020-11-12T17:22:03.955 INFO:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-11-12T17:22:04.003 INFO:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-12T17:22:04.059 INFO:teuthology.orchestra.run.smithi036.stderr:sudo: /sbin/restorecon: command not found 2020-11-12T17:22:04.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:22:04.060 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-12T17:22:04.119 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:04.119 INFO:tasks.ceph:role: osd.3 2020-11-12T17:22:04.120 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:22:04.120 INFO:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-12T17:22:04.643 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-12T17:22:04.643 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-12T17:22:04.644 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-12T17:22:04.644 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-12T17:22:04.644 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2020-11-12T17:22:04.644 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-12T17:22:04.644 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-12T17:22:04.645 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-12T17:22:04.645 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-12T17:22:04.646 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2020-11-12T17:22:04.646 INFO:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-11-12T17:22:04.694 INFO:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-12T17:22:04.706 INFO:teuthology.orchestra.run.smithi036.stderr:sudo: /sbin/restorecon: command not found 2020-11-12T17:22:04.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:22:04.707 INFO:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:04.786 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:04.782+0000 7f426a0e0d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-12T17:22:04.788 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:04.786+0000 7f426a0e0d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-12T17:22:04.788 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:04.786+0000 7f426a0e0d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-12T17:22:04.788 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:04.786+0000 7f426a0e0d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-12T17:22:04.789 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:04.786+0000 7f426a0e0d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-12T17:22:04.796 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:04.794+0000 7f426a0e0d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-11-12T17:22:04.829 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:04.826+0000 7f426a0e0d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-11-12T17:22:07.255 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-12T17:22:07.311 INFO:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:07.389 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:07.386+0000 7f2a24f62d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-12T17:22:07.390 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:07.386+0000 7f2a24f62d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-12T17:22:07.390 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:07.386+0000 7f2a24f62d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-12T17:22:07.391 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:07.386+0000 7f2a24f62d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-12T17:22:07.391 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:07.386+0000 7f2a24f62d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-12T17:22:07.391 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:07.386+0000 7f2a24f62d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-11-12T17:22:07.410 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:07.406+0000 7f2a24f62d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-11-12T17:22:09.858 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-12T17:22:09.915 INFO:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:09.993 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:09.990+0000 7f0a07385d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-12T17:22:09.993 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:09.990+0000 7f0a07385d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-12T17:22:09.994 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:09.990+0000 7f0a07385d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-12T17:22:09.994 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:09.990+0000 7f0a07385d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-12T17:22:09.994 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:09.990+0000 7f0a07385d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-12T17:22:09.994 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:09.990+0000 7f0a07385d80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-11-12T17:22:10.013 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:10.010+0000 7f0a07385d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-11-12T17:22:12.442 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-12T17:22:12.499 INFO:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:12.584 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:12.582+0000 7fc94bb28d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-12T17:22:12.585 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:12.582+0000 7fc94bb28d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-12T17:22:12.585 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:12.582+0000 7fc94bb28d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-12T17:22:12.585 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:12.582+0000 7fc94bb28d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-12T17:22:12.586 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:12.582+0000 7fc94bb28d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-12T17:22:12.586 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:12.582+0000 7fc94bb28d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-11-12T17:22:12.607 INFO:teuthology.orchestra.run.smithi036.stderr:2020-11-12T17:22:12.602+0000 7fc94bb28d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-11-12T17:22:15.050 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-12T17:22:15.107 INFO:teuthology.orchestra.run.smithi205:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-12T17:22:15.231 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:15.232 INFO:tasks.ceph:role: osd.4 2020-11-12T17:22:15.232 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:22:15.233 INFO:teuthology.orchestra.run.smithi205:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-12T17:22:15.776 INFO:teuthology.orchestra.run.smithi205.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-12T17:22:15.777 INFO:teuthology.orchestra.run.smithi205.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-12T17:22:15.777 INFO:teuthology.orchestra.run.smithi205.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-12T17:22:15.777 INFO:teuthology.orchestra.run.smithi205.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-12T17:22:15.777 INFO:teuthology.orchestra.run.smithi205.stdout: = sunit=0 swidth=0 blks 2020-11-12T17:22:15.777 INFO:teuthology.orchestra.run.smithi205.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-12T17:22:15.778 INFO:teuthology.orchestra.run.smithi205.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-12T17:22:15.778 INFO:teuthology.orchestra.run.smithi205.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-12T17:22:15.778 INFO:teuthology.orchestra.run.smithi205.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-12T17:22:15.779 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi205.front.sepia.ceph.com -o noatime 2020-11-12T17:22:15.779 INFO:teuthology.orchestra.run.smithi205:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-11-12T17:22:15.865 INFO:teuthology.orchestra.run.smithi205:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-12T17:22:15.877 INFO:teuthology.orchestra.run.smithi205.stderr:sudo: /sbin/restorecon: command not found 2020-11-12T17:22:15.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:22:15.878 INFO:teuthology.orchestra.run.smithi205:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-12T17:22:15.934 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:15.935 INFO:tasks.ceph:role: osd.5 2020-11-12T17:22:15.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:22:15.935 INFO:teuthology.orchestra.run.smithi205:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-12T17:22:16.458 INFO:teuthology.orchestra.run.smithi205.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-12T17:22:16.458 INFO:teuthology.orchestra.run.smithi205.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-12T17:22:16.458 INFO:teuthology.orchestra.run.smithi205.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-12T17:22:16.458 INFO:teuthology.orchestra.run.smithi205.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-12T17:22:16.459 INFO:teuthology.orchestra.run.smithi205.stdout: = sunit=0 swidth=0 blks 2020-11-12T17:22:16.459 INFO:teuthology.orchestra.run.smithi205.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-12T17:22:16.459 INFO:teuthology.orchestra.run.smithi205.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-12T17:22:16.459 INFO:teuthology.orchestra.run.smithi205.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-12T17:22:16.460 INFO:teuthology.orchestra.run.smithi205.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-12T17:22:16.461 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi205.front.sepia.ceph.com -o noatime 2020-11-12T17:22:16.461 INFO:teuthology.orchestra.run.smithi205:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-12T17:22:16.499 INFO:teuthology.orchestra.run.smithi205:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-12T17:22:16.551 INFO:teuthology.orchestra.run.smithi205.stderr:sudo: /sbin/restorecon: command not found 2020-11-12T17:22:16.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:22:16.554 INFO:teuthology.orchestra.run.smithi205:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-12T17:22:16.611 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:16.612 INFO:tasks.ceph:role: osd.6 2020-11-12T17:22:16.612 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:22:16.613 INFO:teuthology.orchestra.run.smithi205:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-12T17:22:17.120 INFO:teuthology.orchestra.run.smithi205.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-12T17:22:17.121 INFO:teuthology.orchestra.run.smithi205.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-12T17:22:17.121 INFO:teuthology.orchestra.run.smithi205.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-12T17:22:17.121 INFO:teuthology.orchestra.run.smithi205.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-12T17:22:17.121 INFO:teuthology.orchestra.run.smithi205.stdout: = sunit=0 swidth=0 blks 2020-11-12T17:22:17.121 INFO:teuthology.orchestra.run.smithi205.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-12T17:22:17.122 INFO:teuthology.orchestra.run.smithi205.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-12T17:22:17.122 INFO:teuthology.orchestra.run.smithi205.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-12T17:22:17.131 INFO:teuthology.orchestra.run.smithi205.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-12T17:22:17.133 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi205.front.sepia.ceph.com -o noatime 2020-11-12T17:22:17.134 INFO:teuthology.orchestra.run.smithi205:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-12T17:22:17.193 INFO:teuthology.orchestra.run.smithi205:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-12T17:22:17.205 INFO:teuthology.orchestra.run.smithi205.stderr:sudo: /sbin/restorecon: command not found 2020-11-12T17:22:17.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:22:17.207 INFO:teuthology.orchestra.run.smithi205:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-12T17:22:17.267 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-12T17:22:17.268 INFO:tasks.ceph:role: osd.7 2020-11-12T17:22:17.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi205.front.sepia.ceph.com 2020-11-12T17:22:17.269 INFO:teuthology.orchestra.run.smithi205:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-12T17:22:17.810 INFO:teuthology.orchestra.run.smithi205.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-12T17:22:17.810 INFO:teuthology.orchestra.run.smithi205.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-12T17:22:17.811 INFO:teuthology.orchestra.run.smithi205.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-12T17:22:17.811 INFO:teuthology.orchestra.run.smithi205.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-12T17:22:17.811 INFO:teuthology.orchestra.run.smithi205.stdout: = sunit=0 swidth=0 blks 2020-11-12T17:22:17.811 INFO:teuthology.orchestra.run.smithi205.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-12T17:22:17.811 INFO:teuthology.orchestra.run.smithi205.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-12T17:22:17.811 INFO:teuthology.orchestra.run.smithi205.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-12T17:22:17.811 INFO:teuthology.orchestra.run.smithi205.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-12T17:22:17.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi205.front.sepia.ceph.com -o noatime 2020-11-12T17:22:17.812 INFO:teuthology.orchestra.run.smithi205:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-11-12T17:22:17.849 INFO:teuthology.orchestra.run.smithi205:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-12T17:22:17.903 INFO:teuthology.orchestra.run.smithi205.stderr:sudo: /sbin/restorecon: command not found 2020-11-12T17:22:17.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:22:17.905 INFO:teuthology.orchestra.run.smithi205:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:17.996 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:17.992+0000 7fb2bbfc3d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-12T17:22:17.997 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:17.996+0000 7fb2bbfc3d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-12T17:22:17.997 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:17.996+0000 7fb2bbfc3d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-12T17:22:17.997 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:17.996+0000 7fb2bbfc3d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-12T17:22:17.997 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:17.996+0000 7fb2bbfc3d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-12T17:22:18.007 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:18.004+0000 7fb2bbfc3d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-11-12T17:22:18.043 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:18.040+0000 7fb2bbfc3d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-11-12T17:22:20.451 INFO:teuthology.orchestra.run.smithi205:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-12T17:22:20.467 INFO:teuthology.orchestra.run.smithi205:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:20.549 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:20.548+0000 7fe627c0fd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-12T17:22:20.550 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:20.548+0000 7fe627c0fd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-12T17:22:20.550 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:20.548+0000 7fe627c0fd80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-12T17:22:20.550 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:20.548+0000 7fe627c0fd80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-12T17:22:20.550 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:20.548+0000 7fe627c0fd80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-12T17:22:20.551 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:20.548+0000 7fe627c0fd80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-11-12T17:22:20.565 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:20.564+0000 7fe627c0fd80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-11-12T17:22:23.015 INFO:teuthology.orchestra.run.smithi205:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-12T17:22:23.071 INFO:teuthology.orchestra.run.smithi205:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:23.150 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:23.148+0000 7ff089ffed80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-12T17:22:23.150 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:23.148+0000 7ff089ffed80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-12T17:22:23.150 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:23.148+0000 7ff089ffed80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-12T17:22:23.150 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:23.148+0000 7ff089ffed80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-12T17:22:23.151 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:23.148+0000 7ff089ffed80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-12T17:22:23.151 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:23.148+0000 7ff089ffed80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-11-12T17:22:23.172 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:23.168+0000 7ff089ffed80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-11-12T17:22:25.614 INFO:teuthology.orchestra.run.smithi205:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-12T17:22:25.671 INFO:teuthology.orchestra.run.smithi205:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:25.748 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:25.748+0000 7f1140971d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-12T17:22:25.749 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:25.748+0000 7f1140971d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-12T17:22:25.749 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:25.748+0000 7f1140971d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-12T17:22:25.749 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:25.748+0000 7f1140971d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-12T17:22:25.749 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:25.748+0000 7f1140971d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-12T17:22:25.750 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:25.748+0000 7f1140971d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-11-12T17:22:25.772 INFO:teuthology.orchestra.run.smithi205.stderr:2020-11-12T17:22:25.768+0000 7f1140971d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-11-12T17:22:28.202 INFO:teuthology.orchestra.run.smithi205:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-12T17:22:28.259 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-12T17:22:28.259 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:22:28.266 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.TSHCBepHqh 2020-11-12T17:22:28.267 INFO:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.TSHCBepHqh 2020-11-12T17:22:28.323 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.TSHCBepHqh 2020-11-12T17:22:28.427 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.TSHCBepHqh is 56B 2020-11-12T17:22:28.437 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.TSHCBepHqh 2020-11-12T17:22:28.443 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:22:28.489 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.1AWwWpUrtk 2020-11-12T17:22:28.490 INFO:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.1AWwWpUrtk 2020-11-12T17:22:28.555 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.1AWwWpUrtk 2020-11-12T17:22:28.663 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.1AWwWpUrtk is 56B 2020-11-12T17:22:28.683 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.1AWwWpUrtk 2020-11-12T17:22:28.690 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:22:28.736 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.hBjbceh08w 2020-11-12T17:22:28.737 INFO:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.hBjbceh08w 2020-11-12T17:22:28.794 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.hBjbceh08w 2020-11-12T17:22:28.899 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.hBjbceh08w is 56B 2020-11-12T17:22:28.909 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.hBjbceh08w 2020-11-12T17:22:28.914 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:22:28.961 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.FkXxXpSU8S 2020-11-12T17:22:28.961 INFO:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.FkXxXpSU8S 2020-11-12T17:22:29.019 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.FkXxXpSU8S 2020-11-12T17:22:29.122 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.FkXxXpSU8S is 56B 2020-11-12T17:22:29.132 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.FkXxXpSU8S 2020-11-12T17:22:29.138 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:22:29.184 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.bbs8CndDwC 2020-11-12T17:22:29.185 INFO:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.bbs8CndDwC 2020-11-12T17:22:29.242 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.bbs8CndDwC 2020-11-12T17:22:29.355 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.bbs8CndDwC is 56B 2020-11-12T17:22:29.366 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.bbs8CndDwC 2020-11-12T17:22:29.373 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:22:29.380 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.S7SATwx9w4 2020-11-12T17:22:29.380 INFO:teuthology.orchestra.run.smithi205:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.S7SATwx9w4 2020-11-12T17:22:29.438 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.S7SATwx9w4 2020-11-12T17:22:29.547 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.S7SATwx9w4 is 56B 2020-11-12T17:22:29.557 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.S7SATwx9w4 2020-11-12T17:22:29.564 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:22:29.613 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.eOixUU4L8S 2020-11-12T17:22:29.614 INFO:teuthology.orchestra.run.smithi205:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.eOixUU4L8S 2020-11-12T17:22:29.671 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.eOixUU4L8S 2020-11-12T17:22:29.779 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.eOixUU4L8S is 56B 2020-11-12T17:22:29.789 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.eOixUU4L8S 2020-11-12T17:22:29.795 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:22:29.841 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.thterUUqId 2020-11-12T17:22:29.842 INFO:teuthology.orchestra.run.smithi205:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.thterUUqId 2020-11-12T17:22:29.898 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.thterUUqId 2020-11-12T17:22:30.003 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.thterUUqId is 56B 2020-11-12T17:22:30.013 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.thterUUqId 2020-11-12T17:22:30.018 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:22:30.069 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.dEpgvbkcDK 2020-11-12T17:22:30.069 INFO:teuthology.orchestra.run.smithi205:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.dEpgvbkcDK 2020-11-12T17:22:30.126 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.dEpgvbkcDK 2020-11-12T17:22:30.239 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.dEpgvbkcDK is 56B 2020-11-12T17:22:30.250 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.dEpgvbkcDK 2020-11-12T17:22:30.256 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:22:30.305 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.oGBwToTgft 2020-11-12T17:22:30.305 INFO:teuthology.orchestra.run.smithi205:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.oGBwToTgft 2020-11-12T17:22:30.362 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.oGBwToTgft 2020-11-12T17:22:30.467 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.oGBwToTgft is 56B 2020-11-12T17:22:30.517 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.oGBwToTgft 2020-11-12T17:22:30.533 DEBUG:teuthology.orchestra.remote:smithi036:/etc/ceph/ceph.client.0.keyring is 59B 2020-11-12T17:22:30.571 DEBUG:teuthology.orchestra.remote:smithi205:/etc/ceph/ceph.client.1.keyring is 59B 2020-11-12T17:22:30.581 INFO:tasks.ceph:Adding keys to all mons... 2020-11-12T17:22:30.582 INFO:teuthology.orchestra.run.smithi036:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-12T17:22:30.584 INFO:teuthology.orchestra.run.smithi205:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-12T17:22:30.596 INFO:teuthology.orchestra.run.smithi205.stdout:[mgr.y] 2020-11-12T17:22:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQA5b61fk23iOhAAmtzzsO6nRillmfWRDcM+WA== 2020-11-12T17:22:30.597 INFO:teuthology.orchestra.run.smithi205.stdout:[osd.0] 2020-11-12T17:22:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQA8b61fOHDNLhAAcs31Y5ooEzaSeY2C38m14g== 2020-11-12T17:22:30.597 INFO:teuthology.orchestra.run.smithi205.stdout:[osd.1] 2020-11-12T17:22:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQA/b61fv4E2FxAAPoQ0tnnkYEglQGaDkMOhiA== 2020-11-12T17:22:30.598 INFO:teuthology.orchestra.run.smithi205.stdout:[osd.2] 2020-11-12T17:22:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQBBb61fFjIrOxAAmTJ7SKasfk5LtzEG4iGzAA== 2020-11-12T17:22:30.598 INFO:teuthology.orchestra.run.smithi205.stdout:[osd.3] 2020-11-12T17:22:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQBEb61funTJIhAA8J8TYP0+LpQLJ96eJBzQPQ== 2020-11-12T17:22:30.598 INFO:teuthology.orchestra.run.smithi205.stdout:[mgr.x] 2020-11-12T17:22:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQA6b61fSlf2ARAAepb1+E0DIBjbiu+YwQlw1Q== 2020-11-12T17:22:30.598 INFO:teuthology.orchestra.run.smithi205.stdout:[osd.4] 2020-11-12T17:22:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQBJb61fc0dvOxAAbHFByYD20wFdWn2HiEQ+Bw== 2020-11-12T17:22:30.599 INFO:teuthology.orchestra.run.smithi205.stdout:[osd.5] 2020-11-12T17:22:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQBMb61f6DbSIBAAxgWIA+W08jc2eok1ooRq2Q== 2020-11-12T17:22:30.599 INFO:teuthology.orchestra.run.smithi205.stdout:[osd.6] 2020-11-12T17:22:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQBPb61fr6L7CBAA1PzfzSU7G3he5cN4kOdlbw== 2020-11-12T17:22:30.599 INFO:teuthology.orchestra.run.smithi205.stdout:[osd.7] 2020-11-12T17:22:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQBRb61fs2ytLBAALTfxlbhamGkXw0W+QeHEkg== 2020-11-12T17:22:30.600 INFO:teuthology.orchestra.run.smithi205.stdout:[client.0] 2020-11-12T17:22:30.600 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQA6b61f3gA4BBAA+8MJOVlDxrQ4Kr73QhLnvA== 2020-11-12T17:22:30.600 INFO:teuthology.orchestra.run.smithi205.stdout:[client.1] 2020-11-12T17:22:30.600 INFO:teuthology.orchestra.run.smithi205.stdout: key = AQA6b61fQacoBxAAf5fhkqLA8pC1ByC7110GBQ== 2020-11-12T17:22:30.628 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr.y] 2020-11-12T17:22:30.628 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQA5b61fk23iOhAAmtzzsO6nRillmfWRDcM+WA== 2020-11-12T17:22:30.628 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.0] 2020-11-12T17:22:30.628 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQA8b61fOHDNLhAAcs31Y5ooEzaSeY2C38m14g== 2020-11-12T17:22:30.629 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.1] 2020-11-12T17:22:30.629 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQA/b61fv4E2FxAAPoQ0tnnkYEglQGaDkMOhiA== 2020-11-12T17:22:30.629 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.2] 2020-11-12T17:22:30.629 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBBb61fFjIrOxAAmTJ7SKasfk5LtzEG4iGzAA== 2020-11-12T17:22:30.629 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.3] 2020-11-12T17:22:30.629 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBEb61funTJIhAA8J8TYP0+LpQLJ96eJBzQPQ== 2020-11-12T17:22:30.629 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr.x] 2020-11-12T17:22:30.629 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQA6b61fSlf2ARAAepb1+E0DIBjbiu+YwQlw1Q== 2020-11-12T17:22:30.630 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.4] 2020-11-12T17:22:30.630 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBJb61fc0dvOxAAbHFByYD20wFdWn2HiEQ+Bw== 2020-11-12T17:22:30.630 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.5] 2020-11-12T17:22:30.630 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBMb61f6DbSIBAAxgWIA+W08jc2eok1ooRq2Q== 2020-11-12T17:22:30.630 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.6] 2020-11-12T17:22:30.630 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBPb61fr6L7CBAA1PzfzSU7G3he5cN4kOdlbw== 2020-11-12T17:22:30.630 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.7] 2020-11-12T17:22:30.631 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQBRb61fs2ytLBAALTfxlbhamGkXw0W+QeHEkg== 2020-11-12T17:22:30.631 INFO:teuthology.orchestra.run.smithi036.stdout:[client.0] 2020-11-12T17:22:30.631 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQA6b61f3gA4BBAA+8MJOVlDxrQ4Kr73QhLnvA== 2020-11-12T17:22:30.631 INFO:teuthology.orchestra.run.smithi036.stdout:[client.1] 2020-11-12T17:22:30.631 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQA6b61fQacoBxAAf5fhkqLA8pC1ByC7110GBQ== 2020-11-12T17:22:30.632 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-12T17:22:30.677 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-12T17:22:30.720 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:30.761 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:30.824 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:30.849 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:30.910 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:30.933 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:30.992 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.017 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.077 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-12T17:22:31.101 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-12T17:22:31.161 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.185 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.246 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.248 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.336 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.338 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.422 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.424 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-12T17:22:31.506 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-12T17:22:31.509 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-12T17:22:31.593 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-12T17:22:31.595 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-12T17:22:31.639 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-12T17:22:31.640 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-12T17:22:31.696 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-12T17:22:31.817 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-12T17:22:31.832 INFO:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-12T17:22:31.891 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-12T17:22:32.007 INFO:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-12T17:22:32.021 INFO:teuthology.orchestra.run.smithi205:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-12T17:22:32.037 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-12T17:22:32.137 INFO:teuthology.orchestra.run.smithi205:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-12T17:22:32.148 INFO:teuthology.orchestra.run.smithi036:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:32.151 INFO:teuthology.orchestra.run.smithi205:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-12T17:22:32.197 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-12T17:22:32.198 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-12T17:22:32.199 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-12T17:22:32.201 INFO:tasks.ceph.mon.a:Started 2020-11-12T17:22:32.202 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-12T17:22:32.202 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-12T17:22:32.204 INFO:tasks.ceph.mon.c:Started 2020-11-12T17:22:32.204 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-12T17:22:32.205 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-12T17:22:32.241 INFO:tasks.ceph.mon.b:Started 2020-11-12T17:22:32.242 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-12T17:22:32.242 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-12T17:22:32.242 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-12T17:22:32.246 INFO:tasks.ceph.mgr.y:Started 2020-11-12T17:22:32.247 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-12T17:22:32.247 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-12T17:22:32.249 INFO:tasks.ceph.mgr.x:Started 2020-11-12T17:22:32.249 INFO:tasks.ceph:Setting crush tunables to default 2020-11-12T17:22:32.250 INFO:teuthology.orchestra.run.smithi036:> sudo ceph --cluster ceph osd crush tunables default 2020-11-12T17:22:37.715 INFO:teuthology.orchestra.run.smithi036.stderr:adjusted tunables profile to default 2020-11-12T17:22:37.741 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-12T17:22:37.742 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:22:37.747 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.2djmPWP2ZJ 2020-11-12T17:22:37.747 INFO:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.2djmPWP2ZJ 2020-11-12T17:22:37.802 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.2djmPWP2ZJ 2020-11-12T17:22:37.907 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.2djmPWP2ZJ is 37B 2020-11-12T17:22:37.957 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.2djmPWP2ZJ 2020-11-12T17:22:37.965 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:22:38.013 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.DZexD3XiEk 2020-11-12T17:22:38.014 INFO:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.DZexD3XiEk 2020-11-12T17:22:38.070 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.DZexD3XiEk 2020-11-12T17:22:38.174 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.DZexD3XiEk is 37B 2020-11-12T17:22:38.184 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.DZexD3XiEk 2020-11-12T17:22:38.190 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:22:38.236 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.XP9VucZtQY 2020-11-12T17:22:38.237 INFO:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.XP9VucZtQY 2020-11-12T17:22:38.294 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.XP9VucZtQY 2020-11-12T17:22:38.398 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.XP9VucZtQY is 37B 2020-11-12T17:22:38.435 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.XP9VucZtQY 2020-11-12T17:22:38.441 INFO:teuthology.orchestra.run.smithi036:> mktemp 2020-11-12T17:22:38.488 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.CyBV05VvDk 2020-11-12T17:22:38.489 INFO:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.CyBV05VvDk 2020-11-12T17:22:38.546 INFO:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.CyBV05VvDk 2020-11-12T17:22:38.650 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.CyBV05VvDk is 37B 2020-11-12T17:22:38.659 INFO:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.CyBV05VvDk 2020-11-12T17:22:38.664 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:22:38.670 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.CSyNL1Pd59 2020-11-12T17:22:38.671 INFO:teuthology.orchestra.run.smithi205:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.CSyNL1Pd59 2020-11-12T17:22:38.725 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.CSyNL1Pd59 2020-11-12T17:22:38.831 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.CSyNL1Pd59 is 37B 2020-11-12T17:22:38.840 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.CSyNL1Pd59 2020-11-12T17:22:38.846 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:22:38.897 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.redXtLmMXI 2020-11-12T17:22:38.908 INFO:teuthology.orchestra.run.smithi205:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.redXtLmMXI 2020-11-12T17:22:38.954 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.redXtLmMXI 2020-11-12T17:22:39.059 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.redXtLmMXI is 37B 2020-11-12T17:22:39.069 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.redXtLmMXI 2020-11-12T17:22:39.074 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:22:39.120 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.W8UOjFAmCs 2020-11-12T17:22:39.121 INFO:teuthology.orchestra.run.smithi205:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.W8UOjFAmCs 2020-11-12T17:22:39.177 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.W8UOjFAmCs 2020-11-12T17:22:39.283 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.W8UOjFAmCs is 37B 2020-11-12T17:22:39.291 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.W8UOjFAmCs 2020-11-12T17:22:39.296 INFO:teuthology.orchestra.run.smithi205:> mktemp 2020-11-12T17:22:39.344 INFO:teuthology.orchestra.run.smithi205.stdout:/tmp/tmp.3HcTqMVaJU 2020-11-12T17:22:39.345 INFO:teuthology.orchestra.run.smithi205:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.3HcTqMVaJU 2020-11-12T17:22:39.402 INFO:teuthology.orchestra.run.smithi205:> sudo chmod 0666 /tmp/tmp.3HcTqMVaJU 2020-11-12T17:22:39.508 DEBUG:teuthology.orchestra.remote:smithi205:/tmp/tmp.3HcTqMVaJU is 37B 2020-11-12T17:22:39.523 INFO:teuthology.orchestra.run.smithi205:> rm -fr /tmp/tmp.3HcTqMVaJU 2020-11-12T17:22:39.529 INFO:teuthology.orchestra.run.smithi205:> sudo ceph --cluster ceph osd new bd1d5457-5d54-4074-b378-9da417f42976 0 2020-11-12T17:22:39.785 INFO:teuthology.orchestra.run.smithi205.stdout:0 2020-11-12T17:22:39.798 INFO:teuthology.orchestra.run.smithi205:> sudo ceph --cluster ceph osd new 37152eee-a8d8-40f1-8e27-2899e7b94c98 1 2020-11-12T17:22:39.998 INFO:teuthology.orchestra.run.smithi205.stdout:1 2020-11-12T17:22:40.012 INFO:teuthology.orchestra.run.smithi205:> sudo ceph --cluster ceph osd new d8ec2abb-38bf-4863-969a-482c4fa44f41 2 2020-11-12T17:22:40.218 INFO:teuthology.orchestra.run.smithi205.stdout:2 2020-11-12T17:22:40.232 INFO:teuthology.orchestra.run.smithi205:> sudo ceph --cluster ceph osd new 799d3499-577c-4510-a00c-9b2e126fc449 3 2020-11-12T17:22:40.433 INFO:teuthology.orchestra.run.smithi205.stdout:3 2020-11-12T17:22:40.446 INFO:teuthology.orchestra.run.smithi205:> sudo ceph --cluster ceph osd new c36e3100-aadc-4117-b495-24fb08a34148 4 2020-11-12T17:22:40.646 INFO:teuthology.orchestra.run.smithi205.stdout:4 2020-11-12T17:22:40.657 INFO:teuthology.orchestra.run.smithi205:> sudo ceph --cluster ceph osd new b152141f-b530-448e-8dff-fe200559eff0 5 2020-11-12T17:22:40.866 INFO:teuthology.orchestra.run.smithi205.stdout:5 2020-11-12T17:22:40.878 INFO:teuthology.orchestra.run.smithi205:> sudo ceph --cluster ceph osd new 62a140ba-7f94-4bb6-8a62-fda077f81354 6 2020-11-12T17:22:41.087 INFO:teuthology.orchestra.run.smithi205.stdout:6 2020-11-12T17:22:41.101 INFO:teuthology.orchestra.run.smithi205:> sudo ceph --cluster ceph osd new 32879bd7-780c-4da6-9838-5850b6277902 7 2020-11-12T17:22:41.317 INFO:teuthology.orchestra.run.smithi205.stdout:7 2020-11-12T17:22:41.331 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-12T17:22:41.332 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-12T17:22:41.334 INFO:tasks.ceph.osd.0:Started 2020-11-12T17:22:41.334 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-12T17:22:41.335 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-12T17:22:41.336 INFO:tasks.ceph.osd.1:Started 2020-11-12T17:22:41.337 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-12T17:22:41.337 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-12T17:22:41.339 INFO:tasks.ceph.osd.2:Started 2020-11-12T17:22:41.339 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-12T17:22:41.339 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-12T17:22:41.341 INFO:tasks.ceph.osd.3:Started 2020-11-12T17:22:41.342 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-12T17:22:41.342 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-12T17:22:41.344 INFO:tasks.ceph.osd.4:Started 2020-11-12T17:22:41.344 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-12T17:22:41.345 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-12T17:22:41.388 INFO:tasks.ceph.osd.5:Started 2020-11-12T17:22:41.388 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-12T17:22:41.389 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-12T17:22:41.390 INFO:tasks.ceph.osd.6:Started 2020-11-12T17:22:41.390 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-12T17:22:41.391 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-12T17:22:41.393 INFO:tasks.ceph.osd.7:Started 2020-11-12T17:22:41.393 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-12T17:22:41.754 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:22:41.752+0000 7f929cfa5d80 -1 Falling back to public interface 2020-11-12T17:22:41.962 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:22:41.958+0000 7f659b591d80 -1 Falling back to public interface 2020-11-12T17:22:41.962 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:22:41.958+0000 7f4315ff4d80 -1 Falling back to public interface 2020-11-12T17:22:41.969 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:22:41.968+0000 7f7b630e0d80 -1 Falling back to public interface 2020-11-12T17:22:41.976 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:22:41.974+0000 7fc26051ad80 -1 Falling back to public interface 2020-11-12T17:22:41.977 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:22:41.974+0000 7f7ff4a7cd80 -1 Falling back to public interface 2020-11-12T17:22:42.010 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:22:42.008+0000 7f9a1e8ebd80 -1 Falling back to public interface 2020-11-12T17:22:42.011 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:22:42.008+0000 7f28218f8d80 -1 Falling back to public interface 2020-11-12T17:22:42.200 INFO:teuthology.orchestra.run.smithi036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-12T17:22:42.435 INFO:teuthology.misc.health.smithi036.stdout: 2020-11-12T17:22:42.436 INFO:teuthology.misc.health.smithi036.stdout:{"epoch":10,"fsid":"8c8a6bcc-49d4-47d1-904f-e20798ef8e1f","created":"2020-11-12T17:22:37.581394+0000","modified":"2020-11-12T17:22:41.301911+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"bd1d5457-5d54-4074-b378-9da417f42976","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"37152eee-a8d8-40f1-8e27-2899e7b94c98","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d8ec2abb-38bf-4863-969a-482c4fa44f41","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"799d3499-577c-4510-a00c-9b2e126fc449","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c36e3100-aadc-4117-b495-24fb08a34148","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b152141f-b530-448e-8dff-fe200559eff0","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"62a140ba-7f94-4bb6-8a62-fda077f81354","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"32879bd7-780c-4da6-9838-5850b6277902","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-12T17:22:42.447 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-11-12T17:22:42.937 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:22:42.936+0000 7f929cfa5d80 -1 osd.7 0 log_to_monitors {default=true} 2020-11-12T17:22:43.105 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:22:43.102+0000 7f659b591d80 -1 osd.0 0 log_to_monitors {default=true} 2020-11-12T17:22:43.112 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:22:43.108+0000 7f7b630e0d80 -1 osd.4 0 log_to_monitors {default=true} 2020-11-12T17:22:43.159 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:22:43.158+0000 7f4315ff4d80 -1 osd.2 0 log_to_monitors {default=true} 2020-11-12T17:22:43.160 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:22:43.158+0000 7f7ff4a7cd80 -1 osd.1 0 log_to_monitors {default=true} 2020-11-12T17:22:43.174 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:22:43.172+0000 7f9a1e8ebd80 -1 osd.5 0 log_to_monitors {default=true} 2020-11-12T17:22:43.184 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:22:43.182+0000 7fc26051ad80 -1 osd.3 0 log_to_monitors {default=true} 2020-11-12T17:22:43.215 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:22:43.212+0000 7f28218f8d80 -1 osd.6 0 log_to_monitors {default=true} 2020-11-12T17:22:44.569 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:22:44.566+0000 7f42ff1ad700 -1 osd.2 0 waiting for initial osdmap 2020-11-12T17:22:44.570 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:22:44.568+0000 7f9a07aa4700 -1 osd.5 0 waiting for initial osdmap 2020-11-12T17:22:44.570 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:22:44.566+0000 7f658474a700 -1 osd.0 0 waiting for initial osdmap 2020-11-12T17:22:44.571 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:22:44.568+0000 7f7b4c299700 -1 osd.4 0 waiting for initial osdmap 2020-11-12T17:22:44.571 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:22:44.568+0000 7f928615e700 -1 osd.7 0 waiting for initial osdmap 2020-11-12T17:22:44.572 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:22:44.568+0000 7f280aab1700 -1 osd.6 0 waiting for initial osdmap 2020-11-12T17:22:44.572 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:22:44.566+0000 7f7fddc35700 -1 osd.1 0 waiting for initial osdmap 2020-11-12T17:22:44.572 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:22:44.566+0000 7fc2496d3700 -1 osd.3 0 waiting for initial osdmap 2020-11-12T17:22:44.575 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:22:44.570+0000 7fc24d2e3700 -1 osd.3 0 handle_osd_map injecting map crc failure 2020-11-12T17:22:44.576 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:22:44.576+0000 7f7b4fea9700 -1 osd.4 0 handle_osd_map injecting map crc failure 2020-11-12T17:22:45.568 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:22:45.568+0000 7f280e6c1700 -1 osd.6 13 handle_osd_map injecting map crc failure 2020-11-12T17:22:45.569 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:22:45.568+0000 7f9a0b6b4700 -1 osd.5 13 handle_osd_map injecting map crc failure 2020-11-12T17:22:49.254 INFO:teuthology.orchestra.run.smithi036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-12T17:22:49.558 INFO:teuthology.misc.health.smithi036.stdout: 2020-11-12T17:22:49.559 INFO:teuthology.misc.health.smithi036.stdout:{"epoch":16,"fsid":"8c8a6bcc-49d4-47d1-904f-e20798ef8e1f","created":"2020-11-12T17:22:37.581394+0000","modified":"2020-11-12T17:22:47.583752+0000","last_up_change":"2020-11-12T17:22:45.562766+0000","last_in_change":"2020-11-12T17:22:45.562766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-12T17:22:41.596657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"bd1d5457-5d54-4074-b378-9da417f42976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6801","nonce":12304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6802","nonce":12304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6806","nonce":12304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6804","nonce":12304}]},"public_addr":"172.21.15.36:6801/12304","cluster_addr":"172.21.15.36:6802/12304","heartbeat_back_addr":"172.21.15.36:6806/12304","heartbeat_front_addr":"172.21.15.36:6804/12304","state":["exists","up"]},{"osd":1,"uuid":"37152eee-a8d8-40f1-8e27-2899e7b94c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6812","nonce":12307}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6814","nonce":12307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6816","nonce":12307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6815","nonce":12307}]},"public_addr":"172.21.15.36:6812/12307","cluster_addr":"172.21.15.36:6814/12307","heartbeat_back_addr":"172.21.15.36:6816/12307","heartbeat_front_addr":"172.21.15.36:6815/12307","state":["exists","up"]},{"osd":2,"uuid":"d8ec2abb-38bf-4863-969a-482c4fa44f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6803","nonce":12306}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6805","nonce":12306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6808","nonce":12306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6807","nonce":12306}]},"public_addr":"172.21.15.36:6803/12306","cluster_addr":"172.21.15.36:6805/12306","heartbeat_back_addr":"172.21.15.36:6808/12306","heartbeat_front_addr":"172.21.15.36:6807/12306","state":["exists","up"]},{"osd":3,"uuid":"799d3499-577c-4510-a00c-9b2e126fc449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6809","nonce":12305}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6810","nonce":12305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6813","nonce":12305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6811","nonce":12305}]},"public_addr":"172.21.15.36:6809/12305","cluster_addr":"172.21.15.36:6810/12305","heartbeat_back_addr":"172.21.15.36:6813/12305","heartbeat_front_addr":"172.21.15.36:6811/12305","state":["exists","up"]},{"osd":4,"uuid":"c36e3100-aadc-4117-b495-24fb08a34148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6804","nonce":12499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6805","nonce":12499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6807","nonce":12499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6806","nonce":12499}]},"public_addr":"172.21.15.205:6804/12499","cluster_addr":"172.21.15.205:6805/12499","heartbeat_back_addr":"172.21.15.205:6807/12499","heartbeat_front_addr":"172.21.15.205:6806/12499","state":["exists","up"]},{"osd":5,"uuid":"b152141f-b530-448e-8dff-fe200559eff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6808","nonce":12525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6810","nonce":12525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6814","nonce":12525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6812","nonce":12525}]},"public_addr":"172.21.15.205:6808/12525","cluster_addr":"172.21.15.205:6810/12525","heartbeat_back_addr":"172.21.15.205:6814/12525","heartbeat_front_addr":"172.21.15.205:6812/12525","state":["exists","up"]},{"osd":6,"uuid":"62a140ba-7f94-4bb6-8a62-fda077f81354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6809","nonce":12524}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6811","nonce":12524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6815","nonce":12524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6813","nonce":12524}]},"public_addr":"172.21.15.205:6809/12524","cluster_addr":"172.21.15.205:6811/12524","heartbeat_back_addr":"172.21.15.205:6815/12524","heartbeat_front_addr":"172.21.15.205:6813/12524","state":["exists","up"]},{"osd":7,"uuid":"32879bd7-780c-4da6-9838-5850b6277902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6800","nonce":12522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6801","nonce":12522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6803","nonce":12522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6802","nonce":12522}]},"public_addr":"172.21.15.205:6800/12522","cluster_addr":"172.21.15.205:6801/12522","heartbeat_back_addr":"172.21.15.205:6803/12522","heartbeat_front_addr":"172.21.15.205:6802/12522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.153580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.206830+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.143040+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.205663+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.139983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.167307+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.198025+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:43.935482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-12T17:22:49.577 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-11-12T17:22:49.577 INFO:tasks.ceph:Creating RBD pool 2020-11-12T17:22:49.578 INFO:teuthology.orchestra.run.smithi036:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-12T17:22:50.337 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:22:50.336+0000 7f9289d6e700 -1 osd.7 16 handle_osd_map injecting map crc failure 2020-11-12T17:22:50.347 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:22:50.344+0000 7f2809aaf700 -1 osd.6 16 handle_osd_map injecting map crc failure 2020-11-12T17:22:50.348 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'rbd' created 2020-11-12T17:22:50.360 INFO:teuthology.orchestra.run.smithi036:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-12T17:22:51.352 INFO:teuthology.orchestra.run.smithi036.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-12T17:22:51.366 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-12T17:22:51.372 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-12T17:22:51.373 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-12T17:22:51.654 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:51.655 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":18,"fsid":"8c8a6bcc-49d4-47d1-904f-e20798ef8e1f","created":"2020-11-12T17:22:37.581394+0000","modified":"2020-11-12T17:22:51.334093+0000","last_up_change":"2020-11-12T17:22:45.562766+0000","last_in_change":"2020-11-12T17:22:45.562766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-12T17:22:41.596657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-12T17:22:49.905816+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"bd1d5457-5d54-4074-b378-9da417f42976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6801","nonce":12304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6802","nonce":12304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6806","nonce":12304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6804","nonce":12304}]},"public_addr":"172.21.15.36:6801/12304","cluster_addr":"172.21.15.36:6802/12304","heartbeat_back_addr":"172.21.15.36:6806/12304","heartbeat_front_addr":"172.21.15.36:6804/12304","state":["exists","up"]},{"osd":1,"uuid":"37152eee-a8d8-40f1-8e27-2899e7b94c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6812","nonce":12307}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6814","nonce":12307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6816","nonce":12307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6815","nonce":12307}]},"public_addr":"172.21.15.36:6812/12307","cluster_addr":"172.21.15.36:6814/12307","heartbeat_back_addr":"172.21.15.36:6816/12307","heartbeat_front_addr":"172.21.15.36:6815/12307","state":["exists","up"]},{"osd":2,"uuid":"d8ec2abb-38bf-4863-969a-482c4fa44f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6803","nonce":12306}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6805","nonce":12306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6808","nonce":12306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6807","nonce":12306}]},"public_addr":"172.21.15.36:6803/12306","cluster_addr":"172.21.15.36:6805/12306","heartbeat_back_addr":"172.21.15.36:6808/12306","heartbeat_front_addr":"172.21.15.36:6807/12306","state":["exists","up"]},{"osd":3,"uuid":"799d3499-577c-4510-a00c-9b2e126fc449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6809","nonce":12305}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6810","nonce":12305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6813","nonce":12305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6811","nonce":12305}]},"public_addr":"172.21.15.36:6809/12305","cluster_addr":"172.21.15.36:6810/12305","heartbeat_back_addr":"172.21.15.36:6813/12305","heartbeat_front_addr":"172.21.15.36:6811/12305","state":["exists","up"]},{"osd":4,"uuid":"c36e3100-aadc-4117-b495-24fb08a34148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6804","nonce":12499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6805","nonce":12499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6807","nonce":12499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6806","nonce":12499}]},"public_addr":"172.21.15.205:6804/12499","cluster_addr":"172.21.15.205:6805/12499","heartbeat_back_addr":"172.21.15.205:6807/12499","heartbeat_front_addr":"172.21.15.205:6806/12499","state":["exists","up"]},{"osd":5,"uuid":"b152141f-b530-448e-8dff-fe200559eff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6808","nonce":12525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6810","nonce":12525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6814","nonce":12525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6812","nonce":12525}]},"public_addr":"172.21.15.205:6808/12525","cluster_addr":"172.21.15.205:6810/12525","heartbeat_back_addr":"172.21.15.205:6814/12525","heartbeat_front_addr":"172.21.15.205:6812/12525","state":["exists","up"]},{"osd":6,"uuid":"62a140ba-7f94-4bb6-8a62-fda077f81354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6809","nonce":12524}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6811","nonce":12524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6815","nonce":12524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6813","nonce":12524}]},"public_addr":"172.21.15.205:6809/12524","cluster_addr":"172.21.15.205:6811/12524","heartbeat_back_addr":"172.21.15.205:6815/12524","heartbeat_front_addr":"172.21.15.205:6813/12524","state":["exists","up"]},{"osd":7,"uuid":"32879bd7-780c-4da6-9838-5850b6277902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6800","nonce":12522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6801","nonce":12522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6803","nonce":12522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6802","nonce":12522}]},"public_addr":"172.21.15.205:6800/12522","cluster_addr":"172.21.15.205:6801/12522","heartbeat_back_addr":"172.21.15.205:6803/12522","heartbeat_front_addr":"172.21.15.205:6802/12522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.153580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.206830+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.143040+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.205663+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.139983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.167307+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.198025+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:43.935482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-12T17:22:51.667 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-12T17:22:51.668 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-11-12T17:22:51.949 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2020-11-12T17:22:51.963 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-11-12T17:22:52.241 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2020-11-12T17:22:52.254 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-12T17:22:52.254 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-12T17:22:52.255 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-11-12T17:22:52.572 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:52.585 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6800","nonce":12173}]},"active_addr":"172.21.15.36:6800/12173","active_change":"2020-11-12T17:22:41.525166+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.36:0","nonce":2864925556}]},{"addrvec":[{"type":"v2","addr":"172.21.15.36:0","nonce":3321084517}]},{"addrvec":[{"type":"v2","addr":"172.21.15.36:0","nonce":1959066400}]}]}} 2020-11-12T17:22:52.590 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-12T17:22:52.590 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-12T17:22:52.590 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-12T17:22:52.876 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:52.877 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":19,"fsid":"8c8a6bcc-49d4-47d1-904f-e20798ef8e1f","created":"2020-11-12T17:22:37.581394+0000","modified":"2020-11-12T17:22:52.354048+0000","last_up_change":"2020-11-12T17:22:45.562766+0000","last_in_change":"2020-11-12T17:22:45.562766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-12T17:22:41.596657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-12T17:22:49.905816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"bd1d5457-5d54-4074-b378-9da417f42976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6801","nonce":12304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6802","nonce":12304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6806","nonce":12304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6804","nonce":12304}]},"public_addr":"172.21.15.36:6801/12304","cluster_addr":"172.21.15.36:6802/12304","heartbeat_back_addr":"172.21.15.36:6806/12304","heartbeat_front_addr":"172.21.15.36:6804/12304","state":["exists","up"]},{"osd":1,"uuid":"37152eee-a8d8-40f1-8e27-2899e7b94c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6812","nonce":12307}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6814","nonce":12307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6816","nonce":12307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6815","nonce":12307}]},"public_addr":"172.21.15.36:6812/12307","cluster_addr":"172.21.15.36:6814/12307","heartbeat_back_addr":"172.21.15.36:6816/12307","heartbeat_front_addr":"172.21.15.36:6815/12307","state":["exists","up"]},{"osd":2,"uuid":"d8ec2abb-38bf-4863-969a-482c4fa44f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6803","nonce":12306}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6805","nonce":12306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6808","nonce":12306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6807","nonce":12306}]},"public_addr":"172.21.15.36:6803/12306","cluster_addr":"172.21.15.36:6805/12306","heartbeat_back_addr":"172.21.15.36:6808/12306","heartbeat_front_addr":"172.21.15.36:6807/12306","state":["exists","up"]},{"osd":3,"uuid":"799d3499-577c-4510-a00c-9b2e126fc449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6809","nonce":12305}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6810","nonce":12305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6813","nonce":12305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6811","nonce":12305}]},"public_addr":"172.21.15.36:6809/12305","cluster_addr":"172.21.15.36:6810/12305","heartbeat_back_addr":"172.21.15.36:6813/12305","heartbeat_front_addr":"172.21.15.36:6811/12305","state":["exists","up"]},{"osd":4,"uuid":"c36e3100-aadc-4117-b495-24fb08a34148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6804","nonce":12499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6805","nonce":12499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6807","nonce":12499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6806","nonce":12499}]},"public_addr":"172.21.15.205:6804/12499","cluster_addr":"172.21.15.205:6805/12499","heartbeat_back_addr":"172.21.15.205:6807/12499","heartbeat_front_addr":"172.21.15.205:6806/12499","state":["exists","up"]},{"osd":5,"uuid":"b152141f-b530-448e-8dff-fe200559eff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6808","nonce":12525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6810","nonce":12525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6814","nonce":12525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6812","nonce":12525}]},"public_addr":"172.21.15.205:6808/12525","cluster_addr":"172.21.15.205:6810/12525","heartbeat_back_addr":"172.21.15.205:6814/12525","heartbeat_front_addr":"172.21.15.205:6812/12525","state":["exists","up"]},{"osd":6,"uuid":"62a140ba-7f94-4bb6-8a62-fda077f81354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6809","nonce":12524}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6811","nonce":12524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6815","nonce":12524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6813","nonce":12524}]},"public_addr":"172.21.15.205:6809/12524","cluster_addr":"172.21.15.205:6811/12524","heartbeat_back_addr":"172.21.15.205:6815/12524","heartbeat_front_addr":"172.21.15.205:6813/12524","state":["exists","up"]},{"osd":7,"uuid":"32879bd7-780c-4da6-9838-5850b6277902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6800","nonce":12522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6801","nonce":12522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6803","nonce":12522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6802","nonce":12522}]},"public_addr":"172.21.15.205:6800/12522","cluster_addr":"172.21.15.205:6801/12522","heartbeat_back_addr":"172.21.15.205:6803/12522","heartbeat_front_addr":"172.21.15.205:6802/12522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.153580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.206830+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.143040+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.205663+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.139983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.167307+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.198025+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:43.935482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-12T17:22:52.890 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-12T17:22:52.890 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-12T17:22:53.018 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:22:53.016+0000 7f2809aaf700 -1 osd.6 18 handle_osd_map injecting map crc failure 2020-11-12T17:22:53.139 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:22:53.016+0000 7f9a06aa2700 -1 osd.5 18 handle_osd_map injecting map crc failure 2020-11-12T17:22:53.163 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:53.164 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":19,"fsid":"8c8a6bcc-49d4-47d1-904f-e20798ef8e1f","created":"2020-11-12T17:22:37.581394+0000","modified":"2020-11-12T17:22:52.354048+0000","last_up_change":"2020-11-12T17:22:45.562766+0000","last_in_change":"2020-11-12T17:22:45.562766+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-12T17:22:41.596657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-12T17:22:49.905816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"bd1d5457-5d54-4074-b378-9da417f42976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6801","nonce":12304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6802","nonce":12304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6806","nonce":12304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6804","nonce":12304}]},"public_addr":"172.21.15.36:6801/12304","cluster_addr":"172.21.15.36:6802/12304","heartbeat_back_addr":"172.21.15.36:6806/12304","heartbeat_front_addr":"172.21.15.36:6804/12304","state":["exists","up"]},{"osd":1,"uuid":"37152eee-a8d8-40f1-8e27-2899e7b94c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6812","nonce":12307}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6814","nonce":12307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6816","nonce":12307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6815","nonce":12307}]},"public_addr":"172.21.15.36:6812/12307","cluster_addr":"172.21.15.36:6814/12307","heartbeat_back_addr":"172.21.15.36:6816/12307","heartbeat_front_addr":"172.21.15.36:6815/12307","state":["exists","up"]},{"osd":2,"uuid":"d8ec2abb-38bf-4863-969a-482c4fa44f41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6803","nonce":12306}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6805","nonce":12306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6808","nonce":12306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6807","nonce":12306}]},"public_addr":"172.21.15.36:6803/12306","cluster_addr":"172.21.15.36:6805/12306","heartbeat_back_addr":"172.21.15.36:6808/12306","heartbeat_front_addr":"172.21.15.36:6807/12306","state":["exists","up"]},{"osd":3,"uuid":"799d3499-577c-4510-a00c-9b2e126fc449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6809","nonce":12305}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6810","nonce":12305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6813","nonce":12305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6811","nonce":12305}]},"public_addr":"172.21.15.36:6809/12305","cluster_addr":"172.21.15.36:6810/12305","heartbeat_back_addr":"172.21.15.36:6813/12305","heartbeat_front_addr":"172.21.15.36:6811/12305","state":["exists","up"]},{"osd":4,"uuid":"c36e3100-aadc-4117-b495-24fb08a34148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6804","nonce":12499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6805","nonce":12499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6807","nonce":12499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6806","nonce":12499}]},"public_addr":"172.21.15.205:6804/12499","cluster_addr":"172.21.15.205:6805/12499","heartbeat_back_addr":"172.21.15.205:6807/12499","heartbeat_front_addr":"172.21.15.205:6806/12499","state":["exists","up"]},{"osd":5,"uuid":"b152141f-b530-448e-8dff-fe200559eff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6808","nonce":12525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6810","nonce":12525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6814","nonce":12525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6812","nonce":12525}]},"public_addr":"172.21.15.205:6808/12525","cluster_addr":"172.21.15.205:6810/12525","heartbeat_back_addr":"172.21.15.205:6814/12525","heartbeat_front_addr":"172.21.15.205:6812/12525","state":["exists","up"]},{"osd":6,"uuid":"62a140ba-7f94-4bb6-8a62-fda077f81354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6809","nonce":12524}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6811","nonce":12524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6815","nonce":12524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6813","nonce":12524}]},"public_addr":"172.21.15.205:6809/12524","cluster_addr":"172.21.15.205:6811/12524","heartbeat_back_addr":"172.21.15.205:6815/12524","heartbeat_front_addr":"172.21.15.205:6813/12524","state":["exists","up"]},{"osd":7,"uuid":"32879bd7-780c-4da6-9838-5850b6277902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6800","nonce":12522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6801","nonce":12522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6803","nonce":12522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6802","nonce":12522}]},"public_addr":"172.21.15.205:6800/12522","cluster_addr":"172.21.15.205:6801/12522","heartbeat_back_addr":"172.21.15.205:6803/12522","heartbeat_front_addr":"172.21.15.205:6802/12522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.153580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.206830+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.143040+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.205663+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.139983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.167307+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.198025+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:43.935482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-12T17:22:53.184 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-11-12T17:22:53.360 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:53.360 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-11-12T17:22:53.533 INFO:teuthology.orchestra.run.smithi036.stdout:60129542148 2020-11-12T17:22:53.533 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-11-12T17:22:53.712 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:53.712 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-11-12T17:22:53.882 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:53.883 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-11-12T17:22:54.065 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:54.066 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-11-12T17:22:54.246 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:54.247 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-11-12T17:22:54.438 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:54.440 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-11-12T17:22:54.622 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:54.622 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-11-12T17:22:54.909 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:54.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.0 2020-11-12T17:22:54.923 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-11-12T17:22:55.205 INFO:teuthology.orchestra.run.smithi036.stdout:60129542148 2020-11-12T17:22:55.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2020-11-12T17:22:55.218 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-11-12T17:22:55.495 INFO:teuthology.orchestra.run.smithi036.stdout:60129542146 2020-11-12T17:22:55.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.2 2020-11-12T17:22:56.510 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-11-12T17:22:56.848 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:56.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.2 2020-11-12T17:22:56.867 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-11-12T17:22:57.144 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:57.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2020-11-12T17:22:57.159 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-11-12T17:22:57.441 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:57.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.4 2020-11-12T17:22:57.455 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-11-12T17:22:57.729 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:57.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.5 2020-11-12T17:22:57.747 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-11-12T17:22:58.029 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:58.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.6 2020-11-12T17:22:58.102 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-11-12T17:22:58.382 INFO:teuthology.orchestra.run.smithi036.stdout:60129542147 2020-11-12T17:22:58.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.7 2020-11-12T17:22:58.396 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-12T17:22:58.397 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:22:58.668 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:58.670 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:22:58.682 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2020-11-12T17:22:57.535779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8389884,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584836,"statfs":{"total":773094113280,"available":764502872064,"internally_reserved":8589934592,"allocated":1241088,"data_stored":418140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.171108"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359399+0000","last_change":"2020-11-12T17:22:51.355071+0000","last_active":"2020-11-12T17:22:51.359399+0000","last_peered":"2020-11-12T17:22:51.359399+0000","last_clean":"2020-11-12T17:22:51.359399+0000","last_became_active":"2020-11-12T17:22:51.354607+0000","last_became_peered":"2020-11-12T17:22:51.354607+0000","last_unstale":"2020-11-12T17:22:51.359399+0000","last_undegraded":"2020-11-12T17:22:51.359399+0000","last_fullsized":"2020-11-12T17:22:51.359399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.355877+0000","last_change":"2020-11-12T17:22:51.353439+0000","last_active":"2020-11-12T17:22:51.355877+0000","last_peered":"2020-11-12T17:22:51.355877+0000","last_clean":"2020-11-12T17:22:51.355877+0000","last_became_active":"2020-11-12T17:22:51.352991+0000","last_became_peered":"2020-11-12T17:22:51.352991+0000","last_unstale":"2020-11-12T17:22:51.355877+0000","last_undegraded":"2020-11-12T17:22:51.355877+0000","last_fullsized":"2020-11-12T17:22:51.355877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.729692+0000","last_change":"2020-11-12T17:22:51.723934+0000","last_active":"2020-11-12T17:22:51.729692+0000","last_peered":"2020-11-12T17:22:51.729692+0000","last_clean":"2020-11-12T17:22:51.729692+0000","last_became_active":"2020-11-12T17:22:51.723115+0000","last_became_peered":"2020-11-12T17:22:51.723115+0000","last_unstale":"2020-11-12T17:22:51.729692+0000","last_undegraded":"2020-11-12T17:22:51.729692+0000","last_fullsized":"2020-11-12T17:22:51.729692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359527+0000","last_change":"2020-11-12T17:22:51.356607+0000","last_active":"2020-11-12T17:22:51.359527+0000","last_peered":"2020-11-12T17:22:51.359527+0000","last_clean":"2020-11-12T17:22:51.359527+0000","last_became_active":"2020-11-12T17:22:51.356123+0000","last_became_peered":"2020-11-12T17:22:51.356123+0000","last_unstale":"2020-11-12T17:22:51.359527+0000","last_undegraded":"2020-11-12T17:22:51.359527+0000","last_fullsized":"2020-11-12T17:22:51.359527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.348824+0000","last_change":"2020-11-12T17:22:47.070011+0000","last_active":"2020-11-12T17:22:51.348824+0000","last_peered":"2020-11-12T17:22:51.348824+0000","last_clean":"2020-11-12T17:22:51.348824+0000","last_became_active":"2020-11-12T17:22:47.069110+0000","last_became_peered":"2020-11-12T17:22:47.069110+0000","last_unstale":"2020-11-12T17:22:51.348824+0000","last_undegraded":"2020-11-12T17:22:51.348824+0000","last_fullsized":"2020-11-12T17:22:51.348824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:22:42.530591+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.361973+0000","last_change":"2020-11-12T17:22:51.356716+0000","last_active":"2020-11-12T17:22:51.361973+0000","last_peered":"2020-11-12T17:22:51.361973+0000","last_clean":"2020-11-12T17:22:51.361973+0000","last_became_active":"2020-11-12T17:22:51.356165+0000","last_became_peered":"2020-11-12T17:22:51.356165+0000","last_unstale":"2020-11-12T17:22:51.361973+0000","last_undegraded":"2020-11-12T17:22:51.361973+0000","last_fullsized":"2020-11-12T17:22:51.361973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:52.054468+0000","last_change":"2020-11-12T17:22:52.053549+0000","last_active":"2020-11-12T17:22:52.054468+0000","last_peered":"2020-11-12T17:22:52.054468+0000","last_clean":"2020-11-12T17:22:52.054468+0000","last_became_active":"2020-11-12T17:22:52.052882+0000","last_became_peered":"2020-11-12T17:22:52.052882+0000","last_unstale":"2020-11-12T17:22:52.054468+0000","last_undegraded":"2020-11-12T17:22:52.054468+0000","last_fullsized":"2020-11-12T17:22:52.054468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359230+0000","last_change":"2020-11-12T17:22:51.356083+0000","last_active":"2020-11-12T17:22:51.359230+0000","last_peered":"2020-11-12T17:22:51.359230+0000","last_clean":"2020-11-12T17:22:51.359230+0000","last_became_active":"2020-11-12T17:22:51.355473+0000","last_became_peered":"2020-11-12T17:22:51.355473+0000","last_unstale":"2020-11-12T17:22:51.359230+0000","last_undegraded":"2020-11-12T17:22:51.359230+0000","last_fullsized":"2020-11-12T17:22:51.359230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.723187+0000","last_change":"2020-11-12T17:22:51.722504+0000","last_active":"2020-11-12T17:22:51.723187+0000","last_peered":"2020-11-12T17:22:51.723187+0000","last_clean":"2020-11-12T17:22:51.723187+0000","last_became_active":"2020-11-12T17:22:51.721744+0000","last_became_peered":"2020-11-12T17:22:51.721744+0000","last_unstale":"2020-11-12T17:22:51.723187+0000","last_undegraded":"2020-11-12T17:22:51.723187+0000","last_fullsized":"2020-11-12T17:22:51.723187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":53410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3180000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2389999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8130000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.98}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6619999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":51306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0019999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.327}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4540000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6110000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.891}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7970000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":49689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.383}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4660000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4369999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5779999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":53988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0830000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9039999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9810000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0219999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1890000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0670000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":50728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4089999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8610000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":53410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9339999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2850000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0030000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6720000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7370000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":53988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.569}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.722}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.948}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0550000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":51621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.476}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6110000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.577}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5339999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6539999999999999}]}]}]}} 2020-11-12T17:22:58.684 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:22:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:58.961 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:22:58.976 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2020-11-12T17:22:57.535779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8389884,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584836,"statfs":{"total":773094113280,"available":764502872064,"internally_reserved":8589934592,"allocated":1241088,"data_stored":418140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.171108"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359399+0000","last_change":"2020-11-12T17:22:51.355071+0000","last_active":"2020-11-12T17:22:51.359399+0000","last_peered":"2020-11-12T17:22:51.359399+0000","last_clean":"2020-11-12T17:22:51.359399+0000","last_became_active":"2020-11-12T17:22:51.354607+0000","last_became_peered":"2020-11-12T17:22:51.354607+0000","last_unstale":"2020-11-12T17:22:51.359399+0000","last_undegraded":"2020-11-12T17:22:51.359399+0000","last_fullsized":"2020-11-12T17:22:51.359399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.355877+0000","last_change":"2020-11-12T17:22:51.353439+0000","last_active":"2020-11-12T17:22:51.355877+0000","last_peered":"2020-11-12T17:22:51.355877+0000","last_clean":"2020-11-12T17:22:51.355877+0000","last_became_active":"2020-11-12T17:22:51.352991+0000","last_became_peered":"2020-11-12T17:22:51.352991+0000","last_unstale":"2020-11-12T17:22:51.355877+0000","last_undegraded":"2020-11-12T17:22:51.355877+0000","last_fullsized":"2020-11-12T17:22:51.355877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.729692+0000","last_change":"2020-11-12T17:22:51.723934+0000","last_active":"2020-11-12T17:22:51.729692+0000","last_peered":"2020-11-12T17:22:51.729692+0000","last_clean":"2020-11-12T17:22:51.729692+0000","last_became_active":"2020-11-12T17:22:51.723115+0000","last_became_peered":"2020-11-12T17:22:51.723115+0000","last_unstale":"2020-11-12T17:22:51.729692+0000","last_undegraded":"2020-11-12T17:22:51.729692+0000","last_fullsized":"2020-11-12T17:22:51.729692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359527+0000","last_change":"2020-11-12T17:22:51.356607+0000","last_active":"2020-11-12T17:22:51.359527+0000","last_peered":"2020-11-12T17:22:51.359527+0000","last_clean":"2020-11-12T17:22:51.359527+0000","last_became_active":"2020-11-12T17:22:51.356123+0000","last_became_peered":"2020-11-12T17:22:51.356123+0000","last_unstale":"2020-11-12T17:22:51.359527+0000","last_undegraded":"2020-11-12T17:22:51.359527+0000","last_fullsized":"2020-11-12T17:22:51.359527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.348824+0000","last_change":"2020-11-12T17:22:47.070011+0000","last_active":"2020-11-12T17:22:51.348824+0000","last_peered":"2020-11-12T17:22:51.348824+0000","last_clean":"2020-11-12T17:22:51.348824+0000","last_became_active":"2020-11-12T17:22:47.069110+0000","last_became_peered":"2020-11-12T17:22:47.069110+0000","last_unstale":"2020-11-12T17:22:51.348824+0000","last_undegraded":"2020-11-12T17:22:51.348824+0000","last_fullsized":"2020-11-12T17:22:51.348824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:22:42.530591+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.361973+0000","last_change":"2020-11-12T17:22:51.356716+0000","last_active":"2020-11-12T17:22:51.361973+0000","last_peered":"2020-11-12T17:22:51.361973+0000","last_clean":"2020-11-12T17:22:51.361973+0000","last_became_active":"2020-11-12T17:22:51.356165+0000","last_became_peered":"2020-11-12T17:22:51.356165+0000","last_unstale":"2020-11-12T17:22:51.361973+0000","last_undegraded":"2020-11-12T17:22:51.361973+0000","last_fullsized":"2020-11-12T17:22:51.361973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:52.054468+0000","last_change":"2020-11-12T17:22:52.053549+0000","last_active":"2020-11-12T17:22:52.054468+0000","last_peered":"2020-11-12T17:22:52.054468+0000","last_clean":"2020-11-12T17:22:52.054468+0000","last_became_active":"2020-11-12T17:22:52.052882+0000","last_became_peered":"2020-11-12T17:22:52.052882+0000","last_unstale":"2020-11-12T17:22:52.054468+0000","last_undegraded":"2020-11-12T17:22:52.054468+0000","last_fullsized":"2020-11-12T17:22:52.054468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359230+0000","last_change":"2020-11-12T17:22:51.356083+0000","last_active":"2020-11-12T17:22:51.359230+0000","last_peered":"2020-11-12T17:22:51.359230+0000","last_clean":"2020-11-12T17:22:51.359230+0000","last_became_active":"2020-11-12T17:22:51.355473+0000","last_became_peered":"2020-11-12T17:22:51.355473+0000","last_unstale":"2020-11-12T17:22:51.359230+0000","last_undegraded":"2020-11-12T17:22:51.359230+0000","last_fullsized":"2020-11-12T17:22:51.359230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.723187+0000","last_change":"2020-11-12T17:22:51.722504+0000","last_active":"2020-11-12T17:22:51.723187+0000","last_peered":"2020-11-12T17:22:51.723187+0000","last_clean":"2020-11-12T17:22:51.723187+0000","last_became_active":"2020-11-12T17:22:51.721744+0000","last_became_peered":"2020-11-12T17:22:51.721744+0000","last_unstale":"2020-11-12T17:22:51.723187+0000","last_undegraded":"2020-11-12T17:22:51.723187+0000","last_fullsized":"2020-11-12T17:22:51.723187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":53410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3180000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2389999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8130000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.98}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6619999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":51306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0019999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.327}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4540000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6110000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.891}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7970000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":49689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.383}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4660000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4369999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5779999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":53988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0830000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9039999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9810000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0219999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1890000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0670000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":50728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4089999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8610000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":53410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9339999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2850000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0030000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6720000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7370000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":53988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.569}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.722}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.948}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0550000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":51621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.476}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6110000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.577}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5339999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6539999999999999}]}]}]}} 2020-11-12T17:22:58.978 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-12T17:22:58.979 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-12T17:22:58.979 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-12T17:22:58.980 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-11-12T17:22:59.304 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:59.318 INFO:teuthology.orchestra.run.smithi036.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-12T17:22:59.318 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-12T17:22:59.322 INFO:teuthology.run_tasks:Running task thrashosds... 2020-11-12T17:22:59.335 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2020-11-12T17:22:59.335 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd inject bad map crc probability': 0.1, 'osd map cache size': 1, 'osd max backfills': 6, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub during recovery': False, 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'osd_map_cache_size', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'mon_bind_msgr2': False, 'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': '31d4e76d0d584790763b4b1146b29ea4cfc2e9af'}} 2020-11-12T17:22:59.336 INFO:tasks.thrashosds:config is {'chance_pgnum_grow': 0.25, 'chance_pgnum_shrink': 0.25, 'chance_pgpnum_fix': 0.25, 'chance_test_map_discontinuity': 2, 'timeout': 1800, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2020-11-12T17:22:59.336 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mgr mgr_debug_aggressive_pg_num_changes true 2020-11-12T17:22:59.642 INFO:tasks.thrashosds:Beginning thrashosds... 2020-11-12T17:22:59.643 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-12T17:22:59.643 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:22:59.916 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:22:59.918 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:22:59.929 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2020-11-12T17:22:59.536168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8389884,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584836,"statfs":{"total":773094113280,"available":764502872064,"internally_reserved":8589934592,"allocated":1241088,"data_stored":418140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.171497"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359399+0000","last_change":"2020-11-12T17:22:51.355071+0000","last_active":"2020-11-12T17:22:51.359399+0000","last_peered":"2020-11-12T17:22:51.359399+0000","last_clean":"2020-11-12T17:22:51.359399+0000","last_became_active":"2020-11-12T17:22:51.354607+0000","last_became_peered":"2020-11-12T17:22:51.354607+0000","last_unstale":"2020-11-12T17:22:51.359399+0000","last_undegraded":"2020-11-12T17:22:51.359399+0000","last_fullsized":"2020-11-12T17:22:51.359399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.355877+0000","last_change":"2020-11-12T17:22:51.353439+0000","last_active":"2020-11-12T17:22:51.355877+0000","last_peered":"2020-11-12T17:22:51.355877+0000","last_clean":"2020-11-12T17:22:51.355877+0000","last_became_active":"2020-11-12T17:22:51.352991+0000","last_became_peered":"2020-11-12T17:22:51.352991+0000","last_unstale":"2020-11-12T17:22:51.355877+0000","last_undegraded":"2020-11-12T17:22:51.355877+0000","last_fullsized":"2020-11-12T17:22:51.355877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.729692+0000","last_change":"2020-11-12T17:22:51.723934+0000","last_active":"2020-11-12T17:22:51.729692+0000","last_peered":"2020-11-12T17:22:51.729692+0000","last_clean":"2020-11-12T17:22:51.729692+0000","last_became_active":"2020-11-12T17:22:51.723115+0000","last_became_peered":"2020-11-12T17:22:51.723115+0000","last_unstale":"2020-11-12T17:22:51.729692+0000","last_undegraded":"2020-11-12T17:22:51.729692+0000","last_fullsized":"2020-11-12T17:22:51.729692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359527+0000","last_change":"2020-11-12T17:22:51.356607+0000","last_active":"2020-11-12T17:22:51.359527+0000","last_peered":"2020-11-12T17:22:51.359527+0000","last_clean":"2020-11-12T17:22:51.359527+0000","last_became_active":"2020-11-12T17:22:51.356123+0000","last_became_peered":"2020-11-12T17:22:51.356123+0000","last_unstale":"2020-11-12T17:22:51.359527+0000","last_undegraded":"2020-11-12T17:22:51.359527+0000","last_fullsized":"2020-11-12T17:22:51.359527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.348824+0000","last_change":"2020-11-12T17:22:47.070011+0000","last_active":"2020-11-12T17:22:51.348824+0000","last_peered":"2020-11-12T17:22:51.348824+0000","last_clean":"2020-11-12T17:22:51.348824+0000","last_became_active":"2020-11-12T17:22:47.069110+0000","last_became_peered":"2020-11-12T17:22:47.069110+0000","last_unstale":"2020-11-12T17:22:51.348824+0000","last_undegraded":"2020-11-12T17:22:51.348824+0000","last_fullsized":"2020-11-12T17:22:51.348824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:22:42.530591+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.361973+0000","last_change":"2020-11-12T17:22:51.356716+0000","last_active":"2020-11-12T17:22:51.361973+0000","last_peered":"2020-11-12T17:22:51.361973+0000","last_clean":"2020-11-12T17:22:51.361973+0000","last_became_active":"2020-11-12T17:22:51.356165+0000","last_became_peered":"2020-11-12T17:22:51.356165+0000","last_unstale":"2020-11-12T17:22:51.361973+0000","last_undegraded":"2020-11-12T17:22:51.361973+0000","last_fullsized":"2020-11-12T17:22:51.361973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:52.054468+0000","last_change":"2020-11-12T17:22:52.053549+0000","last_active":"2020-11-12T17:22:52.054468+0000","last_peered":"2020-11-12T17:22:52.054468+0000","last_clean":"2020-11-12T17:22:52.054468+0000","last_became_active":"2020-11-12T17:22:52.052882+0000","last_became_peered":"2020-11-12T17:22:52.052882+0000","last_unstale":"2020-11-12T17:22:52.054468+0000","last_undegraded":"2020-11-12T17:22:52.054468+0000","last_fullsized":"2020-11-12T17:22:52.054468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359230+0000","last_change":"2020-11-12T17:22:51.356083+0000","last_active":"2020-11-12T17:22:51.359230+0000","last_peered":"2020-11-12T17:22:51.359230+0000","last_clean":"2020-11-12T17:22:51.359230+0000","last_became_active":"2020-11-12T17:22:51.355473+0000","last_became_peered":"2020-11-12T17:22:51.355473+0000","last_unstale":"2020-11-12T17:22:51.359230+0000","last_undegraded":"2020-11-12T17:22:51.359230+0000","last_fullsized":"2020-11-12T17:22:51.359230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.723187+0000","last_change":"2020-11-12T17:22:51.722504+0000","last_active":"2020-11-12T17:22:51.723187+0000","last_peered":"2020-11-12T17:22:51.723187+0000","last_clean":"2020-11-12T17:22:51.723187+0000","last_became_active":"2020-11-12T17:22:51.721744+0000","last_became_peered":"2020-11-12T17:22:51.721744+0000","last_unstale":"2020-11-12T17:22:51.723187+0000","last_undegraded":"2020-11-12T17:22:51.723187+0000","last_fullsized":"2020-11-12T17:22:51.723187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":53410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3180000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2389999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8130000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.98}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6619999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":51306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0019999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.327}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4540000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6110000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.891}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7970000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":49689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.383}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4660000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4369999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5779999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":53988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0830000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9039999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9810000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0219999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1890000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0670000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":50728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4089999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8610000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":53410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9339999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2850000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0030000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6720000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7370000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":53988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.569}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.722}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.948}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0550000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":51621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.476}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6110000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.577}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5339999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6539999999999999}]}]}]}} 2020-11-12T17:23:00.019 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:23:00.300 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:23:00.302 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:23:00.312 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2020-11-12T17:22:59.536168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8389884,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584836,"statfs":{"total":773094113280,"available":764502872064,"internally_reserved":8589934592,"allocated":1241088,"data_stored":418140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.171497"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359399+0000","last_change":"2020-11-12T17:22:51.355071+0000","last_active":"2020-11-12T17:22:51.359399+0000","last_peered":"2020-11-12T17:22:51.359399+0000","last_clean":"2020-11-12T17:22:51.359399+0000","last_became_active":"2020-11-12T17:22:51.354607+0000","last_became_peered":"2020-11-12T17:22:51.354607+0000","last_unstale":"2020-11-12T17:22:51.359399+0000","last_undegraded":"2020-11-12T17:22:51.359399+0000","last_fullsized":"2020-11-12T17:22:51.359399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.355877+0000","last_change":"2020-11-12T17:22:51.353439+0000","last_active":"2020-11-12T17:22:51.355877+0000","last_peered":"2020-11-12T17:22:51.355877+0000","last_clean":"2020-11-12T17:22:51.355877+0000","last_became_active":"2020-11-12T17:22:51.352991+0000","last_became_peered":"2020-11-12T17:22:51.352991+0000","last_unstale":"2020-11-12T17:22:51.355877+0000","last_undegraded":"2020-11-12T17:22:51.355877+0000","last_fullsized":"2020-11-12T17:22:51.355877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.729692+0000","last_change":"2020-11-12T17:22:51.723934+0000","last_active":"2020-11-12T17:22:51.729692+0000","last_peered":"2020-11-12T17:22:51.729692+0000","last_clean":"2020-11-12T17:22:51.729692+0000","last_became_active":"2020-11-12T17:22:51.723115+0000","last_became_peered":"2020-11-12T17:22:51.723115+0000","last_unstale":"2020-11-12T17:22:51.729692+0000","last_undegraded":"2020-11-12T17:22:51.729692+0000","last_fullsized":"2020-11-12T17:22:51.729692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359527+0000","last_change":"2020-11-12T17:22:51.356607+0000","last_active":"2020-11-12T17:22:51.359527+0000","last_peered":"2020-11-12T17:22:51.359527+0000","last_clean":"2020-11-12T17:22:51.359527+0000","last_became_active":"2020-11-12T17:22:51.356123+0000","last_became_peered":"2020-11-12T17:22:51.356123+0000","last_unstale":"2020-11-12T17:22:51.359527+0000","last_undegraded":"2020-11-12T17:22:51.359527+0000","last_fullsized":"2020-11-12T17:22:51.359527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.348824+0000","last_change":"2020-11-12T17:22:47.070011+0000","last_active":"2020-11-12T17:22:51.348824+0000","last_peered":"2020-11-12T17:22:51.348824+0000","last_clean":"2020-11-12T17:22:51.348824+0000","last_became_active":"2020-11-12T17:22:47.069110+0000","last_became_peered":"2020-11-12T17:22:47.069110+0000","last_unstale":"2020-11-12T17:22:51.348824+0000","last_undegraded":"2020-11-12T17:22:51.348824+0000","last_fullsized":"2020-11-12T17:22:51.348824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:22:42.530591+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.361973+0000","last_change":"2020-11-12T17:22:51.356716+0000","last_active":"2020-11-12T17:22:51.361973+0000","last_peered":"2020-11-12T17:22:51.361973+0000","last_clean":"2020-11-12T17:22:51.361973+0000","last_became_active":"2020-11-12T17:22:51.356165+0000","last_became_peered":"2020-11-12T17:22:51.356165+0000","last_unstale":"2020-11-12T17:22:51.361973+0000","last_undegraded":"2020-11-12T17:22:51.361973+0000","last_fullsized":"2020-11-12T17:22:51.361973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:52.054468+0000","last_change":"2020-11-12T17:22:52.053549+0000","last_active":"2020-11-12T17:22:52.054468+0000","last_peered":"2020-11-12T17:22:52.054468+0000","last_clean":"2020-11-12T17:22:52.054468+0000","last_became_active":"2020-11-12T17:22:52.052882+0000","last_became_peered":"2020-11-12T17:22:52.052882+0000","last_unstale":"2020-11-12T17:22:52.054468+0000","last_undegraded":"2020-11-12T17:22:52.054468+0000","last_fullsized":"2020-11-12T17:22:52.054468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.359230+0000","last_change":"2020-11-12T17:22:51.356083+0000","last_active":"2020-11-12T17:22:51.359230+0000","last_peered":"2020-11-12T17:22:51.359230+0000","last_clean":"2020-11-12T17:22:51.359230+0000","last_became_active":"2020-11-12T17:22:51.355473+0000","last_became_peered":"2020-11-12T17:22:51.355473+0000","last_unstale":"2020-11-12T17:22:51.359230+0000","last_undegraded":"2020-11-12T17:22:51.359230+0000","last_fullsized":"2020-11-12T17:22:51.359230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-11-12T17:22:51.723187+0000","last_change":"2020-11-12T17:22:51.722504+0000","last_active":"2020-11-12T17:22:51.723187+0000","last_peered":"2020-11-12T17:22:51.723187+0000","last_clean":"2020-11-12T17:22:51.723187+0000","last_became_active":"2020-11-12T17:22:51.721744+0000","last_became_peered":"2020-11-12T17:22:51.721744+0000","last_unstale":"2020-11-12T17:22:51.723187+0000","last_undegraded":"2020-11-12T17:22:51.723187+0000","last_fullsized":"2020-11-12T17:22:51.723187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":53410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3180000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2389999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8130000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.98}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6619999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":51306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0019999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.327}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4540000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6110000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.891}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7970000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":49689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.383}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4660000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4369999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5779999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":53988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0830000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9039999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9810000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0219999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1890000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0670000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":50728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4089999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.855}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8610000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":53410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9339999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2850000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0030000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6720000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7370000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":53988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.569}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.722}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2879999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.948}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0550000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048736,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323104,"statfs":{"total":96636764160,"available":95562858496,"internally_reserved":1073741824,"allocated":155648,"data_stored":51621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.476}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6110000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.577}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5339999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6539999999999999}]}]}]}} 2020-11-12T17:23:00.314 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-12T17:23:00.315 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump 2020-11-12T17:23:00.591 INFO:teuthology.orchestra.run.smithi036.stdout:epoch 19 2020-11-12T17:23:00.593 INFO:teuthology.orchestra.run.smithi036.stdout:fsid 8c8a6bcc-49d4-47d1-904f-e20798ef8e1f 2020-11-12T17:23:00.593 INFO:teuthology.orchestra.run.smithi036.stdout:created 2020-11-12T17:22:37.581394+0000 2020-11-12T17:23:00.594 INFO:teuthology.orchestra.run.smithi036.stdout:modified 2020-11-12T17:22:52.354048+0000 2020-11-12T17:23:00.594 INFO:teuthology.orchestra.run.smithi036.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2020-11-12T17:23:00.594 INFO:teuthology.orchestra.run.smithi036.stdout:crush_version 4 2020-11-12T17:23:00.595 INFO:teuthology.orchestra.run.smithi036.stdout:full_ratio 0.95 2020-11-12T17:23:00.595 INFO:teuthology.orchestra.run.smithi036.stdout:backfillfull_ratio 0.9 2020-11-12T17:23:00.595 INFO:teuthology.orchestra.run.smithi036.stdout:nearfull_ratio 0.85 2020-11-12T17:23:00.596 INFO:teuthology.orchestra.run.smithi036.stdout:require_min_compat_client jewel 2020-11-12T17:23:00.596 INFO:teuthology.orchestra.run.smithi036.stdout:min_compat_client jewel 2020-11-12T17:23:00.596 INFO:teuthology.orchestra.run.smithi036.stdout:require_osd_release octopus 2020-11-12T17:23:00.596 INFO:teuthology.orchestra.run.smithi036.stdout:pool 1 'device_health_metrics' replicated size 2 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_min 1 application mgr_devicehealth 2020-11-12T17:23:00.597 INFO:teuthology.orchestra.run.smithi036.stdout:pool 2 'rbd' replicated size 2 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 application rbd 2020-11-12T17:23:00.597 INFO:teuthology.orchestra.run.smithi036.stdout:max_osd 8 2020-11-12T17:23:00.597 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.36:6801/12304 v1:172.21.15.36:6802/12304 exists,up bd1d5457-5d54-4074-b378-9da417f42976 2020-11-12T17:23:00.598 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.36:6812/12307 v1:172.21.15.36:6814/12307 exists,up 37152eee-a8d8-40f1-8e27-2899e7b94c98 2020-11-12T17:23:00.598 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.36:6803/12306 v1:172.21.15.36:6805/12306 exists,up d8ec2abb-38bf-4863-969a-482c4fa44f41 2020-11-12T17:23:00.598 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.36:6809/12305 v1:172.21.15.36:6810/12305 exists,up 799d3499-577c-4510-a00c-9b2e126fc449 2020-11-12T17:23:00.599 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.205:6804/12499 v1:172.21.15.205:6805/12499 exists,up c36e3100-aadc-4117-b495-24fb08a34148 2020-11-12T17:23:00.599 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.205:6808/12525 v1:172.21.15.205:6810/12525 exists,up b152141f-b530-448e-8dff-fe200559eff0 2020-11-12T17:23:00.599 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.205:6809/12524 v1:172.21.15.205:6811/12524 exists,up 62a140ba-7f94-4bb6-8a62-fda077f81354 2020-11-12T17:23:00.599 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.205:6800/12522 v1:172.21.15.205:6801/12522 exists,up 32879bd7-780c-4da6-9838-5850b6277902 2020-11-12T17:23:00.613 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.36:6801/12304 v1:172.21.15.36:6802/12304 exists,up bd1d5457-5d54-4074-b378-9da417f42976', 'osd.1 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.36:6812/12307 v1:172.21.15.36:6814/12307 exists,up 37152eee-a8d8-40f1-8e27-2899e7b94c98', 'osd.2 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.36:6803/12306 v1:172.21.15.36:6805/12306 exists,up d8ec2abb-38bf-4863-969a-482c4fa44f41', 'osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.36:6809/12305 v1:172.21.15.36:6810/12305 exists,up 799d3499-577c-4510-a00c-9b2e126fc449', 'osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) v1:172.21.15.205:6804/12499 v1:172.21.15.205:6805/12499 exists,up c36e3100-aadc-4117-b495-24fb08a34148', 'osd.5 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.205:6808/12525 v1:172.21.15.205:6810/12525 exists,up b152141f-b530-448e-8dff-fe200559eff0', 'osd.6 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.205:6809/12524 v1:172.21.15.205:6811/12524 exists,up 62a140ba-7f94-4bb6-8a62-fda077f81354', 'osd.7 up in weight 1 up_from 14 up_thru 17 down_at 0 last_clean_interval [0,0) v1:172.21.15.205:6800/12522 v1:172.21.15.205:6801/12522 exists,up 32879bd7-780c-4da6-9838-5850b6277902'] 2020-11-12T17:23:00.615 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2020-11-12T17:23:00.724 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:00.725 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "mon.a", 2020-11-12T17:23:00.725 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster": "ceph", 2020-11-12T17:23:00.725 INFO:teuthology.orchestra.run.smithi036.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2020-11-12T17:23:00.725 INFO:teuthology.orchestra.run.smithi036.stdout: "admin_socket_mode": "", 2020-11-12T17:23:00.726 INFO:teuthology.orchestra.run.smithi036.stdout: "allow_ansi": "Terminal", 2020-11-12T17:23:00.726 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_client_required": "cephx, none", 2020-11-12T17:23:00.726 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_cluster_required": "cephx", 2020-11-12T17:23:00.726 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_debug": "true", 2020-11-12T17:23:00.726 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_mon_ticket_ttl": "43200.000000", 2020-11-12T17:23:00.726 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_service_required": "cephx", 2020-11-12T17:23:00.726 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_service_ticket_ttl": "3600.000000", 2020-11-12T17:23:00.727 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_supported": "cephx", 2020-11-12T17:23:00.727 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_aio": "true", 2020-11-12T17:23:00.727 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_aio_max_queue_depth": "1024", 2020-11-12T17:23:00.727 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_aio_poll_ms": "250", 2020-11-12T17:23:00.727 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_aio_reap_max": "16", 2020-11-12T17:23:00.727 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_async_discard": "false", 2020-11-12T17:23:00.727 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_block_size": "4096", 2020-11-12T17:23:00.728 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_debug_aio": "false", 2020-11-12T17:23:00.728 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_debug_aio_log_age": "5.000000", 2020-11-12T17:23:00.728 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2020-11-12T17:23:00.728 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_debug_inflight_ios": "false", 2020-11-12T17:23:00.728 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_enable_discard": "false", 2020-11-12T17:23:00.728 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_inject_crash": "0", 2020-11-12T17:23:00.728 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_inject_crash_flush_delay": "2", 2020-11-12T17:23:00.728 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_nvme_retry_count": "-1", 2020-11-12T17:23:00.729 INFO:teuthology.orchestra.run.smithi036.stdout: "bdev_nvme_unbind_from_kernel": "false", 2020-11-12T17:23:00.729 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_alloc_size": "1048576", 2020-11-12T17:23:00.729 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_allocator": "hybrid", 2020-11-12T17:23:00.729 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_buffered_io": "false", 2020-11-12T17:23:00.729 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_compact_log_sync": "false", 2020-11-12T17:23:00.729 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2020-11-12T17:23:00.729 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_log_compact_min_size": "16777216", 2020-11-12T17:23:00.730 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_log_replay_check_allocations": "true", 2020-11-12T17:23:00.730 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_max_log_runway": "4194304", 2020-11-12T17:23:00.730 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_max_prefetch": "1048576", 2020-11-12T17:23:00.730 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_min_flush_size": "524288", 2020-11-12T17:23:00.730 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_min_log_runway": "1048576", 2020-11-12T17:23:00.730 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_replay_recovery": "false", 2020-11-12T17:23:00.730 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_replay_recovery_disable_compact": "false", 2020-11-12T17:23:00.731 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_shared_alloc_size": "65536", 2020-11-12T17:23:00.731 INFO:teuthology.orchestra.run.smithi036.stdout: "bluefs_sync_write": "false", 2020-11-12T17:23:00.731 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2020-11-12T17:23:00.731 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2020-11-12T17:23:00.731 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2020-11-12T17:23:00.731 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_allocator": "hybrid", 2020-11-12T17:23:00.731 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2020-11-12T17:23:00.731 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2020-11-12T17:23:00.732 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2020-11-12T17:23:00.732 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bitmapallocator_span_size": "1024", 2020-11-12T17:23:00.732 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_blobid_prealloc": "10240", 2020-11-12T17:23:00.732 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_create": "true", 2020-11-12T17:23:00.732 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_db_create": "false", 2020-11-12T17:23:00.732 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_db_path": "", 2020-11-12T17:23:00.732 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_db_size": "0", 2020-11-12T17:23:00.732 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_path": "", 2020-11-12T17:23:00.733 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_preallocate_file": "false", 2020-11-12T17:23:00.733 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_size": "107374182400", 2020-11-12T17:23:00.733 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_wal_create": "false", 2020-11-12T17:23:00.733 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_wal_path": "", 2020-11-12T17:23:00.733 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_block_wal_size": "100663296", 2020-11-12T17:23:00.733 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs": "true", 2020-11-12T17:23:00.733 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2020-11-12T17:23:00.734 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_balance_interval": "1.000000", 2020-11-12T17:23:00.734 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_db_compatibility": "true", 2020-11-12T17:23:00.734 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_env_mirror": "false", 2020-11-12T17:23:00.734 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_gift_ratio": "0.020000", 2020-11-12T17:23:00.734 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_max_free": "10737418240", 2020-11-12T17:23:00.734 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_max_ratio": "0.900000", 2020-11-12T17:23:00.734 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_min": "1073741824", 2020-11-12T17:23:00.734 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_min_free": "1073741824", 2020-11-12T17:23:00.735 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_min_ratio": "0.020000", 2020-11-12T17:23:00.735 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_bluefs_reclaim_ratio": "0.200000", 2020-11-12T17:23:00.735 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_autotune": "true", 2020-11-12T17:23:00.735 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_autotune_interval": "5.000000", 2020-11-12T17:23:00.735 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_kv_ratio": "0.400000", 2020-11-12T17:23:00.735 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_meta_ratio": "0.400000", 2020-11-12T17:23:00.735 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_size": "0", 2020-11-12T17:23:00.736 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_size_hdd": "1073741824", 2020-11-12T17:23:00.736 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_size_ssd": "3221225472", 2020-11-12T17:23:00.736 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_trim_interval": "0.050000", 2020-11-12T17:23:00.736 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_trim_max_skip_pinned": "64", 2020-11-12T17:23:00.736 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_cache_type": "2q", 2020-11-12T17:23:00.736 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_clone_cow": "true", 2020-11-12T17:23:00.736 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_compression_algorithm": "snappy", 2020-11-12T17:23:00.736 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_compression_max_blob_size": "0", 2020-11-12T17:23:00.737 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_compression_max_blob_size_hdd": "524288", 2020-11-12T17:23:00.737 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2020-11-12T17:23:00.737 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_compression_min_blob_size": "0", 2020-11-12T17:23:00.737 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_compression_min_blob_size_hdd": "131072", 2020-11-12T17:23:00.737 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_compression_min_blob_size_ssd": "8192", 2020-11-12T17:23:00.737 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_compression_mode": "none", 2020-11-12T17:23:00.737 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_compression_required_ratio": "0.875000", 2020-11-12T17:23:00.737 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_csum_type": "crc32c", 2020-11-12T17:23:00.738 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_enforce_settings": "default", 2020-11-12T17:23:00.738 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_freelist": "false", 2020-11-12T17:23:00.738 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_fsck_abort": "false", 2020-11-12T17:23:00.738 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_inject_bug21040": "false", 2020-11-12T17:23:00.738 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2020-11-12T17:23:00.738 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_inject_read_err": "false", 2020-11-12T17:23:00.738 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_misc": "false", 2020-11-12T17:23:00.739 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_no_reuse_blocks": "false", 2020-11-12T17:23:00.739 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_omit_block_device_write": "false", 2020-11-12T17:23:00.739 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_omit_kv_commit": "false", 2020-11-12T17:23:00.739 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2020-11-12T17:23:00.739 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_prefill": "0.000000", 2020-11-12T17:23:00.739 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_prefragment_max": "1048576", 2020-11-12T17:23:00.739 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_random_read_err": "0.000000", 2020-11-12T17:23:00.739 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2020-11-12T17:23:00.740 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_small_allocations": "0", 2020-11-12T17:23:00.740 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2020-11-12T17:23:00.740 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_default_buffered_read": "true", 2020-11-12T17:23:00.740 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_default_buffered_write": "false", 2020-11-12T17:23:00.740 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_deferred_batch_ops": "0", 2020-11-12T17:23:00.740 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2020-11-12T17:23:00.740 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2020-11-12T17:23:00.740 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2020-11-12T17:23:00.741 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_extent_map_shard_max_size": "1200", 2020-11-12T17:23:00.741 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_extent_map_shard_min_size": "150", 2020-11-12T17:23:00.741 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_extent_map_shard_target_size": "500", 2020-11-12T17:23:00.741 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2020-11-12T17:23:00.741 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_freelist_blocks_per_key": "128", 2020-11-12T17:23:00.741 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2020-11-12T17:23:00.741 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2020-11-12T17:23:00.742 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_on_mkfs": "true", 2020-11-12T17:23:00.742 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2020-11-12T17:23:00.742 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_on_mount": "false", 2020-11-12T17:23:00.742 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_on_mount_deep": "false", 2020-11-12T17:23:00.742 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_on_umount": "false", 2020-11-12T17:23:00.742 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_on_umount_deep": "false", 2020-11-12T17:23:00.742 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_quick_fix_on_mount": "true", 2020-11-12T17:23:00.742 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_quick_fix_threads": "2", 2020-11-12T17:23:00.743 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2020-11-12T17:23:00.743 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_gc_enable_blob_threshold": "0", 2020-11-12T17:23:00.743 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_gc_enable_total_threshold": "0", 2020-11-12T17:23:00.743 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2020-11-12T17:23:00.743 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_ignore_data_csum": "false", 2020-11-12T17:23:00.743 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_ioring": "false", 2020-11-12T17:23:00.743 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_kvbackend": "rocksdb", 2020-11-12T17:23:00.744 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_log_collection_list_age": "60.000000", 2020-11-12T17:23:00.744 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2020-11-12T17:23:00.744 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_log_op_age": "5.000000", 2020-11-12T17:23:00.744 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_max_alloc_size": "0", 2020-11-12T17:23:00.744 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_max_blob_size": "0", 2020-11-12T17:23:00.744 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_max_blob_size_hdd": "524288", 2020-11-12T17:23:00.744 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_max_blob_size_ssd": "65536", 2020-11-12T17:23:00.744 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_max_defer_interval": "3.000000", 2020-11-12T17:23:00.745 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_max_deferred_txc": "32", 2020-11-12T17:23:00.745 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_min_alloc_size": "0", 2020-11-12T17:23:00.745 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_min_alloc_size_hdd": "65536", 2020-11-12T17:23:00.745 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_min_alloc_size_ssd": "4096", 2020-11-12T17:23:00.745 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_nid_prealloc": "1024", 2020-11-12T17:23:00.745 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_prefer_deferred_size": "0", 2020-11-12T17:23:00.745 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_prefer_deferred_size_hdd": "32768", 2020-11-12T17:23:00.745 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2020-11-12T17:23:00.746 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_retry_disk_reads": "3", 2020-11-12T17:23:00.746 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_rocksdb_cf": "false", 2020-11-12T17:23:00.746 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_rocksdb_cfs": "M= P= L=", 2020-11-12T17:23:00.746 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2", 2020-11-12T17:23:00.746 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_spdk_coremask": "0x1", 2020-11-12T17:23:00.746 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_spdk_io_sleep": "5", 2020-11-12T17:23:00.746 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_spdk_max_io_completion": "0", 2020-11-12T17:23:00.747 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_spdk_mem": "512", 2020-11-12T17:23:00.747 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_sync_submit_transaction": "false", 2020-11-12T17:23:00.747 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_throttle_bytes": "67108864", 2020-11-12T17:23:00.747 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_throttle_cost_per_io": "0", 2020-11-12T17:23:00.747 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2020-11-12T17:23:00.747 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2020-11-12T17:23:00.747 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2020-11-12T17:23:00.747 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_throttle_trace_rate": "0.000000", 2020-11-12T17:23:00.748 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_tracing": "false", 2020-11-12T17:23:00.748 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2020-11-12T17:23:00.748 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_volume_selection_reserved": "0", 2020-11-12T17:23:00.748 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2020-11-12T17:23:00.748 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2020-11-12T17:23:00.748 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_warn_on_legacy_statfs": "true", 2020-11-12T17:23:00.748 INFO:teuthology.orchestra.run.smithi036.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2020-11-12T17:23:00.748 INFO:teuthology.orchestra.run.smithi036.stdout: "cephadm_path": "/usr/sbin/cephadm", 2020-11-12T17:23:00.749 INFO:teuthology.orchestra.run.smithi036.stdout: "cephx_cluster_require_signatures": "false", 2020-11-12T17:23:00.749 INFO:teuthology.orchestra.run.smithi036.stdout: "cephx_cluster_require_version": "1", 2020-11-12T17:23:00.749 INFO:teuthology.orchestra.run.smithi036.stdout: "cephx_require_signatures": "false", 2020-11-12T17:23:00.749 INFO:teuthology.orchestra.run.smithi036.stdout: "cephx_require_version": "1", 2020-11-12T17:23:00.749 INFO:teuthology.orchestra.run.smithi036.stdout: "cephx_service_require_signatures": "false", 2020-11-12T17:23:00.749 INFO:teuthology.orchestra.run.smithi036.stdout: "cephx_service_require_version": "1", 2020-11-12T17:23:00.749 INFO:teuthology.orchestra.run.smithi036.stdout: "cephx_sign_messages": "true", 2020-11-12T17:23:00.750 INFO:teuthology.orchestra.run.smithi036.stdout: "chdir": "", 2020-11-12T17:23:00.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_acl_type": "", 2020-11-12T17:23:00.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_cache_mid": "0.750000", 2020-11-12T17:23:00.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_cache_size": "16384", 2020-11-12T17:23:00.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_caps_release_delay": "5", 2020-11-12T17:23:00.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_check_pool_perm": "true", 2020-11-12T17:23:00.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_debug_force_sync_read": "false", 2020-11-12T17:23:00.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_debug_getattr_caps": "false", 2020-11-12T17:23:00.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_debug_inject_tick_delay": "0", 2020-11-12T17:23:00.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_die_on_failed_dentry_invalidate": "true", 2020-11-12T17:23:00.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_die_on_failed_remount": "false", 2020-11-12T17:23:00.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_dirsize_rbytes": "true", 2020-11-12T17:23:00.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_force_lazyio": "false", 2020-11-12T17:23:00.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_fs": "", 2020-11-12T17:23:00.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_inject_fixed_oldest_tid": "false", 2020-11-12T17:23:00.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_inject_release_failure": "false", 2020-11-12T17:23:00.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_max_inline_size": "4096", 2020-11-12T17:23:00.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_mds_namespace": "", 2020-11-12T17:23:00.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_metadata": "", 2020-11-12T17:23:00.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_mount_gid": "-1", 2020-11-12T17:23:00.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_mount_timeout": "300.000000", 2020-11-12T17:23:00.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_mount_uid": "-1", 2020-11-12T17:23:00.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_mountpoint": "/", 2020-11-12T17:23:00.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_notify_timeout": "10", 2020-11-12T17:23:00.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_oc": "true", 2020-11-12T17:23:00.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_oc_max_dirty": "104857600", 2020-11-12T17:23:00.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_oc_max_dirty_age": "5.000000", 2020-11-12T17:23:00.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_oc_max_objects": "1000", 2020-11-12T17:23:00.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_oc_size": "209715200", 2020-11-12T17:23:00.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_oc_target_dirty": "8388608", 2020-11-12T17:23:00.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_permissions": "true", 2020-11-12T17:23:00.754 INFO:teuthology.orchestra.run.smithi036.stdout: "client_quota_df": "true", 2020-11-12T17:23:00.754 INFO:teuthology.orchestra.run.smithi036.stdout: "client_readahead_max_bytes": "0", 2020-11-12T17:23:00.754 INFO:teuthology.orchestra.run.smithi036.stdout: "client_readahead_max_periods": "4", 2020-11-12T17:23:00.754 INFO:teuthology.orchestra.run.smithi036.stdout: "client_readahead_min": "131072", 2020-11-12T17:23:00.754 INFO:teuthology.orchestra.run.smithi036.stdout: "client_reconnect_stale": "false", 2020-11-12T17:23:00.754 INFO:teuthology.orchestra.run.smithi036.stdout: "client_shutdown_timeout": "30", 2020-11-12T17:23:00.754 INFO:teuthology.orchestra.run.smithi036.stdout: "client_snapdir": ".snap", 2020-11-12T17:23:00.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client_tick_interval": "1.000000", 2020-11-12T17:23:00.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client_trace": "", 2020-11-12T17:23:00.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client_try_dentry_invalidate": "false", 2020-11-12T17:23:00.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client_use_faked_inos": "false", 2020-11-12T17:23:00.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client_use_random_mds": "false", 2020-11-12T17:23:00.755 INFO:teuthology.orchestra.run.smithi036.stdout: "clog_to_graylog": "false", 2020-11-12T17:23:00.755 INFO:teuthology.orchestra.run.smithi036.stdout: "clog_to_graylog_host": "127.0.0.1", 2020-11-12T17:23:00.756 INFO:teuthology.orchestra.run.smithi036.stdout: "clog_to_graylog_port": "12201", 2020-11-12T17:23:00.756 INFO:teuthology.orchestra.run.smithi036.stdout: "clog_to_monitors": "default=true", 2020-11-12T17:23:00.756 INFO:teuthology.orchestra.run.smithi036.stdout: "clog_to_syslog": "false", 2020-11-12T17:23:00.756 INFO:teuthology.orchestra.run.smithi036.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2020-11-12T17:23:00.756 INFO:teuthology.orchestra.run.smithi036.stdout: "clog_to_syslog_level": "info", 2020-11-12T17:23:00.756 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "-", 2020-11-12T17:23:00.756 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_network": "", 2020-11-12T17:23:00.756 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_network_interface": "", 2020-11-12T17:23:00.757 INFO:teuthology.orchestra.run.smithi036.stdout: "colors": "Terminal", 2020-11-12T17:23:00.757 INFO:teuthology.orchestra.run.smithi036.stdout: "compressor_zlib_isal": "false", 2020-11-12T17:23:00.757 INFO:teuthology.orchestra.run.smithi036.stdout: "compressor_zlib_level": "5", 2020-11-12T17:23:00.757 INFO:teuthology.orchestra.run.smithi036.stdout: "compressor_zstd_level": "1", 2020-11-12T17:23:00.757 INFO:teuthology.orchestra.run.smithi036.stdout: "container_image": "docker.io/ceph/ceph:v15", 2020-11-12T17:23:00.757 INFO:teuthology.orchestra.run.smithi036.stdout: "continuation_prompt": ">", 2020-11-12T17:23:00.757 INFO:teuthology.orchestra.run.smithi036.stdout: "crash_dir": "/var/lib/ceph/crash", 2020-11-12T17:23:00.757 INFO:teuthology.orchestra.run.smithi036.stdout: "crimson_osd_obc_lru_size": "10", 2020-11-12T17:23:00.758 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_location": "", 2020-11-12T17:23:00.758 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_location_hook": "", 2020-11-12T17:23:00.758 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_location_hook_timeout": "10", 2020-11-12T17:23:00.758 INFO:teuthology.orchestra.run.smithi036.stdout: "daemonize": "false", 2020-11-12T17:23:00.758 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_allow_any_pool_priority": "false", 2020-11-12T17:23:00.758 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_asok": "1/5", 2020-11-12T17:23:00.758 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_asok_assert_abort": "false", 2020-11-12T17:23:00.759 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_asserts_on_shutdown": "true", 2020-11-12T17:23:00.759 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_auth": "20/20", 2020-11-12T17:23:00.759 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_bdev": "1/3", 2020-11-12T17:23:00.759 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_bluefs": "1/5", 2020-11-12T17:23:00.759 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_bluestore": "1/5", 2020-11-12T17:23:00.759 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_buffer": "0/1", 2020-11-12T17:23:00.759 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_civetweb": "1/10", 2020-11-12T17:23:00.759 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_client": "0/5", 2020-11-12T17:23:00.760 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_compressor": "1/5", 2020-11-12T17:23:00.760 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_context": "0/1", 2020-11-12T17:23:00.760 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_crush": "1/1", 2020-11-12T17:23:00.760 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_crypto": "1/5", 2020-11-12T17:23:00.760 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_deliberately_leak_memory": "false", 2020-11-12T17:23:00.760 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_disable_randomized_ping": "false", 2020-11-12T17:23:00.760 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_dpdk": "1/5", 2020-11-12T17:23:00.760 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_eventtrace": "1/5", 2020-11-12T17:23:00.761 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_filer": "0/1", 2020-11-12T17:23:00.761 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_filestore": "1/3", 2020-11-12T17:23:00.761 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_finisher": "1/1", 2020-11-12T17:23:00.761 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_fuse": "1/5", 2020-11-12T17:23:00.761 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_heartbeat_testing_span": "0", 2020-11-12T17:23:00.761 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_heartbeatmap": "1/5", 2020-11-12T17:23:00.761 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_immutable_obj_cache": "0/5", 2020-11-12T17:23:00.762 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_javaclient": "1/5", 2020-11-12T17:23:00.762 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_journal": "1/3", 2020-11-12T17:23:00.762 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_journaler": "0/5", 2020-11-12T17:23:00.762 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_kstore": "1/5", 2020-11-12T17:23:00.762 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_leveldb": "4/5", 2020-11-12T17:23:00.762 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_lockdep": "0/1", 2020-11-12T17:23:00.762 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_mds": "1/5", 2020-11-12T17:23:00.762 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_mds_balancer": "1/5", 2020-11-12T17:23:00.763 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_mds_locker": "1/5", 2020-11-12T17:23:00.763 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_mds_log": "1/5", 2020-11-12T17:23:00.763 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_mds_log_expire": "1/5", 2020-11-12T17:23:00.763 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_mds_migrator": "1/5", 2020-11-12T17:23:00.763 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_memdb": "4/5", 2020-11-12T17:23:00.763 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_mgr": "1/5", 2020-11-12T17:23:00.763 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_mgrc": "1/5", 2020-11-12T17:23:00.763 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_mon": "20/20", 2020-11-12T17:23:00.764 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_monc": "0/10", 2020-11-12T17:23:00.764 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_ms": "1/1", 2020-11-12T17:23:00.764 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_none": "0/5", 2020-11-12T17:23:00.764 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_objclass": "0/5", 2020-11-12T17:23:00.764 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_objectcacher": "0/5", 2020-11-12T17:23:00.764 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_objecter": "0/1", 2020-11-12T17:23:00.764 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_optracker": "0/5", 2020-11-12T17:23:00.765 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_osd": "1/5", 2020-11-12T17:23:00.765 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_paxos": "20/20", 2020-11-12T17:23:00.765 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_perfcounter": "1/5", 2020-11-12T17:23:00.765 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_prioritycache": "1/5", 2020-11-12T17:23:00.765 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_rados": "0/5", 2020-11-12T17:23:00.765 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_rbd": "0/5", 2020-11-12T17:23:00.765 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_rbd_mirror": "0/5", 2020-11-12T17:23:00.766 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_rbd_replay": "0/5", 2020-11-12T17:23:00.766 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_rbd_rwl": "0/5", 2020-11-12T17:23:00.766 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_refs": "0/0", 2020-11-12T17:23:00.766 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_reserver": "1/1", 2020-11-12T17:23:00.766 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_rgw": "1/5", 2020-11-12T17:23:00.766 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_rgw_sync": "1/5", 2020-11-12T17:23:00.766 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_rocksdb": "4/5", 2020-11-12T17:23:00.767 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_shell": "false", 2020-11-12T17:23:00.767 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_striper": "0/1", 2020-11-12T17:23:00.767 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_test": "0/5", 2020-11-12T17:23:00.767 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_throttle": "1/1", 2020-11-12T17:23:00.767 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_timer": "0/1", 2020-11-12T17:23:00.767 INFO:teuthology.orchestra.run.smithi036.stdout: "debug_tp": "0/5", 2020-11-12T17:23:00.767 INFO:teuthology.orchestra.run.smithi036.stdout: "device_failure_prediction_mode": "none", 2020-11-12T17:23:00.767 INFO:teuthology.orchestra.run.smithi036.stdout: "echo": "false", 2020-11-12T17:23:00.768 INFO:teuthology.orchestra.run.smithi036.stdout: "editor": "vim", 2020-11-12T17:23:00.768 INFO:teuthology.orchestra.run.smithi036.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2020-11-12T17:23:00.768 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2020-11-12T17:23:00.768 INFO:teuthology.orchestra.run.smithi036.stdout: "err_to_graylog": "false", 2020-11-12T17:23:00.768 INFO:teuthology.orchestra.run.smithi036.stdout: "err_to_stderr": "true", 2020-11-12T17:23:00.768 INFO:teuthology.orchestra.run.smithi036.stdout: "err_to_syslog": "false", 2020-11-12T17:23:00.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event_tracing": "false", 2020-11-12T17:23:00.768 INFO:teuthology.orchestra.run.smithi036.stdout: "fake_statfs_for_testing": "0", 2020-11-12T17:23:00.769 INFO:teuthology.orchestra.run.smithi036.stdout: "fatal_signal_handlers": "true", 2020-11-12T17:23:00.769 INFO:teuthology.orchestra.run.smithi036.stdout: "feedback_to_output": "false", 2020-11-12T17:23:00.769 INFO:teuthology.orchestra.run.smithi036.stdout: "filer_max_purge_ops": "10", 2020-11-12T17:23:00.769 INFO:teuthology.orchestra.run.smithi036.stdout: "filer_max_truncate_ops": "128", 2020-11-12T17:23:00.769 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_apply_finisher_threads": "1", 2020-11-12T17:23:00.769 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_blackhole": "false", 2020-11-12T17:23:00.769 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_btrfs_clone_range": "true", 2020-11-12T17:23:00.770 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_btrfs_snap": "true", 2020-11-12T17:23:00.770 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_caller_concurrency": "10", 2020-11-12T17:23:00.770 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_collect_device_partition_information": "true", 2020-11-12T17:23:00.770 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_commit_timeout": "600.000000", 2020-11-12T17:23:00.770 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_debug_inject_read_err": "false", 2020-11-12T17:23:00.770 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_debug_omap_check": "false", 2020-11-12T17:23:00.770 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_debug_random_read_err": "0.000000", 2020-11-12T17:23:00.771 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_debug_verify_split": "false", 2020-11-12T17:23:00.771 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_dump_file": "", 2020-11-12T17:23:00.771 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2020-11-12T17:23:00.771 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_expected_throughput_ops": "200.000000", 2020-11-12T17:23:00.771 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_fadvise": "true", 2020-11-12T17:23:00.771 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_fail_eio": "true", 2020-11-12T17:23:00.771 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_fd_cache_shards": "16", 2020-11-12T17:23:00.772 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_fd_cache_size": "128", 2020-11-12T17:23:00.772 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_fiemap": "false", 2020-11-12T17:23:00.772 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_fiemap_threshold": "4096", 2020-11-12T17:23:00.772 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_fsync_flushes_journal_data": "false", 2020-11-12T17:23:00.772 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_index_retry_probability": "0.000000", 2020-11-12T17:23:00.772 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_inject_stall": "0", 2020-11-12T17:23:00.772 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_journal_parallel": "false", 2020-11-12T17:23:00.772 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_journal_trailing": "false", 2020-11-12T17:23:00.773 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_journal_writeahead": "false", 2020-11-12T17:23:00.773 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_kill_at": "0", 2020-11-12T17:23:00.773 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_alloc_hint_size": "1048576", 2020-11-12T17:23:00.773 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_inline_xattr_size": "0", 2020-11-12T17:23:00.773 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2020-11-12T17:23:00.773 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_inline_xattr_size_other": "512", 2020-11-12T17:23:00.773 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2020-11-12T17:23:00.773 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_inline_xattrs": "0", 2020-11-12T17:23:00.774 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2020-11-12T17:23:00.774 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_inline_xattrs_other": "2", 2020-11-12T17:23:00.774 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_inline_xattrs_xfs": "10", 2020-11-12T17:23:00.774 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_sync_interval": "5.000000", 2020-11-12T17:23:00.774 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_xattr_value_size": "0", 2020-11-12T17:23:00.774 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2020-11-12T17:23:00.774 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_xattr_value_size_other": "1024", 2020-11-12T17:23:00.775 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2020-11-12T17:23:00.775 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_merge_threshold": "-10", 2020-11-12T17:23:00.775 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_min_sync_interval": "0.010000", 2020-11-12T17:23:00.775 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_odsync_write": "false", 2020-11-12T17:23:00.775 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_omap_backend": "rocksdb", 2020-11-12T17:23:00.775 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_omap_backend_path": "", 2020-11-12T17:23:00.775 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_omap_header_cache_size": "1024", 2020-11-12T17:23:00.776 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_ondisk_finisher_threads": "1", 2020-11-12T17:23:00.776 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_op_thread_suicide_timeout": "180", 2020-11-12T17:23:00.776 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_op_thread_timeout": "60", 2020-11-12T17:23:00.776 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_op_threads": "2", 2020-11-12T17:23:00.776 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_punch_hole": "false", 2020-11-12T17:23:00.776 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2020-11-12T17:23:00.776 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2020-11-12T17:23:00.776 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2020-11-12T17:23:00.777 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_high_threshhold": "0.900000", 2020-11-12T17:23:00.777 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_low_threshhold": "0.300000", 2020-11-12T17:23:00.777 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_max_bytes": "104857600", 2020-11-12T17:23:00.777 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2020-11-12T17:23:00.777 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2020-11-12T17:23:00.777 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2020-11-12T17:23:00.777 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_queue_max_ops": "50", 2020-11-12T17:23:00.778 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2020-11-12T17:23:00.778 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_seek_data_hole": "false", 2020-11-12T17:23:00.778 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_sloppy_crc": "false", 2020-11-12T17:23:00.778 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_sloppy_crc_block_size": "65536", 2020-11-12T17:23:00.778 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_splice": "false", 2020-11-12T17:23:00.778 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_split_multiple": "2", 2020-11-12T17:23:00.778 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_split_rand_factor": "20", 2020-11-12T17:23:00.779 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_update_to": "1000", 2020-11-12T17:23:00.779 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2020-11-12T17:23:00.779 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2020-11-12T17:23:00.779 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2020-11-12T17:23:00.779 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2020-11-12T17:23:00.779 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2020-11-12T17:23:00.779 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2020-11-12T17:23:00.779 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_enable": "true", 2020-11-12T17:23:00.780 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2020-11-12T17:23:00.780 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2020-11-12T17:23:00.780 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2020-11-12T17:23:00.780 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2020-11-12T17:23:00.780 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2020-11-12T17:23:00.780 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2020-11-12T17:23:00.780 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_xfs_extsize": "false", 2020-11-12T17:23:00.780 INFO:teuthology.orchestra.run.smithi036.stdout: "filestore_zfs_snap": "false", 2020-11-12T17:23:00.781 INFO:teuthology.orchestra.run.smithi036.stdout: "fio_dir": "/tmp/fio", 2020-11-12T17:23:00.781 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:23:00.781 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_allow_other": "true", 2020-11-12T17:23:00.781 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_atomic_o_trunc": "true", 2020-11-12T17:23:00.781 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_big_writes": "true", 2020-11-12T17:23:00.781 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_debug": "false", 2020-11-12T17:23:00.781 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_default_permissions": "false", 2020-11-12T17:23:00.782 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_disable_pagecache": "false", 2020-11-12T17:23:00.782 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_max_write": "0", 2020-11-12T17:23:00.782 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_multithreaded": "true", 2020-11-12T17:23:00.782 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_require_active_mds": "true", 2020-11-12T17:23:00.782 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_set_user_groups": "true", 2020-11-12T17:23:00.782 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_syncfs_on_mksnap": "true", 2020-11-12T17:23:00.782 INFO:teuthology.orchestra.run.smithi036.stdout: "fuse_use_invalidate_cb": "true", 2020-11-12T17:23:00.782 INFO:teuthology.orchestra.run.smithi036.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2020-11-12T17:23:00.783 INFO:teuthology.orchestra.run.smithi036.stdout: "gss_target_name": "ceph", 2020-11-12T17:23:00.783 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_file": "", 2020-11-12T17:23:00.783 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_inject_failure": "0", 2020-11-12T17:23:00.783 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_interval": "5", 2020-11-12T17:23:00.783 INFO:teuthology.orchestra.run.smithi036.stdout: "host": "", 2020-11-12T17:23:00.783 INFO:teuthology.orchestra.run.smithi036.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2020-11-12T17:23:00.783 INFO:teuthology.orchestra.run.smithi036.stdout: "immutable_object_cache_max_inflight_ops": "128", 2020-11-12T17:23:00.783 INFO:teuthology.orchestra.run.smithi036.stdout: "immutable_object_cache_max_size": "1073741824", 2020-11-12T17:23:00.784 INFO:teuthology.orchestra.run.smithi036.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2020-11-12T17:23:00.784 INFO:teuthology.orchestra.run.smithi036.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2020-11-12T17:23:00.784 INFO:teuthology.orchestra.run.smithi036.stdout: "immutable_object_cache_watermark": "0.100000", 2020-11-12T17:23:00.784 INFO:teuthology.orchestra.run.smithi036.stdout: "inject_early_sigterm": "false", 2020-11-12T17:23:00.784 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_aio": "true", 2020-11-12T17:23:00.784 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_align_min_size": "65536", 2020-11-12T17:23:00.784 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_block_align": "true", 2020-11-12T17:23:00.785 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_block_size": "4096", 2020-11-12T17:23:00.785 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_dio": "true", 2020-11-12T17:23:00.785 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_discard": "false", 2020-11-12T17:23:00.785 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_force_aio": "false", 2020-11-12T17:23:00.785 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_ignore_corruption": "false", 2020-11-12T17:23:00.785 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_max_write_bytes": "10485760", 2020-11-12T17:23:00.785 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_max_write_entries": "100", 2020-11-12T17:23:00.785 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_replay_from": "0", 2020-11-12T17:23:00.786 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_throttle_high_multiple": "0.000000", 2020-11-12T17:23:00.786 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_throttle_high_threshhold": "0.900000", 2020-11-12T17:23:00.786 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_throttle_low_threshhold": "0.600000", 2020-11-12T17:23:00.786 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_throttle_max_multiple": "0.000000", 2020-11-12T17:23:00.786 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_write_header_frequency": "0", 2020-11-12T17:23:00.786 INFO:teuthology.orchestra.run.smithi036.stdout: "journal_zero_on_create": "false", 2020-11-12T17:23:00.799 INFO:teuthology.orchestra.run.smithi036.stdout: "journaler_prefetch_periods": "10", 2020-11-12T17:23:00.800 INFO:teuthology.orchestra.run.smithi036.stdout: "journaler_prezero_periods": "5", 2020-11-12T17:23:00.800 INFO:teuthology.orchestra.run.smithi036.stdout: "journaler_write_head_interval": "15", 2020-11-12T17:23:00.800 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "", 2020-11-12T17:23:00.800 INFO:teuthology.orchestra.run.smithi036.stdout: "keyfile": "", 2020-11-12T17:23:00.800 INFO:teuthology.orchestra.run.smithi036.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2020-11-12T17:23:00.800 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_backend": "rocksdb", 2020-11-12T17:23:00.800 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_default_stripe_size": "65536", 2020-11-12T17:23:00.801 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_fsck_on_mount": "false", 2020-11-12T17:23:00.801 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_fsck_on_mount_deep": "true", 2020-11-12T17:23:00.801 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_max_bytes": "67108864", 2020-11-12T17:23:00.801 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_max_ops": "512", 2020-11-12T17:23:00.801 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_nid_prealloc": "1024", 2020-11-12T17:23:00.801 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_onode_map_size": "1024", 2020-11-12T17:23:00.801 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2020-11-12T17:23:00.802 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_sync_submit_transaction": "false", 2020-11-12T17:23:00.802 INFO:teuthology.orchestra.run.smithi036.stdout: "kstore_sync_transaction": "false", 2020-11-12T17:23:00.802 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_block_size": "65536", 2020-11-12T17:23:00.802 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_bloom_size": "0", 2020-11-12T17:23:00.802 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_cache_size": "536870912", 2020-11-12T17:23:00.802 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_compact_on_mount": "false", 2020-11-12T17:23:00.802 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_compression": "false", 2020-11-12T17:23:00.803 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_log": "", 2020-11-12T17:23:00.803 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_log_to_ceph_log": "true", 2020-11-12T17:23:00.803 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_max_open_files": "0", 2020-11-12T17:23:00.803 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_paranoid": "false", 2020-11-12T17:23:00.803 INFO:teuthology.orchestra.run.smithi036.stdout: "leveldb_write_buffer_size": "33554432", 2020-11-12T17:23:00.803 INFO:teuthology.orchestra.run.smithi036.stdout: "lockdep": "false", 2020-11-12T17:23:00.803 INFO:teuthology.orchestra.run.smithi036.stdout: "lockdep_force_backtrace": "false", 2020-11-12T17:23:00.804 INFO:teuthology.orchestra.run.smithi036.stdout: "log_coarse_timestamps": "true", 2020-11-12T17:23:00.804 INFO:teuthology.orchestra.run.smithi036.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2020-11-12T17:23:00.804 INFO:teuthology.orchestra.run.smithi036.stdout: "log_flush_on_exit": "false", 2020-11-12T17:23:00.804 INFO:teuthology.orchestra.run.smithi036.stdout: "log_graylog_host": "127.0.0.1", 2020-11-12T17:23:00.804 INFO:teuthology.orchestra.run.smithi036.stdout: "log_graylog_port": "12201", 2020-11-12T17:23:00.804 INFO:teuthology.orchestra.run.smithi036.stdout: "log_max_new": "1000", 2020-11-12T17:23:00.804 INFO:teuthology.orchestra.run.smithi036.stdout: "log_max_recent": "10000", 2020-11-12T17:23:00.805 INFO:teuthology.orchestra.run.smithi036.stdout: "log_stderr_prefix": "", 2020-11-12T17:23:00.805 INFO:teuthology.orchestra.run.smithi036.stdout: "log_stop_at_utilization": "0.970000", 2020-11-12T17:23:00.805 INFO:teuthology.orchestra.run.smithi036.stdout: "log_to_file": "true", 2020-11-12T17:23:00.805 INFO:teuthology.orchestra.run.smithi036.stdout: "log_to_graylog": "false", 2020-11-12T17:23:00.805 INFO:teuthology.orchestra.run.smithi036.stdout: "log_to_stderr": "false", 2020-11-12T17:23:00.805 INFO:teuthology.orchestra.run.smithi036.stdout: "log_to_syslog": "false", 2020-11-12T17:23:00.805 INFO:teuthology.orchestra.run.smithi036.stdout: "max_completion_items": "50", 2020-11-12T17:23:00.805 INFO:teuthology.orchestra.run.smithi036.stdout: "max_rotating_auth_attempts": "10", 2020-11-12T17:23:00.806 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_action_on_write_error": "1", 2020-11-12T17:23:00.806 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_export_pin": "true", 2020-11-12T17:23:00.806 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_fragment_dirs": "true", 2020-11-12T17:23:00.806 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2020-11-12T17:23:00.806 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_fragment_interval": "5", 2020-11-12T17:23:00.806 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_fragment_size_max": "100000", 2020-11-12T17:23:00.806 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_idle_threshold": "0.000000", 2020-11-12T17:23:00.807 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_interval": "10", 2020-11-12T17:23:00.807 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_max": "-1", 2020-11-12T17:23:00.807 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_max_until": "-1", 2020-11-12T17:23:00.807 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_merge_size": "50", 2020-11-12T17:23:00.807 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_midchunk": "0.300000", 2020-11-12T17:23:00.807 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_min_rebalance": "0.100000", 2020-11-12T17:23:00.807 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_min_start": "0.200000", 2020-11-12T17:23:00.808 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_minchunk": "0.001000", 2020-11-12T17:23:00.808 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_mode": "0", 2020-11-12T17:23:00.808 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_need_max": "1.200000", 2020-11-12T17:23:00.808 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_need_min": "0.800000", 2020-11-12T17:23:00.808 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_replicate_threshold": "8000.000000", 2020-11-12T17:23:00.808 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_sample_interval": "3.000000", 2020-11-12T17:23:00.808 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_split_bits": "3", 2020-11-12T17:23:00.809 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_split_rd": "25000.000000", 2020-11-12T17:23:00.809 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_split_size": "10000", 2020-11-12T17:23:00.809 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_split_wr": "10000.000000", 2020-11-12T17:23:00.809 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_target_decay": "10.000000", 2020-11-12T17:23:00.809 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2020-11-12T17:23:00.809 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_beacon_grace": "15.000000", 2020-11-12T17:23:00.809 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_beacon_interval": "4.000000", 2020-11-12T17:23:00.810 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_cache_memory_limit": "4294967296", 2020-11-12T17:23:00.810 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_cache_mid": "0.700000", 2020-11-12T17:23:00.810 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_cache_release_free_interval": "10", 2020-11-12T17:23:00.810 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_cache_reservation": "0.050000", 2020-11-12T17:23:00.810 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_cache_trim_decay_rate": "1.000000", 2020-11-12T17:23:00.810 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_cache_trim_interval": "1", 2020-11-12T17:23:00.810 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_cache_trim_threshold": "65536", 2020-11-12T17:23:00.811 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2020-11-12T17:23:00.811 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_client_delegate_inos_pct": "50", 2020-11-12T17:23:00.811 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_client_prealloc_inos": "1000", 2020-11-12T17:23:00.811 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2020-11-12T17:23:00.811 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_damage_table_max_entries": "10000", 2020-11-12T17:23:00.811 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2020-11-12T17:23:00.811 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_debug_auth_pins": "false", 2020-11-12T17:23:00.812 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_debug_frag": "false", 2020-11-12T17:23:00.812 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_debug_scatterstat": "false", 2020-11-12T17:23:00.812 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_debug_subtrees": "false", 2020-11-12T17:23:00.812 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_decay_halflife": "5.000000", 2020-11-12T17:23:00.812 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_default_dir_hash": "2", 2020-11-12T17:23:00.812 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_defer_session_stale": "true", 2020-11-12T17:23:00.812 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_dir_keys_per_op": "16384", 2020-11-12T17:23:00.813 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_dir_max_commit_size": "10", 2020-11-12T17:23:00.813 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_dirstat_min_interval": "1.000000", 2020-11-12T17:23:00.813 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_dump_cache_after_rejoin": "false", 2020-11-12T17:23:00.813 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_dump_cache_on_map": "false", 2020-11-12T17:23:00.813 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_dump_cache_threshold_file": "0", 2020-11-12T17:23:00.813 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2020-11-12T17:23:00.813 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_early_reply": "true", 2020-11-12T17:23:00.814 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_enable_op_tracker": "true", 2020-11-12T17:23:00.814 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_enforce_unique_name": "true", 2020-11-12T17:23:00.814 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_export_ephemeral_distributed": "false", 2020-11-12T17:23:00.814 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_export_ephemeral_random": "false", 2020-11-12T17:23:00.814 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_export_ephemeral_random_max": "0.010000", 2020-11-12T17:23:00.814 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_forward_all_requests_to_auth": "false", 2020-11-12T17:23:00.814 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_freeze_tree_timeout": "30.000000", 2020-11-12T17:23:00.815 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2020-11-12T17:23:00.815 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_health_cache_threshold": "1.500000", 2020-11-12T17:23:00.815 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_health_summarize_threshold": "10", 2020-11-12T17:23:00.815 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_heartbeat_grace": "15.000000", 2020-11-12T17:23:00.815 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_inject_migrator_session_race": "false", 2020-11-12T17:23:00.815 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2020-11-12T17:23:00.815 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_join_fs": "", 2020-11-12T17:23:00.816 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_journal_format": "1", 2020-11-12T17:23:00.816 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_create_at": "0", 2020-11-12T17:23:00.816 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_export_at": "0", 2020-11-12T17:23:00.816 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_import_at": "0", 2020-11-12T17:23:00.816 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_journal_at": "0", 2020-11-12T17:23:00.816 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_journal_expire_at": "0", 2020-11-12T17:23:00.816 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_journal_replay_at": "0", 2020-11-12T17:23:00.817 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_link_at": "0", 2020-11-12T17:23:00.817 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_mdstable_at": "0", 2020-11-12T17:23:00.817 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_openc_at": "0", 2020-11-12T17:23:00.817 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_kill_rename_at": "0", 2020-11-12T17:23:00.817 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_log_events_per_segment": "1024", 2020-11-12T17:23:00.817 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_log_max_events": "-1", 2020-11-12T17:23:00.817 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_log_max_segments": "128", 2020-11-12T17:23:00.818 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_log_pause": "false", 2020-11-12T17:23:00.818 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_log_segment_size": "0", 2020-11-12T17:23:00.818 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_log_skip_corrupt_events": "false", 2020-11-12T17:23:00.818 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_log_warn_factor": "2.000000", 2020-11-12T17:23:00.818 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_caps_per_client": "1048576", 2020-11-12T17:23:00.818 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_completed_flushes": "100000", 2020-11-12T17:23:00.818 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_completed_requests": "100000", 2020-11-12T17:23:00.818 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_export_size": "20971520", 2020-11-12T17:23:00.819 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_file_recover": "32", 2020-11-12T17:23:00.819 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_purge_files": "64", 2020-11-12T17:23:00.819 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_purge_ops": "8192", 2020-11-12T17:23:00.819 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2020-11-12T17:23:00.819 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_retries_on_remount_failure": "5", 2020-11-12T17:23:00.819 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_scrub_ops_in_progress": "5", 2020-11-12T17:23:00.819 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_snaps_per_dir": "100", 2020-11-12T17:23:00.820 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_max_xattr_pairs_size": "65536", 2020-11-12T17:23:00.820 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_min_caps_per_client": "100", 2020-11-12T17:23:00.820 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_min_caps_working_set": "10000", 2020-11-12T17:23:00.820 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_mon_shutdown_timeout": "5.000000", 2020-11-12T17:23:00.820 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_numa_node": "-1", 2020-11-12T17:23:00.820 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_oft_prefetch_dirfrags": "true", 2020-11-12T17:23:00.820 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_op_complaint_time": "30.000000", 2020-11-12T17:23:00.821 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_op_history_duration": "600", 2020-11-12T17:23:00.821 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_op_history_size": "20", 2020-11-12T17:23:00.821 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_op_log_threshold": "5", 2020-11-12T17:23:00.821 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2020-11-12T17:23:00.821 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_recall_global_max_decay_threshold": "65536", 2020-11-12T17:23:00.821 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_recall_max_caps": "5000", 2020-11-12T17:23:00.821 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_recall_max_decay_rate": "2.500000", 2020-11-12T17:23:00.821 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_recall_max_decay_threshold": "16384", 2020-11-12T17:23:00.822 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_recall_warning_decay_rate": "60.000000", 2020-11-12T17:23:00.822 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_recall_warning_threshold": "32768", 2020-11-12T17:23:00.822 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_reconnect_timeout": "45.000000", 2020-11-12T17:23:00.822 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_replay_interval": "1.000000", 2020-11-12T17:23:00.822 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_replay_unsafe_with_closed_session": "false", 2020-11-12T17:23:00.822 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_request_load_average_decay_rate": "60.000000", 2020-11-12T17:23:00.822 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_root_ino_gid": "0", 2020-11-12T17:23:00.823 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_root_ino_uid": "0", 2020-11-12T17:23:00.823 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_scatter_nudge_interval": "5.000000", 2020-11-12T17:23:00.823 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_session_blacklist_on_evict": "true", 2020-11-12T17:23:00.823 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_session_blacklist_on_timeout": "true", 2020-11-12T17:23:00.823 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2020-11-12T17:23:00.823 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_session_cache_liveness_magnitude": "10", 2020-11-12T17:23:00.823 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_sessionmap_keys_per_op": "1024", 2020-11-12T17:23:00.823 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_shutdown_check": "0", 2020-11-12T17:23:00.824 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_skip_ino": "0", 2020-11-12T17:23:00.824 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_snap_max_uid": "4294967294", 2020-11-12T17:23:00.824 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_snap_min_uid": "0", 2020-11-12T17:23:00.824 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_snap_rstat": "false", 2020-11-12T17:23:00.824 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_task_status_update_interval": "2.000000", 2020-11-12T17:23:00.824 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_thrash_exports": "0", 2020-11-12T17:23:00.824 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_thrash_fragments": "0", 2020-11-12T17:23:00.824 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_tick_interval": "5.000000", 2020-11-12T17:23:00.825 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_verify_backtrace": "1", 2020-11-12T17:23:00.825 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_verify_scatter": "false", 2020-11-12T17:23:00.825 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_wipe_ino_prealloc": "false", 2020-11-12T17:23:00.825 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_wipe_sessions": "false", 2020-11-12T17:23:00.825 INFO:teuthology.orchestra.run.smithi036.stdout: "mempool_debug": "false", 2020-11-12T17:23:00.825 INFO:teuthology.orchestra.run.smithi036.stdout: "memstore_debug_omit_block_device_write": "false", 2020-11-12T17:23:00.825 INFO:teuthology.orchestra.run.smithi036.stdout: "memstore_device_bytes": "1073741824", 2020-11-12T17:23:00.826 INFO:teuthology.orchestra.run.smithi036.stdout: "memstore_page_set": "false", 2020-11-12T17:23:00.826 INFO:teuthology.orchestra.run.smithi036.stdout: "memstore_page_size": "65536", 2020-11-12T17:23:00.826 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_client_bytes": "134217728", 2020-11-12T17:23:00.826 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_client_messages": "512", 2020-11-12T17:23:00.826 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2020-11-12T17:23:00.826 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_connect_retry_interval": "1.000000", 2020-11-12T17:23:00.826 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2020-11-12T17:23:00.826 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2020-11-12T17:23:00.827 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_initial_modules": "restful iostat", 2020-11-12T17:23:00.827 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_mds_bytes": "134217728", 2020-11-12T17:23:00.827 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_mds_messages": "128", 2020-11-12T17:23:00.827 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2020-11-12T17:23:00.827 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_mon_bytes": "134217728", 2020-11-12T17:23:00.827 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_mon_messages": "128", 2020-11-12T17:23:00.827 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_osd_bytes": "536870912", 2020-11-12T17:23:00.827 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_osd_messages": "8192", 2020-11-12T17:23:00.828 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_service_beacon_grace": "60.000000", 2020-11-12T17:23:00.828 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_stats_period": "5", 2020-11-12T17:23:00.828 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_stats_threshold": "5", 2020-11-12T17:23:00.828 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_tick_period": "2", 2020-11-12T17:23:00.828 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_accept_timeout_factor": "2.000000", 2020-11-12T17:23:00.828 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_allow_pool_delete": "true", 2020-11-12T17:23:00.828 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2020-11-12T17:23:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2020-11-12T17:23:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_bytes": "104857600", 2020-11-12T17:23:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_directed_command_retry": "5", 2020-11-12T17:23:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_hunt_interval": "3.000000", 2020-11-12T17:23:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2020-11-12T17:23:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2020-11-12T17:23:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2020-11-12T17:23:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_hunt_parallel": "3", 2020-11-12T17:23:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_log_interval": "1.000000", 2020-11-12T17:23:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_max_log_entries_per_message": "1000", 2020-11-12T17:23:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_ping_interval": "10.000000", 2020-11-12T17:23:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_client_ping_timeout": "30.000000", 2020-11-12T17:23:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_clock_drift_allowed": "1.000000", 2020-11-12T17:23:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2020-11-12T17:23:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2020-11-12T17:23:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_file_level": "debug", 2020-11-12T17:23:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_to_file": "true", 2020-11-12T17:23:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_to_graylog": "false", 2020-11-12T17:23:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2020-11-12T17:23:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_to_graylog_port": "12201", 2020-11-12T17:23:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_to_stderr": "false", 2020-11-12T17:23:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_to_syslog": "default=false", 2020-11-12T17:23:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2020-11-12T17:23:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cluster_log_to_syslog_level": "info", 2020-11-12T17:23:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_compact_on_bootstrap": "false", 2020-11-12T17:23:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_compact_on_start": "false", 2020-11-12T17:23:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_compact_on_trim": "true", 2020-11-12T17:23:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_config_key_max_entry_size": "65536", 2020-11-12T17:23:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_cpu_threads": "4", 2020-11-12T17:23:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_crush_min_required_version": "hammer", 2020-11-12T17:23:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_daemon_bytes": "419430400", 2020-11-12T17:23:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2020-11-12T17:23:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_data_avail_crit": "5", 2020-11-12T17:23:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_data_avail_warn": "5", 2020-11-12T17:23:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_data_size_warn": "16106127360", 2020-11-12T17:23:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_block_osdmap_trim": "false", 2020-11-12T17:23:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_deprecated_as_obsolete": "false", 2020-11-12T17:23:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_dump_json": "false", 2020-11-12T17:23:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2020-11-12T17:23:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_dump_transactions": "false", 2020-11-12T17:23:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_extra_checks": "false", 2020-11-12T17:23:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_no_initial_persistent_features": "false", 2020-11-12T17:23:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2020-11-12T17:23:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_no_require_nautilus": "false", 2020-11-12T17:23:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_no_require_octopus": "false", 2020-11-12T17:23:00.835 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2020-11-12T17:23:00.835 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_delta_reset_interval": "10.000000", 2020-11-12T17:23:00.835 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_dns_srv_name": "ceph-mon", 2020-11-12T17:23:00.835 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_election_timeout": "5.000000", 2020-11-12T17:23:00.835 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_enable_op_tracker": "true", 2020-11-12T17:23:00.835 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_fake_pool_delete": "false", 2020-11-12T17:23:00.835 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_force_quorum_join": "false", 2020-11-12T17:23:00.836 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_globalid_prealloc": "10000", 2020-11-12T17:23:00.836 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_health_log_update_period": "5", 2020-11-12T17:23:00.836 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_health_max_detail": "50", 2020-11-12T17:23:00.836 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_health_to_clog": "true", 2020-11-12T17:23:00.836 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_health_to_clog_interval": "3600", 2020-11-12T17:23:00.836 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2020-11-12T17:23:00.836 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_host": "[v1:172.21.15.36:6789],[v1:172.21.15.36:6790],[v1:172.21.15.205:6789]", 2020-11-12T17:23:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_host_override": "", 2020-11-12T17:23:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_initial_members": "", 2020-11-12T17:23:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2020-11-12T17:23:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2020-11-12T17:23:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_inject_transaction_delay_max": "10.000000", 2020-11-12T17:23:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2020-11-12T17:23:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_keyvaluedb": "rocksdb", 2020-11-12T17:23:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_lease": "5.000000", 2020-11-12T17:23:00.838 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2020-11-12T17:23:00.838 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_lease_renew_interval_factor": "0.600000", 2020-11-12T17:23:00.838 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_log_max_summary": "50", 2020-11-12T17:23:00.838 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_max_log_entries_per_event": "4096", 2020-11-12T17:23:00.838 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_max_log_epochs": "500", 2020-11-12T17:23:00.838 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_max_mdsmap_epochs": "500", 2020-11-12T17:23:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_max_mgrmap_epochs": "500", 2020-11-12T17:23:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_max_osd": "10000", 2020-11-12T17:23:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_max_pg_per_osd": "10000", 2020-11-12T17:23:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_max_pool_pg_num": "65536", 2020-11-12T17:23:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_max_snap_prune_per_epoch": "100", 2020-11-12T17:23:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_mds_blacklist_interval": "86400.000000", 2020-11-12T17:23:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_mds_force_trim_to": "0", 2020-11-12T17:23:00.840 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_mds_skip_sanity": "false", 2020-11-12T17:23:00.840 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_memory_autotune": "true", 2020-11-12T17:23:00.840 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_memory_target": "2147483648", 2020-11-12T17:23:00.840 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_mgr_beacon_grace": "30", 2020-11-12T17:23:00.840 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_mgr_blacklist_interval": "86400.000000", 2020-11-12T17:23:00.840 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_mgr_digest_period": "5", 2020-11-12T17:23:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_mgr_inactive_grace": "60", 2020-11-12T17:23:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_mgr_mkfs_grace": "240", 2020-11-12T17:23:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2020-11-12T17:23:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_min_osdmap_epochs": "50", 2020-11-12T17:23:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_op_complaint_time": "30", 2020-11-12T17:23:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_op_history_duration": "600", 2020-11-12T17:23:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_op_history_size": "20", 2020-11-12T17:23:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_op_history_slow_op_size": "20", 2020-11-12T17:23:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_op_history_slow_op_threshold": "10", 2020-11-12T17:23:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_op_log_threshold": "5", 2020-11-12T17:23:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_adjust_down_out_interval": "true", 2020-11-12T17:23:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2020-11-12T17:23:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2020-11-12T17:23:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_auto_mark_in": "false", 2020-11-12T17:23:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_auto_mark_new_in": "true", 2020-11-12T17:23:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2020-11-12T17:23:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_blacklist_default_expire": "3600.000000", 2020-11-12T17:23:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_cache_size": "500", 2020-11-12T17:23:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_cache_size_min": "134217728", 2020-11-12T17:23:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_crush_smoke_test": "true", 2020-11-12T17:23:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_destroyed_out_interval": "600", 2020-11-12T17:23:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_down_out_interval": "600", 2020-11-12T17:23:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_down_out_subtree_limit": "rack", 2020-11-12T17:23:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2020-11-12T17:23:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_force_trim_to": "0", 2020-11-12T17:23:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_full_ratio": "0.950000", 2020-11-12T17:23:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_initial_require_min_compat_client": "jewel", 2020-11-12T17:23:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_laggy_halflife": "3600", 2020-11-12T17:23:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_laggy_max_interval": "300", 2020-11-12T17:23:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_laggy_weight": "0.300000", 2020-11-12T17:23:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2020-11-12T17:23:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_max_creating_pgs": "1024", 2020-11-12T17:23:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_max_initial_pgs": "1024", 2020-11-12T17:23:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_min_down_reporters": "2", 2020-11-12T17:23:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_min_in_ratio": "0.750000", 2020-11-12T17:23:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_min_up_ratio": "0.300000", 2020-11-12T17:23:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_nearfull_ratio": "0.850000", 2020-11-12T17:23:00.846 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_prime_pg_temp": "true", 2020-11-12T17:23:00.846 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2020-11-12T17:23:00.846 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2020-11-12T17:23:00.846 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_report_timeout": "900", 2020-11-12T17:23:00.846 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_reporter_subtree_level": "osd", 2020-11-12T17:23:00.846 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2020-11-12T17:23:00.846 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_warn_num_repaired": "10", 2020-11-12T17:23:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osd_warn_op_age": "32.000000", 2020-11-12T17:23:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osdmap_full_prune_enabled": "true", 2020-11-12T17:23:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osdmap_full_prune_interval": "2", 2020-11-12T17:23:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osdmap_full_prune_min": "15", 2020-11-12T17:23:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_osdmap_full_prune_txsize": "2", 2020-11-12T17:23:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2020-11-12T17:23:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_pg_stuck_threshold": "60", 2020-11-12T17:23:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2020-11-12T17:23:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_pg_warn_min_objects": "10000", 2020-11-12T17:23:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_pg_warn_min_per_osd": "0", 2020-11-12T17:23:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_pg_warn_min_pool_objects": "1000", 2020-11-12T17:23:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_pool_quota_crit_threshold": "0", 2020-11-12T17:23:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_pool_quota_warn_threshold": "0", 2020-11-12T17:23:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_probe_timeout": "2.000000", 2020-11-12T17:23:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_reweight_max_change": "0.050000", 2020-11-12T17:23:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_reweight_max_osds": "4", 2020-11-12T17:23:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_reweight_min_bytes_per_osd": "10", 2020-11-12T17:23:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_reweight_min_pgs_per_osd": "4", 2020-11-12T17:23:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2020-11-12T17:23:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2020-11-12T17:23:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2020-11-12T17:23:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_scrub_interval": "86400", 2020-11-12T17:23:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_scrub_max_keys": "100", 2020-11-12T17:23:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_scrub_timeout": "300", 2020-11-12T17:23:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_session_timeout": "300", 2020-11-12T17:23:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_smart_report_timeout": "5", 2020-11-12T17:23:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_stat_smooth_intervals": "6", 2020-11-12T17:23:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_subscribe_interval": "86400.000000", 2020-11-12T17:23:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_sync_debug": "false", 2020-11-12T17:23:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_sync_max_payload_keys": "2000", 2020-11-12T17:23:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_sync_max_payload_size": "1048576", 2020-11-12T17:23:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_sync_provider_kill_at": "0", 2020-11-12T17:23:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_sync_requester_kill_at": "0", 2020-11-12T17:23:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_sync_timeout": "60.000000", 2020-11-12T17:23:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_target_pg_per_osd": "100", 2020-11-12T17:23:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_tick_interval": "5", 2020-11-12T17:23:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_timecheck_interval": "300.000000", 2020-11-12T17:23:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_timecheck_skew_interval": "30.000000", 2020-11-12T17:23:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2020-11-12T17:23:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2020-11-12T17:23:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2020-11-12T17:23:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_misplaced": "false", 2020-11-12T17:23:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2020-11-12T17:23:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2020-11-12T17:23:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_pool_no_app": "true", 2020-11-12T17:23:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_pool_no_redundancy": "false", 2020-11-12T17:23:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2020-11-12T17:23:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2020-11-12T17:23:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2020-11-12T17:23:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_on_too_few_osds": "false", 2020-11-12T17:23:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2020-11-12T17:23:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2020-11-12T17:23:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "monmap": "", 2020-11-12T17:23:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_max_op_threads": "5", 2020-11-12T17:23:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_op_threads": "3", 2020-11-12T17:23:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_buffer_size": "131072", 2020-11-12T17:23:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_cm": "false", 2020-11-12T17:23:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_device_name": "", 2020-11-12T17:23:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_dscp": "96", 2020-11-12T17:23:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_enable_hugepage": "false", 2020-11-12T17:23:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_gid_idx": "0", 2020-11-12T17:23:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_local_gid": "", 2020-11-12T17:23:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_polling_us": "1000", 2020-11-12T17:23:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_port_num": "1", 2020-11-12T17:23:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_receive_buffers": "32768", 2020-11-12T17:23:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_receive_queue_len": "4096", 2020-11-12T17:23:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_roce_ver": "1", 2020-11-12T17:23:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_send_buffers": "1024", 2020-11-12T17:23:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_sl": "3", 2020-11-12T17:23:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_support_srq": "true", 2020-11-12T17:23:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_async_rdma_type": "ib", 2020-11-12T17:23:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_before_connect": "false", 2020-11-12T17:23:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_ipv4": "true", 2020-11-12T17:23:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_ipv6": "false", 2020-11-12T17:23:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_msgr1": "true", 2020-11-12T17:23:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_msgr2": "false", 2020-11-12T17:23:00.857 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_port_max": "7300", 2020-11-12T17:23:00.857 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_port_min": "6800", 2020-11-12T17:23:00.857 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_prefer_ipv4": "false", 2020-11-12T17:23:00.857 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_retry_count": "3", 2020-11-12T17:23:00.857 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_bind_retry_delay": "5", 2020-11-12T17:23:00.857 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_blackhole_client": "false", 2020-11-12T17:23:00.857 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_blackhole_mds": "false", 2020-11-12T17:23:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_blackhole_mgr": "false", 2020-11-12T17:23:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_blackhole_mon": "false", 2020-11-12T17:23:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_blackhole_osd": "false", 2020-11-12T17:23:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_client_mode": "crc secure", 2020-11-12T17:23:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_cluster_mode": "crc secure", 2020-11-12T17:23:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_cluster_type": "", 2020-11-12T17:23:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_connection_idle_timeout": "900", 2020-11-12T17:23:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_connection_ready_timeout": "10", 2020-11-12T17:23:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_crc_data": "true", 2020-11-12T17:23:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_crc_header": "true", 2020-11-12T17:23:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_die_on_bad_msg": "false", 2020-11-12T17:23:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_die_on_bug": "true", 2020-11-12T17:23:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_die_on_old_message": "true", 2020-11-12T17:23:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_die_on_skipped_message": "false", 2020-11-12T17:23:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_die_on_unhandled_msg": "false", 2020-11-12T17:23:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dispatch_throttle_bytes": "104857600", 2020-11-12T17:23:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_coremask": "0xF", 2020-11-12T17:23:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_debug_allow_loopback": "false", 2020-11-12T17:23:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2020-11-12T17:23:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_host_ipv4_addr": "", 2020-11-12T17:23:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_hugepages": "", 2020-11-12T17:23:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_hw_flow_control": "true", 2020-11-12T17:23:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2020-11-12T17:23:00.861 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_lro": "true", 2020-11-12T17:23:00.861 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_memory_channel": "4", 2020-11-12T17:23:00.861 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2020-11-12T17:23:00.861 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_pmd": "", 2020-11-12T17:23:00.861 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_port_id": "0", 2020-11-12T17:23:00.861 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2020-11-12T17:23:00.861 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dump_corrupt_message_level": "1", 2020-11-12T17:23:00.862 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_dump_on_send": "false", 2020-11-12T17:23:00.862 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_initial_backoff": "0.200000", 2020-11-12T17:23:00.862 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_inject_delay_max": "1.000000", 2020-11-12T17:23:00.862 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_inject_delay_msg_type": "", 2020-11-12T17:23:00.862 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_inject_delay_probability": "0.005000", 2020-11-12T17:23:00.862 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_inject_delay_type": "osd", 2020-11-12T17:23:00.939 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_inject_internal_delays": "0.002000", 2020-11-12T17:23:00.939 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_inject_socket_failures": "2500", 2020-11-12T17:23:00.939 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_learn_addr_from_peer": "true", 2020-11-12T17:23:00.940 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_max_accept_failures": "4", 2020-11-12T17:23:00.940 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_max_backoff": "15.000000", 2020-11-12T17:23:00.940 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_mon_client_mode": "secure crc", 2020-11-12T17:23:00.940 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_mon_cluster_mode": "secure crc", 2020-11-12T17:23:00.940 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_mon_service_mode": "secure crc", 2020-11-12T17:23:00.940 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2020-11-12T17:23:00.941 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_pq_min_cost": "65536", 2020-11-12T17:23:00.941 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_public_type": "", 2020-11-12T17:23:00.941 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_service_mode": "crc secure", 2020-11-12T17:23:00.941 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_tcp_listen_backlog": "512", 2020-11-12T17:23:00.941 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_tcp_nodelay": "true", 2020-11-12T17:23:00.941 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_tcp_prefetch_max_size": "4096", 2020-11-12T17:23:00.941 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_tcp_rcvbuf": "0", 2020-11-12T17:23:00.941 INFO:teuthology.orchestra.run.smithi036.stdout: "ms_type": "async", 2020-11-12T17:23:00.942 INFO:teuthology.orchestra.run.smithi036.stdout: "no_config_file": "false", 2020-11-12T17:23:00.942 INFO:teuthology.orchestra.run.smithi036.stdout: "objecter_completion_locks_per_session": "32", 2020-11-12T17:23:00.942 INFO:teuthology.orchestra.run.smithi036.stdout: "objecter_debug_inject_relock_delay": "false", 2020-11-12T17:23:00.942 INFO:teuthology.orchestra.run.smithi036.stdout: "objecter_inflight_op_bytes": "104857600", 2020-11-12T17:23:00.942 INFO:teuthology.orchestra.run.smithi036.stdout: "objecter_inflight_ops": "1024", 2020-11-12T17:23:00.942 INFO:teuthology.orchestra.run.smithi036.stdout: "objecter_inject_no_watch_ping": "false", 2020-11-12T17:23:00.943 INFO:teuthology.orchestra.run.smithi036.stdout: "objecter_retry_writes_after_first_reply": "false", 2020-11-12T17:23:00.943 INFO:teuthology.orchestra.run.smithi036.stdout: "objecter_tick_interval": "5.000000", 2020-11-12T17:23:00.943 INFO:teuthology.orchestra.run.smithi036.stdout: "objecter_timeout": "10.000000", 2020-11-12T17:23:00.943 INFO:teuthology.orchestra.run.smithi036.stdout: "objectstore_blackhole": "false", 2020-11-12T17:23:00.943 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_agent_delay_time": "5.000000", 2020-11-12T17:23:00.943 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_agent_hist_halflife": "1000", 2020-11-12T17:23:00.943 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_agent_max_low_ops": "2", 2020-11-12T17:23:00.943 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_agent_max_ops": "4", 2020-11-12T17:23:00.944 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_agent_min_evict_effort": "0.100000", 2020-11-12T17:23:00.944 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_agent_quantize_effort": "0.100000", 2020-11-12T17:23:00.944 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_agent_slop": "0.020000", 2020-11-12T17:23:00.944 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_allow_recovery_below_min_size": "true", 2020-11-12T17:23:00.944 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_async_recovery_min_cost": "100", 2020-11-12T17:23:00.944 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_auto_mark_unfound_lost": "false", 2020-11-12T17:23:00.944 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_backfill_retry_interval": "30.000000", 2020-11-12T17:23:00.944 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_backfill_scan_max": "512", 2020-11-12T17:23:00.945 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_backfill_scan_min": "64", 2020-11-12T17:23:00.945 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_backoff_on_degraded": "false", 2020-11-12T17:23:00.945 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_backoff_on_peering": "false", 2020-11-12T17:23:00.945 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_backoff_on_unfound": "true", 2020-11-12T17:23:00.945 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_beacon_report_interval": "300", 2020-11-12T17:23:00.945 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_bench_duration": "30", 2020-11-12T17:23:00.945 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_bench_large_size_max_throughput": "104857600", 2020-11-12T17:23:00.946 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_bench_max_block_size": "67108864", 2020-11-12T17:23:00.946 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_bench_small_size_max_iops": "100", 2020-11-12T17:23:00.946 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_blkin_trace_all": "false", 2020-11-12T17:23:00.946 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2020-11-12T17:23:00.946 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2020-11-12T17:23:00.946 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_check_for_log_corruption": "false", 2020-11-12T17:23:00.946 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_check_max_object_name_len_on_startup": "true", 2020-11-12T17:23:00.946 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", 2020-11-12T17:23:00.947 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2020-11-12T17:23:00.947 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas", 2020-11-12T17:23:00.947 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_class_update_on_start": "true", 2020-11-12T17:23:00.947 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_client_message_cap": "0", 2020-11-12T17:23:00.947 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_client_message_size_cap": "524288000", 2020-11-12T17:23:00.947 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_client_op_priority": "63", 2020-11-12T17:23:00.947 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_client_watch_timeout": "30", 2020-11-12T17:23:00.947 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_command_max_records": "256", 2020-11-12T17:23:00.948 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_command_thread_suicide_timeout": "900", 2020-11-12T17:23:00.948 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_command_thread_timeout": "600", 2020-11-12T17:23:00.948 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_copyfrom_max_chunk": "8388608", 2020-11-12T17:23:00.948 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_crush_chooseleaf_type": "0", 2020-11-12T17:23:00.948 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_crush_initial_weight": "-1.000000", 2020-11-12T17:23:00.948 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_crush_update_on_start": "true", 2020-11-12T17:23:00.948 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_crush_update_weight_set": "true", 2020-11-12T17:23:00.949 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2020-11-12T17:23:00.949 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2020-11-12T17:23:00.949 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2020-11-12T17:23:00.949 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_drop_ping_duration": "0", 2020-11-12T17:23:00.949 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_drop_ping_probability": "0.000000", 2020-11-12T17:23:00.949 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_feed_pullee": "-1", 2020-11-12T17:23:00.949 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_inject_copyfrom_error": "false", 2020-11-12T17:23:00.949 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2020-11-12T17:23:00.950 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2020-11-12T17:23:00.950 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_misdirected_ops": "false", 2020-11-12T17:23:00.950 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_no_acting_change": "false", 2020-11-12T17:23:00.950 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_no_purge_strays": "false", 2020-11-12T17:23:00.950 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_op_order": "false", 2020-11-12T17:23:00.950 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_pg_log_writeout": "false", 2020-11-12T17:23:00.950 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_pretend_recovery_active": "false", 2020-11-12T17:23:00.951 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_random_push_read_error": "0.000000", 2020-11-12T17:23:00.951 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2020-11-12T17:23:00.951 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_shutdown": "false", 2020-11-12T17:23:00.951 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2020-11-12T17:23:00.951 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2020-11-12T17:23:00.951 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_verify_cached_snaps": "false", 2020-11-12T17:23:00.951 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_verify_missing_on_start": "false", 2020-11-12T17:23:00.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_verify_snaps": "false", 2020-11-12T17:23:00.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_debug_verify_stray_on_activate": "false", 2020-11-12T17:23:00.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_deep_scrub_interval": "604800.000000", 2020-11-12T17:23:00.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_deep_scrub_keys": "1024", 2020-11-12T17:23:00.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2020-11-12T17:23:00.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2020-11-12T17:23:00.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2020-11-12T17:23:00.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_deep_scrub_stride": "524288", 2020-11-12T17:23:00.953 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2020-11-12T17:23:00.953 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_default_data_pool_replay_window": "5", 2020-11-12T17:23:00.953 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_default_notify_timeout": "30", 2020-11-12T17:23:00.953 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_delete_sleep": "0.000000", 2020-11-12T17:23:00.953 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_delete_sleep_hdd": "5.000000", 2020-11-12T17:23:00.953 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_delete_sleep_hybrid": "2.000000", 2020-11-12T17:23:00.953 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_delete_sleep_ssd": "0.000000", 2020-11-12T17:23:00.954 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_discard_disconnected_ops": "true", 2020-11-12T17:23:00.954 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_enable_op_tracker": "true", 2020-11-12T17:23:00.954 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_erasure_code_plugins": "jerasure lrc isa", 2020-11-12T17:23:00.954 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_failsafe_full_ratio": "0.970000", 2020-11-12T17:23:00.954 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_fast_fail_on_connection_refused": "true", 2020-11-12T17:23:00.954 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_fast_info": "true", 2020-11-12T17:23:00.954 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_fast_shutdown": "true", 2020-11-12T17:23:00.954 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_find_best_info_ignore_history_les": "false", 2020-11-12T17:23:00.955 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_force_auth_primary_missing_objects": "100", 2020-11-12T17:23:00.955 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2020-11-12T17:23:00.955 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_function_tracing": "false", 2020-11-12T17:23:00.955 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_heartbeat_grace": "20", 2020-11-12T17:23:00.955 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_heartbeat_interval": "6", 2020-11-12T17:23:00.955 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2020-11-12T17:23:00.955 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_heartbeat_min_peers": "10", 2020-11-12T17:23:00.955 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_heartbeat_min_size": "2000", 2020-11-12T17:23:00.956 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_heartbeat_stale": "600", 2020-11-12T17:23:00.956 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2020-11-12T17:23:00.956 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_hit_set_max_size": "100000", 2020-11-12T17:23:00.956 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_hit_set_min_size": "1000", 2020-11-12T17:23:00.956 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_hit_set_namespace": ".ceph-internal", 2020-11-12T17:23:00.956 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_ignore_stale_divergent_priors": "false", 2020-11-12T17:23:00.956 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2020-11-12T17:23:00.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_inject_failure_on_pg_removal": "false", 2020-11-12T17:23:00.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2020-11-12T17:23:00.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_journal_flush_on_shutdown": "true", 2020-11-12T17:23:00.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_journal_size": "5120", 2020-11-12T17:23:00.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_kill_backfill_at": "0", 2020-11-12T17:23:00.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_loop_before_reset_tphandle": "64", 2020-11-12T17:23:00.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_map_cache_size": "50", 2020-11-12T17:23:00.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_map_dedup": "true", 2020-11-12T17:23:00.958 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_map_message_max": "40", 2020-11-12T17:23:00.958 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_map_message_max_bytes": "10485760", 2020-11-12T17:23:00.958 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_map_share_max_epochs": "40", 2020-11-12T17:23:00.959 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_attr_name_len": "100", 2020-11-12T17:23:00.959 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_attr_size": "0", 2020-11-12T17:23:00.959 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_backfills": "1", 2020-11-12T17:23:00.959 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_markdown_count": "5", 2020-11-12T17:23:00.959 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_markdown_period": "600", 2020-11-12T17:23:00.959 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_object_name_len": "2048", 2020-11-12T17:23:00.959 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_object_namespace_len": "256", 2020-11-12T17:23:00.960 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_object_size": "134217728", 2020-11-12T17:23:00.960 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2020-11-12T17:23:00.960 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_omap_entries_per_request": "1024", 2020-11-12T17:23:00.960 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_pg_blocked_by": "16", 2020-11-12T17:23:00.960 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_pg_log_entries": "10000", 2020-11-12T17:23:00.960 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2020-11-12T17:23:00.960 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_pgls": "1024", 2020-11-12T17:23:00.960 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_push_cost": "8388608", 2020-11-12T17:23:00.961 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_push_objects": "10", 2020-11-12T17:23:00.961 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_scrubs": "1", 2020-11-12T17:23:00.961 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2020-11-12T17:23:00.961 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_trimming_pgs": "2", 2020-11-12T17:23:00.961 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_write_op_reply_len": "32", 2020-11-12T17:23:00.961 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_max_write_size": "90", 2020-11-12T17:23:00.961 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2020-11-12T17:23:00.961 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2020-11-12T17:23:00.962 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2020-11-12T17:23:00.962 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2020-11-12T17:23:00.962 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2020-11-12T17:23:00.962 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2020-11-12T17:23:00.962 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2020-11-12T17:23:00.962 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_client_lim": "999999", 2020-11-12T17:23:00.962 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_client_res": "1", 2020-11-12T17:23:00.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mclock_scheduler_client_wgt": "1", 2020-11-12T17:23:00.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_memory_base": "805306368", 2020-11-12T17:23:00.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_memory_cache_min": "134217728", 2020-11-12T17:23:00.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_memory_cache_resize_interval": "1.000000", 2020-11-12T17:23:00.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_memory_expected_fragmentation": "0.150000", 2020-11-12T17:23:00.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_memory_target": "4294967296", 2020-11-12T17:23:00.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2020-11-12T17:23:00.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_min_pg_log_entries": "250", 2020-11-12T17:23:00.964 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_min_recovery_priority": "0", 2020-11-12T17:23:00.964 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mon_ack_timeout": "30.000000", 2020-11-12T17:23:00.964 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mon_heartbeat_interval": "30", 2020-11-12T17:23:00.964 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2020-11-12T17:23:00.964 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mon_report_interval": "5", 2020-11-12T17:23:00.964 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mon_report_max_in_flight": "2", 2020-11-12T17:23:00.964 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_mon_shutdown_timeout": "5.000000", 2020-11-12T17:23:00.965 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_num_cache_shards": "32", 2020-11-12T17:23:00.965 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_num_op_tracker_shard": "32", 2020-11-12T17:23:00.965 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_numa_auto_affinity": "true", 2020-11-12T17:23:00.965 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_numa_node": "-1", 2020-11-12T17:23:00.965 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_numa_prefer_iface": "true", 2020-11-12T17:23:00.965 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_object_clean_region_max_num_intervals": "10", 2020-11-12T17:23:00.965 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_objecter_finishers": "1", 2020-11-12T17:23:00.965 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_objectstore": "bluestore", 2020-11-12T17:23:00.966 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_objectstore_fuse": "false", 2020-11-12T17:23:00.966 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_objectstore_tracing": "false", 2020-11-12T17:23:00.966 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_complaint_time": "30.000000", 2020-11-12T17:23:00.966 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_history_duration": "600", 2020-11-12T17:23:00.966 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_history_size": "20", 2020-11-12T17:23:00.966 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_history_slow_op_size": "20", 2020-11-12T17:23:00.966 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2020-11-12T17:23:00.967 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_log_threshold": "5", 2020-11-12T17:23:00.967 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_num_shards": "0", 2020-11-12T17:23:00.967 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_num_shards_hdd": "5", 2020-11-12T17:23:00.967 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_num_shards_ssd": "8", 2020-11-12T17:23:00.967 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_num_threads_per_shard": "0", 2020-11-12T17:23:00.967 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2020-11-12T17:23:00.967 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2020-11-12T17:23:00.967 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2020-11-12T17:23:00.968 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_pq_min_cost": "65536", 2020-11-12T17:23:00.968 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_queue": "wpq", 2020-11-12T17:23:00.968 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_queue_cut_off": "high", 2020-11-12T17:23:00.968 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_thread_suicide_timeout": "150", 2020-11-12T17:23:00.968 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_op_thread_timeout": "15", 2020-11-12T17:23:00.968 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_open_classes_on_start": "true", 2020-11-12T17:23:00.968 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_os_flags": "0", 2020-11-12T17:23:00.968 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_peering_op_priority": "255", 2020-11-12T17:23:00.969 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_delete_cost": "1048576", 2020-11-12T17:23:00.969 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_delete_priority": "5", 2020-11-12T17:23:00.969 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2020-11-12T17:23:00.969 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2020-11-12T17:23:00.969 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_log_dups_tracked": "3000", 2020-11-12T17:23:00.969 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_log_trim_max": "10000", 2020-11-12T17:23:00.969 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_log_trim_min": "100", 2020-11-12T17:23:00.969 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2020-11-12T17:23:00.970 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_object_context_cache_count": "64", 2020-11-12T17:23:00.970 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pg_stat_report_interval_max": "500", 2020-11-12T17:23:00.970 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2020-11-12T17:23:00.970 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_cache_min_evict_age": "0", 2020-11-12T17:23:00.970 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_cache_min_flush_age": "0", 2020-11-12T17:23:00.970 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2020-11-12T17:23:00.971 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2020-11-12T17:23:00.971 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2020-11-12T17:23:00.971 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_crush_rule": "-1", 2020-11-12T17:23:00.971 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_ec_fast_read": "false", 2020-11-12T17:23:00.971 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd", 2020-11-12T17:23:00.971 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_flag_hashpspool": "true", 2020-11-12T17:23:00.971 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_flag_nodelete": "false", 2020-11-12T17:23:00.972 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_flag_nopgchange": "false", 2020-11-12T17:23:00.972 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_flag_nosizechange": "false", 2020-11-12T17:23:00.972 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_flags": "0", 2020-11-12T17:23:00.972 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2020-11-12T17:23:00.972 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_min_size": "2", 2020-11-12T17:23:00.972 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2020-11-12T17:23:00.972 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_pg_num": "32", 2020-11-12T17:23:00.972 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_pgp_num": "0", 2020-11-12T17:23:00.973 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2020-11-12T17:23:00.973 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_size": "2", 2020-11-12T17:23:00.973 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_default_type": "replicated", 2020-11-12T17:23:00.973 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2020-11-12T17:23:00.973 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_pool_use_gmt_hitset": "true", 2020-11-12T17:23:00.973 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_push_per_object_cost": "1000", 2020-11-12T17:23:00.973 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_read_ec_check_for_errors": "false", 2020-11-12T17:23:00.973 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recover_clone_overlap": "true", 2020-11-12T17:23:00.974 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recover_clone_overlap_limit": "10", 2020-11-12T17:23:00.974 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_cost": "20971520", 2020-11-12T17:23:00.974 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_delay_start": "0.000000", 2020-11-12T17:23:00.974 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_max_active": "0", 2020-11-12T17:23:00.975 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_max_active_hdd": "3", 2020-11-12T17:23:00.975 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_max_active_ssd": "10", 2020-11-12T17:23:00.975 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_max_chunk": "8388608", 2020-11-12T17:23:00.975 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2020-11-12T17:23:00.975 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_max_single_start": "1", 2020-11-12T17:23:00.975 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_op_priority": "3", 2020-11-12T17:23:00.976 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_op_warn_multiple": "16", 2020-11-12T17:23:00.976 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_priority": "5", 2020-11-12T17:23:00.976 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_retry_interval": "30.000000", 2020-11-12T17:23:00.976 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_sleep": "0.000000", 2020-11-12T17:23:00.976 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_sleep_hdd": "0.100000", 2020-11-12T17:23:00.976 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2020-11-12T17:23:00.976 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_recovery_sleep_ssd": "0.000000", 2020-11-12T17:23:00.977 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_repair_during_recovery": "false", 2020-11-12T17:23:00.977 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_requested_scrub_priority": "120", 2020-11-12T17:23:00.977 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_rollback_to_cluster_snap": "", 2020-11-12T17:23:00.977 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_auto_repair": "false", 2020-11-12T17:23:00.977 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_auto_repair_num_errors": "5", 2020-11-12T17:23:00.977 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_backoff_ratio": "0.660000", 2020-11-12T17:23:00.977 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_begin_hour": "0", 2020-11-12T17:23:00.978 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_begin_week_day": "0", 2020-11-12T17:23:00.978 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_chunk_max": "25", 2020-11-12T17:23:00.978 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_chunk_min": "5", 2020-11-12T17:23:00.978 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_cost": "52428800", 2020-11-12T17:23:00.978 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_during_recovery": "false", 2020-11-12T17:23:00.978 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_end_hour": "24", 2020-11-12T17:23:00.979 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_end_week_day": "7", 2020-11-12T17:23:00.979 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_extended_sleep": "0.000000", 2020-11-12T17:23:00.979 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2020-11-12T17:23:00.979 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_invalid_stats": "true", 2020-11-12T17:23:00.979 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_load_threshold": "0.500000", 2020-11-12T17:23:00.979 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_max_interval": "604800.000000", 2020-11-12T17:23:00.979 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_max_preemptions": "5", 2020-11-12T17:23:00.979 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_min_interval": "86400.000000", 2020-11-12T17:23:00.980 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_priority": "5", 2020-11-12T17:23:00.980 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_scrub_sleep": "0.000000", 2020-11-12T17:23:00.980 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_shutdown_pgref_assert": "false", 2020-11-12T17:23:00.980 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_skip_data_digest": "false", 2020-11-12T17:23:00.980 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_smart_report_timeout": "5", 2020-11-12T17:23:00.980 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_snap_trim_cost": "1048576", 2020-11-12T17:23:00.980 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_snap_trim_priority": "5", 2020-11-12T17:23:00.980 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_snap_trim_sleep": "0.000000", 2020-11-12T17:23:00.981 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2020-11-12T17:23:00.981 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2020-11-12T17:23:00.981 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2020-11-12T17:23:00.981 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_stats_ack_timeout_decay": "0.900000", 2020-11-12T17:23:00.981 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_stats_ack_timeout_factor": "2.000000", 2020-11-12T17:23:00.981 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2020-11-12T17:23:00.981 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_target_transaction_size": "30", 2020-11-12T17:23:00.982 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_default_cache_hit_set_count": "4", 2020-11-12T17:23:00.982 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2020-11-12T17:23:00.982 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2020-11-12T17:23:00.982 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2020-11-12T17:23:00.982 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2020-11-12T17:23:00.982 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2020-11-12T17:23:00.982 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2020-11-12T17:23:00.982 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_default_cache_mode": "writeback", 2020-11-12T17:23:00.983 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2020-11-12T17:23:00.983 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tier_promote_max_objects_sec": "25", 2020-11-12T17:23:00.983 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_tracing": "false", 2020-11-12T17:23:00.983 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_use_stale_snap": "false", 2020-11-12T17:23:00.983 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2020-11-12T17:23:00.983 INFO:teuthology.orchestra.run.smithi036.stdout: "osdc_blkin_trace_all": "false", 2020-11-12T17:23:00.983 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_kill_at": "0", 2020-11-12T17:23:00.984 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_max_join_drift": "10", 2020-11-12T17:23:00.984 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_min": "500", 2020-11-12T17:23:00.984 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_min_wait": "0.050000", 2020-11-12T17:23:00.984 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_propose_interval": "1.000000", 2020-11-12T17:23:00.984 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_service_trim_max": "500", 2020-11-12T17:23:00.984 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_service_trim_min": "10", 2020-11-12T17:23:00.984 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_stash_full_interval": "25", 2020-11-12T17:23:00.985 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_trim_max": "500", 2020-11-12T17:23:00.985 INFO:teuthology.orchestra.run.smithi036.stdout: "paxos_trim_min": "250", 2020-11-12T17:23:00.985 INFO:teuthology.orchestra.run.smithi036.stdout: "perf": "true", 2020-11-12T17:23:00.985 INFO:teuthology.orchestra.run.smithi036.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2020-11-12T17:23:00.985 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin_crypto_accelerator": "crypto_isal", 2020-11-12T17:23:00.985 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin_dir": "/usr/lib/ceph", 2020-11-12T17:23:00.985 INFO:teuthology.orchestra.run.smithi036.stdout: "prompt": "\u001b[01;33mCephFS:~\u001b[96m/\u001b[0m\u001b[01;33m>>>\u001b[00m ", 2020-11-12T17:23:00.985 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "-", 2020-11-12T17:23:00.986 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrv": "", 2020-11-12T17:23:00.986 INFO:teuthology.orchestra.run.smithi036.stdout: "public_bind_addr": "-", 2020-11-12T17:23:00.986 INFO:teuthology.orchestra.run.smithi036.stdout: "public_network": "", 2020-11-12T17:23:00.986 INFO:teuthology.orchestra.run.smithi036.stdout: "public_network_interface": "", 2020-11-12T17:23:00.986 INFO:teuthology.orchestra.run.smithi036.stdout: "qat_compressor_enabled": "false", 2020-11-12T17:23:00.986 INFO:teuthology.orchestra.run.smithi036.stdout: "quiet": "false", 2020-11-12T17:23:00.986 INFO:teuthology.orchestra.run.smithi036.stdout: "rados_mon_op_timeout": "0", 2020-11-12T17:23:00.987 INFO:teuthology.orchestra.run.smithi036.stdout: "rados_osd_op_timeout": "0", 2020-11-12T17:23:00.987 INFO:teuthology.orchestra.run.smithi036.stdout: "rados_tracing": "false", 2020-11-12T17:23:00.987 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_atime_update_interval": "60", 2020-11-12T17:23:00.987 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2020-11-12T17:23:00.987 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_balance_parent_reads": "false", 2020-11-12T17:23:00.987 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_balance_snap_reads": "false", 2020-11-12T17:23:00.987 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_blacklist_expire_seconds": "0", 2020-11-12T17:23:00.987 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_blacklist_on_break_lock": "true", 2020-11-12T17:23:00.988 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_blkin_trace_all": "false", 2020-11-12T17:23:00.988 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_cache": "true", 2020-11-12T17:23:00.988 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_cache_block_writes_upfront": "false", 2020-11-12T17:23:00.988 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_cache_max_dirty": "25165824", 2020-11-12T17:23:00.988 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_cache_max_dirty_age": "1.000000", 2020-11-12T17:23:00.988 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_cache_max_dirty_object": "0", 2020-11-12T17:23:00.988 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_cache_policy": "writearound", 2020-11-12T17:23:00.988 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_cache_size": "33554432", 2020-11-12T17:23:00.989 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_cache_target_dirty": "16777216", 2020-11-12T17:23:00.989 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_cache_writethrough_until_flush": "true", 2020-11-12T17:23:00.989 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_clone_copy_on_read": "false", 2020-11-12T17:23:00.989 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_compression_hint": "none", 2020-11-12T17:23:00.989 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_concurrent_management_ops": "10", 2020-11-12T17:23:00.989 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_config_pool_override_update_timestamp": "0", 2020-11-12T17:23:00.989 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_default_clone_format": "auto", 2020-11-12T17:23:00.989 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_default_data_pool": "", 2020-11-12T17:23:00.990 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_default_features": "61", 2020-11-12T17:23:00.990 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_default_format": "2", 2020-11-12T17:23:00.990 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_default_map_options": "", 2020-11-12T17:23:00.990 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_default_order": "22", 2020-11-12T17:23:00.990 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_default_pool": "rbd", 2020-11-12T17:23:00.990 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_default_stripe_count": "0", 2020-11-12T17:23:00.990 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_default_stripe_unit": "0", 2020-11-12T17:23:00.991 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_disable_zero_copy_writes": "true", 2020-11-12T17:23:00.991 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_discard_granularity_bytes": "65536", 2020-11-12T17:23:00.991 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_discard_on_zeroed_write_same": "true", 2020-11-12T17:23:00.991 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_enable_alloc_hint": "true", 2020-11-12T17:23:00.991 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_io_scheduler": "simple", 2020-11-12T17:23:00.991 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2020-11-12T17:23:00.991 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_commit_age": "5.000000", 2020-11-12T17:23:00.991 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2020-11-12T17:23:00.992 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_max_payload_bytes": "16384", 2020-11-12T17:23:00.992 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_object_flush_age": "0.000000", 2020-11-12T17:23:00.992 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_object_flush_bytes": "1048576", 2020-11-12T17:23:00.992 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_object_flush_interval": "0", 2020-11-12T17:23:00.992 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2020-11-12T17:23:00.992 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2020-11-12T17:23:00.992 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_order": "24", 2020-11-12T17:23:00.992 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_pool": "", 2020-11-12T17:23:00.993 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_journal_splay_width": "4", 2020-11-12T17:23:00.993 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_localize_parent_reads": "false", 2020-11-12T17:23:00.993 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_localize_snap_reads": "false", 2020-11-12T17:23:00.993 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2020-11-12T17:23:00.993 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2020-11-12T17:23:00.993 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2020-11-12T17:23:00.993 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2020-11-12T17:23:00.994 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2020-11-12T17:23:00.994 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2020-11-12T17:23:00.994 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_image_policy_type": "simple", 2020-11-12T17:23:00.994 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2020-11-12T17:23:00.994 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_image_state_check_interval": "30", 2020-11-12T17:23:00.994 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2020-11-12T17:23:00.994 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2020-11-12T17:23:00.994 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2020-11-12T17:23:00.995 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2020-11-12T17:23:00.995 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2020-11-12T17:23:00.995 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_memory_autotune": "true", 2020-11-12T17:23:00.995 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_memory_base": "805306368", 2020-11-12T17:23:00.995 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2020-11-12T17:23:00.995 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_memory_cache_min": "134217728", 2020-11-12T17:23:00.995 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2020-11-12T17:23:00.995 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2020-11-12T17:23:00.996 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_memory_target": "4294967296", 2020-11-12T17:23:00.996 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_perf_stats_prio": "5", 2020-11-12T17:23:00.996 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2020-11-12T17:23:00.996 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2020-11-12T17:23:00.996 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirroring_delete_delay": "0", 2020-11-12T17:23:00.996 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirroring_max_mirroring_snapshots": "3", 2020-11-12T17:23:00.996 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirroring_replay_delay": "0", 2020-11-12T17:23:00.997 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2020-11-12T17:23:00.997 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2020-11-12T17:23:00.997 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_move_to_trash_on_remove": "false", 2020-11-12T17:23:00.997 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2020-11-12T17:23:00.997 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_mtime_update_interval": "60", 2020-11-12T17:23:00.998 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_non_blocking_aio": "true", 2020-11-12T17:23:00.998 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_op_thread_timeout": "60", 2020-11-12T17:23:00.998 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_op_threads": "1", 2020-11-12T17:23:00.998 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_parent_cache_enabled": "false", 2020-11-12T17:23:00.998 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_bps_burst": "0", 2020-11-12T17:23:00.998 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_bps_limit": "0", 2020-11-12T17:23:00.998 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_iops_burst": "0", 2020-11-12T17:23:00.998 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_iops_limit": "0", 2020-11-12T17:23:00.999 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_read_bps_burst": "0", 2020-11-12T17:23:00.999 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_read_bps_limit": "0", 2020-11-12T17:23:00.999 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_read_iops_burst": "0", 2020-11-12T17:23:00.999 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_read_iops_limit": "0", 2020-11-12T17:23:00.999 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_schedule_tick_min": "50", 2020-11-12T17:23:00.999 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_write_bps_burst": "0", 2020-11-12T17:23:00.999 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_write_bps_limit": "0", 2020-11-12T17:23:01.000 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_write_iops_burst": "0", 2020-11-12T17:23:01.000 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_qos_write_iops_limit": "0", 2020-11-12T17:23:01.000 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_read_from_replica_policy": "default", 2020-11-12T17:23:01.000 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2020-11-12T17:23:01.000 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_readahead_max_bytes": "524288", 2020-11-12T17:23:01.000 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_readahead_trigger_requests": "10", 2020-11-12T17:23:01.000 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_request_timed_out_seconds": "30", 2020-11-12T17:23:01.000 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_rwl_enabled": "false", 2020-11-12T17:23:01.001 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_rwl_log_periodic_stats": "false", 2020-11-12T17:23:01.001 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_rwl_path": "/tmp", 2020-11-12T17:23:01.001 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_rwl_size": "1073741824", 2020-11-12T17:23:01.001 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_skip_partial_discard": "true", 2020-11-12T17:23:01.001 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2020-11-12T17:23:01.001 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_tracing": "false", 2020-11-12T17:23:01.001 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_validate_names": "true", 2020-11-12T17:23:01.001 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd_validate_pool": "true", 2020-11-12T17:23:01.002 INFO:teuthology.orchestra.run.smithi036.stdout: "restapi_base_url": "", 2020-11-12T17:23:01.002 INFO:teuthology.orchestra.run.smithi036.stdout: "restapi_log_level": "", 2020-11-12T17:23:01.002 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_acl_grants_max_num": "100", 2020-11-12T17:23:01.002 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_admin_entry": "admin", 2020-11-12T17:23:01.002 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_barbican_url": "", 2020-11-12T17:23:01.002 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2020-11-12T17:23:01.002 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_bucket_default_quota_max_size": "-1", 2020-11-12T17:23:01.003 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_bucket_index_max_aio": "128", 2020-11-12T17:23:01.003 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_bucket_quota_cache_size": "10000", 2020-11-12T17:23:01.003 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_bucket_quota_soft_threshold": "0.950000", 2020-11-12T17:23:01.003 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_bucket_quota_ttl": "600", 2020-11-12T17:23:01.003 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_cache_enabled": "true", 2020-11-12T17:23:01.003 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_cache_expiry_interval": "900", 2020-11-12T17:23:01.003 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_cache_lru_size": "10000", 2020-11-12T17:23:01.003 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_content_length_compat": "false", 2020-11-12T17:23:01.004 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_copy_obj_progress": "true", 2020-11-12T17:23:01.004 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2020-11-12T17:23:01.004 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_cors_rules_max_num": "100", 2020-11-12T17:23:01.004 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_cross_domain_policy": "", 2020-11-12T17:23:01.004 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_default_encryption_key": "", 2020-11-12T17:23:01.004 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_require_ssl": "true", 2020-11-12T17:23:01.004 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2020-11-12T17:23:01.004 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2020-11-12T17:23:01.005 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_suppress_logs": "true", 2020-11-12T17:23:01.005 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_vault_addr": "", 2020-11-12T17:23:01.005 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_vault_auth": "token", 2020-11-12T17:23:01.005 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_vault_namespace": "", 2020-11-12T17:23:01.005 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_vault_prefix": "", 2020-11-12T17:23:01.005 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_vault_secret_engine": "transit", 2020-11-12T17:23:01.005 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_crypt_vault_token_file": "", 2020-11-12T17:23:01.006 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_curl_low_speed_limit": "1024", 2020-11-12T17:23:01.006 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_curl_low_speed_time": "300", 2020-11-12T17:23:01.006 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_curl_wait_timeout_ms": "1000", 2020-11-12T17:23:01.006 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2020-11-12T17:23:01.006 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_data_log_changes_size": "1000", 2020-11-12T17:23:01.006 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_data_log_num_shards": "128", 2020-11-12T17:23:01.006 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_data_log_obj_prefix": "data_log", 2020-11-12T17:23:01.006 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_data_log_window": "30", 2020-11-12T17:23:01.007 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_data_notify_interval_msec": "200", 2020-11-12T17:23:01.007 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_default_realm_info_oid": "default.realm", 2020-11-12T17:23:01.007 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_default_region_info_oid": "default.region", 2020-11-12T17:23:01.007 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_default_zone_info_oid": "default.zone", 2020-11-12T17:23:01.007 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2020-11-12T17:23:01.007 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_defer_to_bucket_acls": "", 2020-11-12T17:23:01.007 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_delete_multi_obj_max_num": "1000", 2020-11-12T17:23:01.007 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_admin_lim": "0.000000", 2020-11-12T17:23:01.008 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_admin_res": "100.000000", 2020-11-12T17:23:01.008 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2020-11-12T17:23:01.008 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_auth_lim": "0.000000", 2020-11-12T17:23:01.008 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_auth_res": "200.000000", 2020-11-12T17:23:01.008 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2020-11-12T17:23:01.008 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_data_lim": "0.000000", 2020-11-12T17:23:01.008 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_data_res": "500.000000", 2020-11-12T17:23:01.009 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_data_wgt": "500.000000", 2020-11-12T17:23:01.009 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2020-11-12T17:23:01.009 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_metadata_res": "500.000000", 2020-11-12T17:23:01.009 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2020-11-12T17:23:01.009 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dns_name": "", 2020-11-12T17:23:01.009 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dns_s3website_name": "", 2020-11-12T17:23:01.009 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_dynamic_resharding": "true", 2020-11-12T17:23:01.009 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, pubsub", 2020-11-12T17:23:01.010 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_enable_gc_threads": "true", 2020-11-12T17:23:01.010 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_enable_lc_threads": "true", 2020-11-12T17:23:01.010 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_enable_ops_log": "false", 2020-11-12T17:23:01.010 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_enable_quota_threads": "true", 2020-11-12T17:23:01.010 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_enable_static_website": "false", 2020-11-12T17:23:01.010 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_enable_usage_log": "false", 2020-11-12T17:23:01.010 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_enforce_swift_acls": "true", 2020-11-12T17:23:01.010 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_exit_timeout_secs": "120", 2020-11-12T17:23:01.011 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_expose_bucket": "false", 2020-11-12T17:23:01.011 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_extended_http_attrs": "", 2020-11-12T17:23:01.011 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_fcgi_socket_backlog": "1024", 2020-11-12T17:23:01.011 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2020-11-12T17:23:01.011 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_frontends": "beast port=7480", 2020-11-12T17:23:01.011 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_gc_max_concurrent_io": "10", 2020-11-12T17:23:01.011 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_gc_max_deferred": "50", 2020-11-12T17:23:01.012 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2020-11-12T17:23:01.012 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_gc_max_objs": "32", 2020-11-12T17:23:01.012 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_gc_max_queue_size": "134213632", 2020-11-12T17:23:01.012 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_gc_max_trim_chunk": "16", 2020-11-12T17:23:01.012 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_gc_obj_min_wait": "7200", 2020-11-12T17:23:01.012 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_gc_processor_max_time": "3600", 2020-11-12T17:23:01.012 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_gc_processor_period": "3600", 2020-11-12T17:23:01.013 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_get_obj_max_req_size": "4194304", 2020-11-12T17:23:01.013 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_get_obj_window_size": "16777216", 2020-11-12T17:23:01.013 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_healthcheck_disabling_path": "", 2020-11-12T17:23:01.013 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_host": "", 2020-11-12T17:23:01.013 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ignore_get_invalid_range": "false", 2020-11-12T17:23:01.013 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_init_timeout": "300", 2020-11-12T17:23:01.014 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2020-11-12T17:23:01.014 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_accepted_admin_roles": "", 2020-11-12T17:23:01.014 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2020-11-12T17:23:01.014 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_admin_domain": "", 2020-11-12T17:23:01.014 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_admin_password": "", 2020-11-12T17:23:01.014 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_admin_password_path": "", 2020-11-12T17:23:01.014 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_admin_project": "", 2020-11-12T17:23:01.015 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_admin_tenant": "", 2020-11-12T17:23:01.015 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_admin_token": "", 2020-11-12T17:23:01.015 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_admin_token_path": "", 2020-11-12T17:23:01.015 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_admin_user": "", 2020-11-12T17:23:01.015 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_api_version": "2", 2020-11-12T17:23:01.015 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_barbican_domain": "", 2020-11-12T17:23:01.015 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_barbican_password": "", 2020-11-12T17:23:01.015 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_barbican_project": "", 2020-11-12T17:23:01.016 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_barbican_tenant": "", 2020-11-12T17:23:01.016 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_barbican_user": "", 2020-11-12T17:23:01.016 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_implicit_tenants": "false", 2020-11-12T17:23:01.016 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_token_cache_size": "10000", 2020-11-12T17:23:01.016 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_url": "", 2020-11-12T17:23:01.016 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_keystone_verify_ssl": "true", 2020-11-12T17:23:01.017 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_lc_debug_interval": "-1", 2020-11-12T17:23:01.017 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_lc_lock_max_time": "90", 2020-11-12T17:23:01.017 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_lc_max_objs": "32", 2020-11-12T17:23:01.017 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_lc_max_rules": "1000", 2020-11-12T17:23:01.017 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_lc_max_worker": "3", 2020-11-12T17:23:01.017 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_lc_max_wp_worker": "3", 2020-11-12T17:23:01.017 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_lc_thread_delay": "0", 2020-11-12T17:23:01.017 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2020-11-12T17:23:01.018 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ldap_dnattr": "uid", 2020-11-12T17:23:01.018 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2020-11-12T17:23:01.018 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ldap_searchfilter": "", 2020-11-12T17:23:01.018 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2020-11-12T17:23:01.018 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ldap_uri": "ldaps://", 2020-11-12T17:23:01.018 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2020-11-12T17:23:01.018 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_list_bucket_min_readahead": "1000", 2020-11-12T17:23:01.018 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_list_buckets_max_chunk": "1000", 2020-11-12T17:23:01.019 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_log_http_headers": "", 2020-11-12T17:23:01.019 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_log_nonexistent_bucket": "false", 2020-11-12T17:23:01.019 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2020-11-12T17:23:01.019 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_log_object_name_utc": "false", 2020-11-12T17:23:01.019 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_attr_name_len": "0", 2020-11-12T17:23:01.019 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_attr_size": "0", 2020-11-12T17:23:01.020 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_attrs_num_in_req": "0", 2020-11-12T17:23:01.020 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_chunk_size": "4194304", 2020-11-12T17:23:01.020 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_concurrent_requests": "1024", 2020-11-12T17:23:01.020 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_dynamic_shards": "1999", 2020-11-12T17:23:01.020 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_listing_results": "1000", 2020-11-12T17:23:01.020 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_notify_retries": "3", 2020-11-12T17:23:01.021 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_objs_per_shard": "100000", 2020-11-12T17:23:01.021 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_put_param_size": "1048576", 2020-11-12T17:23:01.021 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_put_size": "5368709120", 2020-11-12T17:23:01.021 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_max_slo_entries": "1000", 2020-11-12T17:23:01.021 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_md_log_max_shards": "64", 2020-11-12T17:23:01.021 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_md_notify_interval_msec": "200", 2020-11-12T17:23:01.021 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_mime_types_file": "/etc/mime.types", 2020-11-12T17:23:01.022 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_mp_lock_max_time": "600", 2020-11-12T17:23:01.022 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_multipart_min_part_size": "5242880", 2020-11-12T17:23:01.022 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_multipart_part_upload_limit": "10000", 2020-11-12T17:23:01.022 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_fhcache_partitions": "3", 2020-11-12T17:23:01.022 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_fhcache_size": "2017", 2020-11-12T17:23:01.023 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2020-11-12T17:23:01.023 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_lru_lanes": "5", 2020-11-12T17:23:01.023 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_max_gc": "300", 2020-11-12T17:23:01.023 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_namespace_expire_secs": "300", 2020-11-12T17:23:01.023 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_run_gc_threads": "false", 2020-11-12T17:23:01.023 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_run_lc_threads": "false", 2020-11-12T17:23:01.023 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_run_quota_threads": "false", 2020-11-12T17:23:01.023 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_run_sync_thread": "false", 2020-11-12T17:23:01.024 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_s3_fast_attrs": "false", 2020-11-12T17:23:01.024 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_nfs_write_completion_interval_s": "10", 2020-11-12T17:23:01.024 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_num_async_rados_threads": "32", 2020-11-12T17:23:01.024 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_num_control_oids": "8", 2020-11-12T17:23:01.024 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_num_rados_handles": "1", 2020-11-12T17:23:01.024 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_numa_node": "-1", 2020-11-12T17:23:01.025 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_obj_stripe_size": "4194304", 2020-11-12T17:23:01.025 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_obj_tombstone_cache_size": "1000", 2020-11-12T17:23:01.025 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_objexp_chunk_size": "100", 2020-11-12T17:23:01.025 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_objexp_gc_interval": "600", 2020-11-12T17:23:01.025 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_objexp_hints_num_shards": "127", 2020-11-12T17:23:01.025 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_olh_pending_timeout_sec": "3600", 2020-11-12T17:23:01.026 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_op_thread_suicide_timeout": "0", 2020-11-12T17:23:01.026 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_op_thread_timeout": "600", 2020-11-12T17:23:01.026 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_op_tracing": "false", 2020-11-12T17:23:01.026 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_opa_token": "", 2020-11-12T17:23:01.026 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_opa_url": "", 2020-11-12T17:23:01.026 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_opa_verify_ssl": "true", 2020-11-12T17:23:01.027 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ops_log_data_backlog": "5242880", 2020-11-12T17:23:01.027 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ops_log_rados": "true", 2020-11-12T17:23:01.027 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_ops_log_socket_path": "", 2020-11-12T17:23:01.027 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_override_bucket_index_max_shards": "0", 2020-11-12T17:23:01.028 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2020-11-12T17:23:01.028 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_period_push_interval": "2.000000", 2020-11-12T17:23:01.028 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_period_push_interval_max": "30.000000", 2020-11-12T17:23:01.028 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_period_root_pool": ".rgw.root", 2020-11-12T17:23:01.029 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_port": "", 2020-11-12T17:23:01.029 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_print_continue": "true", 2020-11-12T17:23:01.029 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_print_prohibited_content_length": "false", 2020-11-12T17:23:01.029 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_put_obj_max_window_size": "67108864", 2020-11-12T17:23:01.029 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_put_obj_min_window_size": "16777216", 2020-11-12T17:23:01.029 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2020-11-12T17:23:01.030 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_rados_pool_pg_num_min": "8", 2020-11-12T17:23:01.030 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_rados_pool_recovery_priority": "5", 2020-11-12T17:23:01.050 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_rados_tracing": "false", 2020-11-12T17:23:01.050 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_realm": "", 2020-11-12T17:23:01.051 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_realm_root_pool": ".rgw.root", 2020-11-12T17:23:01.051 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_region": "", 2020-11-12T17:23:01.051 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_region_root_pool": ".rgw.root", 2020-11-12T17:23:01.051 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_relaxed_region_enforcement": "false", 2020-11-12T17:23:01.051 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_relaxed_s3_bucket_names": "false", 2020-11-12T17:23:01.051 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2020-11-12T17:23:01.051 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_request_uri": "", 2020-11-12T17:23:01.051 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_reshard_batch_size": "64", 2020-11-12T17:23:01.052 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_reshard_bucket_lock_duration": "360", 2020-11-12T17:23:01.052 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_reshard_max_aio": "128", 2020-11-12T17:23:01.052 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_reshard_num_logs": "16", 2020-11-12T17:23:01.052 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_reshard_thread_interval": "600", 2020-11-12T17:23:01.052 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_resolve_cname": "false", 2020-11-12T17:23:01.052 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_rest_getusage_op_compat": "false", 2020-11-12T17:23:01.052 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_run_sync_thread": "true", 2020-11-12T17:23:01.053 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_s3_auth_order": "sts, external, local", 2020-11-12T17:23:01.053 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_s3_auth_use_keystone": "false", 2020-11-12T17:23:01.053 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_s3_auth_use_ldap": "false", 2020-11-12T17:23:01.053 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_s3_auth_use_rados": "true", 2020-11-12T17:23:01.053 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_s3_auth_use_sts": "false", 2020-11-12T17:23:01.053 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_s3_success_create_obj_status": "0", 2020-11-12T17:23:01.053 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_safe_max_objects_per_shard": "102400", 2020-11-12T17:23:01.054 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_scheduler_type": "throttler", 2020-11-12T17:23:01.054 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_script_uri": "", 2020-11-12T17:23:01.054 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_service_provider_name": "", 2020-11-12T17:23:01.054 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_shard_warning_threshold": "90.000000", 2020-11-12T17:23:01.054 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_socket_path": "", 2020-11-12T17:23:01.055 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sts_client_id": "", 2020-11-12T17:23:01.055 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sts_client_secret": "", 2020-11-12T17:23:01.055 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sts_entry": "sts", 2020-11-12T17:23:01.055 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sts_key": "sts", 2020-11-12T17:23:01.056 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sts_max_session_duration": "43200", 2020-11-12T17:23:01.056 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sts_token_introspection_url": "", 2020-11-12T17:23:01.056 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_account_in_url": "false", 2020-11-12T17:23:01.057 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_auth_entry": "auth", 2020-11-12T17:23:01.057 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_auth_url": "", 2020-11-12T17:23:01.057 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_custom_header": "", 2020-11-12T17:23:01.057 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_enforce_content_length": "false", 2020-11-12T17:23:01.058 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_need_stats": "true", 2020-11-12T17:23:01.058 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_tenant_name": "", 2020-11-12T17:23:01.058 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_token_expiration": "86400", 2020-11-12T17:23:01.059 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_url": "", 2020-11-12T17:23:01.059 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_url_prefix": "swift", 2020-11-12T17:23:01.059 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_swift_versioning_enabled": "false", 2020-11-12T17:23:01.059 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2020-11-12T17:23:01.060 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_lease_period": "120", 2020-11-12T17:23:01.060 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2020-11-12T17:23:01.060 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_log_trim_interval": "1200", 2020-11-12T17:23:01.061 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_log_trim_max_buckets": "16", 2020-11-12T17:23:01.061 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2020-11-12T17:23:01.061 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2020-11-12T17:23:01.061 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_trace_history_size": "4096", 2020-11-12T17:23:01.062 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_trace_per_node_log_size": "32", 2020-11-12T17:23:01.062 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2020-11-12T17:23:01.062 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_thread_pool_size": "512", 2020-11-12T17:23:01.063 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_torrent_comment": "", 2020-11-12T17:23:01.063 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_torrent_createby": "", 2020-11-12T17:23:01.063 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_torrent_encoding": "", 2020-11-12T17:23:01.063 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_torrent_flag": "false", 2020-11-12T17:23:01.064 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_torrent_origin": "", 2020-11-12T17:23:01.064 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_torrent_sha_unit": "524288", 2020-11-12T17:23:01.064 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_torrent_tracker": "", 2020-11-12T17:23:01.065 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_trust_forwarded_https": "false", 2020-11-12T17:23:01.065 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_usage_log_flush_threshold": "1024", 2020-11-12T17:23:01.065 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_usage_log_tick_interval": "30", 2020-11-12T17:23:01.065 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_usage_max_shards": "32", 2020-11-12T17:23:01.066 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_usage_max_user_shards": "1", 2020-11-12T17:23:01.066 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_use_opa_authz": "false", 2020-11-12T17:23:01.066 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_user_default_quota_max_objects": "-1", 2020-11-12T17:23:01.067 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_user_default_quota_max_size": "-1", 2020-11-12T17:23:01.067 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_user_max_buckets": "1000", 2020-11-12T17:23:01.067 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2020-11-12T17:23:01.067 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_user_quota_sync_idle_users": "false", 2020-11-12T17:23:01.068 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_user_quota_sync_interval": "86400", 2020-11-12T17:23:01.068 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_user_quota_sync_wait_time": "86400", 2020-11-12T17:23:01.068 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_user_unique_email": "true", 2020-11-12T17:23:01.069 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_verify_ssl": "true", 2020-11-12T17:23:01.069 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_website_routing_rules_max_num": "50", 2020-11-12T17:23:01.069 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_zone": "", 2020-11-12T17:23:01.069 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_zone_root_pool": ".rgw.root", 2020-11-12T17:23:01.070 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_zonegroup": "", 2020-11-12T17:23:01.070 INFO:teuthology.orchestra.run.smithi036.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2020-11-12T17:23:01.070 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_block_size": "4096", 2020-11-12T17:23:01.071 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_bloom_bits_per_key": "20", 2020-11-12T17:23:01.071 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2020-11-12T17:23:01.071 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "true", 2020-11-12T17:23:01.071 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_cache_row_ratio": "0.000000", 2020-11-12T17:23:01.072 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_cache_shard_bits": "4", 2020-11-12T17:23:01.072 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_cache_size": "536870912", 2020-11-12T17:23:01.072 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_cache_type": "binned_lru", 2020-11-12T17:23:01.073 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_collect_compaction_stats": "false", 2020-11-12T17:23:01.073 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_collect_extended_stats": "false", 2020-11-12T17:23:01.073 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_collect_memory_stats": "false", 2020-11-12T17:23:01.073 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_delete_range_threshold": "1048576", 2020-11-12T17:23:01.074 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_index_type": "binary_search", 2020-11-12T17:23:01.074 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_log_to_ceph_log": "true", 2020-11-12T17:23:01.074 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_metadata_block_size": "4096", 2020-11-12T17:23:01.075 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_partition_filters": "false", 2020-11-12T17:23:01.075 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_perf": "false", 2020-11-12T17:23:01.075 INFO:teuthology.orchestra.run.smithi036.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2020-11-12T17:23:01.075 INFO:teuthology.orchestra.run.smithi036.stdout: "rotating_keys_bootstrap_timeout": "30", 2020-11-12T17:23:01.076 INFO:teuthology.orchestra.run.smithi036.stdout: "rotating_keys_renewal_timeout": "10", 2020-11-12T17:23:01.076 INFO:teuthology.orchestra.run.smithi036.stdout: "run_dir": "/var/run/ceph", 2020-11-12T17:23:01.076 INFO:teuthology.orchestra.run.smithi036.stdout: "setgroup": "", 2020-11-12T17:23:01.077 INFO:teuthology.orchestra.run.smithi036.stdout: "setuser": "", 2020-11-12T17:23:01.077 INFO:teuthology.orchestra.run.smithi036.stdout: "setuser_match_path": "", 2020-11-12T17:23:01.077 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_misplaced_ratio": "0.050000", 2020-11-12T17:23:01.077 INFO:teuthology.orchestra.run.smithi036.stdout: "thp": "false", 2020-11-12T17:23:01.078 INFO:teuthology.orchestra.run.smithi036.stdout: "threadpool_default_timeout": "60", 2020-11-12T17:23:01.078 INFO:teuthology.orchestra.run.smithi036.stdout: "threadpool_empty_queue_max_wait": "2", 2020-11-12T17:23:01.078 INFO:teuthology.orchestra.run.smithi036.stdout: "throttler_perf_counter": "true", 2020-11-12T17:23:01.079 INFO:teuthology.orchestra.run.smithi036.stdout: "timing": "false" 2020-11-12T17:23:01.079 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:01.082 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2020-11-12T17:23:01.235 INFO:teuthology.orchestra.run.smithi036.stdout:mon.a: {} 2020-11-12T17:23:01.262 INFO:teuthology.orchestra.run.smithi036.stdout:mon.b: {} 2020-11-12T17:23:01.297 INFO:teuthology.orchestra.run.smithi036.stdout:mon.c: {} 2020-11-12T17:23:01.297 INFO:teuthology.orchestra.run.smithi036.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2020-11-12T17:23:01.297 INFO:teuthology.orchestra.run.smithi036.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2020-11-12T17:23:01.298 INFO:teuthology.orchestra.run.smithi036.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2020-11-12T17:23:01.302 INFO:teuthology.orchestra.run.smithi205:> type ceph-objectstore-tool 2020-11-12T17:23:01.310 INFO:teuthology.orchestra.run.smithi205.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2020-11-12T17:23:01.311 INFO:teuthology.orchestra.run.smithi036:> type ceph-objectstore-tool 2020-11-12T17:23:01.325 INFO:teuthology.orchestra.run.smithi036.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2020-11-12T17:23:01.326 INFO:teuthology.run_tasks:Running task full_sequential... 2020-11-12T17:23:01.339 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2020-11-12T17:23:01.345 INFO:tasks.radosbench:Beginning radosbench... 2020-11-12T17:23:01.346 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2020-11-12T17:23:01.347 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create unique_pool_0 16 2020-11-12T17:23:01.347 INFO:tasks.thrashosds.thrasher:starting do_thrash 2020-11-12T17:23:01.348 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-12T17:23:01.348 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:23:01.348 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2020-11-12T17:23:01.348 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd primary-affinity 0 1 2020-11-12T17:23:01.351 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2020-11-12T17:23:01.351 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2020-11-12T17:23:01.352 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:01.352 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2020-11-12T17:23:01.353 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:01.353 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2020-11-12T17:23:01.353 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:23:01.370 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:01.366+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:01.454 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:01.452+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:01.535 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:01.538 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:01.538 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:01.553 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:01.555 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:01.550+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:01.562 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:01.590 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:01.613 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:01.642 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:01.651 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:01.652 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:01.656 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:01.654+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:01.661 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:01.672 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:01.703 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:01.746 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:01.748 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:01.748 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:01.748 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:01.749 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:01.749 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:01.749 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:01.749 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:01.749 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:01.757 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:01.756+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:01.792 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:01.792 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:01.809 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:01.896 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:01.894+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:01.956 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:01.957 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:01.959 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:01.956+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:01.965 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:02.061 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:02.058+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:02.118 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:02.123 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:02.127 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:02.162 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:02.160+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:02.263 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:02.260+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:02.277 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:02.278 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:02.287 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:02.366 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:02.364+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:02.400 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:02.428 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:02.429 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:02.436 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'unique_pool_0' created 2020-11-12T17:23:02.445 INFO:teuthology.orchestra.run.smithi036.stderr:set osd.0 primary-affinity to 1 (8655362) 2020-11-12T17:23:02.446 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:23:02.452 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2020-11-12T17:23:02.503 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:02.502+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:02.540 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:02.541 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:02.550 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:02.592 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:02.590+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:02.673 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:02.670+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:02.702 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:02.702 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:02.712 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:02.800 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:02.798+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:02.864 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:02.879 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:02.881 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:02.878+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:02.882 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:02.925 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:02.924+0000 7f9289d6e700 -1 osd.7 19 handle_osd_map injecting map crc failure 2020-11-12T17:23:02.982 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:02.978+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:03.037 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:03.038 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:03.047 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:03.083 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:03.080+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:03.184 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:03.182+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:03.204 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:03.254 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:03.256 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:03.300 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:03.298+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:03.371 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:03.372 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:03.381 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:03.387 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:03.382+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:03.467 INFO:teuthology.orchestra.run.smithi036.stderr:enabled application 'rados' on pool 'unique_pool_0' 2020-11-12T17:23:03.493 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:03.492+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:03.497 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:03.498 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:03.507 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:03.595 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:03.590+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:03.657 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:03.657 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:03.667 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:03.696 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:03.694+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:03.763 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:03.772 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:03.773 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:03.782 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:03.811 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:03.810+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:03.889 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:03.889 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:03.899 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:03.894+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:03.908 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:03.931 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:03.960 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:03.994 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:03.999 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:03.996+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:04.020 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:04.020 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:04.022 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:04.029 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:04.053 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:04.083 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:04.114 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:04.116 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:04.116+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:04.142 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:04.145 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:04.145 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:04.146 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:04.146 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:04.146 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:04.146 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:04.146 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:04.146 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:04.184 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:04.184 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:04.184 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:23:04.184 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:04.193 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:04.237 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:04.236+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:04.319 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:04.318+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:04.345 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:04.345 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:04.346 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:04.346 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:04.346 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:04.354 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:04.420 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:04.418+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:04.458 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:04.459 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:04.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:04.459 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [] 2020-11-12T17:23:04.460 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:04.461 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:23:04.468 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:04.481 INFO:teuthology.orchestra.run.smithi036:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_0 bench 90 write' 2020-11-12T17:23:04.509 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2020-11-12T17:23:04.509 INFO:teuthology.orchestra.run:waiting for 3000 2020-11-12T17:23:04.522 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:04.518+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:04.560 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:hints = 1 2020-11-12T17:23:04.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2020-11-12T17:23:04.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Object prefix: benchmark_data_smithi036_14212 2020-11-12T17:23:04.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:23:04.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 0 0 0 0 0 0 - 0 2020-11-12T17:23:04.573 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:04.574 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:04.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.574 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9 3.e 3:78394181:::benchmark_data_smithi036_14212_object1:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.575 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568003+0000", 2020-11-12T17:23:04.575 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0061160440000000002, 2020-11-12T17:23:04.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0061374380000000003, 2020-11-12T17:23:04.575 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.575 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:23:04.575 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.576 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.576 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.576 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9 2020-11-12T17:23:04.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.576 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568003+0000", 2020-11-12T17:23:04.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568003+0000", 2020-11-12T17:23:04.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999949 2020-11-12T17:23:04.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.567952+0000", 2020-11-12T17:23:04.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000157727 2020-11-12T17:23:04.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568110+0000", 2020-11-12T17:23:04.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6849999999999999e-05 2020-11-12T17:23:04.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568137+0000", 2020-11-12T17:23:04.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8870000000000001e-05 2020-11-12T17:23:04.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568156+0000", 2020-11-12T17:23:04.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000158863 2020-11-12T17:23:04.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568314+0000", 2020-11-12T17:23:04.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3827e-05 2020-11-12T17:23:04.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op must wait for map", 2020-11-12T17:23:04.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568328+0000", 2020-11-12T17:23:04.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055298430000000004 2020-11-12T17:23:04.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.573858+0000", 2020-11-12T17:23:04.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058549700000000001 2020-11-12T17:23:04.584 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.584 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.584 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.585 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:10 3.e 3.81829c1e (undecoded) ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.585 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568243+0000", 2020-11-12T17:23:04.585 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0058762370000000003, 2020-11-12T17:23:04.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0059596659999999997, 2020-11-12T17:23:04.585 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.586 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:04.586 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.586 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.586 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.586 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 10 2020-11-12T17:23:04.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.587 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568243+0000", 2020-11-12T17:23:04.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568243+0000", 2020-11-12T17:23:04.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:23:04.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568197+0000", 2020-11-12T17:23:04.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000140283 2020-11-12T17:23:04.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568337+0000", 2020-11-12T17:23:04.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7796999999999999e-05 2020-11-12T17:23:04.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568355+0000", 2020-11-12T17:23:04.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.85e-06 2020-11-12T17:23:04.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568364+0000", 2020-11-12T17:23:04.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108526 2020-11-12T17:23:04.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568472+0000", 2020-11-12T17:23:04.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8536999999999999e-05 2020-11-12T17:23:04.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:04.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568491+0000", 2020-11-12T17:23:04.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024784299999999998 2020-11-12T17:23:04.594 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.594 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.594 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.595 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:11 3.e 3.81829c1e (undecoded) ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.595 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568493+0000", 2020-11-12T17:23:04.595 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.005626097, 2020-11-12T17:23:04.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0057564180000000001, 2020-11-12T17:23:04.595 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.596 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:04.596 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.596 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.596 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.596 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11 2020-11-12T17:23:04.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.596 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568493+0000", 2020-11-12T17:23:04.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568493+0000", 2020-11-12T17:23:04.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999208 2020-11-12T17:23:04.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568414+0000", 2020-11-12T17:23:04.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000194277 2020-11-12T17:23:04.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568608+0000", 2020-11-12T17:23:04.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9930000000000001e-05 2020-11-12T17:23:04.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568628+0000", 2020-11-12T17:23:04.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1829999999999994e-06 2020-11-12T17:23:04.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568636+0000", 2020-11-12T17:23:04.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2436999999999999e-05 2020-11-12T17:23:04.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568699+0000", 2020-11-12T17:23:04.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5999999999999996e-06 2020-11-12T17:23:04.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:04.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568708+0000", 2020-11-12T17:23:04.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215097 2020-11-12T17:23:04.605 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.605 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.605 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.605 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12 3.e 3.81829c1e (undecoded) ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.606 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568738+0000", 2020-11-12T17:23:04.606 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0053807899999999999, 2020-11-12T17:23:04.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055524229999999999, 2020-11-12T17:23:04.606 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.607 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:04.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.608 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12 2020-11-12T17:23:04.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.608 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568738+0000", 2020-11-12T17:23:04.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568738+0000", 2020-11-12T17:23:04.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999499 2020-11-12T17:23:04.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568689+0000", 2020-11-12T17:23:04.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012851099999999999 2020-11-12T17:23:04.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568817+0000", 2020-11-12T17:23:04.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:23:04.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568837+0000", 2020-11-12T17:23:04.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.046e-06 2020-11-12T17:23:04.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568844+0000", 2020-11-12T17:23:04.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0344000000000002e-05 2020-11-12T17:23:04.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568924+0000", 2020-11-12T17:23:04.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9843e-05 2020-11-12T17:23:04.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:04.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568944+0000", 2020-11-12T17:23:04.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020561700000000001 2020-11-12T17:23:04.614 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.614 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.614 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.615 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:13 3.e 3.81829c1e (undecoded) ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.615 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568972+0000", 2020-11-12T17:23:04.615 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0051467429999999996, 2020-11-12T17:23:04.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053681509999999998, 2020-11-12T17:23:04.615 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.615 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:04.616 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.616 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.616 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.616 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 13 2020-11-12T17:23:04.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.616 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568972+0000", 2020-11-12T17:23:04.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568972+0000", 2020-11-12T17:23:04.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999228 2020-11-12T17:23:04.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568895+0000", 2020-11-12T17:23:04.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167484 2020-11-12T17:23:04.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569063+0000", 2020-11-12T17:23:04.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0166e-05 2020-11-12T17:23:04.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569083+0000", 2020-11-12T17:23:04.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1840000000000005e-06 2020-11-12T17:23:04.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569092+0000", 2020-11-12T17:23:04.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7426000000000003e-05 2020-11-12T17:23:04.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569139+0000", 2020-11-12T17:23:04.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4839999999999998e-06 2020-11-12T17:23:04.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:04.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569147+0000", 2020-11-12T17:23:04.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017434699999999999 2020-11-12T17:23:04.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.623 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.624 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:14 3.e 3.81829c1e (undecoded) ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.624 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.569184+0000", 2020-11-12T17:23:04.624 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0049352459999999999, 2020-11-12T17:23:04.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0051957030000000003, 2020-11-12T17:23:04.624 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.624 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:04.625 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.625 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.625 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.625 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 14 2020-11-12T17:23:04.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.625 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569184+0000", 2020-11-12T17:23:04.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569184+0000", 2020-11-12T17:23:04.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:23:04.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569142+0000", 2020-11-12T17:23:04.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012719399999999999 2020-11-12T17:23:04.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569270+0000", 2020-11-12T17:23:04.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3079999999999999e-05 2020-11-12T17:23:04.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569293+0000", 2020-11-12T17:23:04.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8929999999999999e-06 2020-11-12T17:23:04.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569300+0000", 2020-11-12T17:23:04.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010103 2020-11-12T17:23:04.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569401+0000", 2020-11-12T17:23:04.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1514000000000003e-05 2020-11-12T17:23:04.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:04.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569442+0000", 2020-11-12T17:23:04.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025816700000000001 2020-11-12T17:23:04.631 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.631 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.632 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.632 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:15 3.e 3.81829c1e (undecoded) ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.632 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.569501+0000", 2020-11-12T17:23:04.632 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0046183090000000001, 2020-11-12T17:23:04.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049207180000000001, 2020-11-12T17:23:04.633 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.633 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:04.633 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.633 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.633 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.633 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 15 2020-11-12T17:23:04.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.634 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569501+0000", 2020-11-12T17:23:04.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569501+0000", 2020-11-12T17:23:04.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999866 2020-11-12T17:23:04.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569367+0000", 2020-11-12T17:23:04.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021778699999999999 2020-11-12T17:23:04.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569585+0000", 2020-11-12T17:23:04.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9466999999999998e-05 2020-11-12T17:23:04.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569604+0000", 2020-11-12T17:23:04.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5299999999999999e-06 2020-11-12T17:23:04.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569612+0000", 2020-11-12T17:23:04.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0469999999999994e-05 2020-11-12T17:23:04.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569682+0000", 2020-11-12T17:23:04.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8246000000000001e-05 2020-11-12T17:23:04.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:04.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569701+0000", 2020-11-12T17:23:04.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019968000000000001 2020-11-12T17:23:04.642 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.642 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.642 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.643 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:16 3.e 3.81829c1e (undecoded) ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.643 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.569710+0000", 2020-11-12T17:23:04.643 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0044088950000000003, 2020-11-12T17:23:04.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047543710000000003, 2020-11-12T17:23:04.643 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.643 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:04.643 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.644 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.644 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.644 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16 2020-11-12T17:23:04.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.644 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569710+0000", 2020-11-12T17:23:04.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569710+0000", 2020-11-12T17:23:04.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999485 2020-11-12T17:23:04.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569659+0000", 2020-11-12T17:23:04.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013376300000000001 2020-11-12T17:23:04.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569792+0000", 2020-11-12T17:23:04.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4780000000000001e-05 2020-11-12T17:23:04.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569807+0000", 2020-11-12T17:23:04.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9569999999999996e-06 2020-11-12T17:23:04.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569814+0000", 2020-11-12T17:23:04.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2650000000000003e-05 2020-11-12T17:23:04.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569897+0000", 2020-11-12T17:23:04.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5553000000000002e-05 2020-11-12T17:23:04.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:04.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569912+0000", 2020-11-12T17:23:04.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020201299999999999 2020-11-12T17:23:04.649 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.650 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.650 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.650 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.650 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:23:04.650 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 8 2020-11-12T17:23:04.650 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:04.652 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:04.653 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:04.652+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:04.752 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:04.750+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:04.814 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:04.840 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:04.841 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:04.841 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:04.842 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:04.843 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:04.888 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:04.888+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:04.950 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:04.951 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:04.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:04.951 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:04.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.951 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9 3.e 3:78394181:::benchmark_data_smithi036_14212_object1:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.951 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568003+0000", 2020-11-12T17:23:04.952 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.37869127600000002, 2020-11-12T17:23:04.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014473474, 2020-11-12T17:23:04.952 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.952 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:04.952 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.952 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.952 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.953 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9 2020-11-12T17:23:04.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.953 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568003+0000", 2020-11-12T17:23:04.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568003+0000", 2020-11-12T17:23:04.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999949 2020-11-12T17:23:04.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.567952+0000", 2020-11-12T17:23:04.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000157727 2020-11-12T17:23:04.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568110+0000", 2020-11-12T17:23:04.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6849999999999999e-05 2020-11-12T17:23:04.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568137+0000", 2020-11-12T17:23:04.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8870000000000001e-05 2020-11-12T17:23:04.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568156+0000", 2020-11-12T17:23:04.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000158863 2020-11-12T17:23:04.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568314+0000", 2020-11-12T17:23:04.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3827e-05 2020-11-12T17:23:04.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op must wait for map", 2020-11-12T17:23:04.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568328+0000", 2020-11-12T17:23:04.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055298430000000004 2020-11-12T17:23:04.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.573858+0000", 2020-11-12T17:23:04.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029414699999999997 2020-11-12T17:23:04.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:04.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.574152+0000", 2020-11-12T17:23:04.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033708700000000002 2020-11-12T17:23:04.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:04.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.574489+0000", 2020-11-12T17:23:04.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006786762 2020-11-12T17:23:04.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:04.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.581276+0000", 2020-11-12T17:23:04.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001096971 2020-11-12T17:23:04.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:04.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582373+0000", 2020-11-12T17:23:04.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6675999999999998e-05 2020-11-12T17:23:04.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:04.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582420+0000", 2020-11-12T17:23:04.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6861000000000003e-05 2020-11-12T17:23:04.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:04.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582477+0000", 2020-11-12T17:23:04.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014473474 2020-11-12T17:23:04.963 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.964 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.964 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.964 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:10 3.e 3:78394181:::benchmark_data_smithi036_14212_object1:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.964 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568243+0000", 2020-11-12T17:23:04.964 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.37845146899999998, 2020-11-12T17:23:04.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014424143, 2020-11-12T17:23:04.965 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.965 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:04.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.965 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 10 2020-11-12T17:23:04.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.966 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568243+0000", 2020-11-12T17:23:04.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568243+0000", 2020-11-12T17:23:04.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:23:04.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568197+0000", 2020-11-12T17:23:04.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000140283 2020-11-12T17:23:04.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568337+0000", 2020-11-12T17:23:04.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7796999999999999e-05 2020-11-12T17:23:04.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568355+0000", 2020-11-12T17:23:04.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.85e-06 2020-11-12T17:23:04.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568364+0000", 2020-11-12T17:23:04.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108526 2020-11-12T17:23:04.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568472+0000", 2020-11-12T17:23:04.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8536999999999999e-05 2020-11-12T17:23:04.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:04.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568491+0000", 2020-11-12T17:23:04.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073602349999999997 2020-11-12T17:23:04.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.575851+0000", 2020-11-12T17:23:04.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9713e-05 2020-11-12T17:23:04.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:04.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.575941+0000", 2020-11-12T17:23:04.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147885 2020-11-12T17:23:04.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:04.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.576089+0000", 2020-11-12T17:23:04.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005201677 2020-11-12T17:23:04.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:04.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.581290+0000", 2020-11-12T17:23:04.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012535549999999999 2020-11-12T17:23:04.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:04.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582544+0000", 2020-11-12T17:23:04.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8841e-05 2020-11-12T17:23:04.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:04.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582613+0000", 2020-11-12T17:23:04.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4394000000000001e-05 2020-11-12T17:23:04.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:04.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582667+0000", 2020-11-12T17:23:04.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014424143 2020-11-12T17:23:04.976 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.977 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.977 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.977 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:11 3.e 3:78394181:::benchmark_data_smithi036_14212_object1:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.979 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568493+0000", 2020-11-12T17:23:04.979 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.37820132899999998, 2020-11-12T17:23:04.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014311674, 2020-11-12T17:23:04.979 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.979 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:04.980 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.980 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.980 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.980 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11 2020-11-12T17:23:04.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.980 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568493+0000", 2020-11-12T17:23:04.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568493+0000", 2020-11-12T17:23:04.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999208 2020-11-12T17:23:04.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568414+0000", 2020-11-12T17:23:04.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000194277 2020-11-12T17:23:04.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568608+0000", 2020-11-12T17:23:04.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9930000000000001e-05 2020-11-12T17:23:04.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568628+0000", 2020-11-12T17:23:04.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1829999999999994e-06 2020-11-12T17:23:04.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568636+0000", 2020-11-12T17:23:04.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2436999999999999e-05 2020-11-12T17:23:04.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568699+0000", 2020-11-12T17:23:04.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5999999999999996e-06 2020-11-12T17:23:04.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:04.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568708+0000", 2020-11-12T17:23:04.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0079406990000000007 2020-11-12T17:23:04.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.576649+0000", 2020-11-12T17:23:04.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026246700000000001 2020-11-12T17:23:04.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:04.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.576911+0000", 2020-11-12T17:23:04.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00044836799999999999 2020-11-12T17:23:04.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:04.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.577360+0000", 2020-11-12T17:23:04.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0051355790000000004 2020-11-12T17:23:04.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:04.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582495+0000", 2020-11-12T17:23:04.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000239776 2020-11-12T17:23:04.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:04.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582735+0000", 2020-11-12T17:23:04.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5302000000000002e-05 2020-11-12T17:23:04.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:04.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582770+0000", 2020-11-12T17:23:04.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4385999999999999e-05 2020-11-12T17:23:04.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:04.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582805+0000", 2020-11-12T17:23:04.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014311674 2020-11-12T17:23:04.992 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.992 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:04.992 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:04.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.993 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12 3.e 3:78394181:::benchmark_data_smithi036_14212_object1:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:04.993 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568738+0000", 2020-11-12T17:23:04.993 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.377956022, 2020-11-12T17:23:04.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014269195, 2020-11-12T17:23:04.993 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:04.994 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:04.994 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:04.994 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:04.994 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:04.994 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12 2020-11-12T17:23:04.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.994 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:04.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:04.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568738+0000", 2020-11-12T17:23:04.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:04.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:04.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568738+0000", 2020-11-12T17:23:04.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999499 2020-11-12T17:23:04.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:04.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568689+0000", 2020-11-12T17:23:04.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012851099999999999 2020-11-12T17:23:04.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:04.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568817+0000", 2020-11-12T17:23:04.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:23:04.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:04.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568837+0000", 2020-11-12T17:23:04.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.046e-06 2020-11-12T17:23:04.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:04.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568844+0000", 2020-11-12T17:23:04.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0344000000000002e-05 2020-11-12T17:23:04.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:04.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:04.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:04.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568924+0000", 2020-11-12T17:23:04.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9843e-05 2020-11-12T17:23:04.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:05.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568944+0000", 2020-11-12T17:23:05.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0099862800000000002 2020-11-12T17:23:05.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.578930+0000", 2020-11-12T17:23:05.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000116365 2020-11-12T17:23:05.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.579047+0000", 2020-11-12T17:23:05.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022064400000000001 2020-11-12T17:23:05.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.579267+0000", 2020-11-12T17:23:05.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032352990000000001 2020-11-12T17:23:05.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582503+0000", 2020-11-12T17:23:05.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038004899999999998 2020-11-12T17:23:05.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582883+0000", 2020-11-12T17:23:05.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8845999999999998e-05 2020-11-12T17:23:05.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582952+0000", 2020-11-12T17:23:05.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6094999999999997e-05 2020-11-12T17:23:05.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583008+0000", 2020-11-12T17:23:05.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014269195 2020-11-12T17:23:05.006 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.006 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.007 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.007 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:13 3.e 3:78394181:::benchmark_data_smithi036_14212_object1:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.008 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.568972+0000", 2020-11-12T17:23:05.008 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.37772197499999999, 2020-11-12T17:23:05.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014154676999999999, 2020-11-12T17:23:05.009 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.009 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.010 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.010 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 13 2020-11-12T17:23:05.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.010 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568972+0000", 2020-11-12T17:23:05.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568972+0000", 2020-11-12T17:23:05.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999228 2020-11-12T17:23:05.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.568895+0000", 2020-11-12T17:23:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167484 2020-11-12T17:23:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569063+0000", 2020-11-12T17:23:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0166e-05 2020-11-12T17:23:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569083+0000", 2020-11-12T17:23:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1840000000000005e-06 2020-11-12T17:23:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569092+0000", 2020-11-12T17:23:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7426000000000003e-05 2020-11-12T17:23:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569139+0000", 2020-11-12T17:23:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4839999999999998e-06 2020-11-12T17:23:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569147+0000", 2020-11-12T17:23:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010645122999999999 2020-11-12T17:23:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.579792+0000", 2020-11-12T17:23:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027819299999999998 2020-11-12T17:23:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.580070+0000", 2020-11-12T17:23:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052719400000000003 2020-11-12T17:23:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.580597+0000", 2020-11-12T17:23:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020866399999999998 2020-11-12T17:23:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.582684+0000", 2020-11-12T17:23:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037665499999999999 2020-11-12T17:23:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583061+0000", 2020-11-12T17:23:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4992e-05 2020-11-12T17:23:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583096+0000", 2020-11-12T17:23:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1532999999999998e-05 2020-11-12T17:23:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583127+0000", 2020-11-12T17:23:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014154676999999999 2020-11-12T17:23:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:14 3.e 3:78394181:::benchmark_data_smithi036_14212_object1:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.569184+0000", 2020-11-12T17:23:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.37751047799999998, 2020-11-12T17:23:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.015527041, 2020-11-12T17:23:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 14 2020-11-12T17:23:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569184+0000", 2020-11-12T17:23:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569184+0000", 2020-11-12T17:23:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:23:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569142+0000", 2020-11-12T17:23:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012719399999999999 2020-11-12T17:23:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569270+0000", 2020-11-12T17:23:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3079999999999999e-05 2020-11-12T17:23:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569293+0000", 2020-11-12T17:23:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8929999999999999e-06 2020-11-12T17:23:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569300+0000", 2020-11-12T17:23:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010103 2020-11-12T17:23:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569401+0000", 2020-11-12T17:23:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1514000000000003e-05 2020-11-12T17:23:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569442+0000", 2020-11-12T17:23:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011902418 2020-11-12T17:23:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.581345+0000", 2020-11-12T17:23:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000116933 2020-11-12T17:23:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.581462+0000", 2020-11-12T17:23:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022117299999999999 2020-11-12T17:23:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.581683+0000", 2020-11-12T17:23:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013427319999999999 2020-11-12T17:23:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583025+0000", 2020-11-12T17:23:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001601788 2020-11-12T17:23:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.584627+0000", 2020-11-12T17:23:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9601999999999998e-05 2020-11-12T17:23:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.584667+0000", 2020-11-12T17:23:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4227999999999997e-05 2020-11-12T17:23:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.584711+0000", 2020-11-12T17:23:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.015527041 2020-11-12T17:23:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:15 3.e 3:78394181:::benchmark_data_smithi036_14212_object1:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.569501+0000", 2020-11-12T17:23:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.37719354100000002, 2020-11-12T17:23:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0193107, 2020-11-12T17:23:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 15 2020-11-12T17:23:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569501+0000", 2020-11-12T17:23:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569501+0000", 2020-11-12T17:23:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999866 2020-11-12T17:23:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569367+0000", 2020-11-12T17:23:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021778699999999999 2020-11-12T17:23:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569585+0000", 2020-11-12T17:23:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9466999999999998e-05 2020-11-12T17:23:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569604+0000", 2020-11-12T17:23:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5299999999999999e-06 2020-11-12T17:23:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569612+0000", 2020-11-12T17:23:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0469999999999994e-05 2020-11-12T17:23:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569682+0000", 2020-11-12T17:23:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8246000000000001e-05 2020-11-12T17:23:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569701+0000", 2020-11-12T17:23:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013481167 2020-11-12T17:23:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583182+0000", 2020-11-12T17:23:05.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3402e-05 2020-11-12T17:23:05.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583255+0000", 2020-11-12T17:23:05.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017773299999999999 2020-11-12T17:23:05.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583433+0000", 2020-11-12T17:23:05.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001389223 2020-11-12T17:23:05.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.584822+0000", 2020-11-12T17:23:05.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038630299999999999 2020-11-12T17:23:05.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.588685+0000", 2020-11-12T17:23:05.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4969999999999995e-05 2020-11-12T17:23:05.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.588760+0000", 2020-11-12T17:23:05.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1495000000000001e-05 2020-11-12T17:23:05.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.588812+0000", 2020-11-12T17:23:05.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0193107 2020-11-12T17:23:05.053 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.053 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.053 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.053 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:16 3.e 3:78394181:::benchmark_data_smithi036_14212_object1:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.054 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.569710+0000", 2020-11-12T17:23:05.054 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.376984127, 2020-11-12T17:23:05.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.019910036999999998, 2020-11-12T17:23:05.054 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.054 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.054 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.055 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.055 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.055 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16 2020-11-12T17:23:05.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.055 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569710+0000", 2020-11-12T17:23:05.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569710+0000", 2020-11-12T17:23:05.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999485 2020-11-12T17:23:05.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569659+0000", 2020-11-12T17:23:05.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013376300000000001 2020-11-12T17:23:05.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569792+0000", 2020-11-12T17:23:05.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4780000000000001e-05 2020-11-12T17:23:05.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569807+0000", 2020-11-12T17:23:05.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9569999999999996e-06 2020-11-12T17:23:05.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569814+0000", 2020-11-12T17:23:05.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2650000000000003e-05 2020-11-12T17:23:05.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569897+0000", 2020-11-12T17:23:05.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5553000000000002e-05 2020-11-12T17:23:05.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:23:05.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.569912+0000", 2020-11-12T17:23:05.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013949618 2020-11-12T17:23:05.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583862+0000", 2020-11-12T17:23:05.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125525 2020-11-12T17:23:05.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.583988+0000", 2020-11-12T17:23:05.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021886099999999999 2020-11-12T17:23:05.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.584206+0000", 2020-11-12T17:23:05.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00086769600000000005 2020-11-12T17:23:05.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.585074+0000", 2020-11-12T17:23:05.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044804909999999996 2020-11-12T17:23:05.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.589555+0000", 2020-11-12T17:23:05.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6717000000000001e-05 2020-11-12T17:23:05.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.589591+0000", 2020-11-12T17:23:05.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9116e-05 2020-11-12T17:23:05.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.589620+0000", 2020-11-12T17:23:05.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.019910036999999998 2020-11-12T17:23:05.086 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.086 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.086 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.086 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:104 3.e 3:7659503d:::benchmark_data_smithi036_14212_object12:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.086 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.635489+0000", 2020-11-12T17:23:05.087 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.31120508899999999, 2020-11-12T17:23:05.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010651008, 2020-11-12T17:23:05.087 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.087 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.087 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.087 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.087 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.088 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 104 2020-11-12T17:23:05.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.088 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.635489+0000", 2020-11-12T17:23:05.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.635489+0000", 2020-11-12T17:23:05.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:23:05.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.635463+0000", 2020-11-12T17:23:05.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8594e-05 2020-11-12T17:23:05.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.635542+0000", 2020-11-12T17:23:05.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1460000000000002e-06 2020-11-12T17:23:05.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.635551+0000", 2020-11-12T17:23:05.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.206e-06 2020-11-12T17:23:05.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.635555+0000", 2020-11-12T17:23:05.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062445419999999996 2020-11-12T17:23:05.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.641800+0000", 2020-11-12T17:23:05.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000191058 2020-11-12T17:23:05.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.641991+0000", 2020-11-12T17:23:05.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021422600000000001 2020-11-12T17:23:05.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.642205+0000", 2020-11-12T17:23:05.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035567350000000001 2020-11-12T17:23:05.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.645762+0000", 2020-11-12T17:23:05.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000305104 2020-11-12T17:23:05.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.646067+0000", 2020-11-12T17:23:05.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0663e-05 2020-11-12T17:23:05.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.646108+0000", 2020-11-12T17:23:05.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2722000000000003e-05 2020-11-12T17:23:05.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.646140+0000", 2020-11-12T17:23:05.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010651008 2020-11-12T17:23:05.097 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.097 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.097 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.098 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:157 3.f 3:f7fa9cb7:::benchmark_data_smithi036_14212_object19:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.098 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.672362+0000", 2020-11-12T17:23:05.098 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.27433269100000002, 2020-11-12T17:23:05.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011736175, 2020-11-12T17:23:05.098 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.098 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.099 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.099 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.099 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.099 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 157 2020-11-12T17:23:05.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.099 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672362+0000", 2020-11-12T17:23:05.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672362+0000", 2020-11-12T17:23:05.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:23:05.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672334+0000", 2020-11-12T17:23:05.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1446000000000005e-05 2020-11-12T17:23:05.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672426+0000", 2020-11-12T17:23:05.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0112000000000001e-05 2020-11-12T17:23:05.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672436+0000", 2020-11-12T17:23:05.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7400000000000004e-06 2020-11-12T17:23:05.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672440+0000", 2020-11-12T17:23:05.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042157289999999997 2020-11-12T17:23:05.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.676656+0000", 2020-11-12T17:23:05.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119191 2020-11-12T17:23:05.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.676775+0000", 2020-11-12T17:23:05.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000213267 2020-11-12T17:23:05.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.676989+0000", 2020-11-12T17:23:05.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0061596899999999998 2020-11-12T17:23:05.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.683148+0000", 2020-11-12T17:23:05.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00087344600000000005 2020-11-12T17:23:05.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.684022+0000", 2020-11-12T17:23:05.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4014999999999998e-05 2020-11-12T17:23:05.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.684066+0000", 2020-11-12T17:23:05.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2160999999999999e-05 2020-11-12T17:23:05.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.684098+0000", 2020-11-12T17:23:05.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011736175 2020-11-12T17:23:05.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.108 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.109 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.109 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:158 3.f 3:f7fa9cb7:::benchmark_data_smithi036_14212_object19:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.109 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.672488+0000", 2020-11-12T17:23:05.110 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.27420674099999998, 2020-11-12T17:23:05.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011811001, 2020-11-12T17:23:05.110 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.110 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.111 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.111 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 158 2020-11-12T17:23:05.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.111 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672488+0000", 2020-11-12T17:23:05.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672488+0000", 2020-11-12T17:23:05.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:23:05.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672460+0000", 2020-11-12T17:23:05.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7643000000000001e-05 2020-11-12T17:23:05.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672547+0000", 2020-11-12T17:23:05.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8800000000000003e-06 2020-11-12T17:23:05.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672557+0000", 2020-11-12T17:23:05.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4839999999999998e-06 2020-11-12T17:23:05.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.672562+0000", 2020-11-12T17:23:05.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056916839999999998 2020-11-12T17:23:05.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.678253+0000", 2020-11-12T17:23:05.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6298999999999995e-05 2020-11-12T17:23:05.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.678340+0000", 2020-11-12T17:23:05.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014721800000000001 2020-11-12T17:23:05.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.678487+0000", 2020-11-12T17:23:05.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046791230000000003 2020-11-12T17:23:05.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.683166+0000", 2020-11-12T17:23:05.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00103316 2020-11-12T17:23:05.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.684199+0000", 2020-11-12T17:23:05.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4064999999999998e-05 2020-11-12T17:23:05.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.684253+0000", 2020-11-12T17:23:05.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5494999999999997e-05 2020-11-12T17:23:05.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.684299+0000", 2020-11-12T17:23:05.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011811001 2020-11-12T17:23:05.120 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.120 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.120 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.121 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:159 3.f 3:f7fa9cb7:::benchmark_data_smithi036_14212_object19:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.121 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.673512+0000", 2020-11-12T17:23:05.121 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.273182327, 2020-11-12T17:23:05.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010891064000000001, 2020-11-12T17:23:05.121 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.121 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.122 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.122 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.122 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.122 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 159 2020-11-12T17:23:05.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.122 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673512+0000", 2020-11-12T17:23:05.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673512+0000", 2020-11-12T17:23:05.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999929 2020-11-12T17:23:05.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673441+0000", 2020-11-12T17:23:05.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024331099999999999 2020-11-12T17:23:05.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673684+0000", 2020-11-12T17:23:05.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9363999999999999e-05 2020-11-12T17:23:05.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673714+0000", 2020-11-12T17:23:05.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1372000000000001e-05 2020-11-12T17:23:05.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673725+0000", 2020-11-12T17:23:05.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052078130000000004 2020-11-12T17:23:05.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.678933+0000", 2020-11-12T17:23:05.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106309 2020-11-12T17:23:05.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.679039+0000", 2020-11-12T17:23:05.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145678 2020-11-12T17:23:05.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.679185+0000", 2020-11-12T17:23:05.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040007360000000004 2020-11-12T17:23:05.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.683186+0000", 2020-11-12T17:23:05.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001150592 2020-11-12T17:23:05.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.684336+0000", 2020-11-12T17:23:05.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8569999999999998e-05 2020-11-12T17:23:05.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.684375+0000", 2020-11-12T17:23:05.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8495000000000001e-05 2020-11-12T17:23:05.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.684403+0000", 2020-11-12T17:23:05.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010891064000000001 2020-11-12T17:23:05.131 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.132 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.132 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.132 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:160 3.f 3:f7fa9cb7:::benchmark_data_smithi036_14212_object19:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.132 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.673822+0000", 2020-11-12T17:23:05.132 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.27287224900000001, 2020-11-12T17:23:05.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012447341000000001, 2020-11-12T17:23:05.133 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.133 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.133 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.133 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.133 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.133 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 160 2020-11-12T17:23:05.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.134 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673822+0000", 2020-11-12T17:23:05.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673822+0000", 2020-11-12T17:23:05.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999413 2020-11-12T17:23:05.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673764+0000", 2020-11-12T17:23:05.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017550000000000001 2020-11-12T17:23:05.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673939+0000", 2020-11-12T17:23:05.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2524e-05 2020-11-12T17:23:05.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673962+0000", 2020-11-12T17:23:05.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0192e-05 2020-11-12T17:23:05.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.673972+0000", 2020-11-12T17:23:05.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055821309999999997 2020-11-12T17:23:05.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.679554+0000", 2020-11-12T17:23:05.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7838999999999996e-05 2020-11-12T17:23:05.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.679652+0000", 2020-11-12T17:23:05.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014119299999999999 2020-11-12T17:23:05.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.679793+0000", 2020-11-12T17:23:05.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034055579999999999 2020-11-12T17:23:05.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.683199+0000", 2020-11-12T17:23:05.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029861089999999998 2020-11-12T17:23:05.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.686185+0000", 2020-11-12T17:23:05.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8340999999999997e-05 2020-11-12T17:23:05.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.686233+0000", 2020-11-12T17:23:05.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6488e-05 2020-11-12T17:23:05.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.686270+0000", 2020-11-12T17:23:05.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012447341000000001 2020-11-12T17:23:05.142 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.142 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.142 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.143 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:233 3.d 3:b8f061cd:::benchmark_data_smithi036_14212_object29:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.143 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.726239+0000", 2020-11-12T17:23:05.143 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.220455555, 2020-11-12T17:23:05.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011258868999999999, 2020-11-12T17:23:05.143 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.144 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.144 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.144 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.144 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.144 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 233 2020-11-12T17:23:05.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.144 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726239+0000", 2020-11-12T17:23:05.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726239+0000", 2020-11-12T17:23:05.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999452 2020-11-12T17:23:05.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726184+0000", 2020-11-12T17:23:05.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014697700000000001 2020-11-12T17:23:05.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726331+0000", 2020-11-12T17:23:05.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3527999999999999e-05 2020-11-12T17:23:05.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726355+0000", 2020-11-12T17:23:05.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3385e-05 2020-11-12T17:23:05.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726368+0000", 2020-11-12T17:23:05.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6952000000000003e-05 2020-11-12T17:23:05.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726465+0000", 2020-11-12T17:23:05.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00084248299999999999 2020-11-12T17:23:05.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.727307+0000", 2020-11-12T17:23:05.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019980900000000001 2020-11-12T17:23:05.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:05.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.727507+0000", 2020-11-12T17:23:05.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077430470000000003 2020-11-12T17:23:05.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.735250+0000", 2020-11-12T17:23:05.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021216939999999999 2020-11-12T17:23:05.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.737372+0000", 2020-11-12T17:23:05.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1644000000000006e-05 2020-11-12T17:23:05.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.737464+0000", 2020-11-12T17:23:05.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4173e-05 2020-11-12T17:23:05.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.737498+0000", 2020-11-12T17:23:05.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011258868999999999 2020-11-12T17:23:05.154 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.154 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.154 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.154 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:234 3.d 3:b8f061cd:::benchmark_data_smithi036_14212_object29:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.155 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.726434+0000", 2020-11-12T17:23:05.155 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.220260543, 2020-11-12T17:23:05.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011194769, 2020-11-12T17:23:05.155 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.155 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.155 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.155 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.156 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.156 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 234 2020-11-12T17:23:05.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.156 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726434+0000", 2020-11-12T17:23:05.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726434+0000", 2020-11-12T17:23:05.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:23:05.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726403+0000", 2020-11-12T17:23:05.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102497 2020-11-12T17:23:05.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726506+0000", 2020-11-12T17:23:05.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5495e-05 2020-11-12T17:23:05.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726521+0000", 2020-11-12T17:23:05.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.171e-05 2020-11-12T17:23:05.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726533+0000", 2020-11-12T17:23:05.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018417889999999999 2020-11-12T17:23:05.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728375+0000", 2020-11-12T17:23:05.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114231 2020-11-12T17:23:05.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728489+0000", 2020-11-12T17:23:05.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020943200000000001 2020-11-12T17:23:05.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:05.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728698+0000", 2020-11-12T17:23:05.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0065581210000000001 2020-11-12T17:23:05.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.735256+0000", 2020-11-12T17:23:05.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022946379999999999 2020-11-12T17:23:05.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.737551+0000", 2020-11-12T17:23:05.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6149000000000001e-05 2020-11-12T17:23:05.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.737597+0000", 2020-11-12T17:23:05.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1448000000000001e-05 2020-11-12T17:23:05.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.737629+0000", 2020-11-12T17:23:05.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011194769 2020-11-12T17:23:05.165 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.165 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.165 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.165 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:235 3.d 3:b8f061cd:::benchmark_data_smithi036_14212_object29:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.165 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.726591+0000", 2020-11-12T17:23:05.166 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.22010374299999999, 2020-11-12T17:23:05.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014567607999999999, 2020-11-12T17:23:05.166 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.166 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.166 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.166 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.166 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.167 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 235 2020-11-12T17:23:05.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.167 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726591+0000", 2020-11-12T17:23:05.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726591+0000", 2020-11-12T17:23:05.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:23:05.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.726561+0000", 2020-11-12T17:23:05.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001906156 2020-11-12T17:23:05.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728467+0000", 2020-11-12T17:23:05.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4032000000000001e-05 2020-11-12T17:23:05.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728481+0000", 2020-11-12T17:23:05.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0149000000000001e-05 2020-11-12T17:23:05.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728491+0000", 2020-11-12T17:23:05.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00072958599999999995 2020-11-12T17:23:05.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.729221+0000", 2020-11-12T17:23:05.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000118114 2020-11-12T17:23:05.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.729339+0000", 2020-11-12T17:23:05.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028769400000000001 2020-11-12T17:23:05.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:05.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.729626+0000", 2020-11-12T17:23:05.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056342930000000003 2020-11-12T17:23:05.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.735261+0000", 2020-11-12T17:23:05.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0057791759999999996 2020-11-12T17:23:05.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.741040+0000", 2020-11-12T17:23:05.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3495000000000001e-05 2020-11-12T17:23:05.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.741103+0000", 2020-11-12T17:23:05.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5022999999999998e-05 2020-11-12T17:23:05.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.741158+0000", 2020-11-12T17:23:05.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014567607999999999 2020-11-12T17:23:05.180 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.180 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.181 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.181 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:236 3.d 3:b8f061cd:::benchmark_data_smithi036_14212_object29:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.182 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.728553+0000", 2020-11-12T17:23:05.182 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.218141943, 2020-11-12T17:23:05.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013223161000000001, 2020-11-12T17:23:05.183 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.183 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.183 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.183 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.184 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.184 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 236 2020-11-12T17:23:05.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.185 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728553+0000", 2020-11-12T17:23:05.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728553+0000", 2020-11-12T17:23:05.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:05.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728521+0000", 2020-11-12T17:23:05.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.365e-05 2020-11-12T17:23:05.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728614+0000", 2020-11-12T17:23:05.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:23:05.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728628+0000", 2020-11-12T17:23:05.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8750000000000002e-06 2020-11-12T17:23:05.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728635+0000", 2020-11-12T17:23:05.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015274939999999999 2020-11-12T17:23:05.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.730162+0000", 2020-11-12T17:23:05.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011865 2020-11-12T17:23:05.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.730281+0000", 2020-11-12T17:23:05.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000329353 2020-11-12T17:23:05.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:05.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.730610+0000", 2020-11-12T17:23:05.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004679384 2020-11-12T17:23:05.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.735290+0000", 2020-11-12T17:23:05.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546740000000003 2020-11-12T17:23:05.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.741645+0000", 2020-11-12T17:23:05.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0531999999999995e-05 2020-11-12T17:23:05.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.741715+0000", 2020-11-12T17:23:05.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0646999999999997e-05 2020-11-12T17:23:05.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.741776+0000", 2020-11-12T17:23:05.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013223161000000001 2020-11-12T17:23:05.202 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.203 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.203 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.204 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:237 3.d 3:b8f061cd:::benchmark_data_smithi036_14212_object29:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.204 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.728685+0000", 2020-11-12T17:23:05.204 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.218009699, 2020-11-12T17:23:05.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013391603, 2020-11-12T17:23:05.204 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.204 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.205 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.205 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.205 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.205 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 237 2020-11-12T17:23:05.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.206 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728685+0000", 2020-11-12T17:23:05.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728685+0000", 2020-11-12T17:23:05.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:23:05.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728656+0000", 2020-11-12T17:23:05.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2736000000000001e-05 2020-11-12T17:23:05.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728749+0000", 2020-11-12T17:23:05.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1473e-05 2020-11-12T17:23:05.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728760+0000", 2020-11-12T17:23:05.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6954000000000001e-05 2020-11-12T17:23:05.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728777+0000", 2020-11-12T17:23:05.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022954030000000001 2020-11-12T17:23:05.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.731072+0000", 2020-11-12T17:23:05.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1217999999999994e-05 2020-11-12T17:23:05.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.731154+0000", 2020-11-12T17:23:05.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015654699999999999 2020-11-12T17:23:05.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:05.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.731310+0000", 2020-11-12T17:23:05.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040044490000000002 2020-11-12T17:23:05.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.735315+0000", 2020-11-12T17:23:05.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066633619999999999 2020-11-12T17:23:05.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.741978+0000", 2020-11-12T17:23:05.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4880000000000002e-05 2020-11-12T17:23:05.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.742043+0000", 2020-11-12T17:23:05.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3577000000000001e-05 2020-11-12T17:23:05.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.742076+0000", 2020-11-12T17:23:05.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013391603 2020-11-12T17:23:05.220 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.221 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.221 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.222 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:238 3.d 3:b8f061cd:::benchmark_data_smithi036_14212_object29:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.222 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.728827+0000", 2020-11-12T17:23:05.222 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.217867487, 2020-11-12T17:23:05.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013404951999999999, 2020-11-12T17:23:05.223 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.223 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.223 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.224 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.224 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.224 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 238 2020-11-12T17:23:05.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.225 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728827+0000", 2020-11-12T17:23:05.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728827+0000", 2020-11-12T17:23:05.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:23:05.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728797+0000", 2020-11-12T17:23:05.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8115000000000005e-05 2020-11-12T17:23:05.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728895+0000", 2020-11-12T17:23:05.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1516e-05 2020-11-12T17:23:05.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728907+0000", 2020-11-12T17:23:05.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7989999999999999e-06 2020-11-12T17:23:05.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.728912+0000", 2020-11-12T17:23:05.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027946759999999998 2020-11-12T17:23:05.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.731707+0000", 2020-11-12T17:23:05.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8255999999999999e-05 2020-11-12T17:23:05.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.731765+0000", 2020-11-12T17:23:05.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000132764 2020-11-12T17:23:05.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:05.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.731898+0000", 2020-11-12T17:23:05.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003469232 2020-11-12T17:23:05.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.735367+0000", 2020-11-12T17:23:05.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0067724619999999999 2020-11-12T17:23:05.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.742140+0000", 2020-11-12T17:23:05.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7184e-05 2020-11-12T17:23:05.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.742197+0000", 2020-11-12T17:23:05.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5052999999999998e-05 2020-11-12T17:23:05.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.742232+0000", 2020-11-12T17:23:05.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013404951999999999 2020-11-12T17:23:05.243 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.244 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.244 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.245 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:239 3.d 3:b8f061cd:::benchmark_data_smithi036_14212_object29:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.245 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.730574+0000", 2020-11-12T17:23:05.245 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.21612055999999999, 2020-11-12T17:23:05.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011764659, 2020-11-12T17:23:05.246 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:05.246 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.246 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:05.246 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:05.246 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.247 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 239 2020-11-12T17:23:05.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.247 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:05.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:05.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.730574+0000", 2020-11-12T17:23:05.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:05.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:05.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.730574+0000", 2020-11-12T17:23:05.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:23:05.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:05.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.730539+0000", 2020-11-12T17:23:05.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100919 2020-11-12T17:23:05.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:05.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.730640+0000", 2020-11-12T17:23:05.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4598e-05 2020-11-12T17:23:05.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:05.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.730655+0000", 2020-11-12T17:23:05.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4400000000000005e-06 2020-11-12T17:23:05.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.730663+0000", 2020-11-12T17:23:05.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016694520000000001 2020-11-12T17:23:05.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:05.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.732333+0000", 2020-11-12T17:23:05.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107327 2020-11-12T17:23:05.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:05.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.732440+0000", 2020-11-12T17:23:05.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018890700000000001 2020-11-12T17:23:05.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:05.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.732629+0000", 2020-11-12T17:23:05.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027455729999999999 2020-11-12T17:23:05.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:05.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.735374+0000", 2020-11-12T17:23:05.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068928119999999999 2020-11-12T17:23:05.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.742267+0000", 2020-11-12T17:23:05.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8822999999999997e-05 2020-11-12T17:23:05.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:05.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.742306+0000", 2020-11-12T17:23:05.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2512000000000003e-05 2020-11-12T17:23:05.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:05.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:05.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:05.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.742339+0000", 2020-11-12T17:23:05.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011764659 2020-11-12T17:23:05.266 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.266 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.266 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.266 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:05.266 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:05.266 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:05.268 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:05.269 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:05.268+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:05.368 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:05.366+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:05.411 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:888 3.1 3:8d35da87:::benchmark_data_smithi036_14212_object110:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.394703+0000", 2020-11-12T17:23:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.016612696, 2020-11-12T17:23:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016636150999999998, 2020-11-12T17:23:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 888 2020-11-12T17:23:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.394703+0000", 2020-11-12T17:23:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.394703+0000", 2020-11-12T17:23:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.394674+0000", 2020-11-12T17:23:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5439000000000006e-05 2020-11-12T17:23:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.394759+0000", 2020-11-12T17:23:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2084e-05 2020-11-12T17:23:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.394771+0000", 2020-11-12T17:23:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6889999999999998e-06 2020-11-12T17:23:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.394778+0000", 2020-11-12T17:23:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9328999999999998e-05 2020-11-12T17:23:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.394867+0000", 2020-11-12T17:23:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1230999999999994e-05 2020-11-12T17:23:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.394959+0000", 2020-11-12T17:23:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011888 2020-11-12T17:23:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.395077+0000", 2020-11-12T17:23:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052974110000000001 2020-11-12T17:23:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.400375+0000", 2020-11-12T17:23:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056715029999999996 2020-11-12T17:23:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.302438918, 2020-11-12T17:23:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30256998099999999, 2020-11-12T17:23:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:23:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:23:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:23:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:23:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:23:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:23:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:23:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:23:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:23:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:23:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:23:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:23:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:23:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:23:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:23:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:23:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0069788419999999999 2020-11-12T17:23:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:05.430 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 2 2020-11-12T17:23:05.430 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:05.431 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:05.479 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:05.474+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:05.483 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:23:05.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 1 16 1043 1027 8.02302 8.02344 0.0113655 0.014856 2020-11-12T17:23:05.591 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:05.586+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:05.601 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:05.602 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:05.602 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:05.602 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:05.603 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:05.614 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:05.694 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:05.692+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:05.780 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:05.789 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:05.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:05.790 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:05.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.790 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:254 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.790 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:05.791 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.0347826410000001, 2020-11-12T17:23:05.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023, 2020-11-12T17:23:05.791 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.791 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.791 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.791 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.791 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.792 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 254 2020-11-12T17:23:05.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.792 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:05.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:05.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:05.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741501+0000", 2020-11-12T17:23:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8440000000000002e-05 2020-11-12T17:23:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741570+0000", 2020-11-12T17:23:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4515000000000001e-05 2020-11-12T17:23:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741584+0000", 2020-11-12T17:23:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5699999999999998e-06 2020-11-12T17:23:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741591+0000", 2020-11-12T17:23:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033344310000000001 2020-11-12T17:23:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744925+0000", 2020-11-12T17:23:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011066 2020-11-12T17:23:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745036+0000", 2020-11-12T17:23:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015032199999999999 2020-11-12T17:23:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745186+0000", 2020-11-12T17:23:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020296229999999999 2020-11-12T17:23:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747216+0000", 2020-11-12T17:23:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21356234399999999 2020-11-12T17:23:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960778+0000", 2020-11-12T17:23:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011052000000000001 2020-11-12T17:23:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960889+0000", 2020-11-12T17:23:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014397999999999999 2020-11-12T17:23:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961033+0000", 2020-11-12T17:23:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023 2020-11-12T17:23:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:255 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.0322148099999999, 2020-11-12T17:23:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286, 2020-11-12T17:23:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 255 2020-11-12T17:23:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744038+0000", 2020-11-12T17:23:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000142953 2020-11-12T17:23:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744181+0000", 2020-11-12T17:23:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4383999999999999e-05 2020-11-12T17:23:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744206+0000", 2020-11-12T17:23:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0786e-05 2020-11-12T17:23:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744217+0000", 2020-11-12T17:23:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001465002 2020-11-12T17:23:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745682+0000", 2020-11-12T17:23:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000126458 2020-11-12T17:23:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745808+0000", 2020-11-12T17:23:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000164413 2020-11-12T17:23:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745972+0000", 2020-11-12T17:23:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019412520000000001 2020-11-12T17:23:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747914+0000", 2020-11-12T17:23:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.213271294 2020-11-12T17:23:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961185+0000", 2020-11-12T17:23:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001472 2020-11-12T17:23:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961332+0000", 2020-11-12T17:23:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108687 2020-11-12T17:23:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961441+0000", 2020-11-12T17:23:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286 2020-11-12T17:23:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:256 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.030604125, 2020-11-12T17:23:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001, 2020-11-12T17:23:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 256 2020-11-12T17:23:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745651+0000", 2020-11-12T17:23:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000140753 2020-11-12T17:23:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745792+0000", 2020-11-12T17:23:05.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3481e-05 2020-11-12T17:23:05.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745806+0000", 2020-11-12T17:23:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8069999999999999e-06 2020-11-12T17:23:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745810+0000", 2020-11-12T17:23:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001457563 2020-11-12T17:23:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747268+0000", 2020-11-12T17:23:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116141 2020-11-12T17:23:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747384+0000", 2020-11-12T17:23:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013822899999999999 2020-11-12T17:23:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747522+0000", 2020-11-12T17:23:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079223100000000001 2020-11-12T17:23:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.748315+0000", 2020-11-12T17:23:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21734695200000001 2020-11-12T17:23:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965662+0000", 2020-11-12T17:23:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011252999999999999 2020-11-12T17:23:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965774+0000", 2020-11-12T17:23:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015996700000000001 2020-11-12T17:23:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965934+0000", 2020-11-12T17:23:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001 2020-11-12T17:23:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:337 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.96746852900000002, 2020-11-12T17:23:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089, 2020-11-12T17:23:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 337 2020-11-12T17:23:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:05.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:05.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808793+0000", 2020-11-12T17:23:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012736400000000001 2020-11-12T17:23:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808920+0000", 2020-11-12T17:23:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7972e-05 2020-11-12T17:23:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808938+0000", 2020-11-12T17:23:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5259999999999999e-06 2020-11-12T17:23:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808948+0000", 2020-11-12T17:23:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3725000000000001e-05 2020-11-12T17:23:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809041+0000", 2020-11-12T17:23:05.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026396500000000001 2020-11-12T17:23:05.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809305+0000", 2020-11-12T17:23:05.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000287686 2020-11-12T17:23:05.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809593+0000", 2020-11-12T17:23:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049805869999999999 2020-11-12T17:23:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814574+0000", 2020-11-12T17:23:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151510007 2020-11-12T17:23:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966084+0000", 2020-11-12T17:23:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110937 2020-11-12T17:23:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966195+0000", 2020-11-12T17:23:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5339999999999994e-05 2020-11-12T17:23:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966270+0000", 2020-11-12T17:23:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089 2020-11-12T17:23:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:338 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.96724569199999999, 2020-11-12T17:23:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999, 2020-11-12T17:23:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.853 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 338 2020-11-12T17:23:05.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.853 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:05.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809008+0000", 2020-11-12T17:23:05.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000123659 2020-11-12T17:23:05.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809131+0000", 2020-11-12T17:23:05.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4180000000000003e-06 2020-11-12T17:23:05.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809141+0000", 2020-11-12T17:23:05.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2680000000000002e-06 2020-11-12T17:23:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809146+0000", 2020-11-12T17:23:05.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011238120000000001 2020-11-12T17:23:05.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810270+0000", 2020-11-12T17:23:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9084000000000003e-05 2020-11-12T17:23:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810359+0000", 2020-11-12T17:23:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186856 2020-11-12T17:23:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810546+0000", 2020-11-12T17:23:05.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040397699999999998 2020-11-12T17:23:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814586+0000", 2020-11-12T17:23:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15495921400000001 2020-11-12T17:23:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969545+0000", 2020-11-12T17:23:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012353700000000001 2020-11-12T17:23:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969668+0000", 2020-11-12T17:23:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013906300000000001 2020-11-12T17:23:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969807+0000", 2020-11-12T17:23:05.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999 2020-11-12T17:23:05.872 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.873 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.873 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.874 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:339 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.874 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:05.874 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.96710879599999999, 2020-11-12T17:23:05.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999, 2020-11-12T17:23:05.875 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.875 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.875 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.876 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.876 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.876 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 339 2020-11-12T17:23:05.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.877 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:05.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:05.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:05.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809174+0000", 2020-11-12T17:23:05.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4807000000000005e-05 2020-11-12T17:23:05.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809238+0000", 2020-11-12T17:23:05.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2660000000000001e-06 2020-11-12T17:23:05.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809247+0000", 2020-11-12T17:23:05.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1060000000000002e-06 2020-11-12T17:23:05.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809251+0000", 2020-11-12T17:23:05.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001789286 2020-11-12T17:23:05.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811040+0000", 2020-11-12T17:23:05.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013621 2020-11-12T17:23:05.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811176+0000", 2020-11-12T17:23:05.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023835800000000001 2020-11-12T17:23:05.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811415+0000", 2020-11-12T17:23:05.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031774529999999998 2020-11-12T17:23:05.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814592+0000", 2020-11-12T17:23:05.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15532954199999999 2020-11-12T17:23:05.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969922+0000", 2020-11-12T17:23:05.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021167000000000001 2020-11-12T17:23:05.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970133+0000", 2020-11-12T17:23:05.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7349999999999995e-05 2020-11-12T17:23:05.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970231+0000", 2020-11-12T17:23:05.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999 2020-11-12T17:23:05.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.887 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.888 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:340 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.888 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:05.888 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.96657668699999999, 2020-11-12T17:23:05.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999, 2020-11-12T17:23:05.888 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.889 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.889 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 340 2020-11-12T17:23:05.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.889 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:05.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:05.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999958 2020-11-12T17:23:05.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809686+0000", 2020-11-12T17:23:05.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9798999999999999e-05 2020-11-12T17:23:05.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809776+0000", 2020-11-12T17:23:05.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2833999999999999e-05 2020-11-12T17:23:05.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809788+0000", 2020-11-12T17:23:05.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-06 2020-11-12T17:23:05.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809794+0000", 2020-11-12T17:23:05.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020989979999999999 2020-11-12T17:23:05.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811893+0000", 2020-11-12T17:23:05.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012502300000000001 2020-11-12T17:23:05.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812018+0000", 2020-11-12T17:23:05.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013605900000000001 2020-11-12T17:23:05.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812154+0000", 2020-11-12T17:23:05.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003821344 2020-11-12T17:23:05.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815975+0000", 2020-11-12T17:23:05.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15447417999999999 2020-11-12T17:23:05.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970449+0000", 2020-11-12T17:23:05.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2955999999999997e-05 2020-11-12T17:23:05.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970532+0000", 2020-11-12T17:23:05.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6341999999999998e-05 2020-11-12T17:23:05.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970578+0000", 2020-11-12T17:23:05.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999 2020-11-12T17:23:05.899 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.899 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.899 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.900 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:341 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.900 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:05.900 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.96645311, 2020-11-12T17:23:05.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999, 2020-11-12T17:23:05.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.900 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.900 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.901 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 341 2020-11-12T17:23:05.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.901 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:05.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:05.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:23:05.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809810+0000", 2020-11-12T17:23:05.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129682 2020-11-12T17:23:05.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809940+0000", 2020-11-12T17:23:05.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2874000000000002e-05 2020-11-12T17:23:05.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809963+0000", 2020-11-12T17:23:05.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8199999999999997e-06 2020-11-12T17:23:05.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809971+0000", 2020-11-12T17:23:05.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026854119999999999 2020-11-12T17:23:05.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812656+0000", 2020-11-12T17:23:05.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000136685 2020-11-12T17:23:05.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812793+0000", 2020-11-12T17:23:05.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000267831 2020-11-12T17:23:05.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813061+0000", 2020-11-12T17:23:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029210490000000002 2020-11-12T17:23:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815982+0000", 2020-11-12T17:23:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15468012 2020-11-12T17:23:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970662+0000", 2020-11-12T17:23:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111106 2020-11-12T17:23:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970773+0000", 2020-11-12T17:23:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111366 2020-11-12T17:23:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970884+0000", 2020-11-12T17:23:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999 2020-11-12T17:23:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:342 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.96627708899999998, 2020-11-12T17:23:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999, 2020-11-12T17:23:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 342 2020-11-12T17:23:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810002+0000", 2020-11-12T17:23:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0510000000000001e-05 2020-11-12T17:23:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810072+0000", 2020-11-12T17:23:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9950000000000005e-06 2020-11-12T17:23:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810080+0000", 2020-11-12T17:23:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0779999999999997e-06 2020-11-12T17:23:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810084+0000", 2020-11-12T17:23:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003443944 2020-11-12T17:23:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813528+0000", 2020-11-12T17:23:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010784 2020-11-12T17:23:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813636+0000", 2020-11-12T17:23:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019826199999999999 2020-11-12T17:23:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813834+0000", 2020-11-12T17:23:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021549550000000001 2020-11-12T17:23:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815989+0000", 2020-11-12T17:23:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15502450600000001 2020-11-12T17:23:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971014+0000", 2020-11-12T17:23:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6885999999999996e-05 2020-11-12T17:23:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971081+0000", 2020-11-12T17:23:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9054000000000006e-05 2020-11-12T17:23:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971160+0000", 2020-11-12T17:23:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999 2020-11-12T17:23:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:343 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.965974102, 2020-11-12T17:23:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001, 2020-11-12T17:23:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 343 2020-11-12T17:23:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810292+0000", 2020-11-12T17:23:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012150399999999999 2020-11-12T17:23:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810413+0000", 2020-11-12T17:23:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6617e-05 2020-11-12T17:23:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810430+0000", 2020-11-12T17:23:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414000000000001e-05 2020-11-12T17:23:05.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810440+0000", 2020-11-12T17:23:05.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042287779999999999 2020-11-12T17:23:05.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814669+0000", 2020-11-12T17:23:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012893400000000001 2020-11-12T17:23:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814798+0000", 2020-11-12T17:23:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187195 2020-11-12T17:23:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814985+0000", 2020-11-12T17:23:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001013566 2020-11-12T17:23:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815999+0000", 2020-11-12T17:23:05.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15527013200000001 2020-11-12T17:23:05.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971269+0000", 2020-11-12T17:23:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010525 2020-11-12T17:23:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971374+0000", 2020-11-12T17:23:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-05 2020-11-12T17:23:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971425+0000", 2020-11-12T17:23:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001 2020-11-12T17:23:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:344 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.96324929800000003, 2020-11-12T17:23:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999, 2020-11-12T17:23:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 344 2020-11-12T17:23:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813023+0000", 2020-11-12T17:23:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5440999999999996e-05 2020-11-12T17:23:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813119+0000", 2020-11-12T17:23:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2757e-05 2020-11-12T17:23:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813131+0000", 2020-11-12T17:23:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8279999999999997e-06 2020-11-12T17:23:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813138+0000", 2020-11-12T17:23:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002273653 2020-11-12T17:23:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815412+0000", 2020-11-12T17:23:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012572199999999999 2020-11-12T17:23:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815537+0000", 2020-11-12T17:23:05.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013668400000000001 2020-11-12T17:23:05.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815674+0000", 2020-11-12T17:23:05.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001073863 2020-11-12T17:23:05.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.816748+0000", 2020-11-12T17:23:05.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154859634 2020-11-12T17:23:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971608+0000", 2020-11-12T17:23:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7041999999999999e-05 2020-11-12T17:23:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971675+0000", 2020-11-12T17:23:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9370000000000002e-05 2020-11-12T17:23:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971734+0000", 2020-11-12T17:23:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999 2020-11-12T17:23:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:369 3.1 3:8dcbed5a:::benchmark_data_smithi036_14212_object46:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.881426+0000", 2020-11-12T17:23:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.89487794399999998, 2020-11-12T17:23:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.090490853999999996, 2020-11-12T17:23:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 369 2020-11-12T17:23:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881426+0000", 2020-11-12T17:23:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881426+0000", 2020-11-12T17:23:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:23:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881390+0000", 2020-11-12T17:23:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000122019 2020-11-12T17:23:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881512+0000", 2020-11-12T17:23:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0440000000000001e-05 2020-11-12T17:23:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881533+0000", 2020-11-12T17:23:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2523e-05 2020-11-12T17:23:05.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881545+0000", 2020-11-12T17:23:05.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9833000000000005e-05 2020-11-12T17:23:05.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881635+0000", 2020-11-12T17:23:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027254100000000001 2020-11-12T17:23:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881907+0000", 2020-11-12T17:23:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026097700000000002 2020-11-12T17:23:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:05.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.882168+0000", 2020-11-12T17:23:05.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001382376 2020-11-12T17:23:05.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.883551+0000", 2020-11-12T17:23:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.088256887000000006 2020-11-12T17:23:05.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971808+0000", 2020-11-12T17:23:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2611999999999997e-05 2020-11-12T17:23:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971860+0000", 2020-11-12T17:23:05.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7014e-05 2020-11-12T17:23:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971917+0000", 2020-11-12T17:23:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.090490853999999996 2020-11-12T17:23:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.985 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.986 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:05.986 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:05.986 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.66742727599999996, 2020-11-12T17:23:05.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:23:05.987 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.987 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:05.987 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:05.987 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:05.987 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:05.987 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:23:05.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.988 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:05.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:05.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:05.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:05.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:05.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:23:05.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:23:05.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:05.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:23:05.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:23:05.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:05.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:23:05.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:23:05.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:05.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:23:05.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:23:05.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:05.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:23:05.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:23:05.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:05.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:23:05.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:23:05.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:05.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:23:05.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:23:05.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:05.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:23:05.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:23:05.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:05.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:23:05.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:23:05.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:05.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:23:05.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:23:05.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:05.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:23:05.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:23:05.996 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.997 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:05.997 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:05.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.997 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:23:05.998 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:05.998 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.66033547999999997, 2020-11-12T17:23:05.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:23:05.998 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:05.998 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:05.999 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:05.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:05.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:05.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:05.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:05.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:05.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:06.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:06.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:06.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:06.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:23:06.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:23:06.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:06.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:23:06.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:23:06.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:06.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:23:06.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:23:06.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:06.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:23:06.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:23:06.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:06.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:23:06.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:23:06.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:06.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:23:06.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:23:06.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:06.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:23:06.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:23:06.005 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.005 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:06.005 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.005 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:800 3.1 3:89cec530:::benchmark_data_smithi036_14212_object99:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:06.005 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.309954+0000", 2020-11-12T17:23:06.006 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.46634999100000002, 2020-11-12T17:23:06.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.081320585000000001, 2020-11-12T17:23:06.006 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:06.006 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:06.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:06.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:06.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:06.007 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 800 2020-11-12T17:23:06.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.007 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:06.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:06.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.309954+0000", 2020-11-12T17:23:06.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:06.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:06.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.309954+0000", 2020-11-12T17:23:06.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:06.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:06.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.309922+0000", 2020-11-12T17:23:06.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117343 2020-11-12T17:23:06.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:06.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.310039+0000", 2020-11-12T17:23:06.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2055999999999999e-05 2020-11-12T17:23:06.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:06.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.310051+0000", 2020-11-12T17:23:06.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9270000000000002e-06 2020-11-12T17:23:06.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:06.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.310057+0000", 2020-11-12T17:23:06.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0076449559999999996 2020-11-12T17:23:06.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:06.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.317702+0000", 2020-11-12T17:23:06.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112568 2020-11-12T17:23:06.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:06.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.317815+0000", 2020-11-12T17:23:06.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196761 2020-11-12T17:23:06.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:06.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.318011+0000", 2020-11-12T17:23:06.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026124949999999998 2020-11-12T17:23:06.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:06.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.320624+0000", 2020-11-12T17:23:06.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.070567863999999994 2020-11-12T17:23:06.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:06.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.391192+0000", 2020-11-12T17:23:06.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6972999999999999e-05 2020-11-12T17:23:06.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:06.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.391239+0000", 2020-11-12T17:23:06.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6242000000000003e-05 2020-11-12T17:23:06.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:06.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.391275+0000", 2020-11-12T17:23:06.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.081320585000000001 2020-11-12T17:23:06.015 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.016 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:06.016 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.016 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1032 3.6 3:6c903521:::benchmark_data_smithi036_14212_object128:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:06.016 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.544141+0000", 2020-11-12T17:23:06.016 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.23216320200000001, 2020-11-12T17:23:06.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098369252000000004, 2020-11-12T17:23:06.017 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:06.017 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:06.017 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:06.017 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:06.017 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:06.017 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1032 2020-11-12T17:23:06.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.017 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:06.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:06.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544141+0000", 2020-11-12T17:23:06.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:06.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:06.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544141+0000", 2020-11-12T17:23:06.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:23:06.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:06.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544123+0000", 2020-11-12T17:23:06.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3188e-05 2020-11-12T17:23:06.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:06.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544177+0000", 2020-11-12T17:23:06.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6169e-05 2020-11-12T17:23:06.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:06.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544203+0000", 2020-11-12T17:23:06.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7700000000000001e-06 2020-11-12T17:23:06.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:06.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544211+0000", 2020-11-12T17:23:06.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068689559999999998 2020-11-12T17:23:06.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:06.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.551080+0000", 2020-11-12T17:23:06.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153287 2020-11-12T17:23:06.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:06.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.551233+0000", 2020-11-12T17:23:06.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025069399999999998 2020-11-12T17:23:06.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:06.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.551484+0000", 2020-11-12T17:23:06.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0043336549999999996 2020-11-12T17:23:06.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:06.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.555817+0000", 2020-11-12T17:23:06.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086549730000000005 2020-11-12T17:23:06.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:06.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642367+0000", 2020-11-12T17:23:06.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6860999999999994e-05 2020-11-12T17:23:06.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:06.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642454+0000", 2020-11-12T17:23:06.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6699e-05 2020-11-12T17:23:06.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:06.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642510+0000", 2020-11-12T17:23:06.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098369252000000004 2020-11-12T17:23:06.044 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.044 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:06.044 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.045 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:1032 3.6 e23/20 ondisk, result = 0)", 2020-11-12T17:23:06.045 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.556152+0000", 2020-11-12T17:23:06.045 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.220152088, 2020-11-12T17:23:06.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086367480999999996, 2020-11-12T17:23:06.045 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:06.046 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:06.046 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:06.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:06.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.556152+0000", 2020-11-12T17:23:06.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:06.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:06.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.556152+0000", 2020-11-12T17:23:06.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:23:06.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:06.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.556135+0000", 2020-11-12T17:23:06.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5197000000000001e-05 2020-11-12T17:23:06.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:06.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.556180+0000", 2020-11-12T17:23:06.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086085643000000003 2020-11-12T17:23:06.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:06.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642266+0000", 2020-11-12T17:23:06.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0159999999999999e-05 2020-11-12T17:23:06.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:06.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642276+0000", 2020-11-12T17:23:06.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0067999999999994e-05 2020-11-12T17:23:06.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:06.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642346+0000", 2020-11-12T17:23:06.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1042e-05 2020-11-12T17:23:06.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:06.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642357+0000", 2020-11-12T17:23:06.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016288699999999999 2020-11-12T17:23:06.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:06.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642520+0000", 2020-11-12T17:23:06.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086367480999999996 2020-11-12T17:23:06.055 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.055 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:06.055 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.056 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1144 3.6 3:6f81714e:::benchmark_data_smithi036_14212_object142:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:06.056 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.657289+0000", 2020-11-12T17:23:06.056 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.119015676, 2020-11-12T17:23:06.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.058854242000000001, 2020-11-12T17:23:06.056 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:06.056 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:06.056 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:06.057 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:06.057 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:06.057 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1144 2020-11-12T17:23:06.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.057 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:06.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:06.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.657289+0000", 2020-11-12T17:23:06.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:06.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:06.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.657289+0000", 2020-11-12T17:23:06.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:23:06.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:06.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.657270+0000", 2020-11-12T17:23:06.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7785999999999999e-05 2020-11-12T17:23:06.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:06.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.657327+0000", 2020-11-12T17:23:06.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.072e-06 2020-11-12T17:23:06.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:06.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.657335+0000", 2020-11-12T17:23:06.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6020000000000002e-06 2020-11-12T17:23:06.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:06.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.657340+0000", 2020-11-12T17:23:06.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00078976299999999997 2020-11-12T17:23:06.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:06.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.658130+0000", 2020-11-12T17:23:06.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000166193 2020-11-12T17:23:06.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:06.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.658296+0000", 2020-11-12T17:23:06.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026521699999999999 2020-11-12T17:23:06.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.658561+0000", 2020-11-12T17:23:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060992210000000002 2020-11-12T17:23:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.664660+0000", 2020-11-12T17:23:06.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.051301115000000001 2020-11-12T17:23:06.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:06.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.715962+0000", 2020-11-12T17:23:06.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8591999999999995e-05 2020-11-12T17:23:06.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:06.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.716050+0000", 2020-11-12T17:23:06.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2843000000000005e-05 2020-11-12T17:23:06.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:06.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.716143+0000", 2020-11-12T17:23:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.058854242000000001 2020-11-12T17:23:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:1144 3.6 e23/20 ondisk, result = 0)", 2020-11-12T17:23:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.664339+0000", 2020-11-12T17:23:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.11196590300000001, 2020-11-12T17:23:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.051821314, 2020-11-12T17:23:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.664339+0000", 2020-11-12T17:23:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.664339+0000", 2020-11-12T17:23:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.664317+0000", 2020-11-12T17:23:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9238000000000002e-05 2020-11-12T17:23:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.664406+0000", 2020-11-12T17:23:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.051420842000000001 2020-11-12T17:23:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.715827+0000", 2020-11-12T17:23:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9783e-05 2020-11-12T17:23:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.715846+0000", 2020-11-12T17:23:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9376999999999995e-05 2020-11-12T17:23:06.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:06.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.715936+0000", 2020-11-12T17:23:06.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3230999999999999e-05 2020-11-12T17:23:06.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:06.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.715949+0000", 2020-11-12T17:23:06.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021086299999999999 2020-11-12T17:23:06.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:06.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.716160+0000", 2020-11-12T17:23:06.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.051821314 2020-11-12T17:23:06.081 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.081 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:06.082 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.083 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1184 3.1 3:8cf11d6b:::benchmark_data_smithi036_14212_object147:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:06.083 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.695886+0000", 2020-11-12T17:23:06.083 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.080418682000000005, 2020-11-12T17:23:06.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065001903, 2020-11-12T17:23:06.084 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:06.084 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:06.084 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:06.085 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:06.085 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:06.085 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1184 2020-11-12T17:23:06.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.086 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:06.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:06.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695886+0000", 2020-11-12T17:23:06.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:06.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:06.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695886+0000", 2020-11-12T17:23:06.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:06.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:06.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695856+0000", 2020-11-12T17:23:06.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2856999999999995e-05 2020-11-12T17:23:06.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:06.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695949+0000", 2020-11-12T17:23:06.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2404e-05 2020-11-12T17:23:06.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:06.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695961+0000", 2020-11-12T17:23:06.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6699999999999997e-06 2020-11-12T17:23:06.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:06.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695968+0000", 2020-11-12T17:23:06.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001745843 2020-11-12T17:23:06.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:06.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.697714+0000", 2020-11-12T17:23:06.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6091000000000001e-05 2020-11-12T17:23:06.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:06.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.697780+0000", 2020-11-12T17:23:06.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010623 2020-11-12T17:23:06.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:06.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.697886+0000", 2020-11-12T17:23:06.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011941779999999999 2020-11-12T17:23:06.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:06.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.699080+0000", 2020-11-12T17:23:06.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061621771999999998 2020-11-12T17:23:06.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:06.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.760702+0000", 2020-11-12T17:23:06.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000105277 2020-11-12T17:23:06.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:06.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.760807+0000", 2020-11-12T17:23:06.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0196000000000003e-05 2020-11-12T17:23:06.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:06.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.760888+0000", 2020-11-12T17:23:06.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065001903 2020-11-12T17:23:06.105 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.105 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:06.105 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.106 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.106 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:06.106 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:06.108 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:06.109 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:06.106+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:06.159 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:06.209 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:06.208+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:06.273 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:06.286 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:06.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1816 3.4 3:229575d8:::benchmark_data_smithi036_14212_object226:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.046272779999999999, 2020-11-12T17:23:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.046301552000000003, 2020-11-12T17:23:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1816 2020-11-12T17:23:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:06.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:06.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:06.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226671+0000", 2020-11-12T17:23:06.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5532999999999995e-05 2020-11-12T17:23:06.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:06.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226766+0000", 2020-11-12T17:23:06.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:23:06.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226779+0000", 2020-11-12T17:23:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6120000000000004e-06 2020-11-12T17:23:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226786+0000", 2020-11-12T17:23:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00085013099999999996 2020-11-12T17:23:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227636+0000", 2020-11-12T17:23:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1732999999999998e-05 2020-11-12T17:23:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:06.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227718+0000", 2020-11-12T17:23:06.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100733 2020-11-12T17:23:06.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:06.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227819+0000", 2020-11-12T17:23:06.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023757000000000001 2020-11-12T17:23:06.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:06.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:06.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:06.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.230194+0000", 2020-11-12T17:23:06.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034894779999999999 2020-11-12T17:23:06.301 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.301 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:06.302 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:06.304 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:06.305 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 1 2020-11-12T17:23:06.305 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:06.307 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:06.351 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:06.350+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:06.365 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:06.396 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:06.411 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:06.408+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:06.431 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:06.436 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:06.436 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:06.448 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:06.457 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:06.492 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:06.512 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:06.510+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:06.541 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:06.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 2 16 2245 2229 8.70639 9.39062 0.0094848 0.0142124 2020-11-12T17:23:06.610 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:06.611 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:06.611 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:06.612 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:06.614 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:06.614 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:06.616 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:06.612+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:06.715 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:06.712+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:06.803 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:06.804 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:06.815 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:06.822 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:06.816+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:06.916 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:06.916+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:06.937 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:06.939 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:06.960 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:07.019 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:07.016+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:07.096 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:07.096 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:07.107 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:07.152 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:07.150+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:07.221 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:07.218+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:07.235 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:07.235 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:07.246 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:07.323 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:07.320+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:07.418 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:07.419 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:07.425 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:07.422+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:07.438 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:07.455 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-12T17:23:07.455 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:23:07.456 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-12T17:23:07.456 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 6 2020-11-12T17:23:07.502 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:23:07.527 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:07.526+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:07.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 3 16 3313 3297 8.58528 8.34375 0.0079758 0.0144655 2020-11-12T17:23:07.613 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:07.614 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:07.627 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:07.626+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:07.628 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:07.728 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:07.726+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:07.745 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:07.746 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:07.754 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:07.830 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:07.826+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:07.851 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:23:07.850+0000 7f4952786700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2020-11-12T17:23:07.864 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:07.864 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:07.874 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:07.930 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:07.928+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:07.981 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:07.981 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:07.991 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:08.032 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:08.032+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:08.132 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:08.128+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:08.164 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:08.164 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:08.175 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:08.260 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:08.260+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:08.332 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:08.333 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:08.336 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:08.332+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:08.346 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:08.437 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:08.434+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:08.510 INFO:teuthology.orchestra.run.smithi036.stderr:marked out osd.6. 2020-11-12T17:23:08.510 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:23:08.514 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:08.514 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:08.515 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:08.514+0000 7f658835a700 -1 osd.0 23 handle_osd_map injecting map crc failure 2020-11-12T17:23:08.523 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:08.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 4 16 4361 4345 8.48567 8.1875 0.0102049 0.014617 2020-11-12T17:23:08.561 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:08.558+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:08.623 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:08.624 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:08.626 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:08.632 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:08.671 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:08.670+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:08.739 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:08.739 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:08.740 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:08.738+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:08.750 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:08.791 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:08.826 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:08.840 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:08.840+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:08.856 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:08.866 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:08.867 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:08.871 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:08.886 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:08.914 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:08.941 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:08.938+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:08.944 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:08.975 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:09.005 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:09.008 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:09.008 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:09.008 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:09.008 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:09.009 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:09.009 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:09.009 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:09.009 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:09.021 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:09.022 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:09.022 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:23:09.022 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:09.031 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:09.068 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:09.066+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:09.141 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:09.142 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:09.142 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:09.142 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:09.142 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:09.145 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:09.144+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:09.151 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:09.246 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:09.242+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:09.308 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:09.317 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:09.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:09.318 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:09.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.318 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:648 3.e 3:77212938:::benchmark_data_smithi036_14212_object80:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:09.319 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.177671+0000", 2020-11-12T17:23:09.319 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.1283637649999996, 2020-11-12T17:23:09.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.086237434000000002, 2020-11-12T17:23:09.319 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.319 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.320 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.320 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.320 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.320 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 648 2020-11-12T17:23:09.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.320 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.177671+0000", 2020-11-12T17:23:09.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.177671+0000", 2020-11-12T17:23:09.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:09.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.177647+0000", 2020-11-12T17:23:09.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8298000000000002e-05 2020-11-12T17:23:09.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.177715+0000", 2020-11-12T17:23:09.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0223e-05 2020-11-12T17:23:09.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.177725+0000", 2020-11-12T17:23:09.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.699e-06 2020-11-12T17:23:09.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.177731+0000", 2020-11-12T17:23:09.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00050276300000000004 2020-11-12T17:23:09.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.178234+0000", 2020-11-12T17:23:09.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012754199999999999 2020-11-12T17:23:09.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.178361+0000", 2020-11-12T17:23:09.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022710699999999999 2020-11-12T17:23:09.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.178589+0000", 2020-11-12T17:23:09.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049838210000000003 2020-11-12T17:23:09.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.183572+0000", 2020-11-12T17:23:09.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.080122753000000005 2020-11-12T17:23:09.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.263695+0000", 2020-11-12T17:23:09.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012359599999999999 2020-11-12T17:23:09.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.263819+0000", 2020-11-12T17:23:09.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0014999999999998e-05 2020-11-12T17:23:09.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.263909+0000", 2020-11-12T17:23:09.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.086237434000000002 2020-11-12T17:23:09.330 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.331 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.331 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.331 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:648 3.e e22/20 ondisk, result = 0)", 2020-11-12T17:23:09.331 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.183784+0000", 2020-11-12T17:23:09.331 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.1222507620000002, 2020-11-12T17:23:09.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.080132440999999999, 2020-11-12T17:23:09.332 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.332 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:09.332 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.183784+0000", 2020-11-12T17:23:09.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.183784+0000", 2020-11-12T17:23:09.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999886 2020-11-12T17:23:09.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.183773+0000", 2020-11-12T17:23:09.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9654000000000001e-05 2020-11-12T17:23:09.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.183802+0000", 2020-11-12T17:23:09.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.079751997000000005 2020-11-12T17:23:09.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.263554+0000", 2020-11-12T17:23:09.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7399999999999998e-06 2020-11-12T17:23:09.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.263561+0000", 2020-11-12T17:23:09.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7714999999999995e-05 2020-11-12T17:23:09.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.263659+0000", 2020-11-12T17:23:09.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1378000000000001e-05 2020-11-12T17:23:09.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.263680+0000", 2020-11-12T17:23:09.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023661099999999999 2020-11-12T17:23:09.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.263917+0000", 2020-11-12T17:23:09.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.080132440999999999 2020-11-12T17:23:09.338 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.338 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.338 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.339 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:776 3.f 3:f79526d4:::benchmark_data_smithi036_14212_object96:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:09.339 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.290784+0000", 2020-11-12T17:23:09.339 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.015251385, 2020-11-12T17:23:09.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.078662243000000007, 2020-11-12T17:23:09.339 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.339 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.339 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.339 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.340 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.340 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 776 2020-11-12T17:23:09.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.340 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.290784+0000", 2020-11-12T17:23:09.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.290784+0000", 2020-11-12T17:23:09.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999523 2020-11-12T17:23:09.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.290736+0000", 2020-11-12T17:23:09.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110994 2020-11-12T17:23:09.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.290847+0000", 2020-11-12T17:23:09.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4399999999999999e-06 2020-11-12T17:23:09.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.290854+0000", 2020-11-12T17:23:09.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2740000000000001e-06 2020-11-12T17:23:09.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.290859+0000", 2020-11-12T17:23:09.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002976107 2020-11-12T17:23:09.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.293835+0000", 2020-11-12T17:23:09.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7750999999999995e-05 2020-11-12T17:23:09.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.293912+0000", 2020-11-12T17:23:09.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011657100000000001 2020-11-12T17:23:09.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.294029+0000", 2020-11-12T17:23:09.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043275409999999999 2020-11-12T17:23:09.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.298357+0000", 2020-11-12T17:23:09.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.070914499000000006 2020-11-12T17:23:09.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.369271+0000", 2020-11-12T17:23:09.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4975000000000005e-05 2020-11-12T17:23:09.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.369356+0000", 2020-11-12T17:23:09.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9914999999999995e-05 2020-11-12T17:23:09.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.369446+0000", 2020-11-12T17:23:09.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.078662243000000007 2020-11-12T17:23:09.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.349 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.349 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:776 3.f e22/20 ondisk, result = 0)", 2020-11-12T17:23:09.350 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.298854+0000", 2020-11-12T17:23:09.350 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.0071808899999999, 2020-11-12T17:23:09.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.070615911000000003, 2020-11-12T17:23:09.350 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.350 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:09.350 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.298854+0000", 2020-11-12T17:23:09.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.298854+0000", 2020-11-12T17:23:09.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:09.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.298830+0000", 2020-11-12T17:23:09.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1851000000000001e-05 2020-11-12T17:23:09.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.298892+0000", 2020-11-12T17:23:09.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.070288662000000002 2020-11-12T17:23:09.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.369181+0000", 2020-11-12T17:23:09.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:23:09.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.369188+0000", 2020-11-12T17:23:09.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0453e-05 2020-11-12T17:23:09.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.369239+0000", 2020-11-12T17:23:09.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6782999999999998e-05 2020-11-12T17:23:09.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.369255+0000", 2020-11-12T17:23:09.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021465500000000001 2020-11-12T17:23:09.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.369470+0000", 2020-11-12T17:23:09.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.070615911000000003 2020-11-12T17:23:09.356 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.356 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.357 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.357 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:832 3.7 e22/20 3:e120609f:::benchmark_data_smithi036_14212_object103:head v 22'48, mlcod=22'41)", 2020-11-12T17:23:09.357 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.341737+0000", 2020-11-12T17:23:09.357 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.9642979949999999, 2020-11-12T17:23:09.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.042718803, 2020-11-12T17:23:09.358 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.358 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.358 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.341737+0000", 2020-11-12T17:23:09.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.341737+0000", 2020-11-12T17:23:09.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:09.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.341708+0000", 2020-11-12T17:23:09.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112142 2020-11-12T17:23:09.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.341821+0000", 2020-11-12T17:23:09.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.041483237999999999 2020-11-12T17:23:09.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.383304+0000", 2020-11-12T17:23:09.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2019999999999998e-06 2020-11-12T17:23:09.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.383311+0000", 2020-11-12T17:23:09.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1365999999999997e-05 2020-11-12T17:23:09.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.383352+0000", 2020-11-12T17:23:09.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4283000000000001e-05 2020-11-12T17:23:09.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.383377+0000", 2020-11-12T17:23:09.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010164799999999999 2020-11-12T17:23:09.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.384393+0000", 2020-11-12T17:23:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2694000000000007e-05 2020-11-12T17:23:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.384456+0000", 2020-11-12T17:23:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.042718803 2020-11-12T17:23:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:864 3.e 3:747552e3:::benchmark_data_smithi036_14212_object107:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.373069+0000", 2020-11-12T17:23:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.932965861, 2020-11-12T17:23:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.039433257999999999, 2020-11-12T17:23:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 864 2020-11-12T17:23:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.373069+0000", 2020-11-12T17:23:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.373069+0000", 2020-11-12T17:23:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:23:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.373043+0000", 2020-11-12T17:23:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010241 2020-11-12T17:23:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.373145+0000", 2020-11-12T17:23:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7918e-05 2020-11-12T17:23:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.373163+0000", 2020-11-12T17:23:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7219999999999999e-06 2020-11-12T17:23:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.373171+0000", 2020-11-12T17:23:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029110360000000001 2020-11-12T17:23:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.376082+0000", 2020-11-12T17:23:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0756999999999999e-05 2020-11-12T17:23:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.376162+0000", 2020-11-12T17:23:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014105000000000001 2020-11-12T17:23:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.376303+0000", 2020-11-12T17:23:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048760380000000001 2020-11-12T17:23:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.381179+0000", 2020-11-12T17:23:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.031073872999999998 2020-11-12T17:23:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.412253+0000", 2020-11-12T17:23:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013757799999999999 2020-11-12T17:23:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.412391+0000", 2020-11-12T17:23:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011158999999999999 2020-11-12T17:23:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.412502+0000", 2020-11-12T17:23:09.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.039433257999999999 2020-11-12T17:23:09.376 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.376 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.376 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.376 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:952 3.e 3:761d409b:::benchmark_data_smithi036_14212_object118:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:09.376 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.446319+0000", 2020-11-12T17:23:09.377 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.859715708, 2020-11-12T17:23:09.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16236105000000001, 2020-11-12T17:23:09.377 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.377 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.377 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.377 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.377 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.378 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 952 2020-11-12T17:23:09.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.378 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446319+0000", 2020-11-12T17:23:09.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446319+0000", 2020-11-12T17:23:09.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:09.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446277+0000", 2020-11-12T17:23:09.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012484099999999999 2020-11-12T17:23:09.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446401+0000", 2020-11-12T17:23:09.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8328000000000001e-05 2020-11-12T17:23:09.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446420+0000", 2020-11-12T17:23:09.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0899999999999994e-06 2020-11-12T17:23:09.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446429+0000", 2020-11-12T17:23:09.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049512510000000003 2020-11-12T17:23:09.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.451380+0000", 2020-11-12T17:23:09.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017698099999999999 2020-11-12T17:23:09.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.451557+0000", 2020-11-12T17:23:09.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020305599999999999 2020-11-12T17:23:09.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.451760+0000", 2020-11-12T17:23:09.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025762160000000001 2020-11-12T17:23:09.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.454336+0000", 2020-11-12T17:23:09.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.154191153 2020-11-12T17:23:09.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608528+0000", 2020-11-12T17:23:09.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105173 2020-11-12T17:23:09.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608633+0000", 2020-11-12T17:23:09.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7710999999999998e-05 2020-11-12T17:23:09.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608680+0000", 2020-11-12T17:23:09.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16236105000000001 2020-11-12T17:23:09.387 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.387 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.387 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.388 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:952 3.e e22/20 ondisk, result = 0)", 2020-11-12T17:23:09.388 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.457187+0000", 2020-11-12T17:23:09.388 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.8488482350000002, 2020-11-12T17:23:09.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.151500567, 2020-11-12T17:23:09.388 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.388 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:09.388 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.457187+0000", 2020-11-12T17:23:09.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.457187+0000", 2020-11-12T17:23:09.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:09.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.457161+0000", 2020-11-12T17:23:09.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8614000000000004e-05 2020-11-12T17:23:09.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.457230+0000", 2020-11-12T17:23:09.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15119591499999999 2020-11-12T17:23:09.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608426+0000", 2020-11-12T17:23:09.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6949999999999997e-06 2020-11-12T17:23:09.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608432+0000", 2020-11-12T17:23:09.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4737e-05 2020-11-12T17:23:09.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608496+0000", 2020-11-12T17:23:09.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6138999999999999e-05 2020-11-12T17:23:09.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608512+0000", 2020-11-12T17:23:09.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017498700000000001 2020-11-12T17:23:09.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608687+0000", 2020-11-12T17:23:09.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.151500567 2020-11-12T17:23:09.395 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.395 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.395 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.396 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1096 3.f 3:fb220cba:::benchmark_data_smithi036_14212_object136:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:09.396 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.613292+0000", 2020-11-12T17:23:09.396 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.6927435169999998, 2020-11-12T17:23:09.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.090968856000000001, 2020-11-12T17:23:09.396 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.396 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.397 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.397 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.397 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.397 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1096 2020-11-12T17:23:09.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.397 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.613292+0000", 2020-11-12T17:23:09.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.613292+0000", 2020-11-12T17:23:09.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:09.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.613257+0000", 2020-11-12T17:23:09.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8707000000000003e-05 2020-11-12T17:23:09.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.613346+0000", 2020-11-12T17:23:09.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6880000000000005e-06 2020-11-12T17:23:09.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.613355+0000", 2020-11-12T17:23:09.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3049999999999998e-06 2020-11-12T17:23:09.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.613361+0000", 2020-11-12T17:23:09.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00039579300000000002 2020-11-12T17:23:09.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.613757+0000", 2020-11-12T17:23:09.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012973499999999999 2020-11-12T17:23:09.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.613887+0000", 2020-11-12T17:23:09.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023624099999999999 2020-11-12T17:23:09.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.614123+0000", 2020-11-12T17:23:09.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001685534 2020-11-12T17:23:09.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.615808+0000", 2020-11-12T17:23:09.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.088324293999999998 2020-11-12T17:23:09.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.704133+0000", 2020-11-12T17:23:09.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8310000000000002e-05 2020-11-12T17:23:09.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.704191+0000", 2020-11-12T17:23:09.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9462999999999995e-05 2020-11-12T17:23:09.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.704260+0000", 2020-11-12T17:23:09.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.090968856000000001 2020-11-12T17:23:09.407 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.407 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.407 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.407 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1096 3.f e23/20 ondisk, result = 0)", 2020-11-12T17:23:09.408 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.616886+0000", 2020-11-12T17:23:09.408 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.689149365, 2020-11-12T17:23:09.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.087386678999999995, 2020-11-12T17:23:09.408 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.408 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:09.408 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.616886+0000", 2020-11-12T17:23:09.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.616886+0000", 2020-11-12T17:23:09.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:23:09.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.616872+0000", 2020-11-12T17:23:09.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4762999999999999e-05 2020-11-12T17:23:09.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.616907+0000", 2020-11-12T17:23:09.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.087141417999999998 2020-11-12T17:23:09.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.704048+0000", 2020-11-12T17:23:09.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0475999999999999e-05 2020-11-12T17:23:09.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.704059+0000", 2020-11-12T17:23:09.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:23:09.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.704116+0000", 2020-11-12T17:23:09.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5960000000000004e-06 2020-11-12T17:23:09.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.704125+0000", 2020-11-12T17:23:09.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147472 2020-11-12T17:23:09.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.704272+0000", 2020-11-12T17:23:09.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.087386678999999995 2020-11-12T17:23:09.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.415 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.415 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1192 3.f 3:f63c7cd7:::benchmark_data_smithi036_14212_object148:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:09.416 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.705091+0000", 2020-11-12T17:23:09.416 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.6009441899999999, 2020-11-12T17:23:09.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.076727032000000001, 2020-11-12T17:23:09.416 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.416 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.416 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.416 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.416 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.417 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1192 2020-11-12T17:23:09.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.417 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.705091+0000", 2020-11-12T17:23:09.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.705091+0000", 2020-11-12T17:23:09.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999949 2020-11-12T17:23:09.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.705040+0000", 2020-11-12T17:23:09.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013492199999999999 2020-11-12T17:23:09.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.705175+0000", 2020-11-12T17:23:09.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.558e-05 2020-11-12T17:23:09.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.705191+0000", 2020-11-12T17:23:09.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5909999999999998e-06 2020-11-12T17:23:09.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.705198+0000", 2020-11-12T17:23:09.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033769540000000002 2020-11-12T17:23:09.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.708575+0000", 2020-11-12T17:23:09.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183038 2020-11-12T17:23:09.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.708758+0000", 2020-11-12T17:23:09.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030677800000000001 2020-11-12T17:23:09.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.709065+0000", 2020-11-12T17:23:09.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027789410000000001 2020-11-12T17:23:09.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.711844+0000", 2020-11-12T17:23:09.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.069848905000000003 2020-11-12T17:23:09.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.781693+0000", 2020-11-12T17:23:09.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9444999999999996e-05 2020-11-12T17:23:09.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.781772+0000", 2020-11-12T17:23:09.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5701999999999997e-05 2020-11-12T17:23:09.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.781818+0000", 2020-11-12T17:23:09.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.076727032000000001 2020-11-12T17:23:09.426 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.427 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.427 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.427 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1192 3.f e23/20 ondisk, result = 0)", 2020-11-12T17:23:09.427 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.714460+0000", 2020-11-12T17:23:09.427 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.59157511, 2020-11-12T17:23:09.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.067368129999999998, 2020-11-12T17:23:09.428 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.428 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:09.428 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.714460+0000", 2020-11-12T17:23:09.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.714460+0000", 2020-11-12T17:23:09.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:23:09.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.714423+0000", 2020-11-12T17:23:09.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4344000000000003e-05 2020-11-12T17:23:09.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.714517+0000", 2020-11-12T17:23:09.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.065018515999999998 2020-11-12T17:23:09.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.779536+0000", 2020-11-12T17:23:09.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5280000000000003e-06 2020-11-12T17:23:09.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.779544+0000", 2020-11-12T17:23:09.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021268950000000002 2020-11-12T17:23:09.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.781671+0000", 2020-11-12T17:23:09.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1245e-05 2020-11-12T17:23:09.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.781682+0000", 2020-11-12T17:23:09.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014584099999999999 2020-11-12T17:23:09.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.781828+0000", 2020-11-12T17:23:09.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.067368129999999998 2020-11-12T17:23:09.439 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.439 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.439 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.440 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1416 3.e 3:779e8118:::benchmark_data_smithi036_14212_object176:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:09.440 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.893094+0000", 2020-11-12T17:23:09.440 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.4129408520000002, 2020-11-12T17:23:09.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.055296337000000001, 2020-11-12T17:23:09.440 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.441 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.441 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1416 2020-11-12T17:23:09.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.441 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.893094+0000", 2020-11-12T17:23:09.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.893094+0000", 2020-11-12T17:23:09.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:23:09.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.893056+0000", 2020-11-12T17:23:09.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101214 2020-11-12T17:23:09.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.893158+0000", 2020-11-12T17:23:09.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6373000000000001e-05 2020-11-12T17:23:09.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.893174+0000", 2020-11-12T17:23:09.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2013e-05 2020-11-12T17:23:09.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.893186+0000", 2020-11-12T17:23:09.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00091144100000000003 2020-11-12T17:23:09.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.894097+0000", 2020-11-12T17:23:09.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9182999999999999e-05 2020-11-12T17:23:09.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.894157+0000", 2020-11-12T17:23:09.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115114 2020-11-12T17:23:09.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.894272+0000", 2020-11-12T17:23:09.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032618270000000001 2020-11-12T17:23:09.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.897533+0000", 2020-11-12T17:23:09.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.050689044000000003 2020-11-12T17:23:09.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.948223+0000", 2020-11-12T17:23:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4791999999999996e-05 2020-11-12T17:23:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.948317+0000", 2020-11-12T17:23:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3232999999999995e-05 2020-11-12T17:23:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.948391+0000", 2020-11-12T17:23:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.055296337000000001 2020-11-12T17:23:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1536 3.e 3:729acc68:::benchmark_data_smithi036_14212_object191:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.977565+0000", 2020-11-12T17:23:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.3284701320000001, 2020-11-12T17:23:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.128811861, 2020-11-12T17:23:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1536 2020-11-12T17:23:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977565+0000", 2020-11-12T17:23:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977565+0000", 2020-11-12T17:23:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:23:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977534+0000", 2020-11-12T17:23:09.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3104999999999997e-05 2020-11-12T17:23:09.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977627+0000", 2020-11-12T17:23:09.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7805999999999999e-05 2020-11-12T17:23:09.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977645+0000", 2020-11-12T17:23:09.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6569999999999997e-06 2020-11-12T17:23:09.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977653+0000", 2020-11-12T17:23:09.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027620029999999999 2020-11-12T17:23:09.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.980415+0000", 2020-11-12T17:23:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012407999999999999 2020-11-12T17:23:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.980539+0000", 2020-11-12T17:23:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021042000000000001 2020-11-12T17:23:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.980749+0000", 2020-11-12T17:23:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012114999999999999 2020-11-12T17:23:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.981961+0000", 2020-11-12T17:23:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12432718 2020-11-12T17:23:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.106288+0000", 2020-11-12T17:23:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0294000000000003e-05 2020-11-12T17:23:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.106338+0000", 2020-11-12T17:23:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8673000000000001e-05 2020-11-12T17:23:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.106377+0000", 2020-11-12T17:23:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.128811861 2020-11-12T17:23:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1696 3.f 3:f089ed3a:::benchmark_data_smithi036_14212_object211:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.111383+0000", 2020-11-12T17:23:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.1946518570000002, 2020-11-12T17:23:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.076364668999999996, 2020-11-12T17:23:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1696 2020-11-12T17:23:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.111383+0000", 2020-11-12T17:23:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.111383+0000", 2020-11-12T17:23:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:23:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.111353+0000", 2020-11-12T17:23:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8824000000000002e-05 2020-11-12T17:23:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.111442+0000", 2020-11-12T17:23:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0421999999999999e-05 2020-11-12T17:23:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.111452+0000", 2020-11-12T17:23:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4299999999999997e-06 2020-11-12T17:23:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.111457+0000", 2020-11-12T17:23:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011118230000000001 2020-11-12T17:23:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.112569+0000", 2020-11-12T17:23:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000140629 2020-11-12T17:23:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.112710+0000", 2020-11-12T17:23:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170428 2020-11-12T17:23:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.112880+0000", 2020-11-12T17:23:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047325910000000004 2020-11-12T17:23:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.117613+0000", 2020-11-12T17:23:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.069923122000000004 2020-11-12T17:23:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.187536+0000", 2020-11-12T17:23:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000118676 2020-11-12T17:23:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.187655+0000", 2020-11-12T17:23:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3221999999999996e-05 2020-11-12T17:23:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.187748+0000", 2020-11-12T17:23:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.076364668999999996 2020-11-12T17:23:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1782 3.e 3:7659a87d:::benchmark_data_smithi036_14212_object222:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.186740+0000", 2020-11-12T17:23:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.119295208, 2020-11-12T17:23:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098808143000000001, 2020-11-12T17:23:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1782 2020-11-12T17:23:09.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.582 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186740+0000", 2020-11-12T17:23:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186740+0000", 2020-11-12T17:23:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999514 2020-11-12T17:23:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186691+0000", 2020-11-12T17:23:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013075700000000001 2020-11-12T17:23:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186822+0000", 2020-11-12T17:23:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7977000000000001e-05 2020-11-12T17:23:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186840+0000", 2020-11-12T17:23:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1609999999999992e-06 2020-11-12T17:23:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186849+0000", 2020-11-12T17:23:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024460580000000001 2020-11-12T17:23:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189295+0000", 2020-11-12T17:23:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011145 2020-11-12T17:23:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189407+0000", 2020-11-12T17:23:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022201 2020-11-12T17:23:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189629+0000", 2020-11-12T17:23:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00144596 2020-11-12T17:23:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.191075+0000", 2020-11-12T17:23:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094283164000000003 2020-11-12T17:23:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285358+0000", 2020-11-12T17:23:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115186 2020-11-12T17:23:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285473+0000", 2020-11-12T17:23:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4896999999999998e-05 2020-11-12T17:23:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285548+0000", 2020-11-12T17:23:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098808143000000001 2020-11-12T17:23:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1783 3.e 3:7659a87d:::benchmark_data_smithi036_14212_object222:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.188212+0000", 2020-11-12T17:23:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.117823059, 2020-11-12T17:23:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.097621049000000001, 2020-11-12T17:23:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1783 2020-11-12T17:23:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188212+0000", 2020-11-12T17:23:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188212+0000", 2020-11-12T17:23:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188183+0000", 2020-11-12T17:23:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8889999999999999e-05 2020-11-12T17:23:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188262+0000", 2020-11-12T17:23:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.311e-05 2020-11-12T17:23:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188275+0000", 2020-11-12T17:23:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5799999999999998e-06 2020-11-12T17:23:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188285+0000", 2020-11-12T17:23:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030249159999999999 2020-11-12T17:23:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.191310+0000", 2020-11-12T17:23:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012678200000000001 2020-11-12T17:23:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.191437+0000", 2020-11-12T17:23:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023708 2020-11-12T17:23:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.191674+0000", 2020-11-12T17:23:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020731579999999999 2020-11-12T17:23:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.193747+0000", 2020-11-12T17:23:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.091901126999999999 2020-11-12T17:23:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285648+0000", 2020-11-12T17:23:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000117358 2020-11-12T17:23:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285765+0000", 2020-11-12T17:23:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7623e-05 2020-11-12T17:23:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285833+0000", 2020-11-12T17:23:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.097621049000000001 2020-11-12T17:23:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1784 3.e 3:7659a87d:::benchmark_data_smithi036_14212_object222:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.188987+0000", 2020-11-12T17:23:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.1170482439999998, 2020-11-12T17:23:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099291502000000004, 2020-11-12T17:23:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1784 2020-11-12T17:23:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188987+0000", 2020-11-12T17:23:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188987+0000", 2020-11-12T17:23:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999514 2020-11-12T17:23:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188938+0000", 2020-11-12T17:23:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022587 2020-11-12T17:23:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189164+0000", 2020-11-12T17:23:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0205000000000001e-05 2020-11-12T17:23:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189184+0000", 2020-11-12T17:23:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-06 2020-11-12T17:23:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189194+0000", 2020-11-12T17:23:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031712590000000001 2020-11-12T17:23:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.192366+0000", 2020-11-12T17:23:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018079200000000001 2020-11-12T17:23:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.192546+0000", 2020-11-12T17:23:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023559699999999999 2020-11-12T17:23:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.192782+0000", 2020-11-12T17:23:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014876659999999999 2020-11-12T17:23:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.194270+0000", 2020-11-12T17:23:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.093813515 2020-11-12T17:23:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.288083+0000", 2020-11-12T17:23:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108022 2020-11-12T17:23:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.288191+0000", 2020-11-12T17:23:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7211000000000002e-05 2020-11-12T17:23:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.288278+0000", 2020-11-12T17:23:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099291502000000004 2020-11-12T17:23:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:2240 3.f 3:f124239c:::benchmark_data_smithi036_14212_object279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.554275+0000", 2020-11-12T17:23:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.7517601229999999, 2020-11-12T17:23:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.046393956, 2020-11-12T17:23:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 2240 2020-11-12T17:23:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.554275+0000", 2020-11-12T17:23:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.554275+0000", 2020-11-12T17:23:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:23:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.554247+0000", 2020-11-12T17:23:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3177999999999995e-05 2020-11-12T17:23:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.554330+0000", 2020-11-12T17:23:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1705999999999999e-05 2020-11-12T17:23:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.554341+0000", 2020-11-12T17:23:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7540000000000006e-06 2020-11-12T17:23:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.554349+0000", 2020-11-12T17:23:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024705059999999999 2020-11-12T17:23:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.556820+0000", 2020-11-12T17:23:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8602000000000004e-05 2020-11-12T17:23:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.556898+0000", 2020-11-12T17:23:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000123643 2020-11-12T17:23:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.557022+0000", 2020-11-12T17:23:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004240171 2020-11-12T17:23:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.561262+0000", 2020-11-12T17:23:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.039254077999999998 2020-11-12T17:23:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.600516+0000", 2020-11-12T17:23:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1724999999999994e-05 2020-11-12T17:23:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.600598+0000", 2020-11-12T17:23:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0957000000000005e-05 2020-11-12T17:23:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.600669+0000", 2020-11-12T17:23:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.046393956 2020-11-12T17:23:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:2240 3.f e23/20 ondisk, result = 0)", 2020-11-12T17:23:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.564106+0000", 2020-11-12T17:23:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.741929206, 2020-11-12T17:23:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.036572852000000003, 2020-11-12T17:23:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.564106+0000", 2020-11-12T17:23:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.564106+0000", 2020-11-12T17:23:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:23:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.564080+0000", 2020-11-12T17:23:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7515000000000007e-05 2020-11-12T17:23:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.564147+0000", 2020-11-12T17:23:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.034533566000000002 2020-11-12T17:23:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.598681+0000", 2020-11-12T17:23:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2814e-05 2020-11-12T17:23:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.598693+0000", 2020-11-12T17:23:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018002109999999999 2020-11-12T17:23:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.600494+0000", 2020-11-12T17:23:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1212e-05 2020-11-12T17:23:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.600505+0000", 2020-11-12T17:23:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017389799999999999 2020-11-12T17:23:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.600679+0000", 2020-11-12T17:23:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.036572852000000003 2020-11-12T17:23:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:09.633 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:09.634 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 5 16 4511 4495 7.02289 1.17188 0.0129112 0.0172919 2020-11-12T17:23:09.644 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:09.645 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:09.630+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:09.736 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:09.734+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:09.786 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:09.787 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:09.787 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:09.788 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:09.800 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:09.847 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:09.846+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:09.939 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:09.936+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:09.975 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:09.975 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:09.976 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:09.976 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:09.976 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:09.985 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:10.041 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:10.040+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:10.111 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:10.156 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:10.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:10.157 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:10.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.158 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:254 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.158 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:10.159 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3670807050000002, 2020-11-12T17:23:10.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023, 2020-11-12T17:23:10.159 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.160 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.160 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.160 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.161 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.161 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 254 2020-11-12T17:23:10.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.162 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:10.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:10.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:10.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741501+0000", 2020-11-12T17:23:10.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8440000000000002e-05 2020-11-12T17:23:10.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741570+0000", 2020-11-12T17:23:10.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4515000000000001e-05 2020-11-12T17:23:10.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741584+0000", 2020-11-12T17:23:10.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5699999999999998e-06 2020-11-12T17:23:10.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741591+0000", 2020-11-12T17:23:10.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033344310000000001 2020-11-12T17:23:10.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744925+0000", 2020-11-12T17:23:10.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011066 2020-11-12T17:23:10.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745036+0000", 2020-11-12T17:23:10.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015032199999999999 2020-11-12T17:23:10.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745186+0000", 2020-11-12T17:23:10.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020296229999999999 2020-11-12T17:23:10.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747216+0000", 2020-11-12T17:23:10.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21356234399999999 2020-11-12T17:23:10.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960778+0000", 2020-11-12T17:23:10.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011052000000000001 2020-11-12T17:23:10.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960889+0000", 2020-11-12T17:23:10.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014397999999999999 2020-11-12T17:23:10.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961033+0000", 2020-11-12T17:23:10.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023 2020-11-12T17:23:10.181 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.181 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.181 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.182 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:255 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.182 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:10.182 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3645128739999999, 2020-11-12T17:23:10.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286, 2020-11-12T17:23:10.182 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.183 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.183 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.183 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.183 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.183 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 255 2020-11-12T17:23:10.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.183 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:10.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:10.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:10.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744038+0000", 2020-11-12T17:23:10.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000142953 2020-11-12T17:23:10.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744181+0000", 2020-11-12T17:23:10.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4383999999999999e-05 2020-11-12T17:23:10.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744206+0000", 2020-11-12T17:23:10.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0786e-05 2020-11-12T17:23:10.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744217+0000", 2020-11-12T17:23:10.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001465002 2020-11-12T17:23:10.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745682+0000", 2020-11-12T17:23:10.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000126458 2020-11-12T17:23:10.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745808+0000", 2020-11-12T17:23:10.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000164413 2020-11-12T17:23:10.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745972+0000", 2020-11-12T17:23:10.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019412520000000001 2020-11-12T17:23:10.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747914+0000", 2020-11-12T17:23:10.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.213271294 2020-11-12T17:23:10.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961185+0000", 2020-11-12T17:23:10.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001472 2020-11-12T17:23:10.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961332+0000", 2020-11-12T17:23:10.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108687 2020-11-12T17:23:10.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961441+0000", 2020-11-12T17:23:10.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286 2020-11-12T17:23:10.193 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.193 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.193 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.194 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:256 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.194 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:10.194 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3629021889999997, 2020-11-12T17:23:10.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001, 2020-11-12T17:23:10.194 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.195 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.195 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.195 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.195 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.195 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 256 2020-11-12T17:23:10.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.196 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:10.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:10.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:10.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745651+0000", 2020-11-12T17:23:10.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000140753 2020-11-12T17:23:10.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745792+0000", 2020-11-12T17:23:10.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3481e-05 2020-11-12T17:23:10.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745806+0000", 2020-11-12T17:23:10.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8069999999999999e-06 2020-11-12T17:23:10.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745810+0000", 2020-11-12T17:23:10.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001457563 2020-11-12T17:23:10.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747268+0000", 2020-11-12T17:23:10.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116141 2020-11-12T17:23:10.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747384+0000", 2020-11-12T17:23:10.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013822899999999999 2020-11-12T17:23:10.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747522+0000", 2020-11-12T17:23:10.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079223100000000001 2020-11-12T17:23:10.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.748315+0000", 2020-11-12T17:23:10.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21734695200000001 2020-11-12T17:23:10.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965662+0000", 2020-11-12T17:23:10.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011252999999999999 2020-11-12T17:23:10.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965774+0000", 2020-11-12T17:23:10.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015996700000000001 2020-11-12T17:23:10.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965934+0000", 2020-11-12T17:23:10.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001 2020-11-12T17:23:10.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.206 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:337 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2997665930000002, 2020-11-12T17:23:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089, 2020-11-12T17:23:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.208 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.208 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.208 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.208 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.208 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 337 2020-11-12T17:23:10.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.209 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:10.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:10.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:10.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808793+0000", 2020-11-12T17:23:10.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012736400000000001 2020-11-12T17:23:10.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808920+0000", 2020-11-12T17:23:10.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7972e-05 2020-11-12T17:23:10.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808938+0000", 2020-11-12T17:23:10.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5259999999999999e-06 2020-11-12T17:23:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808948+0000", 2020-11-12T17:23:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3725000000000001e-05 2020-11-12T17:23:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809041+0000", 2020-11-12T17:23:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026396500000000001 2020-11-12T17:23:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809305+0000", 2020-11-12T17:23:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000287686 2020-11-12T17:23:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809593+0000", 2020-11-12T17:23:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049805869999999999 2020-11-12T17:23:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814574+0000", 2020-11-12T17:23:10.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151510007 2020-11-12T17:23:10.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966084+0000", 2020-11-12T17:23:10.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110937 2020-11-12T17:23:10.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966195+0000", 2020-11-12T17:23:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5339999999999994e-05 2020-11-12T17:23:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966270+0000", 2020-11-12T17:23:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089 2020-11-12T17:23:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:338 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2995437560000003, 2020-11-12T17:23:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999, 2020-11-12T17:23:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 338 2020-11-12T17:23:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809008+0000", 2020-11-12T17:23:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000123659 2020-11-12T17:23:10.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809131+0000", 2020-11-12T17:23:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4180000000000003e-06 2020-11-12T17:23:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809141+0000", 2020-11-12T17:23:10.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2680000000000002e-06 2020-11-12T17:23:10.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809146+0000", 2020-11-12T17:23:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011238120000000001 2020-11-12T17:23:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810270+0000", 2020-11-12T17:23:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9084000000000003e-05 2020-11-12T17:23:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810359+0000", 2020-11-12T17:23:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186856 2020-11-12T17:23:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810546+0000", 2020-11-12T17:23:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040397699999999998 2020-11-12T17:23:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814586+0000", 2020-11-12T17:23:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15495921400000001 2020-11-12T17:23:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969545+0000", 2020-11-12T17:23:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012353700000000001 2020-11-12T17:23:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969668+0000", 2020-11-12T17:23:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013906300000000001 2020-11-12T17:23:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969807+0000", 2020-11-12T17:23:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999 2020-11-12T17:23:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:339 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2994068600000004, 2020-11-12T17:23:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999, 2020-11-12T17:23:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 339 2020-11-12T17:23:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809174+0000", 2020-11-12T17:23:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4807000000000005e-05 2020-11-12T17:23:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809238+0000", 2020-11-12T17:23:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2660000000000001e-06 2020-11-12T17:23:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809247+0000", 2020-11-12T17:23:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1060000000000002e-06 2020-11-12T17:23:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809251+0000", 2020-11-12T17:23:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001789286 2020-11-12T17:23:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811040+0000", 2020-11-12T17:23:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013621 2020-11-12T17:23:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811176+0000", 2020-11-12T17:23:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023835800000000001 2020-11-12T17:23:10.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811415+0000", 2020-11-12T17:23:10.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031774529999999998 2020-11-12T17:23:10.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814592+0000", 2020-11-12T17:23:10.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15532954199999999 2020-11-12T17:23:10.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969922+0000", 2020-11-12T17:23:10.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021167000000000001 2020-11-12T17:23:10.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970133+0000", 2020-11-12T17:23:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7349999999999995e-05 2020-11-12T17:23:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970231+0000", 2020-11-12T17:23:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999 2020-11-12T17:23:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:340 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2988747509999996, 2020-11-12T17:23:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999, 2020-11-12T17:23:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 340 2020-11-12T17:23:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999958 2020-11-12T17:23:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809686+0000", 2020-11-12T17:23:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9798999999999999e-05 2020-11-12T17:23:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809776+0000", 2020-11-12T17:23:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2833999999999999e-05 2020-11-12T17:23:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809788+0000", 2020-11-12T17:23:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-06 2020-11-12T17:23:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809794+0000", 2020-11-12T17:23:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020989979999999999 2020-11-12T17:23:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811893+0000", 2020-11-12T17:23:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012502300000000001 2020-11-12T17:23:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812018+0000", 2020-11-12T17:23:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013605900000000001 2020-11-12T17:23:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812154+0000", 2020-11-12T17:23:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003821344 2020-11-12T17:23:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815975+0000", 2020-11-12T17:23:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15447417999999999 2020-11-12T17:23:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970449+0000", 2020-11-12T17:23:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2955999999999997e-05 2020-11-12T17:23:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970532+0000", 2020-11-12T17:23:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6341999999999998e-05 2020-11-12T17:23:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970578+0000", 2020-11-12T17:23:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999 2020-11-12T17:23:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:341 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2987511740000004, 2020-11-12T17:23:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999, 2020-11-12T17:23:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 341 2020-11-12T17:23:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:23:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809810+0000", 2020-11-12T17:23:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129682 2020-11-12T17:23:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809940+0000", 2020-11-12T17:23:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2874000000000002e-05 2020-11-12T17:23:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809963+0000", 2020-11-12T17:23:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8199999999999997e-06 2020-11-12T17:23:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809971+0000", 2020-11-12T17:23:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026854119999999999 2020-11-12T17:23:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812656+0000", 2020-11-12T17:23:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000136685 2020-11-12T17:23:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812793+0000", 2020-11-12T17:23:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000267831 2020-11-12T17:23:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813061+0000", 2020-11-12T17:23:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029210490000000002 2020-11-12T17:23:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815982+0000", 2020-11-12T17:23:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15468012 2020-11-12T17:23:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970662+0000", 2020-11-12T17:23:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111106 2020-11-12T17:23:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970773+0000", 2020-11-12T17:23:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111366 2020-11-12T17:23:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970884+0000", 2020-11-12T17:23:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999 2020-11-12T17:23:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:342 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2985751529999998, 2020-11-12T17:23:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999, 2020-11-12T17:23:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 342 2020-11-12T17:23:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810002+0000", 2020-11-12T17:23:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0510000000000001e-05 2020-11-12T17:23:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810072+0000", 2020-11-12T17:23:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9950000000000005e-06 2020-11-12T17:23:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810080+0000", 2020-11-12T17:23:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0779999999999997e-06 2020-11-12T17:23:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810084+0000", 2020-11-12T17:23:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003443944 2020-11-12T17:23:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813528+0000", 2020-11-12T17:23:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010784 2020-11-12T17:23:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813636+0000", 2020-11-12T17:23:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019826199999999999 2020-11-12T17:23:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813834+0000", 2020-11-12T17:23:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021549550000000001 2020-11-12T17:23:10.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815989+0000", 2020-11-12T17:23:10.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15502450600000001 2020-11-12T17:23:10.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971014+0000", 2020-11-12T17:23:10.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6885999999999996e-05 2020-11-12T17:23:10.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971081+0000", 2020-11-12T17:23:10.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9054000000000006e-05 2020-11-12T17:23:10.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971160+0000", 2020-11-12T17:23:10.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999 2020-11-12T17:23:10.343 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.343 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.343 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.344 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:343 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.344 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:10.344 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2982721660000003, 2020-11-12T17:23:10.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001, 2020-11-12T17:23:10.344 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.344 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.345 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 343 2020-11-12T17:23:10.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.345 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:10.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:10.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:10.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810292+0000", 2020-11-12T17:23:10.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012150399999999999 2020-11-12T17:23:10.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810413+0000", 2020-11-12T17:23:10.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6617e-05 2020-11-12T17:23:10.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810430+0000", 2020-11-12T17:23:10.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414000000000001e-05 2020-11-12T17:23:10.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810440+0000", 2020-11-12T17:23:10.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042287779999999999 2020-11-12T17:23:10.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814669+0000", 2020-11-12T17:23:10.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012893400000000001 2020-11-12T17:23:10.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814798+0000", 2020-11-12T17:23:10.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187195 2020-11-12T17:23:10.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814985+0000", 2020-11-12T17:23:10.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001013566 2020-11-12T17:23:10.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815999+0000", 2020-11-12T17:23:10.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15527013200000001 2020-11-12T17:23:10.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971269+0000", 2020-11-12T17:23:10.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010525 2020-11-12T17:23:10.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971374+0000", 2020-11-12T17:23:10.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-05 2020-11-12T17:23:10.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971425+0000", 2020-11-12T17:23:10.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001 2020-11-12T17:23:10.364 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.364 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.364 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.365 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:344 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.365 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:10.365 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2955473619999998, 2020-11-12T17:23:10.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999, 2020-11-12T17:23:10.365 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.365 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.366 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 344 2020-11-12T17:23:10.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.366 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813023+0000", 2020-11-12T17:23:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5440999999999996e-05 2020-11-12T17:23:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813119+0000", 2020-11-12T17:23:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2757e-05 2020-11-12T17:23:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813131+0000", 2020-11-12T17:23:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8279999999999997e-06 2020-11-12T17:23:10.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813138+0000", 2020-11-12T17:23:10.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002273653 2020-11-12T17:23:10.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815412+0000", 2020-11-12T17:23:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012572199999999999 2020-11-12T17:23:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815537+0000", 2020-11-12T17:23:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013668400000000001 2020-11-12T17:23:10.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815674+0000", 2020-11-12T17:23:10.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001073863 2020-11-12T17:23:10.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.816748+0000", 2020-11-12T17:23:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154859634 2020-11-12T17:23:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971608+0000", 2020-11-12T17:23:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7041999999999999e-05 2020-11-12T17:23:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971675+0000", 2020-11-12T17:23:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9370000000000002e-05 2020-11-12T17:23:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971734+0000", 2020-11-12T17:23:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999 2020-11-12T17:23:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:369 3.1 3:8dcbed5a:::benchmark_data_smithi036_14212_object46:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.881426+0000", 2020-11-12T17:23:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2271760079999998, 2020-11-12T17:23:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.090490853999999996, 2020-11-12T17:23:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 369 2020-11-12T17:23:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881426+0000", 2020-11-12T17:23:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881426+0000", 2020-11-12T17:23:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:23:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881390+0000", 2020-11-12T17:23:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000122019 2020-11-12T17:23:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881512+0000", 2020-11-12T17:23:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0440000000000001e-05 2020-11-12T17:23:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881533+0000", 2020-11-12T17:23:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2523e-05 2020-11-12T17:23:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881545+0000", 2020-11-12T17:23:10.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9833000000000005e-05 2020-11-12T17:23:10.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881635+0000", 2020-11-12T17:23:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027254100000000001 2020-11-12T17:23:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.881907+0000", 2020-11-12T17:23:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026097700000000002 2020-11-12T17:23:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.882168+0000", 2020-11-12T17:23:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001382376 2020-11-12T17:23:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.883551+0000", 2020-11-12T17:23:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.088256887000000006 2020-11-12T17:23:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971808+0000", 2020-11-12T17:23:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2611999999999997e-05 2020-11-12T17:23:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971860+0000", 2020-11-12T17:23:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7014e-05 2020-11-12T17:23:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971917+0000", 2020-11-12T17:23:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.090490853999999996 2020-11-12T17:23:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.9997253400000004, 2020-11-12T17:23:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:23:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.388 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:23:10.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.388 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:23:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:23:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:23:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:23:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:23:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:23:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:23:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:23:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:23:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:23:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:23:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:23:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:23:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:23:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:23:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:23:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:23:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:23:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:23:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:23:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:23:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:23:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:23:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.9926335440000003, 2020-11-12T17:23:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:23:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:23:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:23:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:23:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:23:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:23:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:23:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:23:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:23:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:23:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:23:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:23:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:23:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:23:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:23:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:800 3.1 3:89cec530:::benchmark_data_smithi036_14212_object99:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.309954+0000", 2020-11-12T17:23:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.7986480550000001, 2020-11-12T17:23:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.081320585000000001, 2020-11-12T17:23:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 800 2020-11-12T17:23:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.309954+0000", 2020-11-12T17:23:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.309954+0000", 2020-11-12T17:23:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.309922+0000", 2020-11-12T17:23:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117343 2020-11-12T17:23:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.310039+0000", 2020-11-12T17:23:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2055999999999999e-05 2020-11-12T17:23:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.310051+0000", 2020-11-12T17:23:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9270000000000002e-06 2020-11-12T17:23:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.310057+0000", 2020-11-12T17:23:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0076449559999999996 2020-11-12T17:23:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.317702+0000", 2020-11-12T17:23:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112568 2020-11-12T17:23:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.317815+0000", 2020-11-12T17:23:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196761 2020-11-12T17:23:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.318011+0000", 2020-11-12T17:23:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026124949999999998 2020-11-12T17:23:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.320624+0000", 2020-11-12T17:23:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.070567863999999994 2020-11-12T17:23:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.391192+0000", 2020-11-12T17:23:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6972999999999999e-05 2020-11-12T17:23:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.391239+0000", 2020-11-12T17:23:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6242000000000003e-05 2020-11-12T17:23:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.391275+0000", 2020-11-12T17:23:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.081320585000000001 2020-11-12T17:23:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1032 3.6 3:6c903521:::benchmark_data_smithi036_14212_object128:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.544141+0000", 2020-11-12T17:23:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.5644612660000004, 2020-11-12T17:23:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098369252000000004, 2020-11-12T17:23:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1032 2020-11-12T17:23:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544141+0000", 2020-11-12T17:23:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544141+0000", 2020-11-12T17:23:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:23:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544123+0000", 2020-11-12T17:23:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3188e-05 2020-11-12T17:23:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544177+0000", 2020-11-12T17:23:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6169e-05 2020-11-12T17:23:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544203+0000", 2020-11-12T17:23:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7700000000000001e-06 2020-11-12T17:23:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.544211+0000", 2020-11-12T17:23:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068689559999999998 2020-11-12T17:23:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.551080+0000", 2020-11-12T17:23:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153287 2020-11-12T17:23:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.551233+0000", 2020-11-12T17:23:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025069399999999998 2020-11-12T17:23:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.551484+0000", 2020-11-12T17:23:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0043336549999999996 2020-11-12T17:23:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.555817+0000", 2020-11-12T17:23:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086549730000000005 2020-11-12T17:23:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642367+0000", 2020-11-12T17:23:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6860999999999994e-05 2020-11-12T17:23:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642454+0000", 2020-11-12T17:23:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6699e-05 2020-11-12T17:23:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642510+0000", 2020-11-12T17:23:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098369252000000004 2020-11-12T17:23:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:1032 3.6 e23/20 ondisk, result = 0)", 2020-11-12T17:23:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.556152+0000", 2020-11-12T17:23:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.5524501519999996, 2020-11-12T17:23:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086367480999999996, 2020-11-12T17:23:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.556152+0000", 2020-11-12T17:23:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.556152+0000", 2020-11-12T17:23:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:23:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.556135+0000", 2020-11-12T17:23:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5197000000000001e-05 2020-11-12T17:23:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.556180+0000", 2020-11-12T17:23:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086085643000000003 2020-11-12T17:23:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642266+0000", 2020-11-12T17:23:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0159999999999999e-05 2020-11-12T17:23:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642276+0000", 2020-11-12T17:23:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0067999999999994e-05 2020-11-12T17:23:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642346+0000", 2020-11-12T17:23:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1042e-05 2020-11-12T17:23:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642357+0000", 2020-11-12T17:23:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016288699999999999 2020-11-12T17:23:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.642520+0000", 2020-11-12T17:23:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086367480999999996 2020-11-12T17:23:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1184 3.1 3:8cf11d6b:::benchmark_data_smithi036_14212_object147:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.695886+0000", 2020-11-12T17:23:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.4127167460000001, 2020-11-12T17:23:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065001903, 2020-11-12T17:23:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1184 2020-11-12T17:23:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695886+0000", 2020-11-12T17:23:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695886+0000", 2020-11-12T17:23:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695856+0000", 2020-11-12T17:23:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2856999999999995e-05 2020-11-12T17:23:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695949+0000", 2020-11-12T17:23:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2404e-05 2020-11-12T17:23:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695961+0000", 2020-11-12T17:23:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6699999999999997e-06 2020-11-12T17:23:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.695968+0000", 2020-11-12T17:23:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001745843 2020-11-12T17:23:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.697714+0000", 2020-11-12T17:23:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6091000000000001e-05 2020-11-12T17:23:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.697780+0000", 2020-11-12T17:23:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010623 2020-11-12T17:23:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.697886+0000", 2020-11-12T17:23:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011941779999999999 2020-11-12T17:23:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.699080+0000", 2020-11-12T17:23:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061621771999999998 2020-11-12T17:23:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.760702+0000", 2020-11-12T17:23:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000105277 2020-11-12T17:23:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.760807+0000", 2020-11-12T17:23:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0196000000000003e-05 2020-11-12T17:23:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.760888+0000", 2020-11-12T17:23:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065001903 2020-11-12T17:23:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1256 3.1 3:8fc736c6:::benchmark_data_smithi036_14212_object156:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.762818+0000", 2020-11-12T17:23:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.345784138, 2020-11-12T17:23:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15230354900000001, 2020-11-12T17:23:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1256 2020-11-12T17:23:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762818+0000", 2020-11-12T17:23:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762818+0000", 2020-11-12T17:23:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999433 2020-11-12T17:23:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762761+0000", 2020-11-12T17:23:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015136899999999999 2020-11-12T17:23:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762913+0000", 2020-11-12T17:23:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.772e-05 2020-11-12T17:23:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762931+0000", 2020-11-12T17:23:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9279999999999993e-06 2020-11-12T17:23:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762938+0000", 2020-11-12T17:23:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001502078 2020-11-12T17:23:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.764441+0000", 2020-11-12T17:23:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116383 2020-11-12T17:23:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.764557+0000", 2020-11-12T17:23:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018970599999999999 2020-11-12T17:23:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.764747+0000", 2020-11-12T17:23:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00098085199999999994 2020-11-12T17:23:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.765727+0000", 2020-11-12T17:23:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.149260742 2020-11-12T17:23:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.914988+0000", 2020-11-12T17:23:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6503999999999998e-05 2020-11-12T17:23:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.915065+0000", 2020-11-12T17:23:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7188999999999997e-05 2020-11-12T17:23:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.915122+0000", 2020-11-12T17:23:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15230354900000001 2020-11-12T17:23:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1448 3.1 3:86d05ff5:::benchmark_data_smithi036_14212_object180:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.913336+0000", 2020-11-12T17:23:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.1952661449999997, 2020-11-12T17:23:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093733650000000002, 2020-11-12T17:23:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1448 2020-11-12T17:23:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.913336+0000", 2020-11-12T17:23:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.913336+0000", 2020-11-12T17:23:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.913318+0000", 2020-11-12T17:23:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4874999999999999e-05 2020-11-12T17:23:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.913372+0000", 2020-11-12T17:23:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5609999999999999e-06 2020-11-12T17:23:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.913381+0000", 2020-11-12T17:23:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6710000000000005e-06 2020-11-12T17:23:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.913390+0000", 2020-11-12T17:23:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001785334 2020-11-12T17:23:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.915175+0000", 2020-11-12T17:23:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011173199999999999 2020-11-12T17:23:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.915287+0000", 2020-11-12T17:23:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021320000000000001 2020-11-12T17:23:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.915500+0000", 2020-11-12T17:23:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0043039599999999999 2020-11-12T17:23:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.919804+0000", 2020-11-12T17:23:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.087117921000000001 2020-11-12T17:23:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.006922+0000", 2020-11-12T17:23:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4349000000000003e-05 2020-11-12T17:23:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.006996+0000", 2020-11-12T17:23:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3827999999999999e-05 2020-11-12T17:23:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.007070+0000", 2020-11-12T17:23:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093733650000000002 2020-11-12T17:23:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.492 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:10.494 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:10.492+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:10.494 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:10.528 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:23:10.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 6 16 5781 5765 7.5059 9.92188 0.0138375 0.0165459 2020-11-12T17:23:10.595 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:10.590+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:10.650 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:10.651 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:10.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.651 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5720 3.0 3:0c13ab4c:::benchmark_data_smithi036_14212_object714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:10.652 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:10.652 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.16663392299999999, 2020-11-12T17:23:10.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.166678881, 2020-11-12T17:23:10.653 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:10.653 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:10.653 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:10.653 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:10.654 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:10.654 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5720 2020-11-12T17:23:10.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.655 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:10.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:10.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:10.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:10.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:10.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:10.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:10.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:10.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483326+0000", 2020-11-12T17:23:10.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4151999999999999e-05 2020-11-12T17:23:10.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:10.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483380+0000", 2020-11-12T17:23:10.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1484999999999999e-05 2020-11-12T17:23:10.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:10.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483392+0000", 2020-11-12T17:23:10.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0610000000000003e-06 2020-11-12T17:23:10.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:10.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483397+0000", 2020-11-12T17:23:10.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041122260000000001 2020-11-12T17:23:10.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:10.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487509+0000", 2020-11-12T17:23:10.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012518300000000001 2020-11-12T17:23:10.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:10.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487634+0000", 2020-11-12T17:23:10.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020357700000000001 2020-11-12T17:23:10.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:10.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487838+0000", 2020-11-12T17:23:10.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022445590000000001 2020-11-12T17:23:10.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:10.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:10.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:10.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.490082+0000", 2020-11-12T17:23:10.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0067375780000000001 2020-11-12T17:23:10.669 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.669 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:10.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:10.670 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:10.671 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 1 2020-11-12T17:23:10.671 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:10.673 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:10.715 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:10.714+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:10.796 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:10.794+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:10.876 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:10.878 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:10.878 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:10.878 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:10.879 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:10.891 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:10.898 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:10.896+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:10.999 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:10.996+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:11.021 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:11.069 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:11.069 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:11.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:112 3.8 e22/20 3:18b8dd66:::benchmark_data_smithi036_14212_object13:head v 22'8, mlcod=22'1)", 2020-11-12T17:23:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.4211629500000003, 2020-11-12T17:23:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142703407, 2020-11-12T17:23:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999738 2020-11-12T17:23:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644296+0000", 2020-11-12T17:23:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6483000000000005e-05 2020-11-12T17:23:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644382+0000", 2020-11-12T17:23:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14174973900000001 2020-11-12T17:23:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786132+0000", 2020-11-12T17:23:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3459999999999996e-06 2020-11-12T17:23:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786139+0000", 2020-11-12T17:23:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:23:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786193+0000", 2020-11-12T17:23:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6371999999999997e-05 2020-11-12T17:23:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786229+0000", 2020-11-12T17:23:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00074081500000000003 2020-11-12T17:23:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786970+0000", 2020-11-12T17:23:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5047000000000003e-05 2020-11-12T17:23:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787025+0000", 2020-11-12T17:23:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142703407 2020-11-12T17:23:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:336 3.8 e22/20 3:1a561d42:::benchmark_data_smithi036_14212_object41:head v 22'24, mlcod=22'19)", 2020-11-12T17:23:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.2541295510000001, 2020-11-12T17:23:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.163538234, 2020-11-12T17:23:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811319+0000", 2020-11-12T17:23:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133662 2020-11-12T17:23:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811453+0000", 2020-11-12T17:23:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16096115799999999 2020-11-12T17:23:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972414+0000", 2020-11-12T17:23:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.08e-05 2020-11-12T17:23:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972425+0000", 2020-11-12T17:23:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1691000000000001e-05 2020-11-12T17:23:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972507+0000", 2020-11-12T17:23:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2666000000000001e-05 2020-11-12T17:23:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972549+0000", 2020-11-12T17:23:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023026349999999999 2020-11-12T17:23:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.974852+0000", 2020-11-12T17:23:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1347000000000002e-05 2020-11-12T17:23:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.974893+0000", 2020-11-12T17:23:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.163538234 2020-11-12T17:23:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1064 3.4 3:28f19af0:::benchmark_data_smithi036_14212_object132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.4818961809999998, 2020-11-12T17:23:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108211234, 2020-11-12T17:23:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1064 2020-11-12T17:23:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:23:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583558+0000", 2020-11-12T17:23:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1188999999999997e-05 2020-11-12T17:23:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583649+0000", 2020-11-12T17:23:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1898e-05 2020-11-12T17:23:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583661+0000", 2020-11-12T17:23:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7760000000000003e-06 2020-11-12T17:23:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583667+0000", 2020-11-12T17:23:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013380880000000001 2020-11-12T17:23:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585005+0000", 2020-11-12T17:23:11.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9061999999999995e-05 2020-11-12T17:23:11.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585094+0000", 2020-11-12T17:23:11.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017904600000000001 2020-11-12T17:23:11.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585273+0000", 2020-11-12T17:23:11.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094028799999999995 2020-11-12T17:23:11.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.586214+0000", 2020-11-12T17:23:11.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.105461808 2020-11-12T17:23:11.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691675+0000", 2020-11-12T17:23:11.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9709000000000006e-05 2020-11-12T17:23:11.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691745+0000", 2020-11-12T17:23:11.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4641000000000001e-05 2020-11-12T17:23:11.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691800+0000", 2020-11-12T17:23:11.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108211234 2020-11-12T17:23:11.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.108 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.109 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.109 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:1064 3.4 e23/20 ondisk, result = 0)", 2020-11-12T17:23:11.109 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.588277+0000", 2020-11-12T17:23:11.109 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.4772080369999996, 2020-11-12T17:23:11.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10352993200000001, 2020-11-12T17:23:11.110 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.110 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:11.110 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.588277+0000", 2020-11-12T17:23:11.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.588277+0000", 2020-11-12T17:23:11.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:11.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.588254+0000", 2020-11-12T17:23:11.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7148999999999998e-05 2020-11-12T17:23:11.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.588311+0000", 2020-11-12T17:23:11.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.103256166 2020-11-12T17:23:11.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691567+0000", 2020-11-12T17:23:11.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0556e-05 2020-11-12T17:23:11.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691578+0000", 2020-11-12T17:23:11.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5386e-05 2020-11-12T17:23:11.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691653+0000", 2020-11-12T17:23:11.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2241e-05 2020-11-12T17:23:11.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691666+0000", 2020-11-12T17:23:11.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141073 2020-11-12T17:23:11.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691807+0000", 2020-11-12T17:23:11.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10352993200000001 2020-11-12T17:23:11.117 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.117 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.117 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.117 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1816 3.4 3:229575d8:::benchmark_data_smithi036_14212_object226:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:11.118 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:11.118 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.8387799859999996, 2020-11-12T17:23:11.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157715203, 2020-11-12T17:23:11.118 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.118 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.118 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.118 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.119 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1816 2020-11-12T17:23:11.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.119 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:11.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:11.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:11.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226671+0000", 2020-11-12T17:23:11.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5532999999999995e-05 2020-11-12T17:23:11.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226766+0000", 2020-11-12T17:23:11.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:23:11.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226779+0000", 2020-11-12T17:23:11.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6120000000000004e-06 2020-11-12T17:23:11.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226786+0000", 2020-11-12T17:23:11.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00085013099999999996 2020-11-12T17:23:11.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227636+0000", 2020-11-12T17:23:11.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1732999999999998e-05 2020-11-12T17:23:11.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227718+0000", 2020-11-12T17:23:11.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100733 2020-11-12T17:23:11.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227819+0000", 2020-11-12T17:23:11.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023757000000000001 2020-11-12T17:23:11.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.230194+0000", 2020-11-12T17:23:11.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154122064 2020-11-12T17:23:11.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384316+0000", 2020-11-12T17:23:11.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9681000000000001e-05 2020-11-12T17:23:11.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384366+0000", 2020-11-12T17:23:11.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3980000000000002e-05 2020-11-12T17:23:11.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384420+0000", 2020-11-12T17:23:11.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157715203 2020-11-12T17:23:11.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.128 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.128 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:1816 3.4 e23/20 ondisk, result = 0)", 2020-11-12T17:23:11.129 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:11.129 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.8356061219999997, 2020-11-12T17:23:11.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15454711500000001, 2020-11-12T17:23:11.129 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.129 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:11.129 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:11.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:11.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:11.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229854+0000", 2020-11-12T17:23:11.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8783000000000003e-05 2020-11-12T17:23:11.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229913+0000", 2020-11-12T17:23:11.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154309107 2020-11-12T17:23:11.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384222+0000", 2020-11-12T17:23:11.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2269999999999999e-06 2020-11-12T17:23:11.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384232+0000", 2020-11-12T17:23:11.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5488999999999996e-05 2020-11-12T17:23:11.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384297+0000", 2020-11-12T17:23:11.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2262000000000001e-05 2020-11-12T17:23:11.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384309+0000", 2020-11-12T17:23:11.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116474 2020-11-12T17:23:11.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384426+0000", 2020-11-12T17:23:11.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15454711500000001 2020-11-12T17:23:11.135 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.135 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.136 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.136 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:4456 3.4 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e24)", 2020-11-12T17:23:11.136 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:11.136 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 2.2190538809999998, 2020-11-12T17:23:11.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28490720800000002, 2020-11-12T17:23:11.137 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.137 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.137 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.137 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.137 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.137 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 4456 2020-11-12T17:23:11.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.138 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:11.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:11.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:11.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846382+0000", 2020-11-12T17:23:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013956400000000001 2020-11-12T17:23:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846521+0000", 2020-11-12T17:23:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7923000000000001e-05 2020-11-12T17:23:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846539+0000", 2020-11-12T17:23:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1470000000000007e-06 2020-11-12T17:23:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846548+0000", 2020-11-12T17:23:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054463600000000004 2020-11-12T17:23:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847093+0000", 2020-11-12T17:23:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2497000000000006e-05 2020-11-12T17:23:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847186+0000", 2020-11-12T17:23:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144227 2020-11-12T17:23:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847330+0000", 2020-11-12T17:23:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010893070000000001 2020-11-12T17:23:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.848419+0000", 2020-11-12T17:23:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.282686039 2020-11-12T17:23:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131105+0000", 2020-11-12T17:23:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012774600000000001 2020-11-12T17:23:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131233+0000", 2020-11-12T17:23:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000105154 2020-11-12T17:23:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131338+0000", 2020-11-12T17:23:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28490720800000002 2020-11-12T17:23:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.147 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.147 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.147 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:4568 3.4 3:21750469:::benchmark_data_smithi036_14212_object570:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:11.147 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.594615+0000", 2020-11-12T17:23:11.147 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.470869585, 2020-11-12T17:23:11.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.096907367999999994, 2020-11-12T17:23:11.148 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.148 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.148 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.148 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.148 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.148 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 4568 2020-11-12T17:23:11.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.149 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.594615+0000", 2020-11-12T17:23:11.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.594615+0000", 2020-11-12T17:23:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.594581+0000", 2020-11-12T17:23:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8888999999999995e-05 2020-11-12T17:23:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.594680+0000", 2020-11-12T17:23:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2333e-05 2020-11-12T17:23:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.594692+0000", 2020-11-12T17:23:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7020000000000004e-06 2020-11-12T17:23:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.594699+0000", 2020-11-12T17:23:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00040887200000000001 2020-11-12T17:23:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.595108+0000", 2020-11-12T17:23:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9806e-05 2020-11-12T17:23:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.595208+0000", 2020-11-12T17:23:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018037500000000001 2020-11-12T17:23:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.595388+0000", 2020-11-12T17:23:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0043417999999999998 2020-11-12T17:23:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.599730+0000", 2020-11-12T17:23:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.091723979999999997 2020-11-12T17:23:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.691454+0000", 2020-11-12T17:23:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1029999999999998e-05 2020-11-12T17:23:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.691495+0000", 2020-11-12T17:23:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7676999999999999e-05 2020-11-12T17:23:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.691523+0000", 2020-11-12T17:23:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.096907367999999994 2020-11-12T17:23:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5022 3.0 3:0b10311c:::benchmark_data_smithi036_14212_object627:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.911811+0000", 2020-11-12T17:23:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.153674085, 2020-11-12T17:23:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093724279999999993, 2020-11-12T17:23:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5022 2020-11-12T17:23:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.911811+0000", 2020-11-12T17:23:11.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.911811+0000", 2020-11-12T17:23:11.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:11.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.911773+0000", 2020-11-12T17:23:11.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103294 2020-11-12T17:23:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.911876+0000", 2020-11-12T17:23:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4389000000000001e-05 2020-11-12T17:23:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.911890+0000", 2020-11-12T17:23:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1770000000000001e-06 2020-11-12T17:23:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.911898+0000", 2020-11-12T17:23:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025620819999999998 2020-11-12T17:23:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.914460+0000", 2020-11-12T17:23:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6135999999999999e-05 2020-11-12T17:23:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.914516+0000", 2020-11-12T17:23:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012705999999999999 2020-11-12T17:23:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.914643+0000", 2020-11-12T17:23:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040938299999999997 2020-11-12T17:23:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.918737+0000", 2020-11-12T17:23:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086703692999999998 2020-11-12T17:23:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.005440+0000", 2020-11-12T17:23:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1140000000000003e-05 2020-11-12T17:23:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.005481+0000", 2020-11-12T17:23:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3452000000000003e-05 2020-11-12T17:23:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.005535+0000", 2020-11-12T17:23:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093724279999999993 2020-11-12T17:23:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.169 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5023 3.0 3:0b10311c:::benchmark_data_smithi036_14212_object627:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:11.169 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.913451+0000", 2020-11-12T17:23:11.169 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.152033581, 2020-11-12T17:23:11.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.095303177000000003, 2020-11-12T17:23:11.169 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5023 2020-11-12T17:23:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913451+0000", 2020-11-12T17:23:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913451+0000", 2020-11-12T17:23:11.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:23:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913414+0000", 2020-11-12T17:23:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110905 2020-11-12T17:23:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913525+0000", 2020-11-12T17:23:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4233000000000001e-05 2020-11-12T17:23:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913539+0000", 2020-11-12T17:23:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8900000000000001e-06 2020-11-12T17:23:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913546+0000", 2020-11-12T17:23:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001571965 2020-11-12T17:23:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.915118+0000", 2020-11-12T17:23:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3060999999999996e-05 2020-11-12T17:23:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.915201+0000", 2020-11-12T17:23:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016190399999999999 2020-11-12T17:23:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.915363+0000", 2020-11-12T17:23:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003862964 2020-11-12T17:23:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.919226+0000", 2020-11-12T17:23:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.089356237000000005 2020-11-12T17:23:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.008582+0000", 2020-11-12T17:23:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9561999999999995e-05 2020-11-12T17:23:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.008661+0000", 2020-11-12T17:23:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2955999999999996e-05 2020-11-12T17:23:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.008754+0000", 2020-11-12T17:23:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.095303177000000003 2020-11-12T17:23:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5024 3.0 3:0b10311c:::benchmark_data_smithi036_14212_object627:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.913599+0000", 2020-11-12T17:23:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.151885732, 2020-11-12T17:23:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100962908, 2020-11-12T17:23:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5024 2020-11-12T17:23:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913599+0000", 2020-11-12T17:23:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913599+0000", 2020-11-12T17:23:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913567+0000", 2020-11-12T17:23:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010259699999999999 2020-11-12T17:23:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913670+0000", 2020-11-12T17:23:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2643000000000001e-05 2020-11-12T17:23:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913683+0000", 2020-11-12T17:23:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0469999999999999e-06 2020-11-12T17:23:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.913689+0000", 2020-11-12T17:23:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023427980000000001 2020-11-12T17:23:11.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.916031+0000", 2020-11-12T17:23:11.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6010999999999999e-05 2020-11-12T17:23:11.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.916127+0000", 2020-11-12T17:23:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169345 2020-11-12T17:23:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.916297+0000", 2020-11-12T17:23:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029349210000000001 2020-11-12T17:23:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.919232+0000", 2020-11-12T17:23:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.095210310000000006 2020-11-12T17:23:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.014442+0000", 2020-11-12T17:23:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:23:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.014493+0000", 2020-11-12T17:23:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:23:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.014562+0000", 2020-11-12T17:23:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100962908 2020-11-12T17:23:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5024 3.0 e25/20 ondisk, result = 0)", 2020-11-12T17:23:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.920096+0000", 2020-11-12T17:23:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.1453890630000001, 2020-11-12T17:23:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.094477773000000001, 2020-11-12T17:23:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.193 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:11.193 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.920096+0000", 2020-11-12T17:23:11.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.920096+0000", 2020-11-12T17:23:11.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999881 2020-11-12T17:23:11.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.920084+0000", 2020-11-12T17:23:11.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0079000000000001e-05 2020-11-12T17:23:11.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.920114+0000", 2020-11-12T17:23:11.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093031442000000006 2020-11-12T17:23:11.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.013145+0000", 2020-11-12T17:23:11.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2533e-05 2020-11-12T17:23:11.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.013158+0000", 2020-11-12T17:23:11.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001269013 2020-11-12T17:23:11.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.014427+0000", 2020-11-12T17:23:11.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2009999999999999e-06 2020-11-12T17:23:11.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.014435+0000", 2020-11-12T17:23:11.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013829200000000001 2020-11-12T17:23:11.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.014573+0000", 2020-11-12T17:23:11.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.094477773000000001 2020-11-12T17:23:11.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.199 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.199 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5344 3.4 3:256e9fb4:::benchmark_data_smithi036_14212_object667:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:11.199 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:11.200 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.88205884199999995, 2020-11-12T17:23:11.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116435965, 2020-11-12T17:23:11.200 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.200 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.201 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5344 2020-11-12T17:23:11.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.201 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:11.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:23:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183396+0000", 2020-11-12T17:23:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4202000000000004e-05 2020-11-12T17:23:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183490+0000", 2020-11-12T17:23:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9741e-05 2020-11-12T17:23:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183510+0000", 2020-11-12T17:23:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5509999999999996e-06 2020-11-12T17:23:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183516+0000", 2020-11-12T17:23:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036344010000000002 2020-11-12T17:23:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187151+0000", 2020-11-12T17:23:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011442099999999999 2020-11-12T17:23:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187265+0000", 2020-11-12T17:23:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018573799999999999 2020-11-12T17:23:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187451+0000", 2020-11-12T17:23:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044292359999999996 2020-11-12T17:23:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.191880+0000", 2020-11-12T17:23:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.107843906 2020-11-12T17:23:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299724+0000", 2020-11-12T17:23:11.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5835000000000003e-05 2020-11-12T17:23:11.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299780+0000", 2020-11-12T17:23:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2107000000000005e-05 2020-11-12T17:23:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299862+0000", 2020-11-12T17:23:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116435965 2020-11-12T17:23:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5344 3.4 e25/20 ondisk, result = 0)", 2020-11-12T17:23:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.87316707800000004, 2020-11-12T17:23:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10756062, 2020-11-12T17:23:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192288+0000", 2020-11-12T17:23:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9671000000000003e-05 2020-11-12T17:23:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192368+0000", 2020-11-12T17:23:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.105564818 2020-11-12T17:23:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.297932+0000", 2020-11-12T17:23:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1760000000000004e-06 2020-11-12T17:23:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.297940+0000", 2020-11-12T17:23:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017675919999999999 2020-11-12T17:23:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299707+0000", 2020-11-12T17:23:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:23:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299716+0000", 2020-11-12T17:23:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162015 2020-11-12T17:23:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299878+0000", 2020-11-12T17:23:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10756062 2020-11-12T17:23:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5496 3.4 3:2cf172bc:::benchmark_data_smithi036_14212_object686:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.76635827499999998, 2020-11-12T17:23:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124862294, 2020-11-12T17:23:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5496 2020-11-12T17:23:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:11.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299088+0000", 2020-11-12T17:23:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120711 2020-11-12T17:23:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299209+0000", 2020-11-12T17:23:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7577000000000001e-05 2020-11-12T17:23:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299226+0000", 2020-11-12T17:23:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3689999999999999e-05 2020-11-12T17:23:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299240+0000", 2020-11-12T17:23:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056383780000000003 2020-11-12T17:23:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.304878+0000", 2020-11-12T17:23:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104419 2020-11-12T17:23:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.304983+0000", 2020-11-12T17:23:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019338800000000001 2020-11-12T17:23:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.305176+0000", 2020-11-12T17:23:11.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001656366 2020-11-12T17:23:11.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.306832+0000", 2020-11-12T17:23:11.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.117004916 2020-11-12T17:23:11.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423837+0000", 2020-11-12T17:23:11.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1908000000000003e-05 2020-11-12T17:23:11.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423909+0000", 2020-11-12T17:23:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9568999999999997e-05 2020-11-12T17:23:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423989+0000", 2020-11-12T17:23:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124862294 2020-11-12T17:23:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5496 3.4 e25/20 ondisk, result = 0)", 2020-11-12T17:23:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.75820391899999995, 2020-11-12T17:23:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116715649, 2020-11-12T17:23:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:11.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:11.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:11.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307254+0000", 2020-11-12T17:23:11.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7615999999999998e-05 2020-11-12T17:23:11.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307321+0000", 2020-11-12T17:23:11.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116404623 2020-11-12T17:23:11.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423726+0000", 2020-11-12T17:23:11.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8149999999999995e-06 2020-11-12T17:23:11.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423735+0000", 2020-11-12T17:23:11.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1903999999999994e-05 2020-11-12T17:23:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423817+0000", 2020-11-12T17:23:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.028e-05 2020-11-12T17:23:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423827+0000", 2020-11-12T17:23:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016951499999999999 2020-11-12T17:23:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423996+0000", 2020-11-12T17:23:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116715649 2020-11-12T17:23:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:5703 3.6 e25/20 3:6399e945:::benchmark_data_smithi036_14212_object712:head v 25'391, mlcod=25'383)", 2020-11-12T17:23:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.591057952, 2020-11-12T17:23:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19527752500000001, 2020-11-12T17:23:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999347 2020-11-12T17:23:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474361+0000", 2020-11-12T17:23:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015052699999999999 2020-11-12T17:23:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474512+0000", 2020-11-12T17:23:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.194039023 2020-11-12T17:23:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668551+0000", 2020-11-12T17:23:11.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3286e-05 2020-11-12T17:23:11.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668564+0000", 2020-11-12T17:23:11.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960999999999999e-05 2020-11-12T17:23:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668655+0000", 2020-11-12T17:23:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7333999999999999e-05 2020-11-12T17:23:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668692+0000", 2020-11-12T17:23:11.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00091690499999999998 2020-11-12T17:23:11.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669609+0000", 2020-11-12T17:23:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4975999999999993e-05 2020-11-12T17:23:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669704+0000", 2020-11-12T17:23:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19527752500000001 2020-11-12T17:23:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:5704 3.6 e25/20 3:6399e945:::benchmark_data_smithi036_14212_object712:head v 25'392, mlcod=25'386)", 2020-11-12T17:23:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.58897814999999998, 2020-11-12T17:23:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19575757999999999, 2020-11-12T17:23:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476472+0000", 2020-11-12T17:23:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013146800000000001 2020-11-12T17:23:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476603+0000", 2020-11-12T17:23:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.194169657 2020-11-12T17:23:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670773+0000", 2020-11-12T17:23:11.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1989999999999999e-06 2020-11-12T17:23:11.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670777+0000", 2020-11-12T17:23:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6594000000000001e-05 2020-11-12T17:23:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670824+0000", 2020-11-12T17:23:11.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9747000000000002e-05 2020-11-12T17:23:11.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670854+0000", 2020-11-12T17:23:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001341456 2020-11-12T17:23:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.672195+0000", 2020-11-12T17:23:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9018999999999998e-05 2020-11-12T17:23:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.672264+0000", 2020-11-12T17:23:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19575757999999999 2020-11-12T17:23:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.284 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5720 3.0 3:0c13ab4c:::benchmark_data_smithi036_14212_object714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.58213982200000003, 2020-11-12T17:23:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356863017, 2020-11-12T17:23:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5720 2020-11-12T17:23:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483326+0000", 2020-11-12T17:23:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4151999999999999e-05 2020-11-12T17:23:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483380+0000", 2020-11-12T17:23:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1484999999999999e-05 2020-11-12T17:23:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483392+0000", 2020-11-12T17:23:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0610000000000003e-06 2020-11-12T17:23:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483397+0000", 2020-11-12T17:23:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041122260000000001 2020-11-12T17:23:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487509+0000", 2020-11-12T17:23:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012518300000000001 2020-11-12T17:23:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487634+0000", 2020-11-12T17:23:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020357700000000001 2020-11-12T17:23:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487838+0000", 2020-11-12T17:23:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022445590000000001 2020-11-12T17:23:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.490082+0000", 2020-11-12T17:23:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35001414600000003 2020-11-12T17:23:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840097+0000", 2020-11-12T17:23:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9443e-05 2020-11-12T17:23:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840156+0000", 2020-11-12T17:23:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.185e-05 2020-11-12T17:23:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840208+0000", 2020-11-12T17:23:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356863017 2020-11-12T17:23:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5720 3.0 e25/20 ondisk, result = 0)", 2020-11-12T17:23:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.57280948200000004, 2020-11-12T17:23:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.347542456, 2020-11-12T17:23:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999989 2020-11-12T17:23:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492664+0000", 2020-11-12T17:23:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8972999999999999e-05 2020-11-12T17:23:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492693+0000", 2020-11-12T17:23:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34695741600000002 2020-11-12T17:23:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.839651+0000", 2020-11-12T17:23:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.549e-06 2020-11-12T17:23:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.839655+0000", 2020-11-12T17:23:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00042003800000000002 2020-11-12T17:23:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840075+0000", 2020-11-12T17:23:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.205e-05 2020-11-12T17:23:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840087+0000", 2020-11-12T17:23:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054700000000001 2020-11-12T17:23:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840218+0000", 2020-11-12T17:23:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.347542456 2020-11-12T17:23:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.322 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.322 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:11.322 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:11.323 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:11.325 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:11.326 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:11.327 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:11.327 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:11.327 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:11.327 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:11.327 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:11.324+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:11.356 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:11.396 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:11.425 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:11.426 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:11.424+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:11.427 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:11.427 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:11.427 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:11.427 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:11.428 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:11.428 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:11.428 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:11.428 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:11.474 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:11.485 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:11.489 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:11.528 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:23:11.529 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:11.526+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:11.539 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:11.536+0000 7f928515c700 -1 osd.7 25 handle_osd_map injecting map crc failure 2020-11-12T17:23:11.563 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 7 16 6735 6719 7.49828 7.45312 0.00553064 0.0166188 2020-11-12T17:23:11.628 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:11.628+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:11.662 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:11.662 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:11.673 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:11.730 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:11.728+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:11.829 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:11.826+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:11.849 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:11.849 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:11.862 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:11.931 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:11.928+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:12.032 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:12.032+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:12.036 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:12.037 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:12.051 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:12.134 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:12.132+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:12.188 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:12.188 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:12.200 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:12.247 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:12.246+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:12.338 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:12.339 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:12.339 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:12.336+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:12.346 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:12.439 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:12.438+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:12.479 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:12.479 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:12.490 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:12.540 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:12.540+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:12.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 8 16 8098 8082 7.89194 10.6484 0.00531679 0.0157507 2020-11-12T17:23:12.612 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:12.612 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:12.621 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:12.664 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:12.664+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:12.742 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:12.740+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:12.777 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:12.777 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:12.788 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:12.844 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:12.841+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:12.944 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:12.945 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:12.945 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:12.944+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:12.955 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:13.045 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:13.041+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:13.116 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:13.117 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:13.127 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:13.147 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:13.141+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:13.246 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:13.247 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:13.249 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:13.245+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:13.256 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:13.350 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:13.345+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:13.362 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:13.363 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:13.372 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:13.444 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:13.475 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:13.476 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:13.487 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:13.494 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:13.489+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:13.527 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-12T17:23:13.528 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:23:13.528 INFO:tasks.thrashosds.thrasher:Adding osd 6 2020-11-12T17:23:13.529 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd in 6 2020-11-12T17:23:13.541 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:23:13.553 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:13.552+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:13.562 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 9 16 8952 8936 7.75631 6.67188 0.00935198 0.0160392 2020-11-12T17:23:13.620 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:13.620 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:13.631 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:13.641 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:13.673 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:13.672+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:13.674 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:13.711 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:13.754 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:13.755 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:13.752+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:13.781 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:13.781 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:13.791 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:13.811 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:13.881 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:13.882 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:13.877+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:13.909 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:13.917 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:23:13.913+0000 7f4952786700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2020-11-12T17:23:13.951 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:13.952 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:13.952 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:13.953 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:13.953 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:13.953 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:13.953 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:13.954 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:13.954 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:13.982 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:13.980+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:13.991 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:13.992 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:13.992 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:13.992 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:13.993 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:14.003 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:14.084 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:14.077+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:14.172 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:14.186 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:952 3.e 3:761d409b:::benchmark_data_smithi036_14212_object118:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.446319+0000", 2020-11-12T17:23:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 8.7246758189999998, 2020-11-12T17:23:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16236105000000001, 2020-11-12T17:23:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 952 2020-11-12T17:23:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446319+0000", 2020-11-12T17:23:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446319+0000", 2020-11-12T17:23:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446277+0000", 2020-11-12T17:23:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012484099999999999 2020-11-12T17:23:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446401+0000", 2020-11-12T17:23:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8328000000000001e-05 2020-11-12T17:23:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446420+0000", 2020-11-12T17:23:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0899999999999994e-06 2020-11-12T17:23:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.446429+0000", 2020-11-12T17:23:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049512510000000003 2020-11-12T17:23:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.451380+0000", 2020-11-12T17:23:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017698099999999999 2020-11-12T17:23:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.451557+0000", 2020-11-12T17:23:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020305599999999999 2020-11-12T17:23:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.451760+0000", 2020-11-12T17:23:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025762160000000001 2020-11-12T17:23:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.454336+0000", 2020-11-12T17:23:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.154191153 2020-11-12T17:23:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608528+0000", 2020-11-12T17:23:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105173 2020-11-12T17:23:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608633+0000", 2020-11-12T17:23:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7710999999999998e-05 2020-11-12T17:23:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608680+0000", 2020-11-12T17:23:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16236105000000001 2020-11-12T17:23:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:952 3.e e22/20 ondisk, result = 0)", 2020-11-12T17:23:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.457187+0000", 2020-11-12T17:23:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 8.7138083460000004, 2020-11-12T17:23:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.151500567, 2020-11-12T17:23:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.457187+0000", 2020-11-12T17:23:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.457187+0000", 2020-11-12T17:23:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.457161+0000", 2020-11-12T17:23:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8614000000000004e-05 2020-11-12T17:23:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.457230+0000", 2020-11-12T17:23:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15119591499999999 2020-11-12T17:23:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608426+0000", 2020-11-12T17:23:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6949999999999997e-06 2020-11-12T17:23:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608432+0000", 2020-11-12T17:23:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4737e-05 2020-11-12T17:23:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608496+0000", 2020-11-12T17:23:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6138999999999999e-05 2020-11-12T17:23:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608512+0000", 2020-11-12T17:23:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017498700000000001 2020-11-12T17:23:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.608687+0000", 2020-11-12T17:23:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.151500567 2020-11-12T17:23:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1536 3.e 3:729acc68:::benchmark_data_smithi036_14212_object191:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.977565+0000", 2020-11-12T17:23:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 8.1934302429999999, 2020-11-12T17:23:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.128811861, 2020-11-12T17:23:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1536 2020-11-12T17:23:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977565+0000", 2020-11-12T17:23:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977565+0000", 2020-11-12T17:23:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:23:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977534+0000", 2020-11-12T17:23:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3104999999999997e-05 2020-11-12T17:23:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977627+0000", 2020-11-12T17:23:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7805999999999999e-05 2020-11-12T17:23:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977645+0000", 2020-11-12T17:23:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6569999999999997e-06 2020-11-12T17:23:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.977653+0000", 2020-11-12T17:23:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027620029999999999 2020-11-12T17:23:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.980415+0000", 2020-11-12T17:23:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012407999999999999 2020-11-12T17:23:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.980539+0000", 2020-11-12T17:23:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021042000000000001 2020-11-12T17:23:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.980749+0000", 2020-11-12T17:23:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012114999999999999 2020-11-12T17:23:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.981961+0000", 2020-11-12T17:23:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12432718 2020-11-12T17:23:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.106288+0000", 2020-11-12T17:23:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0294000000000003e-05 2020-11-12T17:23:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.106338+0000", 2020-11-12T17:23:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8673000000000001e-05 2020-11-12T17:23:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.106377+0000", 2020-11-12T17:23:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.128811861 2020-11-12T17:23:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1782 3.e 3:7659a87d:::benchmark_data_smithi036_14212_object222:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.186740+0000", 2020-11-12T17:23:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.9842553189999999, 2020-11-12T17:23:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098808143000000001, 2020-11-12T17:23:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1782 2020-11-12T17:23:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186740+0000", 2020-11-12T17:23:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186740+0000", 2020-11-12T17:23:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999514 2020-11-12T17:23:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186691+0000", 2020-11-12T17:23:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013075700000000001 2020-11-12T17:23:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186822+0000", 2020-11-12T17:23:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7977000000000001e-05 2020-11-12T17:23:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186840+0000", 2020-11-12T17:23:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1609999999999992e-06 2020-11-12T17:23:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.186849+0000", 2020-11-12T17:23:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024460580000000001 2020-11-12T17:23:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189295+0000", 2020-11-12T17:23:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011145 2020-11-12T17:23:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189407+0000", 2020-11-12T17:23:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022201 2020-11-12T17:23:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189629+0000", 2020-11-12T17:23:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00144596 2020-11-12T17:23:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.191075+0000", 2020-11-12T17:23:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094283164000000003 2020-11-12T17:23:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285358+0000", 2020-11-12T17:23:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115186 2020-11-12T17:23:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285473+0000", 2020-11-12T17:23:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4896999999999998e-05 2020-11-12T17:23:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285548+0000", 2020-11-12T17:23:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098808143000000001 2020-11-12T17:23:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1783 3.e 3:7659a87d:::benchmark_data_smithi036_14212_object222:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.188212+0000", 2020-11-12T17:23:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.9827831700000003, 2020-11-12T17:23:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.097621049000000001, 2020-11-12T17:23:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1783 2020-11-12T17:23:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188212+0000", 2020-11-12T17:23:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188212+0000", 2020-11-12T17:23:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188183+0000", 2020-11-12T17:23:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8889999999999999e-05 2020-11-12T17:23:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188262+0000", 2020-11-12T17:23:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.311e-05 2020-11-12T17:23:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188275+0000", 2020-11-12T17:23:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5799999999999998e-06 2020-11-12T17:23:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188285+0000", 2020-11-12T17:23:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030249159999999999 2020-11-12T17:23:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.191310+0000", 2020-11-12T17:23:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012678200000000001 2020-11-12T17:23:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.191437+0000", 2020-11-12T17:23:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023708 2020-11-12T17:23:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.191674+0000", 2020-11-12T17:23:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020731579999999999 2020-11-12T17:23:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.193747+0000", 2020-11-12T17:23:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.091901126999999999 2020-11-12T17:23:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285648+0000", 2020-11-12T17:23:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000117358 2020-11-12T17:23:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285765+0000", 2020-11-12T17:23:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7623e-05 2020-11-12T17:23:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.285833+0000", 2020-11-12T17:23:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.097621049000000001 2020-11-12T17:23:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1784 3.e 3:7659a87d:::benchmark_data_smithi036_14212_object222:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.188987+0000", 2020-11-12T17:23:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.9820083549999996, 2020-11-12T17:23:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099291502000000004, 2020-11-12T17:23:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1784 2020-11-12T17:23:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188987+0000", 2020-11-12T17:23:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188987+0000", 2020-11-12T17:23:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999514 2020-11-12T17:23:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.188938+0000", 2020-11-12T17:23:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022587 2020-11-12T17:23:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189164+0000", 2020-11-12T17:23:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0205000000000001e-05 2020-11-12T17:23:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189184+0000", 2020-11-12T17:23:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-06 2020-11-12T17:23:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.189194+0000", 2020-11-12T17:23:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031712590000000001 2020-11-12T17:23:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.192366+0000", 2020-11-12T17:23:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018079200000000001 2020-11-12T17:23:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.192546+0000", 2020-11-12T17:23:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023559699999999999 2020-11-12T17:23:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.192782+0000", 2020-11-12T17:23:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014876659999999999 2020-11-12T17:23:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.194270+0000", 2020-11-12T17:23:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.093813515 2020-11-12T17:23:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.288083+0000", 2020-11-12T17:23:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108022 2020-11-12T17:23:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.288191+0000", 2020-11-12T17:23:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7211000000000002e-05 2020-11-12T17:23:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.288278+0000", 2020-11-12T17:23:14.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099291502000000004 2020-11-12T17:23:14.259 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.259 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.259 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.260 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:23:14.261 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:23:14.261 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.3285481590000003, 2020-11-12T17:23:14.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:23:14.261 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.261 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:23:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:23:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:23:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:23:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:23:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:23:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:23:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:23:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:23:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:23:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:23:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:23:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:23:14.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:23:14.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:23:14.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:23:14.268 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.268 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.269 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.269 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5368 3.d 3:b54fbae0:::benchmark_data_smithi036_14212_object670:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:14.269 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.202445+0000", 2020-11-12T17:23:14.269 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.9685506039999998, 2020-11-12T17:23:14.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24769143199999999, 2020-11-12T17:23:14.269 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.270 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.270 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.270 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.270 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.270 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5368 2020-11-12T17:23:14.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.270 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.202445+0000", 2020-11-12T17:23:14.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.202445+0000", 2020-11-12T17:23:14.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:23:14.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.202403+0000", 2020-11-12T17:23:14.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9042000000000006e-05 2020-11-12T17:23:14.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.202492+0000", 2020-11-12T17:23:14.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1224e-05 2020-11-12T17:23:14.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.202503+0000", 2020-11-12T17:23:14.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.195e-06 2020-11-12T17:23:14.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.202510+0000", 2020-11-12T17:23:14.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038963209999999999 2020-11-12T17:23:14.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.206406+0000", 2020-11-12T17:23:14.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4320000000000006e-05 2020-11-12T17:23:14.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.206490+0000", 2020-11-12T17:23:14.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022887499999999999 2020-11-12T17:23:14.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:14.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.206719+0000", 2020-11-12T17:23:14.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050307900000000003 2020-11-12T17:23:14.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.211750+0000", 2020-11-12T17:23:14.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23816348000000001 2020-11-12T17:23:14.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.449913+0000", 2020-11-12T17:23:14.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010483 2020-11-12T17:23:14.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.450018+0000", 2020-11-12T17:23:14.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000117748 2020-11-12T17:23:14.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.450136+0000", 2020-11-12T17:23:14.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24769143199999999 2020-11-12T17:23:14.284 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.284 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.285 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.286 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5368 3.d e25/20 ondisk, result = 0)", 2020-11-12T17:23:14.286 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.211796+0000", 2020-11-12T17:23:14.286 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.959199221, 2020-11-12T17:23:14.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23835188500000001, 2020-11-12T17:23:14.287 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.287 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:14.287 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.211796+0000", 2020-11-12T17:23:14.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.211796+0000", 2020-11-12T17:23:14.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:14.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.211781+0000", 2020-11-12T17:23:14.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0657000000000001e-05 2020-11-12T17:23:14.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.211822+0000", 2020-11-12T17:23:14.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236725137 2020-11-12T17:23:14.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.448547+0000", 2020-11-12T17:23:14.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9180000000000006e-06 2020-11-12T17:23:14.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.448557+0000", 2020-11-12T17:23:14.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013238600000000001 2020-11-12T17:23:14.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.449881+0000", 2020-11-12T17:23:14.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8178000000000001e-05 2020-11-12T17:23:14.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.449899+0000", 2020-11-12T17:23:14.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024914400000000003 2020-11-12T17:23:14.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.450148+0000", 2020-11-12T17:23:14.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23835188500000001 2020-11-12T17:23:14.298 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.298 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.298 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.299 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5368 3.d 3:b54fbae0:::benchmark_data_smithi036_14212_object670:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e25)", 2020-11-12T17:23:14.299 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.318677+0000", 2020-11-12T17:23:14.300 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.8523186580000002, 2020-11-12T17:23:14.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13136990200000001, 2020-11-12T17:23:14.300 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.300 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:14.300 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.300 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.300 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.301 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5368 2020-11-12T17:23:14.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.301 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.318677+0000", 2020-11-12T17:23:14.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.318677+0000", 2020-11-12T17:23:14.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:14.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.318648+0000", 2020-11-12T17:23:14.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1056000000000004e-05 2020-11-12T17:23:14.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.318739+0000", 2020-11-12T17:23:14.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2401999999999999e-05 2020-11-12T17:23:14.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.318752+0000", 2020-11-12T17:23:14.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7780000000000002e-06 2020-11-12T17:23:14.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.318758+0000", 2020-11-12T17:23:14.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3522000000000005e-05 2020-11-12T17:23:14.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.318832+0000", 2020-11-12T17:23:14.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012466199999999999 2020-11-12T17:23:14.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:23:14.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.318957+0000", 2020-11-12T17:23:14.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13108989800000001 2020-11-12T17:23:14.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.450046+0000", 2020-11-12T17:23:14.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13136990200000001 2020-11-12T17:23:14.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.307 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.308 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:14.308 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:23:14.308 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.6698976160000001, 2020-11-12T17:23:14.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:23:14.308 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.308 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.308 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.309 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:23:14.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.309 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:23:14.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:23:14.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:14.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:23:14.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:23:14.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:23:14.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:23:14.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:23:14.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:23:14.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:23:14.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:23:14.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:23:14.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:23:14.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:23:14.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:23:14.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:14.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:23:14.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:23:14.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:23:14.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:23:14.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:23:14.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:23:14.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:23:14.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:23:14.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:23:14.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:23:14.319 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.319 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.320 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.320 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:14.320 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:23:14.320 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.6682925559999999, 2020-11-12T17:23:14.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:23:14.321 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.321 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.321 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.321 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.321 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.321 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:23:14.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.321 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:23:14.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:23:14.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:14.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:23:14.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:23:14.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:23:14.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:23:14.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:23:14.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:23:14.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:23:14.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:23:14.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:23:14.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:23:14.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:23:14.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:23:14.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:14.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:23:14.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:23:14.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:23:14.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:23:14.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:23:14.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:23:14.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:23:14.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:23:14.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:23:14.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:23:14.335 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.335 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.335 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.335 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5735 3.d e25/20 ondisk, result = 0)", 2020-11-12T17:23:14.335 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:23:14.335 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.662206034, 2020-11-12T17:23:14.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002, 2020-11-12T17:23:14.336 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.336 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:14.336 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:23:14.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:23:14.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:23:14.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508775+0000", 2020-11-12T17:23:14.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4838000000000001e-05 2020-11-12T17:23:14.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508810+0000", 2020-11-12T17:23:14.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30211893099999998 2020-11-12T17:23:14.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810929+0000", 2020-11-12T17:23:14.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3546e-05 2020-11-12T17:23:14.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810942+0000", 2020-11-12T17:23:14.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021619539999999998 2020-11-12T17:23:14.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813104+0000", 2020-11-12T17:23:14.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1251999999999998e-05 2020-11-12T17:23:14.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813135+0000", 2020-11-12T17:23:14.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033488000000000002 2020-11-12T17:23:14.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813470+0000", 2020-11-12T17:23:14.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002 2020-11-12T17:23:14.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.342 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.342 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5824 3.f 3:fffe6057:::benchmark_data_smithi036_14212_object727:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:14.343 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.609972+0000", 2020-11-12T17:23:14.343 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.561023568, 2020-11-12T17:23:14.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25372203199999999, 2020-11-12T17:23:14.343 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.343 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.344 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5824 2020-11-12T17:23:14.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.344 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.609972+0000", 2020-11-12T17:23:14.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.609972+0000", 2020-11-12T17:23:14.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999547 2020-11-12T17:23:14.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.609926+0000", 2020-11-12T17:23:14.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010851100000000001 2020-11-12T17:23:14.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610035+0000", 2020-11-12T17:23:14.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4929999999999999e-05 2020-11-12T17:23:14.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610050+0000", 2020-11-12T17:23:14.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1506e-05 2020-11-12T17:23:14.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610061+0000", 2020-11-12T17:23:14.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021358999999999999 2020-11-12T17:23:14.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610275+0000", 2020-11-12T17:23:14.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012656000000000001 2020-11-12T17:23:14.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610401+0000", 2020-11-12T17:23:14.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025522899999999999 2020-11-12T17:23:14.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610657+0000", 2020-11-12T17:23:14.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013916950000000001 2020-11-12T17:23:14.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.612048+0000", 2020-11-12T17:23:14.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25143695199999999 2020-11-12T17:23:14.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863485+0000", 2020-11-12T17:23:14.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114444 2020-11-12T17:23:14.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863600+0000", 2020-11-12T17:23:14.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3911000000000003e-05 2020-11-12T17:23:14.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863694+0000", 2020-11-12T17:23:14.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25372203199999999 2020-11-12T17:23:14.352 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.353 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.353 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.354 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5824 3.f e25/20 ondisk, result = 0)", 2020-11-12T17:23:14.354 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.616263+0000", 2020-11-12T17:23:14.354 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.5547321599999999, 2020-11-12T17:23:14.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24747045400000001, 2020-11-12T17:23:14.354 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.354 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:14.354 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.616263+0000", 2020-11-12T17:23:14.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.616263+0000", 2020-11-12T17:23:14.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:23:14.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.616233+0000", 2020-11-12T17:23:14.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0451999999999995e-05 2020-11-12T17:23:14.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.616313+0000", 2020-11-12T17:23:14.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24476999199999999 2020-11-12T17:23:14.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.861083+0000", 2020-11-12T17:23:14.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0180000000000001e-05 2020-11-12T17:23:14.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.861093+0000", 2020-11-12T17:23:14.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002357633 2020-11-12T17:23:14.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863451+0000", 2020-11-12T17:23:14.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7782999999999999e-05 2020-11-12T17:23:14.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863469+0000", 2020-11-12T17:23:14.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026493600000000001 2020-11-12T17:23:14.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863733+0000", 2020-11-12T17:23:14.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24747045400000001 2020-11-12T17:23:14.361 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.361 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.361 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.362 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:6039 3.d 3:b8c2806e:::benchmark_data_smithi036_14212_object754:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:14.362 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.906129+0000", 2020-11-12T17:23:14.362 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.264866311, 2020-11-12T17:23:14.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120260354, 2020-11-12T17:23:14.362 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.362 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.363 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.363 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.363 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.363 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 6039 2020-11-12T17:23:14.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.363 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.906129+0000", 2020-11-12T17:23:14.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.906129+0000", 2020-11-12T17:23:14.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:14.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.906086+0000", 2020-11-12T17:23:14.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108589 2020-11-12T17:23:14.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.906194+0000", 2020-11-12T17:23:14.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8745000000000001e-05 2020-11-12T17:23:14.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.906213+0000", 2020-11-12T17:23:14.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1035e-05 2020-11-12T17:23:14.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.906224+0000", 2020-11-12T17:23:14.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1049000000000002e-05 2020-11-12T17:23:14.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.906315+0000", 2020-11-12T17:23:14.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015680800000000001 2020-11-12T17:23:14.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.906472+0000", 2020-11-12T17:23:14.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026381700000000001 2020-11-12T17:23:14.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:14.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.906736+0000", 2020-11-12T17:23:14.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034248289999999999 2020-11-12T17:23:14.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.910161+0000", 2020-11-12T17:23:14.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.116029721 2020-11-12T17:23:14.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.026190+0000", 2020-11-12T17:23:14.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011869799999999999 2020-11-12T17:23:14.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.026309+0000", 2020-11-12T17:23:14.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0062999999999996e-05 2020-11-12T17:23:14.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.026389+0000", 2020-11-12T17:23:14.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120260354 2020-11-12T17:23:14.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.373 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.373 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:6040 3.d 3:b8c2806e:::benchmark_data_smithi036_14212_object754:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:14.374 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.908783+0000", 2020-11-12T17:23:14.374 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.2622125830000002, 2020-11-12T17:23:14.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118996186, 2020-11-12T17:23:14.374 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.374 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.374 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.375 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.375 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.375 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 6040 2020-11-12T17:23:14.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.375 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.908783+0000", 2020-11-12T17:23:14.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.908783+0000", 2020-11-12T17:23:14.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:14.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.908759+0000", 2020-11-12T17:23:14.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011807900000000001 2020-11-12T17:23:14.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.908877+0000", 2020-11-12T17:23:14.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1693e-05 2020-11-12T17:23:14.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.908888+0000", 2020-11-12T17:23:14.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9040000000000003e-06 2020-11-12T17:23:14.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.908895+0000", 2020-11-12T17:23:14.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6873999999999997e-05 2020-11-12T17:23:14.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.908962+0000", 2020-11-12T17:23:14.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111728 2020-11-12T17:23:14.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909074+0000", 2020-11-12T17:23:14.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025978999999999998 2020-11-12T17:23:14.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:14.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909334+0000", 2020-11-12T17:23:14.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00244802 2020-11-12T17:23:14.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.911782+0000", 2020-11-12T17:23:14.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115869943 2020-11-12T17:23:14.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.027652+0000", 2020-11-12T17:23:14.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5821e-05 2020-11-12T17:23:14.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.027707+0000", 2020-11-12T17:23:14.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.135e-05 2020-11-12T17:23:14.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.027779+0000", 2020-11-12T17:23:14.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118996186 2020-11-12T17:23:14.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.385 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.386 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:6039 3.d e25/20 ondisk, result = 0)", 2020-11-12T17:23:14.386 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.912160+0000", 2020-11-12T17:23:14.386 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.2588356059999999, 2020-11-12T17:23:14.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.11425861900000001, 2020-11-12T17:23:14.387 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.387 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:14.387 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.912160+0000", 2020-11-12T17:23:14.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.912160+0000", 2020-11-12T17:23:14.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:14.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.912137+0000", 2020-11-12T17:23:14.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8381000000000002e-05 2020-11-12T17:23:14.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.912195+0000", 2020-11-12T17:23:14.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.112791619 2020-11-12T17:23:14.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024987+0000", 2020-11-12T17:23:14.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2411e-05 2020-11-12T17:23:14.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024999+0000", 2020-11-12T17:23:14.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001164762 2020-11-12T17:23:14.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.026164+0000", 2020-11-12T17:23:14.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4268e-05 2020-11-12T17:23:14.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.026178+0000", 2020-11-12T17:23:14.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024001200000000001 2020-11-12T17:23:14.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.026418+0000", 2020-11-12T17:23:14.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.11425861900000001 2020-11-12T17:23:14.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.408 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.408 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:6160 3.d 3:ba7a878f:::benchmark_data_smithi036_14212_object769:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:14.409 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:11.066499+0000", 2020-11-12T17:23:14.409 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.1044961440000001, 2020-11-12T17:23:14.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.103143553, 2020-11-12T17:23:14.410 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.410 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.410 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:14.411 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:14.411 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.411 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 6160 2020-11-12T17:23:14.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.411 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.066499+0000", 2020-11-12T17:23:14.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.066499+0000", 2020-11-12T17:23:14.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:14.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.066480+0000", 2020-11-12T17:23:14.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9635000000000007e-05 2020-11-12T17:23:14.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.066550+0000", 2020-11-12T17:23:14.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0709999999999997e-06 2020-11-12T17:23:14.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.066557+0000", 2020-11-12T17:23:14.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8060000000000001e-06 2020-11-12T17:23:14.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.066561+0000", 2020-11-12T17:23:14.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028321819999999999 2020-11-12T17:23:14.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.069393+0000", 2020-11-12T17:23:14.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0059e-05 2020-11-12T17:23:14.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.069473+0000", 2020-11-12T17:23:14.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167789 2020-11-12T17:23:14.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:14.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.069641+0000", 2020-11-12T17:23:14.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002033277 2020-11-12T17:23:14.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:14.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.071674+0000", 2020-11-12T17:23:14.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.097850276999999999 2020-11-12T17:23:14.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.169524+0000", 2020-11-12T17:23:14.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2889e-05 2020-11-12T17:23:14.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:14.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.169587+0000", 2020-11-12T17:23:14.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5263000000000003e-05 2020-11-12T17:23:14.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.169643+0000", 2020-11-12T17:23:14.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.103143553 2020-11-12T17:23:14.421 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.421 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.421 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.421 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9256 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:23:14.421 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:13.835170+0000", 2020-11-12T17:23:14.422 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.335825233, 2020-11-12T17:23:14.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.166830863, 2020-11-12T17:23:14.422 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:14.422 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:14.422 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:14.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:14.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.835170+0000", 2020-11-12T17:23:14.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:14.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:14.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.835170+0000", 2020-11-12T17:23:14.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:14.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:14.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.835151+0000", 2020-11-12T17:23:14.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7861000000000001e-05 2020-11-12T17:23:14.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:14.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.835198+0000", 2020-11-12T17:23:14.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16518912499999999 2020-11-12T17:23:14.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:14.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.000387+0000", 2020-11-12T17:23:14.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.618e-06 2020-11-12T17:23:14.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.000394+0000", 2020-11-12T17:23:14.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001469202 2020-11-12T17:23:14.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:14.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.001863+0000", 2020-11-12T17:23:14.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9850000000000001e-06 2020-11-12T17:23:14.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:14.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.001873+0000", 2020-11-12T17:23:14.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012751900000000001 2020-11-12T17:23:14.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:14.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:14.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:14.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.002001+0000", 2020-11-12T17:23:14.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.166830863 2020-11-12T17:23:14.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.429 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:14.429 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:14.429 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:14.431 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:14.428+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:14.431 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:14.532 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:14.532+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:14.555 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:14.556 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:14.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.556 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:14.556 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:14.557 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0028815830000000001, 2020-11-12T17:23:14.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029057929999999998, 2020-11-12T17:23:14.557 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.557 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:14.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.558 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:23:14.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.558 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:14.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:14.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:23:14.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:23:14.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:23:14.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:23:14.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:23:14.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:23:14.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:23:14.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:23:14.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:23:14.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:23:14.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:23:14.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:23:14.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028215710000000001 2020-11-12T17:23:14.564 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.564 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.564 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.565 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3.347b40c1 (undecoded) ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:14.565 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:23:14.565 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.002359164, 2020-11-12T17:23:14.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024603200000000002, 2020-11-12T17:23:14.566 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.566 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:23:14.567 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.568 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.568 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.568 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:23:14.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.568 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:23:14.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:23:14.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:14.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:23:14.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:23:14.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:23:14.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:23:14.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:23:14.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:23:14.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:23:14.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6111000000000003e-05 2020-11-12T17:23:14.573 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.573 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.573 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.574 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9993 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:14.574 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.543180+0000", 2020-11-12T17:23:14.574 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0077071359999999998, 2020-11-12T17:23:14.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0078723390000000008, 2020-11-12T17:23:14.574 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.574 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:14.575 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.575 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.575 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.575 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9993 2020-11-12T17:23:14.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.576 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.543180+0000", 2020-11-12T17:23:14.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.543180+0000", 2020-11-12T17:23:14.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:23:14.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.543146+0000", 2020-11-12T17:23:14.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8287000000000003e-05 2020-11-12T17:23:14.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.543244+0000", 2020-11-12T17:23:14.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6574000000000001e-05 2020-11-12T17:23:14.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.543261+0000", 2020-11-12T17:23:14.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3249999999999997e-06 2020-11-12T17:23:14.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.543270+0000", 2020-11-12T17:23:14.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4229e-05 2020-11-12T17:23:14.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.543314+0000", 2020-11-12T17:23:14.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016994499999999999 2020-11-12T17:23:14.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.543484+0000", 2020-11-12T17:23:14.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000131008 2020-11-12T17:23:14.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.543615+0000", 2020-11-12T17:23:14.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031055840000000002 2020-11-12T17:23:14.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546721+0000", 2020-11-12T17:23:14.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035402910000000001 2020-11-12T17:23:14.583 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.584 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.584 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.584 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9994 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:14.584 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.544951+0000", 2020-11-12T17:23:14.584 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.005936602, 2020-11-12T17:23:14.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061927680000000004, 2020-11-12T17:23:14.585 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.585 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:14.585 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.585 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.585 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.586 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9994 2020-11-12T17:23:14.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.586 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.544951+0000", 2020-11-12T17:23:14.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.544951+0000", 2020-11-12T17:23:14.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:14.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.544934+0000", 2020-11-12T17:23:14.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2324999999999998e-05 2020-11-12T17:23:14.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.544986+0000", 2020-11-12T17:23:14.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3750000000000003e-06 2020-11-12T17:23:14.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.544994+0000", 2020-11-12T17:23:14.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8919999999999999e-06 2020-11-12T17:23:14.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.544999+0000", 2020-11-12T17:23:14.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0305000000000001e-05 2020-11-12T17:23:14.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.545040+0000", 2020-11-12T17:23:14.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6063999999999995e-05 2020-11-12T17:23:14.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.545116+0000", 2020-11-12T17:23:14.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011899 2020-11-12T17:23:14.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.545235+0000", 2020-11-12T17:23:14.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020254600000000002 2020-11-12T17:23:14.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547260+0000", 2020-11-12T17:23:14.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023090710000000002 2020-11-12T17:23:14.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.594 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.595 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9995 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:14.595 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.547177+0000", 2020-11-12T17:23:14.595 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0037103349999999999, 2020-11-12T17:23:14.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040348010000000002, 2020-11-12T17:23:14.595 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.595 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:14.596 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.596 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.596 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.596 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9995 2020-11-12T17:23:14.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.596 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547177+0000", 2020-11-12T17:23:14.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547177+0000", 2020-11-12T17:23:14.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:23:14.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547140+0000", 2020-11-12T17:23:14.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010608899999999999 2020-11-12T17:23:14.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547246+0000", 2020-11-12T17:23:14.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5143000000000001e-05 2020-11-12T17:23:14.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547261+0000", 2020-11-12T17:23:14.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5390000000000002e-06 2020-11-12T17:23:14.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547268+0000", 2020-11-12T17:23:14.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6623999999999999e-05 2020-11-12T17:23:14.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547315+0000", 2020-11-12T17:23:14.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000105609 2020-11-12T17:23:14.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547421+0000", 2020-11-12T17:23:14.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000258266 2020-11-12T17:23:14.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547679+0000", 2020-11-12T17:23:14.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029907829999999999 2020-11-12T17:23:14.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550670+0000", 2020-11-12T17:23:14.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034924159999999999 2020-11-12T17:23:14.603 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.603 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.603 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.604 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9996 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:14.604 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.547338+0000", 2020-11-12T17:23:14.604 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0035491609999999999, 2020-11-12T17:23:14.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0039418430000000004, 2020-11-12T17:23:14.604 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.604 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:14.605 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.605 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.605 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.605 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9996 2020-11-12T17:23:14.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.605 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547338+0000", 2020-11-12T17:23:14.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547338+0000", 2020-11-12T17:23:14.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:23:14.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547301+0000", 2020-11-12T17:23:14.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103477 2020-11-12T17:23:14.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547405+0000", 2020-11-12T17:23:14.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4901e-05 2020-11-12T17:23:14.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547419+0000", 2020-11-12T17:23:14.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8220000000000003e-06 2020-11-12T17:23:14.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547425+0000", 2020-11-12T17:23:14.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00095528099999999999 2020-11-12T17:23:14.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548381+0000", 2020-11-12T17:23:14.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011571299999999999 2020-11-12T17:23:14.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548496+0000", 2020-11-12T17:23:14.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016884100000000001 2020-11-12T17:23:14.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548665+0000", 2020-11-12T17:23:14.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001326615 2020-11-12T17:23:14.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.611 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.612 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9997 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:14.612 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.547699+0000", 2020-11-12T17:23:14.612 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0031886290000000001, 2020-11-12T17:23:14.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036402040000000002, 2020-11-12T17:23:14.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.612 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:14.613 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.613 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.613 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.613 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9997 2020-11-12T17:23:14.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.613 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547699+0000", 2020-11-12T17:23:14.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547699+0000", 2020-11-12T17:23:14.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:14.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547662+0000", 2020-11-12T17:23:14.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010463099999999999 2020-11-12T17:23:14.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547767+0000", 2020-11-12T17:23:14.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0786999999999999e-05 2020-11-12T17:23:14.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547788+0000", 2020-11-12T17:23:14.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8079999999999999e-06 2020-11-12T17:23:14.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547795+0000", 2020-11-12T17:23:14.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001306942 2020-11-12T17:23:14.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.549102+0000", 2020-11-12T17:23:14.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012191100000000001 2020-11-12T17:23:14.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.549224+0000", 2020-11-12T17:23:14.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000217934 2020-11-12T17:23:14.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.549441+0000", 2020-11-12T17:23:14.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001742501 2020-11-12T17:23:14.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.619 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.620 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9998 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:14.620 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.547852+0000", 2020-11-12T17:23:14.620 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0030353110000000002, 2020-11-12T17:23:14.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035836179999999998, 2020-11-12T17:23:14.621 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.621 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:14.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.621 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9998 2020-11-12T17:23:14.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.621 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547852+0000", 2020-11-12T17:23:14.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547852+0000", 2020-11-12T17:23:14.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:23:14.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547818+0000", 2020-11-12T17:23:14.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001016 2020-11-12T17:23:14.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547919+0000", 2020-11-12T17:23:14.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5245999999999999e-05 2020-11-12T17:23:14.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547934+0000", 2020-11-12T17:23:14.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2768e-05 2020-11-12T17:23:14.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547947+0000", 2020-11-12T17:23:14.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020981749999999999 2020-11-12T17:23:14.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550045+0000", 2020-11-12T17:23:14.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1821000000000003e-05 2020-11-12T17:23:14.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550107+0000", 2020-11-12T17:23:14.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7880000000000005e-05 2020-11-12T17:23:14.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550205+0000", 2020-11-12T17:23:14.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023527050000000001 2020-11-12T17:23:14.627 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.627 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.628 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.628 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.628 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:14.628 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 8 2020-11-12T17:23:14.628 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:14.630 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 10 15 10008 9993 7.8064 8.25781 0.00601641 0.015931 2020-11-12T17:23:14.630 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:23:14.630 INFO:teuthology.orchestra.run.smithi036.stderr:marked in osd.6. 2020-11-12T17:23:14.631 INFO:tasks.thrashosds.thrasher:Added osd 6 2020-11-12T17:23:14.631 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:14.633 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:14.632+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:14.734 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:14.729+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:14.745 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:14.746 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:14.746 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:14.746 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:14.746 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:14.755 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:14.841 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:14.836+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:14.913 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:254 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.166357786000001, 2020-11-12T17:23:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023, 2020-11-12T17:23:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 254 2020-11-12T17:23:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:14.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741501+0000", 2020-11-12T17:23:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8440000000000002e-05 2020-11-12T17:23:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741570+0000", 2020-11-12T17:23:14.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4515000000000001e-05 2020-11-12T17:23:14.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741584+0000", 2020-11-12T17:23:14.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5699999999999998e-06 2020-11-12T17:23:14.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741591+0000", 2020-11-12T17:23:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033344310000000001 2020-11-12T17:23:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744925+0000", 2020-11-12T17:23:14.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011066 2020-11-12T17:23:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745036+0000", 2020-11-12T17:23:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015032199999999999 2020-11-12T17:23:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745186+0000", 2020-11-12T17:23:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020296229999999999 2020-11-12T17:23:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747216+0000", 2020-11-12T17:23:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21356234399999999 2020-11-12T17:23:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960778+0000", 2020-11-12T17:23:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011052000000000001 2020-11-12T17:23:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960889+0000", 2020-11-12T17:23:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014397999999999999 2020-11-12T17:23:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961033+0000", 2020-11-12T17:23:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023 2020-11-12T17:23:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:255 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.163789955, 2020-11-12T17:23:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286, 2020-11-12T17:23:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 255 2020-11-12T17:23:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744038+0000", 2020-11-12T17:23:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000142953 2020-11-12T17:23:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744181+0000", 2020-11-12T17:23:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4383999999999999e-05 2020-11-12T17:23:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744206+0000", 2020-11-12T17:23:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0786e-05 2020-11-12T17:23:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744217+0000", 2020-11-12T17:23:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001465002 2020-11-12T17:23:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745682+0000", 2020-11-12T17:23:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000126458 2020-11-12T17:23:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745808+0000", 2020-11-12T17:23:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000164413 2020-11-12T17:23:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745972+0000", 2020-11-12T17:23:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019412520000000001 2020-11-12T17:23:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747914+0000", 2020-11-12T17:23:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.213271294 2020-11-12T17:23:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961185+0000", 2020-11-12T17:23:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001472 2020-11-12T17:23:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961332+0000", 2020-11-12T17:23:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108687 2020-11-12T17:23:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:14.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961441+0000", 2020-11-12T17:23:14.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286 2020-11-12T17:23:14.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.940 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:256 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.162179269999999, 2020-11-12T17:23:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001, 2020-11-12T17:23:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 256 2020-11-12T17:23:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:14.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:14.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745651+0000", 2020-11-12T17:23:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000140753 2020-11-12T17:23:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745792+0000", 2020-11-12T17:23:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3481e-05 2020-11-12T17:23:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745806+0000", 2020-11-12T17:23:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8069999999999999e-06 2020-11-12T17:23:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745810+0000", 2020-11-12T17:23:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001457563 2020-11-12T17:23:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747268+0000", 2020-11-12T17:23:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116141 2020-11-12T17:23:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747384+0000", 2020-11-12T17:23:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013822899999999999 2020-11-12T17:23:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747522+0000", 2020-11-12T17:23:14.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079223100000000001 2020-11-12T17:23:14.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.748315+0000", 2020-11-12T17:23:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21734695200000001 2020-11-12T17:23:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965662+0000", 2020-11-12T17:23:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011252999999999999 2020-11-12T17:23:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965774+0000", 2020-11-12T17:23:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015996700000000001 2020-11-12T17:23:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965934+0000", 2020-11-12T17:23:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001 2020-11-12T17:23:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:337 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.099043674000001, 2020-11-12T17:23:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089, 2020-11-12T17:23:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 337 2020-11-12T17:23:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808793+0000", 2020-11-12T17:23:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012736400000000001 2020-11-12T17:23:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808920+0000", 2020-11-12T17:23:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7972e-05 2020-11-12T17:23:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808938+0000", 2020-11-12T17:23:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5259999999999999e-06 2020-11-12T17:23:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808948+0000", 2020-11-12T17:23:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3725000000000001e-05 2020-11-12T17:23:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809041+0000", 2020-11-12T17:23:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026396500000000001 2020-11-12T17:23:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809305+0000", 2020-11-12T17:23:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000287686 2020-11-12T17:23:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809593+0000", 2020-11-12T17:23:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049805869999999999 2020-11-12T17:23:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814574+0000", 2020-11-12T17:23:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151510007 2020-11-12T17:23:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966084+0000", 2020-11-12T17:23:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110937 2020-11-12T17:23:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966195+0000", 2020-11-12T17:23:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5339999999999994e-05 2020-11-12T17:23:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966270+0000", 2020-11-12T17:23:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089 2020-11-12T17:23:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:338 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.098820837, 2020-11-12T17:23:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999, 2020-11-12T17:23:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 338 2020-11-12T17:23:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809008+0000", 2020-11-12T17:23:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000123659 2020-11-12T17:23:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809131+0000", 2020-11-12T17:23:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4180000000000003e-06 2020-11-12T17:23:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809141+0000", 2020-11-12T17:23:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2680000000000002e-06 2020-11-12T17:23:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809146+0000", 2020-11-12T17:23:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011238120000000001 2020-11-12T17:23:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810270+0000", 2020-11-12T17:23:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9084000000000003e-05 2020-11-12T17:23:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810359+0000", 2020-11-12T17:23:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186856 2020-11-12T17:23:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810546+0000", 2020-11-12T17:23:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040397699999999998 2020-11-12T17:23:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814586+0000", 2020-11-12T17:23:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15495921400000001 2020-11-12T17:23:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969545+0000", 2020-11-12T17:23:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012353700000000001 2020-11-12T17:23:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969668+0000", 2020-11-12T17:23:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013906300000000001 2020-11-12T17:23:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969807+0000", 2020-11-12T17:23:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999 2020-11-12T17:23:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:339 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.098683941000001, 2020-11-12T17:23:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999, 2020-11-12T17:23:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 339 2020-11-12T17:23:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809174+0000", 2020-11-12T17:23:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4807000000000005e-05 2020-11-12T17:23:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809238+0000", 2020-11-12T17:23:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2660000000000001e-06 2020-11-12T17:23:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809247+0000", 2020-11-12T17:23:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1060000000000002e-06 2020-11-12T17:23:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809251+0000", 2020-11-12T17:23:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001789286 2020-11-12T17:23:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811040+0000", 2020-11-12T17:23:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013621 2020-11-12T17:23:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811176+0000", 2020-11-12T17:23:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023835800000000001 2020-11-12T17:23:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811415+0000", 2020-11-12T17:23:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031774529999999998 2020-11-12T17:23:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814592+0000", 2020-11-12T17:23:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15532954199999999 2020-11-12T17:23:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969922+0000", 2020-11-12T17:23:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021167000000000001 2020-11-12T17:23:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970133+0000", 2020-11-12T17:23:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7349999999999995e-05 2020-11-12T17:23:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970231+0000", 2020-11-12T17:23:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999 2020-11-12T17:23:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:340 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.098151831999999, 2020-11-12T17:23:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999, 2020-11-12T17:23:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 340 2020-11-12T17:23:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999958 2020-11-12T17:23:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809686+0000", 2020-11-12T17:23:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9798999999999999e-05 2020-11-12T17:23:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809776+0000", 2020-11-12T17:23:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2833999999999999e-05 2020-11-12T17:23:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809788+0000", 2020-11-12T17:23:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-06 2020-11-12T17:23:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809794+0000", 2020-11-12T17:23:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020989979999999999 2020-11-12T17:23:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811893+0000", 2020-11-12T17:23:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012502300000000001 2020-11-12T17:23:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812018+0000", 2020-11-12T17:23:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013605900000000001 2020-11-12T17:23:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812154+0000", 2020-11-12T17:23:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003821344 2020-11-12T17:23:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815975+0000", 2020-11-12T17:23:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15447417999999999 2020-11-12T17:23:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970449+0000", 2020-11-12T17:23:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2955999999999997e-05 2020-11-12T17:23:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970532+0000", 2020-11-12T17:23:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6341999999999998e-05 2020-11-12T17:23:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970578+0000", 2020-11-12T17:23:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999 2020-11-12T17:23:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:341 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.098028254999999, 2020-11-12T17:23:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999, 2020-11-12T17:23:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 341 2020-11-12T17:23:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:23:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809810+0000", 2020-11-12T17:23:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129682 2020-11-12T17:23:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809940+0000", 2020-11-12T17:23:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2874000000000002e-05 2020-11-12T17:23:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809963+0000", 2020-11-12T17:23:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8199999999999997e-06 2020-11-12T17:23:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809971+0000", 2020-11-12T17:23:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026854119999999999 2020-11-12T17:23:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812656+0000", 2020-11-12T17:23:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000136685 2020-11-12T17:23:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812793+0000", 2020-11-12T17:23:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000267831 2020-11-12T17:23:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813061+0000", 2020-11-12T17:23:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029210490000000002 2020-11-12T17:23:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815982+0000", 2020-11-12T17:23:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15468012 2020-11-12T17:23:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970662+0000", 2020-11-12T17:23:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111106 2020-11-12T17:23:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970773+0000", 2020-11-12T17:23:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111366 2020-11-12T17:23:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970884+0000", 2020-11-12T17:23:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999 2020-11-12T17:23:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:342 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.097852233999999, 2020-11-12T17:23:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999, 2020-11-12T17:23:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 342 2020-11-12T17:23:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810002+0000", 2020-11-12T17:23:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0510000000000001e-05 2020-11-12T17:23:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810072+0000", 2020-11-12T17:23:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9950000000000005e-06 2020-11-12T17:23:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810080+0000", 2020-11-12T17:23:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0779999999999997e-06 2020-11-12T17:23:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810084+0000", 2020-11-12T17:23:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003443944 2020-11-12T17:23:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813528+0000", 2020-11-12T17:23:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010784 2020-11-12T17:23:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813636+0000", 2020-11-12T17:23:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019826199999999999 2020-11-12T17:23:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813834+0000", 2020-11-12T17:23:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021549550000000001 2020-11-12T17:23:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815989+0000", 2020-11-12T17:23:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15502450600000001 2020-11-12T17:23:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971014+0000", 2020-11-12T17:23:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6885999999999996e-05 2020-11-12T17:23:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971081+0000", 2020-11-12T17:23:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9054000000000006e-05 2020-11-12T17:23:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971160+0000", 2020-11-12T17:23:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999 2020-11-12T17:23:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:343 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.097549247, 2020-11-12T17:23:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001, 2020-11-12T17:23:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 343 2020-11-12T17:23:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810292+0000", 2020-11-12T17:23:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012150399999999999 2020-11-12T17:23:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810413+0000", 2020-11-12T17:23:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6617e-05 2020-11-12T17:23:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810430+0000", 2020-11-12T17:23:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414000000000001e-05 2020-11-12T17:23:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810440+0000", 2020-11-12T17:23:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042287779999999999 2020-11-12T17:23:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814669+0000", 2020-11-12T17:23:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012893400000000001 2020-11-12T17:23:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814798+0000", 2020-11-12T17:23:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187195 2020-11-12T17:23:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814985+0000", 2020-11-12T17:23:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001013566 2020-11-12T17:23:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815999+0000", 2020-11-12T17:23:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15527013200000001 2020-11-12T17:23:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971269+0000", 2020-11-12T17:23:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010525 2020-11-12T17:23:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971374+0000", 2020-11-12T17:23:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-05 2020-11-12T17:23:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971425+0000", 2020-11-12T17:23:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001 2020-11-12T17:23:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:344 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.094824443, 2020-11-12T17:23:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999, 2020-11-12T17:23:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 344 2020-11-12T17:23:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813023+0000", 2020-11-12T17:23:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5440999999999996e-05 2020-11-12T17:23:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813119+0000", 2020-11-12T17:23:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2757e-05 2020-11-12T17:23:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813131+0000", 2020-11-12T17:23:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8279999999999997e-06 2020-11-12T17:23:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813138+0000", 2020-11-12T17:23:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002273653 2020-11-12T17:23:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815412+0000", 2020-11-12T17:23:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012572199999999999 2020-11-12T17:23:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815537+0000", 2020-11-12T17:23:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013668400000000001 2020-11-12T17:23:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815674+0000", 2020-11-12T17:23:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001073863 2020-11-12T17:23:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.816748+0000", 2020-11-12T17:23:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154859634 2020-11-12T17:23:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971608+0000", 2020-11-12T17:23:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7041999999999999e-05 2020-11-12T17:23:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971675+0000", 2020-11-12T17:23:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9370000000000002e-05 2020-11-12T17:23:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971734+0000", 2020-11-12T17:23:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999 2020-11-12T17:23:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.7990024210000009, 2020-11-12T17:23:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:23:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:23:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:23:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:23:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:23:15.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:23:15.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:23:15.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:23:15.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:23:15.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:23:15.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:23:15.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:23:15.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:23:15.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:23:15.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:15.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:23:15.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:23:15.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:23:15.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:23:15.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:23:15.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:23:15.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:23:15.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:23:15.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:23:15.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:23:15.067 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.067 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.067 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.068 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:23:15.068 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:15.068 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.7919106249999999, 2020-11-12T17:23:15.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:23:15.068 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.068 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:15.068 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:15.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:15.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:15.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:23:15.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:23:15.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:23:15.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:23:15.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:23:15.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:23:15.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:23:15.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:23:15.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:23:15.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:23:15.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:23:15.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:23:15.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:23:15.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:23:15.074 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.074 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.074 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.075 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1256 3.1 3:8fc736c6:::benchmark_data_smithi036_14212_object156:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:15.075 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.762818+0000", 2020-11-12T17:23:15.075 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.1450612190000005, 2020-11-12T17:23:15.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15230354900000001, 2020-11-12T17:23:15.075 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.076 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.076 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.076 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.076 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.076 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1256 2020-11-12T17:23:15.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.076 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762818+0000", 2020-11-12T17:23:15.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762818+0000", 2020-11-12T17:23:15.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999433 2020-11-12T17:23:15.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762761+0000", 2020-11-12T17:23:15.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015136899999999999 2020-11-12T17:23:15.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762913+0000", 2020-11-12T17:23:15.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.772e-05 2020-11-12T17:23:15.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762931+0000", 2020-11-12T17:23:15.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9279999999999993e-06 2020-11-12T17:23:15.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.762938+0000", 2020-11-12T17:23:15.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001502078 2020-11-12T17:23:15.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.764441+0000", 2020-11-12T17:23:15.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116383 2020-11-12T17:23:15.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.764557+0000", 2020-11-12T17:23:15.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018970599999999999 2020-11-12T17:23:15.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:15.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.764747+0000", 2020-11-12T17:23:15.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00098085199999999994 2020-11-12T17:23:15.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.765727+0000", 2020-11-12T17:23:15.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.149260742 2020-11-12T17:23:15.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.914988+0000", 2020-11-12T17:23:15.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6503999999999998e-05 2020-11-12T17:23:15.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.915065+0000", 2020-11-12T17:23:15.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7188999999999997e-05 2020-11-12T17:23:15.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.915122+0000", 2020-11-12T17:23:15.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15230354900000001 2020-11-12T17:23:15.085 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.085 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.085 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.086 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5703 3.6 3:6399e945:::benchmark_data_smithi036_14212_object712:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:15.086 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.472173+0000", 2020-11-12T17:23:15.086 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.4357062300000001, 2020-11-12T17:23:15.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.197881803, 2020-11-12T17:23:15.086 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.086 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.086 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.087 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5703 2020-11-12T17:23:15.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.087 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472173+0000", 2020-11-12T17:23:15.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472173+0000", 2020-11-12T17:23:15.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:23:15.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472150+0000", 2020-11-12T17:23:15.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1002999999999996e-05 2020-11-12T17:23:15.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472241+0000", 2020-11-12T17:23:15.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8170000000000001e-05 2020-11-12T17:23:15.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472259+0000", 2020-11-12T17:23:15.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6230000000000003e-06 2020-11-12T17:23:15.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472268+0000", 2020-11-12T17:23:15.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014259310000000001 2020-11-12T17:23:15.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.473694+0000", 2020-11-12T17:23:15.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110128 2020-11-12T17:23:15.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.473804+0000", 2020-11-12T17:23:15.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022655700000000001 2020-11-12T17:23:15.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:15.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474031+0000", 2020-11-12T17:23:15.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034442140000000001 2020-11-12T17:23:15.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.477475+0000", 2020-11-12T17:23:15.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19244666099999999 2020-11-12T17:23:15.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669921+0000", 2020-11-12T17:23:15.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5439999999999996e-05 2020-11-12T17:23:15.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669997+0000", 2020-11-12T17:23:15.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8245000000000002e-05 2020-11-12T17:23:15.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670055+0000", 2020-11-12T17:23:15.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.197881803 2020-11-12T17:23:15.096 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.096 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.096 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.096 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5704 3.6 3:6399e945:::benchmark_data_smithi036_14212_object712:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:15.096 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.472307+0000", 2020-11-12T17:23:15.097 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.435573014, 2020-11-12T17:23:15.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20087829400000001, 2020-11-12T17:23:15.097 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.097 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.097 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.097 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.097 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.098 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5704 2020-11-12T17:23:15.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.098 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472307+0000", 2020-11-12T17:23:15.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472307+0000", 2020-11-12T17:23:15.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:23:15.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472285+0000", 2020-11-12T17:23:15.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3293999999999994e-05 2020-11-12T17:23:15.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472348+0000", 2020-11-12T17:23:15.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5220000000000007e-06 2020-11-12T17:23:15.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472357+0000", 2020-11-12T17:23:15.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8410000000000002e-06 2020-11-12T17:23:15.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472361+0000", 2020-11-12T17:23:15.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034082689999999998 2020-11-12T17:23:15.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.475769+0000", 2020-11-12T17:23:15.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016389400000000001 2020-11-12T17:23:15.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.475933+0000", 2020-11-12T17:23:15.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027474999999999998 2020-11-12T17:23:15.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:15.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476208+0000", 2020-11-12T17:23:15.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002358771 2020-11-12T17:23:15.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.478566+0000", 2020-11-12T17:23:15.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19444792 2020-11-12T17:23:15.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.673014+0000", 2020-11-12T17:23:15.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7453000000000004e-05 2020-11-12T17:23:15.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.673112+0000", 2020-11-12T17:23:15.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2992999999999997e-05 2020-11-12T17:23:15.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.673185+0000", 2020-11-12T17:23:15.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20087829400000001 2020-11-12T17:23:15.106 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.106 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.107 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.107 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:6079 3.6 3:68d7b676:::benchmark_data_smithi036_14212_object759:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:15.107 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.969073+0000", 2020-11-12T17:23:15.107 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.9388065609999998, 2020-11-12T17:23:15.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13280117399999999, 2020-11-12T17:23:15.107 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.108 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.108 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.108 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.108 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.108 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 6079 2020-11-12T17:23:15.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.108 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.969073+0000", 2020-11-12T17:23:15.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.969073+0000", 2020-11-12T17:23:15.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999723 2020-11-12T17:23:15.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.969045+0000", 2020-11-12T17:23:15.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9494999999999997e-05 2020-11-12T17:23:15.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.969125+0000", 2020-11-12T17:23:15.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1148000000000001e-05 2020-11-12T17:23:15.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.969136+0000", 2020-11-12T17:23:15.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1650000000000003e-06 2020-11-12T17:23:15.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.969142+0000", 2020-11-12T17:23:15.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029739699999999998 2020-11-12T17:23:15.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972116+0000", 2020-11-12T17:23:15.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000165033 2020-11-12T17:23:15.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972281+0000", 2020-11-12T17:23:15.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000271208 2020-11-12T17:23:15.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:15.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972552+0000", 2020-11-12T17:23:15.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048723250000000003 2020-11-12T17:23:15.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.977425+0000", 2020-11-12T17:23:15.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124297963 2020-11-12T17:23:15.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.101723+0000", 2020-11-12T17:23:15.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1248999999999995e-05 2020-11-12T17:23:15.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.101794+0000", 2020-11-12T17:23:15.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0278000000000006e-05 2020-11-12T17:23:15.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.101874+0000", 2020-11-12T17:23:15.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13280117399999999 2020-11-12T17:23:15.117 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.117 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.117 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.118 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:6080 3.6 3:68d7b676:::benchmark_data_smithi036_14212_object759:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:15.118 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.975299+0000", 2020-11-12T17:23:15.118 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.9325806170000002, 2020-11-12T17:23:15.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12678977299999999, 2020-11-12T17:23:15.118 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.118 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.118 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.118 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.119 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 6080 2020-11-12T17:23:15.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.119 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.975299+0000", 2020-11-12T17:23:15.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.975299+0000", 2020-11-12T17:23:15.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999958 2020-11-12T17:23:15.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.975257+0000", 2020-11-12T17:23:15.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112386 2020-11-12T17:23:15.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.975370+0000", 2020-11-12T17:23:15.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4296e-05 2020-11-12T17:23:15.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.975384+0000", 2020-11-12T17:23:15.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0570000000000004e-06 2020-11-12T17:23:15.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.975391+0000", 2020-11-12T17:23:15.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000327583 2020-11-12T17:23:15.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.975719+0000", 2020-11-12T17:23:15.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112372 2020-11-12T17:23:15.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.975831+0000", 2020-11-12T17:23:15.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020978500000000001 2020-11-12T17:23:15.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:15.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976041+0000", 2020-11-12T17:23:15.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002254327 2020-11-12T17:23:15.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.978295+0000", 2020-11-12T17:23:15.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.123646098 2020-11-12T17:23:15.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.101941+0000", 2020-11-12T17:23:15.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2826999999999998e-05 2020-11-12T17:23:15.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.102024+0000", 2020-11-12T17:23:15.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4788000000000004e-05 2020-11-12T17:23:15.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.102089+0000", 2020-11-12T17:23:15.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12678977299999999 2020-11-12T17:23:15.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.128 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.128 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:15.128 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:15.129 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.35987354700000002, 2020-11-12T17:23:15.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999, 2020-11-12T17:23:15.129 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.129 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.129 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:23:15.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.130 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:15.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:15.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:23:15.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:23:15.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:23:15.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:23:15.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:23:15.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:23:15.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:23:15.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:23:15.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:23:15.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:23:15.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:23:15.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:23:15.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112811 2020-11-12T17:23:15.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:15.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550940+0000", 2020-11-12T17:23:15.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001154101 2020-11-12T17:23:15.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552095+0000", 2020-11-12T17:23:15.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25363090900000002 2020-11-12T17:23:15.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805725+0000", 2020-11-12T17:23:15.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8797999999999998e-05 2020-11-12T17:23:15.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805824+0000", 2020-11-12T17:23:15.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8110999999999998e-05 2020-11-12T17:23:15.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805902+0000", 2020-11-12T17:23:15.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999 2020-11-12T17:23:15.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.139 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.139 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9999 3.1 e26/20 ondisk, result = 0)", 2020-11-12T17:23:15.139 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:23:15.139 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.35098860799999998, 2020-11-12T17:23:15.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145, 2020-11-12T17:23:15.140 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.140 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:15.140 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:23:15.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:23:15.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:15.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556869+0000", 2020-11-12T17:23:15.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1767999999999994e-05 2020-11-12T17:23:15.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556951+0000", 2020-11-12T17:23:15.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.248442731 2020-11-12T17:23:15.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805393+0000", 2020-11-12T17:23:15.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5503e-05 2020-11-12T17:23:15.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805409+0000", 2020-11-12T17:23:15.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027928399999999998 2020-11-12T17:23:15.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805688+0000", 2020-11-12T17:23:15.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2215e-05 2020-11-12T17:23:15.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805710+0000", 2020-11-12T17:23:15.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000226744 2020-11-12T17:23:15.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805937+0000", 2020-11-12T17:23:15.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145 2020-11-12T17:23:15.146 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.146 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.146 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.146 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.146 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.147 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:15.148 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:15.148+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:15.166 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:15.249 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:15.248+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:15.308 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:15.308 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:15.318 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:15.350 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:15.348+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:15.416 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:15.417 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:15.417 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:15.417 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:15.417 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:15.425 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:15.473 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:15.468+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:15.535 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:15.605 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:15.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:15.606 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:15.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.607 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:112 3.8 e22/20 3:18b8dd66:::benchmark_data_smithi036_14212_object13:head v 22'8, mlcod=22'1)", 2020-11-12T17:23:15.607 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:15.607 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.887033378, 2020-11-12T17:23:15.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142703407, 2020-11-12T17:23:15.607 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.608 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.608 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:15.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:15.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999738 2020-11-12T17:23:15.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644296+0000", 2020-11-12T17:23:15.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6483000000000005e-05 2020-11-12T17:23:15.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644382+0000", 2020-11-12T17:23:15.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14174973900000001 2020-11-12T17:23:15.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786132+0000", 2020-11-12T17:23:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3459999999999996e-06 2020-11-12T17:23:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786139+0000", 2020-11-12T17:23:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:23:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786193+0000", 2020-11-12T17:23:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6371999999999997e-05 2020-11-12T17:23:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786229+0000", 2020-11-12T17:23:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00074081500000000003 2020-11-12T17:23:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786970+0000", 2020-11-12T17:23:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5047000000000003e-05 2020-11-12T17:23:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787025+0000", 2020-11-12T17:23:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142703407 2020-11-12T17:23:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:336 3.8 e22/20 3:1a561d42:::benchmark_data_smithi036_14212_object41:head v 22'24, mlcod=22'19)", 2020-11-12T17:23:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.719999979000001, 2020-11-12T17:23:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.163538234, 2020-11-12T17:23:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811319+0000", 2020-11-12T17:23:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133662 2020-11-12T17:23:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811453+0000", 2020-11-12T17:23:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16096115799999999 2020-11-12T17:23:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972414+0000", 2020-11-12T17:23:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.08e-05 2020-11-12T17:23:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972425+0000", 2020-11-12T17:23:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1691000000000001e-05 2020-11-12T17:23:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972507+0000", 2020-11-12T17:23:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2666000000000001e-05 2020-11-12T17:23:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972549+0000", 2020-11-12T17:23:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023026349999999999 2020-11-12T17:23:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.974852+0000", 2020-11-12T17:23:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1347000000000002e-05 2020-11-12T17:23:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.974893+0000", 2020-11-12T17:23:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.163538234 2020-11-12T17:23:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1064 3.4 3:28f19af0:::benchmark_data_smithi036_14212_object132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.9477666090000003, 2020-11-12T17:23:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108211234, 2020-11-12T17:23:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.637 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.637 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.637 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.637 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1064 2020-11-12T17:23:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:23:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583558+0000", 2020-11-12T17:23:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1188999999999997e-05 2020-11-12T17:23:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583649+0000", 2020-11-12T17:23:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1898e-05 2020-11-12T17:23:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583661+0000", 2020-11-12T17:23:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7760000000000003e-06 2020-11-12T17:23:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583667+0000", 2020-11-12T17:23:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013380880000000001 2020-11-12T17:23:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585005+0000", 2020-11-12T17:23:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9061999999999995e-05 2020-11-12T17:23:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585094+0000", 2020-11-12T17:23:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017904600000000001 2020-11-12T17:23:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585273+0000", 2020-11-12T17:23:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094028799999999995 2020-11-12T17:23:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.586214+0000", 2020-11-12T17:23:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.105461808 2020-11-12T17:23:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691675+0000", 2020-11-12T17:23:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9709000000000006e-05 2020-11-12T17:23:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691745+0000", 2020-11-12T17:23:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4641000000000001e-05 2020-11-12T17:23:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691800+0000", 2020-11-12T17:23:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108211234 2020-11-12T17:23:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1816 3.4 3:229575d8:::benchmark_data_smithi036_14212_object226:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3046504139999993, 2020-11-12T17:23:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157715203, 2020-11-12T17:23:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1816 2020-11-12T17:23:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226671+0000", 2020-11-12T17:23:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5532999999999995e-05 2020-11-12T17:23:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226766+0000", 2020-11-12T17:23:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:23:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226779+0000", 2020-11-12T17:23:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6120000000000004e-06 2020-11-12T17:23:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226786+0000", 2020-11-12T17:23:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00085013099999999996 2020-11-12T17:23:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227636+0000", 2020-11-12T17:23:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1732999999999998e-05 2020-11-12T17:23:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227718+0000", 2020-11-12T17:23:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100733 2020-11-12T17:23:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:15.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227819+0000", 2020-11-12T17:23:15.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023757000000000001 2020-11-12T17:23:15.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.230194+0000", 2020-11-12T17:23:15.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154122064 2020-11-12T17:23:15.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384316+0000", 2020-11-12T17:23:15.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9681000000000001e-05 2020-11-12T17:23:15.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384366+0000", 2020-11-12T17:23:15.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3980000000000002e-05 2020-11-12T17:23:15.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384420+0000", 2020-11-12T17:23:15.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157715203 2020-11-12T17:23:15.659 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.659 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.659 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.659 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:1816 3.4 e23/20 ondisk, result = 0)", 2020-11-12T17:23:15.659 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:15.660 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3014765500000003, 2020-11-12T17:23:15.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15454711500000001, 2020-11-12T17:23:15.660 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.660 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:15.660 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:15.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:15.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:15.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229854+0000", 2020-11-12T17:23:15.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8783000000000003e-05 2020-11-12T17:23:15.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229913+0000", 2020-11-12T17:23:15.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154309107 2020-11-12T17:23:15.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384222+0000", 2020-11-12T17:23:15.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2269999999999999e-06 2020-11-12T17:23:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384232+0000", 2020-11-12T17:23:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5488999999999996e-05 2020-11-12T17:23:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384297+0000", 2020-11-12T17:23:15.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2262000000000001e-05 2020-11-12T17:23:15.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384309+0000", 2020-11-12T17:23:15.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116474 2020-11-12T17:23:15.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384426+0000", 2020-11-12T17:23:15.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15454711500000001 2020-11-12T17:23:15.666 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.666 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.667 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.667 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:4456 3.4 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e24)", 2020-11-12T17:23:15.667 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:15.667 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.6849243090000003, 2020-11-12T17:23:15.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28490720800000002, 2020-11-12T17:23:15.667 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.668 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.668 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.668 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.668 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.668 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 4456 2020-11-12T17:23:15.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.668 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:15.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:15.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:15.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846382+0000", 2020-11-12T17:23:15.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013956400000000001 2020-11-12T17:23:15.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846521+0000", 2020-11-12T17:23:15.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7923000000000001e-05 2020-11-12T17:23:15.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846539+0000", 2020-11-12T17:23:15.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1470000000000007e-06 2020-11-12T17:23:15.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846548+0000", 2020-11-12T17:23:15.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054463600000000004 2020-11-12T17:23:15.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847093+0000", 2020-11-12T17:23:15.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2497000000000006e-05 2020-11-12T17:23:15.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847186+0000", 2020-11-12T17:23:15.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144227 2020-11-12T17:23:15.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:15.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847330+0000", 2020-11-12T17:23:15.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010893070000000001 2020-11-12T17:23:15.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.848419+0000", 2020-11-12T17:23:15.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.282686039 2020-11-12T17:23:15.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131105+0000", 2020-11-12T17:23:15.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012774600000000001 2020-11-12T17:23:15.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131233+0000", 2020-11-12T17:23:15.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000105154 2020-11-12T17:23:15.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131338+0000", 2020-11-12T17:23:15.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28490720800000002 2020-11-12T17:23:15.678 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.678 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.678 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.688 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5344 3.4 3:256e9fb4:::benchmark_data_smithi036_14212_object667:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:15.688 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:15.688 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3479292699999998, 2020-11-12T17:23:15.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116435965, 2020-11-12T17:23:15.689 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.689 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.689 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5344 2020-11-12T17:23:15.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.690 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:15.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:15.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:23:15.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183396+0000", 2020-11-12T17:23:15.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4202000000000004e-05 2020-11-12T17:23:15.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183490+0000", 2020-11-12T17:23:15.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9741e-05 2020-11-12T17:23:15.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183510+0000", 2020-11-12T17:23:15.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5509999999999996e-06 2020-11-12T17:23:15.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183516+0000", 2020-11-12T17:23:15.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036344010000000002 2020-11-12T17:23:15.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187151+0000", 2020-11-12T17:23:15.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011442099999999999 2020-11-12T17:23:15.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187265+0000", 2020-11-12T17:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018573799999999999 2020-11-12T17:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187451+0000", 2020-11-12T17:23:15.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044292359999999996 2020-11-12T17:23:15.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.191880+0000", 2020-11-12T17:23:15.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.107843906 2020-11-12T17:23:15.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299724+0000", 2020-11-12T17:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5835000000000003e-05 2020-11-12T17:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299780+0000", 2020-11-12T17:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2107000000000005e-05 2020-11-12T17:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299862+0000", 2020-11-12T17:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116435965 2020-11-12T17:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5344 3.4 e25/20 ondisk, result = 0)", 2020-11-12T17:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3390375060000004, 2020-11-12T17:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10756062, 2020-11-12T17:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.700 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:15.700 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:15.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:15.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:15.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192288+0000", 2020-11-12T17:23:15.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9671000000000003e-05 2020-11-12T17:23:15.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192368+0000", 2020-11-12T17:23:15.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.105564818 2020-11-12T17:23:15.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.297932+0000", 2020-11-12T17:23:15.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1760000000000004e-06 2020-11-12T17:23:15.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.297940+0000", 2020-11-12T17:23:15.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017675919999999999 2020-11-12T17:23:15.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299707+0000", 2020-11-12T17:23:15.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:23:15.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299716+0000", 2020-11-12T17:23:15.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162015 2020-11-12T17:23:15.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299878+0000", 2020-11-12T17:23:15.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10756062 2020-11-12T17:23:15.706 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.706 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.706 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.706 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5496 3.4 3:2cf172bc:::benchmark_data_smithi036_14212_object686:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:15.706 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:15.707 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2322287029999996, 2020-11-12T17:23:15.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124862294, 2020-11-12T17:23:15.707 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.707 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.707 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.707 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.707 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.707 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5496 2020-11-12T17:23:15.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.708 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:15.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:15.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:15.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299088+0000", 2020-11-12T17:23:15.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120711 2020-11-12T17:23:15.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299209+0000", 2020-11-12T17:23:15.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7577000000000001e-05 2020-11-12T17:23:15.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299226+0000", 2020-11-12T17:23:15.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3689999999999999e-05 2020-11-12T17:23:15.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299240+0000", 2020-11-12T17:23:15.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056383780000000003 2020-11-12T17:23:15.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.304878+0000", 2020-11-12T17:23:15.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104419 2020-11-12T17:23:15.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.304983+0000", 2020-11-12T17:23:15.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019338800000000001 2020-11-12T17:23:15.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:15.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.305176+0000", 2020-11-12T17:23:15.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001656366 2020-11-12T17:23:15.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.306832+0000", 2020-11-12T17:23:15.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.117004916 2020-11-12T17:23:15.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423837+0000", 2020-11-12T17:23:15.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1908000000000003e-05 2020-11-12T17:23:15.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423909+0000", 2020-11-12T17:23:15.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9568999999999997e-05 2020-11-12T17:23:15.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423989+0000", 2020-11-12T17:23:15.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124862294 2020-11-12T17:23:15.716 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.717 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.717 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.717 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5496 3.4 e25/20 ondisk, result = 0)", 2020-11-12T17:23:15.717 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:15.717 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2240743470000002, 2020-11-12T17:23:15.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116715649, 2020-11-12T17:23:15.718 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.718 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:15.718 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:15.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:15.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:15.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307254+0000", 2020-11-12T17:23:15.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7615999999999998e-05 2020-11-12T17:23:15.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307321+0000", 2020-11-12T17:23:15.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116404623 2020-11-12T17:23:15.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423726+0000", 2020-11-12T17:23:15.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8149999999999995e-06 2020-11-12T17:23:15.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423735+0000", 2020-11-12T17:23:15.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1903999999999994e-05 2020-11-12T17:23:15.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423817+0000", 2020-11-12T17:23:15.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.028e-05 2020-11-12T17:23:15.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423827+0000", 2020-11-12T17:23:15.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016951499999999999 2020-11-12T17:23:15.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423996+0000", 2020-11-12T17:23:15.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116715649 2020-11-12T17:23:15.724 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.724 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.724 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.724 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:5703 3.6 e25/20 3:6399e945:::benchmark_data_smithi036_14212_object712:head v 25'391, mlcod=25'383)", 2020-11-12T17:23:15.724 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:15.725 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0569283799999996, 2020-11-12T17:23:15.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19527752500000001, 2020-11-12T17:23:15.725 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.725 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.725 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:15.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:15.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999347 2020-11-12T17:23:15.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474361+0000", 2020-11-12T17:23:15.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015052699999999999 2020-11-12T17:23:15.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474512+0000", 2020-11-12T17:23:15.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.194039023 2020-11-12T17:23:15.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668551+0000", 2020-11-12T17:23:15.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3286e-05 2020-11-12T17:23:15.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668564+0000", 2020-11-12T17:23:15.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960999999999999e-05 2020-11-12T17:23:15.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668655+0000", 2020-11-12T17:23:15.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7333999999999999e-05 2020-11-12T17:23:15.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668692+0000", 2020-11-12T17:23:15.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00091690499999999998 2020-11-12T17:23:15.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669609+0000", 2020-11-12T17:23:15.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4975999999999993e-05 2020-11-12T17:23:15.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669704+0000", 2020-11-12T17:23:15.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19527752500000001 2020-11-12T17:23:15.732 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.732 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.732 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.732 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:5704 3.6 e25/20 3:6399e945:::benchmark_data_smithi036_14212_object712:head v 25'392, mlcod=25'386)", 2020-11-12T17:23:15.733 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:15.733 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0548485779999996, 2020-11-12T17:23:15.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19575757999999999, 2020-11-12T17:23:15.733 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.733 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.733 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:15.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:15.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:15.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476472+0000", 2020-11-12T17:23:15.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013146800000000001 2020-11-12T17:23:15.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476603+0000", 2020-11-12T17:23:15.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.194169657 2020-11-12T17:23:15.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670773+0000", 2020-11-12T17:23:15.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1989999999999999e-06 2020-11-12T17:23:15.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670777+0000", 2020-11-12T17:23:15.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6594000000000001e-05 2020-11-12T17:23:15.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670824+0000", 2020-11-12T17:23:15.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9747000000000002e-05 2020-11-12T17:23:15.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670854+0000", 2020-11-12T17:23:15.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001341456 2020-11-12T17:23:15.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.672195+0000", 2020-11-12T17:23:15.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9018999999999998e-05 2020-11-12T17:23:15.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.672264+0000", 2020-11-12T17:23:15.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19575757999999999 2020-11-12T17:23:15.740 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.740 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.740 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.741 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5720 3.0 3:0c13ab4c:::benchmark_data_smithi036_14212_object714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:15.741 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:15.741 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0480102499999999, 2020-11-12T17:23:15.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356863017, 2020-11-12T17:23:15.741 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.741 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.742 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.742 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.742 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.742 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5720 2020-11-12T17:23:15.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.742 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:15.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:15.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:15.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483326+0000", 2020-11-12T17:23:15.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4151999999999999e-05 2020-11-12T17:23:15.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483380+0000", 2020-11-12T17:23:15.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1484999999999999e-05 2020-11-12T17:23:15.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483392+0000", 2020-11-12T17:23:15.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0610000000000003e-06 2020-11-12T17:23:15.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483397+0000", 2020-11-12T17:23:15.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041122260000000001 2020-11-12T17:23:15.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487509+0000", 2020-11-12T17:23:15.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012518300000000001 2020-11-12T17:23:15.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487634+0000", 2020-11-12T17:23:15.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020357700000000001 2020-11-12T17:23:15.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:15.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487838+0000", 2020-11-12T17:23:15.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022445590000000001 2020-11-12T17:23:15.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.490082+0000", 2020-11-12T17:23:15.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35001414600000003 2020-11-12T17:23:15.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840097+0000", 2020-11-12T17:23:15.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9443e-05 2020-11-12T17:23:15.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840156+0000", 2020-11-12T17:23:15.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.185e-05 2020-11-12T17:23:15.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840208+0000", 2020-11-12T17:23:15.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356863017 2020-11-12T17:23:15.751 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.751 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.762 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.763 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5720 3.0 e25/20 ondisk, result = 0)", 2020-11-12T17:23:15.763 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:15.763 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0386799099999999, 2020-11-12T17:23:15.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.347542456, 2020-11-12T17:23:15.763 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.763 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:15.763 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:15.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:15.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999989 2020-11-12T17:23:15.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492664+0000", 2020-11-12T17:23:15.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8972999999999999e-05 2020-11-12T17:23:15.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492693+0000", 2020-11-12T17:23:15.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34695741600000002 2020-11-12T17:23:15.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.839651+0000", 2020-11-12T17:23:15.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.549e-06 2020-11-12T17:23:15.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.839655+0000", 2020-11-12T17:23:15.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00042003800000000002 2020-11-12T17:23:15.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840075+0000", 2020-11-12T17:23:15.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.205e-05 2020-11-12T17:23:15.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840087+0000", 2020-11-12T17:23:15.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054700000000001 2020-11-12T17:23:15.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840218+0000", 2020-11-12T17:23:15.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.347542456 2020-11-12T17:23:15.769 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.770 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.770 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.770 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:6079 3.6 e25/20 3:68d7b676:::benchmark_data_smithi036_14212_object759:head v 25'439, mlcod=25'431)", 2020-11-12T17:23:15.770 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.972746+0000", 2020-11-12T17:23:15.770 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.5586095120000003, 2020-11-12T17:23:15.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124061067, 2020-11-12T17:23:15.771 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.771 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.771 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972746+0000", 2020-11-12T17:23:15.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972746+0000", 2020-11-12T17:23:15.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:15.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972716+0000", 2020-11-12T17:23:15.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2367999999999995e-05 2020-11-12T17:23:15.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972799+0000", 2020-11-12T17:23:15.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.119417204 2020-11-12T17:23:15.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092216+0000", 2020-11-12T17:23:15.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7179999999999999e-06 2020-11-12T17:23:15.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092223+0000", 2020-11-12T17:23:15.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8921999999999997e-05 2020-11-12T17:23:15.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092271+0000", 2020-11-12T17:23:15.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6675000000000001e-05 2020-11-12T17:23:15.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092298+0000", 2020-11-12T17:23:15.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044341149999999998 2020-11-12T17:23:15.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096732+0000", 2020-11-12T17:23:15.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4453e-05 2020-11-12T17:23:15.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096807+0000", 2020-11-12T17:23:15.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124061067 2020-11-12T17:23:15.777 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.778 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.778 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.778 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:6080 3.6 e25/20 3:68d7b676:::benchmark_data_smithi036_14212_object759:head v 25'440, mlcod=25'435)", 2020-11-12T17:23:15.778 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.976223+0000", 2020-11-12T17:23:15.778 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.5551323110000004, 2020-11-12T17:23:15.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.120637035, 2020-11-12T17:23:15.779 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.779 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.779 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976223+0000", 2020-11-12T17:23:15.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976223+0000", 2020-11-12T17:23:15.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:15.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976201+0000", 2020-11-12T17:23:15.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1339000000000002e-05 2020-11-12T17:23:15.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976282+0000", 2020-11-12T17:23:15.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.11703198400000001 2020-11-12T17:23:15.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093314+0000", 2020-11-12T17:23:15.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6599999999999995e-06 2020-11-12T17:23:15.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093322+0000", 2020-11-12T17:23:15.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1506000000000002e-05 2020-11-12T17:23:15.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093403+0000", 2020-11-12T17:23:15.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1201000000000002e-05 2020-11-12T17:23:15.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093435+0000", 2020-11-12T17:23:15.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033751010000000001 2020-11-12T17:23:15.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096810+0000", 2020-11-12T17:23:15.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0133000000000003e-05 2020-11-12T17:23:15.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096860+0000", 2020-11-12T17:23:15.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.120637035 2020-11-12T17:23:15.785 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.785 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.786 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:8928 3.4 e26/20 ondisk, result = 0)", 2020-11-12T17:23:15.786 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.548221+0000", 2020-11-12T17:23:15.786 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.983134645, 2020-11-12T17:23:15.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23226502299999999, 2020-11-12T17:23:15.787 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.787 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:15.787 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548221+0000", 2020-11-12T17:23:15.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548221+0000", 2020-11-12T17:23:15.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:15.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548195+0000", 2020-11-12T17:23:15.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1903000000000006e-05 2020-11-12T17:23:15.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548267+0000", 2020-11-12T17:23:15.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.231938109 2020-11-12T17:23:15.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780205+0000", 2020-11-12T17:23:15.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9040000000000004e-06 2020-11-12T17:23:15.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780215+0000", 2020-11-12T17:23:15.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8253999999999998e-05 2020-11-12T17:23:15.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780313+0000", 2020-11-12T17:23:15.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2525e-05 2020-11-12T17:23:15.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780326+0000", 2020-11-12T17:23:15.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015992099999999999 2020-11-12T17:23:15.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780486+0000", 2020-11-12T17:23:15.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23226502299999999 2020-11-12T17:23:15.793 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.793 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.793 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.793 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9295 3.0 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:15.793 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.854476+0000", 2020-11-12T17:23:15.794 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.676878951, 2020-11-12T17:23:15.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10609671, 2020-11-12T17:23:15.794 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.794 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.794 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.794 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.794 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.795 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9295 2020-11-12T17:23:15.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.795 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854476+0000", 2020-11-12T17:23:15.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854476+0000", 2020-11-12T17:23:15.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:23:15.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854447+0000", 2020-11-12T17:23:15.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9829999999999999e-05 2020-11-12T17:23:15.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854537+0000", 2020-11-12T17:23:15.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2133000000000001e-05 2020-11-12T17:23:15.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854549+0000", 2020-11-12T17:23:15.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5010000000000001e-06 2020-11-12T17:23:15.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854556+0000", 2020-11-12T17:23:15.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037855720000000001 2020-11-12T17:23:15.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.858341+0000", 2020-11-12T17:23:15.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010847499999999999 2020-11-12T17:23:15.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.858450+0000", 2020-11-12T17:23:15.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000174838 2020-11-12T17:23:15.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:15.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.858625+0000", 2020-11-12T17:23:15.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037157290000000001 2020-11-12T17:23:15.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.862340+0000", 2020-11-12T17:23:15.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098151120999999994 2020-11-12T17:23:15.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960491+0000", 2020-11-12T17:23:15.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1106999999999997e-05 2020-11-12T17:23:15.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960542+0000", 2020-11-12T17:23:15.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0431999999999999e-05 2020-11-12T17:23:15.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960573+0000", 2020-11-12T17:23:15.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10609671 2020-11-12T17:23:15.803 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.803 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.804 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.804 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9296 3.0 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:15.804 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.854608+0000", 2020-11-12T17:23:15.804 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.6767469079999999, 2020-11-12T17:23:15.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108252579, 2020-11-12T17:23:15.805 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.805 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.805 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.805 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.805 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.805 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9296 2020-11-12T17:23:15.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.805 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854608+0000", 2020-11-12T17:23:15.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854608+0000", 2020-11-12T17:23:15.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:15.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854580+0000", 2020-11-12T17:23:15.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2990000000000002e-05 2020-11-12T17:23:15.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854673+0000", 2020-11-12T17:23:15.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2016e-05 2020-11-12T17:23:15.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854685+0000", 2020-11-12T17:23:15.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1469999999999998e-06 2020-11-12T17:23:15.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854691+0000", 2020-11-12T17:23:15.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046110760000000004 2020-11-12T17:23:15.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859302+0000", 2020-11-12T17:23:15.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010799299999999999 2020-11-12T17:23:15.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859410+0000", 2020-11-12T17:23:15.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00038086199999999999 2020-11-12T17:23:15.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:15.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859791+0000", 2020-11-12T17:23:15.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049539120000000004 2020-11-12T17:23:15.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.864745+0000", 2020-11-12T17:23:15.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.097925522000000001 2020-11-12T17:23:15.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.962670+0000", 2020-11-12T17:23:15.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109441 2020-11-12T17:23:15.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.962780+0000", 2020-11-12T17:23:15.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1139999999999999e-05 2020-11-12T17:23:15.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.962861+0000", 2020-11-12T17:23:15.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108252579 2020-11-12T17:23:15.814 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.814 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.814 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.814 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9480 3.4 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:15.815 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.033933+0000", 2020-11-12T17:23:15.815 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.497422531, 2020-11-12T17:23:15.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16844625499999999, 2020-11-12T17:23:15.815 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:15.815 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:15.815 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:15.815 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:15.816 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:15.816 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9480 2020-11-12T17:23:15.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.816 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:15.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:15.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033933+0000", 2020-11-12T17:23:15.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:15.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:15.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033933+0000", 2020-11-12T17:23:15.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:15.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:15.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033905+0000", 2020-11-12T17:23:15.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4893000000000003e-05 2020-11-12T17:23:15.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:15.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033980+0000", 2020-11-12T17:23:15.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.189e-05 2020-11-12T17:23:15.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:15.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033992+0000", 2020-11-12T17:23:15.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5068e-05 2020-11-12T17:23:15.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:15.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.034007+0000", 2020-11-12T17:23:15.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00522464 2020-11-12T17:23:15.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:15.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039232+0000", 2020-11-12T17:23:15.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013738800000000001 2020-11-12T17:23:15.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:15.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039369+0000", 2020-11-12T17:23:15.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024835999999999999 2020-11-12T17:23:15.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:15.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039618+0000", 2020-11-12T17:23:15.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018979000000000001 2020-11-12T17:23:15.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:15.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.041515+0000", 2020-11-12T17:23:15.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16076417100000001 2020-11-12T17:23:15.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:15.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.202280+0000", 2020-11-12T17:23:15.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0013999999999998e-05 2020-11-12T17:23:15.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:15.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.202340+0000", 2020-11-12T17:23:15.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9276000000000001e-05 2020-11-12T17:23:15.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:15.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:15.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:15.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.202379+0000", 2020-11-12T17:23:15.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16844625499999999 2020-11-12T17:23:15.824 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.824 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.825 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.825 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:15.825 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:15.825 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:15.826 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:15.748+0000 7f9289d6e700 -1 osd.7 27 handle_osd_map injecting map crc failure 2020-11-12T17:23:15.827 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:15.828 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 11 16 10191 10175 7.22596 1.42188 0.245286 0.016298 2020-11-12T17:23:15.828 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:15.820+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:15.928 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:15.920+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:15.967 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:15.987 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:15.988 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:15.988 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:15.988 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:15.998 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:16.028 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:16.028+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:16.120 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:16.129 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:16.120+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:16.144 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:16.149 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:16.150 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:16.150 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:16.150 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:16.150 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:16.159 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:16.172 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:16.200 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:16.228 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:16.229 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:16.224+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:16.257 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:16.275 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:16.276 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:16.285 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:16.289 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:16.316 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:16.317 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:16.317 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:16.318 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:16.318 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:16.318 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:16.318 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:16.318 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:16.318 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:16.373 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:16.368+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:16.394 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:16.394 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:16.404 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:16.445 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:16.440+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:16.532 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:16.524+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:16.556 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:16.560 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:16.563 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 12 16 10191 10175 6.62378 0 - 0.016298 2020-11-12T17:23:16.566 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:16.627 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:16.620+0000 7f7fe1845700 -1 osd.1 28 handle_osd_map injecting map crc failure 2020-11-12T17:23:16.633 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:23:16.633 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:16.632+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:16.734 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:16.728+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:16.753 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:16.767 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:16.768 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:16.834 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:16.828+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:16.906 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:16.916 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:16.918 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:16.964 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:16.964+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:17.037 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:17.036+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:17.047 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:17.047 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:17.059 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:17.139 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:17.132+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:17.217 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:17.218 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:17.228 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:17.276 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:17.276+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:17.339 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:17.340+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:17.350 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:17.350 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:17.362 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:17.440 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:17.432+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:17.536 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:17.537 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:17.542 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:17.540+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:17.547 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:17.563 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 13 16 11073 11057 6.64426 3.44531 0.0180786 0.0187505 2020-11-12T17:23:17.642 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:17.636+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:17.647 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:23:17.703 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:17.770 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:17.772 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:17.772 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:17.764+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:17.872 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:17.872+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:17.890 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:17.890 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:17.902 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:17.973 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:17.968+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:18.057 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:18.059 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:18.069 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:18.074 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:18.068+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:18.175 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:18.168+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:18.183 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:18.184 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:18.195 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:18.277 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:18.268+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:18.312 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:18.313 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:18.325 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:18.329 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:18.378 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:18.372+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:18.444 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:18.445 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:18.456 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:18.496 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:18.575 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:18.512+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:18.575 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:18.576 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:18.576 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 14 16 12186 12170 6.79071 8.69531 0.00510254 0.0183707 2020-11-12T17:23:18.580 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:18.572+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:18.586 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:18.587 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:18.594 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:18.598 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:18.625 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:18.672 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:18.681 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:18.680+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:18.707 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:18.733 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:18.734 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:18.734 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:18.734 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:18.743 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:18.748 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:18.750 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:18.750 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:18.750 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:18.750 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:18.750 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:18.751 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:18.751 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:18.751 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:18.809 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:18.804+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:18.881 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:18.881 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:18.884 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:18.884+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:18.893 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:18.985 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:18.980+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:19.042 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:19.044 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:19.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:19.045 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:19.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.045 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:254 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.046 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:19.046 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.293901267000001, 2020-11-12T17:23:19.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023, 2020-11-12T17:23:19.047 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.047 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.048 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.048 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.048 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.049 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 254 2020-11-12T17:23:19.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.049 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:19.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:19.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:19.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741501+0000", 2020-11-12T17:23:19.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8440000000000002e-05 2020-11-12T17:23:19.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741570+0000", 2020-11-12T17:23:19.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4515000000000001e-05 2020-11-12T17:23:19.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741584+0000", 2020-11-12T17:23:19.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5699999999999998e-06 2020-11-12T17:23:19.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741591+0000", 2020-11-12T17:23:19.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033344310000000001 2020-11-12T17:23:19.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744925+0000", 2020-11-12T17:23:19.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011066 2020-11-12T17:23:19.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745036+0000", 2020-11-12T17:23:19.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015032199999999999 2020-11-12T17:23:19.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745186+0000", 2020-11-12T17:23:19.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020296229999999999 2020-11-12T17:23:19.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747216+0000", 2020-11-12T17:23:19.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21356234399999999 2020-11-12T17:23:19.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960778+0000", 2020-11-12T17:23:19.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011052000000000001 2020-11-12T17:23:19.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960889+0000", 2020-11-12T17:23:19.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014397999999999999 2020-11-12T17:23:19.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961033+0000", 2020-11-12T17:23:19.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023 2020-11-12T17:23:19.079 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.079 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.079 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.080 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:255 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.080 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:19.080 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.291333436, 2020-11-12T17:23:19.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286, 2020-11-12T17:23:19.081 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.081 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.082 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.082 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 255 2020-11-12T17:23:19.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.082 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:19.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:19.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:19.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744038+0000", 2020-11-12T17:23:19.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000142953 2020-11-12T17:23:19.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744181+0000", 2020-11-12T17:23:19.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4383999999999999e-05 2020-11-12T17:23:19.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744206+0000", 2020-11-12T17:23:19.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0786e-05 2020-11-12T17:23:19.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744217+0000", 2020-11-12T17:23:19.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001465002 2020-11-12T17:23:19.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745682+0000", 2020-11-12T17:23:19.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000126458 2020-11-12T17:23:19.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745808+0000", 2020-11-12T17:23:19.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000164413 2020-11-12T17:23:19.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745972+0000", 2020-11-12T17:23:19.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019412520000000001 2020-11-12T17:23:19.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747914+0000", 2020-11-12T17:23:19.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.213271294 2020-11-12T17:23:19.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961185+0000", 2020-11-12T17:23:19.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001472 2020-11-12T17:23:19.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961332+0000", 2020-11-12T17:23:19.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108687 2020-11-12T17:23:19.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961441+0000", 2020-11-12T17:23:19.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286 2020-11-12T17:23:19.093 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.093 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.094 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.094 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:256 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.094 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:19.094 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.289722750999999, 2020-11-12T17:23:19.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001, 2020-11-12T17:23:19.095 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.095 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.095 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.095 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.095 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.096 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 256 2020-11-12T17:23:19.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.096 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:19.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:19.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:19.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745651+0000", 2020-11-12T17:23:19.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000140753 2020-11-12T17:23:19.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745792+0000", 2020-11-12T17:23:19.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3481e-05 2020-11-12T17:23:19.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745806+0000", 2020-11-12T17:23:19.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8069999999999999e-06 2020-11-12T17:23:19.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745810+0000", 2020-11-12T17:23:19.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001457563 2020-11-12T17:23:19.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747268+0000", 2020-11-12T17:23:19.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116141 2020-11-12T17:23:19.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747384+0000", 2020-11-12T17:23:19.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013822899999999999 2020-11-12T17:23:19.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747522+0000", 2020-11-12T17:23:19.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079223100000000001 2020-11-12T17:23:19.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.748315+0000", 2020-11-12T17:23:19.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21734695200000001 2020-11-12T17:23:19.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965662+0000", 2020-11-12T17:23:19.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011252999999999999 2020-11-12T17:23:19.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965774+0000", 2020-11-12T17:23:19.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015996700000000001 2020-11-12T17:23:19.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965934+0000", 2020-11-12T17:23:19.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001 2020-11-12T17:23:19.106 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.106 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.106 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.107 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:337 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.107 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:19.107 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.226587155000001, 2020-11-12T17:23:19.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089, 2020-11-12T17:23:19.107 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.107 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.107 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.108 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.108 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.108 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 337 2020-11-12T17:23:19.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.108 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:19.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:19.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:19.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808793+0000", 2020-11-12T17:23:19.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012736400000000001 2020-11-12T17:23:19.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808920+0000", 2020-11-12T17:23:19.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7972e-05 2020-11-12T17:23:19.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808938+0000", 2020-11-12T17:23:19.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5259999999999999e-06 2020-11-12T17:23:19.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808948+0000", 2020-11-12T17:23:19.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3725000000000001e-05 2020-11-12T17:23:19.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809041+0000", 2020-11-12T17:23:19.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026396500000000001 2020-11-12T17:23:19.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809305+0000", 2020-11-12T17:23:19.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000287686 2020-11-12T17:23:19.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809593+0000", 2020-11-12T17:23:19.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049805869999999999 2020-11-12T17:23:19.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814574+0000", 2020-11-12T17:23:19.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151510007 2020-11-12T17:23:19.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966084+0000", 2020-11-12T17:23:19.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110937 2020-11-12T17:23:19.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966195+0000", 2020-11-12T17:23:19.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5339999999999994e-05 2020-11-12T17:23:19.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966270+0000", 2020-11-12T17:23:19.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089 2020-11-12T17:23:19.126 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.126 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.126 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.127 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:338 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.127 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:19.127 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.226364318, 2020-11-12T17:23:19.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999, 2020-11-12T17:23:19.128 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.128 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.128 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.129 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 338 2020-11-12T17:23:19.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.130 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:19.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:19.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:19.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809008+0000", 2020-11-12T17:23:19.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000123659 2020-11-12T17:23:19.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809131+0000", 2020-11-12T17:23:19.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4180000000000003e-06 2020-11-12T17:23:19.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809141+0000", 2020-11-12T17:23:19.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2680000000000002e-06 2020-11-12T17:23:19.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809146+0000", 2020-11-12T17:23:19.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011238120000000001 2020-11-12T17:23:19.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810270+0000", 2020-11-12T17:23:19.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9084000000000003e-05 2020-11-12T17:23:19.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810359+0000", 2020-11-12T17:23:19.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186856 2020-11-12T17:23:19.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810546+0000", 2020-11-12T17:23:19.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040397699999999998 2020-11-12T17:23:19.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814586+0000", 2020-11-12T17:23:19.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15495921400000001 2020-11-12T17:23:19.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969545+0000", 2020-11-12T17:23:19.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012353700000000001 2020-11-12T17:23:19.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969668+0000", 2020-11-12T17:23:19.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013906300000000001 2020-11-12T17:23:19.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969807+0000", 2020-11-12T17:23:19.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999 2020-11-12T17:23:19.144 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.144 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.144 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.145 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:339 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.145 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:19.145 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.226227421999999, 2020-11-12T17:23:19.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999, 2020-11-12T17:23:19.145 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.145 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.145 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.146 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.146 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.146 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 339 2020-11-12T17:23:19.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.146 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:19.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:19.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:19.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809174+0000", 2020-11-12T17:23:19.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4807000000000005e-05 2020-11-12T17:23:19.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809238+0000", 2020-11-12T17:23:19.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2660000000000001e-06 2020-11-12T17:23:19.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809247+0000", 2020-11-12T17:23:19.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1060000000000002e-06 2020-11-12T17:23:19.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809251+0000", 2020-11-12T17:23:19.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001789286 2020-11-12T17:23:19.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811040+0000", 2020-11-12T17:23:19.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013621 2020-11-12T17:23:19.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811176+0000", 2020-11-12T17:23:19.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023835800000000001 2020-11-12T17:23:19.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811415+0000", 2020-11-12T17:23:19.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031774529999999998 2020-11-12T17:23:19.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814592+0000", 2020-11-12T17:23:19.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15532954199999999 2020-11-12T17:23:19.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969922+0000", 2020-11-12T17:23:19.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021167000000000001 2020-11-12T17:23:19.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970133+0000", 2020-11-12T17:23:19.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7349999999999995e-05 2020-11-12T17:23:19.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970231+0000", 2020-11-12T17:23:19.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999 2020-11-12T17:23:19.155 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.155 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.155 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.156 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:340 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.156 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:19.156 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.225695312999999, 2020-11-12T17:23:19.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999, 2020-11-12T17:23:19.156 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.156 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.157 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.157 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.157 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.157 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 340 2020-11-12T17:23:19.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.157 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:19.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:19.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999958 2020-11-12T17:23:19.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809686+0000", 2020-11-12T17:23:19.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9798999999999999e-05 2020-11-12T17:23:19.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809776+0000", 2020-11-12T17:23:19.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2833999999999999e-05 2020-11-12T17:23:19.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809788+0000", 2020-11-12T17:23:19.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-06 2020-11-12T17:23:19.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809794+0000", 2020-11-12T17:23:19.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020989979999999999 2020-11-12T17:23:19.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811893+0000", 2020-11-12T17:23:19.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012502300000000001 2020-11-12T17:23:19.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812018+0000", 2020-11-12T17:23:19.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013605900000000001 2020-11-12T17:23:19.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812154+0000", 2020-11-12T17:23:19.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003821344 2020-11-12T17:23:19.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815975+0000", 2020-11-12T17:23:19.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15447417999999999 2020-11-12T17:23:19.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970449+0000", 2020-11-12T17:23:19.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2955999999999997e-05 2020-11-12T17:23:19.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970532+0000", 2020-11-12T17:23:19.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6341999999999998e-05 2020-11-12T17:23:19.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970578+0000", 2020-11-12T17:23:19.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999 2020-11-12T17:23:19.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.167 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.167 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.167 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:341 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.167 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:19.168 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.225571735999999, 2020-11-12T17:23:19.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999, 2020-11-12T17:23:19.168 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.168 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.168 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.168 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.168 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.169 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 341 2020-11-12T17:23:19.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.169 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:19.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:19.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:23:19.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809810+0000", 2020-11-12T17:23:19.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129682 2020-11-12T17:23:19.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809940+0000", 2020-11-12T17:23:19.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2874000000000002e-05 2020-11-12T17:23:19.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809963+0000", 2020-11-12T17:23:19.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8199999999999997e-06 2020-11-12T17:23:19.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809971+0000", 2020-11-12T17:23:19.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026854119999999999 2020-11-12T17:23:19.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812656+0000", 2020-11-12T17:23:19.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000136685 2020-11-12T17:23:19.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812793+0000", 2020-11-12T17:23:19.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000267831 2020-11-12T17:23:19.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813061+0000", 2020-11-12T17:23:19.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029210490000000002 2020-11-12T17:23:19.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815982+0000", 2020-11-12T17:23:19.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15468012 2020-11-12T17:23:19.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970662+0000", 2020-11-12T17:23:19.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111106 2020-11-12T17:23:19.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970773+0000", 2020-11-12T17:23:19.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111366 2020-11-12T17:23:19.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970884+0000", 2020-11-12T17:23:19.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999 2020-11-12T17:23:19.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.178 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.179 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:342 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.179 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:19.179 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.225395714999999, 2020-11-12T17:23:19.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999, 2020-11-12T17:23:19.179 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.179 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.179 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.179 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.180 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.180 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 342 2020-11-12T17:23:19.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.180 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:19.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:19.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:19.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810002+0000", 2020-11-12T17:23:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0510000000000001e-05 2020-11-12T17:23:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810072+0000", 2020-11-12T17:23:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9950000000000005e-06 2020-11-12T17:23:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810080+0000", 2020-11-12T17:23:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0779999999999997e-06 2020-11-12T17:23:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810084+0000", 2020-11-12T17:23:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003443944 2020-11-12T17:23:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813528+0000", 2020-11-12T17:23:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010784 2020-11-12T17:23:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813636+0000", 2020-11-12T17:23:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019826199999999999 2020-11-12T17:23:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813834+0000", 2020-11-12T17:23:19.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021549550000000001 2020-11-12T17:23:19.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815989+0000", 2020-11-12T17:23:19.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15502450600000001 2020-11-12T17:23:19.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971014+0000", 2020-11-12T17:23:19.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6885999999999996e-05 2020-11-12T17:23:19.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971081+0000", 2020-11-12T17:23:19.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9054000000000006e-05 2020-11-12T17:23:19.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971160+0000", 2020-11-12T17:23:19.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999 2020-11-12T17:23:19.189 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.189 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.189 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.189 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:343 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.189 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:19.189 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.225092728, 2020-11-12T17:23:19.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001, 2020-11-12T17:23:19.190 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.190 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.190 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.190 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.190 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.190 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 343 2020-11-12T17:23:19.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.191 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:19.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:19.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:19.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810292+0000", 2020-11-12T17:23:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012150399999999999 2020-11-12T17:23:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810413+0000", 2020-11-12T17:23:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6617e-05 2020-11-12T17:23:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810430+0000", 2020-11-12T17:23:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414000000000001e-05 2020-11-12T17:23:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810440+0000", 2020-11-12T17:23:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042287779999999999 2020-11-12T17:23:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814669+0000", 2020-11-12T17:23:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012893400000000001 2020-11-12T17:23:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814798+0000", 2020-11-12T17:23:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187195 2020-11-12T17:23:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814985+0000", 2020-11-12T17:23:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001013566 2020-11-12T17:23:19.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815999+0000", 2020-11-12T17:23:19.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15527013200000001 2020-11-12T17:23:19.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971269+0000", 2020-11-12T17:23:19.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010525 2020-11-12T17:23:19.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971374+0000", 2020-11-12T17:23:19.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-05 2020-11-12T17:23:19.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971425+0000", 2020-11-12T17:23:19.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001 2020-11-12T17:23:19.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.199 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.200 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:344 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.200 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:19.200 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.222367924, 2020-11-12T17:23:19.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999, 2020-11-12T17:23:19.200 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.201 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.201 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.201 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.201 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.201 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 344 2020-11-12T17:23:19.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.201 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:19.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:19.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:19.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813023+0000", 2020-11-12T17:23:19.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5440999999999996e-05 2020-11-12T17:23:19.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813119+0000", 2020-11-12T17:23:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2757e-05 2020-11-12T17:23:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813131+0000", 2020-11-12T17:23:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8279999999999997e-06 2020-11-12T17:23:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813138+0000", 2020-11-12T17:23:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002273653 2020-11-12T17:23:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815412+0000", 2020-11-12T17:23:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012572199999999999 2020-11-12T17:23:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815537+0000", 2020-11-12T17:23:19.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013668400000000001 2020-11-12T17:23:19.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815674+0000", 2020-11-12T17:23:19.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001073863 2020-11-12T17:23:19.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.816748+0000", 2020-11-12T17:23:19.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154859634 2020-11-12T17:23:19.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971608+0000", 2020-11-12T17:23:19.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7041999999999999e-05 2020-11-12T17:23:19.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971675+0000", 2020-11-12T17:23:19.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9370000000000002e-05 2020-11-12T17:23:19.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971734+0000", 2020-11-12T17:23:19.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999 2020-11-12T17:23:19.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.210 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.211 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.211 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:19.211 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:19.212 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.926545902000001, 2020-11-12T17:23:19.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:23:19.212 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.212 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:23:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:23:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:23:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:23:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:23:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:23:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:23:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:23:19.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:23:19.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:23:19.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:23:19.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:23:19.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:23:19.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:19.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:23:19.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:23:19.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:23:19.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:23:19.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:23:19.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:23:19.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:23:19.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:23:19.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:23:19.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:23:19.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.222 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:23:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.919454106, 2020-11-12T17:23:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:23:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:23:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:23:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:23:19.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:23:19.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:23:19.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:23:19.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:23:19.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:23:19.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:23:19.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:23:19.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:23:19.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:23:19.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:23:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:23:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5703 3.6 3:6399e945:::benchmark_data_smithi036_14212_object712:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.472173+0000", 2020-11-12T17:23:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.5632497109999992, 2020-11-12T17:23:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.197881803, 2020-11-12T17:23:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5703 2020-11-12T17:23:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472173+0000", 2020-11-12T17:23:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472173+0000", 2020-11-12T17:23:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:23:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472150+0000", 2020-11-12T17:23:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1002999999999996e-05 2020-11-12T17:23:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472241+0000", 2020-11-12T17:23:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8170000000000001e-05 2020-11-12T17:23:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472259+0000", 2020-11-12T17:23:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6230000000000003e-06 2020-11-12T17:23:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472268+0000", 2020-11-12T17:23:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014259310000000001 2020-11-12T17:23:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.473694+0000", 2020-11-12T17:23:19.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110128 2020-11-12T17:23:19.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.473804+0000", 2020-11-12T17:23:19.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022655700000000001 2020-11-12T17:23:19.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:19.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474031+0000", 2020-11-12T17:23:19.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034442140000000001 2020-11-12T17:23:19.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.477475+0000", 2020-11-12T17:23:19.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19244666099999999 2020-11-12T17:23:19.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669921+0000", 2020-11-12T17:23:19.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5439999999999996e-05 2020-11-12T17:23:19.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669997+0000", 2020-11-12T17:23:19.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8245000000000002e-05 2020-11-12T17:23:19.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670055+0000", 2020-11-12T17:23:19.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.197881803 2020-11-12T17:23:19.241 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.241 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.241 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.241 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5704 3.6 3:6399e945:::benchmark_data_smithi036_14212_object712:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:19.241 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.472307+0000", 2020-11-12T17:23:19.242 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.5631164949999992, 2020-11-12T17:23:19.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20087829400000001, 2020-11-12T17:23:19.242 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.242 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.242 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5704 2020-11-12T17:23:19.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.243 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472307+0000", 2020-11-12T17:23:19.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472307+0000", 2020-11-12T17:23:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:23:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472285+0000", 2020-11-12T17:23:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3293999999999994e-05 2020-11-12T17:23:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472348+0000", 2020-11-12T17:23:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5220000000000007e-06 2020-11-12T17:23:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472357+0000", 2020-11-12T17:23:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8410000000000002e-06 2020-11-12T17:23:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472361+0000", 2020-11-12T17:23:19.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034082689999999998 2020-11-12T17:23:19.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.475769+0000", 2020-11-12T17:23:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016389400000000001 2020-11-12T17:23:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.475933+0000", 2020-11-12T17:23:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027474999999999998 2020-11-12T17:23:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476208+0000", 2020-11-12T17:23:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002358771 2020-11-12T17:23:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.478566+0000", 2020-11-12T17:23:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19444792 2020-11-12T17:23:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.673014+0000", 2020-11-12T17:23:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7453000000000004e-05 2020-11-12T17:23:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.673112+0000", 2020-11-12T17:23:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2992999999999997e-05 2020-11-12T17:23:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.673185+0000", 2020-11-12T17:23:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20087829400000001 2020-11-12T17:23:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.4874170280000003, 2020-11-12T17:23:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999, 2020-11-12T17:23:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:23:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:23:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:23:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:23:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:23:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:23:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:23:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:23:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:23:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:23:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:23:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:23:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:23:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112811 2020-11-12T17:23:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550940+0000", 2020-11-12T17:23:19.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001154101 2020-11-12T17:23:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552095+0000", 2020-11-12T17:23:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25363090900000002 2020-11-12T17:23:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805725+0000", 2020-11-12T17:23:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8797999999999998e-05 2020-11-12T17:23:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805824+0000", 2020-11-12T17:23:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8110999999999998e-05 2020-11-12T17:23:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805902+0000", 2020-11-12T17:23:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999 2020-11-12T17:23:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:23:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.4868946090000001, 2020-11-12T17:23:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:23:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.278 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.278 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:23:19.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.278 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:23:19.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:23:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:23:19.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:23:19.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:23:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:23:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:23:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:23:19.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:23:19.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:23:19.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:23:19.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:23:19.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:23:19.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:23:19.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:19.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:23:19.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:23:19.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:23:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:23:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:23:19.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:23:19.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:23:19.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:23:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:23:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:23:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.297 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.297 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.298 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9999 3.1 e26/20 ondisk, result = 0)", 2020-11-12T17:23:19.298 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:23:19.298 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.4785320889999998, 2020-11-12T17:23:19.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145, 2020-11-12T17:23:19.298 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:23:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:23:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556869+0000", 2020-11-12T17:23:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1767999999999994e-05 2020-11-12T17:23:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556951+0000", 2020-11-12T17:23:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.248442731 2020-11-12T17:23:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805393+0000", 2020-11-12T17:23:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5503e-05 2020-11-12T17:23:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805409+0000", 2020-11-12T17:23:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027928399999999998 2020-11-12T17:23:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805688+0000", 2020-11-12T17:23:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2215e-05 2020-11-12T17:23:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805710+0000", 2020-11-12T17:23:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000226744 2020-11-12T17:23:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805937+0000", 2020-11-12T17:23:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145 2020-11-12T17:23:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:10000 3.1 e27/20 ondisk, result = 0)", 2020-11-12T17:23:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.807681+0000", 2020-11-12T17:23:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.2277419859999998, 2020-11-12T17:23:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17226509700000001, 2020-11-12T17:23:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.807681+0000", 2020-11-12T17:23:19.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.807681+0000", 2020-11-12T17:23:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9998827 2020-11-12T17:23:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.807564+0000", 2020-11-12T17:23:19.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027963700000000001 2020-11-12T17:23:19.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.807844+0000", 2020-11-12T17:23:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.171710375 2020-11-12T17:23:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979554+0000", 2020-11-12T17:23:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4560000000000006e-06 2020-11-12T17:23:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979563+0000", 2020-11-12T17:23:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6435999999999997e-05 2020-11-12T17:23:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979650+0000", 2020-11-12T17:23:19.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8323000000000001e-05 2020-11-12T17:23:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979668+0000", 2020-11-12T17:23:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027798800000000001 2020-11-12T17:23:19.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979946+0000", 2020-11-12T17:23:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17226509700000001 2020-11-12T17:23:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.319 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10048 3.b e27/20 3:de93336d:::benchmark_data_smithi036_14212_object1255:head v 27'688, mlcod=27'683)", 2020-11-12T17:23:19.319 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.981168+0000", 2020-11-12T17:23:19.319 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.0542551040000001, 2020-11-12T17:23:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18408571700000001, 2020-11-12T17:23:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.981168+0000", 2020-11-12T17:23:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.981168+0000", 2020-11-12T17:23:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.981141+0000", 2020-11-12T17:23:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010602700000000001 2020-11-12T17:23:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.981247+0000", 2020-11-12T17:23:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18230318000000001 2020-11-12T17:23:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.163550+0000", 2020-11-12T17:23:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1389999999999998e-06 2020-11-12T17:23:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.163557+0000", 2020-11-12T17:23:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5004999999999999e-05 2020-11-12T17:23:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.163612+0000", 2020-11-12T17:23:19.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3263000000000003e-05 2020-11-12T17:23:19.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.163645+0000", 2020-11-12T17:23:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015468859999999999 2020-11-12T17:23:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165192+0000", 2020-11-12T17:23:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1554000000000001e-05 2020-11-12T17:23:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165254+0000", 2020-11-12T17:23:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18408571700000001 2020-11-12T17:23:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.331 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.331 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.331 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.331 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.331 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:19.333 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:19.332+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:19.334 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:19.434 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:19.428+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:19.496 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:19.496 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:19.497 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:19.497 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:19.506 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:19.535 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:19.532+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:19.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 15 16 12711 12695 6.61141 4.10156 0.549484 0.0181662 2020-11-12T17:23:19.631 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-12T17:23:19.633 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:23:19.633 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-11-12T17:23:19.636 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:19.628+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:19.660 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:23:19.671 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:19.673 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:19.673 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:19.686 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:19.738 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:19.736+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:19.839 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:19.836+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:19.871 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:19.872 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:19.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:19.872 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:19.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.873 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:112 3.8 e22/20 3:18b8dd66:::benchmark_data_smithi036_14212_object13:head v 22'8, mlcod=22'1)", 2020-11-12T17:23:19.873 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:19.873 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.192447622, 2020-11-12T17:23:19.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142703407, 2020-11-12T17:23:19.874 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.874 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.874 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:19.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:19.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999738 2020-11-12T17:23:19.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644296+0000", 2020-11-12T17:23:19.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6483000000000005e-05 2020-11-12T17:23:19.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644382+0000", 2020-11-12T17:23:19.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14174973900000001 2020-11-12T17:23:19.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786132+0000", 2020-11-12T17:23:19.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3459999999999996e-06 2020-11-12T17:23:19.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786139+0000", 2020-11-12T17:23:19.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:23:19.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786193+0000", 2020-11-12T17:23:19.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6371999999999997e-05 2020-11-12T17:23:19.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786229+0000", 2020-11-12T17:23:19.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00074081500000000003 2020-11-12T17:23:19.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786970+0000", 2020-11-12T17:23:19.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5047000000000003e-05 2020-11-12T17:23:19.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787025+0000", 2020-11-12T17:23:19.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142703407 2020-11-12T17:23:19.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.887 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.888 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:336 3.8 e22/20 3:1a561d42:::benchmark_data_smithi036_14212_object41:head v 22'24, mlcod=22'19)", 2020-11-12T17:23:19.894 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:19.894 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.025414223, 2020-11-12T17:23:19.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.163538234, 2020-11-12T17:23:19.895 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.895 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.895 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:19.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:19.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:19.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811319+0000", 2020-11-12T17:23:19.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133662 2020-11-12T17:23:19.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811453+0000", 2020-11-12T17:23:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16096115799999999 2020-11-12T17:23:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972414+0000", 2020-11-12T17:23:19.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.08e-05 2020-11-12T17:23:19.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972425+0000", 2020-11-12T17:23:19.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1691000000000001e-05 2020-11-12T17:23:19.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972507+0000", 2020-11-12T17:23:19.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2666000000000001e-05 2020-11-12T17:23:19.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972549+0000", 2020-11-12T17:23:19.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023026349999999999 2020-11-12T17:23:19.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.974852+0000", 2020-11-12T17:23:19.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1347000000000002e-05 2020-11-12T17:23:19.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.974893+0000", 2020-11-12T17:23:19.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.163538234 2020-11-12T17:23:19.904 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.904 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.904 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.906 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1064 3.4 3:28f19af0:::benchmark_data_smithi036_14212_object132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:19.906 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:19.906 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.253180853, 2020-11-12T17:23:19.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108211234, 2020-11-12T17:23:19.906 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.906 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.906 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.907 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.907 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.907 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1064 2020-11-12T17:23:19.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.907 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:19.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:19.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:23:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583558+0000", 2020-11-12T17:23:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1188999999999997e-05 2020-11-12T17:23:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583649+0000", 2020-11-12T17:23:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1898e-05 2020-11-12T17:23:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583661+0000", 2020-11-12T17:23:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7760000000000003e-06 2020-11-12T17:23:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583667+0000", 2020-11-12T17:23:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013380880000000001 2020-11-12T17:23:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585005+0000", 2020-11-12T17:23:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9061999999999995e-05 2020-11-12T17:23:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585094+0000", 2020-11-12T17:23:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017904600000000001 2020-11-12T17:23:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585273+0000", 2020-11-12T17:23:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094028799999999995 2020-11-12T17:23:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.586214+0000", 2020-11-12T17:23:19.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.105461808 2020-11-12T17:23:19.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691675+0000", 2020-11-12T17:23:19.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9709000000000006e-05 2020-11-12T17:23:19.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691745+0000", 2020-11-12T17:23:19.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4641000000000001e-05 2020-11-12T17:23:19.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691800+0000", 2020-11-12T17:23:19.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108211234 2020-11-12T17:23:19.916 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.916 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.916 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.917 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1816 3.4 3:229575d8:::benchmark_data_smithi036_14212_object226:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:19.917 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:19.917 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.610064658000001, 2020-11-12T17:23:19.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157715203, 2020-11-12T17:23:19.917 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.917 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.917 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.918 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.918 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.918 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1816 2020-11-12T17:23:19.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.918 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:19.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:19.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:19.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226671+0000", 2020-11-12T17:23:19.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5532999999999995e-05 2020-11-12T17:23:19.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226766+0000", 2020-11-12T17:23:19.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:23:19.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226779+0000", 2020-11-12T17:23:19.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6120000000000004e-06 2020-11-12T17:23:19.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226786+0000", 2020-11-12T17:23:19.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00085013099999999996 2020-11-12T17:23:19.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227636+0000", 2020-11-12T17:23:19.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1732999999999998e-05 2020-11-12T17:23:19.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227718+0000", 2020-11-12T17:23:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100733 2020-11-12T17:23:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227819+0000", 2020-11-12T17:23:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023757000000000001 2020-11-12T17:23:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.230194+0000", 2020-11-12T17:23:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154122064 2020-11-12T17:23:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384316+0000", 2020-11-12T17:23:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9681000000000001e-05 2020-11-12T17:23:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384366+0000", 2020-11-12T17:23:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3980000000000002e-05 2020-11-12T17:23:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384420+0000", 2020-11-12T17:23:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157715203 2020-11-12T17:23:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:1816 3.4 e23/20 ondisk, result = 0)", 2020-11-12T17:23:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.606890794, 2020-11-12T17:23:19.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15454711500000001, 2020-11-12T17:23:19.929 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.929 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:19.929 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:19.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:19.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:19.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229854+0000", 2020-11-12T17:23:19.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8783000000000003e-05 2020-11-12T17:23:19.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229913+0000", 2020-11-12T17:23:19.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154309107 2020-11-12T17:23:19.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384222+0000", 2020-11-12T17:23:19.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2269999999999999e-06 2020-11-12T17:23:19.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384232+0000", 2020-11-12T17:23:19.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5488999999999996e-05 2020-11-12T17:23:19.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384297+0000", 2020-11-12T17:23:19.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2262000000000001e-05 2020-11-12T17:23:19.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384309+0000", 2020-11-12T17:23:19.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116474 2020-11-12T17:23:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384426+0000", 2020-11-12T17:23:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15454711500000001 2020-11-12T17:23:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:4456 3.4 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e24)", 2020-11-12T17:23:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.990338553000001, 2020-11-12T17:23:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28490720800000002, 2020-11-12T17:23:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 4456 2020-11-12T17:23:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846382+0000", 2020-11-12T17:23:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013956400000000001 2020-11-12T17:23:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846521+0000", 2020-11-12T17:23:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7923000000000001e-05 2020-11-12T17:23:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846539+0000", 2020-11-12T17:23:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1470000000000007e-06 2020-11-12T17:23:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846548+0000", 2020-11-12T17:23:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054463600000000004 2020-11-12T17:23:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847093+0000", 2020-11-12T17:23:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2497000000000006e-05 2020-11-12T17:23:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847186+0000", 2020-11-12T17:23:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144227 2020-11-12T17:23:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847330+0000", 2020-11-12T17:23:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010893070000000001 2020-11-12T17:23:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.848419+0000", 2020-11-12T17:23:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.282686039 2020-11-12T17:23:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131105+0000", 2020-11-12T17:23:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012774600000000001 2020-11-12T17:23:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131233+0000", 2020-11-12T17:23:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000105154 2020-11-12T17:23:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131338+0000", 2020-11-12T17:23:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28490720800000002 2020-11-12T17:23:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5344 3.4 3:256e9fb4:::benchmark_data_smithi036_14212_object667:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.6533435139999995, 2020-11-12T17:23:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116435965, 2020-11-12T17:23:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5344 2020-11-12T17:23:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:23:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183396+0000", 2020-11-12T17:23:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4202000000000004e-05 2020-11-12T17:23:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183490+0000", 2020-11-12T17:23:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9741e-05 2020-11-12T17:23:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183510+0000", 2020-11-12T17:23:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5509999999999996e-06 2020-11-12T17:23:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183516+0000", 2020-11-12T17:23:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036344010000000002 2020-11-12T17:23:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187151+0000", 2020-11-12T17:23:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011442099999999999 2020-11-12T17:23:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:19.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:19.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187265+0000", 2020-11-12T17:23:20.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018573799999999999 2020-11-12T17:23:20.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:20.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187451+0000", 2020-11-12T17:23:20.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044292359999999996 2020-11-12T17:23:20.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:20.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.191880+0000", 2020-11-12T17:23:20.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.107843906 2020-11-12T17:23:20.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:20.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299724+0000", 2020-11-12T17:23:20.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5835000000000003e-05 2020-11-12T17:23:20.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:20.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299780+0000", 2020-11-12T17:23:20.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2107000000000005e-05 2020-11-12T17:23:20.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299862+0000", 2020-11-12T17:23:20.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116435965 2020-11-12T17:23:20.149 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.149 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.149 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.150 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5344 3.4 e25/20 ondisk, result = 0)", 2020-11-12T17:23:20.150 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:20.150 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.64445175, 2020-11-12T17:23:20.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10756062, 2020-11-12T17:23:20.151 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.151 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:20.151 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:20.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:20.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:20.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192288+0000", 2020-11-12T17:23:20.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9671000000000003e-05 2020-11-12T17:23:20.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192368+0000", 2020-11-12T17:23:20.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.105564818 2020-11-12T17:23:20.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.297932+0000", 2020-11-12T17:23:20.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1760000000000004e-06 2020-11-12T17:23:20.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.297940+0000", 2020-11-12T17:23:20.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017675919999999999 2020-11-12T17:23:20.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299707+0000", 2020-11-12T17:23:20.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:23:20.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299716+0000", 2020-11-12T17:23:20.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162015 2020-11-12T17:23:20.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299878+0000", 2020-11-12T17:23:20.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10756062 2020-11-12T17:23:20.161 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.161 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.161 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.162 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5496 3.4 3:2cf172bc:::benchmark_data_smithi036_14212_object686:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:20.162 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:20.163 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.5376429470000001, 2020-11-12T17:23:20.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124862294, 2020-11-12T17:23:20.163 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.163 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:20.163 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:20.164 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:20.164 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:20.164 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5496 2020-11-12T17:23:20.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.164 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:20.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:20.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:20.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299088+0000", 2020-11-12T17:23:20.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120711 2020-11-12T17:23:20.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299209+0000", 2020-11-12T17:23:20.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7577000000000001e-05 2020-11-12T17:23:20.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299226+0000", 2020-11-12T17:23:20.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3689999999999999e-05 2020-11-12T17:23:20.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299240+0000", 2020-11-12T17:23:20.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056383780000000003 2020-11-12T17:23:20.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.304878+0000", 2020-11-12T17:23:20.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104419 2020-11-12T17:23:20.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.304983+0000", 2020-11-12T17:23:20.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019338800000000001 2020-11-12T17:23:20.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:20.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.305176+0000", 2020-11-12T17:23:20.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001656366 2020-11-12T17:23:20.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:20.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.306832+0000", 2020-11-12T17:23:20.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.117004916 2020-11-12T17:23:20.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:20.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423837+0000", 2020-11-12T17:23:20.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1908000000000003e-05 2020-11-12T17:23:20.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:20.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423909+0000", 2020-11-12T17:23:20.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9568999999999997e-05 2020-11-12T17:23:20.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423989+0000", 2020-11-12T17:23:20.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124862294 2020-11-12T17:23:20.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.178 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.179 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5496 3.4 e25/20 ondisk, result = 0)", 2020-11-12T17:23:20.179 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:20.179 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.5294885909999998, 2020-11-12T17:23:20.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116715649, 2020-11-12T17:23:20.179 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.179 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:20.180 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:20.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:20.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:20.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307254+0000", 2020-11-12T17:23:20.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7615999999999998e-05 2020-11-12T17:23:20.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307321+0000", 2020-11-12T17:23:20.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116404623 2020-11-12T17:23:20.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423726+0000", 2020-11-12T17:23:20.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8149999999999995e-06 2020-11-12T17:23:20.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423735+0000", 2020-11-12T17:23:20.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1903999999999994e-05 2020-11-12T17:23:20.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423817+0000", 2020-11-12T17:23:20.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.028e-05 2020-11-12T17:23:20.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423827+0000", 2020-11-12T17:23:20.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016951499999999999 2020-11-12T17:23:20.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423996+0000", 2020-11-12T17:23:20.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116715649 2020-11-12T17:23:20.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.188 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.189 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.189 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:5703 3.6 e25/20 3:6399e945:::benchmark_data_smithi036_14212_object712:head v 25'391, mlcod=25'383)", 2020-11-12T17:23:20.189 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:20.189 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3623426240000001, 2020-11-12T17:23:20.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19527752500000001, 2020-11-12T17:23:20.190 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.190 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:20.190 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:20.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:20.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999347 2020-11-12T17:23:20.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474361+0000", 2020-11-12T17:23:20.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015052699999999999 2020-11-12T17:23:20.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474512+0000", 2020-11-12T17:23:20.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.194039023 2020-11-12T17:23:20.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668551+0000", 2020-11-12T17:23:20.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3286e-05 2020-11-12T17:23:20.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668564+0000", 2020-11-12T17:23:20.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960999999999999e-05 2020-11-12T17:23:20.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668655+0000", 2020-11-12T17:23:20.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7333999999999999e-05 2020-11-12T17:23:20.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668692+0000", 2020-11-12T17:23:20.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00091690499999999998 2020-11-12T17:23:20.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:20.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669609+0000", 2020-11-12T17:23:20.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4975999999999993e-05 2020-11-12T17:23:20.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669704+0000", 2020-11-12T17:23:20.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19527752500000001 2020-11-12T17:23:20.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.199 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.199 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:5704 3.6 e25/20 3:6399e945:::benchmark_data_smithi036_14212_object712:head v 25'392, mlcod=25'386)", 2020-11-12T17:23:20.200 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:20.200 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3602628219999993, 2020-11-12T17:23:20.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19575757999999999, 2020-11-12T17:23:20.200 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.200 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:20.200 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:20.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:20.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:20.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476472+0000", 2020-11-12T17:23:20.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013146800000000001 2020-11-12T17:23:20.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476603+0000", 2020-11-12T17:23:20.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.194169657 2020-11-12T17:23:20.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670773+0000", 2020-11-12T17:23:20.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1989999999999999e-06 2020-11-12T17:23:20.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670777+0000", 2020-11-12T17:23:20.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6594000000000001e-05 2020-11-12T17:23:20.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670824+0000", 2020-11-12T17:23:20.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9747000000000002e-05 2020-11-12T17:23:20.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670854+0000", 2020-11-12T17:23:20.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001341456 2020-11-12T17:23:20.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:20.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.672195+0000", 2020-11-12T17:23:20.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9018999999999998e-05 2020-11-12T17:23:20.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.672264+0000", 2020-11-12T17:23:20.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19575757999999999 2020-11-12T17:23:20.240 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.241 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.241 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.243 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5720 3.0 3:0c13ab4c:::benchmark_data_smithi036_14212_object714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:20.243 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:20.243 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3534244940000004, 2020-11-12T17:23:20.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356863017, 2020-11-12T17:23:20.244 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.244 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:20.244 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:20.245 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:20.245 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:20.245 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5720 2020-11-12T17:23:20.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.246 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:20.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:20.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:20.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483326+0000", 2020-11-12T17:23:20.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4151999999999999e-05 2020-11-12T17:23:20.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483380+0000", 2020-11-12T17:23:20.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1484999999999999e-05 2020-11-12T17:23:20.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483392+0000", 2020-11-12T17:23:20.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0610000000000003e-06 2020-11-12T17:23:20.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483397+0000", 2020-11-12T17:23:20.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041122260000000001 2020-11-12T17:23:20.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487509+0000", 2020-11-12T17:23:20.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012518300000000001 2020-11-12T17:23:20.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487634+0000", 2020-11-12T17:23:20.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020357700000000001 2020-11-12T17:23:20.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:20.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487838+0000", 2020-11-12T17:23:20.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022445590000000001 2020-11-12T17:23:20.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:20.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.490082+0000", 2020-11-12T17:23:20.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35001414600000003 2020-11-12T17:23:20.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:20.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840097+0000", 2020-11-12T17:23:20.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9443e-05 2020-11-12T17:23:20.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:20.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840156+0000", 2020-11-12T17:23:20.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.185e-05 2020-11-12T17:23:20.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840208+0000", 2020-11-12T17:23:20.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356863017 2020-11-12T17:23:20.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.261 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.262 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5720 3.0 e25/20 ondisk, result = 0)", 2020-11-12T17:23:20.262 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:20.262 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3440941540000004, 2020-11-12T17:23:20.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.347542456, 2020-11-12T17:23:20.262 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.263 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:20.263 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:20.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:20.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999989 2020-11-12T17:23:20.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492664+0000", 2020-11-12T17:23:20.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8972999999999999e-05 2020-11-12T17:23:20.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492693+0000", 2020-11-12T17:23:20.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34695741600000002 2020-11-12T17:23:20.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.839651+0000", 2020-11-12T17:23:20.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.549e-06 2020-11-12T17:23:20.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.839655+0000", 2020-11-12T17:23:20.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00042003800000000002 2020-11-12T17:23:20.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840075+0000", 2020-11-12T17:23:20.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.205e-05 2020-11-12T17:23:20.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840087+0000", 2020-11-12T17:23:20.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054700000000001 2020-11-12T17:23:20.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840218+0000", 2020-11-12T17:23:20.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.347542456 2020-11-12T17:23:20.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.277 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.278 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:6079 3.6 e25/20 3:68d7b676:::benchmark_data_smithi036_14212_object759:head v 25'439, mlcod=25'431)", 2020-11-12T17:23:20.278 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.972746+0000", 2020-11-12T17:23:20.279 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.8640237559999999, 2020-11-12T17:23:20.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124061067, 2020-11-12T17:23:20.279 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.280 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:20.280 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972746+0000", 2020-11-12T17:23:20.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972746+0000", 2020-11-12T17:23:20.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:20.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972716+0000", 2020-11-12T17:23:20.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2367999999999995e-05 2020-11-12T17:23:20.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972799+0000", 2020-11-12T17:23:20.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.119417204 2020-11-12T17:23:20.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092216+0000", 2020-11-12T17:23:20.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7179999999999999e-06 2020-11-12T17:23:20.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092223+0000", 2020-11-12T17:23:20.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8921999999999997e-05 2020-11-12T17:23:20.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092271+0000", 2020-11-12T17:23:20.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6675000000000001e-05 2020-11-12T17:23:20.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092298+0000", 2020-11-12T17:23:20.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044341149999999998 2020-11-12T17:23:20.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:20.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096732+0000", 2020-11-12T17:23:20.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4453e-05 2020-11-12T17:23:20.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096807+0000", 2020-11-12T17:23:20.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124061067 2020-11-12T17:23:20.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.294 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.294 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.295 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:6080 3.6 e25/20 3:68d7b676:::benchmark_data_smithi036_14212_object759:head v 25'440, mlcod=25'435)", 2020-11-12T17:23:20.295 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.976223+0000", 2020-11-12T17:23:20.295 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.8605465550000009, 2020-11-12T17:23:20.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.120637035, 2020-11-12T17:23:20.296 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.296 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:20.305 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976223+0000", 2020-11-12T17:23:20.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976223+0000", 2020-11-12T17:23:20.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:20.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976201+0000", 2020-11-12T17:23:20.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1339000000000002e-05 2020-11-12T17:23:20.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976282+0000", 2020-11-12T17:23:20.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.11703198400000001 2020-11-12T17:23:20.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093314+0000", 2020-11-12T17:23:20.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6599999999999995e-06 2020-11-12T17:23:20.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093322+0000", 2020-11-12T17:23:20.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1506000000000002e-05 2020-11-12T17:23:20.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093403+0000", 2020-11-12T17:23:20.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1201000000000002e-05 2020-11-12T17:23:20.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093435+0000", 2020-11-12T17:23:20.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033751010000000001 2020-11-12T17:23:20.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:20.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096810+0000", 2020-11-12T17:23:20.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0133000000000003e-05 2020-11-12T17:23:20.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096860+0000", 2020-11-12T17:23:20.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.120637035 2020-11-12T17:23:20.417 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.418 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.419 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.421 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:8928 3.4 e26/20 ondisk, result = 0)", 2020-11-12T17:23:20.421 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.548221+0000", 2020-11-12T17:23:20.422 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.2885488890000003, 2020-11-12T17:23:20.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23226502299999999, 2020-11-12T17:23:20.425 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.426 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:20.426 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548221+0000", 2020-11-12T17:23:20.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548221+0000", 2020-11-12T17:23:20.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:20.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548195+0000", 2020-11-12T17:23:20.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1903000000000006e-05 2020-11-12T17:23:20.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548267+0000", 2020-11-12T17:23:20.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.231938109 2020-11-12T17:23:20.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780205+0000", 2020-11-12T17:23:20.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9040000000000004e-06 2020-11-12T17:23:20.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780215+0000", 2020-11-12T17:23:20.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8253999999999998e-05 2020-11-12T17:23:20.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780313+0000", 2020-11-12T17:23:20.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2525e-05 2020-11-12T17:23:20.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780326+0000", 2020-11-12T17:23:20.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015992099999999999 2020-11-12T17:23:20.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780486+0000", 2020-11-12T17:23:20.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23226502299999999 2020-11-12T17:23:20.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.450 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.451 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9296 3.0 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:20.451 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.854608+0000", 2020-11-12T17:23:20.451 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.9821611519999998, 2020-11-12T17:23:20.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108252579, 2020-11-12T17:23:20.452 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.452 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:20.452 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:20.452 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:20.453 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:20.453 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9296 2020-11-12T17:23:20.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.453 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854608+0000", 2020-11-12T17:23:20.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854608+0000", 2020-11-12T17:23:20.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:20.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854580+0000", 2020-11-12T17:23:20.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2990000000000002e-05 2020-11-12T17:23:20.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854673+0000", 2020-11-12T17:23:20.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2016e-05 2020-11-12T17:23:20.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854685+0000", 2020-11-12T17:23:20.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1469999999999998e-06 2020-11-12T17:23:20.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854691+0000", 2020-11-12T17:23:20.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046110760000000004 2020-11-12T17:23:20.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859302+0000", 2020-11-12T17:23:20.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010799299999999999 2020-11-12T17:23:20.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859410+0000", 2020-11-12T17:23:20.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00038086199999999999 2020-11-12T17:23:20.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:20.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859791+0000", 2020-11-12T17:23:20.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049539120000000004 2020-11-12T17:23:20.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:20.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.864745+0000", 2020-11-12T17:23:20.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.097925522000000001 2020-11-12T17:23:20.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:20.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.962670+0000", 2020-11-12T17:23:20.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109441 2020-11-12T17:23:20.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:20.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.962780+0000", 2020-11-12T17:23:20.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1139999999999999e-05 2020-11-12T17:23:20.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.962861+0000", 2020-11-12T17:23:20.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108252579 2020-11-12T17:23:20.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.484 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.485 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9480 3.4 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:20.486 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.033933+0000", 2020-11-12T17:23:20.486 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.8028367750000003, 2020-11-12T17:23:20.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16844625499999999, 2020-11-12T17:23:20.486 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.487 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:20.487 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:20.487 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:20.488 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:20.488 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9480 2020-11-12T17:23:20.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.488 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033933+0000", 2020-11-12T17:23:20.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033933+0000", 2020-11-12T17:23:20.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:20.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033905+0000", 2020-11-12T17:23:20.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4893000000000003e-05 2020-11-12T17:23:20.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033980+0000", 2020-11-12T17:23:20.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.189e-05 2020-11-12T17:23:20.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033992+0000", 2020-11-12T17:23:20.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5068e-05 2020-11-12T17:23:20.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.034007+0000", 2020-11-12T17:23:20.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00522464 2020-11-12T17:23:20.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039232+0000", 2020-11-12T17:23:20.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013738800000000001 2020-11-12T17:23:20.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:20.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039369+0000", 2020-11-12T17:23:20.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024835999999999999 2020-11-12T17:23:20.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:20.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039618+0000", 2020-11-12T17:23:20.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018979000000000001 2020-11-12T17:23:20.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:20.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.041515+0000", 2020-11-12T17:23:20.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16076417100000001 2020-11-12T17:23:20.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:20.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.202280+0000", 2020-11-12T17:23:20.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0013999999999998e-05 2020-11-12T17:23:20.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:20.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.202340+0000", 2020-11-12T17:23:20.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9276000000000001e-05 2020-11-12T17:23:20.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.202379+0000", 2020-11-12T17:23:20.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16844625499999999 2020-11-12T17:23:20.505 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.505 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.506 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.507 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:12232 3.a e30/28)", 2020-11-12T17:23:20.507 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.604270+0000", 2020-11-12T17:23:20.507 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.232499316, 2020-11-12T17:23:20.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54940630099999999, 2020-11-12T17:23:20.508 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:20.508 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:23:20.508 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:20.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:20.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.604270+0000", 2020-11-12T17:23:20.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:20.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:20.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.604270+0000", 2020-11-12T17:23:20.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:23:20.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:20.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.604241+0000", 2020-11-12T17:23:20.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1444000000000002e-05 2020-11-12T17:23:20.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:20.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.604313+0000", 2020-11-12T17:23:20.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54908786600000004 2020-11-12T17:23:20.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:20.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:19.153400+0000", 2020-11-12T17:23:20.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4346e-05 2020-11-12T17:23:20.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:20.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:19.153415+0000", 2020-11-12T17:23:20.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000216329 2020-11-12T17:23:20.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:20.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:19.153631+0000", 2020-11-12T17:23:20.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5260999999999999e-05 2020-11-12T17:23:20.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:20.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:19.153676+0000", 2020-11-12T17:23:20.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54940630099999999 2020-11-12T17:23:20.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.517 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.518 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:20.519 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:20.521 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:23:20.521 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:20.521 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 32, 2020-11-12T17:23:20.521 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:23:20.521 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2020-11-12T17:22:37.581394+0000", 2020-11-12T17:23:20.522 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2020-11-12T17:23:19.655475+0000", 2020-11-12T17:23:20.522 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2020-11-12T17:22:45.562766+0000", 2020-11-12T17:23:20.522 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2020-11-12T17:23:14.593944+0000", 2020-11-12T17:23:20.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-12T17:23:20.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5806080, 2020-11-12T17:23:20.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2020-11-12T17:23:20.522 INFO:teuthology.orchestra.run.smithi036.stdout: "nodeep-scrub", 2020-11-12T17:23:20.523 INFO:teuthology.orchestra.run.smithi036.stdout: "noscrub", 2020-11-12T17:23:20.523 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2020-11-12T17:23:20.523 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2020-11-12T17:23:20.523 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2020-11-12T17:23:20.523 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2020-11-12T17:23:20.523 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:20.523 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 4, 2020-11-12T17:23:20.524 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2020-11-12T17:23:20.524 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-12T17:23:20.524 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-12T17:23:20.524 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2020-11-12T17:23:20.524 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 3, 2020-11-12T17:23:20.524 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2020-11-12T17:23:20.524 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2020-11-12T17:23:20.525 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2020-11-12T17:23:20.525 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2020-11-12T17:23:20.525 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2020-11-12T17:23:20.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.525 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2020-11-12T17:23:20.525 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2020-11-12T17:23:20.525 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:41.596657+0000", 2020-11-12T17:23:20.526 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:23:20.526 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:23:20.526 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:23:20.526 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:23:20.526 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:23:20.526 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:23:20.527 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:23:20.527 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:23:20.527 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2020-11-12T17:23:20.527 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2020-11-12T17:23:20.527 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2020-11-12T17:23:20.527 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2020-11-12T17:23:20.527 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2020-11-12T17:23:20.528 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:23:20.528 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:23:20.528 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:23:20.528 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:23:20.528 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:23:20.528 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:23:20.528 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:23:20.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.529 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "16", 2020-11-12T17:23:20.529 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:23:20.529 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:23:20.529 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:23:20.529 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:23:20.529 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:23:20.529 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:23:20.530 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:23:20.530 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:23:20.530 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:23:20.530 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:23:20.530 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:23:20.530 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:23:20.531 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:23:20.531 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:23:20.531 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:23:20.531 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:23:20.531 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:23:20.531 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:23:20.531 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:23:20.531 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:23:20.532 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:23:20.532 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:23:20.532 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:23:20.532 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:23:20.532 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:23:20.532 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:23:20.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.533 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:23:20.533 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:23:20.533 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:23:20.533 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:23:20.533 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:23:20.533 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:23:20.533 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:23:20.534 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:23:20.534 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:23:20.534 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:23:20.534 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:23:20.534 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2020-11-12T17:23:20.534 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2020-11-12T17:23:20.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.535 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:23:20.535 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2020-11-12T17:23:20.535 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.535 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2020-11-12T17:23:20.535 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2020-11-12T17:23:20.536 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:49.905816+0000", 2020-11-12T17:23:20.536 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:23:20.536 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:23:20.536 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:23:20.536 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:23:20.536 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:23:20.536 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:23:20.536 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:23:20.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:23:20.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2020-11-12T17:23:20.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2020-11-12T17:23:20.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2020-11-12T17:23:20.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2020-11-12T17:23:20.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2020-11-12T17:23:20.537 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:23:20.538 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:23:20.538 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:23:20.538 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:23:20.538 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:23:20.538 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:23:20.538 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:23:20.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.539 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "19", 2020-11-12T17:23:20.539 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:23:20.539 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:23:20.539 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:23:20.539 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:23:20.539 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:23:20.539 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:23:20.540 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:23:20.540 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:23:20.540 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:23:20.540 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:23:20.540 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:23:20.540 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:23:20.540 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:23:20.540 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:23:20.541 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:23:20.541 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:23:20.541 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:23:20.541 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:23:20.541 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:23:20.541 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:23:20.541 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:23:20.541 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:23:20.542 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:23:20.542 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:23:20.542 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:23:20.542 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:23:20.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.542 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:23:20.542 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:23:20.543 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:23:20.543 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:23:20.543 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:23:20.543 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:23:20.543 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:23:20.543 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:23:20.543 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:23:20.544 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:23:20.544 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:23:20.544 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:23:20.544 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:23:20.544 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2020-11-12T17:23:20.544 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.545 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 3, 2020-11-12T17:23:20.545 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "unique_pool_0", 2020-11-12T17:23:20.545 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:23:01.837897+0000", 2020-11-12T17:23:20.545 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:23:20.545 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:23:20.545 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:23:20.546 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:23:20.546 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:23:20.546 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:23:20.546 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:23:20.546 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:23:20.546 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 16, 2020-11-12T17:23:20.546 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 16, 2020-11-12T17:23:20.547 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 16, 2020-11-12T17:23:20.547 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 16, 2020-11-12T17:23:20.547 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 16, 2020-11-12T17:23:20.547 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:23:20.547 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:23:20.547 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:23:20.547 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:23:20.548 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:23:20.548 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:23:20.548 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:23:20.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.548 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "22", 2020-11-12T17:23:20.548 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:23:20.548 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:23:20.549 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:23:20.549 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:23:20.549 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:23:20.549 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:23:20.549 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:23:20.549 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:23:20.549 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:23:20.549 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:23:20.550 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:23:20.550 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:23:20.550 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:23:20.550 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:23:20.550 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:23:20.550 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:23:20.550 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:23:20.551 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:23:20.551 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:23:20.551 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:23:20.551 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:23:20.551 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:23:20.551 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:23:20.551 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:23:20.552 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:23:20.552 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:23:20.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.552 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:23:20.552 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:23:20.552 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:23:20.552 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:23:20.553 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:23:20.553 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:23:20.553 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:23:20.553 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:23:20.553 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:23:20.553 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:23:20.553 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:23:20.554 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:23:20.554 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:23:20.554 INFO:teuthology.orchestra.run.smithi036.stdout: "rados": {} 2020-11-12T17:23:20.554 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.554 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.554 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:20.554 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2020-11-12T17:23:20.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.555 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:23:20.555 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "bd1d5457-5d54-4074-b378-9da417f42976", 2020-11-12T17:23:20.555 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:23:20.555 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:23:20.555 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:23:20.555 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:23:20.556 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:23:20.556 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:23:20.556 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:23:20.556 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 20, 2020-11-12T17:23:20.556 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:23:20.556 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:23:20.556 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:23:20.557 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.557 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.557 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6801", 2020-11-12T17:23:20.557 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:23:20.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.557 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.558 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:23:20.558 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.558 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2020-11-12T17:23:20.558 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:23:20.559 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.559 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.559 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:23:20.559 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.559 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.560 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2020-11-12T17:23:20.560 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:23:20.560 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.560 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.560 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:23:20.560 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2020-11-12T17:23:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:23:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6801/12304", 2020-11-12T17:23:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6802/12304", 2020-11-12T17:23:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6806/12304", 2020-11-12T17:23:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6804/12304", 2020-11-12T17:23:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:23:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:23:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:23:20.563 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.563 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:23:20.563 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "37152eee-a8d8-40f1-8e27-2899e7b94c98", 2020-11-12T17:23:20.563 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:23:20.564 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:23:20.569 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:23:20.570 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:23:20.570 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:23:20.570 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:23:20.570 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:23:20.571 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 30, 2020-11-12T17:23:20.571 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:23:20.571 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:23:20.571 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:23:20.571 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.572 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.572 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2020-11-12T17:23:20.572 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12307 2020-11-12T17:23:20.572 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.573 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.573 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:23:20.573 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.573 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.574 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2020-11-12T17:23:20.574 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12307 2020-11-12T17:23:20.574 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.574 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.574 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:23:20.575 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.575 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.575 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2020-11-12T17:23:20.575 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12307 2020-11-12T17:23:20.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.575 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.576 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:23:20.576 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.576 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.576 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2020-11-12T17:23:20.577 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12307 2020-11-12T17:23:20.577 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.577 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.577 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/12307", 2020-11-12T17:23:20.577 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6814/12307", 2020-11-12T17:23:20.577 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6816/12307", 2020-11-12T17:23:20.578 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6815/12307", 2020-11-12T17:23:20.578 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:23:20.578 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:23:20.578 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:23:20.578 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.579 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:23:20.579 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "d8ec2abb-38bf-4863-969a-482c4fa44f41", 2020-11-12T17:23:20.579 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:23:20.579 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:23:20.579 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:23:20.579 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:23:20.580 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:23:20.580 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:23:20.580 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:23:20.580 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 17, 2020-11-12T17:23:20.581 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:23:20.581 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:23:20.581 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:23:20.581 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.581 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.581 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2020-11-12T17:23:20.582 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12306 2020-11-12T17:23:20.582 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.582 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.582 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:23:20.582 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.583 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.583 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2020-11-12T17:23:20.583 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12306 2020-11-12T17:23:20.583 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.583 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.583 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:23:20.584 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.584 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.584 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2020-11-12T17:23:20.584 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12306 2020-11-12T17:23:20.584 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.584 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.585 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:23:20.585 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.585 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.586 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2020-11-12T17:23:20.587 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12306 2020-11-12T17:23:20.587 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.587 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.587 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/12306", 2020-11-12T17:23:20.587 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/12306", 2020-11-12T17:23:20.588 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6808/12306", 2020-11-12T17:23:20.588 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/12306", 2020-11-12T17:23:20.588 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:23:20.588 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:23:20.588 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:23:20.588 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.589 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:23:20.589 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "799d3499-577c-4510-a00c-9b2e126fc449", 2020-11-12T17:23:20.589 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:23:20.589 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:23:20.589 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:23:20.589 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:23:20.590 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:23:20.590 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:23:20.590 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:23:20.590 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 20, 2020-11-12T17:23:20.590 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:23:20.590 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:23:20.590 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:23:20.591 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.591 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.591 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2020-11-12T17:23:20.591 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:23:20.591 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.591 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.592 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:23:20.592 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.592 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.592 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2020-11-12T17:23:20.592 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:23:20.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.593 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.593 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:23:20.593 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.593 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.594 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2020-11-12T17:23:20.594 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:23:20.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.594 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.594 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:23:20.595 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.595 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.595 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2020-11-12T17:23:20.595 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:23:20.595 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.595 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.596 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6809/12305", 2020-11-12T17:23:20.596 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6810/12305", 2020-11-12T17:23:20.596 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6813/12305", 2020-11-12T17:23:20.596 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6811/12305", 2020-11-12T17:23:20.596 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:23:20.596 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:23:20.597 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:23:20.597 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.597 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:23:20.597 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "c36e3100-aadc-4117-b495-24fb08a34148", 2020-11-12T17:23:20.597 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:23:20.598 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:23:20.598 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:23:20.598 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:23:20.598 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:23:20.598 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:23:20.598 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:23:20.599 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 24, 2020-11-12T17:23:20.599 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:23:20.599 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:23:20.599 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:23:20.599 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.599 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.600 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6804", 2020-11-12T17:23:20.600 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:23:20.600 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.600 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.600 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:23:20.600 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.601 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.601 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6805", 2020-11-12T17:23:20.601 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:23:20.601 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.601 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.601 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:23:20.602 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.602 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.602 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6807", 2020-11-12T17:23:20.602 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:23:20.602 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.603 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.603 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:23:20.603 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.603 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.603 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6806", 2020-11-12T17:23:20.604 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:23:20.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.604 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.604 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6804/12499", 2020-11-12T17:23:20.604 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6805/12499", 2020-11-12T17:23:20.604 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6807/12499", 2020-11-12T17:23:20.605 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6806/12499", 2020-11-12T17:23:20.605 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:23:20.605 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:23:20.605 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:23:20.605 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.605 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:23:20.606 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "b152141f-b530-448e-8dff-fe200559eff0", 2020-11-12T17:23:20.606 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:23:20.606 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:23:20.606 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:23:20.606 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:23:20.606 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:23:20.607 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:23:20.607 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:23:20.607 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 20, 2020-11-12T17:23:20.607 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:23:20.607 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:23:20.607 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:23:20.607 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.608 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.608 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6808", 2020-11-12T17:23:20.608 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:23:20.608 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.608 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.608 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:23:20.609 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.609 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.609 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6810", 2020-11-12T17:23:20.610 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:23:20.610 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.610 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.610 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:23:20.610 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.611 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.611 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6814", 2020-11-12T17:23:20.611 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:23:20.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.611 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.611 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:23:20.612 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.612 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6812", 2020-11-12T17:23:20.612 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:23:20.612 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.612 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.613 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6808/12525", 2020-11-12T17:23:20.613 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6810/12525", 2020-11-12T17:23:20.613 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6814/12525", 2020-11-12T17:23:20.613 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6812/12525", 2020-11-12T17:23:20.613 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:23:20.613 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:23:20.614 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:23:20.614 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.614 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:23:20.614 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "62a140ba-7f94-4bb6-8a62-fda077f81354", 2020-11-12T17:23:20.614 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:23:20.615 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:23:20.615 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:23:20.615 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:23:20.615 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:23:20.615 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:23:20.615 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:23:20.615 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 31, 2020-11-12T17:23:20.616 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:23:20.616 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:23:20.616 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:23:20.616 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.616 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.616 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6809", 2020-11-12T17:23:20.617 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:23:20.617 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.617 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.617 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:23:20.617 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.618 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.618 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6811", 2020-11-12T17:23:20.618 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:23:20.618 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.618 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.619 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:23:20.619 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.619 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.619 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6815", 2020-11-12T17:23:20.619 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:23:20.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.620 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.620 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:23:20.620 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.620 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.620 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6813", 2020-11-12T17:23:20.621 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:23:20.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.621 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.621 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6809/12524", 2020-11-12T17:23:20.621 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6811/12524", 2020-11-12T17:23:20.621 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6815/12524", 2020-11-12T17:23:20.621 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6813/12524", 2020-11-12T17:23:20.622 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:23:20.622 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:23:20.622 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:23:20.622 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.622 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:23:20.623 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "32879bd7-780c-4da6-9838-5850b6277902", 2020-11-12T17:23:20.623 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:23:20.623 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:23:20.623 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:23:20.623 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:23:20.623 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:23:20.624 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:23:20.624 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:23:20.624 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 24, 2020-11-12T17:23:20.624 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:23:20.624 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:23:20.624 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:23:20.624 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.625 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.625 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6800", 2020-11-12T17:23:20.625 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:23:20.625 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.625 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.626 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:23:20.626 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.626 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.626 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6801", 2020-11-12T17:23:20.626 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:23:20.627 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.627 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.627 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:23:20.627 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.628 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.628 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6803", 2020-11-12T17:23:20.628 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:23:20.628 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.628 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.628 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:23:20.629 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:23:20.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.629 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:23:20.629 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6802", 2020-11-12T17:23:20.629 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:23:20.629 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.629 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.630 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6800/12522", 2020-11-12T17:23:20.630 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6801/12522", 2020-11-12T17:23:20.631 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6803/12522", 2020-11-12T17:23:20.631 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6802/12522", 2020-11-12T17:23:20.631 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:23:20.631 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:23:20.631 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:23:20.631 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:20.632 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.632 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:20.632 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2020-11-12T17:23:20.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.632 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:23:20.632 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:23:20.633 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:23:20.633 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:23:20.633 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:23:20.633 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:23:20.633 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:22:44.153580+0000", 2020-11-12T17:23:20.633 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:23:20.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.634 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:23:20.634 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:23:20.634 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:23:20.634 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:23:20.634 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:23:20.634 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:23:20.635 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:22:44.206830+0000", 2020-11-12T17:23:20.635 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:23:20.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.635 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:23:20.635 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:23:20.635 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:23:20.636 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:23:20.636 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:23:20.636 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:23:20.636 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:22:44.143040+0000", 2020-11-12T17:23:20.636 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:23:20.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.636 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:23:20.637 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:23:20.637 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:23:20.637 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:23:20.637 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:23:20.637 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:23:20.639 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:22:44.205663+0000", 2020-11-12T17:23:20.639 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:23:20.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.639 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:23:20.639 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:23:20.640 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:23:20.640 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:23:20.640 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:23:20.640 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:23:20.640 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:22:44.139983+0000", 2020-11-12T17:23:20.640 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:23:20.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.643 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:23:20.643 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:23:20.643 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:23:20.644 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:23:20.644 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:23:20.644 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:23:20.645 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:22:44.167307+0000", 2020-11-12T17:23:20.645 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:23:20.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.646 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:23:20.646 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:23:20.646 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:23:20.647 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:23:20.647 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:23:20.647 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:23:20.648 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:22:44.198025+0000", 2020-11-12T17:23:20.648 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:23:20.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:20.648 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:23:20.648 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:23:20.648 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:23:20.649 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:23:20.649 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:23:20.649 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:23:20.649 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:22:43.935482+0000", 2020-11-12T17:23:20.649 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:23:20.649 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.649 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:20.650 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2020-11-12T17:23:20.650 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2020-11-12T17:23:20.650 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2020-11-12T17:23:20.650 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2020-11-12T17:23:20.651 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2020-11-12T17:23:20.652 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2020-11-12T17:23:20.652 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2020-11-12T17:23:20.652 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2020-11-12T17:23:20.653 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2020-11-12T17:23:20.653 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2020-11-12T17:23:20.653 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2020-11-12T17:23:20.654 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2020-11-12T17:23:20.654 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2020-11-12T17:23:20.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:20.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:20.655 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2020-11-12T17:23:20.655 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2020-11-12T17:23:20.655 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2020-11-12T17:23:20.655 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2020-11-12T17:23:20.656 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2020-11-12T17:23:20.656 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:20.657 INFO:tasks.thrashosds.thrasher:j is {'epoch': 32, 'fsid': '8c8a6bcc-49d4-47d1-904f-e20798ef8e1f', 'created': '2020-11-12T17:22:37.581394+0000', 'modified': '2020-11-12T17:23:19.655475+0000', 'last_up_change': '2020-11-12T17:22:45.562766+0000', 'last_in_change': '2020-11-12T17:23:14.593944+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'unique_pool_0', 'create_time': '2020-11-12T17:23:01.837897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'bd1d5457-5d54-4074-b378-9da417f42976', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6801', 'nonce': 12304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6802', 'nonce': 12304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6806', 'nonce': 12304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6804', 'nonce': 12304}]}, 'public_addr': '172.21.15.36:6801/12304', 'cluster_addr': '172.21.15.36:6802/12304', 'heartbeat_back_addr': '172.21.15.36:6806/12304', 'heartbeat_front_addr': '172.21.15.36:6804/12304', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '37152eee-a8d8-40f1-8e27-2899e7b94c98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6812', 'nonce': 12307}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6814', 'nonce': 12307}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6816', 'nonce': 12307}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6815', 'nonce': 12307}]}, 'public_addr': '172.21.15.36:6812/12307', 'cluster_addr': '172.21.15.36:6814/12307', 'heartbeat_back_addr': '172.21.15.36:6816/12307', 'heartbeat_front_addr': '172.21.15.36:6815/12307', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd8ec2abb-38bf-4863-969a-482c4fa44f41', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6803', 'nonce': 12306}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6805', 'nonce': 12306}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6808', 'nonce': 12306}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6807', 'nonce': 12306}]}, 'public_addr': '172.21.15.36:6803/12306', 'cluster_addr': '172.21.15.36:6805/12306', 'heartbeat_back_addr': '172.21.15.36:6808/12306', 'heartbeat_front_addr': '172.21.15.36:6807/12306', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '799d3499-577c-4510-a00c-9b2e126fc449', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6809', 'nonce': 12305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6810', 'nonce': 12305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6813', 'nonce': 12305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6811', 'nonce': 12305}]}, 'public_addr': '172.21.15.36:6809/12305', 'cluster_addr': '172.21.15.36:6810/12305', 'heartbeat_back_addr': '172.21.15.36:6813/12305', 'heartbeat_front_addr': '172.21.15.36:6811/12305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c36e3100-aadc-4117-b495-24fb08a34148', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6804', 'nonce': 12499}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6805', 'nonce': 12499}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6807', 'nonce': 12499}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6806', 'nonce': 12499}]}, 'public_addr': '172.21.15.205:6804/12499', 'cluster_addr': '172.21.15.205:6805/12499', 'heartbeat_back_addr': '172.21.15.205:6807/12499', 'heartbeat_front_addr': '172.21.15.205:6806/12499', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b152141f-b530-448e-8dff-fe200559eff0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6808', 'nonce': 12525}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6810', 'nonce': 12525}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6814', 'nonce': 12525}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6812', 'nonce': 12525}]}, 'public_addr': '172.21.15.205:6808/12525', 'cluster_addr': '172.21.15.205:6810/12525', 'heartbeat_back_addr': '172.21.15.205:6814/12525', 'heartbeat_front_addr': '172.21.15.205:6812/12525', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '62a140ba-7f94-4bb6-8a62-fda077f81354', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6809', 'nonce': 12524}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6811', 'nonce': 12524}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6815', 'nonce': 12524}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6813', 'nonce': 12524}]}, 'public_addr': '172.21.15.205:6809/12524', 'cluster_addr': '172.21.15.205:6811/12524', 'heartbeat_back_addr': '172.21.15.205:6815/12524', 'heartbeat_front_addr': '172.21.15.205:6813/12524', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '32879bd7-780c-4da6-9838-5850b6277902', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6800', 'nonce': 12522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6801', 'nonce': 12522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6803', 'nonce': 12522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6802', 'nonce': 12522}]}, 'public_addr': '172.21.15.205:6800/12522', 'cluster_addr': '172.21.15.205:6801/12522', 'heartbeat_back_addr': '172.21.15.205:6803/12522', 'heartbeat_front_addr': '172.21.15.205:6802/12522', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:22:44.153580+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:22:44.206830+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:22:44.143040+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:22:44.205663+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:22:44.139983+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:22:44.167307+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:22:44.198025+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:22:43.935482+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-11-12T17:23:20.657 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2020-11-12T17:23:20.659 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:20.512+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:20.660 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 16 16 12711 12695 6.19817 0 - 0.0181662 2020-11-12T17:23:20.662 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:20.656+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:20.706 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:23:20.762 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:20.760+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:20.765 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:20.776 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:20.776 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:20.776 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:20.776 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:20.786 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:20.877 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:20.872+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:20.916 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:20.945 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:21.048 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:21.049 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:21.049 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:21.049 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:21.051 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:21.052 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:21.053 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:21.053 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:21.053 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:21.048+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:21.054 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:21.071 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:21.106 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:21.151 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:21.152 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:21.152+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:21.153 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:21.154 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:21.154 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:21.154 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:21.154 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:21.155 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:21.155 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:21.155 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:21.205 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:21.206 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:21.215 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:21.253 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:21.251+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:21.354 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:21.348+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:21.369 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:21.370 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:21.379 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:21.455 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:21.451+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:21.533 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:21.533 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:21.543 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:21.564 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 17 16 12711 12695 5.83356 0 - 0.0181662 2020-11-12T17:23:21.564 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:21.556+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:21.648 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:21.648 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:21.659 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:21.660 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:21.652+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:21.759 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:21.755+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:21.783 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:21.784 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:21.795 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:21.859 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:21.852+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:21.944 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:21.945 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:21.955 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:22.000 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:21.999+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:22.068 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:22.068 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:22.068 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:22.063+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:22.078 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:22.169 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:22.167+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:22.228 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:22.228 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:22.237 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:22.281 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:22.279+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:22.372 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:22.368+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:22.394 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:22.407 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:22.409 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:22.473 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:22.468+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:22.516 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:22.516 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:22.526 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:22.564 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 18 16 12711 12695 5.50946 0 - 0.0181662 2020-11-12T17:23:22.593 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:22.588+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:22.642 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:22.643 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:22.645 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:22.694 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:22.691+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:22.721 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:23:22.753 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:22.753 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:22.763 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:22.795 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:22.788+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:22.896 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:22.888+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:22.914 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:22.915 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:22.924 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:22.997 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:22.992+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:23.039 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:23.039 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:23.048 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:23.097 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:23.095+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:23.155 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:23.163 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:23.165 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:23.170 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:23.210 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:23.206+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:23.300 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:23.292+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:23.330 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:23.330 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:23.337 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:23.399 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:23.399 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:23.400 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:23.401 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:23.396+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:23.426 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:23.455 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:23.484 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:23.502 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:23.496+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:23.524 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:23.524 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:23.525 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:23.526 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:23.550 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:23.552 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:23.553 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:23.553 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:23.553 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:23.553 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:23.553 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:23.553 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:23.553 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:23.564 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 19 16 12711 12695 5.21948 0 - 0.0181662 2020-11-12T17:23:23.603 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:23.602+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:23.656 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:23.657 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:23.657 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:23.657 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:23.657 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:23.666 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:23.711 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:23.704+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:23.715 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:23:23.805 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:23.802+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:23.814 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:23.814 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:23.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:23.815 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:23.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.815 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:254 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.815 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:23.815 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.068921484000001, 2020-11-12T17:23:23.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023, 2020-11-12T17:23:23.816 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.816 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.816 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.816 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.816 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.816 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 254 2020-11-12T17:23:23.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.817 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:23.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741522+0000", 2020-11-12T17:23:23.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:23.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741501+0000", 2020-11-12T17:23:23.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8440000000000002e-05 2020-11-12T17:23:23.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741570+0000", 2020-11-12T17:23:23.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4515000000000001e-05 2020-11-12T17:23:23.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741584+0000", 2020-11-12T17:23:23.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5699999999999998e-06 2020-11-12T17:23:23.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.741591+0000", 2020-11-12T17:23:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033344310000000001 2020-11-12T17:23:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744925+0000", 2020-11-12T17:23:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011066 2020-11-12T17:23:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745036+0000", 2020-11-12T17:23:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015032199999999999 2020-11-12T17:23:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745186+0000", 2020-11-12T17:23:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020296229999999999 2020-11-12T17:23:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747216+0000", 2020-11-12T17:23:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21356234399999999 2020-11-12T17:23:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960778+0000", 2020-11-12T17:23:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011052000000000001 2020-11-12T17:23:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.960889+0000", 2020-11-12T17:23:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014397999999999999 2020-11-12T17:23:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961033+0000", 2020-11-12T17:23:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.219511023 2020-11-12T17:23:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:255 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.066353653, 2020-11-12T17:23:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286, 2020-11-12T17:23:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 255 2020-11-12T17:23:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744090+0000", 2020-11-12T17:23:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744038+0000", 2020-11-12T17:23:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000142953 2020-11-12T17:23:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744181+0000", 2020-11-12T17:23:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4383999999999999e-05 2020-11-12T17:23:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744206+0000", 2020-11-12T17:23:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0786e-05 2020-11-12T17:23:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.744217+0000", 2020-11-12T17:23:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001465002 2020-11-12T17:23:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745682+0000", 2020-11-12T17:23:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000126458 2020-11-12T17:23:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745808+0000", 2020-11-12T17:23:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000164413 2020-11-12T17:23:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745972+0000", 2020-11-12T17:23:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019412520000000001 2020-11-12T17:23:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747914+0000", 2020-11-12T17:23:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.213271294 2020-11-12T17:23:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961185+0000", 2020-11-12T17:23:23.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001472 2020-11-12T17:23:23.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961332+0000", 2020-11-12T17:23:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108687 2020-11-12T17:23:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.961441+0000", 2020-11-12T17:23:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.217351286 2020-11-12T17:23:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:256 3.1 3:839ceda0:::benchmark_data_smithi036_14212_object31:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.064742968000001, 2020-11-12T17:23:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001, 2020-11-12T17:23:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 256 2020-11-12T17:23:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:23.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745700+0000", 2020-11-12T17:23:23.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:23.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745651+0000", 2020-11-12T17:23:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000140753 2020-11-12T17:23:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745792+0000", 2020-11-12T17:23:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3481e-05 2020-11-12T17:23:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745806+0000", 2020-11-12T17:23:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8069999999999999e-06 2020-11-12T17:23:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.745810+0000", 2020-11-12T17:23:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001457563 2020-11-12T17:23:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747268+0000", 2020-11-12T17:23:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116141 2020-11-12T17:23:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747384+0000", 2020-11-12T17:23:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013822899999999999 2020-11-12T17:23:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.747522+0000", 2020-11-12T17:23:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079223100000000001 2020-11-12T17:23:23.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.748315+0000", 2020-11-12T17:23:23.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21734695200000001 2020-11-12T17:23:23.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965662+0000", 2020-11-12T17:23:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011252999999999999 2020-11-12T17:23:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965774+0000", 2020-11-12T17:23:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015996700000000001 2020-11-12T17:23:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.965934+0000", 2020-11-12T17:23:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22023374700000001 2020-11-12T17:23:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:337 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.001607371999999, 2020-11-12T17:23:23.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089, 2020-11-12T17:23:23.854 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.854 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.855 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 337 2020-11-12T17:23:23.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.855 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:23.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808836+0000", 2020-11-12T17:23:23.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:23.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808793+0000", 2020-11-12T17:23:23.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012736400000000001 2020-11-12T17:23:23.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808920+0000", 2020-11-12T17:23:23.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7972e-05 2020-11-12T17:23:23.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808938+0000", 2020-11-12T17:23:23.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5259999999999999e-06 2020-11-12T17:23:23.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808948+0000", 2020-11-12T17:23:23.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3725000000000001e-05 2020-11-12T17:23:23.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809041+0000", 2020-11-12T17:23:23.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026396500000000001 2020-11-12T17:23:23.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809305+0000", 2020-11-12T17:23:23.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000287686 2020-11-12T17:23:23.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809593+0000", 2020-11-12T17:23:23.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049805869999999999 2020-11-12T17:23:23.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814574+0000", 2020-11-12T17:23:23.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151510007 2020-11-12T17:23:23.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966084+0000", 2020-11-12T17:23:23.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110937 2020-11-12T17:23:23.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966195+0000", 2020-11-12T17:23:23.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5339999999999994e-05 2020-11-12T17:23:23.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.966270+0000", 2020-11-12T17:23:23.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157434089 2020-11-12T17:23:23.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.876 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.876 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:338 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.877 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:23.877 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.001384535, 2020-11-12T17:23:23.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999, 2020-11-12T17:23:23.877 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.877 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.878 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.878 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 338 2020-11-12T17:23:23.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.878 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:23.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809059+0000", 2020-11-12T17:23:23.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:23:23.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809008+0000", 2020-11-12T17:23:23.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000123659 2020-11-12T17:23:23.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809131+0000", 2020-11-12T17:23:23.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4180000000000003e-06 2020-11-12T17:23:23.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809141+0000", 2020-11-12T17:23:23.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2680000000000002e-06 2020-11-12T17:23:23.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809146+0000", 2020-11-12T17:23:23.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011238120000000001 2020-11-12T17:23:23.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810270+0000", 2020-11-12T17:23:23.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9084000000000003e-05 2020-11-12T17:23:23.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810359+0000", 2020-11-12T17:23:23.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186856 2020-11-12T17:23:23.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810546+0000", 2020-11-12T17:23:23.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040397699999999998 2020-11-12T17:23:23.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814586+0000", 2020-11-12T17:23:23.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15495921400000001 2020-11-12T17:23:23.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969545+0000", 2020-11-12T17:23:23.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012353700000000001 2020-11-12T17:23:23.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969668+0000", 2020-11-12T17:23:23.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013906300000000001 2020-11-12T17:23:23.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969807+0000", 2020-11-12T17:23:23.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16074860399999999 2020-11-12T17:23:23.888 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.889 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.889 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.889 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:339 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.889 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:23.889 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.001247638999999, 2020-11-12T17:23:23.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999, 2020-11-12T17:23:23.890 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.890 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.890 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.890 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.890 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.890 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 339 2020-11-12T17:23:23.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.891 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:23.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809196+0000", 2020-11-12T17:23:23.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:23.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809174+0000", 2020-11-12T17:23:23.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4807000000000005e-05 2020-11-12T17:23:23.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809238+0000", 2020-11-12T17:23:23.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2660000000000001e-06 2020-11-12T17:23:23.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809247+0000", 2020-11-12T17:23:23.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1060000000000002e-06 2020-11-12T17:23:23.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809251+0000", 2020-11-12T17:23:23.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001789286 2020-11-12T17:23:23.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811040+0000", 2020-11-12T17:23:23.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013621 2020-11-12T17:23:23.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811176+0000", 2020-11-12T17:23:23.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023835800000000001 2020-11-12T17:23:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811415+0000", 2020-11-12T17:23:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031774529999999998 2020-11-12T17:23:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814592+0000", 2020-11-12T17:23:23.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15532954199999999 2020-11-12T17:23:23.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.969922+0000", 2020-11-12T17:23:23.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021167000000000001 2020-11-12T17:23:23.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970133+0000", 2020-11-12T17:23:23.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7349999999999995e-05 2020-11-12T17:23:23.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970231+0000", 2020-11-12T17:23:23.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103509499999999 2020-11-12T17:23:23.900 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.900 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.901 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.901 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:340 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.901 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:23.901 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.000715530000001, 2020-11-12T17:23:23.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999, 2020-11-12T17:23:23.902 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.902 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.902 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.902 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.902 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.902 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 340 2020-11-12T17:23:23.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.903 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:23.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809728+0000", 2020-11-12T17:23:23.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999958 2020-11-12T17:23:23.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809686+0000", 2020-11-12T17:23:23.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9798999999999999e-05 2020-11-12T17:23:23.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809776+0000", 2020-11-12T17:23:23.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2833999999999999e-05 2020-11-12T17:23:23.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809788+0000", 2020-11-12T17:23:23.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-06 2020-11-12T17:23:23.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809794+0000", 2020-11-12T17:23:23.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020989979999999999 2020-11-12T17:23:23.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811893+0000", 2020-11-12T17:23:23.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012502300000000001 2020-11-12T17:23:23.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812018+0000", 2020-11-12T17:23:23.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013605900000000001 2020-11-12T17:23:23.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812154+0000", 2020-11-12T17:23:23.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003821344 2020-11-12T17:23:23.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815975+0000", 2020-11-12T17:23:23.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15447417999999999 2020-11-12T17:23:23.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970449+0000", 2020-11-12T17:23:23.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2955999999999997e-05 2020-11-12T17:23:23.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970532+0000", 2020-11-12T17:23:23.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6341999999999998e-05 2020-11-12T17:23:23.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970578+0000", 2020-11-12T17:23:23.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16085068399999999 2020-11-12T17:23:23.912 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.912 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.913 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.913 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:341 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.913 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:23.914 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.000591953000001, 2020-11-12T17:23:23.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999, 2020-11-12T17:23:23.914 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.914 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.914 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.914 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.914 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.915 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 341 2020-11-12T17:23:23.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.915 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:23.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809851+0000", 2020-11-12T17:23:23.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:23:23.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809810+0000", 2020-11-12T17:23:23.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129682 2020-11-12T17:23:23.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809940+0000", 2020-11-12T17:23:23.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2874000000000002e-05 2020-11-12T17:23:23.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809963+0000", 2020-11-12T17:23:23.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8199999999999997e-06 2020-11-12T17:23:23.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.809971+0000", 2020-11-12T17:23:23.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026854119999999999 2020-11-12T17:23:23.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812656+0000", 2020-11-12T17:23:23.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000136685 2020-11-12T17:23:23.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812793+0000", 2020-11-12T17:23:23.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000267831 2020-11-12T17:23:23.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813061+0000", 2020-11-12T17:23:23.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029210490000000002 2020-11-12T17:23:23.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815982+0000", 2020-11-12T17:23:23.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15468012 2020-11-12T17:23:23.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970662+0000", 2020-11-12T17:23:23.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111106 2020-11-12T17:23:23.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970773+0000", 2020-11-12T17:23:23.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111366 2020-11-12T17:23:23.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.970884+0000", 2020-11-12T17:23:23.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16103288499999999 2020-11-12T17:23:23.924 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.924 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.925 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.925 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:342 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.925 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:23.925 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.000415931999999, 2020-11-12T17:23:23.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999, 2020-11-12T17:23:23.926 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.926 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.926 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.926 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.926 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.926 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 342 2020-11-12T17:23:23.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.927 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:23.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810027+0000", 2020-11-12T17:23:23.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:23.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810002+0000", 2020-11-12T17:23:23.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0510000000000001e-05 2020-11-12T17:23:23.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810072+0000", 2020-11-12T17:23:23.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9950000000000005e-06 2020-11-12T17:23:23.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810080+0000", 2020-11-12T17:23:23.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0779999999999997e-06 2020-11-12T17:23:23.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810084+0000", 2020-11-12T17:23:23.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003443944 2020-11-12T17:23:23.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813528+0000", 2020-11-12T17:23:23.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010784 2020-11-12T17:23:23.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813636+0000", 2020-11-12T17:23:23.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019826199999999999 2020-11-12T17:23:23.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813834+0000", 2020-11-12T17:23:23.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021549550000000001 2020-11-12T17:23:23.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815989+0000", 2020-11-12T17:23:23.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15502450600000001 2020-11-12T17:23:23.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971014+0000", 2020-11-12T17:23:23.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6885999999999996e-05 2020-11-12T17:23:23.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971081+0000", 2020-11-12T17:23:23.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9054000000000006e-05 2020-11-12T17:23:23.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971160+0000", 2020-11-12T17:23:23.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16113221699999999 2020-11-12T17:23:23.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.938 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.940 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:343 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.940 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:23.941 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.000112945000001, 2020-11-12T17:23:23.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001, 2020-11-12T17:23:23.941 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.941 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.941 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.941 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.942 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.942 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 343 2020-11-12T17:23:23.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.942 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:23.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810330+0000", 2020-11-12T17:23:23.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:23.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810292+0000", 2020-11-12T17:23:23.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012150399999999999 2020-11-12T17:23:23.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810413+0000", 2020-11-12T17:23:23.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6617e-05 2020-11-12T17:23:23.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810430+0000", 2020-11-12T17:23:23.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414000000000001e-05 2020-11-12T17:23:23.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810440+0000", 2020-11-12T17:23:23.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042287779999999999 2020-11-12T17:23:23.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814669+0000", 2020-11-12T17:23:23.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012893400000000001 2020-11-12T17:23:23.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814798+0000", 2020-11-12T17:23:23.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187195 2020-11-12T17:23:23.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.814985+0000", 2020-11-12T17:23:23.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001013566 2020-11-12T17:23:23.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815999+0000", 2020-11-12T17:23:23.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15527013200000001 2020-11-12T17:23:23.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971269+0000", 2020-11-12T17:23:23.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010525 2020-11-12T17:23:23.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971374+0000", 2020-11-12T17:23:23.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.045e-05 2020-11-12T17:23:23.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971425+0000", 2020-11-12T17:23:23.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16109442600000001 2020-11-12T17:23:23.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.952 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.953 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:344 3.1 3:8c41ab81:::benchmark_data_smithi036_14212_object42:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.953 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:23.953 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.997388140999998, 2020-11-12T17:23:23.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999, 2020-11-12T17:23:23.953 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.953 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.954 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.954 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.954 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.954 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 344 2020-11-12T17:23:23.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.955 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:23.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813055+0000", 2020-11-12T17:23:23.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:23.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813023+0000", 2020-11-12T17:23:23.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5440999999999996e-05 2020-11-12T17:23:23.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813119+0000", 2020-11-12T17:23:23.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2757e-05 2020-11-12T17:23:23.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:23.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813131+0000", 2020-11-12T17:23:23.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8279999999999997e-06 2020-11-12T17:23:23.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:23.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.813138+0000", 2020-11-12T17:23:23.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002273653 2020-11-12T17:23:23.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:23.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815412+0000", 2020-11-12T17:23:23.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012572199999999999 2020-11-12T17:23:23.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:23.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815537+0000", 2020-11-12T17:23:23.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013668400000000001 2020-11-12T17:23:23.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:23.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.815674+0000", 2020-11-12T17:23:23.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001073863 2020-11-12T17:23:23.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:23.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.816748+0000", 2020-11-12T17:23:23.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154859634 2020-11-12T17:23:23.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:23.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971608+0000", 2020-11-12T17:23:23.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7041999999999999e-05 2020-11-12T17:23:23.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:23.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971675+0000", 2020-11-12T17:23:23.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9370000000000002e-05 2020-11-12T17:23:23.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:23.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.971734+0000", 2020-11-12T17:23:23.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15867894599999999 2020-11-12T17:23:23.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:23.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:23.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.969 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:23.970 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:23.970 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.701566118999999, 2020-11-12T17:23:23.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:23:23.970 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:23.970 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:23.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:23.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:23.971 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:23.971 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:23:23.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.971 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:23.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:23.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:23.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:23.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:23.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:23:23.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:23.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:23.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:23:23.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:23:23.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:23.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:23.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:23.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:23:23.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:23:23.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:23:24.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:23:24.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:23:24.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:23:24.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:23:24.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:23:24.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:23:24.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:23:24.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:24.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:23:24.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:23:24.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:23:24.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:23:24.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:23:24.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:23:24.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:23:24.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:23:24.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:23:24.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:23:24.020 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.020 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.021 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.021 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:23:24.021 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:24.021 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.694474323000001, 2020-11-12T17:23:24.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:23:24.022 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.022 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:24.022 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:24.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:23:24.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:24.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:23:24.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:23:24.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:23:24.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:23:24.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:23:24.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:23:24.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:23:24.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:23:24.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:23:24.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:23:24.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:23:24.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:23:24.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:23:24.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:23:24.029 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.029 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.029 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.029 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5703 3.6 3:6399e945:::benchmark_data_smithi036_14212_object712:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:24.029 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.472173+0000", 2020-11-12T17:23:24.029 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.338269928000001, 2020-11-12T17:23:24.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.197881803, 2020-11-12T17:23:24.030 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.030 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.030 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.030 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.030 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.030 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5703 2020-11-12T17:23:24.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.031 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472173+0000", 2020-11-12T17:23:24.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472173+0000", 2020-11-12T17:23:24.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:23:24.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472150+0000", 2020-11-12T17:23:24.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1002999999999996e-05 2020-11-12T17:23:24.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472241+0000", 2020-11-12T17:23:24.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8170000000000001e-05 2020-11-12T17:23:24.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472259+0000", 2020-11-12T17:23:24.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6230000000000003e-06 2020-11-12T17:23:24.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472268+0000", 2020-11-12T17:23:24.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014259310000000001 2020-11-12T17:23:24.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.473694+0000", 2020-11-12T17:23:24.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110128 2020-11-12T17:23:24.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.473804+0000", 2020-11-12T17:23:24.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022655700000000001 2020-11-12T17:23:24.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:24.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474031+0000", 2020-11-12T17:23:24.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034442140000000001 2020-11-12T17:23:24.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.477475+0000", 2020-11-12T17:23:24.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19244666099999999 2020-11-12T17:23:24.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669921+0000", 2020-11-12T17:23:24.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5439999999999996e-05 2020-11-12T17:23:24.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669997+0000", 2020-11-12T17:23:24.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8245000000000002e-05 2020-11-12T17:23:24.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670055+0000", 2020-11-12T17:23:24.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.197881803 2020-11-12T17:23:24.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.040 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.041 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5704 3.6 3:6399e945:::benchmark_data_smithi036_14212_object712:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:24.041 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.472307+0000", 2020-11-12T17:23:24.041 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.338136712000001, 2020-11-12T17:23:24.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20087829400000001, 2020-11-12T17:23:24.041 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.041 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.041 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.042 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5704 2020-11-12T17:23:24.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.042 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472307+0000", 2020-11-12T17:23:24.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472307+0000", 2020-11-12T17:23:24.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:23:24.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472285+0000", 2020-11-12T17:23:24.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3293999999999994e-05 2020-11-12T17:23:24.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472348+0000", 2020-11-12T17:23:24.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5220000000000007e-06 2020-11-12T17:23:24.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472357+0000", 2020-11-12T17:23:24.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8410000000000002e-06 2020-11-12T17:23:24.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.472361+0000", 2020-11-12T17:23:24.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034082689999999998 2020-11-12T17:23:24.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.475769+0000", 2020-11-12T17:23:24.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016389400000000001 2020-11-12T17:23:24.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.475933+0000", 2020-11-12T17:23:24.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027474999999999998 2020-11-12T17:23:24.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:24.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476208+0000", 2020-11-12T17:23:24.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002358771 2020-11-12T17:23:24.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.478566+0000", 2020-11-12T17:23:24.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19444792 2020-11-12T17:23:24.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.673014+0000", 2020-11-12T17:23:24.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7453000000000004e-05 2020-11-12T17:23:24.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.673112+0000", 2020-11-12T17:23:24.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2992999999999997e-05 2020-11-12T17:23:24.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.673185+0000", 2020-11-12T17:23:24.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20087829400000001 2020-11-12T17:23:24.052 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.052 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.052 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.052 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:24.053 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:24.053 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.2624372449999992, 2020-11-12T17:23:24.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999, 2020-11-12T17:23:24.053 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.053 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.053 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.053 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.054 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.054 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:23:24.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.054 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:24.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:23:24.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:23:24.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:23:24.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:23:24.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:23:24.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:23:24.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:23:24.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:23:24.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:23:24.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:23:24.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:23:24.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:23:24.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:23:24.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112811 2020-11-12T17:23:24.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:24.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550940+0000", 2020-11-12T17:23:24.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001154101 2020-11-12T17:23:24.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552095+0000", 2020-11-12T17:23:24.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25363090900000002 2020-11-12T17:23:24.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805725+0000", 2020-11-12T17:23:24.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8797999999999998e-05 2020-11-12T17:23:24.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805824+0000", 2020-11-12T17:23:24.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8110999999999998e-05 2020-11-12T17:23:24.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805902+0000", 2020-11-12T17:23:24.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999 2020-11-12T17:23:24.063 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.063 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.064 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.064 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:24.064 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:23:24.064 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.2619148259999999, 2020-11-12T17:23:24.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:23:24.065 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.065 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.065 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.065 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.065 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.065 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:23:24.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.066 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:23:24.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:23:24.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:24.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:23:24.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:23:24.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:23:24.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:23:24.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:23:24.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:23:24.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:23:24.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:23:24.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:23:24.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:23:24.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:23:24.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:23:24.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:24.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:23:24.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:23:24.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:23:24.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:23:24.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:23:24.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:23:24.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:23:24.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:23:24.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:23:24.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:23:24.075 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.075 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.075 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.076 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9999 3.1 e26/20 ondisk, result = 0)", 2020-11-12T17:23:24.076 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:23:24.076 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.2535523059999996, 2020-11-12T17:23:24.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145, 2020-11-12T17:23:24.076 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.076 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:24.076 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:23:24.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:23:24.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:24.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556869+0000", 2020-11-12T17:23:24.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1767999999999994e-05 2020-11-12T17:23:24.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556951+0000", 2020-11-12T17:23:24.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.248442731 2020-11-12T17:23:24.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805393+0000", 2020-11-12T17:23:24.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5503e-05 2020-11-12T17:23:24.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805409+0000", 2020-11-12T17:23:24.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027928399999999998 2020-11-12T17:23:24.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805688+0000", 2020-11-12T17:23:24.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2215e-05 2020-11-12T17:23:24.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805710+0000", 2020-11-12T17:23:24.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000226744 2020-11-12T17:23:24.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805937+0000", 2020-11-12T17:23:24.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145 2020-11-12T17:23:24.082 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.083 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.083 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.083 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:10000 3.1 e27/20 ondisk, result = 0)", 2020-11-12T17:23:24.083 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.807681+0000", 2020-11-12T17:23:24.083 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.0027622029999996, 2020-11-12T17:23:24.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17226509700000001, 2020-11-12T17:23:24.084 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.084 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:24.084 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.807681+0000", 2020-11-12T17:23:24.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.807681+0000", 2020-11-12T17:23:24.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9998827 2020-11-12T17:23:24.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.807564+0000", 2020-11-12T17:23:24.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027963700000000001 2020-11-12T17:23:24.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.807844+0000", 2020-11-12T17:23:24.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.171710375 2020-11-12T17:23:24.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979554+0000", 2020-11-12T17:23:24.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4560000000000006e-06 2020-11-12T17:23:24.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979563+0000", 2020-11-12T17:23:24.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6435999999999997e-05 2020-11-12T17:23:24.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979650+0000", 2020-11-12T17:23:24.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8323000000000001e-05 2020-11-12T17:23:24.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979668+0000", 2020-11-12T17:23:24.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027798800000000001 2020-11-12T17:23:24.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979946+0000", 2020-11-12T17:23:24.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17226509700000001 2020-11-12T17:23:24.090 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.090 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.090 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.091 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10048 3.b e27/20 3:de93336d:::benchmark_data_smithi036_14212_object1255:head v 27'688, mlcod=27'683)", 2020-11-12T17:23:24.091 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.981168+0000", 2020-11-12T17:23:24.091 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.8292753210000008, 2020-11-12T17:23:24.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18408571700000001, 2020-11-12T17:23:24.091 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.091 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.091 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.981168+0000", 2020-11-12T17:23:24.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.981168+0000", 2020-11-12T17:23:24.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:24.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.981141+0000", 2020-11-12T17:23:24.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010602700000000001 2020-11-12T17:23:24.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.981247+0000", 2020-11-12T17:23:24.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18230318000000001 2020-11-12T17:23:24.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.163550+0000", 2020-11-12T17:23:24.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1389999999999998e-06 2020-11-12T17:23:24.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.163557+0000", 2020-11-12T17:23:24.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5004999999999999e-05 2020-11-12T17:23:24.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.163612+0000", 2020-11-12T17:23:24.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3263000000000003e-05 2020-11-12T17:23:24.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.163645+0000", 2020-11-12T17:23:24.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015468859999999999 2020-11-12T17:23:24.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165192+0000", 2020-11-12T17:23:24.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1554000000000001e-05 2020-11-12T17:23:24.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165254+0000", 2020-11-12T17:23:24.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18408571700000001 2020-11-12T17:23:24.106 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.106 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.107 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.107 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.107 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.107 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:24.108 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:24.109 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:24.100+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:24.210 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:24.204+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:24.230 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:24.230 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:24.231 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:24.231 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:24.239 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:24.325 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:24.320+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:24.395 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:24.395 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:24.396 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:24.396 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:24.396 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:24.406 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:24.411 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:24.406+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:24.512 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:24.504+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:24.564 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:23:24.562848+0000 min lat: 0.00161593 max lat: 2.28729 avg lat: 0.0181662 2020-11-12T17:23:24.564 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:23:24.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 20 16 12711 12695 4.9585 0 - 0.0181662 2020-11-12T17:23:24.566 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:24.567 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:24.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:24.567 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:24.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.567 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:112 3.8 e22/20 3:18b8dd66:::benchmark_data_smithi036_14212_object13:head v 22'8, mlcod=22'1)", 2020-11-12T17:23:24.567 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:24.567 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.917069442999999, 2020-11-12T17:23:24.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142703407, 2020-11-12T17:23:24.568 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.568 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.568 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:24.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644322+0000", 2020-11-12T17:23:24.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999738 2020-11-12T17:23:24.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644296+0000", 2020-11-12T17:23:24.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6483000000000005e-05 2020-11-12T17:23:24.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.644382+0000", 2020-11-12T17:23:24.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14174973900000001 2020-11-12T17:23:24.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786132+0000", 2020-11-12T17:23:24.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3459999999999996e-06 2020-11-12T17:23:24.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786139+0000", 2020-11-12T17:23:24.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:23:24.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786193+0000", 2020-11-12T17:23:24.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6371999999999997e-05 2020-11-12T17:23:24.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786229+0000", 2020-11-12T17:23:24.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00074081500000000003 2020-11-12T17:23:24.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.786970+0000", 2020-11-12T17:23:24.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5047000000000003e-05 2020-11-12T17:23:24.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787025+0000", 2020-11-12T17:23:24.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142703407 2020-11-12T17:23:24.577 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.577 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.577 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.578 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:336 3.8 e22/20 3:1a561d42:::benchmark_data_smithi036_14212_object41:head v 22'24, mlcod=22'19)", 2020-11-12T17:23:24.578 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:24.578 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.750036044000002, 2020-11-12T17:23:24.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.163538234, 2020-11-12T17:23:24.578 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.578 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.579 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:24.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811355+0000", 2020-11-12T17:23:24.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:24.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811319+0000", 2020-11-12T17:23:24.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133662 2020-11-12T17:23:24.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811453+0000", 2020-11-12T17:23:24.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16096115799999999 2020-11-12T17:23:24.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972414+0000", 2020-11-12T17:23:24.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.08e-05 2020-11-12T17:23:24.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972425+0000", 2020-11-12T17:23:24.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1691000000000001e-05 2020-11-12T17:23:24.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972507+0000", 2020-11-12T17:23:24.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2666000000000001e-05 2020-11-12T17:23:24.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.972549+0000", 2020-11-12T17:23:24.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023026349999999999 2020-11-12T17:23:24.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.974852+0000", 2020-11-12T17:23:24.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1347000000000002e-05 2020-11-12T17:23:24.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.974893+0000", 2020-11-12T17:23:24.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.163538234 2020-11-12T17:23:24.622 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.622 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.622 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.623 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1064 3.4 3:28f19af0:::benchmark_data_smithi036_14212_object132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:24.623 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:24.624 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.977802673999999, 2020-11-12T17:23:24.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108211234, 2020-11-12T17:23:24.624 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.625 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.625 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.625 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.625 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.625 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1064 2020-11-12T17:23:24.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.625 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:24.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583589+0000", 2020-11-12T17:23:24.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:23:24.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583558+0000", 2020-11-12T17:23:24.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1188999999999997e-05 2020-11-12T17:23:24.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583649+0000", 2020-11-12T17:23:24.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1898e-05 2020-11-12T17:23:24.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583661+0000", 2020-11-12T17:23:24.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7760000000000003e-06 2020-11-12T17:23:24.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.583667+0000", 2020-11-12T17:23:24.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013380880000000001 2020-11-12T17:23:24.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585005+0000", 2020-11-12T17:23:24.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9061999999999995e-05 2020-11-12T17:23:24.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585094+0000", 2020-11-12T17:23:24.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017904600000000001 2020-11-12T17:23:24.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:24.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.585273+0000", 2020-11-12T17:23:24.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094028799999999995 2020-11-12T17:23:24.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.586214+0000", 2020-11-12T17:23:24.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.105461808 2020-11-12T17:23:24.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691675+0000", 2020-11-12T17:23:24.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9709000000000006e-05 2020-11-12T17:23:24.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691745+0000", 2020-11-12T17:23:24.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4641000000000001e-05 2020-11-12T17:23:24.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.691800+0000", 2020-11-12T17:23:24.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108211234 2020-11-12T17:23:24.635 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.635 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.635 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.635 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:1816 3.4 3:229575d8:::benchmark_data_smithi036_14212_object226:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:24.636 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:24.636 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.334686478999998, 2020-11-12T17:23:24.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157715203, 2020-11-12T17:23:24.636 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.636 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.636 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.636 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.637 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.637 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1816 2020-11-12T17:23:24.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.637 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:24.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226705+0000", 2020-11-12T17:23:24.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:24.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226671+0000", 2020-11-12T17:23:24.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5532999999999995e-05 2020-11-12T17:23:24.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226766+0000", 2020-11-12T17:23:24.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:23:24.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226779+0000", 2020-11-12T17:23:24.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6120000000000004e-06 2020-11-12T17:23:24.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.226786+0000", 2020-11-12T17:23:24.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00085013099999999996 2020-11-12T17:23:24.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227636+0000", 2020-11-12T17:23:24.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1732999999999998e-05 2020-11-12T17:23:24.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227718+0000", 2020-11-12T17:23:24.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100733 2020-11-12T17:23:24.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:24.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.227819+0000", 2020-11-12T17:23:24.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023757000000000001 2020-11-12T17:23:24.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.230194+0000", 2020-11-12T17:23:24.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154122064 2020-11-12T17:23:24.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384316+0000", 2020-11-12T17:23:24.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9681000000000001e-05 2020-11-12T17:23:24.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384366+0000", 2020-11-12T17:23:24.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3980000000000002e-05 2020-11-12T17:23:24.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384420+0000", 2020-11-12T17:23:24.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.157715203 2020-11-12T17:23:24.653 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.653 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.653 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.654 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:1816 3.4 e23/20 ondisk, result = 0)", 2020-11-12T17:23:24.654 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:24.654 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.331512615000001, 2020-11-12T17:23:24.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15454711500000001, 2020-11-12T17:23:24.655 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.655 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:24.655 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:24.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229879+0000", 2020-11-12T17:23:24.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:24.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229854+0000", 2020-11-12T17:23:24.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8783000000000003e-05 2020-11-12T17:23:24.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.229913+0000", 2020-11-12T17:23:24.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.154309107 2020-11-12T17:23:24.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384222+0000", 2020-11-12T17:23:24.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2269999999999999e-06 2020-11-12T17:23:24.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384232+0000", 2020-11-12T17:23:24.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5488999999999996e-05 2020-11-12T17:23:24.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384297+0000", 2020-11-12T17:23:24.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2262000000000001e-05 2020-11-12T17:23:24.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384309+0000", 2020-11-12T17:23:24.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116474 2020-11-12T17:23:24.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.384426+0000", 2020-11-12T17:23:24.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15454711500000001 2020-11-12T17:23:24.661 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.661 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.661 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.662 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:4456 3.4 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e24)", 2020-11-12T17:23:24.662 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:24.662 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.714960374, 2020-11-12T17:23:24.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28490720800000002, 2020-11-12T17:23:24.662 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.662 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.663 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.663 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.663 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.663 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 4456 2020-11-12T17:23:24.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.663 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:24.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846431+0000", 2020-11-12T17:23:24.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:24.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846382+0000", 2020-11-12T17:23:24.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013956400000000001 2020-11-12T17:23:24.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846521+0000", 2020-11-12T17:23:24.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7923000000000001e-05 2020-11-12T17:23:24.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846539+0000", 2020-11-12T17:23:24.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1470000000000007e-06 2020-11-12T17:23:24.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.846548+0000", 2020-11-12T17:23:24.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054463600000000004 2020-11-12T17:23:24.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847093+0000", 2020-11-12T17:23:24.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2497000000000006e-05 2020-11-12T17:23:24.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847186+0000", 2020-11-12T17:23:24.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144227 2020-11-12T17:23:24.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:24.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847330+0000", 2020-11-12T17:23:24.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010893070000000001 2020-11-12T17:23:24.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.848419+0000", 2020-11-12T17:23:24.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.282686039 2020-11-12T17:23:24.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131105+0000", 2020-11-12T17:23:24.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012774600000000001 2020-11-12T17:23:24.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131233+0000", 2020-11-12T17:23:24.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000105154 2020-11-12T17:23:24.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.131338+0000", 2020-11-12T17:23:24.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28490720800000002 2020-11-12T17:23:24.675 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.675 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.675 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.675 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5344 3.4 3:256e9fb4:::benchmark_data_smithi036_14212_object667:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:24.676 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:24.676 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.377965335000001, 2020-11-12T17:23:24.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116435965, 2020-11-12T17:23:24.676 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.676 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.676 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.676 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.677 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.677 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5344 2020-11-12T17:23:24.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.677 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:24.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183426+0000", 2020-11-12T17:23:24.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:23:24.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183396+0000", 2020-11-12T17:23:24.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4202000000000004e-05 2020-11-12T17:23:24.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183490+0000", 2020-11-12T17:23:24.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9741e-05 2020-11-12T17:23:24.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183510+0000", 2020-11-12T17:23:24.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5509999999999996e-06 2020-11-12T17:23:24.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.183516+0000", 2020-11-12T17:23:24.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036344010000000002 2020-11-12T17:23:24.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187151+0000", 2020-11-12T17:23:24.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011442099999999999 2020-11-12T17:23:24.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187265+0000", 2020-11-12T17:23:24.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018573799999999999 2020-11-12T17:23:24.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:24.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.187451+0000", 2020-11-12T17:23:24.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044292359999999996 2020-11-12T17:23:24.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.191880+0000", 2020-11-12T17:23:24.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.107843906 2020-11-12T17:23:24.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299724+0000", 2020-11-12T17:23:24.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5835000000000003e-05 2020-11-12T17:23:24.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299780+0000", 2020-11-12T17:23:24.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2107000000000005e-05 2020-11-12T17:23:24.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299862+0000", 2020-11-12T17:23:24.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116435965 2020-11-12T17:23:24.686 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.686 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.687 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.690 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5344 3.4 e25/20 ondisk, result = 0)", 2020-11-12T17:23:24.690 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:24.690 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.369073570999999, 2020-11-12T17:23:24.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10756062, 2020-11-12T17:23:24.691 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.691 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:24.691 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:24.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192318+0000", 2020-11-12T17:23:24.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:24.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192288+0000", 2020-11-12T17:23:24.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9671000000000003e-05 2020-11-12T17:23:24.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.192368+0000", 2020-11-12T17:23:24.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.105564818 2020-11-12T17:23:24.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.297932+0000", 2020-11-12T17:23:24.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1760000000000004e-06 2020-11-12T17:23:24.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.297940+0000", 2020-11-12T17:23:24.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017675919999999999 2020-11-12T17:23:24.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299707+0000", 2020-11-12T17:23:24.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:23:24.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299716+0000", 2020-11-12T17:23:24.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162015 2020-11-12T17:23:24.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299878+0000", 2020-11-12T17:23:24.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10756062 2020-11-12T17:23:24.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.700 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.701 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5496 3.4 3:2cf172bc:::benchmark_data_smithi036_14212_object686:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:24.701 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:24.701 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.262264768, 2020-11-12T17:23:24.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124862294, 2020-11-12T17:23:24.702 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.702 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.702 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.702 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.702 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.702 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5496 2020-11-12T17:23:24.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.703 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:24.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299126+0000", 2020-11-12T17:23:24.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:24.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299088+0000", 2020-11-12T17:23:24.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120711 2020-11-12T17:23:24.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299209+0000", 2020-11-12T17:23:24.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7577000000000001e-05 2020-11-12T17:23:24.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299226+0000", 2020-11-12T17:23:24.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3689999999999999e-05 2020-11-12T17:23:24.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.299240+0000", 2020-11-12T17:23:24.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056383780000000003 2020-11-12T17:23:24.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.304878+0000", 2020-11-12T17:23:24.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104419 2020-11-12T17:23:24.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.304983+0000", 2020-11-12T17:23:24.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019338800000000001 2020-11-12T17:23:24.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:24.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.305176+0000", 2020-11-12T17:23:24.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001656366 2020-11-12T17:23:24.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.306832+0000", 2020-11-12T17:23:24.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.117004916 2020-11-12T17:23:24.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423837+0000", 2020-11-12T17:23:24.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1908000000000003e-05 2020-11-12T17:23:24.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423909+0000", 2020-11-12T17:23:24.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9568999999999997e-05 2020-11-12T17:23:24.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423989+0000", 2020-11-12T17:23:24.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124862294 2020-11-12T17:23:24.732 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.732 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.732 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.733 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5496 3.4 e25/20 ondisk, result = 0)", 2020-11-12T17:23:24.733 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:24.733 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.254110411999999, 2020-11-12T17:23:24.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116715649, 2020-11-12T17:23:24.733 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.734 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:24.734 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:24.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307281+0000", 2020-11-12T17:23:24.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:24.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307254+0000", 2020-11-12T17:23:24.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7615999999999998e-05 2020-11-12T17:23:24.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.307321+0000", 2020-11-12T17:23:24.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116404623 2020-11-12T17:23:24.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423726+0000", 2020-11-12T17:23:24.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8149999999999995e-06 2020-11-12T17:23:24.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423735+0000", 2020-11-12T17:23:24.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1903999999999994e-05 2020-11-12T17:23:24.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423817+0000", 2020-11-12T17:23:24.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.028e-05 2020-11-12T17:23:24.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423827+0000", 2020-11-12T17:23:24.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016951499999999999 2020-11-12T17:23:24.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.423996+0000", 2020-11-12T17:23:24.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.116715649 2020-11-12T17:23:24.741 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.741 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.741 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.742 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:5703 3.6 e25/20 3:6399e945:::benchmark_data_smithi036_14212_object712:head v 25'391, mlcod=25'383)", 2020-11-12T17:23:24.742 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:24.742 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.086964445, 2020-11-12T17:23:24.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19527752500000001, 2020-11-12T17:23:24.743 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.743 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.743 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:24.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474427+0000", 2020-11-12T17:23:24.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999347 2020-11-12T17:23:24.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474361+0000", 2020-11-12T17:23:24.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015052699999999999 2020-11-12T17:23:24.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.474512+0000", 2020-11-12T17:23:24.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.194039023 2020-11-12T17:23:24.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668551+0000", 2020-11-12T17:23:24.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3286e-05 2020-11-12T17:23:24.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668564+0000", 2020-11-12T17:23:24.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960999999999999e-05 2020-11-12T17:23:24.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668655+0000", 2020-11-12T17:23:24.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7333999999999999e-05 2020-11-12T17:23:24.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.668692+0000", 2020-11-12T17:23:24.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00091690499999999998 2020-11-12T17:23:24.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669609+0000", 2020-11-12T17:23:24.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4975999999999993e-05 2020-11-12T17:23:24.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.669704+0000", 2020-11-12T17:23:24.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19527752500000001 2020-11-12T17:23:24.752 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.753 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.753 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.753 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:5704 3.6 e25/20 3:6399e945:::benchmark_data_smithi036_14212_object712:head v 25'392, mlcod=25'386)", 2020-11-12T17:23:24.753 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:24.753 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.084884643000001, 2020-11-12T17:23:24.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19575757999999999, 2020-11-12T17:23:24.754 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.754 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.754 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:24.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476507+0000", 2020-11-12T17:23:24.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:24.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476472+0000", 2020-11-12T17:23:24.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013146800000000001 2020-11-12T17:23:24.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.476603+0000", 2020-11-12T17:23:24.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.194169657 2020-11-12T17:23:24.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670773+0000", 2020-11-12T17:23:24.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1989999999999999e-06 2020-11-12T17:23:24.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670777+0000", 2020-11-12T17:23:24.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6594000000000001e-05 2020-11-12T17:23:24.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670824+0000", 2020-11-12T17:23:24.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9747000000000002e-05 2020-11-12T17:23:24.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.670854+0000", 2020-11-12T17:23:24.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001341456 2020-11-12T17:23:24.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.672195+0000", 2020-11-12T17:23:24.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9018999999999998e-05 2020-11-12T17:23:24.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.672264+0000", 2020-11-12T17:23:24.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19575757999999999 2020-11-12T17:23:24.776 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.776 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.776 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.777 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5720 3.0 3:0c13ab4c:::benchmark_data_smithi036_14212_object714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:24.777 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:24.777 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.078046315, 2020-11-12T17:23:24.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356863017, 2020-11-12T17:23:24.777 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.778 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.778 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.778 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.778 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.778 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5720 2020-11-12T17:23:24.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.779 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:24.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483345+0000", 2020-11-12T17:23:24.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:24.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483326+0000", 2020-11-12T17:23:24.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4151999999999999e-05 2020-11-12T17:23:24.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483380+0000", 2020-11-12T17:23:24.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1484999999999999e-05 2020-11-12T17:23:24.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483392+0000", 2020-11-12T17:23:24.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0610000000000003e-06 2020-11-12T17:23:24.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.483397+0000", 2020-11-12T17:23:24.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041122260000000001 2020-11-12T17:23:24.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487509+0000", 2020-11-12T17:23:24.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012518300000000001 2020-11-12T17:23:24.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487634+0000", 2020-11-12T17:23:24.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020357700000000001 2020-11-12T17:23:24.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:24.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.487838+0000", 2020-11-12T17:23:24.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022445590000000001 2020-11-12T17:23:24.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.490082+0000", 2020-11-12T17:23:24.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35001414600000003 2020-11-12T17:23:24.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840097+0000", 2020-11-12T17:23:24.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9443e-05 2020-11-12T17:23:24.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840156+0000", 2020-11-12T17:23:24.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.185e-05 2020-11-12T17:23:24.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840208+0000", 2020-11-12T17:23:24.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356863017 2020-11-12T17:23:24.791 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.791 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.791 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.792 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5720 3.0 e25/20 ondisk, result = 0)", 2020-11-12T17:23:24.792 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:24.792 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.068715975, 2020-11-12T17:23:24.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.347542456, 2020-11-12T17:23:24.793 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.793 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:24.793 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:24.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492675+0000", 2020-11-12T17:23:24.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999989 2020-11-12T17:23:24.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492664+0000", 2020-11-12T17:23:24.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8972999999999999e-05 2020-11-12T17:23:24.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.492693+0000", 2020-11-12T17:23:24.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34695741600000002 2020-11-12T17:23:24.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.839651+0000", 2020-11-12T17:23:24.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.549e-06 2020-11-12T17:23:24.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.839655+0000", 2020-11-12T17:23:24.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00042003800000000002 2020-11-12T17:23:24.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840075+0000", 2020-11-12T17:23:24.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.205e-05 2020-11-12T17:23:24.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840087+0000", 2020-11-12T17:23:24.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054700000000001 2020-11-12T17:23:24.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.840218+0000", 2020-11-12T17:23:24.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.347542456 2020-11-12T17:23:24.802 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.802 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.802 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.803 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:6079 3.6 e25/20 3:68d7b676:::benchmark_data_smithi036_14212_object759:head v 25'439, mlcod=25'431)", 2020-11-12T17:23:24.803 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.972746+0000", 2020-11-12T17:23:24.803 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.588645576999999, 2020-11-12T17:23:24.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124061067, 2020-11-12T17:23:24.803 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.803 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.804 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972746+0000", 2020-11-12T17:23:24.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972746+0000", 2020-11-12T17:23:24.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:24.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972716+0000", 2020-11-12T17:23:24.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2367999999999995e-05 2020-11-12T17:23:24.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.972799+0000", 2020-11-12T17:23:24.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.119417204 2020-11-12T17:23:24.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092216+0000", 2020-11-12T17:23:24.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7179999999999999e-06 2020-11-12T17:23:24.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092223+0000", 2020-11-12T17:23:24.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8921999999999997e-05 2020-11-12T17:23:24.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092271+0000", 2020-11-12T17:23:24.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6675000000000001e-05 2020-11-12T17:23:24.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.092298+0000", 2020-11-12T17:23:24.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044341149999999998 2020-11-12T17:23:24.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096732+0000", 2020-11-12T17:23:24.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4453e-05 2020-11-12T17:23:24.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096807+0000", 2020-11-12T17:23:24.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124061067 2020-11-12T17:23:24.812 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.812 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.812 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.813 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:6080 3.6 e25/20 3:68d7b676:::benchmark_data_smithi036_14212_object759:head v 25'440, mlcod=25'435)", 2020-11-12T17:23:24.813 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.976223+0000", 2020-11-12T17:23:24.813 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.585168376, 2020-11-12T17:23:24.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.120637035, 2020-11-12T17:23:24.813 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.813 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.813 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976223+0000", 2020-11-12T17:23:24.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976223+0000", 2020-11-12T17:23:24.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:24.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976201+0000", 2020-11-12T17:23:24.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1339000000000002e-05 2020-11-12T17:23:24.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.976282+0000", 2020-11-12T17:23:24.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.11703198400000001 2020-11-12T17:23:24.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093314+0000", 2020-11-12T17:23:24.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6599999999999995e-06 2020-11-12T17:23:24.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093322+0000", 2020-11-12T17:23:24.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1506000000000002e-05 2020-11-12T17:23:24.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093403+0000", 2020-11-12T17:23:24.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1201000000000002e-05 2020-11-12T17:23:24.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.093435+0000", 2020-11-12T17:23:24.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033751010000000001 2020-11-12T17:23:24.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096810+0000", 2020-11-12T17:23:24.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0133000000000003e-05 2020-11-12T17:23:24.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.096860+0000", 2020-11-12T17:23:24.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.120637035 2020-11-12T17:23:24.820 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.820 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.820 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.821 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:8928 3.4 e26/20 ondisk, result = 0)", 2020-11-12T17:23:24.821 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.548221+0000", 2020-11-12T17:23:24.821 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.013170710000001, 2020-11-12T17:23:24.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23226502299999999, 2020-11-12T17:23:24.821 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.821 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:24.821 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548221+0000", 2020-11-12T17:23:24.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548221+0000", 2020-11-12T17:23:24.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:24.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548195+0000", 2020-11-12T17:23:24.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1903000000000006e-05 2020-11-12T17:23:24.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.548267+0000", 2020-11-12T17:23:24.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.231938109 2020-11-12T17:23:24.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780205+0000", 2020-11-12T17:23:24.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9040000000000004e-06 2020-11-12T17:23:24.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780215+0000", 2020-11-12T17:23:24.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8253999999999998e-05 2020-11-12T17:23:24.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780313+0000", 2020-11-12T17:23:24.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2525e-05 2020-11-12T17:23:24.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780326+0000", 2020-11-12T17:23:24.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015992099999999999 2020-11-12T17:23:24.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.780486+0000", 2020-11-12T17:23:24.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23226502299999999 2020-11-12T17:23:24.828 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.828 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.828 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.829 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9296 3.0 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:24.829 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.854608+0000", 2020-11-12T17:23:24.829 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.706782972999999, 2020-11-12T17:23:24.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108252579, 2020-11-12T17:23:24.829 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.830 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.830 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9296 2020-11-12T17:23:24.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.831 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854608+0000", 2020-11-12T17:23:24.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854608+0000", 2020-11-12T17:23:24.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:24.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854580+0000", 2020-11-12T17:23:24.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2990000000000002e-05 2020-11-12T17:23:24.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854673+0000", 2020-11-12T17:23:24.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2016e-05 2020-11-12T17:23:24.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854685+0000", 2020-11-12T17:23:24.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1469999999999998e-06 2020-11-12T17:23:24.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.854691+0000", 2020-11-12T17:23:24.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046110760000000004 2020-11-12T17:23:24.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859302+0000", 2020-11-12T17:23:24.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010799299999999999 2020-11-12T17:23:24.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859410+0000", 2020-11-12T17:23:24.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00038086199999999999 2020-11-12T17:23:24.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:24.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859791+0000", 2020-11-12T17:23:24.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049539120000000004 2020-11-12T17:23:24.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.864745+0000", 2020-11-12T17:23:24.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.097925522000000001 2020-11-12T17:23:24.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.962670+0000", 2020-11-12T17:23:24.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109441 2020-11-12T17:23:24.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.962780+0000", 2020-11-12T17:23:24.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1139999999999999e-05 2020-11-12T17:23:24.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.962861+0000", 2020-11-12T17:23:24.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.108252579 2020-11-12T17:23:24.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.843 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.844 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9480 3.4 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:24.844 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.033933+0000", 2020-11-12T17:23:24.844 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.527458596000001, 2020-11-12T17:23:24.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16844625499999999, 2020-11-12T17:23:24.844 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.844 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:24.844 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:24.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:24.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:24.845 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9480 2020-11-12T17:23:24.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.845 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033933+0000", 2020-11-12T17:23:24.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033933+0000", 2020-11-12T17:23:24.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:24.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033905+0000", 2020-11-12T17:23:24.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4893000000000003e-05 2020-11-12T17:23:24.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033980+0000", 2020-11-12T17:23:24.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.189e-05 2020-11-12T17:23:24.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.033992+0000", 2020-11-12T17:23:24.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5068e-05 2020-11-12T17:23:24.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.034007+0000", 2020-11-12T17:23:24.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00522464 2020-11-12T17:23:24.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039232+0000", 2020-11-12T17:23:24.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013738800000000001 2020-11-12T17:23:24.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:24.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039369+0000", 2020-11-12T17:23:24.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024835999999999999 2020-11-12T17:23:24.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:24.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039618+0000", 2020-11-12T17:23:24.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018979000000000001 2020-11-12T17:23:24.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:24.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.041515+0000", 2020-11-12T17:23:24.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16076417100000001 2020-11-12T17:23:24.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:24.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.202280+0000", 2020-11-12T17:23:24.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0013999999999998e-05 2020-11-12T17:23:24.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:24.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.202340+0000", 2020-11-12T17:23:24.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9276000000000001e-05 2020-11-12T17:23:24.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.202379+0000", 2020-11-12T17:23:24.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16844625499999999 2020-11-12T17:23:24.866 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.866 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.867 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.867 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:12232 3.a e30/28)", 2020-11-12T17:23:24.868 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.604270+0000", 2020-11-12T17:23:24.868 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.9571211369999997, 2020-11-12T17:23:24.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54940630099999999, 2020-11-12T17:23:24.869 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:24.869 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:23:24.869 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:24.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:24.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.604270+0000", 2020-11-12T17:23:24.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:24.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:24.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.604270+0000", 2020-11-12T17:23:24.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:23:24.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:24.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.604241+0000", 2020-11-12T17:23:24.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1444000000000002e-05 2020-11-12T17:23:24.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:24.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.604313+0000", 2020-11-12T17:23:24.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54908786600000004 2020-11-12T17:23:24.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:24.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:19.153400+0000", 2020-11-12T17:23:24.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4346e-05 2020-11-12T17:23:24.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:24.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:19.153415+0000", 2020-11-12T17:23:24.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000216329 2020-11-12T17:23:24.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:24.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:19.153631+0000", 2020-11-12T17:23:24.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5260999999999999e-05 2020-11-12T17:23:24.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:24.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:24.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:24.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:19.153676+0000", 2020-11-12T17:23:24.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54940630099999999 2020-11-12T17:23:24.882 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.882 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.882 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:24.883 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:24.883 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:24.886 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:24.882+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:24.886 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:24.986 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:24.982+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:25.045 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:25.045 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:25.045 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:25.046 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:25.055 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:25.105 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:25.100+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:25.164 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:25.165 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:25.165 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:25.165 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:25.165 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:25.174 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:25.217 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:25.212+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:25.290 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:25.284+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:25.331 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:25.418 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:25.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:25.419 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:25.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.419 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:23:25.419 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:25.420 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.668064835999999, 2020-11-12T17:23:25.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:23:25.420 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.420 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.420 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:25.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:25.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:25.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:23:25.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:23:25.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:23:25.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:23:25.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:23:25.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:23:25.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:23:25.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:23:25.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:23:25.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:23:25.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:23:25.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:23:25.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:23:25.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:23:25.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:23:25.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:23:25.429 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.429 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.430 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.430 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:23:25.430 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:25.430 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.667158041, 2020-11-12T17:23:25.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:23:25.431 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.431 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.431 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:25.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:25.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:23:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:23:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:23:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:23:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:23:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:23:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:23:25.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:23:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:23:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:23:25.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:23:25.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:23:25.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:23:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:23:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:23:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:23:25.439 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:23:25.440 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.666455817999999, 2020-11-12T17:23:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:23:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:23:25.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:23:25.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:23:25.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:23:25.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:23:25.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:23:25.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:23:25.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:23:25.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:23:25.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:23:25.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:23:25.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:23:25.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:23:25.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:23:25.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:23:25.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:23:25.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.450 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.450 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:23:25.451 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:25.451 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.661949622000002, 2020-11-12T17:23:25.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:23:25.451 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.451 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.451 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:25.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:23:25.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:23:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:23:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:23:25.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:23:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:23:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:23:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:23:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:23:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:23:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:23:25.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:23:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:23:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:23:25.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:23:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:23:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:23:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:25.460 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.158408641000001, 2020-11-12T17:23:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:23:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:23:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:23:25.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:23:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:23:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:23:25.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:23:25.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:23:25.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:23:25.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:23:25.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:23:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:23:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:23:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:23:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:23:25.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:23:25.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:23:25.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:23:25.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.469 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.470 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.470 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:23:25.470 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:25.470 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.157482399999999, 2020-11-12T17:23:25.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:23:25.471 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.471 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.471 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:25.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:25.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:23:25.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:23:25.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:23:25.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:23:25.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:23:25.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:23:25.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:23:25.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:23:25.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:23:25.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:23:25.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:23:25.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:23:25.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:23:25.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:23:25.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:23:25.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:23:25.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:23:25.479 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.480 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.480 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.480 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:23:25.480 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:25.481 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.155134889999999, 2020-11-12T17:23:25.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:23:25.481 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.481 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.481 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:25.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:25.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:25.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:23:25.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:23:25.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:23:25.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:23:25.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:23:25.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:23:25.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:23:25.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:23:25.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:23:25.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:23:25.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:23:25.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:23:25.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:23:25.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:23:25.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:23:25.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:23:25.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.490 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.491 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:23:25.491 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:25.491 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.154370098000001, 2020-11-12T17:23:25.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:23:25.491 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.492 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.492 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:25.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:25.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:25.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:23:25.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:23:25.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:23:25.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:23:25.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:23:25.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:23:25.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:23:25.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:23:25.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:23:25.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:23:25.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:23:25.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:23:25.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:23:25.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:23:25.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:23:25.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:23:25.561 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.562 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.562 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.563 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:23:25.563 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:25.563 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.072143619999999, 2020-11-12T17:23:25.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:23:25.564 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.564 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.565 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:25.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:25.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:25.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:23:25.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:23:25.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:23:25.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:23:25.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:23:25.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:23:25.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:23:25.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:23:25.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:23:25.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:23:25.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:23:25.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:23:25.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:23:25.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:23:25.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:23:25.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:23:25.579 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.579 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.579 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.580 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:23:25.581 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:25.581 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.480030187000001, 2020-11-12T17:23:25.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:23:25.581 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.582 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.582 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:25.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:25.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:23:25.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:23:25.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:23:25.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:23:25.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:23:25.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:23:25.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:23:25.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:23:25.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:23:25.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:23:25.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:23:25.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:23:25.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:23:25.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:23:25.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:23:25.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:23:25.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:23:25.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.604 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.606 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.606 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:23:25.607 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:25.607 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.45136989, 2020-11-12T17:23:25.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:23:25.607 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.608 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.608 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:25.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:25.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:25.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:23:25.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:23:25.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:23:25.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:23:25.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:23:25.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:23:25.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:23:25.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:23:25.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:23:25.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:23:25.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:23:25.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:23:25.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:23:25.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:23:25.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:23:25.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:23:25.781 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.782 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.782 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.782 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:23:25.783 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:25.783 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.538773179, 2020-11-12T17:23:25.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:23:25.783 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.783 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.784 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:25.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:25.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:25.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:23:25.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:23:25.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:23:25.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:23:25.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:23:25.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:23:25.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:23:25.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:23:25.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:23:25.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:23:25.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:23:25.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:23:25.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:23:25.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:23:25.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:23:25.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:23:25.798 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.799 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.799 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.799 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:23:25.799 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:25.800 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.467633534999999, 2020-11-12T17:23:25.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:23:25.800 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.800 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.800 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:25.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:25.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:25.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:23:25.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:23:25.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:23:25.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:23:25.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:23:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:23:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:23:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:23:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:23:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:23:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:23:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:23:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:23:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:23:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:23:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:23:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:23:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.358246244, 2020-11-12T17:23:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:23:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:23:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:23:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:23:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:23:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:23:25.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:23:25.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:23:25.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:23:25.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:23:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:23:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:23:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:23:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:23:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:23:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:23:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:23:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:23:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.287710405, 2020-11-12T17:23:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:23:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:23:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:23:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:23:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:23:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:23:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:23:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:23:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:23:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:23:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:23:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:23:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:23:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:23:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:23:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:23:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:23:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:23:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.118344467, 2020-11-12T17:23:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:23:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:23:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:23:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:23:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:23:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:23:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:23:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:23:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:23:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:23:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:23:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:23:25.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:23:25.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:23:25.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:23:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:23:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:23:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:23:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:23:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.789718595, 2020-11-12T17:23:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:23:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:23:25.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:23:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:23:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:23:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:23:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:23:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:23:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:23:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:23:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:23:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:23:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:23:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:23:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:23:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:23:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:23:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:23:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:23:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.133255233, 2020-11-12T17:23:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:23:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:23:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:23:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:23:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:23:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:23:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:23:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:23:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:23:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:23:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:23:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:23:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:23:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:23:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:23:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:23:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:23:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:23:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.130614509999999, 2020-11-12T17:23:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:23:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:23:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:23:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:23:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:23:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:23:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:23:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:23:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:23:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:23:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:23:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:23:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:23:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:23:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:23:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:23:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:23:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:23:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.6463684709999997, 2020-11-12T17:23:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:23:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:25.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:23:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:23:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:23:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:23:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:23:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:23:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:23:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:23:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:23:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:23:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:23:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:23:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:23:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:23:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:23:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:23:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:23:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.879 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.879 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:25.879 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:25.879 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:25.880 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:25.881 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 7, 6] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-12T17:23:25.881 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:23:25.881 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [0, 1, 2, 3, 4, 5, 7, 6] 2020-11-12T17:23:25.881 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 2 2020-11-12T17:23:25.882 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:23:25.884 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 21 16 12711 12695 4.72237 0 - 0.0181662 2020-11-12T17:23:25.884 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:25.876+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:25.885 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:25.982 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:25.976+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:26.066 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:26.067 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:26.067 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:26.067 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:26.075 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:26.076 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:26.104 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:26.105 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:26.096+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:26.131 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:26.159 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:26.185 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:26.178+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:26.189 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:26.221 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:26.233 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:26.233 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:26.242 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:26.249 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:26.252 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:23:26.248+0000 7f4952786700 -1 mon.a@0(leader).osd e34 definitely_dead 0 2020-11-12T17:23:26.291 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:26.284+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:26.354 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:26.355 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:26.367 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:26.414 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:26.410+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:26.486 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:26.487 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:26.493 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:26.486+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:26.496 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:26.564 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 22 16 12711 12695 4.50771 0 - 0.0181662 2020-11-12T17:23:26.594 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:26.592+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:26.653 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:26.654 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:26.663 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:26.696 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:26.692+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:26.717 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:26.708+0000 7f7fe1845700 -1 osd.1 34 handle_osd_map injecting map crc failure 2020-11-12T17:23:26.730 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:26.722+0000 7f2809aaf700 -1 osd.6 34 handle_osd_map injecting map crc failure 2020-11-12T17:23:26.733 INFO:teuthology.orchestra.run.smithi036.stderr:marked out osd.2. 2020-11-12T17:23:26.733 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:23:26.778 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:26.778 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:26.785 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:26.799 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:26.792+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:26.832 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:26.826+0000 7f7b4b297700 -1 osd.4 34 handle_osd_map injecting map crc failure 2020-11-12T17:23:26.903 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:26.896+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:26.905 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:26.916 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:26.917 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:27.005 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:27.002+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:27.072 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:27.072 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:27.081 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:27.099 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:27.166 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:27.166 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:27.167 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:27.167 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:27.167 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:27.167 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:27.168 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:27.168 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:27.169 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:27.162+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:27.266 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:27.262+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:27.277 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:27.279 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:27.287 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:27.373 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:27.370+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:27.440 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:27.456 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:27.458 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:27.501 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:27.498+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:27.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 23 16 12711 12695 4.31171 0 - 0.0181662 2020-11-12T17:23:27.569 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:27.564+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:27.612 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:27.612 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:27.622 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:27.671 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:27.666+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:27.732 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:27.733 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:27.750 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:27.772 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:27.764+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:27.873 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:27.870+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:27.919 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:27.920 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:27.930 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:27.934 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:27.926+0000 7f2809aaf700 -1 osd.6 35 handle_osd_map injecting map crc failure 2020-11-12T17:23:27.935 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:27.930+0000 7f2809aaf700 -1 osd.6 35 handle_osd_map injecting map crc failure 2020-11-12T17:23:27.974 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:27.968+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:28.056 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:28.057 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:28.068 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:28.074 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:28.068+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:28.176 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:28.170+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:28.178 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:28.179 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:28.188 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:28.276 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:28.270+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:28.304 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:28.412 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:28.413 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:28.414 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:28.408+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:28.515 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:28.510+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:28.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 24 16 12711 12695 4.13205 0 - 0.0181662 2020-11-12T17:23:28.574 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:28.575 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:28.587 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:28.619 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:28.610+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:28.695 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:28.695 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:28.704 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:28.745 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:23:28.753 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:28.748+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:28.820 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:28.818+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:28.833 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:28.833 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:28.843 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:28.922 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:28.916+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:28.949 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:28.949 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:28.959 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:29.058 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:29.044+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:29.112 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:29.122 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:29.123 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:29.167 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:29.160+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:29.193 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:29.232 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:29.226+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:29.298 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:29.299 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:29.310 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:29.357 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:29.357 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:29.348+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:29.383 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:29.410 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:29.411 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:29.411 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:29.411 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:29.412 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:29.412 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:29.420 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:29.434 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:29.430+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:29.441 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:29.472 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:29.502 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:29.531 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:29.554 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:29.555 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:29.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:29.555 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:29.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.555 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:23:29.556 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:29.556 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.887648726999998, 2020-11-12T17:23:29.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:23:29.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.558 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.558 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:29.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:29.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:29.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:23:29.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:23:29.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:23:29.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:23:29.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:23:29.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:23:29.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:23:29.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:23:29.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:23:29.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:23:29.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:23:29.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:23:29.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:23:29.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:23:29.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:23:29.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:23:29.565 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.565 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.565 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.566 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:23:29.566 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:29.566 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.886741932, 2020-11-12T17:23:29.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:23:29.566 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.566 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.566 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:29.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:29.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:29.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:23:29.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:23:29.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:23:29.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:23:29.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:23:29.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:23:29.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:23:29.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:23:29.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:23:29.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:23:29.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:23:29.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:23:29.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:23:29.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:23:29.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:23:29.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:23:29.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.575 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.576 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:23:29.576 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:29.576 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.886039708999999, 2020-11-12T17:23:29.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:23:29.577 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.577 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.577 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:29.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:29.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:29.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:23:29.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:23:29.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:23:29.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:23:29.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:23:29.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:23:29.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:23:29.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:23:29.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:23:29.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:23:29.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:23:29.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:23:29.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:23:29.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:23:29.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:23:29.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:23:29.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.596 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.597 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.599 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:23:29.601 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:29.601 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.881533513000001, 2020-11-12T17:23:29.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:23:29.601 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.602 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.602 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:29.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:29.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:29.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:23:29.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:23:29.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:23:29.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:23:29.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:23:29.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:23:29.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:23:29.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:23:29.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:23:29.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:23:29.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:23:29.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:23:29.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:23:29.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:23:29.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:23:29.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:23:29.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.611 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.611 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:23:29.612 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:29.612 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.377992532, 2020-11-12T17:23:29.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:23:29.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.612 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.612 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:29.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:29.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:23:29.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:23:29.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:23:29.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:23:29.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:23:29.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:23:29.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:23:29.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:23:29.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:23:29.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:23:29.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:23:29.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:23:29.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:23:29.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:23:29.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:23:29.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:23:29.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:23:29.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.620 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.621 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:23:29.621 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:29.621 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.377066290999998, 2020-11-12T17:23:29.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:23:29.622 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.622 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.622 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:29.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:29.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:23:29.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:23:29.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:23:29.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:23:29.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:23:29.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:23:29.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:23:29.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:23:29.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:23:29.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:23:29.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:23:29.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:23:29.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:23:29.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:23:29.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:23:29.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:23:29.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:23:29.630 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.630 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.631 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:23:29.631 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:29.631 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.374718780999999, 2020-11-12T17:23:29.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:23:29.631 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.632 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.632 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:29.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:29.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:29.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:23:29.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:23:29.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:23:29.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:23:29.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:23:29.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:23:29.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:23:29.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:23:29.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:23:29.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:23:29.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:23:29.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:23:29.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:23:29.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:23:29.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:23:29.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:23:29.640 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.640 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.640 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.640 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:23:29.641 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:29.641 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.373953989, 2020-11-12T17:23:29.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:23:29.641 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.641 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.642 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:29.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:29.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:29.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:23:29.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:23:29.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:23:29.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:23:29.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:23:29.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:23:29.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:23:29.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:23:29.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:23:29.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:23:29.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:23:29.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:23:29.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:23:29.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:23:29.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:23:29.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:23:29.651 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.652 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.652 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.652 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:23:29.652 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:29.652 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.291727511000001, 2020-11-12T17:23:29.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:23:29.653 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.671 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.671 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:29.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:29.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:29.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:23:29.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:23:29.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:23:29.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:23:29.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:23:29.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:23:29.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:23:29.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:23:29.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:23:29.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:23:29.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:23:29.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:23:29.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:23:29.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:23:29.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:23:29.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:23:29.683 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.683 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.684 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.685 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:23:29.685 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:29.685 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.699614078, 2020-11-12T17:23:29.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:23:29.686 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.686 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.686 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:29.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:29.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:23:29.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:23:29.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:23:29.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:23:29.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:23:29.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:23:29.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:23:29.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:23:29.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:23:29.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:23:29.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:23:29.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:23:29.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:23:29.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:23:29.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:23:29.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:23:29.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:23:29.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.700 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.701 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:23:29.701 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:29.701 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.670953781000001, 2020-11-12T17:23:29.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:23:29.701 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.703 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.704 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:29.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:29.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:29.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:23:29.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:23:29.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:23:29.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:23:29.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:23:29.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:23:29.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:23:29.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:23:29.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:23:29.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:23:29.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:23:29.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:23:29.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:23:29.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:23:29.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:23:29.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:23:29.715 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.716 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.716 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.716 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:23:29.716 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:29.717 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.758357070000001, 2020-11-12T17:23:29.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:23:29.717 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.717 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.717 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:29.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:29.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:29.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:23:29.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:23:29.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:23:29.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:23:29.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:23:29.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:23:29.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:23:29.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:23:29.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:23:29.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:23:29.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:23:29.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:23:29.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:23:29.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:23:29.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:23:29.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:23:29.724 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.724 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.724 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.725 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:23:29.725 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:29.725 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.687217426, 2020-11-12T17:23:29.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:23:29.725 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.725 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.726 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:29.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:29.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:29.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:23:29.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:23:29.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:23:29.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:23:29.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:23:29.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:23:29.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:23:29.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:23:29.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:23:29.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:23:29.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:23:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:23:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:23:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:23:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:23:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:23:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:23:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.577830134999999, 2020-11-12T17:23:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:23:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:23:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:23:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:23:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:23:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:23:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:23:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:23:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:23:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:23:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:23:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:23:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:23:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:23:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:23:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:23:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:23:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:23:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.507294296, 2020-11-12T17:23:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:23:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:23:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:23:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:23:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:23:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:23:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:23:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:23:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:23:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:23:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:23:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:23:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:23:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:23:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:23:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:23:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:23:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:23:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.337928357999999, 2020-11-12T17:23:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:23:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:23:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:23:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:23:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:23:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:23:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:23:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:23:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:23:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:23:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:23:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:23:29.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:23:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:23:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:23:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:23:29.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:23:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:23:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.790 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:23:29.790 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:29.790 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.009302485999999, 2020-11-12T17:23:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:23:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:23:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:23:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:23:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:23:29.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:23:29.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:23:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:23:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:23:29.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:23:29.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:23:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:23:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:23:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:23:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:23:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:23:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:23:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:23:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:23:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.352839124000001, 2020-11-12T17:23:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:23:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:23:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:23:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:23:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:23:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:23:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:23:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:23:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:23:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:23:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:23:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:23:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:23:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:23:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:23:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:23:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:23:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:23:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.350198401, 2020-11-12T17:23:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:23:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:23:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:23:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:23:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:23:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:23:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:23:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:23:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:23:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:23:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:23:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:23:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:23:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:23:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:23:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:23:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:23:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:23:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.865952362, 2020-11-12T17:23:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:23:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:23:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:23:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:23:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:23:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:23:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:23:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:23:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:23:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:23:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:23:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:23:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:23:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:23:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:23:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:23:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:23:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:23:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:29.836 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:29.836 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:29.550+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:29.837 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 25 16 12711 12695 3.96676 0 - 0.0181662 2020-11-12T17:23:29.838 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:23:29.838 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:29.832+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:29.839 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:29.944 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:29.938+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:30.002 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:30.002 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:30.002 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:23:30.003 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:30.011 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:30.045 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:30.042+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:30.130 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:30.131 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:30.131 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:30.131 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:30.131 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:30.132 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:30.151 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:30.146+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:30.247 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:30.248 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:30.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:30.248 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:30.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.249 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:112 3.8 3:18b8dd66:::benchmark_data_smithi036_14212_object13:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:30.249 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.640501+0000", 2020-11-12T17:23:30.249 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.596948846, 2020-11-12T17:23:30.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14688447800000001, 2020-11-12T17:23:30.249 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.249 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.250 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.250 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.250 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.250 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 112 2020-11-12T17:23:30.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.251 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640501+0000", 2020-11-12T17:23:30.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640501+0000", 2020-11-12T17:23:30.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:30.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640467+0000", 2020-11-12T17:23:30.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6193000000000005e-05 2020-11-12T17:23:30.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640563+0000", 2020-11-12T17:23:30.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.377e-05 2020-11-12T17:23:30.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640577+0000", 2020-11-12T17:23:30.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9313e-05 2020-11-12T17:23:30.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640596+0000", 2020-11-12T17:23:30.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025484539999999999 2020-11-12T17:23:30.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.643145+0000", 2020-11-12T17:23:30.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6131000000000006e-05 2020-11-12T17:23:30.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.643231+0000", 2020-11-12T17:23:30.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108199 2020-11-12T17:23:30.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:30.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.643339+0000", 2020-11-12T17:23:30.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0053218750000000002 2020-11-12T17:23:30.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.648661+0000", 2020-11-12T17:23:30.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.138608647 2020-11-12T17:23:30.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787270+0000", 2020-11-12T17:23:30.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9970999999999999e-05 2020-11-12T17:23:30.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787330+0000", 2020-11-12T17:23:30.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6008999999999999e-05 2020-11-12T17:23:30.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787386+0000", 2020-11-12T17:23:30.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14688447800000001 2020-11-12T17:23:30.281 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.282 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.282 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.283 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:335 3.8 3:1a561d42:::benchmark_data_smithi036_14212_object41:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:30.283 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:30.283 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.429221462000001, 2020-11-12T17:23:30.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16935236200000001, 2020-11-12T17:23:30.285 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.285 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.285 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.285 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.286 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.286 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 335 2020-11-12T17:23:30.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.287 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:30.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:30.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999866 2020-11-12T17:23:30.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808094+0000", 2020-11-12T17:23:30.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000224563 2020-11-12T17:23:30.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808319+0000", 2020-11-12T17:23:30.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3512e-05 2020-11-12T17:23:30.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808332+0000", 2020-11-12T17:23:30.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9740000000000008e-06 2020-11-12T17:23:30.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808341+0000", 2020-11-12T17:23:30.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00166 2020-11-12T17:23:30.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810001+0000", 2020-11-12T17:23:30.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013877900000000001 2020-11-12T17:23:30.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810140+0000", 2020-11-12T17:23:30.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018191099999999999 2020-11-12T17:23:30.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:30.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810322+0000", 2020-11-12T17:23:30.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010403820000000001 2020-11-12T17:23:30.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811362+0000", 2020-11-12T17:23:30.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16607825100000001 2020-11-12T17:23:30.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977441+0000", 2020-11-12T17:23:30.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1192999999999995e-05 2020-11-12T17:23:30.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977502+0000", 2020-11-12T17:23:30.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8917000000000004e-05 2020-11-12T17:23:30.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977581+0000", 2020-11-12T17:23:30.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16935236200000001 2020-11-12T17:23:30.300 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.300 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.300 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.301 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:336 3.8 3:1a561d42:::benchmark_data_smithi036_14212_object41:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:30.301 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:30.301 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.429036302, 2020-11-12T17:23:30.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001, 2020-11-12T17:23:30.301 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.301 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.302 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.302 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.302 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.302 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 336 2020-11-12T17:23:30.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.302 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:30.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:30.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:23:30.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808370+0000", 2020-11-12T17:23:30.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8706e-05 2020-11-12T17:23:30.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808469+0000", 2020-11-12T17:23:30.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.329e-06 2020-11-12T17:23:30.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808478+0000", 2020-11-12T17:23:30.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.181e-06 2020-11-12T17:23:30.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808483+0000", 2020-11-12T17:23:30.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022620499999999998 2020-11-12T17:23:30.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810746+0000", 2020-11-12T17:23:30.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6533000000000006e-05 2020-11-12T17:23:30.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810842+0000", 2020-11-12T17:23:30.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018000000000000001 2020-11-12T17:23:30.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:30.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811022+0000", 2020-11-12T17:23:30.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00081152800000000005 2020-11-12T17:23:30.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811834+0000", 2020-11-12T17:23:30.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16750948399999999 2020-11-12T17:23:30.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979343+0000", 2020-11-12T17:23:30.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4766999999999998e-05 2020-11-12T17:23:30.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979408+0000", 2020-11-12T17:23:30.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3001999999999999e-05 2020-11-12T17:23:30.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979451+0000", 2020-11-12T17:23:30.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001 2020-11-12T17:23:30.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.313 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.314 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:335 3.8 e22/20 ondisk, result = 0)", 2020-11-12T17:23:30.314 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:30.314 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.424557806999999, 2020-11-12T17:23:30.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.164701714, 2020-11-12T17:23:30.314 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.315 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:30.315 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:30.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:30.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:30.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812856+0000", 2020-11-12T17:23:30.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2423999999999995e-05 2020-11-12T17:23:30.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812948+0000", 2020-11-12T17:23:30.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16219246800000001 2020-11-12T17:23:30.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.975141+0000", 2020-11-12T17:23:30.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0543999999999999e-05 2020-11-12T17:23:30.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.975151+0000", 2020-11-12T17:23:30.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002271398 2020-11-12T17:23:30.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977422+0000", 2020-11-12T17:23:30.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7550000000000006e-06 2020-11-12T17:23:30.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977432+0000", 2020-11-12T17:23:30.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016162899999999999 2020-11-12T17:23:30.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977594+0000", 2020-11-12T17:23:30.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.164701714 2020-11-12T17:23:30.322 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.322 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.322 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.323 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:656 3.b 3:d7e055d2:::benchmark_data_smithi036_14212_object81:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:30.323 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.182042+0000", 2020-11-12T17:23:30.323 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.055408172, 2020-11-12T17:23:30.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13346680499999999, 2020-11-12T17:23:30.323 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.323 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.324 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.324 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.324 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.324 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 656 2020-11-12T17:23:30.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.324 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182042+0000", 2020-11-12T17:23:30.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182042+0000", 2020-11-12T17:23:30.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999456 2020-11-12T17:23:30.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.181987+0000", 2020-11-12T17:23:30.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016009499999999999 2020-11-12T17:23:30.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182148+0000", 2020-11-12T17:23:30.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0428000000000002e-05 2020-11-12T17:23:30.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182168+0000", 2020-11-12T17:23:30.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0508e-05 2020-11-12T17:23:30.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182178+0000", 2020-11-12T17:23:30.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003631713 2020-11-12T17:23:30.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.185810+0000", 2020-11-12T17:23:30.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020195900000000001 2020-11-12T17:23:30.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.186012+0000", 2020-11-12T17:23:30.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027031800000000002 2020-11-12T17:23:30.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:30.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.186282+0000", 2020-11-12T17:23:30.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045565750000000002 2020-11-12T17:23:30.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.190839+0000", 2020-11-12T17:23:30.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12440807500000001 2020-11-12T17:23:30.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315247+0000", 2020-11-12T17:23:30.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0984999999999997e-05 2020-11-12T17:23:30.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315338+0000", 2020-11-12T17:23:30.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170493 2020-11-12T17:23:30.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315509+0000", 2020-11-12T17:23:30.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13346680499999999 2020-11-12T17:23:30.334 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.334 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.335 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:656 3.b e22/20 ondisk, result = 0)", 2020-11-12T17:23:30.335 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.191193+0000", 2020-11-12T17:23:30.335 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.046257082, 2020-11-12T17:23:30.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124325132, 2020-11-12T17:23:30.336 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.336 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:30.336 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.191193+0000", 2020-11-12T17:23:30.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.191193+0000", 2020-11-12T17:23:30.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:30.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.191164+0000", 2020-11-12T17:23:30.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:23:30.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.191237+0000", 2020-11-12T17:23:30.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.123073712 2020-11-12T17:23:30.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.314311+0000", 2020-11-12T17:23:30.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5079999999999994e-06 2020-11-12T17:23:30.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.314320+0000", 2020-11-12T17:23:30.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089928999999999996 2020-11-12T17:23:30.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315219+0000", 2020-11-12T17:23:30.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1092e-05 2020-11-12T17:23:30.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315230+0000", 2020-11-12T17:23:30.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028759 2020-11-12T17:23:30.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315518+0000", 2020-11-12T17:23:30.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124325132 2020-11-12T17:23:30.343 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.343 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.343 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.344 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:808 3.b 3:d27ca39f:::benchmark_data_smithi036_14212_object100:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:30.344 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:30.344 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.917591267999999, 2020-11-12T17:23:30.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742, 2020-11-12T17:23:30.344 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.344 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.345 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 808 2020-11-12T17:23:30.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.345 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:30.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:30.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:23:30.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319816+0000", 2020-11-12T17:23:30.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012461199999999999 2020-11-12T17:23:30.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319941+0000", 2020-11-12T17:23:30.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4997000000000001e-05 2020-11-12T17:23:30.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319956+0000", 2020-11-12T17:23:30.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9940000000000003e-06 2020-11-12T17:23:30.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319963+0000", 2020-11-12T17:23:30.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011778870000000001 2020-11-12T17:23:30.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321141+0000", 2020-11-12T17:23:30.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010428400000000001 2020-11-12T17:23:30.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321245+0000", 2020-11-12T17:23:30.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117811 2020-11-12T17:23:30.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:30.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321363+0000", 2020-11-12T17:23:30.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001974511 2020-11-12T17:23:30.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323337+0000", 2020-11-12T17:23:30.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185308416 2020-11-12T17:23:30.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508646+0000", 2020-11-12T17:23:30.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3879000000000002e-05 2020-11-12T17:23:30.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508720+0000", 2020-11-12T17:23:30.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6706000000000002e-05 2020-11-12T17:23:30.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508776+0000", 2020-11-12T17:23:30.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742 2020-11-12T17:23:30.355 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.355 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.355 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.355 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:808 3.b e22/20 ondisk, result = 0)", 2020-11-12T17:23:30.355 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:30.356 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.913778629999999, 2020-11-12T17:23:30.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999, 2020-11-12T17:23:30.356 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.356 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:30.356 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:30.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:30.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:30.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323648+0000", 2020-11-12T17:23:30.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0744e-05 2020-11-12T17:23:30.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323709+0000", 2020-11-12T17:23:30.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18463727299999999 2020-11-12T17:23:30.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508346+0000", 2020-11-12T17:23:30.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.798e-06 2020-11-12T17:23:30.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508356+0000", 2020-11-12T17:23:30.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027103199999999999 2020-11-12T17:23:30.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508627+0000", 2020-11-12T17:23:30.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999993e-06 2020-11-12T17:23:30.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508637+0000", 2020-11-12T17:23:30.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014688799999999999 2020-11-12T17:23:30.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508784+0000", 2020-11-12T17:23:30.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999 2020-11-12T17:23:30.363 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.363 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.363 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.363 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:927 3.2 3:4c5417bc:::benchmark_data_smithi036_14212_object115:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:30.363 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.426934+0000", 2020-11-12T17:23:30.364 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.810516388, 2020-11-12T17:23:30.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12011153400000001, 2020-11-12T17:23:30.364 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.364 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.364 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.365 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.365 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.365 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 927 2020-11-12T17:23:30.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.365 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.426934+0000", 2020-11-12T17:23:30.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.426934+0000", 2020-11-12T17:23:30.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:30.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.426915+0000", 2020-11-12T17:23:30.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5866999999999999e-05 2020-11-12T17:23:30.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.426971+0000", 2020-11-12T17:23:30.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5509999999999996e-06 2020-11-12T17:23:30.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.426978+0000", 2020-11-12T17:23:30.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2610000000000002e-06 2020-11-12T17:23:30.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.426981+0000", 2020-11-12T17:23:30.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018727920000000001 2020-11-12T17:23:30.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.428854+0000", 2020-11-12T17:23:30.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012890800000000001 2020-11-12T17:23:30.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.428983+0000", 2020-11-12T17:23:30.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019409700000000001 2020-11-12T17:23:30.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:30.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.429177+0000", 2020-11-12T17:23:30.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022434820000000002 2020-11-12T17:23:30.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.431420+0000", 2020-11-12T17:23:30.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.11554858 2020-11-12T17:23:30.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.546969+0000", 2020-11-12T17:23:30.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3201999999999997e-05 2020-11-12T17:23:30.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.547012+0000", 2020-11-12T17:23:30.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3157999999999997e-05 2020-11-12T17:23:30.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.547045+0000", 2020-11-12T17:23:30.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12011153400000001 2020-11-12T17:23:30.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.375 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.376 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:928 3.2 3:4c5417bc:::benchmark_data_smithi036_14212_object115:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:30.376 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.428586+0000", 2020-11-12T17:23:30.376 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.808864349, 2020-11-12T17:23:30.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.123620621, 2020-11-12T17:23:30.377 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.377 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.400 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 928 2020-11-12T17:23:30.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.400 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.428586+0000", 2020-11-12T17:23:30.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.428586+0000", 2020-11-12T17:23:30.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:30.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.428536+0000", 2020-11-12T17:23:30.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016038200000000001 2020-11-12T17:23:30.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.428697+0000", 2020-11-12T17:23:30.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9263000000000001e-05 2020-11-12T17:23:30.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.428726+0000", 2020-11-12T17:23:30.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4150000000000005e-06 2020-11-12T17:23:30.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.428735+0000", 2020-11-12T17:23:30.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001655183 2020-11-12T17:23:30.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.430390+0000", 2020-11-12T17:23:30.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015754199999999999 2020-11-12T17:23:30.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.430548+0000", 2020-11-12T17:23:30.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026788799999999998 2020-11-12T17:23:30.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:30.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.430816+0000", 2020-11-12T17:23:30.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015505130000000001 2020-11-12T17:23:30.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.432366+0000", 2020-11-12T17:23:30.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.11976012799999999 2020-11-12T17:23:30.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.552126+0000", 2020-11-12T17:23:30.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5435000000000001e-05 2020-11-12T17:23:30.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.552172+0000", 2020-11-12T17:23:30.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4304999999999998e-05 2020-11-12T17:23:30.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.552206+0000", 2020-11-12T17:23:30.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.123620621 2020-11-12T17:23:30.410 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.410 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.410 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.410 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:927 3.2 e22/20 ondisk, result = 0)", 2020-11-12T17:23:30.411 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.432285+0000", 2020-11-12T17:23:30.411 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.805165337999998, 2020-11-12T17:23:30.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.114764989, 2020-11-12T17:23:30.411 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.411 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:30.411 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.432285+0000", 2020-11-12T17:23:30.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.432285+0000", 2020-11-12T17:23:30.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:30.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.432248+0000", 2020-11-12T17:23:30.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8924000000000005e-05 2020-11-12T17:23:30.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.432327+0000", 2020-11-12T17:23:30.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.114531339 2020-11-12T17:23:30.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.546858+0000", 2020-11-12T17:23:30.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7290000000000006e-06 2020-11-12T17:23:30.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.546867+0000", 2020-11-12T17:23:30.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5884000000000006e-05 2020-11-12T17:23:30.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.546953+0000", 2020-11-12T17:23:30.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0000000000000001e-05 2020-11-12T17:23:30.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.546963+0000", 2020-11-12T17:23:30.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6848999999999995e-05 2020-11-12T17:23:30.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.547050+0000", 2020-11-12T17:23:30.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.114764989 2020-11-12T17:23:30.418 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.418 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.418 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.419 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5672 3.7 3:e4132891:::benchmark_data_smithi036_14212_object708:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:30.419 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:30.419 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.794095035000002, 2020-11-12T17:23:30.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906, 2020-11-12T17:23:30.419 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.419 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.419 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.420 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.420 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.420 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5672 2020-11-12T17:23:30.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.420 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:30.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:30.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:30.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443325+0000", 2020-11-12T17:23:30.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3981999999999996e-05 2020-11-12T17:23:30.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443419+0000", 2020-11-12T17:23:30.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8057e-05 2020-11-12T17:23:30.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443437+0000", 2020-11-12T17:23:30.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3709999999999996e-06 2020-11-12T17:23:30.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443444+0000", 2020-11-12T17:23:30.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019104530000000001 2020-11-12T17:23:30.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445354+0000", 2020-11-12T17:23:30.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2356999999999999e-05 2020-11-12T17:23:30.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445426+0000", 2020-11-12T17:23:30.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111113 2020-11-12T17:23:30.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:30.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445538+0000", 2020-11-12T17:23:30.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00086618700000000003 2020-11-12T17:23:30.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.446404+0000", 2020-11-12T17:23:30.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.205445288 2020-11-12T17:23:30.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651849+0000", 2020-11-12T17:23:30.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2787000000000005e-05 2020-11-12T17:23:30.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651942+0000", 2020-11-12T17:23:30.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2173000000000003e-05 2020-11-12T17:23:30.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652004+0000", 2020-11-12T17:23:30.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906 2020-11-12T17:23:30.429 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.429 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.430 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.430 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5672 3.7 e25/20 ondisk, result = 0)", 2020-11-12T17:23:30.430 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:30.430 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.785311641, 2020-11-12T17:23:30.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162, 2020-11-12T17:23:30.431 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.431 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:30.431 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:30.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:30.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:30.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452124+0000", 2020-11-12T17:23:30.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6100000000000003e-05 2020-11-12T17:23:30.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452160+0000", 2020-11-12T17:23:30.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199026693 2020-11-12T17:23:30.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651186+0000", 2020-11-12T17:23:30.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0820000000000001e-06 2020-11-12T17:23:30.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651194+0000", 2020-11-12T17:23:30.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00062788999999999998 2020-11-12T17:23:30.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651821+0000", 2020-11-12T17:23:30.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4558e-05 2020-11-12T17:23:30.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651836+0000", 2020-11-12T17:23:30.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018151300000000001 2020-11-12T17:23:30.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652017+0000", 2020-11-12T17:23:30.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162 2020-11-12T17:23:30.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.437 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.438 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.438 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:6048 3.7 3:e3840c9f:::benchmark_data_smithi036_14212_object755:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:30.438 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.919912+0000", 2020-11-12T17:23:30.438 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.317537948999998, 2020-11-12T17:23:30.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151432184, 2020-11-12T17:23:30.439 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.439 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.439 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 6048 2020-11-12T17:23:30.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.440 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.919912+0000", 2020-11-12T17:23:30.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.919912+0000", 2020-11-12T17:23:30.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:30.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.919863+0000", 2020-11-12T17:23:30.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013728500000000001 2020-11-12T17:23:30.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920000+0000", 2020-11-12T17:23:30.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1212e-05 2020-11-12T17:23:30.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920021+0000", 2020-11-12T17:23:30.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8639999999999996e-06 2020-11-12T17:23:30.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920029+0000", 2020-11-12T17:23:30.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00076714100000000005 2020-11-12T17:23:30.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920796+0000", 2020-11-12T17:23:30.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013040299999999999 2020-11-12T17:23:30.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920926+0000", 2020-11-12T17:23:30.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000194205 2020-11-12T17:23:30.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:30.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.921121+0000", 2020-11-12T17:23:30.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025300639999999998 2020-11-12T17:23:30.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.923651+0000", 2020-11-12T17:23:30.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14748789600000001 2020-11-12T17:23:30.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.071139+0000", 2020-11-12T17:23:30.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0044999999999996e-05 2020-11-12T17:23:30.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.071229+0000", 2020-11-12T17:23:30.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011548999999999999 2020-11-12T17:23:30.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.071344+0000", 2020-11-12T17:23:30.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151432184 2020-11-12T17:23:30.458 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.458 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.458 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.459 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:30.460 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:30.460 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.818961677000001, 2020-11-12T17:23:30.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:23:30.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.461 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.461 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.462 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.462 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.462 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:23:30.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.463 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:30.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:30.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:23:30.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:23:30.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:23:30.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:23:30.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:23:30.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:23:30.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:23:30.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:23:30.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:23:30.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:23:30.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:23:30.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:23:30.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:23:30.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:30.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:23:30.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:23:30.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:23:30.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:23:30.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:23:30.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:23:30.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:23:30.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:23:30.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:23:30.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:23:30.481 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.482 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.483 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:23:30.483 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:30.483 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.812017615, 2020-11-12T17:23:30.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:23:30.484 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.484 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:30.484 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:30.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:30.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:30.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:23:30.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:23:30.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:23:30.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:23:30.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:23:30.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:23:30.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:23:30.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:23:30.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:23:30.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:23:30.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:23:30.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:23:30.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:23:30.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:23:30.497 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.497 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.498 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.499 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:30.499 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:30.499 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.256940459999999, 2020-11-12T17:23:30.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866, 2020-11-12T17:23:30.500 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.500 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.648 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.648 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.648 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.648 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:30.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.649 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:30.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:30.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:30.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980460+0000", 2020-11-12T17:23:30.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012467899999999999 2020-11-12T17:23:30.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980585+0000", 2020-11-12T17:23:30.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6456e-05 2020-11-12T17:23:30.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980602+0000", 2020-11-12T17:23:30.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9169999999999995e-06 2020-11-12T17:23:30.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980611+0000", 2020-11-12T17:23:30.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015059000000000001 2020-11-12T17:23:30.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980761+0000", 2020-11-12T17:23:30.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9624999999999997e-05 2020-11-12T17:23:30.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980841+0000", 2020-11-12T17:23:30.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133702 2020-11-12T17:23:30.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:30.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980974+0000", 2020-11-12T17:23:30.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001625076 2020-11-12T17:23:30.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.982600+0000", 2020-11-12T17:23:30.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18301002199999999 2020-11-12T17:23:30.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165610+0000", 2020-11-12T17:23:30.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4160999999999998e-05 2020-11-12T17:23:30.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165674+0000", 2020-11-12T17:23:30.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000127661 2020-11-12T17:23:30.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165801+0000", 2020-11-12T17:23:30.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866 2020-11-12T17:23:30.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.679 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.680 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e27)", 2020-11-12T17:23:30.680 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:30.680 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.245228707000001, 2020-11-12T17:23:30.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678, 2020-11-12T17:23:30.681 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.681 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:23:30.681 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.682 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.682 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.682 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:30.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.683 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:30.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:30.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:23:30.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992202+0000", 2020-11-12T17:23:30.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5812e-05 2020-11-12T17:23:30.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992258+0000", 2020-11-12T17:23:30.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3090000000000001e-06 2020-11-12T17:23:30.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992267+0000", 2020-11-12T17:23:30.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7680000000000008e-06 2020-11-12T17:23:30.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992275+0000", 2020-11-12T17:23:30.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0019000000000003e-05 2020-11-12T17:23:30.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992335+0000", 2020-11-12T17:23:30.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0896999999999995e-05 2020-11-12T17:23:30.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:23:30.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992416+0000", 2020-11-12T17:23:30.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17331891299999999 2020-11-12T17:23:30.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165735+0000", 2020-11-12T17:23:30.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678 2020-11-12T17:23:30.694 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.694 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.694 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.695 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10064 3.7 3:e0dfa39d:::benchmark_data_smithi036_14212_object1257:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:30.695 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:30.695 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.224381588, 2020-11-12T17:23:30.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999, 2020-11-12T17:23:30.695 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.695 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:30.695 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:30.696 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:30.696 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:30.696 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10064 2020-11-12T17:23:30.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.696 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:30.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:30.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:30.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013037+0000", 2020-11-12T17:23:30.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7905000000000006e-05 2020-11-12T17:23:30.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013125+0000", 2020-11-12T17:23:30.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4722999999999999e-05 2020-11-12T17:23:30.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013140+0000", 2020-11-12T17:23:30.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6830000000000008e-06 2020-11-12T17:23:30.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013148+0000", 2020-11-12T17:23:30.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:23:30.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013223+0000", 2020-11-12T17:23:30.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020518000000000001 2020-11-12T17:23:30.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013428+0000", 2020-11-12T17:23:30.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023399799999999999 2020-11-12T17:23:30.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:30.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013662+0000", 2020-11-12T17:23:30.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034048939999999999 2020-11-12T17:23:30.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:30.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.017067+0000", 2020-11-12T17:23:30.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18367845899999999 2020-11-12T17:23:30.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:30.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200745+0000", 2020-11-12T17:23:30.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013196599999999999 2020-11-12T17:23:30.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:30.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200877+0000", 2020-11-12T17:23:30.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011756099999999999 2020-11-12T17:23:30.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200995+0000", 2020-11-12T17:23:30.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999 2020-11-12T17:23:30.712 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.712 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.712 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.712 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:10064 3.7 e27/20 ondisk, result = 0)", 2020-11-12T17:23:30.713 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:30.713 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.218767596999999, 2020-11-12T17:23:30.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999, 2020-11-12T17:23:30.713 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:30.713 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:30.713 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:30.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:30.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:30.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:30.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:30.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:30.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:30.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:30.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018663+0000", 2020-11-12T17:23:30.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1436e-05 2020-11-12T17:23:30.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:30.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018714+0000", 2020-11-12T17:23:30.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18186307199999999 2020-11-12T17:23:30.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:30.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200577+0000", 2020-11-12T17:23:30.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5204e-05 2020-11-12T17:23:30.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:30.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200592+0000", 2020-11-12T17:23:30.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110565 2020-11-12T17:23:30.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:30.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200703+0000", 2020-11-12T17:23:30.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2906000000000001e-05 2020-11-12T17:23:30.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:30.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200726+0000", 2020-11-12T17:23:30.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028337099999999998 2020-11-12T17:23:30.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:30.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:30.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:30.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.201009+0000", 2020-11-12T17:23:30.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999 2020-11-12T17:23:30.720 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.720 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.721 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.721 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:30.721 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:30.721 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:30.723 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:30.723 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:30.725 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:30.725 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 26 16 12711 12695 3.81418 0 - 0.0181662 2020-11-12T17:23:30.725 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:30.718+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:30.726 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:30.825 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:30.818+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:30.844 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:30.844 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:30.844 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:23:30.845 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:30.854 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:30.963 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:30.950+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:31.027 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:31.028 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:31.028 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:31.028 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:31.028 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:31.029 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:31.024+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:31.061 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:31.161 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:31.158+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:31.230 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:31.368 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:31.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:31.368 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:31.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.368 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:31.369 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:31.369 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.466284724000001, 2020-11-12T17:23:31.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:23:31.369 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.369 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.369 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:31.369 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:31.370 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:31.370 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:23:31.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.370 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:31.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:31.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:31.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:23:31.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:23:31.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:23:31.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:23:31.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:23:31.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:23:31.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:23:31.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:23:31.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:23:31.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:23:31.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:23:31.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:23:31.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:31.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:23:31.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:23:31.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:31.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:23:31.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:23:31.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:31.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:23:31.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:23:31.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:23:31.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:23:31.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:23:31.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:23:31.380 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.380 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.380 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.380 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:23:31.380 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:31.380 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.459485872999998, 2020-11-12T17:23:31.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:23:31.381 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.381 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:31.381 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:31.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:31.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:23:31.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:23:31.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:23:31.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:23:31.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:23:31.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:23:31.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:23:31.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:23:31.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:23:31.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:23:31.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:23:31.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:23:31.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:23:31.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:23:31.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:23:31.387 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.388 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.388 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.388 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:984 3.3 3:c7e6075e:::benchmark_data_smithi036_14212_object122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:31.388 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.493710+0000", 2020-11-12T17:23:31.388 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.73140527, 2020-11-12T17:23:31.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.166177411, 2020-11-12T17:23:31.389 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.389 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.389 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:31.389 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:31.389 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:31.389 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 984 2020-11-12T17:23:31.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.390 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.493710+0000", 2020-11-12T17:23:31.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.493710+0000", 2020-11-12T17:23:31.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999939 2020-11-12T17:23:31.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.493648+0000", 2020-11-12T17:23:31.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167651 2020-11-12T17:23:31.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.493816+0000", 2020-11-12T17:23:31.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9375999999999999e-05 2020-11-12T17:23:31.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.493836+0000", 2020-11-12T17:23:31.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0278000000000001e-05 2020-11-12T17:23:31.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.493846+0000", 2020-11-12T17:23:31.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001129573 2020-11-12T17:23:31.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.494975+0000", 2020-11-12T17:23:31.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010343700000000001 2020-11-12T17:23:31.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.495079+0000", 2020-11-12T17:23:31.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015996700000000001 2020-11-12T17:23:31.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:31.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.495239+0000", 2020-11-12T17:23:31.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050911109999999997 2020-11-12T17:23:31.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:31.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.500330+0000", 2020-11-12T17:23:31.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.159446583 2020-11-12T17:23:31.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:31.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.659776+0000", 2020-11-12T17:23:31.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6915000000000006e-05 2020-11-12T17:23:31.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.659843+0000", 2020-11-12T17:23:31.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3608e-05 2020-11-12T17:23:31.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.659887+0000", 2020-11-12T17:23:31.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.166177411 2020-11-12T17:23:31.409 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.409 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.409 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.409 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:984 3.3 e23/20 ondisk, result = 0)", 2020-11-12T17:23:31.409 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.499008+0000", 2020-11-12T17:23:31.410 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.726106422000001, 2020-11-12T17:23:31.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16088481399999999, 2020-11-12T17:23:31.410 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.410 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:31.410 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.499008+0000", 2020-11-12T17:23:31.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.499008+0000", 2020-11-12T17:23:31.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:31.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.498981+0000", 2020-11-12T17:23:31.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6422999999999997e-05 2020-11-12T17:23:31.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.499058+0000", 2020-11-12T17:23:31.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.160622869 2020-11-12T17:23:31.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.659680+0000", 2020-11-12T17:23:31.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0360000000000006e-06 2020-11-12T17:23:31.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.659688+0000", 2020-11-12T17:23:31.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7130000000000003e-05 2020-11-12T17:23:31.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.659756+0000", 2020-11-12T17:23:31.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6879999999999994e-06 2020-11-12T17:23:31.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.659765+0000", 2020-11-12T17:23:31.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000127964 2020-11-12T17:23:31.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.659893+0000", 2020-11-12T17:23:31.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16088481399999999 2020-11-12T17:23:31.416 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.416 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.416 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.417 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1104 3.9 3:9f55e211:::benchmark_data_smithi036_14212_object137:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:31.417 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:31.417 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.607691522, 2020-11-12T17:23:31.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001, 2020-11-12T17:23:31.417 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.417 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.417 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:31.418 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:31.418 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:31.418 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1104 2020-11-12T17:23:31.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.418 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:31.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:31.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:31.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617385+0000", 2020-11-12T17:23:31.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9141999999999994e-05 2020-11-12T17:23:31.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617484+0000", 2020-11-12T17:23:31.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2413e-05 2020-11-12T17:23:31.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617497+0000", 2020-11-12T17:23:31.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1659999999999999e-06 2020-11-12T17:23:31.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617503+0000", 2020-11-12T17:23:31.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032791000000000001 2020-11-12T17:23:31.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620782+0000", 2020-11-12T17:23:31.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102198 2020-11-12T17:23:31.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620884+0000", 2020-11-12T17:23:31.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114058 2020-11-12T17:23:31.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:31.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620998+0000", 2020-11-12T17:23:31.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018203270000000001 2020-11-12T17:23:31.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:31.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622818+0000", 2020-11-12T17:23:31.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.203924995 2020-11-12T17:23:31.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:31.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826743+0000", 2020-11-12T17:23:31.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012106 2020-11-12T17:23:31.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826865+0000", 2020-11-12T17:23:31.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014220699999999999 2020-11-12T17:23:31.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827007+0000", 2020-11-12T17:23:31.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001 2020-11-12T17:23:31.426 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.427 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.427 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.427 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1104 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:31.427 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:31.427 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.602762739999999, 2020-11-12T17:23:31.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999, 2020-11-12T17:23:31.428 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.428 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:31.428 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:31.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:31.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:23:31.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622338+0000", 2020-11-12T17:23:31.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5814e-05 2020-11-12T17:23:31.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622374+0000", 2020-11-12T17:23:31.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20244251299999999 2020-11-12T17:23:31.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824817+0000", 2020-11-12T17:23:31.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.117e-05 2020-11-12T17:23:31.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824828+0000", 2020-11-12T17:23:31.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001882332 2020-11-12T17:23:31.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826710+0000", 2020-11-12T17:23:31.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6818000000000001e-05 2020-11-12T17:23:31.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826727+0000", 2020-11-12T17:23:31.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031566199999999997 2020-11-12T17:23:31.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827043+0000", 2020-11-12T17:23:31.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999 2020-11-12T17:23:31.434 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.434 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.434 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.434 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:1256 3.1 e23/20 3:8fc736c6:::benchmark_data_smithi036_14212_object156:head v 23'128, mlcod=23'124)", 2020-11-12T17:23:31.435 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.766304+0000", 2020-11-12T17:23:31.435 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.458811057999998, 2020-11-12T17:23:31.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.148437338, 2020-11-12T17:23:31.435 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.435 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.435 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.766304+0000", 2020-11-12T17:23:31.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.766304+0000", 2020-11-12T17:23:31.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:31.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.766275+0000", 2020-11-12T17:23:31.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5643000000000006e-05 2020-11-12T17:23:31.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.766371+0000", 2020-11-12T17:23:31.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14369423000000001 2020-11-12T17:23:31.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.910065+0000", 2020-11-12T17:23:31.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4778e-05 2020-11-12T17:23:31.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.910080+0000", 2020-11-12T17:23:31.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001129852 2020-11-12T17:23:31.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.911210+0000", 2020-11-12T17:23:31.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3388e-05 2020-11-12T17:23:31.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.911233+0000", 2020-11-12T17:23:31.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034636659999999998 2020-11-12T17:23:31.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.914697+0000", 2020-11-12T17:23:31.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4532e-05 2020-11-12T17:23:31.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.914741+0000", 2020-11-12T17:23:31.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.148437338 2020-11-12T17:23:31.442 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.442 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.442 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.442 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:31.442 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:31.443 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.216227097000001, 2020-11-12T17:23:31.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:23:31.443 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.443 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.443 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:31.443 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:31.443 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:31.444 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:23:31.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.444 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:31.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:31.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:31.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:23:31.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:23:31.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:23:31.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:23:31.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:23:31.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:23:31.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:23:31.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:23:31.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:23:31.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:23:31.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:23:31.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:23:31.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:31.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:23:31.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:23:31.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:31.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:23:31.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:23:31.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:31.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:23:31.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:23:31.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:23:31.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:23:31.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:23:31.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:23:31.452 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.453 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.453 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:31.453 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:31.453 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.209011916000001, 2020-11-12T17:23:31.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:23:31.454 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.454 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:31.454 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:31.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:31.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:23:31.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:23:31.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:23:31.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:23:31.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:23:31.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:23:31.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:23:31.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:23:31.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:23:31.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:23:31.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:23:31.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:23:31.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:23:31.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:23:31.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:23:31.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.460 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.460 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:4896 3.3 3:c1830331:::benchmark_data_smithi036_14212_object611:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:31.460 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:31.461 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.408941992999999, 2020-11-12T17:23:31.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001, 2020-11-12T17:23:31.461 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.461 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:31.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:31.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:31.462 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 4896 2020-11-12T17:23:31.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.462 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:31.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:31.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:23:31.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816142+0000", 2020-11-12T17:23:31.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7733999999999998e-05 2020-11-12T17:23:31.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816220+0000", 2020-11-12T17:23:31.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2221999999999999e-05 2020-11-12T17:23:31.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816232+0000", 2020-11-12T17:23:31.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4469999999999997e-06 2020-11-12T17:23:31.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816237+0000", 2020-11-12T17:23:31.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012662909999999999 2020-11-12T17:23:31.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817504+0000", 2020-11-12T17:23:31.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167959 2020-11-12T17:23:31.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817672+0000", 2020-11-12T17:23:31.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025141300000000003 2020-11-12T17:23:31.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:31.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817923+0000", 2020-11-12T17:23:31.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001128467 2020-11-12T17:23:31.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:31.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.819051+0000", 2020-11-12T17:23:31.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19242863199999999 2020-11-12T17:23:31.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:31.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011480+0000", 2020-11-12T17:23:31.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9741999999999996e-05 2020-11-12T17:23:31.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011560+0000", 2020-11-12T17:23:31.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4276e-05 2020-11-12T17:23:31.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011614+0000", 2020-11-12T17:23:31.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001 2020-11-12T17:23:31.470 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.470 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.471 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.471 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4896 3.3 e25/20 ondisk, result = 0)", 2020-11-12T17:23:31.471 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:31.471 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.401556155000002, 2020-11-12T17:23:31.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.188067817, 2020-11-12T17:23:31.471 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.472 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:31.472 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:31.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:31.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:31.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823525+0000", 2020-11-12T17:23:31.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-05 2020-11-12T17:23:31.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823615+0000", 2020-11-12T17:23:31.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18777782700000001 2020-11-12T17:23:31.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011392+0000", 2020-11-12T17:23:31.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9179999999999997e-06 2020-11-12T17:23:31.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011399+0000", 2020-11-12T17:23:31.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5306000000000002e-05 2020-11-12T17:23:31.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011455+0000", 2020-11-12T17:23:31.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3124e-05 2020-11-12T17:23:31.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011468+0000", 2020-11-12T17:23:31.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015874800000000001 2020-11-12T17:23:31.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011627+0000", 2020-11-12T17:23:31.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.188067817 2020-11-12T17:23:31.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.478 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.479 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5576 3.9 3:9d9511b2:::benchmark_data_smithi036_14212_object696:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:31.479 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.354488+0000", 2020-11-12T17:23:31.479 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.870626740999999, 2020-11-12T17:23:31.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15970554100000001, 2020-11-12T17:23:31.479 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.479 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.479 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:31.479 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:31.480 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:31.480 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5576 2020-11-12T17:23:31.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.480 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.354488+0000", 2020-11-12T17:23:31.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.354488+0000", 2020-11-12T17:23:31.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:23:31.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.354461+0000", 2020-11-12T17:23:31.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9096000000000003e-05 2020-11-12T17:23:31.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.354540+0000", 2020-11-12T17:23:31.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6059999999999992e-06 2020-11-12T17:23:31.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.354550+0000", 2020-11-12T17:23:31.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.318e-06 2020-11-12T17:23:31.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.354554+0000", 2020-11-12T17:23:31.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0085032440000000001 2020-11-12T17:23:31.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.363057+0000", 2020-11-12T17:23:31.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4868000000000002e-05 2020-11-12T17:23:31.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.363132+0000", 2020-11-12T17:23:31.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120887 2020-11-12T17:23:31.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:31.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.363253+0000", 2020-11-12T17:23:31.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028910580000000002 2020-11-12T17:23:31.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:31.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.366144+0000", 2020-11-12T17:23:31.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14796113499999999 2020-11-12T17:23:31.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:31.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.514105+0000", 2020-11-12T17:23:31.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4497999999999999e-05 2020-11-12T17:23:31.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.514160+0000", 2020-11-12T17:23:31.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4085000000000003e-05 2020-11-12T17:23:31.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.514194+0000", 2020-11-12T17:23:31.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15970554100000001 2020-11-12T17:23:31.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.489 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.489 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:31.489 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:31.489 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.538567024999999, 2020-11-12T17:23:31.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:23:31.490 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.490 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.490 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:31.490 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:31.490 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:31.490 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:23:31.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.490 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:31.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:31.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:31.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:23:31.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:23:31.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:23:31.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:23:31.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:23:31.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:23:31.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:23:31.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:23:31.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:23:31.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:23:31.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:23:31.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:23:31.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:31.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:23:31.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:23:31.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:31.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:23:31.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:23:31.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:31.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:23:31.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:23:31.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:23:31.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:23:31.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:23:31.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:23:31.499 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.499 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.499 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.500 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:31.500 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:31.500 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.538402122000001, 2020-11-12T17:23:31.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:23:31.501 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.501 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.501 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:31.501 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:31.501 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:31.501 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:23:31.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.502 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:31.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:31.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:31.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:23:31.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:23:31.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:23:31.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:23:31.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:23:31.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:23:31.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:23:31.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:23:31.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:23:31.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:23:31.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:23:31.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:23:31.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:31.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:23:31.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:23:31.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:31.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:23:31.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:23:31.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:31.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:23:31.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:23:31.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:23:31.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:23:31.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:23:31.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:23:31.577 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.577 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.577 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.577 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:31.578 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:31.578 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.534238888000001, 2020-11-12T17:23:31.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:23:31.578 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.578 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:31.578 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:31.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:31.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:23:31.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:23:31.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:23:31.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:23:31.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:23:31.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:23:31.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:23:31.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:23:31.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:23:31.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:23:31.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:23:31.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:23:31.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:23:31.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:23:31.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:23:31.585 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.585 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.585 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.585 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:31.585 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:31.586 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.532922053, 2020-11-12T17:23:31.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:23:31.586 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.586 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:31.587 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:31.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:31.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:23:31.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:23:31.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:23:31.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:23:31.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:23:31.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:23:31.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:23:31.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:23:31.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:23:31.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:23:31.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:23:31.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:23:31.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:23:31.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:23:31.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:23:31.595 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.595 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.595 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.596 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:23:31.596 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:31.596 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.670602421000002, 2020-11-12T17:23:31.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:23:31.596 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.596 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.597 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:31.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:31.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:31.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:23:31.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:23:31.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:23:31.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:23:31.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:23:31.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:23:31.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:23:31.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:23:31.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:23:31.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:23:31.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:23:31.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:23:31.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:23:31.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:23:31.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:23:31.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:23:31.604 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.605 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.605 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.605 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:23:31.606 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:31.606 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.342800453000001, 2020-11-12T17:23:31.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:23:31.606 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.606 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.606 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:31.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:31.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:31.607 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:23:31.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.607 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:31.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:31.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:23:31.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:23:31.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:23:31.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:23:31.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:23:31.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:23:31.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:23:31.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:23:31.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:23:31.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:23:31.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:23:31.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:23:31.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:23:31.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:31.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:23:31.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:23:31.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:31.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:23:31.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:23:31.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:31.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:23:31.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:23:31.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:23:31.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:23:31.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:23:31.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:23:31.621 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.622 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.622 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.623 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:23:31.623 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:31.623 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.335556744, 2020-11-12T17:23:31.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:23:31.624 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.624 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:31.624 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:31.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:31.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:23:31.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:23:31.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:23:31.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:23:31.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:23:31.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:23:31.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:23:31.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:23:31.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:23:31.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:23:31.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:23:31.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:23:31.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:23:31.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:23:31.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:23:31.632 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.633 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.633 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.633 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:12624 3.e e31/20 3:70fa9130:::benchmark_data_smithi036_14212_object1577:head v 31'672, mlcod=31'665)", 2020-11-12T17:23:31.633 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.902009+0000", 2020-11-12T17:23:31.633 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.323106064999999, 2020-11-12T17:23:31.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.166019264, 2020-11-12T17:23:31.634 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:31.634 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:31.634 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:31.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:31.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.902009+0000", 2020-11-12T17:23:31.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:31.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:31.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.902009+0000", 2020-11-12T17:23:31.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:31.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:31.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.901984+0000", 2020-11-12T17:23:31.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6977000000000003e-05 2020-11-12T17:23:31.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:31.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.902081+0000", 2020-11-12T17:23:31.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.163400987 2020-11-12T17:23:31.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:31.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.065482+0000", 2020-11-12T17:23:31.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:23:31.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:31.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.065496+0000", 2020-11-12T17:23:31.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9926000000000005e-05 2020-11-12T17:23:31.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:31.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.065596+0000", 2020-11-12T17:23:31.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2503999999999997e-05 2020-11-12T17:23:31.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:31.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.065648+0000", 2020-11-12T17:23:31.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002237036 2020-11-12T17:23:31.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:31.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.067885+0000", 2020-11-12T17:23:31.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014297999999999999 2020-11-12T17:23:31.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:31.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:31.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:31.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.068028+0000", 2020-11-12T17:23:31.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.166019264 2020-11-12T17:23:31.642 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.642 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.642 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.642 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:31.642 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:31.642 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:31.643 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:31.226+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:31.644 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 27 16 12711 12695 3.67291 0 - 0.0181662 2020-11-12T17:23:31.645 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:31.645 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:31.636+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:31.744 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 7, 6] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-12T17:23:31.745 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 0 1 2020-11-12T17:23:31.746 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:31.742+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:31.801 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:31.838 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:31.838 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:23:31.839 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:31.839 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:23:31.841 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:31.886 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:31.880+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:31.947 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:31.942+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:31.999 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:32.062 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:32.063 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:32.063 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:32.063 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:32.065 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:32.065 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:32.060+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:32.167 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:32.164+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:32.232 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:32.233 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:32.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:32.233 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:32.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.233 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:608 3.5 3:a26db4d9:::benchmark_data_smithi036_14212_object75:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:32.234 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.150010+0000", 2020-11-12T17:23:32.234 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.078504542000001, 2020-11-12T17:23:32.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.058667379999999998, 2020-11-12T17:23:32.234 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.234 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.234 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.235 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.235 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.235 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 608 2020-11-12T17:23:32.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.235 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.150010+0000", 2020-11-12T17:23:32.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.150010+0000", 2020-11-12T17:23:32.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:32.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.149986+0000", 2020-11-12T17:23:32.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2921000000000001e-05 2020-11-12T17:23:32.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.150069+0000", 2020-11-12T17:23:32.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1763000000000001e-05 2020-11-12T17:23:32.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.150081+0000", 2020-11-12T17:23:32.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6579999999999999e-06 2020-11-12T17:23:32.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.150086+0000", 2020-11-12T17:23:32.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000574174 2020-11-12T17:23:32.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.150660+0000", 2020-11-12T17:23:32.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2744999999999994e-05 2020-11-12T17:23:32.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.150753+0000", 2020-11-12T17:23:32.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159424 2020-11-12T17:23:32.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.150913+0000", 2020-11-12T17:23:32.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0051184009999999999 2020-11-12T17:23:32.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.156031+0000", 2020-11-12T17:23:32.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.052496142000000003 2020-11-12T17:23:32.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.208527+0000", 2020-11-12T17:23:32.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3393000000000005e-05 2020-11-12T17:23:32.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.208621+0000", 2020-11-12T17:23:32.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6492000000000001e-05 2020-11-12T17:23:32.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.208677+0000", 2020-11-12T17:23:32.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.058667379999999998 2020-11-12T17:23:32.246 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.246 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.246 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.246 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:823 3.c 3:36f36e11:::benchmark_data_smithi036_14212_object102:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:32.247 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.330665+0000", 2020-11-12T17:23:32.247 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.897849432000001, 2020-11-12T17:23:32.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.095579737999999997, 2020-11-12T17:23:32.247 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.247 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.247 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.247 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.248 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.257 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 823 2020-11-12T17:23:32.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.258 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330665+0000", 2020-11-12T17:23:32.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330665+0000", 2020-11-12T17:23:32.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:32.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330633+0000", 2020-11-12T17:23:32.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109712 2020-11-12T17:23:32.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330743+0000", 2020-11-12T17:23:32.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3318e-05 2020-11-12T17:23:32.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330756+0000", 2020-11-12T17:23:32.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1728e-05 2020-11-12T17:23:32.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330768+0000", 2020-11-12T17:23:32.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0075436380000000001 2020-11-12T17:23:32.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.338311+0000", 2020-11-12T17:23:32.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010406 2020-11-12T17:23:32.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.338415+0000", 2020-11-12T17:23:32.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015149799999999999 2020-11-12T17:23:32.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.338567+0000", 2020-11-12T17:23:32.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058399790000000004 2020-11-12T17:23:32.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344407+0000", 2020-11-12T17:23:32.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.081675758000000001 2020-11-12T17:23:32.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426083+0000", 2020-11-12T17:23:32.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7353000000000003e-05 2020-11-12T17:23:32.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426160+0000", 2020-11-12T17:23:32.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4445999999999998e-05 2020-11-12T17:23:32.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426245+0000", 2020-11-12T17:23:32.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.095579737999999997 2020-11-12T17:23:32.269 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.269 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.269 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.269 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:824 3.c 3:36f36e11:::benchmark_data_smithi036_14212_object102:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:32.269 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.332862+0000", 2020-11-12T17:23:32.270 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.895652211000002, 2020-11-12T17:23:32.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098157404000000004, 2020-11-12T17:23:32.270 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.270 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.270 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.270 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.272 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.272 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 824 2020-11-12T17:23:32.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.272 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332862+0000", 2020-11-12T17:23:32.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332862+0000", 2020-11-12T17:23:32.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:23:32.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332822+0000", 2020-11-12T17:23:32.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108002 2020-11-12T17:23:32.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332930+0000", 2020-11-12T17:23:32.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:23:32.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332941+0000", 2020-11-12T17:23:32.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5189999999999998e-06 2020-11-12T17:23:32.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332948+0000", 2020-11-12T17:23:32.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064326440000000004 2020-11-12T17:23:32.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.339380+0000", 2020-11-12T17:23:32.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000138391 2020-11-12T17:23:32.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.339519+0000", 2020-11-12T17:23:32.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019887600000000001 2020-11-12T17:23:32.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.339717+0000", 2020-11-12T17:23:32.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046980709999999998 2020-11-12T17:23:32.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344416+0000", 2020-11-12T17:23:32.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.086535669999999995 2020-11-12T17:23:32.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.430951+0000", 2020-11-12T17:23:32.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0278999999999998e-05 2020-11-12T17:23:32.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.430991+0000", 2020-11-12T17:23:32.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.792e-05 2020-11-12T17:23:32.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.431019+0000", 2020-11-12T17:23:32.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098157404000000004 2020-11-12T17:23:32.283 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.283 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.283 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.284 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:823 3.c e22/20 ondisk, result = 0)", 2020-11-12T17:23:32.284 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.344956+0000", 2020-11-12T17:23:32.284 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.883558196999999, 2020-11-12T17:23:32.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.081305916000000006, 2020-11-12T17:23:32.285 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.285 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:32.285 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344956+0000", 2020-11-12T17:23:32.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344956+0000", 2020-11-12T17:23:32.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:32.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344936+0000", 2020-11-12T17:23:32.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0596000000000001e-05 2020-11-12T17:23:32.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344986+0000", 2020-11-12T17:23:32.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.080975511999999999 2020-11-12T17:23:32.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.425962+0000", 2020-11-12T17:23:32.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.055e-06 2020-11-12T17:23:32.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.425970+0000", 2020-11-12T17:23:32.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4287000000000001e-05 2020-11-12T17:23:32.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426054+0000", 2020-11-12T17:23:32.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5583999999999999e-05 2020-11-12T17:23:32.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426070+0000", 2020-11-12T17:23:32.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019232799999999999 2020-11-12T17:23:32.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426262+0000", 2020-11-12T17:23:32.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.081305916000000006 2020-11-12T17:23:32.292 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.292 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.293 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:928 3.2 e22/20 3:4c5417bc:::benchmark_data_smithi036_14212_object115:head v 22'80, mlcod=22'75)", 2020-11-12T17:23:32.293 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:32.293 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.796112265000001, 2020-11-12T17:23:32.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875, 2020-11-12T17:23:32.294 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.294 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.294 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:32.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:32.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:23:32.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432388+0000", 2020-11-12T17:23:32.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2012000000000003e-05 2020-11-12T17:23:32.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432440+0000", 2020-11-12T17:23:32.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.11616101500000001 2020-11-12T17:23:32.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548601+0000", 2020-11-12T17:23:32.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3270000000000001e-06 2020-11-12T17:23:32.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548609+0000", 2020-11-12T17:23:32.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6627999999999997e-05 2020-11-12T17:23:32.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548706+0000", 2020-11-12T17:23:32.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9027999999999999e-05 2020-11-12T17:23:32.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548755+0000", 2020-11-12T17:23:32.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038296739999999999 2020-11-12T17:23:32.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552584+0000", 2020-11-12T17:23:32.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010042 2020-11-12T17:23:32.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552685+0000", 2020-11-12T17:23:32.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875 2020-11-12T17:23:32.302 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.302 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.302 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.302 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1119 3.c 3:364fce39:::benchmark_data_smithi036_14212_object139:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:32.303 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:32.303 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.599033531, 2020-11-12T17:23:32.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111702974, 2020-11-12T17:23:32.303 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.303 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.303 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.304 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.304 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.304 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1119 2020-11-12T17:23:32.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.304 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:32.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:32.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:32.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629447+0000", 2020-11-12T17:23:32.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7503999999999993e-05 2020-11-12T17:23:32.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629545+0000", 2020-11-12T17:23:32.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2435999999999999e-05 2020-11-12T17:23:32.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629557+0000", 2020-11-12T17:23:32.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5889999999999999e-06 2020-11-12T17:23:32.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629564+0000", 2020-11-12T17:23:32.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003337773 2020-11-12T17:23:32.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.632902+0000", 2020-11-12T17:23:32.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010063199999999999 2020-11-12T17:23:32.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633002+0000", 2020-11-12T17:23:32.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000132698 2020-11-12T17:23:32.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633135+0000", 2020-11-12T17:23:32.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019819870000000002 2020-11-12T17:23:32.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.635117+0000", 2020-11-12T17:23:32.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.105938543 2020-11-12T17:23:32.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741056+0000", 2020-11-12T17:23:32.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8002000000000003e-05 2020-11-12T17:23:32.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741134+0000", 2020-11-12T17:23:32.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0025999999999998e-05 2020-11-12T17:23:32.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741184+0000", 2020-11-12T17:23:32.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111702974 2020-11-12T17:23:32.315 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.315 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.315 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.316 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1120 3.c 3:364fce39:::benchmark_data_smithi036_14212_object139:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:32.316 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.633688+0000", 2020-11-12T17:23:32.316 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.594826474000001, 2020-11-12T17:23:32.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109445737, 2020-11-12T17:23:32.317 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.317 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.317 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.317 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.317 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.317 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1120 2020-11-12T17:23:32.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.318 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633688+0000", 2020-11-12T17:23:32.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633688+0000", 2020-11-12T17:23:32.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:32.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633655+0000", 2020-11-12T17:23:32.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3597000000000006e-05 2020-11-12T17:23:32.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633739+0000", 2020-11-12T17:23:32.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1420000000000001e-05 2020-11-12T17:23:32.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633750+0000", 2020-11-12T17:23:32.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5629999999999999e-06 2020-11-12T17:23:32.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633756+0000", 2020-11-12T17:23:32.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022420200000000001 2020-11-12T17:23:32.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633980+0000", 2020-11-12T17:23:32.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8585000000000007e-05 2020-11-12T17:23:32.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.634069+0000", 2020-11-12T17:23:32.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012874800000000001 2020-11-12T17:23:32.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.634197+0000", 2020-11-12T17:23:32.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00092912099999999998 2020-11-12T17:23:32.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.635127+0000", 2020-11-12T17:23:32.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.107821245 2020-11-12T17:23:32.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.742948+0000", 2020-11-12T17:23:32.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100605 2020-11-12T17:23:32.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.743048+0000", 2020-11-12T17:23:32.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5061000000000004e-05 2020-11-12T17:23:32.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.743133+0000", 2020-11-12T17:23:32.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109445737 2020-11-12T17:23:32.328 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.328 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.328 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.329 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1119 3.c e23/20 ondisk, result = 0)", 2020-11-12T17:23:32.329 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.636786+0000", 2020-11-12T17:23:32.329 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.591728053000001, 2020-11-12T17:23:32.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.104404152, 2020-11-12T17:23:32.329 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.330 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:32.330 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636786+0000", 2020-11-12T17:23:32.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636786+0000", 2020-11-12T17:23:32.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:32.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636769+0000", 2020-11-12T17:23:32.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9211e-05 2020-11-12T17:23:32.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636818+0000", 2020-11-12T17:23:32.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.10413915 2020-11-12T17:23:32.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.740957+0000", 2020-11-12T17:23:32.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2655e-05 2020-11-12T17:23:32.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.740970+0000", 2020-11-12T17:23:32.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5438999999999995e-05 2020-11-12T17:23:32.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741036+0000", 2020-11-12T17:23:32.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0757999999999999e-05 2020-11-12T17:23:32.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741046+0000", 2020-11-12T17:23:32.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014404199999999999 2020-11-12T17:23:32.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741190+0000", 2020-11-12T17:23:32.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.104404152 2020-11-12T17:23:32.336 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.336 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.337 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.337 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1840 3.c 3:39eed79a:::benchmark_data_smithi036_14212_object229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:32.337 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.251239+0000", 2020-11-12T17:23:32.337 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.977275687999999, 2020-11-12T17:23:32.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.062416068999999998, 2020-11-12T17:23:32.338 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.338 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.338 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.338 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.338 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.338 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1840 2020-11-12T17:23:32.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.339 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.251239+0000", 2020-11-12T17:23:32.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.251239+0000", 2020-11-12T17:23:32.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99998 2020-11-12T17:23:32.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.251219+0000", 2020-11-12T17:23:32.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0568e-05 2020-11-12T17:23:32.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.251279+0000", 2020-11-12T17:23:32.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4309999999999997e-06 2020-11-12T17:23:32.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.251287+0000", 2020-11-12T17:23:32.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4089999999999999e-06 2020-11-12T17:23:32.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.251290+0000", 2020-11-12T17:23:32.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029675610000000001 2020-11-12T17:23:32.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254258+0000", 2020-11-12T17:23:32.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8183999999999997e-05 2020-11-12T17:23:32.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254316+0000", 2020-11-12T17:23:32.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000104789 2020-11-12T17:23:32.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254421+0000", 2020-11-12T17:23:32.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046881630000000004 2020-11-12T17:23:32.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.259109+0000", 2020-11-12T17:23:32.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.054382690999999997 2020-11-12T17:23:32.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.313491+0000", 2020-11-12T17:23:32.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010088 2020-11-12T17:23:32.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.313592+0000", 2020-11-12T17:23:32.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2315000000000002e-05 2020-11-12T17:23:32.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.313655+0000", 2020-11-12T17:23:32.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.062416068999999998 2020-11-12T17:23:32.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.349 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.350 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1920 3.5 3:ae3288f6:::benchmark_data_smithi036_14212_object239:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:32.350 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.315667+0000", 2020-11-12T17:23:32.350 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.9128471, 2020-11-12T17:23:32.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.077818432000000007, 2020-11-12T17:23:32.350 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.351 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.351 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1920 2020-11-12T17:23:32.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.352 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.315667+0000", 2020-11-12T17:23:32.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.315667+0000", 2020-11-12T17:23:32.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:23:32.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.315634+0000", 2020-11-12T17:23:32.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119218 2020-11-12T17:23:32.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.315753+0000", 2020-11-12T17:23:32.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2265e-05 2020-11-12T17:23:32.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.315766+0000", 2020-11-12T17:23:32.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2960000000000004e-06 2020-11-12T17:23:32.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.315772+0000", 2020-11-12T17:23:32.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039960400000000002 2020-11-12T17:23:32.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.319768+0000", 2020-11-12T17:23:32.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7330000000000006e-05 2020-11-12T17:23:32.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.319855+0000", 2020-11-12T17:23:32.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016058199999999999 2020-11-12T17:23:32.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.320016+0000", 2020-11-12T17:23:32.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012410959999999999 2020-11-12T17:23:32.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.321257+0000", 2020-11-12T17:23:32.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.072122222999999999 2020-11-12T17:23:32.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.393379+0000", 2020-11-12T17:23:32.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7037000000000002e-05 2020-11-12T17:23:32.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.393446+0000", 2020-11-12T17:23:32.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9246000000000003e-05 2020-11-12T17:23:32.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.393486+0000", 2020-11-12T17:23:32.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.077818432000000007 2020-11-12T17:23:32.362 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.362 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.363 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:4920 3.5 3:ad731e03:::benchmark_data_smithi036_14212_object614:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:32.363 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.831113+0000", 2020-11-12T17:23:32.363 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.397401139999999, 2020-11-12T17:23:32.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.060693576999999999, 2020-11-12T17:23:32.364 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.364 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.364 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.364 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.364 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.364 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 4920 2020-11-12T17:23:32.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.365 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.831113+0000", 2020-11-12T17:23:32.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.831113+0000", 2020-11-12T17:23:32.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:32.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.831081+0000", 2020-11-12T17:23:32.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3660999999999997e-05 2020-11-12T17:23:32.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.831175+0000", 2020-11-12T17:23:32.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2632999999999999e-05 2020-11-12T17:23:32.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.831187+0000", 2020-11-12T17:23:32.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0560000000000004e-06 2020-11-12T17:23:32.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.831192+0000", 2020-11-12T17:23:32.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003430485 2020-11-12T17:23:32.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.834623+0000", 2020-11-12T17:23:32.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3486999999999996e-05 2020-11-12T17:23:32.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.834696+0000", 2020-11-12T17:23:32.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014430199999999999 2020-11-12T17:23:32.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.834841+0000", 2020-11-12T17:23:32.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003653173 2020-11-12T17:23:32.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.838494+0000", 2020-11-12T17:23:32.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.053178371000000002 2020-11-12T17:23:32.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.891672+0000", 2020-11-12T17:23:32.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4616999999999994e-05 2020-11-12T17:23:32.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.891747+0000", 2020-11-12T17:23:32.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9818999999999998e-05 2020-11-12T17:23:32.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.891807+0000", 2020-11-12T17:23:32.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.060693576999999999 2020-11-12T17:23:32.375 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.376 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.376 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.376 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:23:32.376 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:32.376 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.724285562999999, 2020-11-12T17:23:32.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:23:32.377 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.377 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.377 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:32.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:32.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:32.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:23:32.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:23:32.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:23:32.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:23:32.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:23:32.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:23:32.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:23:32.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:23:32.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:23:32.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:23:32.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:23:32.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:23:32.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:23:32.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:23:32.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:23:32.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:23:32.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.386 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.386 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5984 3.d e25/20 3:b688a7d1:::benchmark_data_smithi036_14212_object747:head v 25'352, mlcod=25'345)", 2020-11-12T17:23:32.386 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.839095+0000", 2020-11-12T17:23:32.387 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.389419632999999, 2020-11-12T17:23:32.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.058628737, 2020-11-12T17:23:32.387 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.387 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.387 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.839095+0000", 2020-11-12T17:23:32.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.839095+0000", 2020-11-12T17:23:32.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:32.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.839072+0000", 2020-11-12T17:23:32.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7341000000000004e-05 2020-11-12T17:23:32.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.839149+0000", 2020-11-12T17:23:32.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.056630433000000001 2020-11-12T17:23:32.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.895780+0000", 2020-11-12T17:23:32.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.25e-06 2020-11-12T17:23:32.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.895787+0000", 2020-11-12T17:23:32.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3007000000000001e-05 2020-11-12T17:23:32.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.895860+0000", 2020-11-12T17:23:32.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7977999999999999e-05 2020-11-12T17:23:32.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.895888+0000", 2020-11-12T17:23:32.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017719579999999999 2020-11-12T17:23:32.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.897660+0000", 2020-11-12T17:23:32.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3478000000000004e-05 2020-11-12T17:23:32.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.897723+0000", 2020-11-12T17:23:32.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.058628737 2020-11-12T17:23:32.395 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.396 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.396 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.396 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:6040 3.d e25/20 3:b8c2806e:::benchmark_data_smithi036_14212_object754:head v 25'360, mlcod=25'354)", 2020-11-12T17:23:32.396 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:32.397 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.318979926000001, 2020-11-12T17:23:32.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431, 2020-11-12T17:23:32.397 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.397 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.397 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:32.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:32.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:32.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909516+0000", 2020-11-12T17:23:32.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6403999999999996e-05 2020-11-12T17:23:32.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909582+0000", 2020-11-12T17:23:32.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.113169626 2020-11-12T17:23:32.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022752+0000", 2020-11-12T17:23:32.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1850000000000004e-06 2020-11-12T17:23:32.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022760+0000", 2020-11-12T17:23:32.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7312999999999998e-05 2020-11-12T17:23:32.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022817+0000", 2020-11-12T17:23:32.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1387999999999999e-05 2020-11-12T17:23:32.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022838+0000", 2020-11-12T17:23:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001833487 2020-11-12T17:23:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024672+0000", 2020-11-12T17:23:32.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8751000000000005e-05 2020-11-12T17:23:32.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024761+0000", 2020-11-12T17:23:32.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431 2020-11-12T17:23:32.405 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.405 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.405 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.405 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9408 3.c 3:32425205:::benchmark_data_smithi036_14212_object1175:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:32.406 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:13.985618+0000", 2020-11-12T17:23:32.406 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.242895758, 2020-11-12T17:23:32.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.060360430999999999, 2020-11-12T17:23:32.406 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.406 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.408 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9408 2020-11-12T17:23:32.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.408 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.985618+0000", 2020-11-12T17:23:32.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.985618+0000", 2020-11-12T17:23:32.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999938 2020-11-12T17:23:32.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.985556+0000", 2020-11-12T17:23:32.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183494 2020-11-12T17:23:32.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.985740+0000", 2020-11-12T17:23:32.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6937999999999999e-05 2020-11-12T17:23:32.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.985767+0000", 2020-11-12T17:23:32.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.102e-05 2020-11-12T17:23:32.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.985778+0000", 2020-11-12T17:23:32.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044136030000000003 2020-11-12T17:23:32.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.990191+0000", 2020-11-12T17:23:32.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014766099999999999 2020-11-12T17:23:32.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.990339+0000", 2020-11-12T17:23:32.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000242499 2020-11-12T17:23:32.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.990582+0000", 2020-11-12T17:23:32.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047224390000000002 2020-11-12T17:23:32.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:13.995304+0000", 2020-11-12T17:23:32.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.050582582000000001 2020-11-12T17:23:32.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.045887+0000", 2020-11-12T17:23:32.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4938999999999997e-05 2020-11-12T17:23:32.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.045942+0000", 2020-11-12T17:23:32.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7279e-05 2020-11-12T17:23:32.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.045979+0000", 2020-11-12T17:23:32.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.060360430999999999 2020-11-12T17:23:32.418 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.419 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.419 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.419 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9832 3.c 3:3b0730c9:::benchmark_data_smithi036_14212_object1228:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:32.419 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.347361+0000", 2020-11-12T17:23:32.419 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.881153002000001, 2020-11-12T17:23:32.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094955906000000007, 2020-11-12T17:23:32.420 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.420 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.420 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.420 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.420 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.420 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9832 2020-11-12T17:23:32.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.421 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347361+0000", 2020-11-12T17:23:32.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347361+0000", 2020-11-12T17:23:32.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:32.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347342+0000", 2020-11-12T17:23:32.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5386000000000001e-05 2020-11-12T17:23:32.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347397+0000", 2020-11-12T17:23:32.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3729999999999998e-06 2020-11-12T17:23:32.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347403+0000", 2020-11-12T17:23:32.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0360000000000001e-05 2020-11-12T17:23:32.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347414+0000", 2020-11-12T17:23:32.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063595880000000002 2020-11-12T17:23:32.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.353773+0000", 2020-11-12T17:23:32.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017073300000000001 2020-11-12T17:23:32.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.353944+0000", 2020-11-12T17:23:32.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018458999999999999 2020-11-12T17:23:32.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.354129+0000", 2020-11-12T17:23:32.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018879140000000001 2020-11-12T17:23:32.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356017+0000", 2020-11-12T17:23:32.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.086152773000000002 2020-11-12T17:23:32.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442169+0000", 2020-11-12T17:23:32.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2831999999999995e-05 2020-11-12T17:23:32.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442262+0000", 2020-11-12T17:23:32.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4880000000000003e-05 2020-11-12T17:23:32.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442317+0000", 2020-11-12T17:23:32.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094955906000000007 2020-11-12T17:23:32.430 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.430 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.430 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.431 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9832 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:23:32.431 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.356564+0000", 2020-11-12T17:23:32.431 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.871950629000001, 2020-11-12T17:23:32.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.085784281000000004, 2020-11-12T17:23:32.431 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.431 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:32.431 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356564+0000", 2020-11-12T17:23:32.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356564+0000", 2020-11-12T17:23:32.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:23:32.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356529+0000", 2020-11-12T17:23:32.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9649999999999997e-05 2020-11-12T17:23:32.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356618+0000", 2020-11-12T17:23:32.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.085377103999999995 2020-11-12T17:23:32.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.441995+0000", 2020-11-12T17:23:32.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4127e-05 2020-11-12T17:23:32.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442009+0000", 2020-11-12T17:23:32.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013204699999999999 2020-11-12T17:23:32.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442142+0000", 2020-11-12T17:23:32.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.469e-05 2020-11-12T17:23:32.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442156+0000", 2020-11-12T17:23:32.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019165799999999999 2020-11-12T17:23:32.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442348+0000", 2020-11-12T17:23:32.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.085784281000000004 2020-11-12T17:23:32.439 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.439 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.439 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.440 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:32.440 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:32.440 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.702275998000001, 2020-11-12T17:23:32.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:23:32.440 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.441 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.441 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:23:32.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.441 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:32.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:32.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:32.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:23:32.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:23:32.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:23:32.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:23:32.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:23:32.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:23:32.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:23:32.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:23:32.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:23:32.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:23:32.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:23:32.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:23:32.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:23:32.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:23:32.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:23:32.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:23:32.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:23:32.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:23:32.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:23:32.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:23:32.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:23:32.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:23:32.452 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.452 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.452 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.452 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:23:32.453 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:32.453 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.698876064, 2020-11-12T17:23:32.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:23:32.453 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.453 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:32.453 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:32.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:32.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:32.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:23:32.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:23:32.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:23:32.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:23:32.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:23:32.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:23:32.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:23:32.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:23:32.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:23:32.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:23:32.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:23:32.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:23:32.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:23:32.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:23:32.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.461 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.461 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.461 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12608 3.5 3:a2c36073:::benchmark_data_smithi036_14212_object1575:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:23:32.461 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.888614+0000", 2020-11-12T17:23:32.462 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.339900362, 2020-11-12T17:23:32.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.057828715000000003, 2020-11-12T17:23:32.462 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.462 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:32.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.463 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.463 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12608 2020-11-12T17:23:32.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.463 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.888614+0000", 2020-11-12T17:23:32.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.888614+0000", 2020-11-12T17:23:32.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:32.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.888580+0000", 2020-11-12T17:23:32.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111399 2020-11-12T17:23:32.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.888691+0000", 2020-11-12T17:23:32.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.38e-05 2020-11-12T17:23:32.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.888705+0000", 2020-11-12T17:23:32.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0049999999999998e-06 2020-11-12T17:23:32.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.888712+0000", 2020-11-12T17:23:32.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039430480000000002 2020-11-12T17:23:32.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.892655+0000", 2020-11-12T17:23:32.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121002 2020-11-12T17:23:32.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:32.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.892776+0000", 2020-11-12T17:23:32.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000225675 2020-11-12T17:23:32.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:32.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.893002+0000", 2020-11-12T17:23:32.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015472439999999999 2020-11-12T17:23:32.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:32.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.894549+0000", 2020-11-12T17:23:32.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.051657605000000002 2020-11-12T17:23:32.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:32.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.946206+0000", 2020-11-12T17:23:32.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014603399999999999 2020-11-12T17:23:32.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:32.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.946352+0000", 2020-11-12T17:23:32.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0116000000000003e-05 2020-11-12T17:23:32.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:32.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.946443+0000", 2020-11-12T17:23:32.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.057828715000000003 2020-11-12T17:23:32.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.488 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.488 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.488 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:32.490 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:32.491 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:32.488+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:32.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 28 16 12711 12695 3.54173 0 - 0.0181662 2020-11-12T17:23:32.591 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:32.586+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:32.619 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:23:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.943620662000001, 2020-11-12T17:23:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.943681019, 2020-11-12T17:23:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:23:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:23:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:23:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:23:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:23:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:23:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:23:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:23:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:23:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:23:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:23:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:23:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:23:32.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:23:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:23:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:23:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:23:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:23:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:23:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0069144059999999997 2020-11-12T17:23:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:23:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.943333165, 2020-11-12T17:23:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.943560092, 2020-11-12T17:23:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:23:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:23:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:23:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:23:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:23:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:23:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:23:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:23:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:23:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:23:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:23:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:23:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:23:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:23:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:23:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:23:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:23:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:23:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:23:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066887400000000003 2020-11-12T17:23:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.650 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:23:32.650 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.943112793999999, 2020-11-12T17:23:32.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.943486535, 2020-11-12T17:23:32.650 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:23:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:23:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:23:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:23:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:23:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:23:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:23:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:23:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:23:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:23:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:23:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:23:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:23:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:23:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:23:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:23:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:23:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:23:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:23:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0065026399999999996 2020-11-12T17:23:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:23:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:23:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.946697328999999, 2020-11-12T17:23:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.947219837, 2020-11-12T17:23:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:23:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:23:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:23:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:23:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:23:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:23:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:23:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:23:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:23:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:23:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:23:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:23:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:23:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:23:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:23:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:23:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:23:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:23:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:23:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.008598227 2020-11-12T17:23:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:23:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.946294968, 2020-11-12T17:23:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946958466, 2020-11-12T17:23:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:23:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:23:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:23:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:23:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:23:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:23:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:23:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:23:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:23:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:23:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:23:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:23:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:23:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:23:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:23:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:23:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:23:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:23:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:23:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0087934339999999993 2020-11-12T17:23:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:23:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.945970975, 2020-11-12T17:23:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946776513, 2020-11-12T17:23:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:23:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:23:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:23:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:23:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:23:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:23:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:23:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:23:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:23:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:23:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:23:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:23:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:23:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:23:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:23:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:23:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:23:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:23:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:23:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0085942150000000005 2020-11-12T17:23:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:23:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.945727264, 2020-11-12T17:23:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946676022, 2020-11-12T17:23:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:23:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:23:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:23:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:23:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:23:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:23:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:23:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:23:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:23:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:23:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:23:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:23:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:23:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:23:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:23:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:23:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:23:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:23:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084242250000000005 2020-11-12T17:23:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:23:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.945489116999999, 2020-11-12T17:23:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946598835, 2020-11-12T17:23:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:23:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:23:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:23:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:23:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:23:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:23:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:23:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:23:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:23:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:23:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:23:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:23:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:23:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:23:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:23:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:23:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:23:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:23:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:23:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082401520000000006 2020-11-12T17:23:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:23:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.945287077, 2020-11-12T17:23:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946538732, 2020-11-12T17:23:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:23:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:23:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:23:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:23:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:23:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:23:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:23:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:23:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:23:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:23:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:23:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:23:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:23:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:23:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:23:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:23:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:23:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:23:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:23:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080944450000000005 2020-11-12T17:23:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:23:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.945081707, 2020-11-12T17:23:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946481473, 2020-11-12T17:23:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:23:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:23:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:23:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:23:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:23:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:23:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:23:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:23:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:23:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:23:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:23:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:23:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:23:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:23:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:23:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:23:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:23:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:23:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0079811910000000003 2020-11-12T17:23:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:23:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.944895880000001, 2020-11-12T17:23:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946439952, 2020-11-12T17:23:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:23:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:23:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:23:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:23:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:23:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:23:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:23:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:23:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:23:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:23:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:23:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:23:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:23:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:23:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:23:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:23:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:23:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:23:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078504909999999994 2020-11-12T17:23:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:23:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.944698916, 2020-11-12T17:23:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946384512, 2020-11-12T17:23:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:23:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:23:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:23:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:23:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:23:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:23:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:23:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:23:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:23:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:23:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:23:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:23:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:23:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:23:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:23:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:23:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:23:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:23:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:23:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077190510000000002 2020-11-12T17:23:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:23:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.944502886, 2020-11-12T17:23:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946341835, 2020-11-12T17:23:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:23:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:23:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:23:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:23:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:23:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:23:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:23:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:23:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:23:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:23:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:23:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:23:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:23:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:23:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:23:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:23:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:23:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:23:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:23:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0075727440000000002 2020-11-12T17:23:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:23:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.944322086, 2020-11-12T17:23:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946301224999999, 2020-11-12T17:23:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:23:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:23:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:23:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:23:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:23:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:23:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:23:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:23:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:23:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:23:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:23:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:23:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:23:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:23:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:23:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:23:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:23:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:23:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:23:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074572179999999998 2020-11-12T17:23:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:23:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.944126132999999, 2020-11-12T17:23:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946245713, 2020-11-12T17:23:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:23:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:23:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:23:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:23:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:23:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:23:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:23:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:23:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:23:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:23:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:23:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:23:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:23:32.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:23:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:23:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:23:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:23:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:23:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:23:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073114699999999996 2020-11-12T17:23:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:23:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.943932524999999, 2020-11-12T17:23:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 12.946192382, 2020-11-12T17:23:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:23:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:23:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:23:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:23:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:23:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:23:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:23:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:23:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:23:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:23:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:23:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:23:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:23:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:23:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:23:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:23:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:23:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:23:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:23:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:23:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071789669999999996 2020-11-12T17:23:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:23:32.851 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 16 2020-11-12T17:23:32.851 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:32.851 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:32.853 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:23:32.854 INFO:teuthology.orchestra.run.smithi036.stderr:reweighted osd.0 to 1 (10000) 2020-11-12T17:23:32.854 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 1 1 2020-11-12T17:23:32.855 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:32.844+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:32.855 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:32.956 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:32.950+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:33.033 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:33.034 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:33.034 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:33.034 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:33.034 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:33.045 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:33.054 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:33.048+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:33.074 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:33.117 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:33.208 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:33.209 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:33.209 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:33.209 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:33.202+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:33.223 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:33.224 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:33.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:33.224 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:33.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.225 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:23:33.225 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:23:33.225 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.550297393999999, 2020-11-12T17:23:33.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:23:33.225 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:33.226 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:23:33.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:33.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:33.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:33.226 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:23:33.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.226 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:33.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:33.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:23:33.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:33.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:33.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:23:33.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:23:33.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:33.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:23:33.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:23:33.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:33.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:23:33.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:23:33.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:33.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:23:33.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:23:33.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:33.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:23:33.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:23:33.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:23:33.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:23:33.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:33.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:23:33.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:23:33.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:23:33.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:23:33.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:33.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:23:33.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:23:33.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:23:33.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:23:33.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:33.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:23:33.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:23:33.236 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.236 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:33.236 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.236 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:33.236 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:23:33.237 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.549895033, 2020-11-12T17:23:33.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:23:33.237 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:33.237 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:33.237 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:33.237 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:33.237 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:33.238 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:23:33.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.238 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:33.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:33.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:23:33.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:33.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:33.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:23:33.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:23:33.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:33.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:23:33.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:23:33.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:33.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:23:33.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:23:33.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:33.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:23:33.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:23:33.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:33.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:23:33.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:23:33.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:23:33.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:23:33.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:33.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:23:33.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:23:33.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:23:33.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:23:33.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:33.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:23:33.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:23:33.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:23:33.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:23:33.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:33.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:23:33.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:23:33.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:33.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:23:33.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:23:33.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:33.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:23:33.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:23:33.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:33.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:23:33.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:23:33.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:33.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:23:33.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:23:33.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:33.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:23:33.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:23:33.252 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.252 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:33.252 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.252 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:33.253 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:23:33.253 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.54957104, 2020-11-12T17:23:33.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:23:33.253 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:33.253 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:33.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:33.254 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:33.254 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:33.254 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:23:33.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.254 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:33.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:33.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:23:33.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:33.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:33.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:23:33.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:23:33.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:33.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:23:33.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:23:33.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:33.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:23:33.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:23:33.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:33.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:23:33.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:23:33.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:33.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:23:33.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:23:33.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:23:33.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:23:33.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:33.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:23:33.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:23:33.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:23:33.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:23:33.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:33.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:23:33.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:23:33.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:23:33.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:23:33.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:33.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:23:33.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:23:33.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:33.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:23:33.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:23:33.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:33.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:23:33.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:23:33.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:33.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:23:33.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:23:33.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:33.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:23:33.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:23:33.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:33.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:23:33.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:23:33.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.267 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:33.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.268 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:33.268 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:23:33.268 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.549327329, 2020-11-12T17:23:33.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:23:33.268 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:33.269 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:33.269 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:33.269 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:33.269 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:33.269 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:23:33.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.270 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:33.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:33.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:23:33.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:33.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:33.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:23:33.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:33.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:33.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:23:33.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:23:33.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:33.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:23:33.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:23:33.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:33.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:23:33.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:23:33.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:33.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:23:33.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:23:33.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:23:33.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:23:33.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:33.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:23:33.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:23:33.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:23:33.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:23:33.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:33.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:23:33.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:23:33.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:23:33.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:23:33.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:33.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:23:33.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:23:33.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:33.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:23:33.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:23:33.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:33.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:23:33.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:23:33.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:33.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:23:33.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:23:33.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:33.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:23:33.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:23:33.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:33.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:23:33.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:23:33.283 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.283 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:33.284 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.285 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:33.286 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:23:33.286 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.549089181999999, 2020-11-12T17:23:33.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:23:33.286 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:33.286 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:33.287 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:33.287 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:33.287 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:33.287 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:23:33.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.287 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:33.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:33.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:23:33.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:33.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:33.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:23:33.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:23:33.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:33.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:23:33.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:23:33.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:33.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:23:33.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:23:33.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:33.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:23:33.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:23:33.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:33.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:23:33.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:23:33.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:23:33.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:23:33.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:33.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:23:33.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:23:33.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:23:33.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:23:33.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:33.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:23:33.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:23:33.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:23:33.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:23:33.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:33.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:23:33.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:23:33.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:33.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:23:33.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:23:33.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:33.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:23:33.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:23:33.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:33.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:23:33.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:23:33.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:33.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:23:33.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:23:33.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:33.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:23:33.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:23:33.301 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.301 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:33.302 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.302 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:33.302 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:23:33.302 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.548887142, 2020-11-12T17:23:33.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:23:33.303 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:33.303 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:33.303 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:33.303 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:33.303 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:33.304 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:23:33.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.304 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:33.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:33.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:23:33.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:33.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:33.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:23:33.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:23:33.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:33.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:23:33.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:23:33.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:33.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:23:33.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:23:33.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:33.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:23:33.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:23:33.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:33.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:23:33.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:23:33.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:23:33.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:23:33.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:33.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:23:33.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:23:33.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:23:33.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:23:33.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:33.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:23:33.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:23:33.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:33.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:23:33.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:23:33.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:33.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:23:33.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:23:33.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:33.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:23:33.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:23:33.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:33.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:23:33.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:23:33.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:33.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:23:33.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:23:33.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:33.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:23:33.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:23:33.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:33.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:23:33.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:23:33.319 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.319 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:33.319 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:33.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.319 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:33.319 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:23:33.319 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.548681772, 2020-11-12T17:23:33.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:23:33.320 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:33.320 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:33.320 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:33.320 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:33.320 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:33.320 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:23:33.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:33.321 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:33.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:33.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:23:35.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:23:35.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:35.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:23:35.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:23:35.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:23:35.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:23:35.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:23:35.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:23:35.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:23:35.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:23:35.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:23:35.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:23:35.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:23:35.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:23:35.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:23:35.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:23:35.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:23:35.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:23:35.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:23:35.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:23:35.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:23:35.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:23:35.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:23:35.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:23:35.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:23:35.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:23:35.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:23:35.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:23:35.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:23:35.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:23:35.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:23:35.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:23:35.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.335 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.335 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.336 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:35.336 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:23:35.336 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.548495945000001, 2020-11-12T17:23:35.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:23:35.336 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.336 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.337 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.337 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.337 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.337 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:23:35.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.337 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:23:35.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:23:35.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:35.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:23:35.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:23:35.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:23:35.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:23:35.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:23:35.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:23:35.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:23:35.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:23:35.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:23:35.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:23:35.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:23:35.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:23:35.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:23:35.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:23:35.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:23:35.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:23:35.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:23:35.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:23:35.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:23:35.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:23:35.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:23:35.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:23:35.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:23:35.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:23:35.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:23:35.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:23:35.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:23:35.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:23:35.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:23:35.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:23:35.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.349 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.350 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:35.350 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:23:35.350 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.548298981, 2020-11-12T17:23:35.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:23:35.350 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.350 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.351 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:23:35.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.351 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:23:35.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:23:35.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:23:35.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:23:35.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:23:35.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:23:35.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:23:35.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:23:35.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:23:35.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:23:35.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:23:35.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:23:35.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:23:35.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:23:35.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:23:35.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:23:35.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:23:35.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:23:35.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:23:35.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:23:35.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:23:35.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:23:35.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:23:35.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:23:35.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:23:35.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:23:35.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:23:35.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:23:35.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:23:35.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:23:35.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:23:35.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:23:35.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:23:35.364 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.364 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.364 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.365 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:35.365 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:23:35.365 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.548102951000001, 2020-11-12T17:23:35.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:23:35.365 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.365 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.365 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.366 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.366 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.366 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:23:35.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.366 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:23:35.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:23:35.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:23:35.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:23:35.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:23:35.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:23:35.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:23:35.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:23:35.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:23:35.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:23:35.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:23:35.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:23:35.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:23:35.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:23:35.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:23:35.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:23:35.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:23:35.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:23:35.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:23:35.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:23:35.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:23:35.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:23:35.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:23:35.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:23:35.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:23:35.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:23:35.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:23:35.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:23:35.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:23:35.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:23:35.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:23:35.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:23:35.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:23:35.379 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.379 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.379 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.379 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:35.379 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:23:35.380 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.547922151, 2020-11-12T17:23:35.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:23:35.380 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.380 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.380 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.380 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.380 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.381 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:23:35.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.381 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:23:35.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:23:35.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:23:35.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:23:35.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:23:35.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:23:35.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:23:35.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:23:35.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:23:35.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:23:35.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:23:35.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:23:35.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:23:35.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:23:35.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:23:35.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:23:35.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:23:35.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:23:35.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:23:35.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:23:35.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:23:35.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:23:35.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:23:35.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:23:35.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:23:35.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:23:35.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:23:35.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:23:35.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:23:35.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:23:35.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:23:35.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:23:35.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:23:35.393 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.393 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.393 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.394 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:35.394 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:23:35.394 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.547726197999999, 2020-11-12T17:23:35.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:23:35.394 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.395 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.395 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:23:35.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.395 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:23:35.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:23:35.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:23:35.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:23:35.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:23:35.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:23:35.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:23:35.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:23:35.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:23:35.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:23:35.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:23:35.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:23:35.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:23:35.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:23:35.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:23:35.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:23:35.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:23:35.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:23:35.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:23:35.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:23:35.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:23:35.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:23:35.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:23:35.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:23:35.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:23:35.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:23:35.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:23:35.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:23:35.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:23:35.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:23:35.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:23:35.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:23:35.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:23:35.407 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.408 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.408 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:35.409 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:23:35.409 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.547532589999999, 2020-11-12T17:23:35.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:23:35.409 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.409 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.409 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.409 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.409 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.410 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:23:35.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.410 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:23:35.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:23:35.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:23:35.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:23:35.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:23:35.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:23:35.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:23:35.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:23:35.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:23:35.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:23:35.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:23:35.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:23:35.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:23:35.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:23:35.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:23:35.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:23:35.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:23:35.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:23:35.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:23:35.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:23:35.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:23:35.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:23:35.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:23:35.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:23:35.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:23:35.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:23:35.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:23:35.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:23:35.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:23:35.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:23:35.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:23:35.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:23:35.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:23:35.422 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.422 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.423 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.423 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:35.423 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:23:35.423 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.547220726999999, 2020-11-12T17:23:35.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:23:35.423 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.424 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.424 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.424 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.424 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.424 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:23:35.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.424 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:23:35.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:23:35.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:23:35.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:23:35.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:23:35.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:23:35.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:23:35.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:23:35.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:23:35.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:23:35.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:23:35.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:23:35.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:23:35.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:23:35.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:23:35.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:23:35.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:23:35.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:23:35.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:23:35.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:23:35.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:23:35.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:23:35.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:23:35.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:23:35.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:23:35.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:23:35.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:23:35.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:23:35.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:23:35.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:23:35.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:23:35.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:23:35.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:23:35.439 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.440 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.440 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:35.440 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:23:35.440 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.54693323, 2020-11-12T17:23:35.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:23:35.441 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.441 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.441 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:23:35.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.442 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:23:35.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:23:35.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:23:35.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:23:35.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:23:35.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:23:35.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:23:35.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:23:35.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:23:35.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:23:35.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:23:35.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:23:35.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:23:35.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:23:35.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:23:35.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:23:35.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:23:35.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:23:35.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:23:35.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:23:35.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:23:35.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:23:35.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:23:35.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:23:35.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:23:35.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:23:35.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:23:35.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:23:35.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:23:35.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:23:35.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:23:35.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:23:35.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:23:35.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.453 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.466 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:23:35.467 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:23:35.467 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.546712858999999, 2020-11-12T17:23:35.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:23:35.467 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.468 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.469 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:23:35.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.469 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:23:35.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:23:35.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:23:35.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:23:35.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:23:35.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:23:35.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:23:35.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:23:35.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:23:35.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:23:35.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:23:35.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:23:35.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:23:35.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:23:35.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:23:35.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:23:35.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:23:35.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:23:35.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:23:35.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:23:35.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:23:35.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:23:35.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:23:35.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:23:35.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:23:35.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:23:35.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:23:35.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:23:35.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:23:35.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:23:35.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:23:35.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:23:35.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:23:35.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:23:35.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:23:35.484 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.484 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.484 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.485 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12712 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e37)", 2020-11-12T17:23:35.485 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:32.853391+0000", 2020-11-12T17:23:35.485 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.36654321499999998, 2020-11-12T17:23:35.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.031267344000000002, 2020-11-12T17:23:35.486 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.486 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.486 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.486 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.486 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.486 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12712 2020-11-12T17:23:35.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.487 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.853391+0000", 2020-11-12T17:23:35.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.853391+0000", 2020-11-12T17:23:35.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999528 2020-11-12T17:23:35.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.853343+0000", 2020-11-12T17:23:35.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000152504 2020-11-12T17:23:35.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.853496+0000", 2020-11-12T17:23:35.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1753e-05 2020-11-12T17:23:35.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.853518+0000", 2020-11-12T17:23:35.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2272999999999999e-05 2020-11-12T17:23:35.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.853530+0000", 2020-11-12T17:23:35.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.02608164 2020-11-12T17:23:35.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.879612+0000", 2020-11-12T17:23:35.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020834400000000001 2020-11-12T17:23:35.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.879820+0000", 2020-11-12T17:23:35.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000331959 2020-11-12T17:23:35.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880152+0000", 2020-11-12T17:23:35.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037561460000000001 2020-11-12T17:23:35.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883908+0000", 2020-11-12T17:23:35.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00063348199999999999 2020-11-12T17:23:35.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.884541+0000", 2020-11-12T17:23:35.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8645000000000004e-05 2020-11-12T17:23:35.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.884610+0000", 2020-11-12T17:23:35.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7874999999999998e-05 2020-11-12T17:23:35.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.884658+0000", 2020-11-12T17:23:35.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.031267344000000002 2020-11-12T17:23:35.497 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.497 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.497 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.497 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12991 3.a 3:5f1d7ba5:::benchmark_data_smithi036_14212_object1623:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e38)", 2020-11-12T17:23:35.498 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:33.084502+0000", 2020-11-12T17:23:35.498 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.13543201399999999, 2020-11-12T17:23:35.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.051699180999999997, 2020-11-12T17:23:35.498 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.498 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.498 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.498 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.499 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.499 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12991 2020-11-12T17:23:35.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.499 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084502+0000", 2020-11-12T17:23:35.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084502+0000", 2020-11-12T17:23:35.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:35.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084485+0000", 2020-11-12T17:23:35.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2123999999999998e-05 2020-11-12T17:23:35.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084537+0000", 2020-11-12T17:23:35.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2679999999999997e-06 2020-11-12T17:23:35.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084544+0000", 2020-11-12T17:23:35.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7049999999999999e-06 2020-11-12T17:23:35.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084547+0000", 2020-11-12T17:23:35.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0059216099999999999 2020-11-12T17:23:35.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.090468+0000", 2020-11-12T17:23:35.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018754700000000001 2020-11-12T17:23:35.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.090656+0000", 2020-11-12T17:23:35.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030988499999999998 2020-11-12T17:23:35.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.090966+0000", 2020-11-12T17:23:35.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030794519999999999 2020-11-12T17:23:35.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.094045+0000", 2020-11-12T17:23:35.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.041806034999999998 2020-11-12T17:23:35.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.135851+0000", 2020-11-12T17:23:35.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028523900000000001 2020-11-12T17:23:35.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.136136+0000", 2020-11-12T17:23:35.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4614000000000002e-05 2020-11-12T17:23:35.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.136201+0000", 2020-11-12T17:23:35.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.051699180999999997 2020-11-12T17:23:35.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.510 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.511 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12992 3.a 3:5f1d7ba5:::benchmark_data_smithi036_14212_object1623:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e38)", 2020-11-12T17:23:35.511 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:33.084575+0000", 2020-11-12T17:23:35.511 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.13535884500000001, 2020-11-12T17:23:35.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.057814378999999999, 2020-11-12T17:23:35.512 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.512 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:35.512 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:35.512 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:35.512 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:35.512 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12992 2020-11-12T17:23:35.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.513 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084575+0000", 2020-11-12T17:23:35.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084575+0000", 2020-11-12T17:23:35.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:23:35.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084557+0000", 2020-11-12T17:23:35.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4902999999999999e-05 2020-11-12T17:23:35.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084612+0000", 2020-11-12T17:23:35.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8069999999999996e-06 2020-11-12T17:23:35.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084618+0000", 2020-11-12T17:23:35.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9189999999999999e-06 2020-11-12T17:23:35.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.084621+0000", 2020-11-12T17:23:35.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074062019999999998 2020-11-12T17:23:35.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.092027+0000", 2020-11-12T17:23:35.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6360000000000007e-05 2020-11-12T17:23:35.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.092113+0000", 2020-11-12T17:23:35.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159273 2020-11-12T17:23:35.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:23:35.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.092273+0000", 2020-11-12T17:23:35.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001779734 2020-11-12T17:23:35.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:35.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.094052+0000", 2020-11-12T17:23:35.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.048267610000000002 2020-11-12T17:23:35.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:35.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.142320+0000", 2020-11-12T17:23:35.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0864e-05 2020-11-12T17:23:35.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:35.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.142361+0000", 2020-11-12T17:23:35.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8651000000000001e-05 2020-11-12T17:23:35.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.142389+0000", 2020-11-12T17:23:35.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.057814378999999999 2020-11-12T17:23:35.526 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.527 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.527 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.528 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12991 3.a e38/31 ondisk, result = 0)", 2020-11-12T17:23:35.528 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:33.096425+0000", 2020-11-12T17:23:35.528 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.12350889900000001, 2020-11-12T17:23:35.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.039785131000000001, 2020-11-12T17:23:35.529 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:35.529 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:35.529 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:35.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:35.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.096425+0000", 2020-11-12T17:23:35.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:35.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:35.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.096425+0000", 2020-11-12T17:23:35.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:35.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:35.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.096399+0000", 2020-11-12T17:23:35.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:23:35.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:35.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.096465+0000", 2020-11-12T17:23:35.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.039302531000000002 2020-11-12T17:23:35.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:35.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.135767+0000", 2020-11-12T17:23:35.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.711e-06 2020-11-12T17:23:35.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:35.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.135773+0000", 2020-11-12T17:23:35.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6659000000000001e-05 2020-11-12T17:23:35.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:35.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.135829+0000", 2020-11-12T17:23:35.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2719e-05 2020-11-12T17:23:35.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:35.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.135842+0000", 2020-11-12T17:23:35.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000367931 2020-11-12T17:23:35.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:35.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:35.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:35.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:33.136210+0000", 2020-11-12T17:23:35.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.039785131000000001 2020-11-12T17:23:35.538 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.539 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.539 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.539 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:35.539 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:35.539 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:35.540 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:23:35.543 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:35.543 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:35.543 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:35.543 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:35.543 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:35.543 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:35.544 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:35.544 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:35.544 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:35.544 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:35.544 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:35.544 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 29 16 13539 13523 3.64264 0.462054 0.00551071 0.0342799 2020-11-12T17:23:35.545 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 30 16 14645 14629 3.80921 8.64062 0.00997994 0.0327415 2020-11-12T17:23:35.545 INFO:teuthology.orchestra.run.smithi036.stderr:reweighted osd.1 to 1 (10000) 2020-11-12T17:23:35.545 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 3 1 2020-11-12T17:23:35.546 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:35.547 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:33.770+0000 7f9a0b6b4700 -1 osd.5 38 handle_osd_map injecting map crc failure 2020-11-12T17:23:35.547 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:35.538+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:35.547 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:33.782+0000 7f7b4fea9700 -1 osd.4 38 handle_osd_map injecting map crc failure 2020-11-12T17:23:35.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 31 16 15517 15501 3.90607 6.8125 0.00667771 0.0319784 2020-11-12T17:23:35.642 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:35.636+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:35.708 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:35.709 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:35.719 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:35.743 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:35.736+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:35.852 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:35.853 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:35.853 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:35.846+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:35.856 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:35.954 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:35.950+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:36.016 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:36.016 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:36.025 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:36.071 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:36.064+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:36.139 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:36.140 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:36.152 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:36.197 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:36.192+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:36.277 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:36.272+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:36.318 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:36.325 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:36.333 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:36.377 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:36.374+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:36.478 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:36.472+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:36.496 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:36.497 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:36.506 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:36.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 32 16 16552 16536 4.03666 8.08594 0.00607232 0.0308928 2020-11-12T17:23:36.581 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:36.572+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:36.682 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:36.678+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:36.749 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:36.749 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:36.750 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:36.783 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:36.778+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:36.787 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:36.782+0000 7f7b4b297700 -1 osd.4 39 handle_osd_map injecting map crc failure 2020-11-12T17:23:36.794 INFO:teuthology.orchestra.run.smithi036.stderr:reweighted osd.3 to 1 (10000) 2020-11-12T17:23:36.801 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:23:36.849 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 4 1 2020-11-12T17:23:36.889 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:36.884+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:36.930 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:36.930 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:36.943 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:36.986 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:36.982+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:37.086 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:37.080+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:37.128 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:37.128 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:37.143 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:37.186 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:37.180+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:37.287 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:37.280+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:37.314 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:37.315 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:37.325 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:37.388 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:37.382+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:37.490 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:37.484+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:37.502 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:37.503 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:37.512 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:37.545 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:37.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 33 16 17710 17694 4.18846 9.04688 0.0100881 0.0298279 2020-11-12T17:23:37.590 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:37.586+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:37.681 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:37.682 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:37.693 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:37.694 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:37.684+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:37.718 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:37.751 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:38.939 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:23:38.946 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:38.946 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:38.946 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:38.946 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:38.947 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:38.947 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:38.947 INFO:teuthology.orchestra.run.smithi036.stderr:reweighted osd.4 to 1 (10000) 2020-11-12T17:23:38.947 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:38.947 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:18032 3.2 3:4a67b455:::benchmark_data_smithi036_14212_object2253:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:37.838523+0000", 2020-11-12T17:23:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0076403859999999999, 2020-11-12T17:23:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0076720110000000003, 2020-11-12T17:23:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 18032 2020-11-12T17:23:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.838523+0000", 2020-11-12T17:23:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.838523+0000", 2020-11-12T17:23:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999456 2020-11-12T17:23:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.838468+0000", 2020-11-12T17:23:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104201 2020-11-12T17:23:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.838573+0000", 2020-11-12T17:23:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1855000000000001e-05 2020-11-12T17:23:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.838584+0000", 2020-11-12T17:23:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3489999999999997e-06 2020-11-12T17:23:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.838591+0000", 2020-11-12T17:23:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051957050000000001 2020-11-12T17:23:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.843787+0000", 2020-11-12T17:23:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018868800000000001 2020-11-12T17:23:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.843975+0000", 2020-11-12T17:23:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030988000000000001 2020-11-12T17:23:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.844285+0000", 2020-11-12T17:23:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057623889999999997 2020-11-12T17:23:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:18032 3.2 e41/20)", 2020-11-12T17:23:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:37.846097+0000", 2020-11-12T17:23:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.6273999999999996e-05, 2020-11-12T17:23:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023259299999999999, 2020-11-12T17:23:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:23:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.846097+0000", 2020-11-12T17:23:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.846097+0000", 2020-11-12T17:23:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:23:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.846053+0000", 2020-11-12T17:23:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011434600000000001 2020-11-12T17:23:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.846168+0000", 2020-11-12T17:23:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2680000000000001e-05 2020-11-12T17:23:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.846250+0000", 2020-11-12T17:23:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7399999999999999e-06 2020-11-12T17:23:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.846260+0000", 2020-11-12T17:23:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6660000000000002e-05 2020-11-12T17:23:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.846327+0000", 2020-11-12T17:23:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4860000000000003e-06 2020-11-12T17:23:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:37.846336+0000", 2020-11-12T17:23:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023956199999999999 2020-11-12T17:23:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:38.964 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:38.964 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 2 2020-11-12T17:23:38.964 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:38.964 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:38.964 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:38.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:38.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:38.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:38.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:38.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:38.966 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:38.966 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 34 16 18730 18714 4.29963 7.96875 0.0110081 0.0290587 2020-11-12T17:23:38.966 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:38.932+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:38.967 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 5 1 2020-11-12T17:23:38.967 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:39.041 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:39.036+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:39.113 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:39.121 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:39.121 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:39.121 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:39.122 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:39.126 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:39.169 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:39.164+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:39.246 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:39.242+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:39.313 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:39.313 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:39.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:39.314 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:39.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.315 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:112 3.8 3:18b8dd66:::benchmark_data_smithi036_14212_object13:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:39.315 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.640501+0000", 2020-11-12T17:23:39.316 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.666222462999997, 2020-11-12T17:23:39.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14688447800000001, 2020-11-12T17:23:39.316 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.317 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.317 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.317 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.317 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.318 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 112 2020-11-12T17:23:39.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.318 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640501+0000", 2020-11-12T17:23:39.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640501+0000", 2020-11-12T17:23:39.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:39.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640467+0000", 2020-11-12T17:23:39.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6193000000000005e-05 2020-11-12T17:23:39.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640563+0000", 2020-11-12T17:23:39.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.377e-05 2020-11-12T17:23:39.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640577+0000", 2020-11-12T17:23:39.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9313e-05 2020-11-12T17:23:39.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640596+0000", 2020-11-12T17:23:39.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025484539999999999 2020-11-12T17:23:39.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.643145+0000", 2020-11-12T17:23:39.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6131000000000006e-05 2020-11-12T17:23:39.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.643231+0000", 2020-11-12T17:23:39.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108199 2020-11-12T17:23:39.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:39.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.643339+0000", 2020-11-12T17:23:39.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0053218750000000002 2020-11-12T17:23:39.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.648661+0000", 2020-11-12T17:23:39.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.138608647 2020-11-12T17:23:39.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787270+0000", 2020-11-12T17:23:39.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9970999999999999e-05 2020-11-12T17:23:39.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787330+0000", 2020-11-12T17:23:39.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6008999999999999e-05 2020-11-12T17:23:39.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787386+0000", 2020-11-12T17:23:39.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14688447800000001 2020-11-12T17:23:39.331 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.331 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.331 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.332 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:335 3.8 3:1a561d42:::benchmark_data_smithi036_14212_object41:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:39.332 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:39.332 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.498495079000001, 2020-11-12T17:23:39.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16935236200000001, 2020-11-12T17:23:39.332 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.333 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.333 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.333 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.333 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.333 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 335 2020-11-12T17:23:39.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.334 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:39.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:39.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999866 2020-11-12T17:23:39.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808094+0000", 2020-11-12T17:23:39.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000224563 2020-11-12T17:23:39.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808319+0000", 2020-11-12T17:23:39.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3512e-05 2020-11-12T17:23:39.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808332+0000", 2020-11-12T17:23:39.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9740000000000008e-06 2020-11-12T17:23:39.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808341+0000", 2020-11-12T17:23:39.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00166 2020-11-12T17:23:39.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810001+0000", 2020-11-12T17:23:39.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013877900000000001 2020-11-12T17:23:39.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810140+0000", 2020-11-12T17:23:39.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018191099999999999 2020-11-12T17:23:39.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:39.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810322+0000", 2020-11-12T17:23:39.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010403820000000001 2020-11-12T17:23:39.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811362+0000", 2020-11-12T17:23:39.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16607825100000001 2020-11-12T17:23:39.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977441+0000", 2020-11-12T17:23:39.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1192999999999995e-05 2020-11-12T17:23:39.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977502+0000", 2020-11-12T17:23:39.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8917000000000004e-05 2020-11-12T17:23:39.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977581+0000", 2020-11-12T17:23:39.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16935236200000001 2020-11-12T17:23:39.347 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.348 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.348 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.349 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:336 3.8 3:1a561d42:::benchmark_data_smithi036_14212_object41:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:39.349 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:39.349 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.498309919, 2020-11-12T17:23:39.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001, 2020-11-12T17:23:39.350 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.350 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.350 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.350 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.351 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 336 2020-11-12T17:23:39.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.351 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:39.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:39.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:23:39.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808370+0000", 2020-11-12T17:23:39.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8706e-05 2020-11-12T17:23:39.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808469+0000", 2020-11-12T17:23:39.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.329e-06 2020-11-12T17:23:39.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808478+0000", 2020-11-12T17:23:39.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.181e-06 2020-11-12T17:23:39.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808483+0000", 2020-11-12T17:23:39.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022620499999999998 2020-11-12T17:23:39.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810746+0000", 2020-11-12T17:23:39.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6533000000000006e-05 2020-11-12T17:23:39.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810842+0000", 2020-11-12T17:23:39.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018000000000000001 2020-11-12T17:23:39.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:39.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811022+0000", 2020-11-12T17:23:39.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00081152800000000005 2020-11-12T17:23:39.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811834+0000", 2020-11-12T17:23:39.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16750948399999999 2020-11-12T17:23:39.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979343+0000", 2020-11-12T17:23:39.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4766999999999998e-05 2020-11-12T17:23:39.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979408+0000", 2020-11-12T17:23:39.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3001999999999999e-05 2020-11-12T17:23:39.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979451+0000", 2020-11-12T17:23:39.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001 2020-11-12T17:23:39.379 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.379 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.379 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.379 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:335 3.8 e22/20 ondisk, result = 0)", 2020-11-12T17:23:39.380 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:39.380 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.493831424, 2020-11-12T17:23:39.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.164701714, 2020-11-12T17:23:39.380 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.380 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:39.380 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:39.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:39.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:39.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812856+0000", 2020-11-12T17:23:39.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2423999999999995e-05 2020-11-12T17:23:39.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812948+0000", 2020-11-12T17:23:39.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16219246800000001 2020-11-12T17:23:39.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.975141+0000", 2020-11-12T17:23:39.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0543999999999999e-05 2020-11-12T17:23:39.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.975151+0000", 2020-11-12T17:23:39.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002271398 2020-11-12T17:23:39.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977422+0000", 2020-11-12T17:23:39.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7550000000000006e-06 2020-11-12T17:23:39.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977432+0000", 2020-11-12T17:23:39.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016162899999999999 2020-11-12T17:23:39.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977594+0000", 2020-11-12T17:23:39.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.164701714 2020-11-12T17:23:39.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.392 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.393 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.393 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:656 3.b 3:d7e055d2:::benchmark_data_smithi036_14212_object81:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:39.394 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.182042+0000", 2020-11-12T17:23:39.394 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.124681789, 2020-11-12T17:23:39.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13346680499999999, 2020-11-12T17:23:39.395 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.395 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.395 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.396 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.396 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.396 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 656 2020-11-12T17:23:39.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.397 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182042+0000", 2020-11-12T17:23:39.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182042+0000", 2020-11-12T17:23:39.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999456 2020-11-12T17:23:39.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.181987+0000", 2020-11-12T17:23:39.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016009499999999999 2020-11-12T17:23:39.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182148+0000", 2020-11-12T17:23:39.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0428000000000002e-05 2020-11-12T17:23:39.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182168+0000", 2020-11-12T17:23:39.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0508e-05 2020-11-12T17:23:39.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.182178+0000", 2020-11-12T17:23:39.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003631713 2020-11-12T17:23:39.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.185810+0000", 2020-11-12T17:23:39.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020195900000000001 2020-11-12T17:23:39.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.186012+0000", 2020-11-12T17:23:39.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027031800000000002 2020-11-12T17:23:39.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:39.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.186282+0000", 2020-11-12T17:23:39.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045565750000000002 2020-11-12T17:23:39.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.190839+0000", 2020-11-12T17:23:39.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12440807500000001 2020-11-12T17:23:39.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315247+0000", 2020-11-12T17:23:39.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0984999999999997e-05 2020-11-12T17:23:39.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315338+0000", 2020-11-12T17:23:39.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170493 2020-11-12T17:23:39.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315509+0000", 2020-11-12T17:23:39.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13346680499999999 2020-11-12T17:23:39.417 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.417 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.417 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.418 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:656 3.b e22/20 ondisk, result = 0)", 2020-11-12T17:23:39.419 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.191193+0000", 2020-11-12T17:23:39.419 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.115530698999997, 2020-11-12T17:23:39.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124325132, 2020-11-12T17:23:39.420 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.420 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:39.420 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.191193+0000", 2020-11-12T17:23:39.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.191193+0000", 2020-11-12T17:23:39.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:23:39.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.191164+0000", 2020-11-12T17:23:39.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:23:39.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.191237+0000", 2020-11-12T17:23:39.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.123073712 2020-11-12T17:23:39.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.314311+0000", 2020-11-12T17:23:39.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5079999999999994e-06 2020-11-12T17:23:39.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.314320+0000", 2020-11-12T17:23:39.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089928999999999996 2020-11-12T17:23:39.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315219+0000", 2020-11-12T17:23:39.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1092e-05 2020-11-12T17:23:39.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315230+0000", 2020-11-12T17:23:39.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028759 2020-11-12T17:23:39.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.315518+0000", 2020-11-12T17:23:39.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.124325132 2020-11-12T17:23:39.433 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.433 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.433 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.434 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:808 3.b 3:d27ca39f:::benchmark_data_smithi036_14212_object100:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:39.435 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:39.435 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 33.986864885000003, 2020-11-12T17:23:39.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742, 2020-11-12T17:23:39.435 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.436 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.436 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 808 2020-11-12T17:23:39.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.437 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:39.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:39.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:23:39.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319816+0000", 2020-11-12T17:23:39.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012461199999999999 2020-11-12T17:23:39.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319941+0000", 2020-11-12T17:23:39.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4997000000000001e-05 2020-11-12T17:23:39.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319956+0000", 2020-11-12T17:23:39.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9940000000000003e-06 2020-11-12T17:23:39.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319963+0000", 2020-11-12T17:23:39.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011778870000000001 2020-11-12T17:23:39.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321141+0000", 2020-11-12T17:23:39.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010428400000000001 2020-11-12T17:23:39.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321245+0000", 2020-11-12T17:23:39.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117811 2020-11-12T17:23:39.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:39.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321363+0000", 2020-11-12T17:23:39.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001974511 2020-11-12T17:23:39.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323337+0000", 2020-11-12T17:23:39.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185308416 2020-11-12T17:23:39.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508646+0000", 2020-11-12T17:23:39.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3879000000000002e-05 2020-11-12T17:23:39.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508720+0000", 2020-11-12T17:23:39.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6706000000000002e-05 2020-11-12T17:23:39.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508776+0000", 2020-11-12T17:23:39.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742 2020-11-12T17:23:39.446 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.446 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.446 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.447 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:808 3.b e22/20 ondisk, result = 0)", 2020-11-12T17:23:39.447 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:39.447 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 33.983052247000003, 2020-11-12T17:23:39.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999, 2020-11-12T17:23:39.447 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.448 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:39.448 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:39.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:39.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:39.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323648+0000", 2020-11-12T17:23:39.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0744e-05 2020-11-12T17:23:39.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323709+0000", 2020-11-12T17:23:39.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18463727299999999 2020-11-12T17:23:39.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508346+0000", 2020-11-12T17:23:39.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.798e-06 2020-11-12T17:23:39.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508356+0000", 2020-11-12T17:23:39.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027103199999999999 2020-11-12T17:23:39.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508627+0000", 2020-11-12T17:23:39.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999993e-06 2020-11-12T17:23:39.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508637+0000", 2020-11-12T17:23:39.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014688799999999999 2020-11-12T17:23:39.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508784+0000", 2020-11-12T17:23:39.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999 2020-11-12T17:23:39.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.454 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.455 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5672 3.7 3:e4132891:::benchmark_data_smithi036_14212_object708:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:39.455 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:39.455 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 28.863368651999998, 2020-11-12T17:23:39.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906, 2020-11-12T17:23:39.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.455 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.456 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5672 2020-11-12T17:23:39.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.456 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:39.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:39.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:39.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443325+0000", 2020-11-12T17:23:39.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3981999999999996e-05 2020-11-12T17:23:39.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443419+0000", 2020-11-12T17:23:39.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8057e-05 2020-11-12T17:23:39.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443437+0000", 2020-11-12T17:23:39.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3709999999999996e-06 2020-11-12T17:23:39.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443444+0000", 2020-11-12T17:23:39.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019104530000000001 2020-11-12T17:23:39.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445354+0000", 2020-11-12T17:23:39.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2356999999999999e-05 2020-11-12T17:23:39.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445426+0000", 2020-11-12T17:23:39.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111113 2020-11-12T17:23:39.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:39.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445538+0000", 2020-11-12T17:23:39.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00086618700000000003 2020-11-12T17:23:39.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.446404+0000", 2020-11-12T17:23:39.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.205445288 2020-11-12T17:23:39.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651849+0000", 2020-11-12T17:23:39.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2787000000000005e-05 2020-11-12T17:23:39.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651942+0000", 2020-11-12T17:23:39.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2173000000000003e-05 2020-11-12T17:23:39.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652004+0000", 2020-11-12T17:23:39.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906 2020-11-12T17:23:39.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.465 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.466 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5672 3.7 e25/20 ondisk, result = 0)", 2020-11-12T17:23:39.466 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:39.466 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 28.854585258, 2020-11-12T17:23:39.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162, 2020-11-12T17:23:39.466 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.466 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:39.467 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:39.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:39.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:39.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452124+0000", 2020-11-12T17:23:39.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6100000000000003e-05 2020-11-12T17:23:39.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452160+0000", 2020-11-12T17:23:39.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199026693 2020-11-12T17:23:39.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651186+0000", 2020-11-12T17:23:39.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0820000000000001e-06 2020-11-12T17:23:39.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651194+0000", 2020-11-12T17:23:39.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00062788999999999998 2020-11-12T17:23:39.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651821+0000", 2020-11-12T17:23:39.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4558e-05 2020-11-12T17:23:39.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651836+0000", 2020-11-12T17:23:39.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018151300000000001 2020-11-12T17:23:39.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652017+0000", 2020-11-12T17:23:39.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162 2020-11-12T17:23:39.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.473 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.473 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:6048 3.7 3:e3840c9f:::benchmark_data_smithi036_14212_object755:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:39.474 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.919912+0000", 2020-11-12T17:23:39.474 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 28.386811565999999, 2020-11-12T17:23:39.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151432184, 2020-11-12T17:23:39.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.474 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.475 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.475 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.475 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.475 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 6048 2020-11-12T17:23:39.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.476 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.919912+0000", 2020-11-12T17:23:39.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.919912+0000", 2020-11-12T17:23:39.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:39.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.919863+0000", 2020-11-12T17:23:39.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013728500000000001 2020-11-12T17:23:39.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920000+0000", 2020-11-12T17:23:39.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1212e-05 2020-11-12T17:23:39.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920021+0000", 2020-11-12T17:23:39.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8639999999999996e-06 2020-11-12T17:23:39.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920029+0000", 2020-11-12T17:23:39.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00076714100000000005 2020-11-12T17:23:39.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920796+0000", 2020-11-12T17:23:39.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013040299999999999 2020-11-12T17:23:39.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920926+0000", 2020-11-12T17:23:39.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000194205 2020-11-12T17:23:39.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:39.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.921121+0000", 2020-11-12T17:23:39.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025300639999999998 2020-11-12T17:23:39.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.923651+0000", 2020-11-12T17:23:39.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14748789600000001 2020-11-12T17:23:39.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.071139+0000", 2020-11-12T17:23:39.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0044999999999996e-05 2020-11-12T17:23:39.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.071229+0000", 2020-11-12T17:23:39.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011548999999999999 2020-11-12T17:23:39.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.071344+0000", 2020-11-12T17:23:39.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151432184 2020-11-12T17:23:39.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.484 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.485 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:39.485 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:39.485 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.888235294000001, 2020-11-12T17:23:39.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:23:39.485 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.485 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.486 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:23:39.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.486 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:39.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:39.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:23:39.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:23:39.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:23:39.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:23:39.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:23:39.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:23:39.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:23:39.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:23:39.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:23:39.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:23:39.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:23:39.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:23:39.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:23:39.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:39.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:23:39.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:23:39.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:23:39.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:23:39.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:23:39.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:23:39.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:23:39.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:23:39.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:23:39.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:23:39.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.495 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.496 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:23:39.496 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:39.496 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.881291231999999, 2020-11-12T17:23:39.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:23:39.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.496 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:39.505 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:39.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:39.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:39.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:23:39.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:23:39.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:23:39.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:23:39.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:23:39.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:23:39.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:23:39.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:23:39.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:23:39.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:23:39.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:23:39.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:23:39.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:23:39.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:23:39.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.512 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.512 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.513 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:39.513 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:39.513 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.326214076999999, 2020-11-12T17:23:39.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866, 2020-11-12T17:23:39.513 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.513 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.513 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.514 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.514 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.514 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:39.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.514 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:39.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:39.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:39.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980460+0000", 2020-11-12T17:23:39.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012467899999999999 2020-11-12T17:23:39.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980585+0000", 2020-11-12T17:23:39.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6456e-05 2020-11-12T17:23:39.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980602+0000", 2020-11-12T17:23:39.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9169999999999995e-06 2020-11-12T17:23:39.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980611+0000", 2020-11-12T17:23:39.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015059000000000001 2020-11-12T17:23:39.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980761+0000", 2020-11-12T17:23:39.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9624999999999997e-05 2020-11-12T17:23:39.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980841+0000", 2020-11-12T17:23:39.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133702 2020-11-12T17:23:39.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:39.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980974+0000", 2020-11-12T17:23:39.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001625076 2020-11-12T17:23:39.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.982600+0000", 2020-11-12T17:23:39.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18301002199999999 2020-11-12T17:23:39.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165610+0000", 2020-11-12T17:23:39.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4160999999999998e-05 2020-11-12T17:23:39.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165674+0000", 2020-11-12T17:23:39.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000127661 2020-11-12T17:23:39.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165801+0000", 2020-11-12T17:23:39.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866 2020-11-12T17:23:39.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.526 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.527 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e27)", 2020-11-12T17:23:39.527 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:39.528 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.314502323999999, 2020-11-12T17:23:39.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678, 2020-11-12T17:23:39.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.528 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:23:39.529 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.529 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.529 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.529 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:39.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.530 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:39.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:23:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992202+0000", 2020-11-12T17:23:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5812e-05 2020-11-12T17:23:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992258+0000", 2020-11-12T17:23:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3090000000000001e-06 2020-11-12T17:23:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992267+0000", 2020-11-12T17:23:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7680000000000008e-06 2020-11-12T17:23:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992275+0000", 2020-11-12T17:23:39.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0019000000000003e-05 2020-11-12T17:23:39.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992335+0000", 2020-11-12T17:23:39.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0896999999999995e-05 2020-11-12T17:23:39.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:23:39.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992416+0000", 2020-11-12T17:23:39.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17331891299999999 2020-11-12T17:23:39.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165735+0000", 2020-11-12T17:23:39.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678 2020-11-12T17:23:39.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10064 3.7 3:e0dfa39d:::benchmark_data_smithi036_14212_object1257:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:39.544 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.293655205, 2020-11-12T17:23:39.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999, 2020-11-12T17:23:39.544 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.544 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.545 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.545 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.545 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.545 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10064 2020-11-12T17:23:39.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.546 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013037+0000", 2020-11-12T17:23:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7905000000000006e-05 2020-11-12T17:23:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013125+0000", 2020-11-12T17:23:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4722999999999999e-05 2020-11-12T17:23:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013140+0000", 2020-11-12T17:23:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6830000000000008e-06 2020-11-12T17:23:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013148+0000", 2020-11-12T17:23:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:23:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013223+0000", 2020-11-12T17:23:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020518000000000001 2020-11-12T17:23:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013428+0000", 2020-11-12T17:23:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023399799999999999 2020-11-12T17:23:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013662+0000", 2020-11-12T17:23:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034048939999999999 2020-11-12T17:23:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.017067+0000", 2020-11-12T17:23:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18367845899999999 2020-11-12T17:23:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200745+0000", 2020-11-12T17:23:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013196599999999999 2020-11-12T17:23:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200877+0000", 2020-11-12T17:23:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011756099999999999 2020-11-12T17:23:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200995+0000", 2020-11-12T17:23:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999 2020-11-12T17:23:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:10064 3.7 e27/20 ondisk, result = 0)", 2020-11-12T17:23:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.288041214, 2020-11-12T17:23:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999, 2020-11-12T17:23:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018663+0000", 2020-11-12T17:23:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1436e-05 2020-11-12T17:23:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018714+0000", 2020-11-12T17:23:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18186307199999999 2020-11-12T17:23:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200577+0000", 2020-11-12T17:23:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5204e-05 2020-11-12T17:23:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200592+0000", 2020-11-12T17:23:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110565 2020-11-12T17:23:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200703+0000", 2020-11-12T17:23:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2906000000000001e-05 2020-11-12T17:23:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200726+0000", 2020-11-12T17:23:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028337099999999998 2020-11-12T17:23:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.201009+0000", 2020-11-12T17:23:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999 2020-11-12T17:23:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19271 3.2 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:39.047191+0000", 2020-11-12T17:23:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.25953296100000001, 2020-11-12T17:23:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.131977556, 2020-11-12T17:23:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19271 2020-11-12T17:23:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.047191+0000", 2020-11-12T17:23:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.047191+0000", 2020-11-12T17:23:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.047157+0000", 2020-11-12T17:23:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9655999999999997e-05 2020-11-12T17:23:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.047247+0000", 2020-11-12T17:23:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.137e-05 2020-11-12T17:23:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.047258+0000", 2020-11-12T17:23:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4140000000000002e-06 2020-11-12T17:23:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.047264+0000", 2020-11-12T17:23:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097607579999999996 2020-11-12T17:23:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.057024+0000", 2020-11-12T17:23:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100011 2020-11-12T17:23:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.057125+0000", 2020-11-12T17:23:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00088375300000000003 2020-11-12T17:23:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.058008+0000", 2020-11-12T17:23:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024696980000000002 2020-11-12T17:23:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060478+0000", 2020-11-12T17:23:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.11855629099999999 2020-11-12T17:23:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.179034+0000", 2020-11-12T17:23:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0218999999999999e-05 2020-11-12T17:23:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.179114+0000", 2020-11-12T17:23:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3699000000000002e-05 2020-11-12T17:23:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.179168+0000", 2020-11-12T17:23:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.131977556 2020-11-12T17:23:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19272 3.2 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.25812486299999998, 2020-11-12T17:23:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899, 2020-11-12T17:23:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19272 2020-11-12T17:23:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:23:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048566+0000", 2020-11-12T17:23:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108874 2020-11-12T17:23:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048675+0000", 2020-11-12T17:23:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3494e-05 2020-11-12T17:23:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048688+0000", 2020-11-12T17:23:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8549999999999996e-06 2020-11-12T17:23:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048695+0000", 2020-11-12T17:23:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010513026 2020-11-12T17:23:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059208+0000", 2020-11-12T17:23:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107161 2020-11-12T17:23:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059315+0000", 2020-11-12T17:23:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019627499999999999 2020-11-12T17:23:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059511+0000", 2020-11-12T17:23:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014392770000000001 2020-11-12T17:23:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060951+0000", 2020-11-12T17:23:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18718517000000001 2020-11-12T17:23:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248136+0000", 2020-11-12T17:23:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099000000000003e-05 2020-11-12T17:23:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248198+0000", 2020-11-12T17:23:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7726999999999998e-05 2020-11-12T17:23:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248256+0000", 2020-11-12T17:23:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899 2020-11-12T17:23:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19280 3.b 3:d8a2f1b1:::benchmark_data_smithi036_14212_object2409:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:39.059417+0000", 2020-11-12T17:23:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.24730670099999999, 2020-11-12T17:23:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17050370200000001, 2020-11-12T17:23:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19280 2020-11-12T17:23:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059417+0000", 2020-11-12T17:23:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059417+0000", 2020-11-12T17:23:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059386+0000", 2020-11-12T17:23:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000167174 2020-11-12T17:23:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059553+0000", 2020-11-12T17:23:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2649e-05 2020-11-12T17:23:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059566+0000", 2020-11-12T17:23:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4980000000000003e-06 2020-11-12T17:23:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059572+0000", 2020-11-12T17:23:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011039870000000001 2020-11-12T17:23:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060676+0000", 2020-11-12T17:23:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010639100000000001 2020-11-12T17:23:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060783+0000", 2020-11-12T17:23:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018312299999999999 2020-11-12T17:23:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060966+0000", 2020-11-12T17:23:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041580059999999997 2020-11-12T17:23:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.065124+0000", 2020-11-12T17:23:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16470816499999999 2020-11-12T17:23:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.229832+0000", 2020-11-12T17:23:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9223e-05 2020-11-12T17:23:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.229871+0000", 2020-11-12T17:23:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9453000000000002e-05 2020-11-12T17:23:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.229921+0000", 2020-11-12T17:23:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17050370200000001 2020-11-12T17:23:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:39.643 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:39.645 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 35 16 19777 19761 4.41046 8.17969 0.0052306 0.0283229 2020-11-12T17:23:39.645 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:39.636+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:39.646 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:39.745 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:39.742+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:39.767 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:39.767 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20017 3.3 3:cfd07a9f:::benchmark_data_smithi036_14212_object2502:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.763045+0000", 2020-11-12T17:23:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0035973060000000002, 2020-11-12T17:23:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036338149999999999, 2020-11-12T17:23:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20017 2020-11-12T17:23:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763045+0000", 2020-11-12T17:23:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763045+0000", 2020-11-12T17:23:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763020+0000", 2020-11-12T17:23:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3084999999999996e-05 2020-11-12T17:23:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763094+0000", 2020-11-12T17:23:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5041e-05 2020-11-12T17:23:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:39.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763109+0000", 2020-11-12T17:23:39.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3619999999999995e-06 2020-11-12T17:23:39.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763118+0000", 2020-11-12T17:23:39.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7760000000000003e-05 2020-11-12T17:23:39.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:39.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763176+0000", 2020-11-12T17:23:39.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018786900000000001 2020-11-12T17:23:39.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:39.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763364+0000", 2020-11-12T17:23:39.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014187299999999999 2020-11-12T17:23:39.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:39.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763505+0000", 2020-11-12T17:23:39.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00045998700000000003 2020-11-12T17:23:39.777 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.778 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:39.778 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.778 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20018 3.3 3:cfd07a9f:::benchmark_data_smithi036_14212_object2502:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.778 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.763647+0000", 2020-11-12T17:23:39.778 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0029957859999999998, 2020-11-12T17:23:39.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031566620000000002, 2020-11-12T17:23:39.779 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:39.779 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:39.779 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:39.779 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:39.779 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.779 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20018 2020-11-12T17:23:39.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.780 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:39.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:39.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763647+0000", 2020-11-12T17:23:39.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:39.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:39.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763647+0000", 2020-11-12T17:23:39.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:39.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:39.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763614+0000", 2020-11-12T17:23:39.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7523999999999997e-05 2020-11-12T17:23:39.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:39.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763711+0000", 2020-11-12T17:23:39.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8919999999999998e-05 2020-11-12T17:23:39.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:39.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763730+0000", 2020-11-12T17:23:39.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8929999999999999e-06 2020-11-12T17:23:39.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.763737+0000", 2020-11-12T17:23:39.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000639377 2020-11-12T17:23:39.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:39.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.764376+0000", 2020-11-12T17:23:39.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013022000000000001 2020-11-12T17:23:39.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:39.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.764507+0000", 2020-11-12T17:23:39.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025376899999999999 2020-11-12T17:23:39.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:39.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.764760+0000", 2020-11-12T17:23:39.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011134820000000001 2020-11-12T17:23:39.787 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.787 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:39.787 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.788 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20019 3.3 3:cfd07a9f:::benchmark_data_smithi036_14212_object2502:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.788 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.765596+0000", 2020-11-12T17:23:39.788 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.001046576, 2020-11-12T17:23:39.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001295161, 2020-11-12T17:23:39.788 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:39.788 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:39.788 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:39.789 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:39.789 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.789 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20019 2020-11-12T17:23:39.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.789 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:39.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:39.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765596+0000", 2020-11-12T17:23:39.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:39.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:39.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765596+0000", 2020-11-12T17:23:39.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:39.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:39.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765562+0000", 2020-11-12T17:23:39.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2099e-05 2020-11-12T17:23:39.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:39.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765654+0000", 2020-11-12T17:23:39.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.322e-05 2020-11-12T17:23:39.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:39.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765668+0000", 2020-11-12T17:23:39.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8739999999999997e-06 2020-11-12T17:23:39.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765675+0000", 2020-11-12T17:23:39.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4215999999999996e-05 2020-11-12T17:23:39.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:39.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765739+0000", 2020-11-12T17:23:39.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000135251 2020-11-12T17:23:39.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:39.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765874+0000", 2020-11-12T17:23:39.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000233105 2020-11-12T17:23:39.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:39.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766107+0000", 2020-11-12T17:23:39.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00051090700000000001 2020-11-12T17:23:39.796 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.796 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:39.796 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.797 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20020 3.3 3:cfd07a9f:::benchmark_data_smithi036_14212_object2502:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.797 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.765907+0000", 2020-11-12T17:23:39.797 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00073622300000000004, 2020-11-12T17:23:39.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010596679999999999, 2020-11-12T17:23:39.797 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:39.797 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:23:39.798 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:39.798 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:39.798 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.798 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20020 2020-11-12T17:23:39.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.798 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:39.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:39.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765907+0000", 2020-11-12T17:23:39.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:39.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:39.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765907+0000", 2020-11-12T17:23:39.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:23:39.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:39.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765874+0000", 2020-11-12T17:23:39.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8679999999999997e-05 2020-11-12T17:23:39.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:39.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765972+0000", 2020-11-12T17:23:39.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3489000000000001e-05 2020-11-12T17:23:39.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:39.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765986+0000", 2020-11-12T17:23:39.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7130000000000002e-06 2020-11-12T17:23:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.765991+0000", 2020-11-12T17:23:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00089254600000000003 2020-11-12T17:23:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766884+0000", 2020-11-12T17:23:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00097746500000000006 2020-11-12T17:23:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20021 3.3 3.f95e0bf3 (undecoded) ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.766056+0000", 2020-11-12T17:23:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00058695100000000005, 2020-11-12T17:23:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00096390099999999997, 2020-11-12T17:23:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:23:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20021 2020-11-12T17:23:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766056+0000", 2020-11-12T17:23:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766056+0000", 2020-11-12T17:23:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:23:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766015+0000", 2020-11-12T17:23:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010924100000000001 2020-11-12T17:23:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766125+0000", 2020-11-12T17:23:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1755e-05 2020-11-12T17:23:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766136+0000", 2020-11-12T17:23:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5960000000000003e-06 2020-11-12T17:23:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766142+0000", 2020-11-12T17:23:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6267000000000006e-05 2020-11-12T17:23:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20022 3.3 3.f95e0bf3 (undecoded) ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.766194+0000", 2020-11-12T17:23:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.000449102, 2020-11-12T17:23:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00086984699999999998, 2020-11-12T17:23:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:23:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20022 2020-11-12T17:23:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766194+0000", 2020-11-12T17:23:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766194+0000", 2020-11-12T17:23:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:23:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766164+0000", 2020-11-12T17:23:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7188999999999995e-05 2020-11-12T17:23:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766251+0000", 2020-11-12T17:23:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0801e-05 2020-11-12T17:23:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766262+0000", 2020-11-12T17:23:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5450000000000003e-06 2020-11-12T17:23:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.766267+0000", 2020-11-12T17:23:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3706000000000002e-05 2020-11-12T17:23:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:19976 3.3 3:cf74ea8e:::benchmark_data_smithi036_14212_object2496:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.726091+0000", 2020-11-12T17:23:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.040552157999999998, 2020-11-12T17:23:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.041020495999999997, 2020-11-12T17:23:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 19976 2020-11-12T17:23:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.726091+0000", 2020-11-12T17:23:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.726091+0000", 2020-11-12T17:23:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:23:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.726060+0000", 2020-11-12T17:23:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0480000000000001e-05 2020-11-12T17:23:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.726151+0000", 2020-11-12T17:23:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3027000000000001e-05 2020-11-12T17:23:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.726164+0000", 2020-11-12T17:23:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5239999999999997e-06 2020-11-12T17:23:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.726170+0000", 2020-11-12T17:23:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037677019999999999 2020-11-12T17:23:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.729938+0000", 2020-11-12T17:23:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108659 2020-11-12T17:23:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.730047+0000", 2020-11-12T17:23:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016787400000000001 2020-11-12T17:23:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.730215+0000", 2020-11-12T17:23:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004340048 2020-11-12T17:23:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.734555+0000", 2020-11-12T17:23:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084640340000000005 2020-11-12T17:23:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:23:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 7 2020-11-12T17:23:39.825 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:39.826 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:23:39.826 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:39.810+0000 7f7b4fea9700 -1 osd.4 41 handle_osd_map injecting map crc failure 2020-11-12T17:23:39.827 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:39.835 INFO:teuthology.orchestra.run.smithi036.stderr:reweighted osd.5 to 1 (10000) 2020-11-12T17:23:39.839 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 7 1 2020-11-12T17:23:39.869 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:39.866+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:39.967 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:39.962+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:39.989 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:39.990 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:40.002 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:40.067 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:40.060+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:40.160 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:40.160 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:40.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.396257525000003, 2020-11-12T17:23:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:23:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:23:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:23:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:23:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:23:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:23:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:23:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:23:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:23:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:23:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:23:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:23:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:23:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:23:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:23:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:23:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:23:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:23:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:23:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:23:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:23:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:23:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:23:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:23:40.173 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.173 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.173 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.173 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:23:40.173 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.389458673999997, 2020-11-12T17:23:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:23:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:23:40.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:23:40.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:23:40.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:23:40.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:23:40.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:23:40.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:23:40.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:23:40.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:23:40.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:23:40.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:23:40.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:23:40.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:23:40.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:23:40.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:23:40.181 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.181 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.181 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.182 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1104 3.9 3:9f55e211:::benchmark_data_smithi036_14212_object137:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:40.182 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:40.182 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.537664323000001, 2020-11-12T17:23:40.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001, 2020-11-12T17:23:40.182 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.183 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.183 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.183 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.183 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.183 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1104 2020-11-12T17:23:40.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.183 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:40.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:40.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:40.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617385+0000", 2020-11-12T17:23:40.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9141999999999994e-05 2020-11-12T17:23:40.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617484+0000", 2020-11-12T17:23:40.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2413e-05 2020-11-12T17:23:40.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617497+0000", 2020-11-12T17:23:40.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1659999999999999e-06 2020-11-12T17:23:40.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617503+0000", 2020-11-12T17:23:40.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032791000000000001 2020-11-12T17:23:40.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620782+0000", 2020-11-12T17:23:40.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102198 2020-11-12T17:23:40.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620884+0000", 2020-11-12T17:23:40.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114058 2020-11-12T17:23:40.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:40.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620998+0000", 2020-11-12T17:23:40.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018203270000000001 2020-11-12T17:23:40.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622818+0000", 2020-11-12T17:23:40.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.203924995 2020-11-12T17:23:40.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826743+0000", 2020-11-12T17:23:40.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012106 2020-11-12T17:23:40.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826865+0000", 2020-11-12T17:23:40.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014220699999999999 2020-11-12T17:23:40.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827007+0000", 2020-11-12T17:23:40.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001 2020-11-12T17:23:40.194 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.194 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.195 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.195 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1104 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:40.195 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:40.195 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.532735541000001, 2020-11-12T17:23:40.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999, 2020-11-12T17:23:40.195 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.196 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:40.196 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:40.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:40.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:23:40.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622338+0000", 2020-11-12T17:23:40.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5814e-05 2020-11-12T17:23:40.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622374+0000", 2020-11-12T17:23:40.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20244251299999999 2020-11-12T17:23:40.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824817+0000", 2020-11-12T17:23:40.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.117e-05 2020-11-12T17:23:40.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824828+0000", 2020-11-12T17:23:40.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001882332 2020-11-12T17:23:40.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826710+0000", 2020-11-12T17:23:40.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6818000000000001e-05 2020-11-12T17:23:40.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826727+0000", 2020-11-12T17:23:40.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031566199999999997 2020-11-12T17:23:40.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827043+0000", 2020-11-12T17:23:40.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999 2020-11-12T17:23:40.202 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.202 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.203 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.203 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:40.203 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:40.203 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.146199897999999, 2020-11-12T17:23:40.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:23:40.204 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.204 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.204 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.204 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.204 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.204 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:23:40.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.205 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:40.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:40.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:40.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:23:40.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:23:40.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:23:40.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:23:40.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:23:40.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:23:40.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:23:40.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:23:40.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:23:40.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:23:40.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:23:40.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:23:40.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:40.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:23:40.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:23:40.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:23:40.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:23:40.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:23:40.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:23:40.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:23:40.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:23:40.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:23:40.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:23:40.214 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.215 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.215 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.215 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:40.215 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:40.216 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.138984717, 2020-11-12T17:23:40.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:23:40.216 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.216 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:40.216 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:40.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:40.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:23:40.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:23:40.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:23:40.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:23:40.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:23:40.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:23:40.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:23:40.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:23:40.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:23:40.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:23:40.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:23:40.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:23:40.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:23:40.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:23:40.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:23:40.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.224 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.224 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:4896 3.3 3:c1830331:::benchmark_data_smithi036_14212_object611:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:40.225 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:40.225 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.338914794000001, 2020-11-12T17:23:40.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001, 2020-11-12T17:23:40.275 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.275 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.276 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.276 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.276 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.276 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 4896 2020-11-12T17:23:40.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.277 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:40.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:40.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:23:40.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816142+0000", 2020-11-12T17:23:40.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7733999999999998e-05 2020-11-12T17:23:40.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816220+0000", 2020-11-12T17:23:40.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2221999999999999e-05 2020-11-12T17:23:40.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816232+0000", 2020-11-12T17:23:40.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4469999999999997e-06 2020-11-12T17:23:40.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816237+0000", 2020-11-12T17:23:40.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012662909999999999 2020-11-12T17:23:40.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817504+0000", 2020-11-12T17:23:40.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167959 2020-11-12T17:23:40.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817672+0000", 2020-11-12T17:23:40.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025141300000000003 2020-11-12T17:23:40.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:40.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817923+0000", 2020-11-12T17:23:40.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001128467 2020-11-12T17:23:40.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.819051+0000", 2020-11-12T17:23:40.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19242863199999999 2020-11-12T17:23:40.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011480+0000", 2020-11-12T17:23:40.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9741999999999996e-05 2020-11-12T17:23:40.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011560+0000", 2020-11-12T17:23:40.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4276e-05 2020-11-12T17:23:40.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011614+0000", 2020-11-12T17:23:40.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001 2020-11-12T17:23:40.291 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.291 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.291 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.292 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4896 3.3 e25/20 ondisk, result = 0)", 2020-11-12T17:23:40.292 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:40.292 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.331528956, 2020-11-12T17:23:40.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.188067817, 2020-11-12T17:23:40.292 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.292 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:40.292 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:40.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:40.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:40.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823525+0000", 2020-11-12T17:23:40.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-05 2020-11-12T17:23:40.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823615+0000", 2020-11-12T17:23:40.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18777782700000001 2020-11-12T17:23:40.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011392+0000", 2020-11-12T17:23:40.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9179999999999997e-06 2020-11-12T17:23:40.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011399+0000", 2020-11-12T17:23:40.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5306000000000002e-05 2020-11-12T17:23:40.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011455+0000", 2020-11-12T17:23:40.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3124e-05 2020-11-12T17:23:40.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011468+0000", 2020-11-12T17:23:40.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015874800000000001 2020-11-12T17:23:40.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011627+0000", 2020-11-12T17:23:40.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.188067817 2020-11-12T17:23:40.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.300 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.300 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:40.301 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:40.301 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.468539826000001, 2020-11-12T17:23:40.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:23:40.301 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.301 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.301 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.301 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.302 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.302 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:23:40.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.302 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:40.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:40.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:40.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:23:40.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:23:40.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:23:40.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:23:40.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:23:40.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:23:40.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:23:40.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:23:40.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:23:40.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:23:40.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:23:40.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:23:40.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:40.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:23:40.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:23:40.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:23:40.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:23:40.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:23:40.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:23:40.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:23:40.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:23:40.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:23:40.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:23:40.313 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.313 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.313 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.314 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:40.314 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:40.314 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.468374922999999, 2020-11-12T17:23:40.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:23:40.314 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.315 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.315 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:23:40.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.315 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:40.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:40.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:40.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:23:40.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:23:40.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:23:40.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:23:40.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:23:40.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:23:40.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:23:40.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:23:40.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:23:40.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:23:40.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:23:40.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:23:40.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:40.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:23:40.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:23:40.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:23:40.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:23:40.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:23:40.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:23:40.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:23:40.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:23:40.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:23:40.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:23:40.331 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.331 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.331 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.332 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:40.332 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:40.332 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.464211688999999, 2020-11-12T17:23:40.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:23:40.333 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.333 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:40.333 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:40.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:40.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:23:40.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:23:40.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:23:40.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:23:40.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:23:40.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:23:40.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:23:40.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:23:40.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:23:40.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:23:40.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:23:40.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:23:40.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:23:40.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:23:40.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:23:40.340 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.340 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.340 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.340 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:40.340 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:40.341 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.462894854000002, 2020-11-12T17:23:40.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:23:40.341 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.341 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:40.341 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:40.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:40.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:23:40.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:23:40.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:23:40.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:23:40.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:23:40.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:23:40.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:23:40.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:23:40.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:23:40.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:23:40.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:23:40.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:23:40.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:23:40.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:23:40.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:23:40.350 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.350 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.350 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.350 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:23:40.351 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:40.351 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.600575222, 2020-11-12T17:23:40.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:23:40.351 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.351 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.352 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:40.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:40.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:40.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:23:40.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:23:40.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:23:40.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:23:40.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:23:40.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:23:40.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:23:40.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:23:40.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:23:40.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:23:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:23:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:23:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:23:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:23:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:23:40.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:23:40.382 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.382 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.382 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:23:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.272773254000001, 2020-11-12T17:23:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:23:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:23:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:23:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:23:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:23:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:23:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:23:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:23:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:23:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:23:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:23:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:23:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:23:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:23:40.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:23:40.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:40.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:23:40.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:23:40.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:23:40.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:23:40.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:23:40.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:23:40.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:23:40.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:23:40.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:23:40.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:23:40.395 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.395 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.395 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.395 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:23:40.395 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:40.396 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.265529545, 2020-11-12T17:23:40.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:23:40.396 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.396 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:40.396 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:40.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:40.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:23:40.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:23:40.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:23:40.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:23:40.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:23:40.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:23:40.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:23:40.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:23:40.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:23:40.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:23:40.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:23:40.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:23:40.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:23:40.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:23:40.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:23:40.402 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.402 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.402 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.403 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18077 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:40.403 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.885881+0000", 2020-11-12T17:23:40.403 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.2692068010000002, 2020-11-12T17:23:40.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.185238772, 2020-11-12T17:23:40.403 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.403 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.403 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.404 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.404 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.404 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18077 2020-11-12T17:23:40.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.404 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885881+0000", 2020-11-12T17:23:40.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885881+0000", 2020-11-12T17:23:40.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:40.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885857+0000", 2020-11-12T17:23:40.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6453999999999997e-05 2020-11-12T17:23:40.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885933+0000", 2020-11-12T17:23:40.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1838000000000001e-05 2020-11-12T17:23:40.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885945+0000", 2020-11-12T17:23:40.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1880000000000008e-06 2020-11-12T17:23:40.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885954+0000", 2020-11-12T17:23:40.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8446000000000003e-05 2020-11-12T17:23:40.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886003+0000", 2020-11-12T17:23:40.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011008199999999999 2020-11-12T17:23:40.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886113+0000", 2020-11-12T17:23:40.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018435399999999999 2020-11-12T17:23:40.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:40.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886297+0000", 2020-11-12T17:23:40.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040884600000000004 2020-11-12T17:23:40.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890385+0000", 2020-11-12T17:23:40.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.180543073 2020-11-12T17:23:40.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.070928+0000", 2020-11-12T17:23:40.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9800000000000001e-05 2020-11-12T17:23:40.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.071018+0000", 2020-11-12T17:23:40.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101326 2020-11-12T17:23:40.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.071120+0000", 2020-11-12T17:23:40.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.185238772 2020-11-12T17:23:40.420 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.420 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.421 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.421 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18078 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:40.421 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:40.422 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.2690899, 2020-11-12T17:23:40.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001, 2020-11-12T17:23:40.422 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.422 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.423 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.423 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.423 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.423 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18078 2020-11-12T17:23:40.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.424 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:40.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:40.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:40.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885975+0000", 2020-11-12T17:23:40.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1489000000000006e-05 2020-11-12T17:23:40.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886047+0000", 2020-11-12T17:23:40.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7270000000000002e-06 2020-11-12T17:23:40.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886057+0000", 2020-11-12T17:23:40.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4660000000000001e-06 2020-11-12T17:23:40.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886061+0000", 2020-11-12T17:23:40.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001076579 2020-11-12T17:23:40.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887138+0000", 2020-11-12T17:23:40.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131815 2020-11-12T17:23:40.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887270+0000", 2020-11-12T17:23:40.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018425599999999999 2020-11-12T17:23:40.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:40.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887454+0000", 2020-11-12T17:23:40.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048314439999999998 2020-11-12T17:23:40.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892285+0000", 2020-11-12T17:23:40.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18195460599999999 2020-11-12T17:23:40.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074240+0000", 2020-11-12T17:23:40.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167078 2020-11-12T17:23:40.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074407+0000", 2020-11-12T17:23:40.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112014 2020-11-12T17:23:40.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074519+0000", 2020-11-12T17:23:40.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001 2020-11-12T17:23:40.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.436 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.436 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18079 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:40.437 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:40.437 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.268980354, 2020-11-12T17:23:40.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999, 2020-11-12T17:23:40.437 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.437 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.438 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18079 2020-11-12T17:23:40.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.438 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:40.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:40.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:40.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886083+0000", 2020-11-12T17:23:40.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1087999999999993e-05 2020-11-12T17:23:40.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886164+0000", 2020-11-12T17:23:40.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8720000000000008e-06 2020-11-12T17:23:40.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886173+0000", 2020-11-12T17:23:40.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2519999999999996e-06 2020-11-12T17:23:40.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886179+0000", 2020-11-12T17:23:40.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027277500000000001 2020-11-12T17:23:40.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.888907+0000", 2020-11-12T17:23:40.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019889199999999999 2020-11-12T17:23:40.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889106+0000", 2020-11-12T17:23:40.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028895700000000001 2020-11-12T17:23:40.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:40.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889395+0000", 2020-11-12T17:23:40.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003372571 2020-11-12T17:23:40.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892767+0000", 2020-11-12T17:23:40.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.181837265 2020-11-12T17:23:40.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074604+0000", 2020-11-12T17:23:40.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.135e-05 2020-11-12T17:23:40.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074666+0000", 2020-11-12T17:23:40.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7472999999999996e-05 2020-11-12T17:23:40.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074733+0000", 2020-11-12T17:23:40.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999 2020-11-12T17:23:40.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.447 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.447 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18080 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:40.447 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:40.448 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.2684788669999998, 2020-11-12T17:23:40.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999, 2020-11-12T17:23:40.448 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.449 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.449 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18080 2020-11-12T17:23:40.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.450 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:40.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:40.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:40.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886586+0000", 2020-11-12T17:23:40.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3144000000000002e-05 2020-11-12T17:23:40.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886669+0000", 2020-11-12T17:23:40.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6894000000000001e-05 2020-11-12T17:23:40.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886686+0000", 2020-11-12T17:23:40.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5079999999999999e-06 2020-11-12T17:23:40.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886693+0000", 2020-11-12T17:23:40.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037501600000000002 2020-11-12T17:23:40.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890444+0000", 2020-11-12T17:23:40.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183449 2020-11-12T17:23:40.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890627+0000", 2020-11-12T17:23:40.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000305762 2020-11-12T17:23:40.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:40.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890933+0000", 2020-11-12T17:23:40.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022402920000000001 2020-11-12T17:23:40.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.893173+0000", 2020-11-12T17:23:40.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18168999399999999 2020-11-12T17:23:40.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:40.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074863+0000", 2020-11-12T17:23:40.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012771700000000001 2020-11-12T17:23:40.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:40.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074991+0000", 2020-11-12T17:23:40.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0248999999999999e-05 2020-11-12T17:23:40.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.075051+0000", 2020-11-12T17:23:40.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999 2020-11-12T17:23:40.462 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.462 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.462 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.463 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:18077 3.3 e41/20 ondisk, result = 0)", 2020-11-12T17:23:40.463 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.892720+0000", 2020-11-12T17:23:40.463 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.2623674579999999, 2020-11-12T17:23:40.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.17849220099999999, 2020-11-12T17:23:40.463 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.464 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:40.464 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892720+0000", 2020-11-12T17:23:40.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892720+0000", 2020-11-12T17:23:40.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999566 2020-11-12T17:23:40.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892677+0000", 2020-11-12T17:23:40.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106902 2020-11-12T17:23:40.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892784+0000", 2020-11-12T17:23:40.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.17596225500000001 2020-11-12T17:23:40.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.068746+0000", 2020-11-12T17:23:40.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0220000000000004e-06 2020-11-12T17:23:40.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.068754+0000", 2020-11-12T17:23:40.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021461739999999998 2020-11-12T17:23:40.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.070900+0000", 2020-11-12T17:23:40.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2651e-05 2020-11-12T17:23:40.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.070913+0000", 2020-11-12T17:23:40.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029960400000000003 2020-11-12T17:23:40.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:40.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.071212+0000", 2020-11-12T17:23:40.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.17849220099999999 2020-11-12T17:23:40.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.472 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.473 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.473 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:40.474 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:40.475 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:40.468+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:40.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 36 16 20860 20844 4.52295 8.46094 0.00927629 0.0276223 2020-11-12T17:23:40.575 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:40.570+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:40.599 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:40.610 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:40.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.610 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20847 3.c 3:321a0193:::benchmark_data_smithi036_14212_object2605:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:23:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.556205+0000", 2020-11-12T17:23:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.042520661000000001, 2020-11-12T17:23:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.042558328999999999, 2020-11-12T17:23:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20847 2020-11-12T17:23:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556205+0000", 2020-11-12T17:23:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556205+0000", 2020-11-12T17:23:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556179+0000", 2020-11-12T17:23:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7803e-05 2020-11-12T17:23:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556257+0000", 2020-11-12T17:23:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1499999999999999e-06 2020-11-12T17:23:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556265+0000", 2020-11-12T17:23:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3100000000000002e-06 2020-11-12T17:23:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556269+0000", 2020-11-12T17:23:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031951340000000001 2020-11-12T17:23:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.559465+0000", 2020-11-12T17:23:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1159e-05 2020-11-12T17:23:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.559546+0000", 2020-11-12T17:23:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000142965 2020-11-12T17:23:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.559689+0000", 2020-11-12T17:23:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002932652 2020-11-12T17:23:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.562621+0000", 2020-11-12T17:23:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064163069999999996 2020-11-12T17:23:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20848 3.c 3:321a0193:::benchmark_data_smithi036_14212_object2605:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:23:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.556303+0000", 2020-11-12T17:23:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.042422296999999998, 2020-11-12T17:23:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.042551911999999997, 2020-11-12T17:23:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.625 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:40.625 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20848 2020-11-12T17:23:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556303+0000", 2020-11-12T17:23:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556303+0000", 2020-11-12T17:23:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556283+0000", 2020-11-12T17:23:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9200999999999998e-05 2020-11-12T17:23:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556342+0000", 2020-11-12T17:23:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:23:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556350+0000", 2020-11-12T17:23:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5920000000000001e-06 2020-11-12T17:23:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.556353+0000", 2020-11-12T17:23:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043431770000000001 2020-11-12T17:23:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.560696+0000", 2020-11-12T17:23:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121573 2020-11-12T17:23:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.560818+0000", 2020-11-12T17:23:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017352599999999999 2020-11-12T17:23:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.560991+0000", 2020-11-12T17:23:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032329849999999999 2020-11-12T17:23:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.564224+0000", 2020-11-12T17:23:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0079209759999999997 2020-11-12T17:23:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:23:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:23:40.637 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:40.642 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:40.682 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:40.678+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:40.777 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:40.770+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:40.803 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:40.805 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:40.806 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:40.806 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:40.806 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:40.814 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:40.820 INFO:teuthology.orchestra.run.smithi036.stderr:reweighted osd.7 to 1 (10000) 2020-11-12T17:23:40.836 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 6 1 2020-11-12T17:23:40.901 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:40.898+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:40.967 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:40.978 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:40.979 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:40.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:40.979 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:40.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.979 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:823 3.c 3:36f36e11:::benchmark_data_smithi036_14212_object102:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:40.979 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.330665+0000", 2020-11-12T17:23:40.980 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.645147571999999, 2020-11-12T17:23:40.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.095579737999999997, 2020-11-12T17:23:40.980 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:40.980 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:40.980 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:40.980 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:40.981 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:40.981 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 823 2020-11-12T17:23:40.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.989 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:40.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:40.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330665+0000", 2020-11-12T17:23:40.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:40.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:40.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330665+0000", 2020-11-12T17:23:40.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:40.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:40.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330633+0000", 2020-11-12T17:23:40.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109712 2020-11-12T17:23:40.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:40.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330743+0000", 2020-11-12T17:23:40.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3318e-05 2020-11-12T17:23:40.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:40.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330756+0000", 2020-11-12T17:23:40.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1728e-05 2020-11-12T17:23:40.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:40.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330768+0000", 2020-11-12T17:23:40.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0075436380000000001 2020-11-12T17:23:40.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:40.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.338311+0000", 2020-11-12T17:23:40.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010406 2020-11-12T17:23:40.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:40.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.338415+0000", 2020-11-12T17:23:40.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015149799999999999 2020-11-12T17:23:40.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:40.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.338567+0000", 2020-11-12T17:23:40.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058399790000000004 2020-11-12T17:23:40.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:40.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:40.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:40.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344407+0000", 2020-11-12T17:23:40.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.081675758000000001 2020-11-12T17:23:40.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426083+0000", 2020-11-12T17:23:41.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7353000000000003e-05 2020-11-12T17:23:41.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426160+0000", 2020-11-12T17:23:41.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4445999999999998e-05 2020-11-12T17:23:41.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426245+0000", 2020-11-12T17:23:41.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.095579737999999997 2020-11-12T17:23:41.002 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.002 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.002 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.003 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:824 3.c 3:36f36e11:::benchmark_data_smithi036_14212_object102:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:41.003 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.332862+0000", 2020-11-12T17:23:41.003 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.642950351000003, 2020-11-12T17:23:41.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098157404000000004, 2020-11-12T17:23:41.003 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.003 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.004 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.004 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.004 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 824 2020-11-12T17:23:41.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.004 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332862+0000", 2020-11-12T17:23:41.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332862+0000", 2020-11-12T17:23:41.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:23:41.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332822+0000", 2020-11-12T17:23:41.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108002 2020-11-12T17:23:41.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332930+0000", 2020-11-12T17:23:41.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:23:41.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332941+0000", 2020-11-12T17:23:41.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5189999999999998e-06 2020-11-12T17:23:41.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332948+0000", 2020-11-12T17:23:41.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064326440000000004 2020-11-12T17:23:41.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.339380+0000", 2020-11-12T17:23:41.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000138391 2020-11-12T17:23:41.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.339519+0000", 2020-11-12T17:23:41.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019887600000000001 2020-11-12T17:23:41.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.339717+0000", 2020-11-12T17:23:41.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046980709999999998 2020-11-12T17:23:41.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344416+0000", 2020-11-12T17:23:41.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.086535669999999995 2020-11-12T17:23:41.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.430951+0000", 2020-11-12T17:23:41.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0278999999999998e-05 2020-11-12T17:23:41.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.430991+0000", 2020-11-12T17:23:41.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.792e-05 2020-11-12T17:23:41.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.431019+0000", 2020-11-12T17:23:41.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098157404000000004 2020-11-12T17:23:41.019 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.019 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.020 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.021 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:928 3.2 e22/20 3:4c5417bc:::benchmark_data_smithi036_14212_object115:head v 22'80, mlcod=22'75)", 2020-11-12T17:23:41.021 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:41.022 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.543410405000003, 2020-11-12T17:23:41.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875, 2020-11-12T17:23:41.023 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.023 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.023 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:41.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:41.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:23:41.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432388+0000", 2020-11-12T17:23:41.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2012000000000003e-05 2020-11-12T17:23:41.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432440+0000", 2020-11-12T17:23:41.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.11616101500000001 2020-11-12T17:23:41.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548601+0000", 2020-11-12T17:23:41.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3270000000000001e-06 2020-11-12T17:23:41.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548609+0000", 2020-11-12T17:23:41.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6627999999999997e-05 2020-11-12T17:23:41.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548706+0000", 2020-11-12T17:23:41.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9027999999999999e-05 2020-11-12T17:23:41.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548755+0000", 2020-11-12T17:23:41.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038296739999999999 2020-11-12T17:23:41.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552584+0000", 2020-11-12T17:23:41.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010042 2020-11-12T17:23:41.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552685+0000", 2020-11-12T17:23:41.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875 2020-11-12T17:23:41.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.038 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.039 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.039 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1119 3.c 3:364fce39:::benchmark_data_smithi036_14212_object139:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:41.040 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:41.040 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.346331671000002, 2020-11-12T17:23:41.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111702974, 2020-11-12T17:23:41.041 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.041 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.041 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.041 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.042 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.042 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1119 2020-11-12T17:23:41.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.043 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:41.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:41.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:41.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629447+0000", 2020-11-12T17:23:41.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7503999999999993e-05 2020-11-12T17:23:41.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629545+0000", 2020-11-12T17:23:41.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2435999999999999e-05 2020-11-12T17:23:41.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629557+0000", 2020-11-12T17:23:41.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5889999999999999e-06 2020-11-12T17:23:41.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629564+0000", 2020-11-12T17:23:41.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003337773 2020-11-12T17:23:41.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.632902+0000", 2020-11-12T17:23:41.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010063199999999999 2020-11-12T17:23:41.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633002+0000", 2020-11-12T17:23:41.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000132698 2020-11-12T17:23:41.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633135+0000", 2020-11-12T17:23:41.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019819870000000002 2020-11-12T17:23:41.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.635117+0000", 2020-11-12T17:23:41.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.105938543 2020-11-12T17:23:41.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741056+0000", 2020-11-12T17:23:41.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8002000000000003e-05 2020-11-12T17:23:41.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741134+0000", 2020-11-12T17:23:41.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0025999999999998e-05 2020-11-12T17:23:41.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741184+0000", 2020-11-12T17:23:41.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111702974 2020-11-12T17:23:41.061 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.062 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.062 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.063 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1120 3.c 3:364fce39:::benchmark_data_smithi036_14212_object139:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:41.063 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.633688+0000", 2020-11-12T17:23:41.063 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.342124613999999, 2020-11-12T17:23:41.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109445737, 2020-11-12T17:23:41.064 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.064 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.065 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.065 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.065 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.065 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1120 2020-11-12T17:23:41.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.066 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633688+0000", 2020-11-12T17:23:41.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633688+0000", 2020-11-12T17:23:41.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:41.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633655+0000", 2020-11-12T17:23:41.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3597000000000006e-05 2020-11-12T17:23:41.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633739+0000", 2020-11-12T17:23:41.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1420000000000001e-05 2020-11-12T17:23:41.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633750+0000", 2020-11-12T17:23:41.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5629999999999999e-06 2020-11-12T17:23:41.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633756+0000", 2020-11-12T17:23:41.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022420200000000001 2020-11-12T17:23:41.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633980+0000", 2020-11-12T17:23:41.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8585000000000007e-05 2020-11-12T17:23:41.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.634069+0000", 2020-11-12T17:23:41.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012874800000000001 2020-11-12T17:23:41.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.634197+0000", 2020-11-12T17:23:41.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00092912099999999998 2020-11-12T17:23:41.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.635127+0000", 2020-11-12T17:23:41.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.107821245 2020-11-12T17:23:41.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.742948+0000", 2020-11-12T17:23:41.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100605 2020-11-12T17:23:41.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.743048+0000", 2020-11-12T17:23:41.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5061000000000004e-05 2020-11-12T17:23:41.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.743133+0000", 2020-11-12T17:23:41.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109445737 2020-11-12T17:23:41.083 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.083 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.083 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.084 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1119 3.c e23/20 ondisk, result = 0)", 2020-11-12T17:23:41.084 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.636786+0000", 2020-11-12T17:23:41.084 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.339026193000002, 2020-11-12T17:23:41.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.104404152, 2020-11-12T17:23:41.084 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.085 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:41.085 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636786+0000", 2020-11-12T17:23:41.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636786+0000", 2020-11-12T17:23:41.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:41.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636769+0000", 2020-11-12T17:23:41.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9211e-05 2020-11-12T17:23:41.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636818+0000", 2020-11-12T17:23:41.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.10413915 2020-11-12T17:23:41.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.740957+0000", 2020-11-12T17:23:41.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2655e-05 2020-11-12T17:23:41.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.740970+0000", 2020-11-12T17:23:41.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5438999999999995e-05 2020-11-12T17:23:41.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741036+0000", 2020-11-12T17:23:41.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0757999999999999e-05 2020-11-12T17:23:41.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741046+0000", 2020-11-12T17:23:41.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014404199999999999 2020-11-12T17:23:41.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741190+0000", 2020-11-12T17:23:41.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.104404152 2020-11-12T17:23:41.091 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.091 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.091 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.091 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:23:41.091 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:41.092 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.471583703, 2020-11-12T17:23:41.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:23:41.092 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.092 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.092 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:41.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:41.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:41.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:23:41.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:23:41.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:23:41.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:23:41.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:23:41.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:23:41.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:23:41.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:23:41.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:23:41.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:23:41.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:23:41.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:23:41.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:23:41.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:23:41.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:23:41.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:23:41.099 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.099 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.099 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.099 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:6040 3.d e25/20 3:b8c2806e:::benchmark_data_smithi036_14212_object754:head v 25'360, mlcod=25'354)", 2020-11-12T17:23:41.099 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:41.099 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.066278065999999, 2020-11-12T17:23:41.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431, 2020-11-12T17:23:41.100 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.100 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.100 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:41.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:41.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:41.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909516+0000", 2020-11-12T17:23:41.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6403999999999996e-05 2020-11-12T17:23:41.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909582+0000", 2020-11-12T17:23:41.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.113169626 2020-11-12T17:23:41.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022752+0000", 2020-11-12T17:23:41.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1850000000000004e-06 2020-11-12T17:23:41.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022760+0000", 2020-11-12T17:23:41.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7312999999999998e-05 2020-11-12T17:23:41.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022817+0000", 2020-11-12T17:23:41.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1387999999999999e-05 2020-11-12T17:23:41.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022838+0000", 2020-11-12T17:23:41.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001833487 2020-11-12T17:23:41.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024672+0000", 2020-11-12T17:23:41.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8751000000000005e-05 2020-11-12T17:23:41.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024761+0000", 2020-11-12T17:23:41.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431 2020-11-12T17:23:41.106 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.107 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.107 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.107 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9832 3.c 3:3b0730c9:::benchmark_data_smithi036_14212_object1228:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:41.107 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.347361+0000", 2020-11-12T17:23:41.107 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.628451141999999, 2020-11-12T17:23:41.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094955906000000007, 2020-11-12T17:23:41.108 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.108 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.108 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9832 2020-11-12T17:23:41.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.109 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347361+0000", 2020-11-12T17:23:41.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347361+0000", 2020-11-12T17:23:41.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:41.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347342+0000", 2020-11-12T17:23:41.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5386000000000001e-05 2020-11-12T17:23:41.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347397+0000", 2020-11-12T17:23:41.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3729999999999998e-06 2020-11-12T17:23:41.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347403+0000", 2020-11-12T17:23:41.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0360000000000001e-05 2020-11-12T17:23:41.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347414+0000", 2020-11-12T17:23:41.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063595880000000002 2020-11-12T17:23:41.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.353773+0000", 2020-11-12T17:23:41.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017073300000000001 2020-11-12T17:23:41.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.353944+0000", 2020-11-12T17:23:41.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018458999999999999 2020-11-12T17:23:41.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.354129+0000", 2020-11-12T17:23:41.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018879140000000001 2020-11-12T17:23:41.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356017+0000", 2020-11-12T17:23:41.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.086152773000000002 2020-11-12T17:23:41.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442169+0000", 2020-11-12T17:23:41.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2831999999999995e-05 2020-11-12T17:23:41.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442262+0000", 2020-11-12T17:23:41.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4880000000000003e-05 2020-11-12T17:23:41.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442317+0000", 2020-11-12T17:23:41.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094955906000000007 2020-11-12T17:23:41.117 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.117 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.117 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.118 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9832 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:23:41.118 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.356564+0000", 2020-11-12T17:23:41.118 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.619248768999999, 2020-11-12T17:23:41.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.085784281000000004, 2020-11-12T17:23:41.118 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.118 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:41.119 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356564+0000", 2020-11-12T17:23:41.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356564+0000", 2020-11-12T17:23:41.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:23:41.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356529+0000", 2020-11-12T17:23:41.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9649999999999997e-05 2020-11-12T17:23:41.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356618+0000", 2020-11-12T17:23:41.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.085377103999999995 2020-11-12T17:23:41.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.441995+0000", 2020-11-12T17:23:41.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4127e-05 2020-11-12T17:23:41.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442009+0000", 2020-11-12T17:23:41.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013204699999999999 2020-11-12T17:23:41.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442142+0000", 2020-11-12T17:23:41.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.469e-05 2020-11-12T17:23:41.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442156+0000", 2020-11-12T17:23:41.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019165799999999999 2020-11-12T17:23:41.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442348+0000", 2020-11-12T17:23:41.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.085784281000000004 2020-11-12T17:23:41.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.125 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.125 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.125 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:41.125 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:41.125 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.449574137999999, 2020-11-12T17:23:41.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:23:41.126 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.126 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.126 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.126 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.126 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.126 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:23:41.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.127 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:41.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:41.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:41.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:23:41.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:23:41.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:23:41.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:23:41.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:23:41.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:23:41.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:23:41.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:23:41.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:23:41.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:23:41.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:23:41.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:23:41.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:23:41.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:23:41.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:23:41.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:23:41.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:23:41.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:23:41.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:23:41.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:23:41.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:23:41.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:23:41.135 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.136 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.136 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.136 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:23:41.136 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:41.136 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.446174203999998, 2020-11-12T17:23:41.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:23:41.137 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.137 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:41.137 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:41.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:41.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:41.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:23:41.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:23:41.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:23:41.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:23:41.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:23:41.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:23:41.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:23:41.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:23:41.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:23:41.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:23:41.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:23:41.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:23:41.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:23:41.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:23:41.143 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.143 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.143 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.143 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:17992 3.d e41/20 3:bfb5f180:::benchmark_data_smithi036_14212_object2248:head v 41'952, mlcod=40'947)", 2020-11-12T17:23:41.143 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:41.144 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.1697227450000001, 2020-11-12T17:23:41.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12242665599999999, 2020-11-12T17:23:41.144 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.144 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.144 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:41.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:41.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:41.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806068+0000", 2020-11-12T17:23:41.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9553000000000002e-05 2020-11-12T17:23:41.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806147+0000", 2020-11-12T17:23:41.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120094329 2020-11-12T17:23:41.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926242+0000", 2020-11-12T17:23:41.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5110000000000003e-06 2020-11-12T17:23:41.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926247+0000", 2020-11-12T17:23:41.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8669000000000002e-05 2020-11-12T17:23:41.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926326+0000", 2020-11-12T17:23:41.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0543e-05 2020-11-12T17:23:41.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926386+0000", 2020-11-12T17:23:41.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020619430000000001 2020-11-12T17:23:41.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.928448+0000", 2020-11-12T17:23:41.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7936999999999997e-05 2020-11-12T17:23:41.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.928516+0000", 2020-11-12T17:23:41.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12242665599999999 2020-11-12T17:23:41.151 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.151 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.151 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.151 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:18120 3.d e41/20 3:b4a6068b:::benchmark_data_smithi036_14212_object2264:head v 41'960, mlcod=41'953)", 2020-11-12T17:23:41.152 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:41.152 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.0381664270000002, 2020-11-12T17:23:41.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13161703499999999, 2020-11-12T17:23:41.152 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.152 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.152 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:41.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:41.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:23:41.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937606+0000", 2020-11-12T17:23:41.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015189199999999999 2020-11-12T17:23:41.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937758+0000", 2020-11-12T17:23:41.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.129116967 2020-11-12T17:23:41.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066875+0000", 2020-11-12T17:23:41.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1977999999999999e-05 2020-11-12T17:23:41.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066887+0000", 2020-11-12T17:23:41.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102873 2020-11-12T17:23:41.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066990+0000", 2020-11-12T17:23:41.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8860000000000002e-05 2020-11-12T17:23:41.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.067049+0000", 2020-11-12T17:23:41.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020681240000000002 2020-11-12T17:23:41.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.069117+0000", 2020-11-12T17:23:41.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014595299999999999 2020-11-12T17:23:41.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.069263+0000", 2020-11-12T17:23:41.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13161703499999999 2020-11-12T17:23:41.159 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.159 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.159 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.159 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:19118 3.c 3:37e8b7dc:::benchmark_data_smithi036_14212_object2389:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:41.159 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:38.887389+0000", 2020-11-12T17:23:41.160 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.0884232890000001, 2020-11-12T17:23:41.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.096630643000000002, 2020-11-12T17:23:41.160 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.160 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.160 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.160 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.160 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.161 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 19118 2020-11-12T17:23:41.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.161 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887389+0000", 2020-11-12T17:23:41.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887389+0000", 2020-11-12T17:23:41.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:23:41.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887368+0000", 2020-11-12T17:23:41.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9048000000000001e-05 2020-11-12T17:23:41.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887427+0000", 2020-11-12T17:23:41.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3379999999999994e-06 2020-11-12T17:23:41.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887436+0000", 2020-11-12T17:23:41.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.896e-06 2020-11-12T17:23:41.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887442+0000", 2020-11-12T17:23:41.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080267580000000002 2020-11-12T17:23:41.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.895469+0000", 2020-11-12T17:23:41.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102191 2020-11-12T17:23:41.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.895571+0000", 2020-11-12T17:23:41.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017947899999999999 2020-11-12T17:23:41.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.895750+0000", 2020-11-12T17:23:41.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033634789999999999 2020-11-12T17:23:41.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.899114+0000", 2020-11-12T17:23:41.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.084775891000000006 2020-11-12T17:23:41.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.983890+0000", 2020-11-12T17:23:41.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.381e-05 2020-11-12T17:23:41.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.983964+0000", 2020-11-12T17:23:41.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6125000000000002e-05 2020-11-12T17:23:41.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.984020+0000", 2020-11-12T17:23:41.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.096630643000000002 2020-11-12T17:23:41.169 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.169 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.169 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.170 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:19119 3.c 3:37e8b7dc:::benchmark_data_smithi036_14212_object2389:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:41.170 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:38.889817+0000", 2020-11-12T17:23:41.170 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.0859951269999999, 2020-11-12T17:23:41.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094434208000000006, 2020-11-12T17:23:41.170 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.171 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.171 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.171 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.171 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.171 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 19119 2020-11-12T17:23:41.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.171 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.889817+0000", 2020-11-12T17:23:41.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.889817+0000", 2020-11-12T17:23:41.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:23:41.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.889784+0000", 2020-11-12T17:23:41.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010506 2020-11-12T17:23:41.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.889889+0000", 2020-11-12T17:23:41.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4565e-05 2020-11-12T17:23:41.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.889904+0000", 2020-11-12T17:23:41.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8460000000000008e-06 2020-11-12T17:23:41.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.889912+0000", 2020-11-12T17:23:41.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068248320000000003 2020-11-12T17:23:41.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.896737+0000", 2020-11-12T17:23:41.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101117 2020-11-12T17:23:41.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.896838+0000", 2020-11-12T17:23:41.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015084000000000001 2020-11-12T17:23:41.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.896988+0000", 2020-11-12T17:23:41.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022844950000000001 2020-11-12T17:23:41.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.899273+0000", 2020-11-12T17:23:41.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.084847486 2020-11-12T17:23:41.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.984120+0000", 2020-11-12T17:23:41.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.728e-05 2020-11-12T17:23:41.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.984178+0000", 2020-11-12T17:23:41.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3690999999999996e-05 2020-11-12T17:23:41.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.984251+0000", 2020-11-12T17:23:41.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094434208000000006 2020-11-12T17:23:41.180 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.180 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.190 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.191 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:19120 3.c 3:37e8b7dc:::benchmark_data_smithi036_14212_object2389:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:41.191 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:38.889967+0000", 2020-11-12T17:23:41.191 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.0858453269999999, 2020-11-12T17:23:41.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094651606999999999, 2020-11-12T17:23:41.191 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.191 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.192 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.192 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.192 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.192 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 19120 2020-11-12T17:23:41.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.192 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.889967+0000", 2020-11-12T17:23:41.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.889967+0000", 2020-11-12T17:23:41.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:41.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.889934+0000", 2020-11-12T17:23:41.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4232000000000002e-05 2020-11-12T17:23:41.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.890029+0000", 2020-11-12T17:23:41.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1253000000000001e-05 2020-11-12T17:23:41.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.890040+0000", 2020-11-12T17:23:41.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1100000000000002e-06 2020-11-12T17:23:41.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.890045+0000", 2020-11-12T17:23:41.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077979579999999998 2020-11-12T17:23:41.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.897843+0000", 2020-11-12T17:23:41.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8653999999999994e-05 2020-11-12T17:23:41.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.897942+0000", 2020-11-12T17:23:41.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015989899999999999 2020-11-12T17:23:41.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.898102+0000", 2020-11-12T17:23:41.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014823869999999999 2020-11-12T17:23:41.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.899584+0000", 2020-11-12T17:23:41.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.084786326999999995 2020-11-12T17:23:41.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.984370+0000", 2020-11-12T17:23:41.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013336199999999999 2020-11-12T17:23:41.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.984504+0000", 2020-11-12T17:23:41.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115036 2020-11-12T17:23:41.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.984619+0000", 2020-11-12T17:23:41.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094651606999999999 2020-11-12T17:23:41.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.201 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.202 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:19272 3.2 e41/20 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head v 41'1256, mlcod=41'1251)", 2020-11-12T17:23:41.202 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:41.202 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.9142356009999999, 2020-11-12T17:23:41.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118689434, 2020-11-12T17:23:41.202 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.202 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.202 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:41.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:41.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:41.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061534+0000", 2020-11-12T17:23:41.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147861 2020-11-12T17:23:41.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061682+0000", 2020-11-12T17:23:41.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.116405122 2020-11-12T17:23:41.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178087+0000", 2020-11-12T17:23:41.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1800000000000001e-05 2020-11-12T17:23:41.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178098+0000", 2020-11-12T17:23:41.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000129016 2020-11-12T17:23:41.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178227+0000", 2020-11-12T17:23:41.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8186000000000002e-05 2020-11-12T17:23:41.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178286+0000", 2020-11-12T17:23:41.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018917160000000001 2020-11-12T17:23:41.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.180177+0000", 2020-11-12T17:23:41.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8812000000000003e-05 2020-11-12T17:23:41.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.180266+0000", 2020-11-12T17:23:41.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118689434 2020-11-12T17:23:41.209 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.209 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.209 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.210 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20951 3.c 3:3964cfba:::benchmark_data_smithi036_14212_object2618:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:23:41.210 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.657158+0000", 2020-11-12T17:23:41.210 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.31865437400000002, 2020-11-12T17:23:41.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.089464033999999998, 2020-11-12T17:23:41.210 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.210 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.210 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.211 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.211 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.211 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20951 2020-11-12T17:23:41.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.211 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657158+0000", 2020-11-12T17:23:41.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657158+0000", 2020-11-12T17:23:41.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:41.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657124+0000", 2020-11-12T17:23:41.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-05 2020-11-12T17:23:41.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657198+0000", 2020-11-12T17:23:41.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8050000000000007e-06 2020-11-12T17:23:41.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657206+0000", 2020-11-12T17:23:41.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.782e-06 2020-11-12T17:23:41.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657209+0000", 2020-11-12T17:23:41.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029180830000000001 2020-11-12T17:23:41.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.660127+0000", 2020-11-12T17:23:41.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000116116 2020-11-12T17:23:41.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.660244+0000", 2020-11-12T17:23:41.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000202857 2020-11-12T17:23:41.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.660446+0000", 2020-11-12T17:23:41.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021684320000000001 2020-11-12T17:23:41.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.662615+0000", 2020-11-12T17:23:41.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.083844101000000004 2020-11-12T17:23:41.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.746459+0000", 2020-11-12T17:23:41.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010409 2020-11-12T17:23:41.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.746563+0000", 2020-11-12T17:23:41.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8983000000000001e-05 2020-11-12T17:23:41.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.746622+0000", 2020-11-12T17:23:41.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.089464033999999998 2020-11-12T17:23:41.220 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.220 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.220 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.221 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20952 3.c 3:3964cfba:::benchmark_data_smithi036_14212_object2618:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:23:41.221 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.657793+0000", 2020-11-12T17:23:41.221 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.31801938899999999, 2020-11-12T17:23:41.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099594468000000005, 2020-11-12T17:23:41.221 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:41.221 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:41.221 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:41.222 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:41.222 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:41.222 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20952 2020-11-12T17:23:41.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.222 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:41.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:41.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657793+0000", 2020-11-12T17:23:41.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:41.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:41.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657793+0000", 2020-11-12T17:23:41.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:23:41.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:41.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657766+0000", 2020-11-12T17:23:41.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4486000000000005e-05 2020-11-12T17:23:41.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:41.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657841+0000", 2020-11-12T17:23:41.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9420000000000007e-06 2020-11-12T17:23:41.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:41.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657851+0000", 2020-11-12T17:23:41.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6999999999999996e-06 2020-11-12T17:23:41.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:41.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657856+0000", 2020-11-12T17:23:41.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034368160000000001 2020-11-12T17:23:41.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:41.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.661293+0000", 2020-11-12T17:23:41.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114543 2020-11-12T17:23:41.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:41.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.661408+0000", 2020-11-12T17:23:41.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020112900000000001 2020-11-12T17:23:41.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:41.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.661609+0000", 2020-11-12T17:23:41.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014751689999999999 2020-11-12T17:23:41.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:41.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.663084+0000", 2020-11-12T17:23:41.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094180085999999996 2020-11-12T17:23:41.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:41.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.757264+0000", 2020-11-12T17:23:41.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2193999999999994e-05 2020-11-12T17:23:41.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:41.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.757336+0000", 2020-11-12T17:23:41.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1116000000000003e-05 2020-11-12T17:23:41.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:41.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:41.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:41.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.757387+0000", 2020-11-12T17:23:41.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099594468000000005 2020-11-12T17:23:41.234 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.235 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.235 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.235 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:41.235 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:41.235 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:41.237 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:41.237 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:41.237 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:41.237 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:41.238 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:41.232+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:41.238 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:41.252 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:41.283 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:41.313 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:41.338 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:41.332+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:41.350 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:41.352 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:41.353 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:41.353 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:41.353 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:41.353 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:41.353 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:41.353 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:41.407 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:41.412 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:41.420 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:41.438 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:41.432+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:41.540 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:41.534+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:41.541 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:41.542 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:41.556 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:41.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 37 16 21703 21687 4.57869 6.58594 0.00541014 0.0272732 2020-11-12T17:23:41.645 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:41.642+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:41.725 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:41.726 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:41.735 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:41.778 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:41.774+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:41.827 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:41.820+0000 7f7fe1845700 -1 osd.1 43 handle_osd_map injecting map crc failure 2020-11-12T17:23:41.835 INFO:teuthology.orchestra.run.smithi036.stderr:reweighted osd.6 to 1 (10000) 2020-11-12T17:23:41.837 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:23:41.852 INFO:tasks.thrashosds.thrasher:Waiting for recovery 2020-11-12T17:23:41.852 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-12T17:23:41.853 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-12T17:23:41.853 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:41.844+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:41.899 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:41.899 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:41.911 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:41.950 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:41.944+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:42.036 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:42.036 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:42.047 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:42.050 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:42.046+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:42.151 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:42.146+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:42.169 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:42.169 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:42.182 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:42.241 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:23:42.250 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":44,"fsid":"8c8a6bcc-49d4-47d1-904f-e20798ef8e1f","created":"2020-11-12T17:22:37.581394+0000","modified":"2020-11-12T17:23:41.818434+0000","last_up_change":"2020-11-12T17:22:45.562766+0000","last_in_change":"2020-11-12T17:23:26.708344+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-12T17:22:41.596657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-12T17:22:49.905816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-11-12T17:23:01.837897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"bd1d5457-5d54-4074-b378-9da417f42976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6801","nonce":12304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6802","nonce":12304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6806","nonce":12304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6804","nonce":12304}]},"public_addr":"172.21.15.36:6801/12304","cluster_addr":"172.21.15.36:6802/12304","heartbeat_back_addr":"172.21.15.36:6806/12304","heartbeat_front_addr":"172.21.15.36:6804/12304","state":["exists","up"]},{"osd":1,"uuid":"37152eee-a8d8-40f1-8e27-2899e7b94c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6812","nonce":12307}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6814","nonce":12307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6816","nonce":12307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6815","nonce":12307}]},"public_addr":"172.21.15.36:6812/12307","cluster_addr":"172.21.15.36:6814/12307","heartbeat_back_addr":"172.21.15.36:6816/12307","heartbeat_front_addr":"172.21.15.36:6815/12307","state":["exists","up"]},{"osd":2,"uuid":"d8ec2abb-38bf-4863-969a-482c4fa44f41","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6803","nonce":12306}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6805","nonce":12306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6808","nonce":12306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6807","nonce":12306}]},"public_addr":"172.21.15.36:6803/12306","cluster_addr":"172.21.15.36:6805/12306","heartbeat_back_addr":"172.21.15.36:6808/12306","heartbeat_front_addr":"172.21.15.36:6807/12306","state":["exists","up"]},{"osd":3,"uuid":"799d3499-577c-4510-a00c-9b2e126fc449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6809","nonce":12305}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6810","nonce":12305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6813","nonce":12305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6811","nonce":12305}]},"public_addr":"172.21.15.36:6809/12305","cluster_addr":"172.21.15.36:6810/12305","heartbeat_back_addr":"172.21.15.36:6813/12305","heartbeat_front_addr":"172.21.15.36:6811/12305","state":["exists","up"]},{"osd":4,"uuid":"c36e3100-aadc-4117-b495-24fb08a34148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6804","nonce":12499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6805","nonce":12499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6807","nonce":12499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6806","nonce":12499}]},"public_addr":"172.21.15.205:6804/12499","cluster_addr":"172.21.15.205:6805/12499","heartbeat_back_addr":"172.21.15.205:6807/12499","heartbeat_front_addr":"172.21.15.205:6806/12499","state":["exists","up"]},{"osd":5,"uuid":"b152141f-b530-448e-8dff-fe200559eff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6808","nonce":12525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6810","nonce":12525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6814","nonce":12525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6812","nonce":12525}]},"public_addr":"172.21.15.205:6808/12525","cluster_addr":"172.21.15.205:6810/12525","heartbeat_back_addr":"172.21.15.205:6814/12525","heartbeat_front_addr":"172.21.15.205:6812/12525","state":["exists","up"]},{"osd":6,"uuid":"62a140ba-7f94-4bb6-8a62-fda077f81354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6809","nonce":12524}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6811","nonce":12524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6815","nonce":12524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6813","nonce":12524}]},"public_addr":"172.21.15.205:6809/12524","cluster_addr":"172.21.15.205:6811/12524","heartbeat_back_addr":"172.21.15.205:6815/12524","heartbeat_front_addr":"172.21.15.205:6813/12524","state":["exists","up"]},{"osd":7,"uuid":"32879bd7-780c-4da6-9838-5850b6277902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6800","nonce":12522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6801","nonce":12522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6803","nonce":12522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6802","nonce":12522}]},"public_addr":"172.21.15.205:6800/12522","cluster_addr":"172.21.15.205:6801/12522","heartbeat_back_addr":"172.21.15.205:6803/12522","heartbeat_front_addr":"172.21.15.205:6802/12522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.153580+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.206830+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":65536,"last_purged_snaps_scrub":"2020-11-12T17:22:44.143040+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.205663+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.139983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.167307+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:44.198025+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:22:43.935482+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-12T17:23:42.255 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:42.248+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:42.257 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-12T17:23:42.314 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:42.346 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:42.348 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:42.355 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:42.350+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:42.456 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:42.450+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:42.467 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:42.467 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:42.477 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:42.557 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:42.554+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:42.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 38 16 22701 22685 4.66336 7.79688 0.0105593 0.0267577 2020-11-12T17:23:42.602 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:42.602 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:42.615 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:42.662 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:42.656+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:42.729 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:42.730 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:42.742 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:42.785 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:42.780+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:42.861 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:42.858+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:42.861 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:23:42.899 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:42.899 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:42.911 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:42.962 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:42.958+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:43.064 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:43.058+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:43.078 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:43.078 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:43.091 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:43.165 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:43.162+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:43.214 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:43.215 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:43.225 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:43.266 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:43.262+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:43.341 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:43.341 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:43.352 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:43.365 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:43.397 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:43.392+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:43.468 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:43.464+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:43.483 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:43.484 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:43.486 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:43.558 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:43.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 39 16 23565 23549 4.71685 6.75 0.00905207 0.0264664 2020-11-12T17:23:43.569 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:43.564+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:43.591 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:43.622 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:43.651 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:43.668 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23663 3.b 3:dbf1e297:::benchmark_data_smithi036_14212_object2957:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:43.670 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.658099+0000", 2020-11-12T17:23:43.670 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0072407269999999998, 2020-11-12T17:23:43.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0072657750000000004, 2020-11-12T17:23:43.670 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:43.671 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:43.671 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:43.671 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:43.671 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:43.672 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23663 2020-11-12T17:23:43.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.672 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:43.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:43.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658099+0000", 2020-11-12T17:23:43.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:43.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658099+0000", 2020-11-12T17:23:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658065+0000", 2020-11-12T17:23:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1564999999999995e-05 2020-11-12T17:23:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658157+0000", 2020-11-12T17:23:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2187e-05 2020-11-12T17:23:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658169+0000", 2020-11-12T17:23:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0000000000000002e-06 2020-11-12T17:23:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:43.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658175+0000", 2020-11-12T17:23:43.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038452809999999999 2020-11-12T17:23:43.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.662020+0000", 2020-11-12T17:23:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060699999999999 2020-11-12T17:23:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.662121+0000", 2020-11-12T17:23:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018404200000000001 2020-11-12T17:23:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.662305+0000", 2020-11-12T17:23:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042060140000000001 2020-11-12T17:23:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23664 3.b 3:dbf1e297:::benchmark_data_smithi036_14212_object2957:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.658226+0000", 2020-11-12T17:23:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0071134989999999997, 2020-11-12T17:23:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0072315870000000003, 2020-11-12T17:23:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23664 2020-11-12T17:23:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658226+0000", 2020-11-12T17:23:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658226+0000", 2020-11-12T17:23:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658195+0000", 2020-11-12T17:23:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3974999999999994e-05 2020-11-12T17:23:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658289+0000", 2020-11-12T17:23:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2224e-05 2020-11-12T17:23:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658301+0000", 2020-11-12T17:23:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7400000000000001e-06 2020-11-12T17:23:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.658307+0000", 2020-11-12T17:23:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.004842725 2020-11-12T17:23:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663150+0000", 2020-11-12T17:23:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011087 2020-11-12T17:23:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663260+0000", 2020-11-12T17:23:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187097 2020-11-12T17:23:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663448+0000", 2020-11-12T17:23:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052215129999999997 2020-11-12T17:23:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23665 3.2 3:4ee5039d:::benchmark_data_smithi036_14212_object2958:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.659831+0000", 2020-11-12T17:23:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0055088699999999999, 2020-11-12T17:23:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005728113, 2020-11-12T17:23:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23665 2020-11-12T17:23:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.659831+0000", 2020-11-12T17:23:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.659831+0000", 2020-11-12T17:23:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:23:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.659791+0000", 2020-11-12T17:23:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010883300000000001 2020-11-12T17:23:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.659900+0000", 2020-11-12T17:23:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6144e-05 2020-11-12T17:23:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.659916+0000", 2020-11-12T17:23:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.916e-05 2020-11-12T17:23:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.659935+0000", 2020-11-12T17:23:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5896999999999996e-05 2020-11-12T17:23:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.660001+0000", 2020-11-12T17:23:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016435000000000001 2020-11-12T17:23:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.660165+0000", 2020-11-12T17:23:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000127143 2020-11-12T17:23:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.660292+0000", 2020-11-12T17:23:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003716319 2020-11-12T17:23:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664009+0000", 2020-11-12T17:23:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041779699999999996 2020-11-12T17:23:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23666 3.2 3:4ee5039d:::benchmark_data_smithi036_14212_object2958:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.660018+0000", 2020-11-12T17:23:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.005321994, 2020-11-12T17:23:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056288429999999997, 2020-11-12T17:23:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23666 2020-11-12T17:23:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.660018+0000", 2020-11-12T17:23:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.660018+0000", 2020-11-12T17:23:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:23:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.659979+0000", 2020-11-12T17:23:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109679 2020-11-12T17:23:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.660088+0000", 2020-11-12T17:23:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2642e-05 2020-11-12T17:23:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.660101+0000", 2020-11-12T17:23:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:23:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.660108+0000", 2020-11-12T17:23:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001430099 2020-11-12T17:23:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.661538+0000", 2020-11-12T17:23:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5352000000000005e-05 2020-11-12T17:23:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.661623+0000", 2020-11-12T17:23:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000221981 2020-11-12T17:23:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.661845+0000", 2020-11-12T17:23:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00182782 2020-11-12T17:23:43.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.710 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:43.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23667 3.2 3:4ee5039d:::benchmark_data_smithi036_14212_object2958:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.662893+0000", 2020-11-12T17:23:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0024467999999999998, 2020-11-12T17:23:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028318710000000001, 2020-11-12T17:23:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23667 2020-11-12T17:23:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.662893+0000", 2020-11-12T17:23:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.662893+0000", 2020-11-12T17:23:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:23:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.662857+0000", 2020-11-12T17:23:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110525 2020-11-12T17:23:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.662967+0000", 2020-11-12T17:23:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4168000000000001e-05 2020-11-12T17:23:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.662981+0000", 2020-11-12T17:23:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7159999999999997e-06 2020-11-12T17:23:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.662988+0000", 2020-11-12T17:23:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4490999999999998e-05 2020-11-12T17:23:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663032+0000", 2020-11-12T17:23:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0710000000000006e-05 2020-11-12T17:23:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663103+0000", 2020-11-12T17:23:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110882 2020-11-12T17:23:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663214+0000", 2020-11-12T17:23:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000321355 2020-11-12T17:23:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23668 3.2 3:4ee5039d:::benchmark_data_smithi036_14212_object2958:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.663059+0000", 2020-11-12T17:23:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0022803569999999998, 2020-11-12T17:23:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027336050000000001, 2020-11-12T17:23:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23668 2020-11-12T17:23:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663059+0000", 2020-11-12T17:23:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663059+0000", 2020-11-12T17:23:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999604 2020-11-12T17:23:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663020+0000", 2020-11-12T17:23:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010560099999999999 2020-11-12T17:23:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663125+0000", 2020-11-12T17:23:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4138000000000001e-05 2020-11-12T17:23:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663139+0000", 2020-11-12T17:23:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6420000000000001e-06 2020-11-12T17:23:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.663146+0000", 2020-11-12T17:23:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00088557100000000004 2020-11-12T17:23:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664032+0000", 2020-11-12T17:23:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2967000000000003e-05 2020-11-12T17:23:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664085+0000", 2020-11-12T17:23:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2399999999999996e-05 2020-11-12T17:23:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664177+0000", 2020-11-12T17:23:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001117846 2020-11-12T17:23:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23669 3.2 3:4ee5039d:::benchmark_data_smithi036_14212_object2958:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.664850+0000", 2020-11-12T17:23:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00048929500000000005, 2020-11-12T17:23:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010137600000000001, 2020-11-12T17:23:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23669 2020-11-12T17:23:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.733 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:43.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:43.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664850+0000", 2020-11-12T17:23:43.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:43.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664850+0000", 2020-11-12T17:23:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:23:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664809+0000", 2020-11-12T17:23:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000142628 2020-11-12T17:23:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664952+0000", 2020-11-12T17:23:43.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4459e-05 2020-11-12T17:23:43.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:43.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664966+0000", 2020-11-12T17:23:43.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.917e-06 2020-11-12T17:23:43.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.664973+0000", 2020-11-12T17:23:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9255000000000001e-05 2020-11-12T17:23:43.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:43.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.665033+0000", 2020-11-12T17:23:43.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108823 2020-11-12T17:23:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.665141+0000", 2020-11-12T17:23:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189166 2020-11-12T17:23:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.665331+0000", 2020-11-12T17:23:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00048042700000000001 2020-11-12T17:23:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:43.745 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:43.745 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 7 2020-11-12T17:23:43.745 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:43.747 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:43.747 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:43.748 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:43.748 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:43.742+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:43.753 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:43.788 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:43.790 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:43.808 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:43.847 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:43.842+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:43.882 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:43.883 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:43.883 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:43.883 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:43.883 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:43.895 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:43.948 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:43.942+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:44.019 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:44.020 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:44.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:44.020 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:44.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.020 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:112 3.8 3:18b8dd66:::benchmark_data_smithi036_14212_object13:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:44.021 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.640501+0000", 2020-11-12T17:23:44.021 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.371504455999997, 2020-11-12T17:23:44.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14688447800000001, 2020-11-12T17:23:44.021 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.021 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.021 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.022 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.022 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.022 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 112 2020-11-12T17:23:44.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.022 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640501+0000", 2020-11-12T17:23:44.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640501+0000", 2020-11-12T17:23:44.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:44.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640467+0000", 2020-11-12T17:23:44.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6193000000000005e-05 2020-11-12T17:23:44.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640563+0000", 2020-11-12T17:23:44.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.377e-05 2020-11-12T17:23:44.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640577+0000", 2020-11-12T17:23:44.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9313e-05 2020-11-12T17:23:44.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.640596+0000", 2020-11-12T17:23:44.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025484539999999999 2020-11-12T17:23:44.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.643145+0000", 2020-11-12T17:23:44.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6131000000000006e-05 2020-11-12T17:23:44.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.643231+0000", 2020-11-12T17:23:44.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108199 2020-11-12T17:23:44.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:44.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.643339+0000", 2020-11-12T17:23:44.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0053218750000000002 2020-11-12T17:23:44.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.648661+0000", 2020-11-12T17:23:44.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.138608647 2020-11-12T17:23:44.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787270+0000", 2020-11-12T17:23:44.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9970999999999999e-05 2020-11-12T17:23:44.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787330+0000", 2020-11-12T17:23:44.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6008999999999999e-05 2020-11-12T17:23:44.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.787386+0000", 2020-11-12T17:23:44.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14688447800000001 2020-11-12T17:23:44.034 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.034 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.035 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:335 3.8 3:1a561d42:::benchmark_data_smithi036_14212_object41:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:44.035 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:44.035 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.203777072000001, 2020-11-12T17:23:44.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16935236200000001, 2020-11-12T17:23:44.036 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.036 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.036 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.036 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.036 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.036 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 335 2020-11-12T17:23:44.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.037 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:44.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:44.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999866 2020-11-12T17:23:44.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808094+0000", 2020-11-12T17:23:44.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000224563 2020-11-12T17:23:44.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808319+0000", 2020-11-12T17:23:44.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3512e-05 2020-11-12T17:23:44.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808332+0000", 2020-11-12T17:23:44.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9740000000000008e-06 2020-11-12T17:23:44.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808341+0000", 2020-11-12T17:23:44.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00166 2020-11-12T17:23:44.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810001+0000", 2020-11-12T17:23:44.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013877900000000001 2020-11-12T17:23:44.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810140+0000", 2020-11-12T17:23:44.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018191099999999999 2020-11-12T17:23:44.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:44.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810322+0000", 2020-11-12T17:23:44.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010403820000000001 2020-11-12T17:23:44.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811362+0000", 2020-11-12T17:23:44.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16607825100000001 2020-11-12T17:23:44.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977441+0000", 2020-11-12T17:23:44.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1192999999999995e-05 2020-11-12T17:23:44.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977502+0000", 2020-11-12T17:23:44.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8917000000000004e-05 2020-11-12T17:23:44.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977581+0000", 2020-11-12T17:23:44.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16935236200000001 2020-11-12T17:23:44.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.047 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.048 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:336 3.8 3:1a561d42:::benchmark_data_smithi036_14212_object41:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:44.048 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:44.048 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.203591912, 2020-11-12T17:23:44.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001, 2020-11-12T17:23:44.048 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.048 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.048 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.049 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.049 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.049 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 336 2020-11-12T17:23:44.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.049 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:44.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:44.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:23:44.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808370+0000", 2020-11-12T17:23:44.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8706e-05 2020-11-12T17:23:44.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808469+0000", 2020-11-12T17:23:44.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.329e-06 2020-11-12T17:23:44.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808478+0000", 2020-11-12T17:23:44.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.181e-06 2020-11-12T17:23:44.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808483+0000", 2020-11-12T17:23:44.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022620499999999998 2020-11-12T17:23:44.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810746+0000", 2020-11-12T17:23:44.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6533000000000006e-05 2020-11-12T17:23:44.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810842+0000", 2020-11-12T17:23:44.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018000000000000001 2020-11-12T17:23:44.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:44.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811022+0000", 2020-11-12T17:23:44.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00081152800000000005 2020-11-12T17:23:44.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811834+0000", 2020-11-12T17:23:44.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16750948399999999 2020-11-12T17:23:44.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979343+0000", 2020-11-12T17:23:44.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4766999999999998e-05 2020-11-12T17:23:44.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979408+0000", 2020-11-12T17:23:44.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3001999999999999e-05 2020-11-12T17:23:44.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979451+0000", 2020-11-12T17:23:44.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001 2020-11-12T17:23:44.060 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.060 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.060 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.060 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:335 3.8 e22/20 ondisk, result = 0)", 2020-11-12T17:23:44.060 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:44.061 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.199113417, 2020-11-12T17:23:44.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.164701714, 2020-11-12T17:23:44.061 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.061 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:44.061 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:44.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:44.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:44.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812856+0000", 2020-11-12T17:23:44.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2423999999999995e-05 2020-11-12T17:23:44.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812948+0000", 2020-11-12T17:23:44.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16219246800000001 2020-11-12T17:23:44.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.975141+0000", 2020-11-12T17:23:44.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0543999999999999e-05 2020-11-12T17:23:44.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.975151+0000", 2020-11-12T17:23:44.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002271398 2020-11-12T17:23:44.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977422+0000", 2020-11-12T17:23:44.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7550000000000006e-06 2020-11-12T17:23:44.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977432+0000", 2020-11-12T17:23:44.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016162899999999999 2020-11-12T17:23:44.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977594+0000", 2020-11-12T17:23:44.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.164701714 2020-11-12T17:23:44.067 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.068 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.068 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.068 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:808 3.b 3:d27ca39f:::benchmark_data_smithi036_14212_object100:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:44.068 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:44.068 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 38.692146878000003, 2020-11-12T17:23:44.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742, 2020-11-12T17:23:44.069 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.069 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.069 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 808 2020-11-12T17:23:44.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.069 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:44.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:23:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319816+0000", 2020-11-12T17:23:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012461199999999999 2020-11-12T17:23:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319941+0000", 2020-11-12T17:23:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4997000000000001e-05 2020-11-12T17:23:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319956+0000", 2020-11-12T17:23:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9940000000000003e-06 2020-11-12T17:23:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319963+0000", 2020-11-12T17:23:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011778870000000001 2020-11-12T17:23:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321141+0000", 2020-11-12T17:23:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010428400000000001 2020-11-12T17:23:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321245+0000", 2020-11-12T17:23:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117811 2020-11-12T17:23:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321363+0000", 2020-11-12T17:23:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001974511 2020-11-12T17:23:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323337+0000", 2020-11-12T17:23:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185308416 2020-11-12T17:23:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508646+0000", 2020-11-12T17:23:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3879000000000002e-05 2020-11-12T17:23:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508720+0000", 2020-11-12T17:23:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6706000000000002e-05 2020-11-12T17:23:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508776+0000", 2020-11-12T17:23:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742 2020-11-12T17:23:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:808 3.b e22/20 ondisk, result = 0)", 2020-11-12T17:23:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 38.688334240000003, 2020-11-12T17:23:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999, 2020-11-12T17:23:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323648+0000", 2020-11-12T17:23:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0744e-05 2020-11-12T17:23:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323709+0000", 2020-11-12T17:23:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18463727299999999 2020-11-12T17:23:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508346+0000", 2020-11-12T17:23:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.798e-06 2020-11-12T17:23:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508356+0000", 2020-11-12T17:23:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027103199999999999 2020-11-12T17:23:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508627+0000", 2020-11-12T17:23:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999993e-06 2020-11-12T17:23:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508637+0000", 2020-11-12T17:23:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014688799999999999 2020-11-12T17:23:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508784+0000", 2020-11-12T17:23:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999 2020-11-12T17:23:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5672 3.7 3:e4132891:::benchmark_data_smithi036_14212_object708:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 33.568650644999998, 2020-11-12T17:23:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906, 2020-11-12T17:23:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5672 2020-11-12T17:23:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443325+0000", 2020-11-12T17:23:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3981999999999996e-05 2020-11-12T17:23:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443419+0000", 2020-11-12T17:23:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8057e-05 2020-11-12T17:23:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443437+0000", 2020-11-12T17:23:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3709999999999996e-06 2020-11-12T17:23:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443444+0000", 2020-11-12T17:23:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019104530000000001 2020-11-12T17:23:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445354+0000", 2020-11-12T17:23:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2356999999999999e-05 2020-11-12T17:23:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445426+0000", 2020-11-12T17:23:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111113 2020-11-12T17:23:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445538+0000", 2020-11-12T17:23:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00086618700000000003 2020-11-12T17:23:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.446404+0000", 2020-11-12T17:23:44.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.205445288 2020-11-12T17:23:44.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651849+0000", 2020-11-12T17:23:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2787000000000005e-05 2020-11-12T17:23:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651942+0000", 2020-11-12T17:23:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2173000000000003e-05 2020-11-12T17:23:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652004+0000", 2020-11-12T17:23:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906 2020-11-12T17:23:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5672 3.7 e25/20 ondisk, result = 0)", 2020-11-12T17:23:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 33.559867251, 2020-11-12T17:23:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162, 2020-11-12T17:23:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452124+0000", 2020-11-12T17:23:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6100000000000003e-05 2020-11-12T17:23:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452160+0000", 2020-11-12T17:23:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199026693 2020-11-12T17:23:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651186+0000", 2020-11-12T17:23:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0820000000000001e-06 2020-11-12T17:23:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651194+0000", 2020-11-12T17:23:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00062788999999999998 2020-11-12T17:23:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651821+0000", 2020-11-12T17:23:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4558e-05 2020-11-12T17:23:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651836+0000", 2020-11-12T17:23:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018151300000000001 2020-11-12T17:23:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652017+0000", 2020-11-12T17:23:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162 2020-11-12T17:23:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:6048 3.7 3:e3840c9f:::benchmark_data_smithi036_14212_object755:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.919912+0000", 2020-11-12T17:23:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 33.092093558999998, 2020-11-12T17:23:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151432184, 2020-11-12T17:23:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 6048 2020-11-12T17:23:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.919912+0000", 2020-11-12T17:23:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.919912+0000", 2020-11-12T17:23:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:44.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.919863+0000", 2020-11-12T17:23:44.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013728500000000001 2020-11-12T17:23:44.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920000+0000", 2020-11-12T17:23:44.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1212e-05 2020-11-12T17:23:44.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920021+0000", 2020-11-12T17:23:44.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8639999999999996e-06 2020-11-12T17:23:44.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920029+0000", 2020-11-12T17:23:44.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00076714100000000005 2020-11-12T17:23:44.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920796+0000", 2020-11-12T17:23:44.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013040299999999999 2020-11-12T17:23:44.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.920926+0000", 2020-11-12T17:23:44.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000194205 2020-11-12T17:23:44.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:44.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.921121+0000", 2020-11-12T17:23:44.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025300639999999998 2020-11-12T17:23:44.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.923651+0000", 2020-11-12T17:23:44.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14748789600000001 2020-11-12T17:23:44.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.071139+0000", 2020-11-12T17:23:44.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0044999999999996e-05 2020-11-12T17:23:44.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.071229+0000", 2020-11-12T17:23:44.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011548999999999999 2020-11-12T17:23:44.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:11.071344+0000", 2020-11-12T17:23:44.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.151432184 2020-11-12T17:23:44.115 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.115 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.115 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.115 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:44.116 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:44.116 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.593517287000001, 2020-11-12T17:23:44.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:23:44.116 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.116 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.116 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.116 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.117 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.117 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:23:44.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.117 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:44.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:44.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:23:44.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:23:44.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:23:44.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:23:44.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:23:44.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:23:44.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:23:44.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:23:44.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:23:44.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:23:44.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:23:44.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:23:44.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:23:44.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:44.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:23:44.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:23:44.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:23:44.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:23:44.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:23:44.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:23:44.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:23:44.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:23:44.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:23:44.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:23:44.126 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.126 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.128 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:23:44.128 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:44.128 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.586573224999999, 2020-11-12T17:23:44.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:23:44.129 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.129 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:44.129 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:44.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:44.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:44.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:23:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:23:44.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:23:44.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:23:44.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:23:44.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:23:44.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:23:44.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:23:44.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:23:44.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:23:44.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:23:44.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:23:44.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.205 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.207 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:44.207 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:44.207 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.031496069999999, 2020-11-12T17:23:44.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866, 2020-11-12T17:23:44.208 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.208 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.209 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.209 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.209 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.210 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:44.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.210 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:44.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:44.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:44.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980460+0000", 2020-11-12T17:23:44.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012467899999999999 2020-11-12T17:23:44.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980585+0000", 2020-11-12T17:23:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6456e-05 2020-11-12T17:23:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980602+0000", 2020-11-12T17:23:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9169999999999995e-06 2020-11-12T17:23:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980611+0000", 2020-11-12T17:23:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015059000000000001 2020-11-12T17:23:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980761+0000", 2020-11-12T17:23:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9624999999999997e-05 2020-11-12T17:23:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980841+0000", 2020-11-12T17:23:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133702 2020-11-12T17:23:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980974+0000", 2020-11-12T17:23:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001625076 2020-11-12T17:23:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.982600+0000", 2020-11-12T17:23:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18301002199999999 2020-11-12T17:23:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165610+0000", 2020-11-12T17:23:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4160999999999998e-05 2020-11-12T17:23:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165674+0000", 2020-11-12T17:23:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000127661 2020-11-12T17:23:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165801+0000", 2020-11-12T17:23:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866 2020-11-12T17:23:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e27)", 2020-11-12T17:23:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.019784316999999, 2020-11-12T17:23:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678, 2020-11-12T17:23:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:23:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:23:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992202+0000", 2020-11-12T17:23:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5812e-05 2020-11-12T17:23:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992258+0000", 2020-11-12T17:23:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3090000000000001e-06 2020-11-12T17:23:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992267+0000", 2020-11-12T17:23:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7680000000000008e-06 2020-11-12T17:23:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992275+0000", 2020-11-12T17:23:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0019000000000003e-05 2020-11-12T17:23:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992335+0000", 2020-11-12T17:23:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0896999999999995e-05 2020-11-12T17:23:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:23:44.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992416+0000", 2020-11-12T17:23:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17331891299999999 2020-11-12T17:23:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165735+0000", 2020-11-12T17:23:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678 2020-11-12T17:23:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10064 3.7 3:e0dfa39d:::benchmark_data_smithi036_14212_object1257:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 28.998937198, 2020-11-12T17:23:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999, 2020-11-12T17:23:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10064 2020-11-12T17:23:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013037+0000", 2020-11-12T17:23:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7905000000000006e-05 2020-11-12T17:23:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013125+0000", 2020-11-12T17:23:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4722999999999999e-05 2020-11-12T17:23:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013140+0000", 2020-11-12T17:23:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6830000000000008e-06 2020-11-12T17:23:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013148+0000", 2020-11-12T17:23:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:23:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013223+0000", 2020-11-12T17:23:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020518000000000001 2020-11-12T17:23:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013428+0000", 2020-11-12T17:23:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023399799999999999 2020-11-12T17:23:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013662+0000", 2020-11-12T17:23:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034048939999999999 2020-11-12T17:23:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.017067+0000", 2020-11-12T17:23:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18367845899999999 2020-11-12T17:23:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200745+0000", 2020-11-12T17:23:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013196599999999999 2020-11-12T17:23:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200877+0000", 2020-11-12T17:23:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011756099999999999 2020-11-12T17:23:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200995+0000", 2020-11-12T17:23:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999 2020-11-12T17:23:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:10064 3.7 e27/20 ondisk, result = 0)", 2020-11-12T17:23:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 28.993323207, 2020-11-12T17:23:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999, 2020-11-12T17:23:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018663+0000", 2020-11-12T17:23:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1436e-05 2020-11-12T17:23:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018714+0000", 2020-11-12T17:23:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18186307199999999 2020-11-12T17:23:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200577+0000", 2020-11-12T17:23:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5204e-05 2020-11-12T17:23:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200592+0000", 2020-11-12T17:23:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110565 2020-11-12T17:23:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200703+0000", 2020-11-12T17:23:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2906000000000001e-05 2020-11-12T17:23:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200726+0000", 2020-11-12T17:23:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028337099999999998 2020-11-12T17:23:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.201009+0000", 2020-11-12T17:23:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999 2020-11-12T17:23:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19272 3.2 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.9634068559999998, 2020-11-12T17:23:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899, 2020-11-12T17:23:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19272 2020-11-12T17:23:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:23:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048566+0000", 2020-11-12T17:23:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108874 2020-11-12T17:23:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048675+0000", 2020-11-12T17:23:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3494e-05 2020-11-12T17:23:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048688+0000", 2020-11-12T17:23:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8549999999999996e-06 2020-11-12T17:23:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048695+0000", 2020-11-12T17:23:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010513026 2020-11-12T17:23:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059208+0000", 2020-11-12T17:23:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107161 2020-11-12T17:23:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059315+0000", 2020-11-12T17:23:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019627499999999999 2020-11-12T17:23:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059511+0000", 2020-11-12T17:23:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014392770000000001 2020-11-12T17:23:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060951+0000", 2020-11-12T17:23:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18718517000000001 2020-11-12T17:23:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248136+0000", 2020-11-12T17:23:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099000000000003e-05 2020-11-12T17:23:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248198+0000", 2020-11-12T17:23:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7726999999999998e-05 2020-11-12T17:23:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248256+0000", 2020-11-12T17:23:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899 2020-11-12T17:23:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19280 3.b 3:d8a2f1b1:::benchmark_data_smithi036_14212_object2409:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:39.059417+0000", 2020-11-12T17:23:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.9525886940000001, 2020-11-12T17:23:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17050370200000001, 2020-11-12T17:23:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19280 2020-11-12T17:23:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059417+0000", 2020-11-12T17:23:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059417+0000", 2020-11-12T17:23:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059386+0000", 2020-11-12T17:23:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000167174 2020-11-12T17:23:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059553+0000", 2020-11-12T17:23:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2649e-05 2020-11-12T17:23:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059566+0000", 2020-11-12T17:23:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4980000000000003e-06 2020-11-12T17:23:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059572+0000", 2020-11-12T17:23:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011039870000000001 2020-11-12T17:23:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060676+0000", 2020-11-12T17:23:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010639100000000001 2020-11-12T17:23:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060783+0000", 2020-11-12T17:23:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018312299999999999 2020-11-12T17:23:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060966+0000", 2020-11-12T17:23:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041580059999999997 2020-11-12T17:23:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.065124+0000", 2020-11-12T17:23:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16470816499999999 2020-11-12T17:23:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.229832+0000", 2020-11-12T17:23:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9223e-05 2020-11-12T17:23:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.229871+0000", 2020-11-12T17:23:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9453000000000002e-05 2020-11-12T17:23:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.229921+0000", 2020-11-12T17:23:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17050370200000001 2020-11-12T17:23:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23704 3.8 3:19577b19:::benchmark_data_smithi036_14212_object2962:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.699378+0000", 2020-11-12T17:23:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.31262754999999998, 2020-11-12T17:23:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16395786700000001, 2020-11-12T17:23:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23704 2020-11-12T17:23:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699378+0000", 2020-11-12T17:23:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699378+0000", 2020-11-12T17:23:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999514 2020-11-12T17:23:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699329+0000", 2020-11-12T17:23:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012612699999999999 2020-11-12T17:23:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699455+0000", 2020-11-12T17:23:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7482999999999998e-05 2020-11-12T17:23:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699473+0000", 2020-11-12T17:23:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0265000000000001e-05 2020-11-12T17:23:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699483+0000", 2020-11-12T17:23:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092479469999999994 2020-11-12T17:23:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.708731+0000", 2020-11-12T17:23:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010935 2020-11-12T17:23:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.708840+0000", 2020-11-12T17:23:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012120099999999999 2020-11-12T17:23:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.708962+0000", 2020-11-12T17:23:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019714810000000002 2020-11-12T17:23:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.710933+0000", 2020-11-12T17:23:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15228412199999999 2020-11-12T17:23:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863217+0000", 2020-11-12T17:23:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5543000000000002e-05 2020-11-12T17:23:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863253+0000", 2020-11-12T17:23:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3109000000000007e-05 2020-11-12T17:23:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863336+0000", 2020-11-12T17:23:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16395786700000001 2020-11-12T17:23:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:23704 3.8 e45/20 ondisk, result = 0)", 2020-11-12T17:23:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.710976+0000", 2020-11-12T17:23:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.301029518, 2020-11-12T17:23:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15236971599999999, 2020-11-12T17:23:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.710976+0000", 2020-11-12T17:23:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.710976+0000", 2020-11-12T17:23:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.710952+0000", 2020-11-12T17:23:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9209000000000003e-05 2020-11-12T17:23:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.711001+0000", 2020-11-12T17:23:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.152164295 2020-11-12T17:23:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863166+0000", 2020-11-12T17:23:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9940000000000002e-06 2020-11-12T17:23:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863170+0000", 2020-11-12T17:23:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5768e-05 2020-11-12T17:23:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863205+0000", 2020-11-12T17:23:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1519999999999997e-06 2020-11-12T17:23:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863212+0000", 2020-11-12T17:23:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013422400000000001 2020-11-12T17:23:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863346+0000", 2020-11-12T17:23:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15236971599999999 2020-11-12T17:23:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23704 3.8 3:19577b19:::benchmark_data_smithi036_14212_object2962:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e45)", 2020-11-12T17:23:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.716204+0000", 2020-11-12T17:23:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.29580195399999998, 2020-11-12T17:23:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14706651300000001, 2020-11-12T17:23:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:23:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23704 2020-11-12T17:23:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.716204+0000", 2020-11-12T17:23:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.716204+0000", 2020-11-12T17:23:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.716171+0000", 2020-11-12T17:23:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0714000000000001e-05 2020-11-12T17:23:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.716242+0000", 2020-11-12T17:23:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7570000000000004e-06 2020-11-12T17:23:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.716250+0000", 2020-11-12T17:23:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0629999999999999e-06 2020-11-12T17:23:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.716254+0000", 2020-11-12T17:23:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133843 2020-11-12T17:23:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.716388+0000", 2020-11-12T17:23:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7182999999999998e-05 2020-11-12T17:23:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:23:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.716445+0000", 2020-11-12T17:23:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.146825281 2020-11-12T17:23:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863270+0000", 2020-11-12T17:23:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14706651300000001 2020-11-12T17:23:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:44.371 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:44.372 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:44.373 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:44.364+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:44.474 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:44.470+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:44.499 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:44.510 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:44.511 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:23:44.511 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:44.513 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:44.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:23:44.565117+0000 min lat: 0.00161593 max lat: 14.2555 avg lat: 0.0259715 2020-11-12T17:23:44.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:23:44.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 40 16 24625 24609 4.80594 8.28125 0.0123027 0.0259715 2020-11-12T17:23:44.575 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:44.568+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:44.673 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:44.674 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:44.674 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:44.674 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:44.674 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:44.677 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:44.674+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:44.686 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:44.777 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:44.772+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:44.860 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:44.860 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:44.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:44.861 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:44.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.862 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:44.862 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:44.862 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.099167180999999, 2020-11-12T17:23:44.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:23:44.863 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:44.863 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:44.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:44.864 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.864 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:23:44.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.864 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:44.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:44.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:44.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:44.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:44.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:44.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:44.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:44.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:23:44.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:23:44.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:44.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:23:44.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:23:44.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:44.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:23:44.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:23:44.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:23:44.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:23:44.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:44.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:23:44.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:23:44.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:44.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:23:44.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:23:44.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:44.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:23:44.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:23:44.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:44.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:23:44.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:23:44.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:23:44.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:23:44.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:44.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:23:44.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:23:44.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:44.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:23:44.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:23:44.881 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.882 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:44.882 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.883 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:23:44.883 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:44.883 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.092368329999999, 2020-11-12T17:23:44.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:23:44.884 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:44.884 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:44.885 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:44.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:44.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:44.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:44.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:44.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:44.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:23:44.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:44.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:23:44.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:23:44.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:44.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:23:44.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:23:44.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:44.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:23:44.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:23:44.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:23:44.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:23:44.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:44.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:23:44.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:23:44.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:44.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:23:44.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:23:44.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:44.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:23:44.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:23:44.898 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.899 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:44.899 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.900 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1104 3.9 3:9f55e211:::benchmark_data_smithi036_14212_object137:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:44.900 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:44.900 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.240573978999997, 2020-11-12T17:23:44.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001, 2020-11-12T17:23:44.901 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:44.901 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.901 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:44.902 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:44.902 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.902 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1104 2020-11-12T17:23:44.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.903 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:44.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:44.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:44.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:44.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:44.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:44.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:44.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:44.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617385+0000", 2020-11-12T17:23:44.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9141999999999994e-05 2020-11-12T17:23:44.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:44.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617484+0000", 2020-11-12T17:23:44.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2413e-05 2020-11-12T17:23:44.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:44.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617497+0000", 2020-11-12T17:23:44.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1659999999999999e-06 2020-11-12T17:23:44.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617503+0000", 2020-11-12T17:23:44.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032791000000000001 2020-11-12T17:23:44.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:44.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620782+0000", 2020-11-12T17:23:44.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102198 2020-11-12T17:23:44.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:44.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620884+0000", 2020-11-12T17:23:44.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114058 2020-11-12T17:23:44.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:44.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620998+0000", 2020-11-12T17:23:44.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018203270000000001 2020-11-12T17:23:44.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:44.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622818+0000", 2020-11-12T17:23:44.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.203924995 2020-11-12T17:23:44.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826743+0000", 2020-11-12T17:23:44.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012106 2020-11-12T17:23:44.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:44.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826865+0000", 2020-11-12T17:23:44.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014220699999999999 2020-11-12T17:23:44.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:44.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827007+0000", 2020-11-12T17:23:44.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001 2020-11-12T17:23:44.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.922 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:44.922 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.923 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1104 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:44.923 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:44.923 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.235645196999997, 2020-11-12T17:23:44.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999, 2020-11-12T17:23:44.924 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:44.924 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:44.925 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:44.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:44.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:44.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:44.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:44.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:44.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:23:44.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:44.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622338+0000", 2020-11-12T17:23:44.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5814e-05 2020-11-12T17:23:44.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:44.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622374+0000", 2020-11-12T17:23:44.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20244251299999999 2020-11-12T17:23:44.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:44.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824817+0000", 2020-11-12T17:23:44.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.117e-05 2020-11-12T17:23:44.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824828+0000", 2020-11-12T17:23:44.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001882332 2020-11-12T17:23:44.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:44.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826710+0000", 2020-11-12T17:23:44.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6818000000000001e-05 2020-11-12T17:23:44.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:44.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826727+0000", 2020-11-12T17:23:44.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031566199999999997 2020-11-12T17:23:44.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:44.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827043+0000", 2020-11-12T17:23:44.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999 2020-11-12T17:23:44.937 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.938 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:44.938 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.939 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:44.939 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:44.939 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 38.849109554000002, 2020-11-12T17:23:44.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:23:44.940 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:44.940 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.941 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:44.941 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:44.941 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.941 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:23:44.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.942 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:44.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:44.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:44.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:44.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:44.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:44.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:44.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:44.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:23:44.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:23:44.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:44.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:23:44.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:23:44.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:44.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:23:44.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:23:44.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:23:44.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:23:44.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:44.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:23:44.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:23:44.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:44.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:23:44.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:23:44.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:44.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:23:44.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:23:44.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:44.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:23:44.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:23:44.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:23:44.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:23:44.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:44.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:23:44.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:23:44.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:44.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:23:44.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:23:44.956 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.956 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:44.956 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.957 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:44.957 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:44.957 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 38.841894373000002, 2020-11-12T17:23:44.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:23:44.957 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:44.958 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:44.958 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:44.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:44.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:44.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:44.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:44.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:44.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:23:44.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:44.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:23:44.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:23:44.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:44.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:23:44.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:23:44.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:44.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:23:44.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:23:44.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:23:44.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:23:44.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:44.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:23:44.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:23:44.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:44.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:23:44.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:23:44.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:44.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:23:44.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:23:44.964 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.964 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:44.964 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.964 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:4896 3.3 3:c1830331:::benchmark_data_smithi036_14212_object611:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:44.964 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:44.965 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.04182445, 2020-11-12T17:23:44.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001, 2020-11-12T17:23:44.965 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:44.965 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:44.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:44.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.965 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 4896 2020-11-12T17:23:44.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.966 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:44.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:44.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:44.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:44.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:44.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:44.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:23:44.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:44.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816142+0000", 2020-11-12T17:23:44.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7733999999999998e-05 2020-11-12T17:23:44.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:44.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816220+0000", 2020-11-12T17:23:44.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2221999999999999e-05 2020-11-12T17:23:44.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:44.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816232+0000", 2020-11-12T17:23:44.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4469999999999997e-06 2020-11-12T17:23:44.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816237+0000", 2020-11-12T17:23:44.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012662909999999999 2020-11-12T17:23:44.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:44.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817504+0000", 2020-11-12T17:23:44.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167959 2020-11-12T17:23:44.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:44.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817672+0000", 2020-11-12T17:23:44.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025141300000000003 2020-11-12T17:23:44.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:44.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817923+0000", 2020-11-12T17:23:44.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001128467 2020-11-12T17:23:44.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:44.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.819051+0000", 2020-11-12T17:23:44.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19242863199999999 2020-11-12T17:23:44.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011480+0000", 2020-11-12T17:23:44.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9741999999999996e-05 2020-11-12T17:23:44.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:44.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011560+0000", 2020-11-12T17:23:44.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4276e-05 2020-11-12T17:23:44.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:44.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011614+0000", 2020-11-12T17:23:44.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001 2020-11-12T17:23:44.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.974 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:44.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.975 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4896 3.3 e25/20 ondisk, result = 0)", 2020-11-12T17:23:44.975 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:44.975 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.034438612000002, 2020-11-12T17:23:44.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.188067817, 2020-11-12T17:23:44.975 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:44.976 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:44.976 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:44.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:44.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:44.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:44.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:44.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:44.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:44.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:44.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823525+0000", 2020-11-12T17:23:44.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-05 2020-11-12T17:23:44.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:44.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823615+0000", 2020-11-12T17:23:44.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18777782700000001 2020-11-12T17:23:44.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:44.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011392+0000", 2020-11-12T17:23:44.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9179999999999997e-06 2020-11-12T17:23:44.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011399+0000", 2020-11-12T17:23:44.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5306000000000002e-05 2020-11-12T17:23:44.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:44.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011455+0000", 2020-11-12T17:23:44.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3124e-05 2020-11-12T17:23:44.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:44.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011468+0000", 2020-11-12T17:23:44.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015874800000000001 2020-11-12T17:23:44.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:44.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011627+0000", 2020-11-12T17:23:44.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.188067817 2020-11-12T17:23:44.981 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.982 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:44.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:44.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.982 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:44.982 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:44.982 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.171449482, 2020-11-12T17:23:44.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:23:44.983 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:44.983 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:44.983 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:44.983 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:44.983 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:44.983 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:23:44.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.984 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:44.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:44.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:44.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:44.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:44.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:44.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:44.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:44.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:23:44.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:23:44.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:44.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:23:44.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:23:44.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:23:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:23:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:23:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:23:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:23:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:23:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:44.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:23:44.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:23:44.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:44.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:23:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:23:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:23:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:23:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:23:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:23:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:23:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:23:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:23:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:23:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.171284579000002, 2020-11-12T17:23:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:23:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:23:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:45.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:23:45.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:23:45.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:23:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:23:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:23:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:23:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:23:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:23:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:23:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:23:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:23:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:23:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:23:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:23:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:23:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:23:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:23:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:23:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:23:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:23:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:23:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:23:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.167121344999998, 2020-11-12T17:23:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:23:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:45.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:45.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:23:45.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:23:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:23:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:23:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:23:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:23:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:23:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:23:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:23:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:23:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:23:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:23:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:23:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:23:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:23:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.021 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.021 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:45.021 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:45.021 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.165804510000001, 2020-11-12T17:23:45.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:23:45.022 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.022 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:45.022 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:45.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:45.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:23:45.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:23:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:23:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:23:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:23:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:23:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:23:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:23:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:23:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:23:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:23:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:23:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:23:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:23:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:23:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:23:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.303484877999999, 2020-11-12T17:23:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:23:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:23:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:23:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:23:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:23:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:23:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:23:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:23:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:23:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:23:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:23:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:23:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:23:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:23:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:23:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:23:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:23:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:23:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.97568291, 2020-11-12T17:23:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:23:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:23:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:23:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:23:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:23:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:23:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:23:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:23:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:23:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:23:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:23:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:23:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:23:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:23:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:23:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:23:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:23:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:23:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:23:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:23:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:23:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:23:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:23:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:23:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:23:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:23:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.968439200999999, 2020-11-12T17:23:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:23:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:23:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:23:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:23:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:23:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:23:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:23:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:23:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:23:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:23:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:23:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:23:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:23:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:23:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:23:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:23:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18077 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.885881+0000", 2020-11-12T17:23:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.9721164570000003, 2020-11-12T17:23:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.185238772, 2020-11-12T17:23:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18077 2020-11-12T17:23:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885881+0000", 2020-11-12T17:23:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885881+0000", 2020-11-12T17:23:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885857+0000", 2020-11-12T17:23:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6453999999999997e-05 2020-11-12T17:23:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885933+0000", 2020-11-12T17:23:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1838000000000001e-05 2020-11-12T17:23:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885945+0000", 2020-11-12T17:23:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1880000000000008e-06 2020-11-12T17:23:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885954+0000", 2020-11-12T17:23:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8446000000000003e-05 2020-11-12T17:23:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886003+0000", 2020-11-12T17:23:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011008199999999999 2020-11-12T17:23:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886113+0000", 2020-11-12T17:23:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018435399999999999 2020-11-12T17:23:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886297+0000", 2020-11-12T17:23:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040884600000000004 2020-11-12T17:23:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890385+0000", 2020-11-12T17:23:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.180543073 2020-11-12T17:23:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.070928+0000", 2020-11-12T17:23:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9800000000000001e-05 2020-11-12T17:23:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.071018+0000", 2020-11-12T17:23:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101326 2020-11-12T17:23:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.071120+0000", 2020-11-12T17:23:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.185238772 2020-11-12T17:23:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18078 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.9719995560000001, 2020-11-12T17:23:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001, 2020-11-12T17:23:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18078 2020-11-12T17:23:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885975+0000", 2020-11-12T17:23:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1489000000000006e-05 2020-11-12T17:23:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886047+0000", 2020-11-12T17:23:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7270000000000002e-06 2020-11-12T17:23:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886057+0000", 2020-11-12T17:23:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4660000000000001e-06 2020-11-12T17:23:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886061+0000", 2020-11-12T17:23:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001076579 2020-11-12T17:23:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887138+0000", 2020-11-12T17:23:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131815 2020-11-12T17:23:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887270+0000", 2020-11-12T17:23:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018425599999999999 2020-11-12T17:23:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887454+0000", 2020-11-12T17:23:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048314439999999998 2020-11-12T17:23:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892285+0000", 2020-11-12T17:23:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18195460599999999 2020-11-12T17:23:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074240+0000", 2020-11-12T17:23:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167078 2020-11-12T17:23:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074407+0000", 2020-11-12T17:23:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112014 2020-11-12T17:23:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074519+0000", 2020-11-12T17:23:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001 2020-11-12T17:23:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18079 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.9718900100000001, 2020-11-12T17:23:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999, 2020-11-12T17:23:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18079 2020-11-12T17:23:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886083+0000", 2020-11-12T17:23:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1087999999999993e-05 2020-11-12T17:23:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886164+0000", 2020-11-12T17:23:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8720000000000008e-06 2020-11-12T17:23:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886173+0000", 2020-11-12T17:23:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2519999999999996e-06 2020-11-12T17:23:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886179+0000", 2020-11-12T17:23:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027277500000000001 2020-11-12T17:23:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.888907+0000", 2020-11-12T17:23:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019889199999999999 2020-11-12T17:23:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889106+0000", 2020-11-12T17:23:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028895700000000001 2020-11-12T17:23:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889395+0000", 2020-11-12T17:23:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003372571 2020-11-12T17:23:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892767+0000", 2020-11-12T17:23:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.181837265 2020-11-12T17:23:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074604+0000", 2020-11-12T17:23:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.135e-05 2020-11-12T17:23:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074666+0000", 2020-11-12T17:23:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7472999999999996e-05 2020-11-12T17:23:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074733+0000", 2020-11-12T17:23:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999 2020-11-12T17:23:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18080 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.9713885229999999, 2020-11-12T17:23:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999, 2020-11-12T17:23:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18080 2020-11-12T17:23:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886586+0000", 2020-11-12T17:23:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3144000000000002e-05 2020-11-12T17:23:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886669+0000", 2020-11-12T17:23:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6894000000000001e-05 2020-11-12T17:23:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886686+0000", 2020-11-12T17:23:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5079999999999999e-06 2020-11-12T17:23:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886693+0000", 2020-11-12T17:23:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037501600000000002 2020-11-12T17:23:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890444+0000", 2020-11-12T17:23:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183449 2020-11-12T17:23:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890627+0000", 2020-11-12T17:23:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000305762 2020-11-12T17:23:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890933+0000", 2020-11-12T17:23:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022402920000000001 2020-11-12T17:23:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.893173+0000", 2020-11-12T17:23:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18168999399999999 2020-11-12T17:23:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074863+0000", 2020-11-12T17:23:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012771700000000001 2020-11-12T17:23:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074991+0000", 2020-11-12T17:23:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0248999999999999e-05 2020-11-12T17:23:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.075051+0000", 2020-11-12T17:23:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999 2020-11-12T17:23:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:23:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:23:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.8060914979999998, 2020-11-12T17:23:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:23:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:23:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:23:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:23:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:23:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:23:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:23:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:23:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:23:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:23:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:23:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:23:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:23:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:23:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:23:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:23:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:23:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:23:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:23:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:23:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:23:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:23:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:23:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:23:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:23:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:23:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.115 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:45.116 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:23:45.117 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:45.119 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:45.114+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:45.218 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:45.212+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:45.236 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:23:45.237 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:45.246 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:45.319 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:45.312+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:45.363 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:45.573 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:45.574 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:45.574 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:45.574 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:45.575 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 41 16 25606 25590 4.87563 7.66406 0.00663207 0.0256142 2020-11-12T17:23:45.576 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:45.576 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:45.570+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:45.677 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:45.670+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:45.741 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:823 3.c 3:36f36e11:::benchmark_data_smithi036_14212_object102:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.330665+0000", 2020-11-12T17:23:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.407487443000001, 2020-11-12T17:23:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.095579737999999997, 2020-11-12T17:23:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 823 2020-11-12T17:23:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330665+0000", 2020-11-12T17:23:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330665+0000", 2020-11-12T17:23:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330633+0000", 2020-11-12T17:23:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109712 2020-11-12T17:23:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330743+0000", 2020-11-12T17:23:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3318e-05 2020-11-12T17:23:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330756+0000", 2020-11-12T17:23:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1728e-05 2020-11-12T17:23:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.330768+0000", 2020-11-12T17:23:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0075436380000000001 2020-11-12T17:23:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.338311+0000", 2020-11-12T17:23:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010406 2020-11-12T17:23:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.338415+0000", 2020-11-12T17:23:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015149799999999999 2020-11-12T17:23:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.338567+0000", 2020-11-12T17:23:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058399790000000004 2020-11-12T17:23:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344407+0000", 2020-11-12T17:23:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.081675758000000001 2020-11-12T17:23:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426083+0000", 2020-11-12T17:23:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7353000000000003e-05 2020-11-12T17:23:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426160+0000", 2020-11-12T17:23:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4445999999999998e-05 2020-11-12T17:23:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.426245+0000", 2020-11-12T17:23:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.095579737999999997 2020-11-12T17:23:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:824 3.c 3:36f36e11:::benchmark_data_smithi036_14212_object102:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.332862+0000", 2020-11-12T17:23:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.405290221999998, 2020-11-12T17:23:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098157404000000004, 2020-11-12T17:23:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.810 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 824 2020-11-12T17:23:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332862+0000", 2020-11-12T17:23:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332862+0000", 2020-11-12T17:23:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:23:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332822+0000", 2020-11-12T17:23:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108002 2020-11-12T17:23:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332930+0000", 2020-11-12T17:23:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:23:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332941+0000", 2020-11-12T17:23:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5189999999999998e-06 2020-11-12T17:23:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.332948+0000", 2020-11-12T17:23:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064326440000000004 2020-11-12T17:23:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.339380+0000", 2020-11-12T17:23:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000138391 2020-11-12T17:23:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.339519+0000", 2020-11-12T17:23:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019887600000000001 2020-11-12T17:23:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.339717+0000", 2020-11-12T17:23:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046980709999999998 2020-11-12T17:23:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.344416+0000", 2020-11-12T17:23:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.086535669999999995 2020-11-12T17:23:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.430951+0000", 2020-11-12T17:23:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0278999999999998e-05 2020-11-12T17:23:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.430991+0000", 2020-11-12T17:23:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.792e-05 2020-11-12T17:23:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.431019+0000", 2020-11-12T17:23:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.098157404000000004 2020-11-12T17:23:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:928 3.2 e22/20 3:4c5417bc:::benchmark_data_smithi036_14212_object115:head v 22'80, mlcod=22'75)", 2020-11-12T17:23:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.305750275999998, 2020-11-12T17:23:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875, 2020-11-12T17:23:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:23:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432388+0000", 2020-11-12T17:23:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2012000000000003e-05 2020-11-12T17:23:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432440+0000", 2020-11-12T17:23:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.11616101500000001 2020-11-12T17:23:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548601+0000", 2020-11-12T17:23:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3270000000000001e-06 2020-11-12T17:23:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548609+0000", 2020-11-12T17:23:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6627999999999997e-05 2020-11-12T17:23:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548706+0000", 2020-11-12T17:23:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9027999999999999e-05 2020-11-12T17:23:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548755+0000", 2020-11-12T17:23:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038296739999999999 2020-11-12T17:23:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552584+0000", 2020-11-12T17:23:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010042 2020-11-12T17:23:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552685+0000", 2020-11-12T17:23:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875 2020-11-12T17:23:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1119 3.c 3:364fce39:::benchmark_data_smithi036_14212_object139:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.108671542000003, 2020-11-12T17:23:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111702974, 2020-11-12T17:23:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1119 2020-11-12T17:23:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629447+0000", 2020-11-12T17:23:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7503999999999993e-05 2020-11-12T17:23:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629545+0000", 2020-11-12T17:23:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2435999999999999e-05 2020-11-12T17:23:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629557+0000", 2020-11-12T17:23:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5889999999999999e-06 2020-11-12T17:23:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629564+0000", 2020-11-12T17:23:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003337773 2020-11-12T17:23:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.632902+0000", 2020-11-12T17:23:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010063199999999999 2020-11-12T17:23:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633002+0000", 2020-11-12T17:23:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000132698 2020-11-12T17:23:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633135+0000", 2020-11-12T17:23:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019819870000000002 2020-11-12T17:23:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.635117+0000", 2020-11-12T17:23:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.105938543 2020-11-12T17:23:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741056+0000", 2020-11-12T17:23:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8002000000000003e-05 2020-11-12T17:23:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741134+0000", 2020-11-12T17:23:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0025999999999998e-05 2020-11-12T17:23:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741184+0000", 2020-11-12T17:23:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111702974 2020-11-12T17:23:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1120 3.c 3:364fce39:::benchmark_data_smithi036_14212_object139:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.633688+0000", 2020-11-12T17:23:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.104464485000001, 2020-11-12T17:23:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109445737, 2020-11-12T17:23:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1120 2020-11-12T17:23:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633688+0000", 2020-11-12T17:23:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633688+0000", 2020-11-12T17:23:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633655+0000", 2020-11-12T17:23:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3597000000000006e-05 2020-11-12T17:23:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633739+0000", 2020-11-12T17:23:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1420000000000001e-05 2020-11-12T17:23:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633750+0000", 2020-11-12T17:23:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5629999999999999e-06 2020-11-12T17:23:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633756+0000", 2020-11-12T17:23:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022420200000000001 2020-11-12T17:23:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633980+0000", 2020-11-12T17:23:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8585000000000007e-05 2020-11-12T17:23:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.634069+0000", 2020-11-12T17:23:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012874800000000001 2020-11-12T17:23:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.634197+0000", 2020-11-12T17:23:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00092912099999999998 2020-11-12T17:23:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.635127+0000", 2020-11-12T17:23:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.107821245 2020-11-12T17:23:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.742948+0000", 2020-11-12T17:23:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100605 2020-11-12T17:23:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.743048+0000", 2020-11-12T17:23:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5061000000000004e-05 2020-11-12T17:23:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.743133+0000", 2020-11-12T17:23:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109445737 2020-11-12T17:23:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1119 3.c e23/20 ondisk, result = 0)", 2020-11-12T17:23:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.636786+0000", 2020-11-12T17:23:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.101366063999997, 2020-11-12T17:23:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.104404152, 2020-11-12T17:23:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636786+0000", 2020-11-12T17:23:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636786+0000", 2020-11-12T17:23:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636769+0000", 2020-11-12T17:23:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9211e-05 2020-11-12T17:23:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.636818+0000", 2020-11-12T17:23:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.10413915 2020-11-12T17:23:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.740957+0000", 2020-11-12T17:23:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2655e-05 2020-11-12T17:23:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.740970+0000", 2020-11-12T17:23:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5438999999999995e-05 2020-11-12T17:23:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741036+0000", 2020-11-12T17:23:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0757999999999999e-05 2020-11-12T17:23:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741046+0000", 2020-11-12T17:23:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014404199999999999 2020-11-12T17:23:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741190+0000", 2020-11-12T17:23:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.104404152 2020-11-12T17:23:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:23:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.233923574000002, 2020-11-12T17:23:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:23:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:23:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:23:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:23:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:23:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:23:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:23:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:23:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:23:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:23:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:23:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:23:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:23:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:23:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:23:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:23:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:23:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:6040 3.d e25/20 3:b8c2806e:::benchmark_data_smithi036_14212_object754:head v 25'360, mlcod=25'354)", 2020-11-12T17:23:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.828617936999997, 2020-11-12T17:23:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431, 2020-11-12T17:23:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909516+0000", 2020-11-12T17:23:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6403999999999996e-05 2020-11-12T17:23:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909582+0000", 2020-11-12T17:23:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.113169626 2020-11-12T17:23:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022752+0000", 2020-11-12T17:23:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1850000000000004e-06 2020-11-12T17:23:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022760+0000", 2020-11-12T17:23:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7312999999999998e-05 2020-11-12T17:23:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022817+0000", 2020-11-12T17:23:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1387999999999999e-05 2020-11-12T17:23:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022838+0000", 2020-11-12T17:23:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001833487 2020-11-12T17:23:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024672+0000", 2020-11-12T17:23:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8751000000000005e-05 2020-11-12T17:23:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024761+0000", 2020-11-12T17:23:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431 2020-11-12T17:23:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9832 3.c 3:3b0730c9:::benchmark_data_smithi036_14212_object1228:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.347361+0000", 2020-11-12T17:23:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.390791013000001, 2020-11-12T17:23:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094955906000000007, 2020-11-12T17:23:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9832 2020-11-12T17:23:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347361+0000", 2020-11-12T17:23:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347361+0000", 2020-11-12T17:23:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347342+0000", 2020-11-12T17:23:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5386000000000001e-05 2020-11-12T17:23:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347397+0000", 2020-11-12T17:23:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3729999999999998e-06 2020-11-12T17:23:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347403+0000", 2020-11-12T17:23:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0360000000000001e-05 2020-11-12T17:23:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.347414+0000", 2020-11-12T17:23:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063595880000000002 2020-11-12T17:23:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.353773+0000", 2020-11-12T17:23:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017073300000000001 2020-11-12T17:23:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.353944+0000", 2020-11-12T17:23:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018458999999999999 2020-11-12T17:23:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.354129+0000", 2020-11-12T17:23:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018879140000000001 2020-11-12T17:23:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.356017+0000", 2020-11-12T17:23:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.086152773000000002 2020-11-12T17:23:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442169+0000", 2020-11-12T17:23:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2831999999999995e-05 2020-11-12T17:23:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442262+0000", 2020-11-12T17:23:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4880000000000003e-05 2020-11-12T17:23:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.442317+0000", 2020-11-12T17:23:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094955906000000007 2020-11-12T17:23:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.211914009000001, 2020-11-12T17:23:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:23:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:23:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:23:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:23:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:23:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:23:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:23:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:23:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:23:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:23:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:23:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:23:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:23:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:23:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:23:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:23:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:23:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:23:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:23:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:23:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:23:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:23:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:23:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:23:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:23:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.208514075, 2020-11-12T17:23:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:23:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:23:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:23:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:23:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:23:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:23:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:23:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:23:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:23:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:23:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:23:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:23:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:23:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:23:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:23:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:17992 3.d e41/20 3:bfb5f180:::benchmark_data_smithi036_14212_object2248:head v 41'952, mlcod=40'947)", 2020-11-12T17:23:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.9320626159999996, 2020-11-12T17:23:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12242665599999999, 2020-11-12T17:23:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806068+0000", 2020-11-12T17:23:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9553000000000002e-05 2020-11-12T17:23:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806147+0000", 2020-11-12T17:23:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120094329 2020-11-12T17:23:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926242+0000", 2020-11-12T17:23:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5110000000000003e-06 2020-11-12T17:23:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926247+0000", 2020-11-12T17:23:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8669000000000002e-05 2020-11-12T17:23:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926326+0000", 2020-11-12T17:23:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0543e-05 2020-11-12T17:23:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926386+0000", 2020-11-12T17:23:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020619430000000001 2020-11-12T17:23:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.928448+0000", 2020-11-12T17:23:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7936999999999997e-05 2020-11-12T17:23:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.928516+0000", 2020-11-12T17:23:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12242665599999999 2020-11-12T17:23:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:18120 3.d e41/20 3:b4a6068b:::benchmark_data_smithi036_14212_object2264:head v 41'960, mlcod=41'953)", 2020-11-12T17:23:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.8005062980000002, 2020-11-12T17:23:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13161703499999999, 2020-11-12T17:23:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:23:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937606+0000", 2020-11-12T17:23:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015189199999999999 2020-11-12T17:23:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937758+0000", 2020-11-12T17:23:45.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.129116967 2020-11-12T17:23:45.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066875+0000", 2020-11-12T17:23:45.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1977999999999999e-05 2020-11-12T17:23:45.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066887+0000", 2020-11-12T17:23:45.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102873 2020-11-12T17:23:45.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066990+0000", 2020-11-12T17:23:45.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8860000000000002e-05 2020-11-12T17:23:45.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.067049+0000", 2020-11-12T17:23:45.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020681240000000002 2020-11-12T17:23:45.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.069117+0000", 2020-11-12T17:23:45.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014595299999999999 2020-11-12T17:23:45.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.069263+0000", 2020-11-12T17:23:45.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13161703499999999 2020-11-12T17:23:45.931 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.931 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.932 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.932 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:19118 3.c 3:37e8b7dc:::benchmark_data_smithi036_14212_object2389:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:45.932 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:38.887389+0000", 2020-11-12T17:23:45.932 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.8507631599999996, 2020-11-12T17:23:45.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.096630643000000002, 2020-11-12T17:23:45.932 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.933 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.933 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 19118 2020-11-12T17:23:45.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.933 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887389+0000", 2020-11-12T17:23:45.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887389+0000", 2020-11-12T17:23:45.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:23:45.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887368+0000", 2020-11-12T17:23:45.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9048000000000001e-05 2020-11-12T17:23:45.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887427+0000", 2020-11-12T17:23:45.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3379999999999994e-06 2020-11-12T17:23:45.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887436+0000", 2020-11-12T17:23:45.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.896e-06 2020-11-12T17:23:45.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.887442+0000", 2020-11-12T17:23:45.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080267580000000002 2020-11-12T17:23:45.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.895469+0000", 2020-11-12T17:23:45.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102191 2020-11-12T17:23:45.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.895571+0000", 2020-11-12T17:23:45.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017947899999999999 2020-11-12T17:23:45.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:45.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.895750+0000", 2020-11-12T17:23:45.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033634789999999999 2020-11-12T17:23:45.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.899114+0000", 2020-11-12T17:23:45.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.084775891000000006 2020-11-12T17:23:45.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.983890+0000", 2020-11-12T17:23:45.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.381e-05 2020-11-12T17:23:45.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.983964+0000", 2020-11-12T17:23:45.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6125000000000002e-05 2020-11-12T17:23:45.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.984020+0000", 2020-11-12T17:23:45.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.096630643000000002 2020-11-12T17:23:45.942 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.942 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.942 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.942 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:19272 3.2 e41/20 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head v 41'1256, mlcod=41'1251)", 2020-11-12T17:23:45.943 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:45.943 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.6765754719999997, 2020-11-12T17:23:45.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118689434, 2020-11-12T17:23:45.943 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.943 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.943 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:45.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:45.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:45.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061534+0000", 2020-11-12T17:23:45.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147861 2020-11-12T17:23:45.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061682+0000", 2020-11-12T17:23:45.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.116405122 2020-11-12T17:23:45.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178087+0000", 2020-11-12T17:23:45.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1800000000000001e-05 2020-11-12T17:23:45.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178098+0000", 2020-11-12T17:23:45.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000129016 2020-11-12T17:23:45.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178227+0000", 2020-11-12T17:23:45.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8186000000000002e-05 2020-11-12T17:23:45.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178286+0000", 2020-11-12T17:23:45.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018917160000000001 2020-11-12T17:23:45.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.180177+0000", 2020-11-12T17:23:45.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8812000000000003e-05 2020-11-12T17:23:45.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.180266+0000", 2020-11-12T17:23:45.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118689434 2020-11-12T17:23:45.950 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.950 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.950 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.951 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20952 3.c 3:3964cfba:::benchmark_data_smithi036_14212_object2618:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:23:45.951 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.657793+0000", 2020-11-12T17:23:45.951 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.0803592599999998, 2020-11-12T17:23:45.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099594468000000005, 2020-11-12T17:23:45.951 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.951 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.951 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.952 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.952 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.952 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20952 2020-11-12T17:23:45.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.952 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657793+0000", 2020-11-12T17:23:45.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657793+0000", 2020-11-12T17:23:45.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:23:45.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657766+0000", 2020-11-12T17:23:45.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4486000000000005e-05 2020-11-12T17:23:45.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657841+0000", 2020-11-12T17:23:45.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9420000000000007e-06 2020-11-12T17:23:45.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657851+0000", 2020-11-12T17:23:45.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6999999999999996e-06 2020-11-12T17:23:45.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.657856+0000", 2020-11-12T17:23:45.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034368160000000001 2020-11-12T17:23:45.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.661293+0000", 2020-11-12T17:23:45.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114543 2020-11-12T17:23:45.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.661408+0000", 2020-11-12T17:23:45.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020112900000000001 2020-11-12T17:23:45.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:45.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.661609+0000", 2020-11-12T17:23:45.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014751689999999999 2020-11-12T17:23:45.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.663084+0000", 2020-11-12T17:23:45.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.094180085999999996 2020-11-12T17:23:45.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:45.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.757264+0000", 2020-11-12T17:23:45.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2193999999999994e-05 2020-11-12T17:23:45.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:45.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.757336+0000", 2020-11-12T17:23:45.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1116000000000003e-05 2020-11-12T17:23:45.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:45.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.757387+0000", 2020-11-12T17:23:45.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099594468000000005 2020-11-12T17:23:45.961 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.961 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:45.961 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:45.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.961 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:21184 3.c 3:3552ec06:::benchmark_data_smithi036_14212_object2647:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e43)", 2020-11-12T17:23:45.961 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.922390+0000", 2020-11-12T17:23:45.962 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.815762018, 2020-11-12T17:23:45.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.10030459899999999, 2020-11-12T17:23:45.962 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:45.962 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:45.962 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:45.962 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:45.962 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:45.962 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 21184 2020-11-12T17:23:45.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.963 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:45.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:45.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.922390+0000", 2020-11-12T17:23:45.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:45.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:45.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.922390+0000", 2020-11-12T17:23:45.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999547 2020-11-12T17:23:45.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:45.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.922345+0000", 2020-11-12T17:23:45.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000140469 2020-11-12T17:23:45.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:45.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.922485+0000", 2020-11-12T17:23:45.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2300999999999999e-05 2020-11-12T17:23:45.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:45.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.922508+0000", 2020-11-12T17:23:45.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0163000000000001e-05 2020-11-12T17:23:45.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:45.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.922518+0000", 2020-11-12T17:23:45.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002782929 2020-11-12T17:23:45.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:45.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.925301+0000", 2020-11-12T17:23:45.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7466999999999995e-05 2020-11-12T17:23:45.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:45.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.925388+0000", 2020-11-12T17:23:45.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013946499999999999 2020-11-12T17:23:45.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:45.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.925528+0000", 2020-11-12T17:23:45.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039161760000000004 2020-11-12T17:23:45.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:45.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:45.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:45.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.929444+0000", 2020-11-12T17:23:45.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.093182825999999996 2020-11-12T17:23:46.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:46.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.022627+0000", 2020-11-12T17:23:46.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1335000000000003e-05 2020-11-12T17:23:46.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:46.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.022668+0000", 2020-11-12T17:23:46.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6780000000000001e-05 2020-11-12T17:23:46.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:46.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.022695+0000", 2020-11-12T17:23:46.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.10030459899999999 2020-11-12T17:23:46.001 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:46.002 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:46.002 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:46.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.002 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:21304 3.c 3:3733c053:::benchmark_data_smithi036_14212_object2662:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e43)", 2020-11-12T17:23:46.002 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:41.067137+0000", 2020-11-12T17:23:46.002 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.6710155950000001, 2020-11-12T17:23:46.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099987874000000004, 2020-11-12T17:23:46.003 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:46.003 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:46.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:46.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:46.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:46.003 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 21304 2020-11-12T17:23:46.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.004 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:46.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:46.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.067137+0000", 2020-11-12T17:23:46.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:46.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:46.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.067137+0000", 2020-11-12T17:23:46.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:23:46.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:46.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.067111+0000", 2020-11-12T17:23:46.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8930000000000005e-05 2020-11-12T17:23:46.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:46.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.067190+0000", 2020-11-12T17:23:46.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0739e-05 2020-11-12T17:23:46.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:46.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.067200+0000", 2020-11-12T17:23:46.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759999999999997e-06 2020-11-12T17:23:46.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:46.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.067207+0000", 2020-11-12T17:23:46.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048687210000000003 2020-11-12T17:23:46.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:46.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.072075+0000", 2020-11-12T17:23:46.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015472700000000001 2020-11-12T17:23:46.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:46.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.072230+0000", 2020-11-12T17:23:46.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198579 2020-11-12T17:23:46.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:46.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.072429+0000", 2020-11-12T17:23:46.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028265120000000002 2020-11-12T17:23:46.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:46.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.075255+0000", 2020-11-12T17:23:46.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.091785809999999995 2020-11-12T17:23:46.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:46.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.167041+0000", 2020-11-12T17:23:46.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0497000000000001e-05 2020-11-12T17:23:46.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:46.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.167091+0000", 2020-11-12T17:23:46.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3077000000000002e-05 2020-11-12T17:23:46.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:46.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.167124+0000", 2020-11-12T17:23:46.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.099987874000000004 2020-11-12T17:23:46.012 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:46.012 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:46.012 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:46.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.013 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:21384 3.2 e43/20 3:48db7915:::benchmark_data_smithi036_14212_object2672:head v 43'1376, mlcod=43'1371)", 2020-11-12T17:23:46.013 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:41.170261+0000", 2020-11-12T17:23:46.013 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.5678916770000004, 2020-11-12T17:23:46.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109568493, 2020-11-12T17:23:46.013 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:46.013 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:46.013 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:46.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:46.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.170261+0000", 2020-11-12T17:23:46.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:46.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:46.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.170261+0000", 2020-11-12T17:23:46.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:23:46.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:46.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.170245+0000", 2020-11-12T17:23:46.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4144000000000002e-05 2020-11-12T17:23:46.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:46.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.170299+0000", 2020-11-12T17:23:46.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.10475084 2020-11-12T17:23:46.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:46.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.275050+0000", 2020-11-12T17:23:46.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4399999999999994e-06 2020-11-12T17:23:46.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:46.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.275060+0000", 2020-11-12T17:23:46.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010338799999999999 2020-11-12T17:23:46.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:46.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.275163+0000", 2020-11-12T17:23:46.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4117e-05 2020-11-12T17:23:46.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:46.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.275187+0000", 2020-11-12T17:23:46.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045820419999999997 2020-11-12T17:23:46.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:46.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.279769+0000", 2020-11-12T17:23:46.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9840999999999998e-05 2020-11-12T17:23:46.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:46.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.279829+0000", 2020-11-12T17:23:46.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109568493 2020-11-12T17:23:46.020 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:46.020 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:46.020 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:46.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.021 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:24744 3.4 e45/35 3:27e37414:::benchmark_data_smithi036_14212_object3092:head v 45'1584, mlcod=45'1580)", 2020-11-12T17:23:46.021 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:23:46.021 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.057598933, 2020-11-12T17:23:46.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999, 2020-11-12T17:23:46.021 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:46.021 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:46.021 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:46.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:46.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:23:46.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:46.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:46.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:23:46.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:23:46.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:46.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680526+0000", 2020-11-12T17:23:46.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3724e-05 2020-11-12T17:23:46.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:46.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680609+0000", 2020-11-12T17:23:46.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.154293649 2020-11-12T17:23:46.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:46.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834903+0000", 2020-11-12T17:23:46.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1653e-05 2020-11-12T17:23:46.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:46.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834915+0000", 2020-11-12T17:23:46.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5685000000000006e-05 2020-11-12T17:23:46.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:46.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834980+0000", 2020-11-12T17:23:46.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4757e-05 2020-11-12T17:23:46.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:46.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.835005+0000", 2020-11-12T17:23:46.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001426067 2020-11-12T17:23:46.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:46.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836431+0000", 2020-11-12T17:23:46.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5732999999999997e-05 2020-11-12T17:23:46.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:46.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:46.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:46.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836477+0000", 2020-11-12T17:23:46.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999 2020-11-12T17:23:46.028 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:46.028 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:46.028 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:46.028 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:46.028 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:46.029 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:46.029 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:46.031 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:45.880+0000 7f658835a700 -1 osd.0 46 handle_osd_map injecting map crc failure 2020-11-12T17:23:46.032 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:45.884+0000 7f7fe1845700 -1 osd.1 46 handle_osd_map injecting map crc failure 2020-11-12T17:23:46.032 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:23:46.032 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:46.033 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:46.026+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:46.132 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:46.124+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:46.205 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:46.224 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:46.224 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:23:46.225 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:46.226 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:46.240 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:46.268 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:46.269 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:46.266+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:46.298 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:46.327 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:46.333 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:46.326+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:46.356 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:46.359 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:46.360 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:46.370 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:46.393 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:46.419 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:46.434 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:46.428+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:46.449 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:46.450 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:46.451 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:46.451 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:46.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:46.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:46.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:46.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:46.453 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:46.532 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:46.598 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:46.600 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 42 16 26615 26599 4.94721 7.88281 0.00815225 0.0252494 2020-11-12T17:23:46.600 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:46.594+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:46.601 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:46.701 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:46.696+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:46.744 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:46.744 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:46.754 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:46.802 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:46.796+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:46.856 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:46.952 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:46.954 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:46.955 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:46.950+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:47.055 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:47.048+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:47.125 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:47.125 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:47.138 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:47.185 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:47.180+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:47.256 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:47.250+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:47.266 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:47.267 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:47.276 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:47.357 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:47.354+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:47.434 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:47.434 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:47.445 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:47.458 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:47.454+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:47.559 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:47.554+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:47.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 43 16 27495 27479 4.99203 6.875 0.0103735 0.0250214 2020-11-12T17:23:47.580 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:47.581 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:47.596 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:47.660 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:47.652+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:47.716 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:47.716 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:47.727 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:47.769 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:47.764+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:47.869 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:47.864+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:47.893 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:47.894 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:47.908 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:48.002 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:47.996+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:48.035 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:23:48.081 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:48.076+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:48.085 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:48.086 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:48.095 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:48.181 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:48.176+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:48.267 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:48.267 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:48.273 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:48.264+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:48.279 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:48.374 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:48.368+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:48.459 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:48.460 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:48.463 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:48.471 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:48.474 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:48.470+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:48.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 44 16 28466 28450 5.05097 7.58594 0.0138873 0.0247222 2020-11-12T17:23:48.575 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:48.570+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:48.640 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:49.160 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:49.161 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:49.161 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:49.162 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:49.162 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:49.162 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:49.163 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:49.164 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:49.164 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:49.164 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:49.164 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:49.164 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:49.164 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:49.165 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:49.165 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:49.165 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:49.165 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:49.165 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:49.154+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:49.166 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:49.260 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:49.254+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:49.298 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:49.299 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:49.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.299 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:29339 3.7 3:e2c56c22:::benchmark_data_smithi036_14212_object3667:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e47)", 2020-11-12T17:23:49.299 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:49.295186+0000", 2020-11-12T17:23:49.299 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0012377779999999999, 2020-11-12T17:23:49.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012616859999999999, 2020-11-12T17:23:49.300 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.300 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:49.300 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.300 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.300 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.301 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29339 2020-11-12T17:23:49.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.301 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.295186+0000", 2020-11-12T17:23:49.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.295186+0000", 2020-11-12T17:23:49.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:49.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.295153+0000", 2020-11-12T17:23:49.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5947999999999997e-05 2020-11-12T17:23:49.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.295249+0000", 2020-11-12T17:23:49.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6991e-05 2020-11-12T17:23:49.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.295266+0000", 2020-11-12T17:23:49.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8231e-05 2020-11-12T17:23:49.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.295304+0000", 2020-11-12T17:23:49.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2461999999999999e-05 2020-11-12T17:23:49.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.295367+0000", 2020-11-12T17:23:49.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107242 2020-11-12T17:23:49.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.295474+0000", 2020-11-12T17:23:49.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013330699999999999 2020-11-12T17:23:49.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:49.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.295607+0000", 2020-11-12T17:23:49.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00042152999999999998 2020-11-12T17:23:49.308 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.308 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.308 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.309 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:29337 3.7 3:e2c56c22:::benchmark_data_smithi036_14212_object3667:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e47)", 2020-11-12T17:23:49.309 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:49.291203+0000", 2020-11-12T17:23:49.309 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0052208760000000002, 2020-11-12T17:23:49.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0053074970000000004, 2020-11-12T17:23:49.309 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.309 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:49.310 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.310 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.310 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.310 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29337 2020-11-12T17:23:49.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.310 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.291203+0000", 2020-11-12T17:23:49.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.291203+0000", 2020-11-12T17:23:49.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:23:49.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.291165+0000", 2020-11-12T17:23:49.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108402 2020-11-12T17:23:49.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.291274+0000", 2020-11-12T17:23:49.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8156e-05 2020-11-12T17:23:49.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.291292+0000", 2020-11-12T17:23:49.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8220000000000002e-06 2020-11-12T17:23:49.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.291302+0000", 2020-11-12T17:23:49.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7973999999999998e-05 2020-11-12T17:23:49.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.291360+0000", 2020-11-12T17:23:49.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026565099999999999 2020-11-12T17:23:49.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.291625+0000", 2020-11-12T17:23:49.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022457099999999999 2020-11-12T17:23:49.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:49.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.291850+0000", 2020-11-12T17:23:49.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00064708699999999997 2020-11-12T17:23:49.318 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.318 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.318 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.319 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:29248 3.7 3:e7d911ae:::benchmark_data_smithi036_14212_object3655:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e47)", 2020-11-12T17:23:49.319 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:49.231842+0000", 2020-11-12T17:23:49.319 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.064582027, 2020-11-12T17:23:49.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.064726480000000003, 2020-11-12T17:23:49.319 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.319 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:49.320 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.320 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.320 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.320 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29248 2020-11-12T17:23:49.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.320 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.231842+0000", 2020-11-12T17:23:49.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.231842+0000", 2020-11-12T17:23:49.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:49.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.231805+0000", 2020-11-12T17:23:49.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010194 2020-11-12T17:23:49.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.231907+0000", 2020-11-12T17:23:49.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7377e-05 2020-11-12T17:23:49.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.231924+0000", 2020-11-12T17:23:49.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1130000000000001e-06 2020-11-12T17:23:49.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.231932+0000", 2020-11-12T17:23:49.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027309959999999999 2020-11-12T17:23:49.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.234663+0000", 2020-11-12T17:23:49.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107763 2020-11-12T17:23:49.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.234771+0000", 2020-11-12T17:23:49.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017206400000000001 2020-11-12T17:23:49.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:49.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.234943+0000", 2020-11-12T17:23:49.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0032335290000000002 2020-11-12T17:23:49.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.238177+0000", 2020-11-12T17:23:49.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0063352149999999999 2020-11-12T17:23:49.329 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.329 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.329 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.330 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:29338 3.7 3:e2c56c22:::benchmark_data_smithi036_14212_object3667:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e47)", 2020-11-12T17:23:49.330 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:49.293203+0000", 2020-11-12T17:23:49.330 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0032201970000000002, 2020-11-12T17:23:49.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034637130000000002, 2020-11-12T17:23:49.330 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.330 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:49.331 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.331 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.331 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.331 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29338 2020-11-12T17:23:49.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.331 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.293203+0000", 2020-11-12T17:23:49.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.293203+0000", 2020-11-12T17:23:49.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:23:49.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.293180+0000", 2020-11-12T17:23:49.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113473 2020-11-12T17:23:49.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.293293+0000", 2020-11-12T17:23:49.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5338000000000001e-05 2020-11-12T17:23:49.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.293309+0000", 2020-11-12T17:23:49.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2990000000000002e-06 2020-11-12T17:23:49.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.293315+0000", 2020-11-12T17:23:49.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0005e-05 2020-11-12T17:23:49.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.293365+0000", 2020-11-12T17:23:49.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012294199999999999 2020-11-12T17:23:49.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.293488+0000", 2020-11-12T17:23:49.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000238547 2020-11-12T17:23:49.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:49.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:49.293727+0000", 2020-11-12T17:23:49.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00052321900000000001 2020-11-12T17:23:49.339 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.339 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.339 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.339 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.340 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:49.340 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 4 2020-11-12T17:23:49.340 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:49.341 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:49.350 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:23:49.360 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:49.352+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:49.462 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:49.458+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:49.481 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:49.482 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:49.482 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:49.482 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:49.482 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:49.493 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:49.562 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:49.556+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:49.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 45 15 29602 29587 5.1361 8.88281 0.0109785 0.0243191 2020-11-12T17:23:49.613 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:49.654 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:49.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:49.655 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:49.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.655 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:335 3.8 3:1a561d42:::benchmark_data_smithi036_14212_object41:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:49.656 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:49.656 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.799931821000001, 2020-11-12T17:23:49.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16935236200000001, 2020-11-12T17:23:49.656 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.657 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.658 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.658 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 335 2020-11-12T17:23:49.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.658 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:49.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808228+0000", 2020-11-12T17:23:49.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999866 2020-11-12T17:23:49.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808094+0000", 2020-11-12T17:23:49.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000224563 2020-11-12T17:23:49.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808319+0000", 2020-11-12T17:23:49.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3512e-05 2020-11-12T17:23:49.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808332+0000", 2020-11-12T17:23:49.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9740000000000008e-06 2020-11-12T17:23:49.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808341+0000", 2020-11-12T17:23:49.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00166 2020-11-12T17:23:49.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810001+0000", 2020-11-12T17:23:49.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013877900000000001 2020-11-12T17:23:49.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810140+0000", 2020-11-12T17:23:49.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018191099999999999 2020-11-12T17:23:49.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:49.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810322+0000", 2020-11-12T17:23:49.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010403820000000001 2020-11-12T17:23:49.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811362+0000", 2020-11-12T17:23:49.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16607825100000001 2020-11-12T17:23:49.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977441+0000", 2020-11-12T17:23:49.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1192999999999995e-05 2020-11-12T17:23:49.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977502+0000", 2020-11-12T17:23:49.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8917000000000004e-05 2020-11-12T17:23:49.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977581+0000", 2020-11-12T17:23:49.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16935236200000001 2020-11-12T17:23:49.674 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.674 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.674 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.674 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:336 3.8 3:1a561d42:::benchmark_data_smithi036_14212_object41:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:49.675 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:49.675 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.799746661, 2020-11-12T17:23:49.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001, 2020-11-12T17:23:49.675 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.675 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.675 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.675 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.676 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.676 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 336 2020-11-12T17:23:49.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.676 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:49.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:49.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:23:49.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808370+0000", 2020-11-12T17:23:49.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8706e-05 2020-11-12T17:23:49.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808469+0000", 2020-11-12T17:23:49.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.329e-06 2020-11-12T17:23:49.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808478+0000", 2020-11-12T17:23:49.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.181e-06 2020-11-12T17:23:49.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808483+0000", 2020-11-12T17:23:49.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022620499999999998 2020-11-12T17:23:49.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810746+0000", 2020-11-12T17:23:49.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6533000000000006e-05 2020-11-12T17:23:49.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810842+0000", 2020-11-12T17:23:49.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018000000000000001 2020-11-12T17:23:49.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:49.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811022+0000", 2020-11-12T17:23:49.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00081152800000000005 2020-11-12T17:23:49.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811834+0000", 2020-11-12T17:23:49.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16750948399999999 2020-11-12T17:23:49.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979343+0000", 2020-11-12T17:23:49.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4766999999999998e-05 2020-11-12T17:23:49.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979408+0000", 2020-11-12T17:23:49.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3001999999999999e-05 2020-11-12T17:23:49.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979451+0000", 2020-11-12T17:23:49.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001 2020-11-12T17:23:49.685 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.685 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.685 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.685 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:335 3.8 e22/20 ondisk, result = 0)", 2020-11-12T17:23:49.685 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.795268166, 2020-11-12T17:23:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.164701714, 2020-11-12T17:23:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812892+0000", 2020-11-12T17:23:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812856+0000", 2020-11-12T17:23:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2423999999999995e-05 2020-11-12T17:23:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.812948+0000", 2020-11-12T17:23:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16219246800000001 2020-11-12T17:23:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.975141+0000", 2020-11-12T17:23:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0543999999999999e-05 2020-11-12T17:23:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.975151+0000", 2020-11-12T17:23:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002271398 2020-11-12T17:23:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977422+0000", 2020-11-12T17:23:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7550000000000006e-06 2020-11-12T17:23:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977432+0000", 2020-11-12T17:23:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016162899999999999 2020-11-12T17:23:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.977594+0000", 2020-11-12T17:23:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.164701714 2020-11-12T17:23:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:808 3.b 3:d27ca39f:::benchmark_data_smithi036_14212_object100:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.288301627000003, 2020-11-12T17:23:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742, 2020-11-12T17:23:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 808 2020-11-12T17:23:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:23:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319816+0000", 2020-11-12T17:23:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012461199999999999 2020-11-12T17:23:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319941+0000", 2020-11-12T17:23:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4997000000000001e-05 2020-11-12T17:23:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319956+0000", 2020-11-12T17:23:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9940000000000003e-06 2020-11-12T17:23:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319963+0000", 2020-11-12T17:23:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011778870000000001 2020-11-12T17:23:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321141+0000", 2020-11-12T17:23:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010428400000000001 2020-11-12T17:23:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321245+0000", 2020-11-12T17:23:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117811 2020-11-12T17:23:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321363+0000", 2020-11-12T17:23:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001974511 2020-11-12T17:23:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323337+0000", 2020-11-12T17:23:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185308416 2020-11-12T17:23:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508646+0000", 2020-11-12T17:23:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3879000000000002e-05 2020-11-12T17:23:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508720+0000", 2020-11-12T17:23:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6706000000000002e-05 2020-11-12T17:23:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508776+0000", 2020-11-12T17:23:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742 2020-11-12T17:23:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:808 3.b e22/20 ondisk, result = 0)", 2020-11-12T17:23:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.284488989000003, 2020-11-12T17:23:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999, 2020-11-12T17:23:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323648+0000", 2020-11-12T17:23:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0744e-05 2020-11-12T17:23:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323709+0000", 2020-11-12T17:23:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18463727299999999 2020-11-12T17:23:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508346+0000", 2020-11-12T17:23:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.798e-06 2020-11-12T17:23:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508356+0000", 2020-11-12T17:23:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027103199999999999 2020-11-12T17:23:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508627+0000", 2020-11-12T17:23:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999993e-06 2020-11-12T17:23:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508637+0000", 2020-11-12T17:23:49.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014688799999999999 2020-11-12T17:23:49.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508784+0000", 2020-11-12T17:23:49.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999 2020-11-12T17:23:49.711 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.711 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.711 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.711 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5672 3.7 3:e4132891:::benchmark_data_smithi036_14212_object708:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:49.711 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:49.712 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.164805393999998, 2020-11-12T17:23:49.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906, 2020-11-12T17:23:49.712 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.712 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.712 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.712 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.712 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.712 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5672 2020-11-12T17:23:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443325+0000", 2020-11-12T17:23:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3981999999999996e-05 2020-11-12T17:23:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443419+0000", 2020-11-12T17:23:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8057e-05 2020-11-12T17:23:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443437+0000", 2020-11-12T17:23:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3709999999999996e-06 2020-11-12T17:23:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443444+0000", 2020-11-12T17:23:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019104530000000001 2020-11-12T17:23:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445354+0000", 2020-11-12T17:23:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2356999999999999e-05 2020-11-12T17:23:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445426+0000", 2020-11-12T17:23:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111113 2020-11-12T17:23:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445538+0000", 2020-11-12T17:23:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00086618700000000003 2020-11-12T17:23:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.446404+0000", 2020-11-12T17:23:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.205445288 2020-11-12T17:23:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651849+0000", 2020-11-12T17:23:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2787000000000005e-05 2020-11-12T17:23:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651942+0000", 2020-11-12T17:23:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2173000000000003e-05 2020-11-12T17:23:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652004+0000", 2020-11-12T17:23:49.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906 2020-11-12T17:23:49.722 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.722 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.722 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.723 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5672 3.7 e25/20 ondisk, result = 0)", 2020-11-12T17:23:49.723 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:49.723 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.156022, 2020-11-12T17:23:49.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162, 2020-11-12T17:23:49.723 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.723 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:49.723 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:49.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452124+0000", 2020-11-12T17:23:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6100000000000003e-05 2020-11-12T17:23:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452160+0000", 2020-11-12T17:23:49.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199026693 2020-11-12T17:23:49.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651186+0000", 2020-11-12T17:23:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0820000000000001e-06 2020-11-12T17:23:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651194+0000", 2020-11-12T17:23:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00062788999999999998 2020-11-12T17:23:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651821+0000", 2020-11-12T17:23:49.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4558e-05 2020-11-12T17:23:49.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651836+0000", 2020-11-12T17:23:49.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018151300000000001 2020-11-12T17:23:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652017+0000", 2020-11-12T17:23:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162 2020-11-12T17:23:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 35.189672035999997, 2020-11-12T17:23:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:23:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:23:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:23:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:23:49.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:23:49.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:23:49.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:23:49.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:23:49.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:23:49.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:23:49.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:23:49.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:23:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:23:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:23:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:23:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:23:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:23:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:23:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:23:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:23:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:23:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:23:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:23:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:23:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:23:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:23:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 35.182727974000002, 2020-11-12T17:23:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:23:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:23:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:23:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:23:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:23:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:23:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:23:49.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:23:49.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:23:49.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:23:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:23:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:23:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:23:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:23:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:23:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.627650819000003, 2020-11-12T17:23:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866, 2020-11-12T17:23:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980460+0000", 2020-11-12T17:23:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012467899999999999 2020-11-12T17:23:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980585+0000", 2020-11-12T17:23:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6456e-05 2020-11-12T17:23:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980602+0000", 2020-11-12T17:23:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9169999999999995e-06 2020-11-12T17:23:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980611+0000", 2020-11-12T17:23:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015059000000000001 2020-11-12T17:23:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980761+0000", 2020-11-12T17:23:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9624999999999997e-05 2020-11-12T17:23:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980841+0000", 2020-11-12T17:23:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133702 2020-11-12T17:23:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980974+0000", 2020-11-12T17:23:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001625076 2020-11-12T17:23:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.982600+0000", 2020-11-12T17:23:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18301002199999999 2020-11-12T17:23:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165610+0000", 2020-11-12T17:23:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4160999999999998e-05 2020-11-12T17:23:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165674+0000", 2020-11-12T17:23:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000127661 2020-11-12T17:23:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165801+0000", 2020-11-12T17:23:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866 2020-11-12T17:23:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e27)", 2020-11-12T17:23:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.615939066000003, 2020-11-12T17:23:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678, 2020-11-12T17:23:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:23:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:23:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992202+0000", 2020-11-12T17:23:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5812e-05 2020-11-12T17:23:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992258+0000", 2020-11-12T17:23:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3090000000000001e-06 2020-11-12T17:23:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992267+0000", 2020-11-12T17:23:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7680000000000008e-06 2020-11-12T17:23:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992275+0000", 2020-11-12T17:23:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0019000000000003e-05 2020-11-12T17:23:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992335+0000", 2020-11-12T17:23:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0896999999999995e-05 2020-11-12T17:23:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:23:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992416+0000", 2020-11-12T17:23:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17331891299999999 2020-11-12T17:23:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165735+0000", 2020-11-12T17:23:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678 2020-11-12T17:23:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10064 3.7 3:e0dfa39d:::benchmark_data_smithi036_14212_object1257:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.595091947, 2020-11-12T17:23:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999, 2020-11-12T17:23:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10064 2020-11-12T17:23:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013037+0000", 2020-11-12T17:23:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7905000000000006e-05 2020-11-12T17:23:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013125+0000", 2020-11-12T17:23:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4722999999999999e-05 2020-11-12T17:23:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013140+0000", 2020-11-12T17:23:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6830000000000008e-06 2020-11-12T17:23:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013148+0000", 2020-11-12T17:23:49.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:23:49.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013223+0000", 2020-11-12T17:23:49.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020518000000000001 2020-11-12T17:23:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013428+0000", 2020-11-12T17:23:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023399799999999999 2020-11-12T17:23:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013662+0000", 2020-11-12T17:23:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034048939999999999 2020-11-12T17:23:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.017067+0000", 2020-11-12T17:23:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18367845899999999 2020-11-12T17:23:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200745+0000", 2020-11-12T17:23:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013196599999999999 2020-11-12T17:23:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200877+0000", 2020-11-12T17:23:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011756099999999999 2020-11-12T17:23:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200995+0000", 2020-11-12T17:23:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999 2020-11-12T17:23:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:10064 3.7 e27/20 ondisk, result = 0)", 2020-11-12T17:23:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.589477956000003, 2020-11-12T17:23:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999, 2020-11-12T17:23:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018663+0000", 2020-11-12T17:23:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1436e-05 2020-11-12T17:23:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018714+0000", 2020-11-12T17:23:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18186307199999999 2020-11-12T17:23:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200577+0000", 2020-11-12T17:23:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5204e-05 2020-11-12T17:23:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200592+0000", 2020-11-12T17:23:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110565 2020-11-12T17:23:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200703+0000", 2020-11-12T17:23:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2906000000000001e-05 2020-11-12T17:23:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200726+0000", 2020-11-12T17:23:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028337099999999998 2020-11-12T17:23:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.201009+0000", 2020-11-12T17:23:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999 2020-11-12T17:23:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19272 3.2 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.559561605000001, 2020-11-12T17:23:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899, 2020-11-12T17:23:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19272 2020-11-12T17:23:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:23:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048566+0000", 2020-11-12T17:23:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108874 2020-11-12T17:23:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048675+0000", 2020-11-12T17:23:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3494e-05 2020-11-12T17:23:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048688+0000", 2020-11-12T17:23:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8549999999999996e-06 2020-11-12T17:23:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048695+0000", 2020-11-12T17:23:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010513026 2020-11-12T17:23:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059208+0000", 2020-11-12T17:23:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107161 2020-11-12T17:23:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059315+0000", 2020-11-12T17:23:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019627499999999999 2020-11-12T17:23:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059511+0000", 2020-11-12T17:23:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014392770000000001 2020-11-12T17:23:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060951+0000", 2020-11-12T17:23:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18718517000000001 2020-11-12T17:23:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248136+0000", 2020-11-12T17:23:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099000000000003e-05 2020-11-12T17:23:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248198+0000", 2020-11-12T17:23:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7726999999999998e-05 2020-11-12T17:23:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248256+0000", 2020-11-12T17:23:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899 2020-11-12T17:23:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19280 3.b 3:d8a2f1b1:::benchmark_data_smithi036_14212_object2409:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:39.059417+0000", 2020-11-12T17:23:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.548743442999999, 2020-11-12T17:23:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17050370200000001, 2020-11-12T17:23:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19280 2020-11-12T17:23:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059417+0000", 2020-11-12T17:23:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059417+0000", 2020-11-12T17:23:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059386+0000", 2020-11-12T17:23:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000167174 2020-11-12T17:23:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059553+0000", 2020-11-12T17:23:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2649e-05 2020-11-12T17:23:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059566+0000", 2020-11-12T17:23:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4980000000000003e-06 2020-11-12T17:23:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059572+0000", 2020-11-12T17:23:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011039870000000001 2020-11-12T17:23:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060676+0000", 2020-11-12T17:23:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010639100000000001 2020-11-12T17:23:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060783+0000", 2020-11-12T17:23:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018312299999999999 2020-11-12T17:23:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060966+0000", 2020-11-12T17:23:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041580059999999997 2020-11-12T17:23:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.065124+0000", 2020-11-12T17:23:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16470816499999999 2020-11-12T17:23:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.229832+0000", 2020-11-12T17:23:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9223e-05 2020-11-12T17:23:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.229871+0000", 2020-11-12T17:23:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9453000000000002e-05 2020-11-12T17:23:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.229921+0000", 2020-11-12T17:23:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17050370200000001 2020-11-12T17:23:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:23704 3.8 3:19577b19:::benchmark_data_smithi036_14212_object2962:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:43.699378+0000", 2020-11-12T17:23:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.9087822990000003, 2020-11-12T17:23:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16395786700000001, 2020-11-12T17:23:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 23704 2020-11-12T17:23:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699378+0000", 2020-11-12T17:23:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699378+0000", 2020-11-12T17:23:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999514 2020-11-12T17:23:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699329+0000", 2020-11-12T17:23:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012612699999999999 2020-11-12T17:23:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699455+0000", 2020-11-12T17:23:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7482999999999998e-05 2020-11-12T17:23:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699473+0000", 2020-11-12T17:23:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0265000000000001e-05 2020-11-12T17:23:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.699483+0000", 2020-11-12T17:23:49.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092479469999999994 2020-11-12T17:23:49.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.708731+0000", 2020-11-12T17:23:49.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010935 2020-11-12T17:23:49.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.708840+0000", 2020-11-12T17:23:49.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012120099999999999 2020-11-12T17:23:49.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:49.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.708962+0000", 2020-11-12T17:23:49.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019714810000000002 2020-11-12T17:23:49.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.710933+0000", 2020-11-12T17:23:49.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15228412199999999 2020-11-12T17:23:49.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863217+0000", 2020-11-12T17:23:49.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5543000000000002e-05 2020-11-12T17:23:49.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863253+0000", 2020-11-12T17:23:49.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3109000000000007e-05 2020-11-12T17:23:49.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:43.863336+0000", 2020-11-12T17:23:49.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16395786700000001 2020-11-12T17:23:49.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.844 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.844 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.844 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:24712 3.7 3:ef6ddd74:::benchmark_data_smithi036_14212_object3088:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:49.844 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:44.648094+0000", 2020-11-12T17:23:49.844 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.9600661290000003, 2020-11-12T17:23:49.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.207900908, 2020-11-12T17:23:49.845 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.845 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.845 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 24712 2020-11-12T17:23:49.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.846 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648094+0000", 2020-11-12T17:23:49.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648094+0000", 2020-11-12T17:23:49.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:49.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648062+0000", 2020-11-12T17:23:49.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3991000000000002e-05 2020-11-12T17:23:49.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648156+0000", 2020-11-12T17:23:49.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2483999999999999e-05 2020-11-12T17:23:49.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648169+0000", 2020-11-12T17:23:49.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0269999999999998e-06 2020-11-12T17:23:49.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648176+0000", 2020-11-12T17:23:49.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042901199999999997 2020-11-12T17:23:49.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.652466+0000", 2020-11-12T17:23:49.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9704000000000003e-05 2020-11-12T17:23:49.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.652526+0000", 2020-11-12T17:23:49.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116524 2020-11-12T17:23:49.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:49.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.652642+0000", 2020-11-12T17:23:49.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003019538 2020-11-12T17:23:49.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.655662+0000", 2020-11-12T17:23:49.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20023754399999999 2020-11-12T17:23:49.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.855899+0000", 2020-11-12T17:23:49.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2182999999999999e-05 2020-11-12T17:23:49.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.855941+0000", 2020-11-12T17:23:49.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3601999999999999e-05 2020-11-12T17:23:49.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.855995+0000", 2020-11-12T17:23:49.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.207900908 2020-11-12T17:23:49.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.854 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.855 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:24944 3.7 3:e947d4ca:::benchmark_data_smithi036_14212_object3117:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:49.855 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:44.871894+0000", 2020-11-12T17:23:49.855 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.7362667050000002, 2020-11-12T17:23:49.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21402005599999999, 2020-11-12T17:23:49.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.855 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.856 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.856 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.856 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.856 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 24944 2020-11-12T17:23:49.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.856 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871894+0000", 2020-11-12T17:23:49.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871894+0000", 2020-11-12T17:23:49.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999495 2020-11-12T17:23:49.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871843+0000", 2020-11-12T17:23:49.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014137899999999999 2020-11-12T17:23:49.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871985+0000", 2020-11-12T17:23:49.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9230000000000001e-05 2020-11-12T17:23:49.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.872004+0000", 2020-11-12T17:23:49.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0258000000000001e-05 2020-11-12T17:23:49.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.872014+0000", 2020-11-12T17:23:49.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020382600000000001 2020-11-12T17:23:49.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.874052+0000", 2020-11-12T17:23:49.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3418999999999995e-05 2020-11-12T17:23:49.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.874136+0000", 2020-11-12T17:23:49.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100831 2020-11-12T17:23:49.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:49.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.874237+0000", 2020-11-12T17:23:49.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019406270000000001 2020-11-12T17:23:49.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.876177+0000", 2020-11-12T17:23:49.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20960147300000001 2020-11-12T17:23:49.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.085779+0000", 2020-11-12T17:23:49.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3523000000000007e-05 2020-11-12T17:23:49.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.085862+0000", 2020-11-12T17:23:49.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1502999999999998e-05 2020-11-12T17:23:49.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.085914+0000", 2020-11-12T17:23:49.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21402005599999999 2020-11-12T17:23:49.865 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.865 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.865 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.865 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25280 3.b 3:d39b0d08:::benchmark_data_smithi036_14212_object3159:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:23:49.866 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:23:49.866 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.4066805980000003, 2020-11-12T17:23:49.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224130581, 2020-11-12T17:23:49.866 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.866 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.866 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.866 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.867 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.867 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25280 2020-11-12T17:23:49.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.867 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:23:49.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:23:49.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999604 2020-11-12T17:23:49.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201440+0000", 2020-11-12T17:23:49.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011655 2020-11-12T17:23:49.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201557+0000", 2020-11-12T17:23:49.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7612999999999999e-05 2020-11-12T17:23:49.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201574+0000", 2020-11-12T17:23:49.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9449999999999993e-06 2020-11-12T17:23:49.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201582+0000", 2020-11-12T17:23:49.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000790633 2020-11-12T17:23:49.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202373+0000", 2020-11-12T17:23:49.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107295 2020-11-12T17:23:49.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202480+0000", 2020-11-12T17:23:49.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000168703 2020-11-12T17:23:49.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:49.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202649+0000", 2020-11-12T17:23:49.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050285470000000004 2020-11-12T17:23:49.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.207677+0000", 2020-11-12T17:23:49.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21784867699999999 2020-11-12T17:23:49.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425526+0000", 2020-11-12T17:23:49.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8837e-05 2020-11-12T17:23:49.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425575+0000", 2020-11-12T17:23:49.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5524000000000001e-05 2020-11-12T17:23:49.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425610+0000", 2020-11-12T17:23:49.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224130581 2020-11-12T17:23:49.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.876 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.876 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:23:49.876 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:23:49.877 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.1514422580000003, 2020-11-12T17:23:49.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:23:49.877 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:49.877 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:49.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:49.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:49.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:49.877 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:23:49.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.878 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:49.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:49.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:23:49.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:49.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:49.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:23:49.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:49.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:49.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:23:49.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:23:49.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:49.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:23:49.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:23:49.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:49.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:23:49.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:23:49.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:49.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:23:49.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:23:49.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:49.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:23:49.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:23:49.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:49.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:23:49.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:23:49.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:49.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:23:49.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:23:49.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:49.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:23:49.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:23:49.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:49.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:23:49.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:23:49.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:49.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:23:49.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:23:49.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:49.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:49.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:49.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:23:49.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:23:49.886 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.887 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:49.887 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:49.887 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:49.889 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:49.889 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:49.882+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:49.989 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:49.986+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:50.016 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:50.016 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:50.017 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:23:50.017 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:50.027 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:50.118 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:50.114+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:50.190 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:50.191 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:50.191 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:50.191 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:50.191 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:50.194 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:50.190+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:50.199 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:50.296 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:50.290+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:50.369 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.606789116999998, 2020-11-12T17:23:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:23:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:23:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:23:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:23:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:23:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:23:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:23:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:23:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:23:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:23:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:23:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:23:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:23:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:23:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:23:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:23:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:23:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:23:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:23:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:23:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:23:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:23:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:23:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:23:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:23:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.599990265999999, 2020-11-12T17:23:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:23:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:23:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:23:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:23:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:23:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:23:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:23:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:23:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:23:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:23:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:23:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:23:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:23:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:23:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:23:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:23:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1104 3.9 3:9f55e211:::benchmark_data_smithi036_14212_object137:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.748195914999997, 2020-11-12T17:23:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001, 2020-11-12T17:23:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1104 2020-11-12T17:23:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617385+0000", 2020-11-12T17:23:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9141999999999994e-05 2020-11-12T17:23:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617484+0000", 2020-11-12T17:23:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2413e-05 2020-11-12T17:23:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617497+0000", 2020-11-12T17:23:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1659999999999999e-06 2020-11-12T17:23:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617503+0000", 2020-11-12T17:23:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032791000000000001 2020-11-12T17:23:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620782+0000", 2020-11-12T17:23:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102198 2020-11-12T17:23:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620884+0000", 2020-11-12T17:23:50.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114058 2020-11-12T17:23:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620998+0000", 2020-11-12T17:23:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018203270000000001 2020-11-12T17:23:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622818+0000", 2020-11-12T17:23:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.203924995 2020-11-12T17:23:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826743+0000", 2020-11-12T17:23:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012106 2020-11-12T17:23:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826865+0000", 2020-11-12T17:23:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014220699999999999 2020-11-12T17:23:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827007+0000", 2020-11-12T17:23:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001 2020-11-12T17:23:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1104 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.743267133000003, 2020-11-12T17:23:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999, 2020-11-12T17:23:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:23:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622338+0000", 2020-11-12T17:23:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5814e-05 2020-11-12T17:23:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622374+0000", 2020-11-12T17:23:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20244251299999999 2020-11-12T17:23:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824817+0000", 2020-11-12T17:23:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.117e-05 2020-11-12T17:23:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824828+0000", 2020-11-12T17:23:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001882332 2020-11-12T17:23:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826710+0000", 2020-11-12T17:23:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6818000000000001e-05 2020-11-12T17:23:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826727+0000", 2020-11-12T17:23:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031566199999999997 2020-11-12T17:23:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827043+0000", 2020-11-12T17:23:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999 2020-11-12T17:23:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.356731490000001, 2020-11-12T17:23:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:23:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:23:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:23:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:23:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:23:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:23:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:23:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:23:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:23:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:23:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:23:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:23:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:23:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:23:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:23:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:23:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:23:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:23:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:23:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:23:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:23:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:23:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:23:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:23:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.349516309000002, 2020-11-12T17:23:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:23:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:23:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:23:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:23:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:23:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:23:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:23:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:23:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:23:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:23:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:23:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:23:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:23:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:23:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:23:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:23:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:4896 3.3 3:c1830331:::benchmark_data_smithi036_14212_object611:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.549446386, 2020-11-12T17:23:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001, 2020-11-12T17:23:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 4896 2020-11-12T17:23:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:23:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816142+0000", 2020-11-12T17:23:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7733999999999998e-05 2020-11-12T17:23:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816220+0000", 2020-11-12T17:23:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2221999999999999e-05 2020-11-12T17:23:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816232+0000", 2020-11-12T17:23:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4469999999999997e-06 2020-11-12T17:23:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816237+0000", 2020-11-12T17:23:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012662909999999999 2020-11-12T17:23:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817504+0000", 2020-11-12T17:23:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167959 2020-11-12T17:23:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817672+0000", 2020-11-12T17:23:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025141300000000003 2020-11-12T17:23:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817923+0000", 2020-11-12T17:23:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001128467 2020-11-12T17:23:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.819051+0000", 2020-11-12T17:23:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19242863199999999 2020-11-12T17:23:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011480+0000", 2020-11-12T17:23:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9741999999999996e-05 2020-11-12T17:23:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011560+0000", 2020-11-12T17:23:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4276e-05 2020-11-12T17:23:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011614+0000", 2020-11-12T17:23:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001 2020-11-12T17:23:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4896 3.3 e25/20 ondisk, result = 0)", 2020-11-12T17:23:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.542060548000002, 2020-11-12T17:23:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.188067817, 2020-11-12T17:23:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823559+0000", 2020-11-12T17:23:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:23:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823525+0000", 2020-11-12T17:23:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-05 2020-11-12T17:23:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.823615+0000", 2020-11-12T17:23:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18777782700000001 2020-11-12T17:23:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011392+0000", 2020-11-12T17:23:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9179999999999997e-06 2020-11-12T17:23:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011399+0000", 2020-11-12T17:23:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5306000000000002e-05 2020-11-12T17:23:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011455+0000", 2020-11-12T17:23:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3124e-05 2020-11-12T17:23:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011468+0000", 2020-11-12T17:23:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015874800000000001 2020-11-12T17:23:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011627+0000", 2020-11-12T17:23:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.188067817 2020-11-12T17:23:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.679071417999999, 2020-11-12T17:23:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:23:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:23:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:23:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:23:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:23:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:23:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:23:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:23:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:23:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:23:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:23:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:23:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:23:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:23:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:23:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:23:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:23:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:23:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:23:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:23:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:23:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:23:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:23:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:23:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.678906515000001, 2020-11-12T17:23:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:23:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:23:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:50.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:23:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:23:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:23:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:23:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:23:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:23:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:23:50.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:23:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:23:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:23:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:23:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:23:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:23:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:23:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:23:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:23:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:23:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:23:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:23:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:23:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:23:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:23:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.674743280999998, 2020-11-12T17:23:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:23:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:23:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:23:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:23:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:23:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:23:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:23:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:23:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:23:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:23:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:23:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:23:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:23:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:23:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:23:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:23:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.673426446000001, 2020-11-12T17:23:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:23:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:23:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:23:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:23:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:23:50.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:23:50.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:23:50.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:23:50.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:23:50.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:23:50.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:23:50.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:23:50.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:23:50.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:23:50.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:23:50.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:23:50.573 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.574 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.574 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.575 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:23:50.575 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:50.575 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.811106813999999, 2020-11-12T17:23:50.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:23:50.576 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.576 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.577 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:50.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:50.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:50.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:23:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:23:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:23:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:23:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:23:50.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:23:50.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:23:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:23:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:23:50.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:23:50.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:23:50.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:23:50.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:23:50.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:23:50.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:23:50.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:23:50.591 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.592 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.592 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:23:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.483304845999999, 2020-11-12T17:23:50.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:23:50.594 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.594 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:23:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:50.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:50.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:23:50.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:23:50.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:23:50.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:23:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:23:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:23:50.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:23:50.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:23:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:23:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:23:50.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:23:50.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:23:50.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:23:50.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:50.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:23:50.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:23:50.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:23:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:23:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:23:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:23:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:23:50.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:23:50.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:23:50.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:23:50.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.616 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.617 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:23:50.617 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:50.617 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.476061136999999, 2020-11-12T17:23:50.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:23:50.618 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.618 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:50.618 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:50.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:50.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:23:50.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:23:50.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:23:50.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:23:50.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:23:50.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:23:50.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:23:50.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:23:50.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:23:50.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:23:50.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:23:50.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:23:50.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:23:50.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:23:50.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:23:50.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.625 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.626 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18077 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:50.626 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.885881+0000", 2020-11-12T17:23:50.626 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.479738393, 2020-11-12T17:23:50.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.185238772, 2020-11-12T17:23:50.626 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.626 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.627 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.627 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.627 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.627 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18077 2020-11-12T17:23:50.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.627 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885881+0000", 2020-11-12T17:23:50.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885881+0000", 2020-11-12T17:23:50.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:50.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885857+0000", 2020-11-12T17:23:50.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6453999999999997e-05 2020-11-12T17:23:50.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885933+0000", 2020-11-12T17:23:50.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1838000000000001e-05 2020-11-12T17:23:50.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885945+0000", 2020-11-12T17:23:50.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1880000000000008e-06 2020-11-12T17:23:50.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885954+0000", 2020-11-12T17:23:50.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8446000000000003e-05 2020-11-12T17:23:50.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886003+0000", 2020-11-12T17:23:50.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011008199999999999 2020-11-12T17:23:50.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886113+0000", 2020-11-12T17:23:50.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018435399999999999 2020-11-12T17:23:50.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:50.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886297+0000", 2020-11-12T17:23:50.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040884600000000004 2020-11-12T17:23:50.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890385+0000", 2020-11-12T17:23:50.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.180543073 2020-11-12T17:23:50.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.070928+0000", 2020-11-12T17:23:50.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9800000000000001e-05 2020-11-12T17:23:50.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.071018+0000", 2020-11-12T17:23:50.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101326 2020-11-12T17:23:50.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.071120+0000", 2020-11-12T17:23:50.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.185238772 2020-11-12T17:23:50.637 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.637 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.637 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.638 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18078 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:50.638 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:50.638 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.479621492, 2020-11-12T17:23:50.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001, 2020-11-12T17:23:50.638 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.639 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.639 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.639 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.639 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.639 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18078 2020-11-12T17:23:50.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.639 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:50.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:50.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:50.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885975+0000", 2020-11-12T17:23:50.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1489000000000006e-05 2020-11-12T17:23:50.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886047+0000", 2020-11-12T17:23:50.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7270000000000002e-06 2020-11-12T17:23:50.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886057+0000", 2020-11-12T17:23:50.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4660000000000001e-06 2020-11-12T17:23:50.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886061+0000", 2020-11-12T17:23:50.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001076579 2020-11-12T17:23:50.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887138+0000", 2020-11-12T17:23:50.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131815 2020-11-12T17:23:50.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887270+0000", 2020-11-12T17:23:50.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018425599999999999 2020-11-12T17:23:50.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:50.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887454+0000", 2020-11-12T17:23:50.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048314439999999998 2020-11-12T17:23:50.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892285+0000", 2020-11-12T17:23:50.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18195460599999999 2020-11-12T17:23:50.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074240+0000", 2020-11-12T17:23:50.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167078 2020-11-12T17:23:50.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074407+0000", 2020-11-12T17:23:50.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112014 2020-11-12T17:23:50.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074519+0000", 2020-11-12T17:23:50.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001 2020-11-12T17:23:50.649 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.649 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.649 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.649 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18079 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:50.650 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:50.650 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.479511946000001, 2020-11-12T17:23:50.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999, 2020-11-12T17:23:50.650 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.651 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.651 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.651 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.651 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.652 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18079 2020-11-12T17:23:50.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.652 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:50.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:50.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:50.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886083+0000", 2020-11-12T17:23:50.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1087999999999993e-05 2020-11-12T17:23:50.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886164+0000", 2020-11-12T17:23:50.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8720000000000008e-06 2020-11-12T17:23:50.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886173+0000", 2020-11-12T17:23:50.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2519999999999996e-06 2020-11-12T17:23:50.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886179+0000", 2020-11-12T17:23:50.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027277500000000001 2020-11-12T17:23:50.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.888907+0000", 2020-11-12T17:23:50.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019889199999999999 2020-11-12T17:23:50.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889106+0000", 2020-11-12T17:23:50.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028895700000000001 2020-11-12T17:23:50.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:50.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889395+0000", 2020-11-12T17:23:50.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003372571 2020-11-12T17:23:50.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892767+0000", 2020-11-12T17:23:50.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.181837265 2020-11-12T17:23:50.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074604+0000", 2020-11-12T17:23:50.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.135e-05 2020-11-12T17:23:50.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074666+0000", 2020-11-12T17:23:50.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7472999999999996e-05 2020-11-12T17:23:50.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074733+0000", 2020-11-12T17:23:50.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999 2020-11-12T17:23:50.667 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.667 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.667 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.668 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18080 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:50.669 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:50.669 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.479010458999999, 2020-11-12T17:23:50.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999, 2020-11-12T17:23:50.669 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.670 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.670 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.670 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.671 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.671 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18080 2020-11-12T17:23:50.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.671 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:50.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:50.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:50.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886586+0000", 2020-11-12T17:23:50.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3144000000000002e-05 2020-11-12T17:23:50.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886669+0000", 2020-11-12T17:23:50.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6894000000000001e-05 2020-11-12T17:23:50.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886686+0000", 2020-11-12T17:23:50.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5079999999999999e-06 2020-11-12T17:23:50.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886693+0000", 2020-11-12T17:23:50.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037501600000000002 2020-11-12T17:23:50.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890444+0000", 2020-11-12T17:23:50.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183449 2020-11-12T17:23:50.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890627+0000", 2020-11-12T17:23:50.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000305762 2020-11-12T17:23:50.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:50.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890933+0000", 2020-11-12T17:23:50.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022402920000000001 2020-11-12T17:23:50.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.893173+0000", 2020-11-12T17:23:50.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18168999399999999 2020-11-12T17:23:50.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074863+0000", 2020-11-12T17:23:50.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012771700000000001 2020-11-12T17:23:50.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074991+0000", 2020-11-12T17:23:50.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0248999999999999e-05 2020-11-12T17:23:50.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.075051+0000", 2020-11-12T17:23:50.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999 2020-11-12T17:23:50.682 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.682 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.682 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.683 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:23:50.683 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:23:50.683 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.313713434, 2020-11-12T17:23:50.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:23:50.683 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.683 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:50.683 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.684 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.684 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.684 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:23:50.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.684 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:23:50.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:23:50.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:50.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:23:50.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:23:50.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:23:50.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:23:50.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:23:50.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:23:50.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:23:50.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:23:50.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:23:50.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:23:50.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:23:50.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:23:50.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:50.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:23:50.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:23:50.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:23:50.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:23:50.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:23:50.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:23:50.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:50.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:23:50.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:23:50.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:50.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:23:50.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:23:50.694 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.694 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.694 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.694 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.694 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.694 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:50.696 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 46 16 30479 30463 5.17321 6.84375 0.0233327 0.0241433 2020-11-12T17:23:50.696 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:50.697 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:50.690+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:50.796 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:50.792+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:50.861 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:50.862 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:50.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.863 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:30788 3.5 3:a0dbf43d:::benchmark_data_smithi036_14212_object3848:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:23:50.863 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.852019+0000", 2020-11-12T17:23:50.863 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0084814699999999996, 2020-11-12T17:23:50.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0085244099999999996, 2020-11-12T17:23:50.863 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.864 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:50.864 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.864 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.864 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.864 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 30788 2020-11-12T17:23:50.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.865 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852019+0000", 2020-11-12T17:23:50.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852019+0000", 2020-11-12T17:23:50.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:50.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.851993+0000", 2020-11-12T17:23:50.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6854000000000007e-05 2020-11-12T17:23:50.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852070+0000", 2020-11-12T17:23:50.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1878e-05 2020-11-12T17:23:50.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852081+0000", 2020-11-12T17:23:50.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6820000000000002e-06 2020-11-12T17:23:50.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852086+0000", 2020-11-12T17:23:50.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016436319999999999 2020-11-12T17:23:50.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.853730+0000", 2020-11-12T17:23:50.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8916e-05 2020-11-12T17:23:50.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.853829+0000", 2020-11-12T17:23:50.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015911000000000001 2020-11-12T17:23:50.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:50.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.853988+0000", 2020-11-12T17:23:50.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053796979999999996 2020-11-12T17:23:50.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:50.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.859368+0000", 2020-11-12T17:23:50.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001120406 2020-11-12T17:23:50.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:50.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.860488+0000", 2020-11-12T17:23:50.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084693379999999999 2020-11-12T17:23:50.874 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.874 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.874 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.875 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:30789 3.5 3:a0dbf43d:::benchmark_data_smithi036_14212_object3848:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:23:50.875 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.852155+0000", 2020-11-12T17:23:50.875 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0083450079999999992, 2020-11-12T17:23:50.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0085795539999999997, 2020-11-12T17:23:50.875 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.875 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:50.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.876 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 30789 2020-11-12T17:23:50.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.876 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852155+0000", 2020-11-12T17:23:50.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852155+0000", 2020-11-12T17:23:50.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:23:50.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852127+0000", 2020-11-12T17:23:50.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4883999999999997e-05 2020-11-12T17:23:50.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852202+0000", 2020-11-12T17:23:50.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5060000000000001e-06 2020-11-12T17:23:50.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852212+0000", 2020-11-12T17:23:50.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7460000000000003e-06 2020-11-12T17:23:50.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.852219+0000", 2020-11-12T17:23:50.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028045930000000002 2020-11-12T17:23:50.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.855023+0000", 2020-11-12T17:23:50.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000192043 2020-11-12T17:23:50.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.855215+0000", 2020-11-12T17:23:50.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032438999999999998 2020-11-12T17:23:50.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:50.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.855540+0000", 2020-11-12T17:23:50.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00338449 2020-11-12T17:23:50.882 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.882 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.882 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.883 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:30790 3.5 3:a0dbf43d:::benchmark_data_smithi036_14212_object3848:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:23:50.883 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.854242+0000", 2020-11-12T17:23:50.883 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0062582860000000001, 2020-11-12T17:23:50.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066213449999999998, 2020-11-12T17:23:50.883 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.883 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:50.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.884 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 30790 2020-11-12T17:23:50.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.884 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.854242+0000", 2020-11-12T17:23:50.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.854242+0000", 2020-11-12T17:23:50.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:23:50.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.854215+0000", 2020-11-12T17:23:50.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8121000000000006e-05 2020-11-12T17:23:50.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.854293+0000", 2020-11-12T17:23:50.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3918e-05 2020-11-12T17:23:50.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.854307+0000", 2020-11-12T17:23:50.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1280000000000002e-06 2020-11-12T17:23:50.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.854314+0000", 2020-11-12T17:23:50.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026702620000000001 2020-11-12T17:23:50.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856984+0000", 2020-11-12T17:23:50.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019912 2020-11-12T17:23:50.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.857183+0000", 2020-11-12T17:23:50.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00034478599999999997 2020-11-12T17:23:50.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:50.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.857528+0000", 2020-11-12T17:23:50.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032864330000000001 2020-11-12T17:23:50.890 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.890 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.890 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.891 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:30791 3.5 3.bc2fdb05 (undecoded) ondisk+write+known_if_redirected e48)", 2020-11-12T17:23:50.891 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.856430+0000", 2020-11-12T17:23:50.891 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00407012, 2020-11-12T17:23:50.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045499319999999996, 2020-11-12T17:23:50.891 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.891 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:23:50.892 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.892 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.892 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.892 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 30791 2020-11-12T17:23:50.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.892 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856430+0000", 2020-11-12T17:23:50.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856430+0000", 2020-11-12T17:23:50.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:23:50.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856405+0000", 2020-11-12T17:23:50.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010527999999999999 2020-11-12T17:23:50.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856510+0000", 2020-11-12T17:23:50.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8508999999999998e-05 2020-11-12T17:23:50.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856529+0000", 2020-11-12T17:23:50.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1200000000000002e-06 2020-11-12T17:23:50.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856537+0000", 2020-11-12T17:23:50.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106681 2020-11-12T17:23:50.896 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.896 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.897 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.897 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:30792 3.5 3.bc2fdb05 (undecoded) ondisk+write+known_if_redirected e48)", 2020-11-12T17:23:50.897 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.856614+0000", 2020-11-12T17:23:50.897 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.003885856, 2020-11-12T17:23:50.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004455723, 2020-11-12T17:23:50.898 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.898 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:23:50.898 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:50.898 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:50.898 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:50.898 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 30792 2020-11-12T17:23:50.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.898 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856614+0000", 2020-11-12T17:23:50.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856614+0000", 2020-11-12T17:23:50.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999533 2020-11-12T17:23:50.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856567+0000", 2020-11-12T17:23:50.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013341899999999999 2020-11-12T17:23:50.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856701+0000", 2020-11-12T17:23:50.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6586e-05 2020-11-12T17:23:50.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856717+0000", 2020-11-12T17:23:50.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5569999999999996e-06 2020-11-12T17:23:50.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.856726+0000", 2020-11-12T17:23:50.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111597 2020-11-12T17:23:50.903 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.903 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.903 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.903 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:30788 3.5 e48/20 ondisk, result = 0)", 2020-11-12T17:23:50.903 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.858674+0000", 2020-11-12T17:23:50.904 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0018258879999999999, 2020-11-12T17:23:50.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024801129999999999, 2020-11-12T17:23:50.904 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.904 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:50.904 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.858674+0000", 2020-11-12T17:23:50.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.858674+0000", 2020-11-12T17:23:50.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999542 2020-11-12T17:23:50.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.858628+0000", 2020-11-12T17:23:50.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000116358 2020-11-12T17:23:50.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.858745+0000", 2020-11-12T17:23:50.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6264e-05 2020-11-12T17:23:50.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.858821+0000", 2020-11-12T17:23:50.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0016e-05 2020-11-12T17:23:50.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.858831+0000", 2020-11-12T17:23:50.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016181640000000001 2020-11-12T17:23:50.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:50.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.860449+0000", 2020-11-12T17:23:50.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1880000000000001e-05 2020-11-12T17:23:50.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:50.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.860471+0000", 2020-11-12T17:23:50.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017969139999999999 2020-11-12T17:23:50.909 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.909 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.910 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.910 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:30789 3.5 e48/20)", 2020-11-12T17:23:50.910 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.858993+0000", 2020-11-12T17:23:50.910 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.001507162, 2020-11-12T17:23:50.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022517909999999999, 2020-11-12T17:23:50.911 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:50.911 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:23:50.911 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:50.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:50.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.858993+0000", 2020-11-12T17:23:50.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:50.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:50.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.858993+0000", 2020-11-12T17:23:50.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:50.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:50.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.858950+0000", 2020-11-12T17:23:50.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108214 2020-11-12T17:23:50.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:50.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.859058+0000", 2020-11-12T17:23:50.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8334e-05 2020-11-12T17:23:50.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:50.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.859127+0000", 2020-11-12T17:23:50.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1040000000000007e-06 2020-11-12T17:23:50.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:50.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:50.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:50.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.859135+0000", 2020-11-12T17:23:50.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014191 2020-11-12T17:23:50.915 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.915 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:50.915 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.915 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:50.915 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:23:50.915 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 7 2020-11-12T17:23:50.915 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:50.917 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:50.918 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:50.912+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:51.018 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:51.014+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:51.043 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:51.044 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:51.045 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:51.045 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:51.045 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:51.057 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:51.120 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:51.112+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:51.167 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:51.221 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:51.216+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:51.233 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:51.233 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:51.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:51.234 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:51.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.235 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:928 3.2 e22/20 3:4c5417bc:::benchmark_data_smithi036_14212_object115:head v 22'80, mlcod=22'75)", 2020-11-12T17:23:51.235 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:51.235 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.797623025999997, 2020-11-12T17:23:51.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875, 2020-11-12T17:23:51.236 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.237 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.237 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:51.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:51.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:23:51.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432388+0000", 2020-11-12T17:23:51.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2012000000000003e-05 2020-11-12T17:23:51.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432440+0000", 2020-11-12T17:23:51.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.11616101500000001 2020-11-12T17:23:51.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548601+0000", 2020-11-12T17:23:51.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3270000000000001e-06 2020-11-12T17:23:51.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548609+0000", 2020-11-12T17:23:51.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6627999999999997e-05 2020-11-12T17:23:51.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548706+0000", 2020-11-12T17:23:51.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9027999999999999e-05 2020-11-12T17:23:51.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548755+0000", 2020-11-12T17:23:51.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038296739999999999 2020-11-12T17:23:51.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552584+0000", 2020-11-12T17:23:51.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010042 2020-11-12T17:23:51.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552685+0000", 2020-11-12T17:23:51.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875 2020-11-12T17:23:51.252 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.252 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.253 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1119 3.c 3:364fce39:::benchmark_data_smithi036_14212_object139:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:51.254 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:51.254 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.600544292000002, 2020-11-12T17:23:51.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111702974, 2020-11-12T17:23:51.254 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.255 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:51.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:51.256 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:51.256 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1119 2020-11-12T17:23:51.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.256 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:51.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629481+0000", 2020-11-12T17:23:51.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:51.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629447+0000", 2020-11-12T17:23:51.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7503999999999993e-05 2020-11-12T17:23:51.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629545+0000", 2020-11-12T17:23:51.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2435999999999999e-05 2020-11-12T17:23:51.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629557+0000", 2020-11-12T17:23:51.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5889999999999999e-06 2020-11-12T17:23:51.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.629564+0000", 2020-11-12T17:23:51.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003337773 2020-11-12T17:23:51.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.632902+0000", 2020-11-12T17:23:51.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010063199999999999 2020-11-12T17:23:51.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633002+0000", 2020-11-12T17:23:51.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000132698 2020-11-12T17:23:51.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:51.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.633135+0000", 2020-11-12T17:23:51.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019819870000000002 2020-11-12T17:23:51.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:51.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.635117+0000", 2020-11-12T17:23:51.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.105938543 2020-11-12T17:23:51.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:51.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741056+0000", 2020-11-12T17:23:51.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8002000000000003e-05 2020-11-12T17:23:51.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741134+0000", 2020-11-12T17:23:51.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0025999999999998e-05 2020-11-12T17:23:51.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.741184+0000", 2020-11-12T17:23:51.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111702974 2020-11-12T17:23:51.271 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.271 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.271 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.272 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:23:51.272 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:51.272 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.725796324000001, 2020-11-12T17:23:51.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:23:51.273 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.273 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.273 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:51.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:51.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:51.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:23:51.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:23:51.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:23:51.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:23:51.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:23:51.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:23:51.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:23:51.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:23:51.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:23:51.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:23:51.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:23:51.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:23:51.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:23:51.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:23:51.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:23:51.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:23:51.280 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.280 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.280 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.281 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:6040 3.d e25/20 3:b8c2806e:::benchmark_data_smithi036_14212_object754:head v 25'360, mlcod=25'354)", 2020-11-12T17:23:51.281 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:51.281 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.320490687000003, 2020-11-12T17:23:51.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431, 2020-11-12T17:23:51.281 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.282 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.282 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:51.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:51.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:51.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909516+0000", 2020-11-12T17:23:51.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6403999999999996e-05 2020-11-12T17:23:51.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909582+0000", 2020-11-12T17:23:51.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.113169626 2020-11-12T17:23:51.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022752+0000", 2020-11-12T17:23:51.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1850000000000004e-06 2020-11-12T17:23:51.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022760+0000", 2020-11-12T17:23:51.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7312999999999998e-05 2020-11-12T17:23:51.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022817+0000", 2020-11-12T17:23:51.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1387999999999999e-05 2020-11-12T17:23:51.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022838+0000", 2020-11-12T17:23:51.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001833487 2020-11-12T17:23:51.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024672+0000", 2020-11-12T17:23:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8751000000000005e-05 2020-11-12T17:23:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024761+0000", 2020-11-12T17:23:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431 2020-11-12T17:23:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.289 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.289 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:51.289 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:51.289 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.703786759000003, 2020-11-12T17:23:51.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:23:51.289 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.290 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.290 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:51.290 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:51.290 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:51.290 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:23:51.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.290 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:23:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:23:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:23:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:23:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:23:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:23:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:23:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:23:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:23:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:23:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:23:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:23:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:23:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:23:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:23:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:23:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:23:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:23:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:23:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:23:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:23:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:23:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:23:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.700386825000002, 2020-11-12T17:23:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:23:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:23:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:23:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:23:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:23:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:23:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:23:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:23:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:23:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:23:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:23:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:23:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:23:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:23:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:23:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:17992 3.d e41/20 3:bfb5f180:::benchmark_data_smithi036_14212_object2248:head v 41'952, mlcod=40'947)", 2020-11-12T17:23:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.423935366, 2020-11-12T17:23:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12242665599999999, 2020-11-12T17:23:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806068+0000", 2020-11-12T17:23:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9553000000000002e-05 2020-11-12T17:23:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806147+0000", 2020-11-12T17:23:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120094329 2020-11-12T17:23:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926242+0000", 2020-11-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5110000000000003e-06 2020-11-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926247+0000", 2020-11-12T17:23:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8669000000000002e-05 2020-11-12T17:23:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926326+0000", 2020-11-12T17:23:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0543e-05 2020-11-12T17:23:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926386+0000", 2020-11-12T17:23:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020619430000000001 2020-11-12T17:23:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.928448+0000", 2020-11-12T17:23:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7936999999999997e-05 2020-11-12T17:23:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.928516+0000", 2020-11-12T17:23:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12242665599999999 2020-11-12T17:23:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:18120 3.d e41/20 3:b4a6068b:::benchmark_data_smithi036_14212_object2264:head v 41'960, mlcod=41'953)", 2020-11-12T17:23:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.292379048000001, 2020-11-12T17:23:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13161703499999999, 2020-11-12T17:23:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:23:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937606+0000", 2020-11-12T17:23:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015189199999999999 2020-11-12T17:23:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937758+0000", 2020-11-12T17:23:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.129116967 2020-11-12T17:23:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066875+0000", 2020-11-12T17:23:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1977999999999999e-05 2020-11-12T17:23:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066887+0000", 2020-11-12T17:23:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102873 2020-11-12T17:23:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066990+0000", 2020-11-12T17:23:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8860000000000002e-05 2020-11-12T17:23:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.067049+0000", 2020-11-12T17:23:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020681240000000002 2020-11-12T17:23:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.069117+0000", 2020-11-12T17:23:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014595299999999999 2020-11-12T17:23:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.069263+0000", 2020-11-12T17:23:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13161703499999999 2020-11-12T17:23:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:19272 3.2 e41/20 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head v 41'1256, mlcod=41'1251)", 2020-11-12T17:23:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.168448222, 2020-11-12T17:23:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118689434, 2020-11-12T17:23:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061534+0000", 2020-11-12T17:23:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147861 2020-11-12T17:23:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061682+0000", 2020-11-12T17:23:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.116405122 2020-11-12T17:23:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178087+0000", 2020-11-12T17:23:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1800000000000001e-05 2020-11-12T17:23:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178098+0000", 2020-11-12T17:23:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000129016 2020-11-12T17:23:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178227+0000", 2020-11-12T17:23:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8186000000000002e-05 2020-11-12T17:23:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178286+0000", 2020-11-12T17:23:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018917160000000001 2020-11-12T17:23:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.180177+0000", 2020-11-12T17:23:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8812000000000003e-05 2020-11-12T17:23:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.180266+0000", 2020-11-12T17:23:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118689434 2020-11-12T17:23:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:21384 3.2 e43/20 3:48db7915:::benchmark_data_smithi036_14212_object2672:head v 43'1376, mlcod=43'1371)", 2020-11-12T17:23:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:41.170261+0000", 2020-11-12T17:23:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.059764426999999, 2020-11-12T17:23:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109568493, 2020-11-12T17:23:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.170261+0000", 2020-11-12T17:23:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.170261+0000", 2020-11-12T17:23:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:23:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.170245+0000", 2020-11-12T17:23:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4144000000000002e-05 2020-11-12T17:23:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.170299+0000", 2020-11-12T17:23:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.10475084 2020-11-12T17:23:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.275050+0000", 2020-11-12T17:23:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4399999999999994e-06 2020-11-12T17:23:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.275060+0000", 2020-11-12T17:23:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010338799999999999 2020-11-12T17:23:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.275163+0000", 2020-11-12T17:23:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4117e-05 2020-11-12T17:23:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.275187+0000", 2020-11-12T17:23:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045820419999999997 2020-11-12T17:23:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.279769+0000", 2020-11-12T17:23:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9840999999999998e-05 2020-11-12T17:23:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:41.279829+0000", 2020-11-12T17:23:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.109568493 2020-11-12T17:23:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:24744 3.4 e45/35 3:27e37414:::benchmark_data_smithi036_14212_object3092:head v 45'1584, mlcod=45'1580)", 2020-11-12T17:23:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:23:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.5494716830000002, 2020-11-12T17:23:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999, 2020-11-12T17:23:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:23:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:23:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:23:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680526+0000", 2020-11-12T17:23:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3724e-05 2020-11-12T17:23:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680609+0000", 2020-11-12T17:23:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.154293649 2020-11-12T17:23:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834903+0000", 2020-11-12T17:23:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1653e-05 2020-11-12T17:23:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834915+0000", 2020-11-12T17:23:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5685000000000006e-05 2020-11-12T17:23:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834980+0000", 2020-11-12T17:23:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4757e-05 2020-11-12T17:23:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.835005+0000", 2020-11-12T17:23:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001426067 2020-11-12T17:23:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836431+0000", 2020-11-12T17:23:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5732999999999997e-05 2020-11-12T17:23:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836477+0000", 2020-11-12T17:23:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999 2020-11-12T17:23:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:28560 3.4 e47/35 3:202f80a5:::benchmark_data_smithi036_14212_object3569:head v 47'1808, mlcod=47'1801)", 2020-11-12T17:23:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:23:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.56767031, 2020-11-12T17:23:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697, 2020-11-12T17:23:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:23:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:23:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:23:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662339+0000", 2020-11-12T17:23:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9332000000000001e-05 2020-11-12T17:23:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662389+0000", 2020-11-12T17:23:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.240093907 2020-11-12T17:23:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902482+0000", 2020-11-12T17:23:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1109999999999996e-06 2020-11-12T17:23:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902489+0000", 2020-11-12T17:23:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0870000000000004e-05 2020-11-12T17:23:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902559+0000", 2020-11-12T17:23:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2245e-05 2020-11-12T17:23:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902592+0000", 2020-11-12T17:23:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029425010000000001 2020-11-12T17:23:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905534+0000", 2020-11-12T17:23:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8211e-05 2020-11-12T17:23:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905622+0000", 2020-11-12T17:23:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697 2020-11-12T17:23:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29088 3.4 e47/35 3:2728cac2:::benchmark_data_smithi036_14212_object3635:head v 47'1856, mlcod=47'1851)", 2020-11-12T17:23:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:23:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.1279414399999999, 2020-11-12T17:23:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15063083799999999, 2020-11-12T17:23:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:23:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:23:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:23:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102067+0000", 2020-11-12T17:23:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8427000000000002e-05 2020-11-12T17:23:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102126+0000", 2020-11-12T17:23:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.145643039 2020-11-12T17:23:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247769+0000", 2020-11-12T17:23:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5070000000000003e-06 2020-11-12T17:23:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247776+0000", 2020-11-12T17:23:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9156000000000002e-05 2020-11-12T17:23:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247825+0000", 2020-11-12T17:23:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9045999999999999e-05 2020-11-12T17:23:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247854+0000", 2020-11-12T17:23:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004802054 2020-11-12T17:23:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.252656+0000", 2020-11-12T17:23:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8059000000000001e-05 2020-11-12T17:23:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.252714+0000", 2020-11-12T17:23:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15063083799999999 2020-11-12T17:23:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29440 3.4 e48/35 3:252d7780:::benchmark_data_smithi036_14212_object3679:head v 48'1880, mlcod=48'1871)", 2020-11-12T17:23:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:23:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.832039019, 2020-11-12T17:23:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999, 2020-11-12T17:23:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:23:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:23:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:23:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397961+0000", 2020-11-12T17:23:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5236999999999997e-05 2020-11-12T17:23:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.398046+0000", 2020-11-12T17:23:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23963379700000001 2020-11-12T17:23:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637680+0000", 2020-11-12T17:23:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.824e-06 2020-11-12T17:23:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637687+0000", 2020-11-12T17:23:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4215999999999998e-05 2020-11-12T17:23:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637732+0000", 2020-11-12T17:23:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8510000000000001e-05 2020-11-12T17:23:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637750+0000", 2020-11-12T17:23:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012233260000000001 2020-11-12T17:23:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.638973+0000", 2020-11-12T17:23:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8594999999999998e-05 2020-11-12T17:23:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.639022+0000", 2020-11-12T17:23:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999 2020-11-12T17:23:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29584 3.c 3:32eb6ccf:::benchmark_data_smithi036_14212_object3697:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:23:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.546737+0000", 2020-11-12T17:23:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.6832881470000001, 2020-11-12T17:23:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.123590087, 2020-11-12T17:23:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29584 2020-11-12T17:23:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546737+0000", 2020-11-12T17:23:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546737+0000", 2020-11-12T17:23:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546707+0000", 2020-11-12T17:23:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1920000000000002e-05 2020-11-12T17:23:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546789+0000", 2020-11-12T17:23:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1283e-05 2020-11-12T17:23:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546800+0000", 2020-11-12T17:23:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9370000000000001e-06 2020-11-12T17:23:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546806+0000", 2020-11-12T17:23:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0069702080000000003 2020-11-12T17:23:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.553776+0000", 2020-11-12T17:23:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010622499999999999 2020-11-12T17:23:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.553883+0000", 2020-11-12T17:23:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000152752 2020-11-12T17:23:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.554035+0000", 2020-11-12T17:23:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045351250000000001 2020-11-12T17:23:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.558571+0000", 2020-11-12T17:23:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111600112 2020-11-12T17:23:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.670171+0000", 2020-11-12T17:23:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8102999999999994e-05 2020-11-12T17:23:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.670249+0000", 2020-11-12T17:23:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8172999999999998e-05 2020-11-12T17:23:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.670327+0000", 2020-11-12T17:23:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.123590087 2020-11-12T17:23:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29784 3.d e48/20 3:be9adc0e:::benchmark_data_smithi036_14212_object3722:head v 48'1664, mlcod=48'1656)", 2020-11-12T17:23:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:23:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.4533412450000001, 2020-11-12T17:23:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20712350500000001, 2020-11-12T17:23:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:23:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:23:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:23:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776662+0000", 2020-11-12T17:23:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6710000000000002e-05 2020-11-12T17:23:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776749+0000", 2020-11-12T17:23:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20445004899999999 2020-11-12T17:23:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981199+0000", 2020-11-12T17:23:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:23:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981207+0000", 2020-11-12T17:23:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8742999999999997e-05 2020-11-12T17:23:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981256+0000", 2020-11-12T17:23:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9745999999999999e-05 2020-11-12T17:23:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981285+0000", 2020-11-12T17:23:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024615840000000002 2020-11-12T17:23:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.983747+0000", 2020-11-12T17:23:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0350999999999999e-05 2020-11-12T17:23:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.983807+0000", 2020-11-12T17:23:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20712350500000001 2020-11-12T17:23:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29991 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1679, mlcod=48'1673)", 2020-11-12T17:23:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:23:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.225861131, 2020-11-12T17:23:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001, 2020-11-12T17:23:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:23:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:23:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:23:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004127+0000", 2020-11-12T17:23:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012464900000000001 2020-11-12T17:23:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004251+0000", 2020-11-12T17:23:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28639012600000002 2020-11-12T17:23:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290641+0000", 2020-11-12T17:23:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:23:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290646+0000", 2020-11-12T17:23:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2363000000000002e-05 2020-11-12T17:23:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290679+0000", 2020-11-12T17:23:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3289999999999999e-05 2020-11-12T17:23:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290702+0000", 2020-11-12T17:23:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014675440000000001 2020-11-12T17:23:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292170+0000", 2020-11-12T17:23:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6585000000000001e-05 2020-11-12T17:23:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292226+0000", 2020-11-12T17:23:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001 2020-11-12T17:23:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:23:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:23:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.2244973779999999, 2020-11-12T17:23:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:23:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:23:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:23:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:23:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:23:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:23:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:23:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:23:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:23:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:23:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:23:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:23:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:23:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:23:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:23:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:23:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:23:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:23:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:23:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:23:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30039 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1927, mlcod=48'1921)", 2020-11-12T17:23:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:23:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.1652187009999999, 2020-11-12T17:23:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001, 2020-11-12T17:23:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:23:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:23:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999409 2020-11-12T17:23:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064747+0000", 2020-11-12T17:23:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019364299999999999 2020-11-12T17:23:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064941+0000", 2020-11-12T17:23:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.212994778 2020-11-12T17:23:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277936+0000", 2020-11-12T17:23:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7939999999999997e-06 2020-11-12T17:23:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277945+0000", 2020-11-12T17:23:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032420940000000001 2020-11-12T17:23:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281187+0000", 2020-11-12T17:23:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3390000000000001e-05 2020-11-12T17:23:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281211+0000", 2020-11-12T17:23:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062069380000000004 2020-11-12T17:23:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287418+0000", 2020-11-12T17:23:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109126 2020-11-12T17:23:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287527+0000", 2020-11-12T17:23:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001 2020-11-12T17:23:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30040 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1928, mlcod=48'1921)", 2020-11-12T17:23:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:23:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.16359995, 2020-11-12T17:23:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277, 2020-11-12T17:23:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:23:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:23:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:23:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066369+0000", 2020-11-12T17:23:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185513 2020-11-12T17:23:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066555+0000", 2020-11-12T17:23:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22267770000000001 2020-11-12T17:23:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289233+0000", 2020-11-12T17:23:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5750000000000001e-06 2020-11-12T17:23:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289236+0000", 2020-11-12T17:23:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7205e-05 2020-11-12T17:23:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289283+0000", 2020-11-12T17:23:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0210000000000001e-05 2020-11-12T17:23:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289304+0000", 2020-11-12T17:23:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018794020000000001 2020-11-12T17:23:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291183+0000", 2020-11-12T17:23:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2386999999999998e-05 2020-11-12T17:23:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291235+0000", 2020-11-12T17:23:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277 2020-11-12T17:23:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.441 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:51.441 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:51.441 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:51.442 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:23:51.443 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:51.443 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:51.443 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:51.444 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:51.444 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:51.436+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:51.444 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:51.476 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:51.522 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:51.543 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:51.536+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:51.555 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:51.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 47 16 31611 31595 5.25128 8.84375 0.025457 0.0237937 2020-11-12T17:23:51.569 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:51.570 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:51.581 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:51.589 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:51.591 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:51.591 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:51.591 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:51.592 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:51.592 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:51.592 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:51.592 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:51.592 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:51.653 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:51.648+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:51.710 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:51.710 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:51.720 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:51.745 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:51.740+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:51.838 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:51.839 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:51.846 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:51.840+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:51.852 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:51.948 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:51.942+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:51.976 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:51.976 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:51.987 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:52.073 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:52.070+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:52.127 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:52.127 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:52.136 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:52.150 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:52.144+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:52.252 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:52.244+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:52.297 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:52.298 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:52.309 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:52.357 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:52.352+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:52.366 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:52.362+0000 7f7b4fea9700 -1 osd.4 48 handle_osd_map injecting map crc failure 2020-11-12T17:23:52.379 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:23:52.435 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:52.436 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:52.448 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:52.454 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:52.450+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:52.554 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:52.550+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:52.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 48 16 32534 32518 5.29209 7.21094 0.0945057 0.0236106 2020-11-12T17:23:52.613 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:52.614 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:52.625 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:52.669 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:52.664+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:52.757 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:52.752+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:52.807 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:52.807 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:52.808 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:52.893 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:52.888+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:52.959 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:52.952+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:52.985 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:52.986 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:52.999 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:53.093 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:53.088+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:53.161 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:53.156+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:53.166 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:53.167 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:53.178 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:53.268 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:53.264+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:53.347 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:53.348 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:53.361 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:53.405 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:53.400+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:53.466 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:53.460+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:53.542 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:53.543 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:53.552 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:53.566 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:53.562+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:53.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 49 16 33555 33539 5.34686 7.97656 0.00833007 0.0233393 2020-11-12T17:23:53.605 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:53.667 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:53.660+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:53.692 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:53.700 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:53.702 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:53.768 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:53.762+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:53.769 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:53.811 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:53.837 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:53.866 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:53.869 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:53.866+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:53.872 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:53.872 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:53.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:23:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.208608857000002, 2020-11-12T17:23:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:23:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:23:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:23:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:53.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:23:53.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:23:53.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:23:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:23:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:23:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:23:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:23:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:23:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:23:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:23:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:23:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:23:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:23:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:23:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:23:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.207702062000003, 2020-11-12T17:23:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:23:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:23:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:23:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:23:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:23:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:23:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:23:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:23:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:23:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:23:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:23:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:23:53.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:23:53.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:53.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:23:53.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:23:53.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:53.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:23:53.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:23:53.898 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.898 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:53.898 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.898 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:23:53.899 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:53.899 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.206999838999998, 2020-11-12T17:23:53.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:23:53.899 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:53.899 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:53.899 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:53.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:53.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:53.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:53.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:53.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:53.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:53.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:53.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:23:53.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:23:53.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:53.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:23:53.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:23:53.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:53.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:23:53.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:23:53.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:53.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:23:53.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:23:53.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:53.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:23:53.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:23:53.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:53.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:23:53.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:23:53.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:53.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:23:53.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:23:53.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:53.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:23:53.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:23:53.911 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.911 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:53.912 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.912 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:23:53.913 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:53.913 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.202493642999997, 2020-11-12T17:23:53.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:23:53.914 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:53.914 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:53.914 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:53.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:53.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:53.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:53.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:53.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:53.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:53.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:53.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:23:53.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:23:53.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:53.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:23:53.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:23:53.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:53.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:23:53.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:23:53.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:53.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:23:53.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:23:53.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:53.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:23:53.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:23:53.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:53.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:23:53.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:23:53.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:53.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:23:53.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:23:53.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:53.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:23:53.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:23:53.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.927 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:53.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.928 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:23:53.928 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:53.928 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 47.698952662000003, 2020-11-12T17:23:53.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:23:53.928 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:53.928 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:53.928 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:53.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:53.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:53.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:53.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:53.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:53.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:23:53.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:53.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:23:53.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:23:53.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:53.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:23:53.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:23:53.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:53.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:23:53.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:23:53.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:53.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:23:53.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:23:53.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:53.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:23:53.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:23:53.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:53.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:23:53.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:23:53.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:53.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:23:53.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:23:53.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:53.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:23:53.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:23:53.935 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.935 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:53.935 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.936 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:23:53.936 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:53.936 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 47.698026421000002, 2020-11-12T17:23:53.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:23:53.936 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:53.936 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:53.936 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:53.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:53.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:53.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:53.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:53.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:53.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:23:53.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:53.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:23:53.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:23:53.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:53.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:23:53.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:23:53.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:53.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:23:53.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:23:53.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:53.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:23:53.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:23:53.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:53.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:23:53.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:23:53.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:53.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:23:53.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:23:53.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:53.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:23:53.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:23:53.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:53.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:23:53.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:23:53.943 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.943 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:53.943 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.943 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:23:53.944 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:53.944 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 47.695678911000002, 2020-11-12T17:23:53.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:23:53.944 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:53.944 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:53.944 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:53.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:53.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:53.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:53.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:53.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:53.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:53.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:53.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:23:53.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:23:53.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:53.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:23:53.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:23:53.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:53.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:23:53.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:23:53.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:53.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:23:53.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:23:53.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:53.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:23:53.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:23:53.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:53.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:23:53.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:23:53.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:53.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:23:53.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:23:53.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:53.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:23:53.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:23:53.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:53.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.970 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:23:53.970 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:53.971 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 47.694914119000003, 2020-11-12T17:23:53.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:23:53.971 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:53.972 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:53.972 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:53.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:53.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:53.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:53.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:53.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:53.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:53.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:53.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:23:53.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:23:53.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:53.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:23:53.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:23:53.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:53.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:23:53.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:23:53.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:53.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:23:53.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:23:53.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:53.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:23:53.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:23:53.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:53.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:23:53.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:23:53.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:53.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:23:53.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:23:53.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:53.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:23:53.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:23:53.986 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.986 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:53.987 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:53.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.996 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:23:53.996 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:53.996 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 47.612687641000001, 2020-11-12T17:23:53.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:23:53.997 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:53.997 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:53.997 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:53.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:53.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:53.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:53.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:53.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:53.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:54.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:54.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:23:54.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:23:54.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:23:54.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:23:54.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:23:54.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:23:54.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:23:54.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:23:54.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:23:54.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:23:54.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:23:54.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:23:54.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:23:54.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:23:54.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:23:54.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:23:54.011 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.011 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.011 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.012 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:23:54.012 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:54.012 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.020574207999999, 2020-11-12T17:23:54.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:23:54.013 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.013 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.013 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:54.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:54.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:23:54.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:23:54.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:23:54.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:23:54.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:23:54.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:23:54.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:23:54.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:23:54.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:23:54.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:23:54.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:23:54.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:23:54.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:23:54.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:23:54.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:23:54.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:23:54.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:23:54.026 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.027 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.027 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.028 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:23:54.028 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:54.028 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.991913910999997, 2020-11-12T17:23:54.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:23:54.029 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.029 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.029 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:54.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:54.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:54.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:23:54.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:23:54.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:23:54.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:23:54.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:23:54.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:23:54.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:23:54.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:23:54.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:23:54.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:23:54.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:23:54.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:23:54.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:23:54.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:23:54.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:23:54.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:23:54.036 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.037 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.037 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.037 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:23:54.037 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:54.037 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.079317199999998, 2020-11-12T17:23:54.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:23:54.038 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.038 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.038 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:54.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:54.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:54.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:23:54.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:23:54.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:23:54.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:23:54.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:23:54.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:23:54.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:23:54.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:23:54.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:23:54.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:23:54.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:23:54.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:23:54.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:23:54.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:23:54.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:23:54.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:23:54.044 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.044 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.045 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.045 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:23:54.045 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:54.045 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.008177556, 2020-11-12T17:23:54.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:23:54.046 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.046 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.046 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:54.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:54.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:54.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:23:54.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:23:54.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:23:54.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:23:54.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:23:54.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:23:54.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:23:54.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:23:54.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:23:54.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:23:54.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:23:54.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:23:54.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:23:54.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:23:54.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:23:54.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:23:54.052 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.052 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.053 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.053 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:23:54.053 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:54.053 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.898790265000002, 2020-11-12T17:23:54.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:23:54.053 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.054 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.054 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:54.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:54.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:54.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:23:54.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:23:54.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:23:54.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:23:54.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:23:54.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:23:54.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:23:54.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:23:54.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:23:54.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:23:54.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:23:54.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:23:54.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:23:54.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:23:54.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:23:54.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:23:54.060 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.060 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.061 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.061 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:23:54.061 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:54.061 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.828254426000001, 2020-11-12T17:23:54.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:23:54.062 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.062 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.062 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:54.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:54.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:54.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:23:54.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:23:54.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:23:54.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:23:54.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:23:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:23:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:23:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:23:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:23:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:23:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:23:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:23:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:23:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:23:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:23:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:23:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:23:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.658888488000002, 2020-11-12T17:23:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:23:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:23:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:23:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:23:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:23:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:23:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:23:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:23:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:23:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:23:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:23:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:23:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:23:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:23:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:23:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:23:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:23:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:23:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.077 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:23:54.077 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:54.077 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.330262615999999, 2020-11-12T17:23:54.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:23:54.077 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.077 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.078 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:54.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:54.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:23:54.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:23:54.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:23:54.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:23:54.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:23:54.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:23:54.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:23:54.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:23:54.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:23:54.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:23:54.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:23:54.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:23:54.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:23:54.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:23:54.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:23:54.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:23:54.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:23:54.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.084 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.085 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:23:54.085 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:54.085 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 38.673799254000002, 2020-11-12T17:23:54.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:23:54.085 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.085 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.086 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:54.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:54.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:54.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:23:54.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:23:54.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:23:54.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:23:54.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:23:54.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:23:54.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:23:54.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:23:54.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:23:54.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:23:54.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:23:54.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:23:54.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:23:54.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:23:54.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:23:54.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:23:54.092 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.092 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.092 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.093 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:23:54.093 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:54.093 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 38.671158531000003, 2020-11-12T17:23:54.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:23:54.093 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.093 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.093 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:54.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:54.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:54.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:23:54.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:23:54.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:23:54.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:23:54.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:23:54.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:23:54.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:23:54.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:23:54.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:23:54.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:23:54.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:23:54.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:23:54.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:23:54.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:23:54.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:23:54.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:23:54.100 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.100 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.100 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.101 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:23:54.101 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:54.101 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 35.186912491999998, 2020-11-12T17:23:54.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:23:54.101 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.101 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.101 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:54.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:54.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:23:54.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:23:54.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:23:54.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:23:54.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:23:54.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:23:54.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:23:54.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:23:54.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:23:54.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:23:54.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:23:54.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:23:54.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:23:54.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:23:54.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:23:54.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:23:54.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:23:54.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.108 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.108 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.109 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:54.111 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:54.111 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:54.111 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:54.112 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:54.112 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:54.112 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:54.112 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:54.112 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:54.112 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:54.113 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:54.113 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:54.113 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:54.113 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:54.104+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:54.114 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:54.211 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:54.206+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:54.284 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:54.308 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:54.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.308 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:33992 3.7 3:ec7d9e2f:::benchmark_data_smithi036_14212_object4248:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:23:54.308 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.224745+0000", 2020-11-12T17:23:54.309 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.058016224999999998, 2020-11-12T17:23:54.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.058040042, 2020-11-12T17:23:54.309 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.309 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:54.309 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.309 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.309 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.310 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 33992 2020-11-12T17:23:54.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.310 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.224745+0000", 2020-11-12T17:23:54.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.224745+0000", 2020-11-12T17:23:54.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:23:54.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.224728+0000", 2020-11-12T17:23:54.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9446e-05 2020-11-12T17:23:54.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.224787+0000", 2020-11-12T17:23:54.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4582e-05 2020-11-12T17:23:54.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.224802+0000", 2020-11-12T17:23:54.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6319999999999996e-06 2020-11-12T17:23:54.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.224807+0000", 2020-11-12T17:23:54.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030025939999999999 2020-11-12T17:23:54.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.227810+0000", 2020-11-12T17:23:54.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111258 2020-11-12T17:23:54.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.227921+0000", 2020-11-12T17:23:54.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019939799999999999 2020-11-12T17:23:54.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:54.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.228121+0000", 2020-11-12T17:23:54.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028914589999999999 2020-11-12T17:23:54.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.231012+0000", 2020-11-12T17:23:54.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0062674510000000003 2020-11-12T17:23:54.317 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.317 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.317 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.317 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.317 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:54.318 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 1 2020-11-12T17:23:54.318 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:54.319 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:54.320 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:54.312+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:54.394 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:23:54.420 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:54.414+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:54.500 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:54.501 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:54.512 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:54.521 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:54.518+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:54.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 50 16 34333 34317 5.36148 6.07812 0.0130964 0.0233026 2020-11-12T17:23:54.622 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:54.616+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:54.644 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:54.644 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:54.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:54.645 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:54.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.645 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:336 3.8 3:1a561d42:::benchmark_data_smithi036_14212_object41:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:54.645 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:54.645 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.831776013000002, 2020-11-12T17:23:54.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001, 2020-11-12T17:23:54.645 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.646 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.646 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.647 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.648 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.648 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 336 2020-11-12T17:23:54.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.648 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:54.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808414+0000", 2020-11-12T17:23:54.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:23:54.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808370+0000", 2020-11-12T17:23:54.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8706e-05 2020-11-12T17:23:54.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808469+0000", 2020-11-12T17:23:54.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.329e-06 2020-11-12T17:23:54.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808478+0000", 2020-11-12T17:23:54.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.181e-06 2020-11-12T17:23:54.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.808483+0000", 2020-11-12T17:23:54.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022620499999999998 2020-11-12T17:23:54.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810746+0000", 2020-11-12T17:23:54.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6533000000000006e-05 2020-11-12T17:23:54.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.810842+0000", 2020-11-12T17:23:54.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018000000000000001 2020-11-12T17:23:54.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:54.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811022+0000", 2020-11-12T17:23:54.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00081152800000000005 2020-11-12T17:23:54.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.811834+0000", 2020-11-12T17:23:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16750948399999999 2020-11-12T17:23:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979343+0000", 2020-11-12T17:23:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4766999999999998e-05 2020-11-12T17:23:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979408+0000", 2020-11-12T17:23:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3001999999999999e-05 2020-11-12T17:23:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.979451+0000", 2020-11-12T17:23:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17103717700000001 2020-11-12T17:23:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:808 3.b 3:d27ca39f:::benchmark_data_smithi036_14212_object100:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.320330978999998, 2020-11-12T17:23:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742, 2020-11-12T17:23:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 808 2020-11-12T17:23:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319859+0000", 2020-11-12T17:23:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:23:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319816+0000", 2020-11-12T17:23:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012461199999999999 2020-11-12T17:23:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319941+0000", 2020-11-12T17:23:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4997000000000001e-05 2020-11-12T17:23:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319956+0000", 2020-11-12T17:23:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9940000000000003e-06 2020-11-12T17:23:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.319963+0000", 2020-11-12T17:23:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011778870000000001 2020-11-12T17:23:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321141+0000", 2020-11-12T17:23:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010428400000000001 2020-11-12T17:23:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321245+0000", 2020-11-12T17:23:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117811 2020-11-12T17:23:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.321363+0000", 2020-11-12T17:23:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001974511 2020-11-12T17:23:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323337+0000", 2020-11-12T17:23:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185308416 2020-11-12T17:23:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508646+0000", 2020-11-12T17:23:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3879000000000002e-05 2020-11-12T17:23:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508720+0000", 2020-11-12T17:23:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6706000000000002e-05 2020-11-12T17:23:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508776+0000", 2020-11-12T17:23:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.188917742 2020-11-12T17:23:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:808 3.b e22/20 ondisk, result = 0)", 2020-11-12T17:23:54.675 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:54.675 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.316518340999998, 2020-11-12T17:23:54.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999, 2020-11-12T17:23:54.675 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323671+0000", 2020-11-12T17:23:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323648+0000", 2020-11-12T17:23:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0744e-05 2020-11-12T17:23:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.323709+0000", 2020-11-12T17:23:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18463727299999999 2020-11-12T17:23:54.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508346+0000", 2020-11-12T17:23:54.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.798e-06 2020-11-12T17:23:54.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508356+0000", 2020-11-12T17:23:54.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027103199999999999 2020-11-12T17:23:54.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508627+0000", 2020-11-12T17:23:54.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999993e-06 2020-11-12T17:23:54.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508637+0000", 2020-11-12T17:23:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014688799999999999 2020-11-12T17:23:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.508784+0000", 2020-11-12T17:23:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18511249699999999 2020-11-12T17:23:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.687 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.687 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.687 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5672 3.7 3:e4132891:::benchmark_data_smithi036_14212_object708:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:54.688 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:54.688 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.196834746, 2020-11-12T17:23:54.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906, 2020-11-12T17:23:54.688 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.689 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5672 2020-11-12T17:23:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443325+0000", 2020-11-12T17:23:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3981999999999996e-05 2020-11-12T17:23:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443419+0000", 2020-11-12T17:23:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8057e-05 2020-11-12T17:23:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443437+0000", 2020-11-12T17:23:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3709999999999996e-06 2020-11-12T17:23:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443444+0000", 2020-11-12T17:23:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019104530000000001 2020-11-12T17:23:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445354+0000", 2020-11-12T17:23:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2356999999999999e-05 2020-11-12T17:23:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445426+0000", 2020-11-12T17:23:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111113 2020-11-12T17:23:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445538+0000", 2020-11-12T17:23:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00086618700000000003 2020-11-12T17:23:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.446404+0000", 2020-11-12T17:23:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.205445288 2020-11-12T17:23:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651849+0000", 2020-11-12T17:23:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2787000000000005e-05 2020-11-12T17:23:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651942+0000", 2020-11-12T17:23:54.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2173000000000003e-05 2020-11-12T17:23:54.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652004+0000", 2020-11-12T17:23:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906 2020-11-12T17:23:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5672 3.7 e25/20 ondisk, result = 0)", 2020-11-12T17:23:54.702 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:54.702 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.188051352000002, 2020-11-12T17:23:54.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162, 2020-11-12T17:23:54.702 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.702 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:54.702 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452124+0000", 2020-11-12T17:23:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6100000000000003e-05 2020-11-12T17:23:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452160+0000", 2020-11-12T17:23:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199026693 2020-11-12T17:23:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651186+0000", 2020-11-12T17:23:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0820000000000001e-06 2020-11-12T17:23:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651194+0000", 2020-11-12T17:23:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00062788999999999998 2020-11-12T17:23:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651821+0000", 2020-11-12T17:23:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4558e-05 2020-11-12T17:23:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651836+0000", 2020-11-12T17:23:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018151300000000001 2020-11-12T17:23:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652017+0000", 2020-11-12T17:23:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162 2020-11-12T17:23:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.221701388, 2020-11-12T17:23:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:23:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:23:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:23:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:23:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:23:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:23:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:23:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:23:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:23:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:23:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:23:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:23:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:23:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:23:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:23:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:23:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:23:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:23:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:23:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:23:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:23:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:23:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:23:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:23:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:23:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:23:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.214757325999997, 2020-11-12T17:23:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:23:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:23:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:23:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:23:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:23:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:23:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:23:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:23:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:23:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:23:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:23:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:23:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:23:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:23:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:23:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.659680170999998, 2020-11-12T17:23:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866, 2020-11-12T17:23:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980509+0000", 2020-11-12T17:23:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980460+0000", 2020-11-12T17:23:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012467899999999999 2020-11-12T17:23:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980585+0000", 2020-11-12T17:23:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6456e-05 2020-11-12T17:23:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980602+0000", 2020-11-12T17:23:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9169999999999995e-06 2020-11-12T17:23:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980611+0000", 2020-11-12T17:23:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015059000000000001 2020-11-12T17:23:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980761+0000", 2020-11-12T17:23:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9624999999999997e-05 2020-11-12T17:23:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980841+0000", 2020-11-12T17:23:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133702 2020-11-12T17:23:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.980974+0000", 2020-11-12T17:23:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001625076 2020-11-12T17:23:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.982600+0000", 2020-11-12T17:23:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18301002199999999 2020-11-12T17:23:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165610+0000", 2020-11-12T17:23:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4160999999999998e-05 2020-11-12T17:23:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165674+0000", 2020-11-12T17:23:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000127661 2020-11-12T17:23:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165801+0000", 2020-11-12T17:23:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.185291866 2020-11-12T17:23:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10048 3.b 3:de93336d:::benchmark_data_smithi036_14212_object1255:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e27)", 2020-11-12T17:23:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.647968417999998, 2020-11-12T17:23:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678, 2020-11-12T17:23:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:23:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10048 2020-11-12T17:23:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992221+0000", 2020-11-12T17:23:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:23:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992202+0000", 2020-11-12T17:23:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5812e-05 2020-11-12T17:23:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992258+0000", 2020-11-12T17:23:54.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3090000000000001e-06 2020-11-12T17:23:54.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992267+0000", 2020-11-12T17:23:54.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7680000000000008e-06 2020-11-12T17:23:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992275+0000", 2020-11-12T17:23:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0019000000000003e-05 2020-11-12T17:23:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992335+0000", 2020-11-12T17:23:54.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0896999999999995e-05 2020-11-12T17:23:54.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:23:54.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.992416+0000", 2020-11-12T17:23:54.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17331891299999999 2020-11-12T17:23:54.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.165735+0000", 2020-11-12T17:23:54.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.173513678 2020-11-12T17:23:54.751 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.752 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.752 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.752 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10064 3.7 3:e0dfa39d:::benchmark_data_smithi036_14212_object1257:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e27)", 2020-11-12T17:23:54.752 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:54.752 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.627121299000002, 2020-11-12T17:23:54.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999, 2020-11-12T17:23:54.753 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.753 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.753 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.753 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10064 2020-11-12T17:23:54.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.754 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:54.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013068+0000", 2020-11-12T17:23:54.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:54.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013037+0000", 2020-11-12T17:23:54.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7905000000000006e-05 2020-11-12T17:23:54.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013125+0000", 2020-11-12T17:23:54.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4722999999999999e-05 2020-11-12T17:23:54.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013140+0000", 2020-11-12T17:23:54.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6830000000000008e-06 2020-11-12T17:23:54.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013148+0000", 2020-11-12T17:23:54.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:23:54.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013223+0000", 2020-11-12T17:23:54.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020518000000000001 2020-11-12T17:23:54.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013428+0000", 2020-11-12T17:23:54.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023399799999999999 2020-11-12T17:23:54.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:54.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.013662+0000", 2020-11-12T17:23:54.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034048939999999999 2020-11-12T17:23:54.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.017067+0000", 2020-11-12T17:23:54.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18367845899999999 2020-11-12T17:23:54.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200745+0000", 2020-11-12T17:23:54.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013196599999999999 2020-11-12T17:23:54.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200877+0000", 2020-11-12T17:23:54.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011756099999999999 2020-11-12T17:23:54.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200995+0000", 2020-11-12T17:23:54.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18792640299999999 2020-11-12T17:23:54.767 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.767 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.767 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.768 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:10064 3.7 e27/20 ondisk, result = 0)", 2020-11-12T17:23:54.768 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:54.769 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.621507307999998, 2020-11-12T17:23:54.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999, 2020-11-12T17:23:54.769 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.769 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:54.769 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:54.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018682+0000", 2020-11-12T17:23:54.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:23:54.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018663+0000", 2020-11-12T17:23:54.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1436e-05 2020-11-12T17:23:54.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.018714+0000", 2020-11-12T17:23:54.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18186307199999999 2020-11-12T17:23:54.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200577+0000", 2020-11-12T17:23:54.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5204e-05 2020-11-12T17:23:54.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200592+0000", 2020-11-12T17:23:54.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110565 2020-11-12T17:23:54.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200703+0000", 2020-11-12T17:23:54.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2906000000000001e-05 2020-11-12T17:23:54.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.200726+0000", 2020-11-12T17:23:54.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028337099999999998 2020-11-12T17:23:54.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.201009+0000", 2020-11-12T17:23:54.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18232688399999999 2020-11-12T17:23:54.776 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.776 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.776 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.777 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19272 3.2 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:54.777 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:54.777 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.591590956999999, 2020-11-12T17:23:54.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899, 2020-11-12T17:23:54.777 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.777 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.777 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.778 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.778 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.778 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19272 2020-11-12T17:23:54.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.778 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:54.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:54.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:23:54.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048566+0000", 2020-11-12T17:23:54.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108874 2020-11-12T17:23:54.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048675+0000", 2020-11-12T17:23:54.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3494e-05 2020-11-12T17:23:54.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048688+0000", 2020-11-12T17:23:54.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8549999999999996e-06 2020-11-12T17:23:54.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048695+0000", 2020-11-12T17:23:54.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010513026 2020-11-12T17:23:54.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059208+0000", 2020-11-12T17:23:54.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107161 2020-11-12T17:23:54.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059315+0000", 2020-11-12T17:23:54.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019627499999999999 2020-11-12T17:23:54.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:54.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059511+0000", 2020-11-12T17:23:54.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014392770000000001 2020-11-12T17:23:54.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060951+0000", 2020-11-12T17:23:54.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18718517000000001 2020-11-12T17:23:54.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248136+0000", 2020-11-12T17:23:54.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099000000000003e-05 2020-11-12T17:23:54.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248198+0000", 2020-11-12T17:23:54.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7726999999999998e-05 2020-11-12T17:23:54.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248256+0000", 2020-11-12T17:23:54.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899 2020-11-12T17:23:54.795 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.795 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.795 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.796 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:24712 3.7 3:ef6ddd74:::benchmark_data_smithi036_14212_object3088:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:54.797 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:44.648094+0000", 2020-11-12T17:23:54.797 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.9920954809999998, 2020-11-12T17:23:54.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.207900908, 2020-11-12T17:23:54.797 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.798 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.798 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.798 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.799 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.799 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 24712 2020-11-12T17:23:54.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.799 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648094+0000", 2020-11-12T17:23:54.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648094+0000", 2020-11-12T17:23:54.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:54.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648062+0000", 2020-11-12T17:23:54.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3991000000000002e-05 2020-11-12T17:23:54.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648156+0000", 2020-11-12T17:23:54.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2483999999999999e-05 2020-11-12T17:23:54.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648169+0000", 2020-11-12T17:23:54.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0269999999999998e-06 2020-11-12T17:23:54.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648176+0000", 2020-11-12T17:23:54.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042901199999999997 2020-11-12T17:23:54.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.652466+0000", 2020-11-12T17:23:54.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9704000000000003e-05 2020-11-12T17:23:54.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.652526+0000", 2020-11-12T17:23:54.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116524 2020-11-12T17:23:54.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:54.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.652642+0000", 2020-11-12T17:23:54.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003019538 2020-11-12T17:23:54.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.655662+0000", 2020-11-12T17:23:54.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20023754399999999 2020-11-12T17:23:54.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.855899+0000", 2020-11-12T17:23:54.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2182999999999999e-05 2020-11-12T17:23:54.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.855941+0000", 2020-11-12T17:23:54.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3601999999999999e-05 2020-11-12T17:23:54.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.855995+0000", 2020-11-12T17:23:54.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.207900908 2020-11-12T17:23:54.815 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.815 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.816 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:24944 3.7 3:e947d4ca:::benchmark_data_smithi036_14212_object3117:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:54.816 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:44.871894+0000", 2020-11-12T17:23:54.816 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.7682960570000006, 2020-11-12T17:23:54.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21402005599999999, 2020-11-12T17:23:54.817 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.817 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.817 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 24944 2020-11-12T17:23:54.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.817 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871894+0000", 2020-11-12T17:23:54.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871894+0000", 2020-11-12T17:23:54.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999495 2020-11-12T17:23:54.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871843+0000", 2020-11-12T17:23:54.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014137899999999999 2020-11-12T17:23:54.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871985+0000", 2020-11-12T17:23:54.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9230000000000001e-05 2020-11-12T17:23:54.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.872004+0000", 2020-11-12T17:23:54.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0258000000000001e-05 2020-11-12T17:23:54.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.872014+0000", 2020-11-12T17:23:54.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020382600000000001 2020-11-12T17:23:54.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.874052+0000", 2020-11-12T17:23:54.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3418999999999995e-05 2020-11-12T17:23:54.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.874136+0000", 2020-11-12T17:23:54.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100831 2020-11-12T17:23:54.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:54.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.874237+0000", 2020-11-12T17:23:54.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019406270000000001 2020-11-12T17:23:54.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.876177+0000", 2020-11-12T17:23:54.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20960147300000001 2020-11-12T17:23:54.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.085779+0000", 2020-11-12T17:23:54.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3523000000000007e-05 2020-11-12T17:23:54.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.085862+0000", 2020-11-12T17:23:54.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1502999999999998e-05 2020-11-12T17:23:54.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.085914+0000", 2020-11-12T17:23:54.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21402005599999999 2020-11-12T17:23:54.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.826 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.827 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25280 3.b 3:d39b0d08:::benchmark_data_smithi036_14212_object3159:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:23:54.827 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:23:54.827 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.4387099499999998, 2020-11-12T17:23:54.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224130581, 2020-11-12T17:23:54.827 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.827 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.828 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25280 2020-11-12T17:23:54.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.828 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:23:54.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:23:54.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999604 2020-11-12T17:23:54.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201440+0000", 2020-11-12T17:23:54.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011655 2020-11-12T17:23:54.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201557+0000", 2020-11-12T17:23:54.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7612999999999999e-05 2020-11-12T17:23:54.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201574+0000", 2020-11-12T17:23:54.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9449999999999993e-06 2020-11-12T17:23:54.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201582+0000", 2020-11-12T17:23:54.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000790633 2020-11-12T17:23:54.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202373+0000", 2020-11-12T17:23:54.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107295 2020-11-12T17:23:54.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202480+0000", 2020-11-12T17:23:54.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000168703 2020-11-12T17:23:54.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:54.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202649+0000", 2020-11-12T17:23:54.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050285470000000004 2020-11-12T17:23:54.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.207677+0000", 2020-11-12T17:23:54.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21784867699999999 2020-11-12T17:23:54.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425526+0000", 2020-11-12T17:23:54.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8837e-05 2020-11-12T17:23:54.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425575+0000", 2020-11-12T17:23:54.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5524000000000001e-05 2020-11-12T17:23:54.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425610+0000", 2020-11-12T17:23:54.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224130581 2020-11-12T17:23:54.837 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.837 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.837 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.837 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:23:54.837 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:23:54.837 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.1834716099999998, 2020-11-12T17:23:54.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:23:54.838 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.838 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.838 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.838 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.838 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.838 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:23:54.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.839 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:23:54.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:23:54.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:54.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:23:54.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:23:54.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:23:54.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:23:54.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:23:54.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:23:54.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:23:54.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:23:54.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:23:54.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:23:54.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:23:54.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:23:54.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:54.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:23:54.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:23:54.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:23:54.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:23:54.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:23:54.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:23:54.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:23:54.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:23:54.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:23:54.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:23:54.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.847 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.848 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:23:54.848 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:23:54.848 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.04091954, 2020-11-12T17:23:54.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:23:54.848 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.848 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.848 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.849 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.849 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.849 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:23:54.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.849 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:23:54.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:23:54.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:23:54.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:23:54.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:23:54.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:23:54.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:23:54.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:23:54.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:23:54.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:23:54.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:23:54.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:23:54.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:23:54.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:23:54.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:23:54.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:54.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:23:54.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:23:54.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:23:54.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:23:54.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:23:54.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:23:54.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:23:54.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:23:54.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:23:54.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:23:54.858 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.858 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.858 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.858 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e48)", 2020-11-12T17:23:54.858 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:23:54.858 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.9641297419999999, 2020-11-12T17:23:54.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998, 2020-11-12T17:23:54.859 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.859 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:23:54.859 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.859 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.859 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.859 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:23:54.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.860 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:23:54.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:23:54.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:23:54.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676007+0000", 2020-11-12T17:23:54.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110902 2020-11-12T17:23:54.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676118+0000", 2020-11-12T17:23:54.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6195e-05 2020-11-12T17:23:54.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676135+0000", 2020-11-12T17:23:54.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3829999999999998e-06 2020-11-12T17:23:54.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676144+0000", 2020-11-12T17:23:54.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5806000000000001e-05 2020-11-12T17:23:54.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676200+0000", 2020-11-12T17:23:54.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9735999999999999e-05 2020-11-12T17:23:54.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:23:54.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676259+0000", 2020-11-12T17:23:54.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29976251100000001 2020-11-12T17:23:54.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976022+0000", 2020-11-12T17:23:54.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998 2020-11-12T17:23:54.865 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.866 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.866 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.866 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:33576 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:23:54.866 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:23:54.866 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.0322750940000001, 2020-11-12T17:23:54.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846, 2020-11-12T17:23:54.867 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.867 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:54.867 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:23:54.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:23:54.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:23:54.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607883+0000", 2020-11-12T17:23:54.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0716000000000004e-05 2020-11-12T17:23:54.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607964+0000", 2020-11-12T17:23:54.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28021348200000001 2020-11-12T17:23:54.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888177+0000", 2020-11-12T17:23:54.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0214000000000001e-05 2020-11-12T17:23:54.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888188+0000", 2020-11-12T17:23:54.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0760999999999994e-05 2020-11-12T17:23:54.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888278+0000", 2020-11-12T17:23:54.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0537e-05 2020-11-12T17:23:54.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888299+0000", 2020-11-12T17:23:54.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020659300000000001 2020-11-12T17:23:54.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888505+0000", 2020-11-12T17:23:54.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846 2020-11-12T17:23:54.873 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.873 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.873 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.873 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34112 3.7 3:e7a0542c:::benchmark_data_smithi036_14212_object4263:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:23:54.873 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.337722+0000", 2020-11-12T17:23:54.874 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.30246739700000003, 2020-11-12T17:23:54.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17921952899999999, 2020-11-12T17:23:54.874 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:54.874 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:54.874 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:54.874 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:54.874 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:54.874 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34112 2020-11-12T17:23:54.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.875 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:54.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:54.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.337722+0000", 2020-11-12T17:23:54.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:54.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:54.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.337722+0000", 2020-11-12T17:23:54.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:54.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:54.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.337697+0000", 2020-11-12T17:23:54.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2447000000000005e-05 2020-11-12T17:23:54.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:54.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.337779+0000", 2020-11-12T17:23:54.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3036e-05 2020-11-12T17:23:54.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:54.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.337792+0000", 2020-11-12T17:23:54.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9100000000000002e-06 2020-11-12T17:23:54.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:54.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.337798+0000", 2020-11-12T17:23:54.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054116779999999996 2020-11-12T17:23:54.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:54.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.343210+0000", 2020-11-12T17:23:54.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6401000000000001e-05 2020-11-12T17:23:54.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:54.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.343306+0000", 2020-11-12T17:23:54.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015768299999999999 2020-11-12T17:23:54.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:54.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.343464+0000", 2020-11-12T17:23:54.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015199160000000001 2020-11-12T17:23:54.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:54.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.344984+0000", 2020-11-12T17:23:54.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17181986099999999 2020-11-12T17:23:54.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:54.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.516804+0000", 2020-11-12T17:23:54.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8366000000000003e-05 2020-11-12T17:23:54.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:54.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.516862+0000", 2020-11-12T17:23:54.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9903999999999999e-05 2020-11-12T17:23:54.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:54.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:54.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:54.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.516942+0000", 2020-11-12T17:23:54.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17921952899999999 2020-11-12T17:23:54.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.883 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:54.884 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:54.884 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:54.885 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:54.886 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:54.880+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:54.986 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:54.982+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:55.017 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:55.017 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:55.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.017 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:34800 3.f e49/20 3:f6c99cf0:::benchmark_data_smithi036_14212_object4349:head v 49'2240, mlcod=49'2236)", 2020-11-12T17:23:55.017 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:55.016465+0000", 2020-11-12T17:23:55.018 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00043450800000000001, 2020-11-12T17:23:55.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000462633, 2020-11-12T17:23:55.018 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.018 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:55.018 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.016465+0000", 2020-11-12T17:23:55.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.016465+0000", 2020-11-12T17:23:55.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:23:55.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.016438+0000", 2020-11-12T17:23:55.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3041000000000006e-05 2020-11-12T17:23:55.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.016531+0000", 2020-11-12T17:23:55.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8783999999999996e-05 2020-11-12T17:23:55.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.016620+0000", 2020-11-12T17:23:55.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7850000000000003e-06 2020-11-12T17:23:55.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.016627+0000", 2020-11-12T17:23:55.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8013999999999997e-05 2020-11-12T17:23:55.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.016685+0000", 2020-11-12T17:23:55.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3445999999999998e-05 2020-11-12T17:23:55.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.016718+0000", 2020-11-12T17:23:55.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000253377 2020-11-12T17:23:55.024 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.024 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.024 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.024 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.024 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:23:55.025 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:23:55.025 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:55.026 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:23:55.087 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:55.080+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:55.188 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:55.180+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:55.191 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:55.192 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:55.192 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:55.192 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:55.192 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:55.203 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:23:55.289 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:55.286+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:55.334 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:55.384 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:23:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.572368204, 2020-11-12T17:23:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:23:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:23:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:23:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:23:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:23:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:23:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:23:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:23:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:23:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:23:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:23:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:23:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:23:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:23:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:23:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:23:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:23:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:23:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:23:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:23:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:23:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:23:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:23:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:23:55.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:23:55.397 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.397 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.397 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.398 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:23:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.565569353000001, 2020-11-12T17:23:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:23:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:23:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:23:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:23:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:23:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:23:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:23:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:23:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:23:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:23:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:23:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:23:55.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:23:55.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:23:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:23:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:23:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:23:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.406 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.406 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1104 3.9 3:9f55e211:::benchmark_data_smithi036_14212_object137:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:55.406 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:55.406 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.713775001999998, 2020-11-12T17:23:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001, 2020-11-12T17:23:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1104 2020-11-12T17:23:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:23:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617385+0000", 2020-11-12T17:23:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9141999999999994e-05 2020-11-12T17:23:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617484+0000", 2020-11-12T17:23:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2413e-05 2020-11-12T17:23:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617497+0000", 2020-11-12T17:23:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1659999999999999e-06 2020-11-12T17:23:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617503+0000", 2020-11-12T17:23:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032791000000000001 2020-11-12T17:23:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620782+0000", 2020-11-12T17:23:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102198 2020-11-12T17:23:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620884+0000", 2020-11-12T17:23:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114058 2020-11-12T17:23:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620998+0000", 2020-11-12T17:23:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018203270000000001 2020-11-12T17:23:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622818+0000", 2020-11-12T17:23:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.203924995 2020-11-12T17:23:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826743+0000", 2020-11-12T17:23:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012106 2020-11-12T17:23:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826865+0000", 2020-11-12T17:23:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014220699999999999 2020-11-12T17:23:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827007+0000", 2020-11-12T17:23:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001 2020-11-12T17:23:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1104 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:55.419 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.708846219999998, 2020-11-12T17:23:55.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999, 2020-11-12T17:23:55.419 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.419 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:55.420 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:23:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:23:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622338+0000", 2020-11-12T17:23:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5814e-05 2020-11-12T17:23:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622374+0000", 2020-11-12T17:23:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20244251299999999 2020-11-12T17:23:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824817+0000", 2020-11-12T17:23:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.117e-05 2020-11-12T17:23:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824828+0000", 2020-11-12T17:23:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001882332 2020-11-12T17:23:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826710+0000", 2020-11-12T17:23:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6818000000000001e-05 2020-11-12T17:23:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826727+0000", 2020-11-12T17:23:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031566199999999997 2020-11-12T17:23:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827043+0000", 2020-11-12T17:23:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999 2020-11-12T17:23:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:23:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.322310577000003, 2020-11-12T17:23:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:23:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:23:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:23:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:23:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:23:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:23:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:23:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:23:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:23:55.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:23:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:23:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:23:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:23:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:23:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:23:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:23:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:23:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:23:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:23:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:23:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:23:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:23:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:23:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:23:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:23:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:23:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:23:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.315095395999997, 2020-11-12T17:23:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:23:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:23:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:23:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:23:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:23:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:23:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:23:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:23:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:23:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:23:55.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:23:55.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:23:55.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:23:55.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:23:55.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:23:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:23:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:23:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:4896 3.3 3:c1830331:::benchmark_data_smithi036_14212_object611:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.515025473000001, 2020-11-12T17:23:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001, 2020-11-12T17:23:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 4896 2020-11-12T17:23:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:23:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:23:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816142+0000", 2020-11-12T17:23:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7733999999999998e-05 2020-11-12T17:23:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816220+0000", 2020-11-12T17:23:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2221999999999999e-05 2020-11-12T17:23:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816232+0000", 2020-11-12T17:23:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4469999999999997e-06 2020-11-12T17:23:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816237+0000", 2020-11-12T17:23:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012662909999999999 2020-11-12T17:23:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817504+0000", 2020-11-12T17:23:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167959 2020-11-12T17:23:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817672+0000", 2020-11-12T17:23:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025141300000000003 2020-11-12T17:23:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817923+0000", 2020-11-12T17:23:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001128467 2020-11-12T17:23:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.819051+0000", 2020-11-12T17:23:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19242863199999999 2020-11-12T17:23:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011480+0000", 2020-11-12T17:23:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9741999999999996e-05 2020-11-12T17:23:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011560+0000", 2020-11-12T17:23:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4276e-05 2020-11-12T17:23:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011614+0000", 2020-11-12T17:23:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001 2020-11-12T17:23:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.644650505000001, 2020-11-12T17:23:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:23:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:23:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:23:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:23:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:23:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:23:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:23:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:23:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:23:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:23:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:23:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:23:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:23:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:23:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:23:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:23:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:23:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:23:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:23:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:23:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:23:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:23:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:23:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:23:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:23:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.644485602000003, 2020-11-12T17:23:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:23:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:23:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:23:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:23:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:23:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:23:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:23:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:23:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:23:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:23:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:23:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:23:55.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:23:55.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:23:55.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:23:55.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:23:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:23:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:23:55.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:23:55.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:23:55.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:23:55.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:23:55.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:23:55.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:23:55.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:23:55.482 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.482 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.482 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.483 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:55.483 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:55.483 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.640322368, 2020-11-12T17:23:55.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:23:55.483 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.483 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:55.483 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:55.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:23:55.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:23:55.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:23:55.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:23:55.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:23:55.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:23:55.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:23:55.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:23:55.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:23:55.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:23:55.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:23:55.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:23:55.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:23:55.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:23:55.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:23:55.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:23:55.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.489 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.490 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:23:55.490 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:55.490 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.639005533000002, 2020-11-12T17:23:55.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:23:55.490 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.491 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:55.491 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:55.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:23:55.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:23:55.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:23:55.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:23:55.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:23:55.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:23:55.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:23:55.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:23:55.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:23:55.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:23:55.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:23:55.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:23:55.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:23:55.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:23:55.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:23:55.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:23:55.499 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.499 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.499 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.500 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:23:55.500 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:55.500 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.776685901, 2020-11-12T17:23:55.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:23:55.501 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.501 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.502 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:55.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:23:55.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:23:55.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:23:55.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:23:55.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:23:55.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:23:55.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:23:55.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:23:55.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:23:55.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:23:55.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:23:55.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:23:55.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:23:55.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:23:55.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:23:55.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:23:55.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:23:55.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:23:55.514 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.514 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.515 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.515 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:23:55.515 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:55.515 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.448883932999998, 2020-11-12T17:23:55.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:23:55.516 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.516 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.516 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.516 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.516 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.516 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:23:55.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.517 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:55.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:23:55.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:23:55.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:23:55.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:23:55.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:23:55.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:23:55.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:23:55.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:23:55.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:23:55.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:23:55.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:23:55.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:23:55.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:23:55.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:23:55.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:23:55.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:23:55.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:23:55.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:23:55.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:23:55.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:23:55.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:23:55.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:23:55.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:23:55.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:23:55.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:23:55.525 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.525 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.525 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.526 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:23:55.526 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:55.526 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.441640223999997, 2020-11-12T17:23:55.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:23:55.526 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.526 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:55.527 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:55.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:23:55.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:23:55.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:23:55.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:23:55.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:23:55.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:23:55.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:23:55.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:23:55.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:23:55.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:23:55.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:23:55.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:23:55.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:23:55.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:23:55.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:23:55.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:23:55.532 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.533 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.533 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.533 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18078 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:55.533 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:55.533 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.445200579000002, 2020-11-12T17:23:55.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001, 2020-11-12T17:23:55.534 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.534 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.534 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.534 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.534 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.534 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18078 2020-11-12T17:23:55.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.535 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:55.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:23:55.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:55.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885975+0000", 2020-11-12T17:23:55.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1489000000000006e-05 2020-11-12T17:23:55.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886047+0000", 2020-11-12T17:23:55.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7270000000000002e-06 2020-11-12T17:23:55.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886057+0000", 2020-11-12T17:23:55.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4660000000000001e-06 2020-11-12T17:23:55.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886061+0000", 2020-11-12T17:23:55.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001076579 2020-11-12T17:23:55.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887138+0000", 2020-11-12T17:23:55.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131815 2020-11-12T17:23:55.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887270+0000", 2020-11-12T17:23:55.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018425599999999999 2020-11-12T17:23:55.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:55.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887454+0000", 2020-11-12T17:23:55.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048314439999999998 2020-11-12T17:23:55.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892285+0000", 2020-11-12T17:23:55.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18195460599999999 2020-11-12T17:23:55.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074240+0000", 2020-11-12T17:23:55.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167078 2020-11-12T17:23:55.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074407+0000", 2020-11-12T17:23:55.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112014 2020-11-12T17:23:55.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074519+0000", 2020-11-12T17:23:55.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001 2020-11-12T17:23:55.543 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.543 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.543 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.544 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18079 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:55.544 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:55.544 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.445091033000001, 2020-11-12T17:23:55.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999, 2020-11-12T17:23:55.544 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.544 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.544 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.545 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.545 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.545 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18079 2020-11-12T17:23:55.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.545 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:55.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:23:55.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:55.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886083+0000", 2020-11-12T17:23:55.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1087999999999993e-05 2020-11-12T17:23:55.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886164+0000", 2020-11-12T17:23:55.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8720000000000008e-06 2020-11-12T17:23:55.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886173+0000", 2020-11-12T17:23:55.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2519999999999996e-06 2020-11-12T17:23:55.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886179+0000", 2020-11-12T17:23:55.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027277500000000001 2020-11-12T17:23:55.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.888907+0000", 2020-11-12T17:23:55.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019889199999999999 2020-11-12T17:23:55.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889106+0000", 2020-11-12T17:23:55.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028895700000000001 2020-11-12T17:23:55.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:55.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889395+0000", 2020-11-12T17:23:55.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003372571 2020-11-12T17:23:55.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892767+0000", 2020-11-12T17:23:55.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.181837265 2020-11-12T17:23:55.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074604+0000", 2020-11-12T17:23:55.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.135e-05 2020-11-12T17:23:55.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074666+0000", 2020-11-12T17:23:55.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7472999999999996e-05 2020-11-12T17:23:55.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074733+0000", 2020-11-12T17:23:55.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999 2020-11-12T17:23:55.555 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.555 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.555 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.555 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18080 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:55.556 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:55.556 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.444589546, 2020-11-12T17:23:55.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999, 2020-11-12T17:23:55.556 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.556 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.556 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.556 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.556 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.557 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18080 2020-11-12T17:23:55.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.557 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:55.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:23:55.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:55.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886586+0000", 2020-11-12T17:23:55.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3144000000000002e-05 2020-11-12T17:23:55.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886669+0000", 2020-11-12T17:23:55.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6894000000000001e-05 2020-11-12T17:23:55.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886686+0000", 2020-11-12T17:23:55.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5079999999999999e-06 2020-11-12T17:23:55.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886693+0000", 2020-11-12T17:23:55.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037501600000000002 2020-11-12T17:23:55.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890444+0000", 2020-11-12T17:23:55.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183449 2020-11-12T17:23:55.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890627+0000", 2020-11-12T17:23:55.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000305762 2020-11-12T17:23:55.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:55.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890933+0000", 2020-11-12T17:23:55.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022402920000000001 2020-11-12T17:23:55.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.893173+0000", 2020-11-12T17:23:55.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18168999399999999 2020-11-12T17:23:55.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074863+0000", 2020-11-12T17:23:55.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012771700000000001 2020-11-12T17:23:55.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074991+0000", 2020-11-12T17:23:55.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0248999999999999e-05 2020-11-12T17:23:55.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.075051+0000", 2020-11-12T17:23:55.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999 2020-11-12T17:23:55.586 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.586 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.586 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.587 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:23:55.587 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:23:55.587 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 15.279292521, 2020-11-12T17:23:55.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:23:55.588 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.588 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.588 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.588 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.588 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.588 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:23:55.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.589 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:23:55.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:23:55.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:55.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:23:55.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:23:55.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:23:55.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:23:55.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:23:55.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:23:55.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:23:55.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:23:55.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:23:55.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:23:55.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:23:55.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:23:55.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:55.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:23:55.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:23:55.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:23:55.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:23:55.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:23:55.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:23:55.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:23:55.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:23:55.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:23:55.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:23:55.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.599 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.599 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:23:55.599 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:23:55.600 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.338464764, 2020-11-12T17:23:55.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:23:55.600 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.600 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:55.600 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.600 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.601 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.601 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:23:55.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.601 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:23:55.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:23:55.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:23:55.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:23:55.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:23:55.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:23:55.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:23:55.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:23:55.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:23:55.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:23:55.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:23:55.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:23:55.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:23:55.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:23:55.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:23:55.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:55.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:23:55.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:23:55.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:23:55.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:23:55.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:55.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:23:55.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:23:55.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:55.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:23:55.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:23:55.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:23:55.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:23:55.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.616 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.617 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:23:55.617 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:23:55.617 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.330805955, 2020-11-12T17:23:55.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:23:55.617 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.617 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:55.618 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:23:55.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:23:55.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:23:55.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:23:55.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:23:55.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:23:55.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:23:55.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:23:55.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:23:55.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:23:55.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:23:55.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:23:55.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:23:55.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:23:55.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:23:55.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:55.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:23:55.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:23:55.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.624 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.624 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.624 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:55.626 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:23:55.626 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 51 15 35378 35363 5.41657 8.17188 0.00601855 0.0230686 2020-11-12T17:23:55.627 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:55.620+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:55.627 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:23:55.628 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:55.382+0000 7f9a06aa2700 -1 osd.5 49 handle_osd_map injecting map crc failure 2020-11-12T17:23:55.628 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:55.406+0000 7f9289d6e700 -1 osd.7 49 handle_osd_map injecting map crc failure 2020-11-12T17:23:55.726 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:55.722+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:55.808 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:55.818 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:55.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.819 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:35638 3.5 3:a6867654:::benchmark_data_smithi036_14212_object4454:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e50)", 2020-11-12T17:23:55.819 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:55.797466+0000", 2020-11-12T17:23:55.819 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.010525955, 2020-11-12T17:23:55.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010550919000000001, 2020-11-12T17:23:55.820 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.820 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:55.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.820 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 35638 2020-11-12T17:23:55.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.821 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.797466+0000", 2020-11-12T17:23:55.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.797466+0000", 2020-11-12T17:23:55.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:23:55.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.797435+0000", 2020-11-12T17:23:55.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9691999999999994e-05 2020-11-12T17:23:55.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.797524+0000", 2020-11-12T17:23:55.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1216999999999999e-05 2020-11-12T17:23:55.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.797536+0000", 2020-11-12T17:23:55.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5439999999999998e-06 2020-11-12T17:23:55.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.797541+0000", 2020-11-12T17:23:55.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038168379999999999 2020-11-12T17:23:55.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.801358+0000", 2020-11-12T17:23:55.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000117719 2020-11-12T17:23:55.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.801476+0000", 2020-11-12T17:23:55.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018297300000000001 2020-11-12T17:23:55.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:55.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.801659+0000", 2020-11-12T17:23:55.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049746850000000004 2020-11-12T17:23:55.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.806633+0000", 2020-11-12T17:23:55.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0091675260000000005 2020-11-12T17:23:55.828 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.828 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.829 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.829 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:35639 3.5 3:a6867654:::benchmark_data_smithi036_14212_object4454:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e50)", 2020-11-12T17:23:55.829 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:55.798522+0000", 2020-11-12T17:23:55.829 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.009470226, 2020-11-12T17:23:55.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0095690459999999995, 2020-11-12T17:23:55.830 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.830 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:55.830 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.830 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.830 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.830 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 35639 2020-11-12T17:23:55.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.831 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.798522+0000", 2020-11-12T17:23:55.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.798522+0000", 2020-11-12T17:23:55.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:23:55.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.798489+0000", 2020-11-12T17:23:55.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7269999999999995e-05 2020-11-12T17:23:55.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.798586+0000", 2020-11-12T17:23:55.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1980999999999999e-05 2020-11-12T17:23:55.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.798598+0000", 2020-11-12T17:23:55.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4819999999999999e-06 2020-11-12T17:23:55.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.798605+0000", 2020-11-12T17:23:55.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041013459999999996 2020-11-12T17:23:55.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.802706+0000", 2020-11-12T17:23:55.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013395599999999999 2020-11-12T17:23:55.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.802840+0000", 2020-11-12T17:23:55.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017422100000000001 2020-11-12T17:23:55.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:55.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.803014+0000", 2020-11-12T17:23:55.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036232389999999999 2020-11-12T17:23:55.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.806638+0000", 2020-11-12T17:23:55.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081159960000000003 2020-11-12T17:23:55.838 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.838 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.838 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.839 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:35640 3.5 3:a6867654:::benchmark_data_smithi036_14212_object4454:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e50)", 2020-11-12T17:23:55.839 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:55.799737+0000", 2020-11-12T17:23:55.839 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0082551910000000003, 2020-11-12T17:23:55.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084174109999999996, 2020-11-12T17:23:55.839 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:55.839 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:23:55.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:55.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:55.840 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:55.840 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 35640 2020-11-12T17:23:55.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.840 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:55.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:55.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.799737+0000", 2020-11-12T17:23:55.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:55.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:55.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.799737+0000", 2020-11-12T17:23:55.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:55.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:55.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.799718+0000", 2020-11-12T17:23:55.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1482000000000005e-05 2020-11-12T17:23:55.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:55.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.799780+0000", 2020-11-12T17:23:55.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:23:55.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:55.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.799790+0000", 2020-11-12T17:23:55.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9100000000000004e-06 2020-11-12T17:23:55.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:55.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.799794+0000", 2020-11-12T17:23:55.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041982979999999996 2020-11-12T17:23:55.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:55.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.803993+0000", 2020-11-12T17:23:55.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000113004 2020-11-12T17:23:55.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:55.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.804106+0000", 2020-11-12T17:23:55.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000182871 2020-11-12T17:23:55.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:55.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.804289+0000", 2020-11-12T17:23:55.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029731470000000002 2020-11-12T17:23:55.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:55.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:55.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:55.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.807262+0000", 2020-11-12T17:23:55.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0075252030000000003 2020-11-12T17:23:55.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.848 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:55.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:55.848 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:23:55.848 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 3 2020-11-12T17:23:55.849 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:55.850 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:23:55.851 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:55.844+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:55.951 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:23:55.944+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:23:56.019 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:23:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:23:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:23:56.020 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:56.030 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:23:56.077 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:56.074+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:56.114 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:23:56.163 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:23:56.163 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:23:56.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:23:56.163 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:23:56.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.164 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:928 3.2 e22/20 3:4c5417bc:::benchmark_data_smithi036_14212_object115:head v 22'80, mlcod=22'75)", 2020-11-12T17:23:56.164 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:56.164 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.727391249999997, 2020-11-12T17:23:56.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875, 2020-11-12T17:23:56.164 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.164 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.164 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:56.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432402+0000", 2020-11-12T17:23:56.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:23:56.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432388+0000", 2020-11-12T17:23:56.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2012000000000003e-05 2020-11-12T17:23:56.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.432440+0000", 2020-11-12T17:23:56.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.11616101500000001 2020-11-12T17:23:56.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548601+0000", 2020-11-12T17:23:56.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3270000000000001e-06 2020-11-12T17:23:56.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548609+0000", 2020-11-12T17:23:56.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6627999999999997e-05 2020-11-12T17:23:56.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548706+0000", 2020-11-12T17:23:56.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9027999999999999e-05 2020-11-12T17:23:56.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.548755+0000", 2020-11-12T17:23:56.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038296739999999999 2020-11-12T17:23:56.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552584+0000", 2020-11-12T17:23:56.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010042 2020-11-12T17:23:56.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.552685+0000", 2020-11-12T17:23:56.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120282875 2020-11-12T17:23:56.172 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.172 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.172 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.173 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:23:56.173 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:56.173 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.655564548000001, 2020-11-12T17:23:56.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:23:56.174 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.174 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.174 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:56.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:23:56.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:23:56.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:23:56.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:23:56.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:23:56.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:23:56.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:23:56.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:23:56.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:23:56.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:23:56.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:23:56.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:23:56.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:23:56.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:23:56.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:23:56.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:23:56.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:23:56.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:23:56.183 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.183 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.183 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.183 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:6040 3.d e25/20 3:b8c2806e:::benchmark_data_smithi036_14212_object754:head v 25'360, mlcod=25'354)", 2020-11-12T17:23:56.184 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:56.184 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.250258911000003, 2020-11-12T17:23:56.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431, 2020-11-12T17:23:56.184 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.184 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.184 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:56.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909534+0000", 2020-11-12T17:23:56.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:23:56.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909516+0000", 2020-11-12T17:23:56.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6403999999999996e-05 2020-11-12T17:23:56.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.909582+0000", 2020-11-12T17:23:56.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.113169626 2020-11-12T17:23:56.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022752+0000", 2020-11-12T17:23:56.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1850000000000004e-06 2020-11-12T17:23:56.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022760+0000", 2020-11-12T17:23:56.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7312999999999998e-05 2020-11-12T17:23:56.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022817+0000", 2020-11-12T17:23:56.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1387999999999999e-05 2020-11-12T17:23:56.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.022838+0000", 2020-11-12T17:23:56.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001833487 2020-11-12T17:23:56.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024672+0000", 2020-11-12T17:23:56.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8751000000000005e-05 2020-11-12T17:23:56.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.024761+0000", 2020-11-12T17:23:56.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.115226431 2020-11-12T17:23:56.191 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.191 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.191 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.192 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:56.192 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:56.192 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.633554983000003, 2020-11-12T17:23:56.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:23:56.192 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.192 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.192 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:56.192 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:56.193 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:56.193 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:23:56.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.193 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:56.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:23:56.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:23:56.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:23:56.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:23:56.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:23:56.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:23:56.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:23:56.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:23:56.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:23:56.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:23:56.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:23:56.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:23:56.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:23:56.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:23:56.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:56.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:23:56.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:23:56.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:56.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:23:56.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:23:56.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:56.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:23:56.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:23:56.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:23:56.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:23:56.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:23:56.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:23:56.203 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.203 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.204 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.204 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:23:56.204 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:56.204 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.630155049000003, 2020-11-12T17:23:56.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:23:56.205 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.205 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:23:56.205 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:56.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:23:56.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:56.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:23:56.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:23:56.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:23:56.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:23:56.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:23:56.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:23:56.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:23:56.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:23:56.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:23:56.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:23:56.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:23:56.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:23:56.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:23:56.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:23:56.211 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.211 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.211 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.212 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:17992 3.d e41/20 3:bfb5f180:::benchmark_data_smithi036_14212_object2248:head v 41'952, mlcod=40'947)", 2020-11-12T17:23:56.212 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:56.212 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.353703589999999, 2020-11-12T17:23:56.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12242665599999999, 2020-11-12T17:23:56.212 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.212 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.212 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:56.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806090+0000", 2020-11-12T17:23:56.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:23:56.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806068+0000", 2020-11-12T17:23:56.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9553000000000002e-05 2020-11-12T17:23:56.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.806147+0000", 2020-11-12T17:23:56.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.120094329 2020-11-12T17:23:56.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926242+0000", 2020-11-12T17:23:56.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5110000000000003e-06 2020-11-12T17:23:56.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926247+0000", 2020-11-12T17:23:56.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8669000000000002e-05 2020-11-12T17:23:56.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926326+0000", 2020-11-12T17:23:56.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0543e-05 2020-11-12T17:23:56.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.926386+0000", 2020-11-12T17:23:56.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020619430000000001 2020-11-12T17:23:56.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.928448+0000", 2020-11-12T17:23:56.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7936999999999997e-05 2020-11-12T17:23:56.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.928516+0000", 2020-11-12T17:23:56.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12242665599999999 2020-11-12T17:23:56.220 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.220 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.220 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.221 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:18120 3.d e41/20 3:b4a6068b:::benchmark_data_smithi036_14212_object2264:head v 41'960, mlcod=41'953)", 2020-11-12T17:23:56.221 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:56.221 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.222147272000001, 2020-11-12T17:23:56.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13161703499999999, 2020-11-12T17:23:56.221 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.221 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.222 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:56.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937646+0000", 2020-11-12T17:23:56.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:23:56.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937606+0000", 2020-11-12T17:23:56.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015189199999999999 2020-11-12T17:23:56.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.937758+0000", 2020-11-12T17:23:56.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.129116967 2020-11-12T17:23:56.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066875+0000", 2020-11-12T17:23:56.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1977999999999999e-05 2020-11-12T17:23:56.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066887+0000", 2020-11-12T17:23:56.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102873 2020-11-12T17:23:56.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.066990+0000", 2020-11-12T17:23:56.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8860000000000002e-05 2020-11-12T17:23:56.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.067049+0000", 2020-11-12T17:23:56.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020681240000000002 2020-11-12T17:23:56.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.069117+0000", 2020-11-12T17:23:56.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014595299999999999 2020-11-12T17:23:56.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.069263+0000", 2020-11-12T17:23:56.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13161703499999999 2020-11-12T17:23:56.231 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.231 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.231 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.231 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:19272 3.2 e41/20 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head v 41'1256, mlcod=41'1251)", 2020-11-12T17:23:56.232 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:56.232 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.098216445999999, 2020-11-12T17:23:56.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118689434, 2020-11-12T17:23:56.232 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.232 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.233 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:56.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061577+0000", 2020-11-12T17:23:56.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:23:56.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061534+0000", 2020-11-12T17:23:56.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147861 2020-11-12T17:23:56.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.061682+0000", 2020-11-12T17:23:56.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.116405122 2020-11-12T17:23:56.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178087+0000", 2020-11-12T17:23:56.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1800000000000001e-05 2020-11-12T17:23:56.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178098+0000", 2020-11-12T17:23:56.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000129016 2020-11-12T17:23:56.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178227+0000", 2020-11-12T17:23:56.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8186000000000002e-05 2020-11-12T17:23:56.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.178286+0000", 2020-11-12T17:23:56.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018917160000000001 2020-11-12T17:23:56.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.180177+0000", 2020-11-12T17:23:56.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8812000000000003e-05 2020-11-12T17:23:56.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.180266+0000", 2020-11-12T17:23:56.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.118689434 2020-11-12T17:23:56.241 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.242 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.242 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.242 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:24744 3.4 e45/35 3:27e37414:::benchmark_data_smithi036_14212_object3092:head v 45'1584, mlcod=45'1580)", 2020-11-12T17:23:56.242 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:23:56.242 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.479239907, 2020-11-12T17:23:56.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999, 2020-11-12T17:23:56.243 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.243 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.243 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:23:56.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:23:56.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:23:56.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680526+0000", 2020-11-12T17:23:56.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3724e-05 2020-11-12T17:23:56.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680609+0000", 2020-11-12T17:23:56.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.154293649 2020-11-12T17:23:56.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834903+0000", 2020-11-12T17:23:56.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1653e-05 2020-11-12T17:23:56.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834915+0000", 2020-11-12T17:23:56.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5685000000000006e-05 2020-11-12T17:23:56.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834980+0000", 2020-11-12T17:23:56.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4757e-05 2020-11-12T17:23:56.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.835005+0000", 2020-11-12T17:23:56.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001426067 2020-11-12T17:23:56.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836431+0000", 2020-11-12T17:23:56.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5732999999999997e-05 2020-11-12T17:23:56.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836477+0000", 2020-11-12T17:23:56.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999 2020-11-12T17:23:56.250 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.250 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.250 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.251 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:28560 3.4 e47/35 3:202f80a5:::benchmark_data_smithi036_14212_object3569:head v 47'1808, mlcod=47'1801)", 2020-11-12T17:23:56.251 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:23:56.252 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.4974385339999996, 2020-11-12T17:23:56.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697, 2020-11-12T17:23:56.252 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.252 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.252 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:23:56.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:23:56.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:23:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662339+0000", 2020-11-12T17:23:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9332000000000001e-05 2020-11-12T17:23:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662389+0000", 2020-11-12T17:23:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.240093907 2020-11-12T17:23:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902482+0000", 2020-11-12T17:23:56.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1109999999999996e-06 2020-11-12T17:23:56.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902489+0000", 2020-11-12T17:23:56.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0870000000000004e-05 2020-11-12T17:23:56.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902559+0000", 2020-11-12T17:23:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2245e-05 2020-11-12T17:23:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902592+0000", 2020-11-12T17:23:56.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029425010000000001 2020-11-12T17:23:56.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905534+0000", 2020-11-12T17:23:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8211e-05 2020-11-12T17:23:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905622+0000", 2020-11-12T17:23:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697 2020-11-12T17:23:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29088 3.4 e47/35 3:2728cac2:::benchmark_data_smithi036_14212_object3635:head v 47'1856, mlcod=47'1851)", 2020-11-12T17:23:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:23:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.0577096639999999, 2020-11-12T17:23:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15063083799999999, 2020-11-12T17:23:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:23:56.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:23:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:23:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102067+0000", 2020-11-12T17:23:56.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8427000000000002e-05 2020-11-12T17:23:56.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102126+0000", 2020-11-12T17:23:56.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.145643039 2020-11-12T17:23:56.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247769+0000", 2020-11-12T17:23:56.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5070000000000003e-06 2020-11-12T17:23:56.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247776+0000", 2020-11-12T17:23:56.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9156000000000002e-05 2020-11-12T17:23:56.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247825+0000", 2020-11-12T17:23:56.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9045999999999999e-05 2020-11-12T17:23:56.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247854+0000", 2020-11-12T17:23:56.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004802054 2020-11-12T17:23:56.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.252656+0000", 2020-11-12T17:23:56.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8059000000000001e-05 2020-11-12T17:23:56.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.252714+0000", 2020-11-12T17:23:56.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15063083799999999 2020-11-12T17:23:56.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.288 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.288 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29440 3.4 e48/35 3:252d7780:::benchmark_data_smithi036_14212_object3679:head v 48'1880, mlcod=48'1871)", 2020-11-12T17:23:56.288 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:23:56.289 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.7618072429999998, 2020-11-12T17:23:56.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999, 2020-11-12T17:23:56.289 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.289 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.289 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:23:56.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:23:56.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:23:56.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397961+0000", 2020-11-12T17:23:56.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5236999999999997e-05 2020-11-12T17:23:56.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.398046+0000", 2020-11-12T17:23:56.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23963379700000001 2020-11-12T17:23:56.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637680+0000", 2020-11-12T17:23:56.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.824e-06 2020-11-12T17:23:56.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637687+0000", 2020-11-12T17:23:56.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4215999999999998e-05 2020-11-12T17:23:56.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637732+0000", 2020-11-12T17:23:56.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8510000000000001e-05 2020-11-12T17:23:56.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637750+0000", 2020-11-12T17:23:56.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012233260000000001 2020-11-12T17:23:56.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.638973+0000", 2020-11-12T17:23:56.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8594999999999998e-05 2020-11-12T17:23:56.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.639022+0000", 2020-11-12T17:23:56.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999 2020-11-12T17:23:56.299 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.299 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.300 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29584 3.c 3:32eb6ccf:::benchmark_data_smithi036_14212_object3697:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:23:56.300 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.546737+0000", 2020-11-12T17:23:56.301 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.6130563709999999, 2020-11-12T17:23:56.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.123590087, 2020-11-12T17:23:56.301 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.301 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.301 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:23:56.301 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:23:56.302 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:56.302 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29584 2020-11-12T17:23:56.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.302 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546737+0000", 2020-11-12T17:23:56.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546737+0000", 2020-11-12T17:23:56.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:56.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546707+0000", 2020-11-12T17:23:56.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1920000000000002e-05 2020-11-12T17:23:56.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546789+0000", 2020-11-12T17:23:56.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1283e-05 2020-11-12T17:23:56.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546800+0000", 2020-11-12T17:23:56.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9370000000000001e-06 2020-11-12T17:23:56.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.546806+0000", 2020-11-12T17:23:56.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0069702080000000003 2020-11-12T17:23:56.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.553776+0000", 2020-11-12T17:23:56.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010622499999999999 2020-11-12T17:23:56.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.553883+0000", 2020-11-12T17:23:56.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000152752 2020-11-12T17:23:56.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:23:56.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.554035+0000", 2020-11-12T17:23:56.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045351250000000001 2020-11-12T17:23:56.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:23:56.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.558571+0000", 2020-11-12T17:23:56.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.111600112 2020-11-12T17:23:56.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:56.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.670171+0000", 2020-11-12T17:23:56.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8102999999999994e-05 2020-11-12T17:23:56.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.670249+0000", 2020-11-12T17:23:56.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8172999999999998e-05 2020-11-12T17:23:56.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.670327+0000", 2020-11-12T17:23:56.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.123590087 2020-11-12T17:23:56.316 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.317 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.317 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.317 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29784 3.d e48/20 3:be9adc0e:::benchmark_data_smithi036_14212_object3722:head v 48'1664, mlcod=48'1656)", 2020-11-12T17:23:56.317 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:23:56.317 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.3831094689999999, 2020-11-12T17:23:56.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20712350500000001, 2020-11-12T17:23:56.318 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.318 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.318 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:23:56.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:23:56.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:23:56.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776662+0000", 2020-11-12T17:23:56.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6710000000000002e-05 2020-11-12T17:23:56.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776749+0000", 2020-11-12T17:23:56.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20445004899999999 2020-11-12T17:23:56.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981199+0000", 2020-11-12T17:23:56.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:23:56.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981207+0000", 2020-11-12T17:23:56.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8742999999999997e-05 2020-11-12T17:23:56.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981256+0000", 2020-11-12T17:23:56.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9745999999999999e-05 2020-11-12T17:23:56.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981285+0000", 2020-11-12T17:23:56.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024615840000000002 2020-11-12T17:23:56.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.983747+0000", 2020-11-12T17:23:56.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0350999999999999e-05 2020-11-12T17:23:56.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.983807+0000", 2020-11-12T17:23:56.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20712350500000001 2020-11-12T17:23:56.330 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.330 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.330 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.331 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29991 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1679, mlcod=48'1673)", 2020-11-12T17:23:56.331 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:23:56.331 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.1556293550000003, 2020-11-12T17:23:56.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001, 2020-11-12T17:23:56.331 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.332 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.332 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:23:56.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:23:56.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:23:56.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004127+0000", 2020-11-12T17:23:56.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012464900000000001 2020-11-12T17:23:56.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004251+0000", 2020-11-12T17:23:56.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28639012600000002 2020-11-12T17:23:56.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290641+0000", 2020-11-12T17:23:56.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:23:56.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290646+0000", 2020-11-12T17:23:56.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2363000000000002e-05 2020-11-12T17:23:56.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290679+0000", 2020-11-12T17:23:56.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3289999999999999e-05 2020-11-12T17:23:56.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290702+0000", 2020-11-12T17:23:56.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014675440000000001 2020-11-12T17:23:56.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292170+0000", 2020-11-12T17:23:56.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6585000000000001e-05 2020-11-12T17:23:56.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292226+0000", 2020-11-12T17:23:56.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001 2020-11-12T17:23:56.341 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.341 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.341 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.341 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:23:56.342 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:23:56.342 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.1542656019999997, 2020-11-12T17:23:56.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:23:56.342 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.342 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.342 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:23:56.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:23:56.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:23:56.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:23:56.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:23:56.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:23:56.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:23:56.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:23:56.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:23:56.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:23:56.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:23:56.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:23:56.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:23:56.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:23:56.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:23:56.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:23:56.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:23:56.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:23:56.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:23:56.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.349 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.350 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30039 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1927, mlcod=48'1921)", 2020-11-12T17:23:56.350 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:23:56.350 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.0949869249999997, 2020-11-12T17:23:56.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001, 2020-11-12T17:23:56.350 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.350 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.350 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:23:56.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:23:56.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999409 2020-11-12T17:23:56.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064747+0000", 2020-11-12T17:23:56.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019364299999999999 2020-11-12T17:23:56.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064941+0000", 2020-11-12T17:23:56.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.212994778 2020-11-12T17:23:56.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277936+0000", 2020-11-12T17:23:56.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7939999999999997e-06 2020-11-12T17:23:56.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277945+0000", 2020-11-12T17:23:56.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032420940000000001 2020-11-12T17:23:56.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281187+0000", 2020-11-12T17:23:56.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3390000000000001e-05 2020-11-12T17:23:56.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281211+0000", 2020-11-12T17:23:56.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062069380000000004 2020-11-12T17:23:56.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287418+0000", 2020-11-12T17:23:56.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109126 2020-11-12T17:23:56.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287527+0000", 2020-11-12T17:23:56.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001 2020-11-12T17:23:56.357 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.357 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.357 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.358 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30040 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1928, mlcod=48'1921)", 2020-11-12T17:23:56.358 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:23:56.358 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.0933681740000001, 2020-11-12T17:23:56.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277, 2020-11-12T17:23:56.358 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.358 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.358 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:23:56.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:23:56.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:23:56.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066369+0000", 2020-11-12T17:23:56.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185513 2020-11-12T17:23:56.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066555+0000", 2020-11-12T17:23:56.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22267770000000001 2020-11-12T17:23:56.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289233+0000", 2020-11-12T17:23:56.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5750000000000001e-06 2020-11-12T17:23:56.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289236+0000", 2020-11-12T17:23:56.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7205e-05 2020-11-12T17:23:56.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289283+0000", 2020-11-12T17:23:56.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0210000000000001e-05 2020-11-12T17:23:56.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289304+0000", 2020-11-12T17:23:56.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018794020000000001 2020-11-12T17:23:56.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291183+0000", 2020-11-12T17:23:56.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2386999999999998e-05 2020-11-12T17:23:56.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291235+0000", 2020-11-12T17:23:56.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277 2020-11-12T17:23:56.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.365 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.366 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:33768 3.d e49/20 3:bed94f4a:::benchmark_data_smithi036_14212_object4220:head v 49'1880, mlcod=49'1874)", 2020-11-12T17:23:56.366 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:23:56.366 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.2452225540000001, 2020-11-12T17:23:56.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001, 2020-11-12T17:23:56.366 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.366 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.366 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:23:56.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:23:56.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:23:56.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914530+0000", 2020-11-12T17:23:56.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013119499999999999 2020-11-12T17:23:56.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914662+0000", 2020-11-12T17:23:56.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26915680600000003 2020-11-12T17:23:56.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183818+0000", 2020-11-12T17:23:56.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.61e-06 2020-11-12T17:23:56.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183826+0000", 2020-11-12T17:23:56.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2031999999999999e-05 2020-11-12T17:23:56.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183878+0000", 2020-11-12T17:23:56.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1192999999999998e-05 2020-11-12T17:23:56.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183909+0000", 2020-11-12T17:23:56.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055133250000000003 2020-11-12T17:23:56.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189422+0000", 2020-11-12T17:23:56.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4030999999999997e-05 2020-11-12T17:23:56.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189486+0000", 2020-11-12T17:23:56.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001 2020-11-12T17:23:56.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.373 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.374 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:34848 3.d e49/20 3:bcc6b687:::benchmark_data_smithi036_14212_object4355:head v 49'1936, mlcod=49'1931)", 2020-11-12T17:23:56.374 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:55.064313+0000", 2020-11-12T17:23:56.374 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.095479721, 2020-11-12T17:23:56.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.134768947, 2020-11-12T17:23:56.374 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:23:56.374 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:56.375 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:23:56.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:23:56.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.064313+0000", 2020-11-12T17:23:56.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:23:56.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:23:56.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.064313+0000", 2020-11-12T17:23:56.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:23:56.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:23:56.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.064290+0000", 2020-11-12T17:23:56.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9713000000000001e-05 2020-11-12T17:23:56.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:23:56.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.064370+0000", 2020-11-12T17:23:56.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12993665400000001 2020-11-12T17:23:56.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:23:56.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.194306+0000", 2020-11-12T17:23:56.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4989999999999997e-06 2020-11-12T17:23:56.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:23:56.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.194314+0000", 2020-11-12T17:23:56.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.19e-05 2020-11-12T17:23:56.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:23:56.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.194376+0000", 2020-11-12T17:23:56.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3696999999999999e-05 2020-11-12T17:23:56.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:23:56.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.194410+0000", 2020-11-12T17:23:56.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045424669999999997 2020-11-12T17:23:56.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:23:56.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.198952+0000", 2020-11-12T17:23:56.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013040799999999999 2020-11-12T17:23:56.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:23:56.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:23:56.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:23:56.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:55.199082+0000", 2020-11-12T17:23:56.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.134768947 2020-11-12T17:23:56.383 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.383 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.383 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.383 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:23:56.383 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:23:56.383 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:23:56.384 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:56.156+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:56.385 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:23:56.386 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:56.382+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:56.386 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:56.386 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:56.386 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:56.387 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:56.423 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:56.454 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:56.485 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:56.486 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:56.482+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:56.515 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:56.518 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:23:56.518 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:23:56.518 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:23:56.518 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:23:56.518 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:23:56.519 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:23:56.519 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:23:56.519 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:23:56.547 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:56.548 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:56.560 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:23:56.570 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 52 15 36413 36398 5.46789 8.08594 0.0120065 0.0228474 2020-11-12T17:23:56.587 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:56.580+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:56.688 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:56.680+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:56.728 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:56.729 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:56.738 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:23:56.790 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:56.786+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:56.862 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:56.862 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:56.875 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:23:56.891 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:56.884+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:56.992 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:56.984+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:57.042 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:57.070 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:57.072 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:23:57.121 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:57.118+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:57.193 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:57.193 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:57.194 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:57.190+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:57.204 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:23:57.294 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:57.290+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:57.471 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:57.472 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:57.472 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:57.464+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:57.473 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:23:57.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 53 16 37346 37330 5.50209 7.28125 0.0068123 0.0226975 2020-11-12T17:23:57.572 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:57.566+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:23:57.602 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:57.602 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:57.613 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:23:57.627 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:23:57.701 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:57.696+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:57.731 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:57.732 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:57.743 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:23:57.774 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:57.770+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:57.875 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:57.870+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:57.899 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:57.899 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:57.913 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:23:57.977 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:57.970+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:58.041 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:58.042 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:58.053 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:23:58.097 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:23:58.092+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:23:58.171 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:58.172 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:58.177 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:58.172+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:58.182 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:23:58.278 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:58.274+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:58.345 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:58.346 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:58.356 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:23:58.379 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:58.374+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:58.413 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:23:58.406+0000 7f7b4fea9700 -1 osd.4 50 handle_osd_map injecting map crc failure 2020-11-12T17:23:58.418 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:23:58.477 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:58.478 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:58.480 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:58.472+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:58.488 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:23:58.534 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:23:58.571 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 54 16 38218 38202 5.52635 6.8125 0.0395619 0.0225761 2020-11-12T17:23:58.617 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:58.612+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:58.637 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:23:58.637 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:23:58.647 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:23:58.689 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:23:58.684+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:23:58.734 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:23:58.784 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:23:58.785 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:23:58.782+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:23:58.786 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:23:58.794 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:58.794 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:58.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:58.794 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:58.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.795 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:23:58.795 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:58.795 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.131044404999997, 2020-11-12T17:23:58.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:23:58.795 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.795 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.796 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:58.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:23:58.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:58.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:23:58.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:23:58.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:23:58.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:23:58.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:23:58.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:23:58.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:23:58.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:23:58.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:23:58.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:23:58.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:23:58.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:23:58.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:23:58.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:23:58.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:23:58.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:23:58.802 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.803 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.803 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.803 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:23:58.803 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:58.803 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.130137609999998, 2020-11-12T17:23:58.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:23:58.804 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.804 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.804 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:58.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:23:58.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:58.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:23:58.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:23:58.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:23:58.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:23:58.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:23:58.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:23:58.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:23:58.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:23:58.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:23:58.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:23:58.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:23:58.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:23:58.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:23:58.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:23:58.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:23:58.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:23:58.810 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.811 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.811 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.811 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:23:58.811 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:58.811 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.129435387000001, 2020-11-12T17:23:58.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:23:58.812 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.812 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.812 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:58.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:23:58.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:23:58.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:23:58.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:23:58.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:23:58.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:23:58.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:23:58.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:23:58.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:23:58.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:23:58.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:23:58.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:23:58.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:23:58.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:23:58.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:23:58.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:23:58.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:23:58.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:23:58.819 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.819 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.819 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.819 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:23:58.819 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:58.819 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.124929191, 2020-11-12T17:23:58.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:23:58.820 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.820 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.820 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:58.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:23:58.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:58.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:23:58.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:23:58.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:23:58.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:23:58.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:23:58.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:23:58.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:23:58.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:23:58.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:23:58.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:23:58.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:23:58.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:23:58.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:23:58.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:23:58.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:23:58.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:23:58.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.827 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.827 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:23:58.827 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:58.828 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 52.621388209999999, 2020-11-12T17:23:58.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:23:58.828 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.828 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.828 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:58.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:23:58.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:23:58.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:23:58.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:23:58.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:23:58.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:23:58.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:23:58.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:23:58.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:23:58.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:23:58.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:23:58.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:23:58.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:23:58.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:23:58.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:23:58.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:23:58.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:23:58.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:23:58.835 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.835 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.835 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.835 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:23:58.835 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:58.836 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 52.620461968999997, 2020-11-12T17:23:58.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:23:58.836 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.836 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.836 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:58.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:23:58.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:23:58.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:23:58.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:23:58.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:23:58.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:23:58.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:23:58.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:23:58.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:23:58.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:23:58.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:23:58.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:23:58.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:23:58.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:23:58.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:23:58.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:23:58.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:23:58.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:23:58.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.843 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.843 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:23:58.843 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:58.844 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 52.618114458999997, 2020-11-12T17:23:58.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:23:58.844 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.844 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.844 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:58.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:23:58.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:23:58.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:23:58.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:23:58.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:23:58.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:23:58.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:23:58.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:23:58.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:23:58.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:23:58.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:23:58.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:23:58.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:23:58.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:23:58.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:23:58.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:23:58.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:23:58.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:23:58.851 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.851 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.851 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.851 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:23:58.852 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:58.852 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 52.617349666999999, 2020-11-12T17:23:58.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:23:58.852 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.852 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.852 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:58.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:23:58.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:23:58.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:23:58.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:23:58.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:23:58.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:23:58.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:23:58.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:23:58.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:23:58.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:23:58.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:23:58.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:23:58.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:23:58.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:23:58.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:23:58.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:23:58.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:23:58.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:23:58.859 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.859 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.859 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.860 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:23:58.860 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:58.860 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 52.535123188999997, 2020-11-12T17:23:58.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:23:58.860 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.861 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.861 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:58.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:23:58.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:23:58.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:23:58.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:23:58.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:23:58.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:23:58.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:23:58.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:23:58.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:23:58.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:23:58.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:23:58.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:23:58.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:23:58.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:23:58.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:23:58.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:23:58.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:23:58.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:23:58.867 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.867 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.868 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:23:58.868 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:58.868 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.943009756000002, 2020-11-12T17:23:58.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:23:58.869 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.869 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.869 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:58.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:23:58.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:23:58.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:23:58.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:23:58.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:23:58.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:23:58.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:23:58.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:23:58.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:23:58.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:23:58.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:23:58.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:23:58.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:23:58.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:23:58.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:23:58.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:23:58.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:23:58.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:23:58.875 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.876 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.876 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:23:58.876 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:58.876 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 48.914349459, 2020-11-12T17:23:58.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:23:58.877 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.877 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.877 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:58.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:23:58.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:58.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:23:58.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:23:58.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:23:58.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:23:58.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:23:58.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:23:58.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:23:58.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:23:58.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:23:58.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:23:58.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:23:58.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:23:58.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:23:58.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:23:58.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:23:58.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:23:58.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.884 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.884 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.884 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:23:58.884 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:58.884 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.001752748000001, 2020-11-12T17:23:58.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:23:58.885 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.885 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.885 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:58.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:23:58.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:23:58.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:23:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:23:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:23:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:23:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:23:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:23:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:23:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:23:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:23:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:23:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:23:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:23:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:23:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:23:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:23:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:23:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:23:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.930613104000003, 2020-11-12T17:23:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:23:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:23:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:23:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:23:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:23:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:23:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:23:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:23:58.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:23:58.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:23:58.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:23:58.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:23:58.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:23:58.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:23:58.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:23:58.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:23:58.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:23:58.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:23:58.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:23:58.900 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.900 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.900 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.901 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:23:58.901 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:58.901 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.821225812999998, 2020-11-12T17:23:58.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:23:58.901 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.901 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.901 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:58.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:23:58.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:58.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:23:58.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:23:58.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:23:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:23:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:23:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:23:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:23:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:23:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:23:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:23:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:23:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:23:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:23:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:23:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:23:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:23:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:23:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.750689973999997, 2020-11-12T17:23:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:23:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:58.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:23:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:23:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:23:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:23:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:23:58.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:23:58.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:23:58.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:23:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:23:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:23:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:23:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:23:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:23:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:23:58.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:23:58.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:23:58.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:23:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:23:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:23:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.581324035999998, 2020-11-12T17:23:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:23:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:23:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:23:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:23:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:23:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:23:58.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:23:58.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:23:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:23:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:23:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:23:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:23:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:23:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:23:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:23:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:23:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:23:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:23:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:23:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:23:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.252698164000002, 2020-11-12T17:23:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:23:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:23:58.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:23:58.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:23:58.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:23:58.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:23:58.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:23:58.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:23:58.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:23:58.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:23:58.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:23:58.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:23:58.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:23:58.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:23:58.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:23:58.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:23:58.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:23:58.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:23:58.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:23:58.932 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.932 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.932 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.933 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:23:58.933 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:58.933 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.596234801999998, 2020-11-12T17:23:58.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:23:58.933 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.933 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.933 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:58.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:23:58.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:58.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:23:58.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:23:58.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:23:58.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:23:58.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:23:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:23:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:23:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:23:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:23:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:23:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:23:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:23:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:23:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:23:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:23:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:23:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:23:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.593594078999999, 2020-11-12T17:23:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:23:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:23:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:23:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:23:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:23:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:23:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:23:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:23:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:23:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:23:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:23:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:23:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:23:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:23:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:23:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:23:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:23:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:23:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:23:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:23:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.10934804, 2020-11-12T17:23:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:23:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:23:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:23:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:23:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:23:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:23:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:23:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:23:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:23:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:23:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:23:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:58.957 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:58.958 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:23:58.959 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:23:58.959 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:23:58.959 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:23:58.959 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:23:58.959 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:23:58.959 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:23:58.960 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:23:58.960 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:23:58.960 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:23:58.960 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:23:58.960 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:23:58.960 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:23:58.960 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:58.954+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:58.961 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:23:59.059 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:59.052+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:59.153 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:59.153 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:59.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.153 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:38636 3.c e51/20 3:3d6c4224:::benchmark_data_smithi036_14212_object4829:head v 51'2756, mlcod=51'2751)", 2020-11-12T17:23:59.153 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:59.149360+0000", 2020-11-12T17:23:59.154 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00155966, 2020-11-12T17:23:59.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001587841, 2020-11-12T17:23:59.154 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.154 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:59.154 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.149360+0000", 2020-11-12T17:23:59.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.149360+0000", 2020-11-12T17:23:59.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:23:59.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.149329+0000", 2020-11-12T17:23:59.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0097000000000002e-05 2020-11-12T17:23:59.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.149409+0000", 2020-11-12T17:23:59.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3635999999999998e-05 2020-11-12T17:23:59.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.149483+0000", 2020-11-12T17:23:59.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8169999999999999e-06 2020-11-12T17:23:59.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.149491+0000", 2020-11-12T17:23:59.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4051000000000001e-05 2020-11-12T17:23:59.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.149545+0000", 2020-11-12T17:23:59.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6568999999999999e-05 2020-11-12T17:23:59.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.149571+0000", 2020-11-12T17:23:59.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000210862 2020-11-12T17:23:59.160 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.160 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.160 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.161 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:38637 3.c e51/20 3:3d6c4224:::benchmark_data_smithi036_14212_object4829:head v 51'2757, mlcod=51'2751)", 2020-11-12T17:23:59.161 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:59.150643+0000", 2020-11-12T17:23:59.161 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00027709000000000002, 2020-11-12T17:23:59.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00039281899999999998, 2020-11-12T17:23:59.161 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.161 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:59.162 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.150643+0000", 2020-11-12T17:23:59.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.150643+0000", 2020-11-12T17:23:59.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:23:59.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.150608+0000", 2020-11-12T17:23:59.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000131645 2020-11-12T17:23:59.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.150740+0000", 2020-11-12T17:23:59.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108501 2020-11-12T17:23:59.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.150848+0000", 2020-11-12T17:23:59.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5129999999999999e-06 2020-11-12T17:23:59.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.150856+0000", 2020-11-12T17:23:59.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1294999999999997e-05 2020-11-12T17:23:59.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.150897+0000", 2020-11-12T17:23:59.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0522000000000001e-05 2020-11-12T17:23:59.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:59.150918+0000", 2020-11-12T17:23:59.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000274951 2020-11-12T17:23:59.169 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.169 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.169 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.169 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.169 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:23:59.169 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 2 2020-11-12T17:23:59.170 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:59.171 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:59.166+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:59.172 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:23:59.272 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:59.264+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:23:59.352 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:23:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:23:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:23:59.353 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:59.369 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:23:59.374 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:23:59.370+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:23:59.476 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:23:59.470+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:23:59.538 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:23:59.538 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:23:59.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:23:59.539 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:23:59.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.539 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:5672 3.7 3:e4132891:::benchmark_data_smithi036_14212_object708:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:23:59.540 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:59.540 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.089499535000002, 2020-11-12T17:23:59.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906, 2020-11-12T17:23:59.540 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.540 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.541 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.541 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.541 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.541 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 5672 2020-11-12T17:23:59.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.542 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:59.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443355+0000", 2020-11-12T17:23:59.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:23:59.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443325+0000", 2020-11-12T17:23:59.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3981999999999996e-05 2020-11-12T17:23:59.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443419+0000", 2020-11-12T17:23:59.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8057e-05 2020-11-12T17:23:59.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443437+0000", 2020-11-12T17:23:59.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3709999999999996e-06 2020-11-12T17:23:59.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.443444+0000", 2020-11-12T17:23:59.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019104530000000001 2020-11-12T17:23:59.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445354+0000", 2020-11-12T17:23:59.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2356999999999999e-05 2020-11-12T17:23:59.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445426+0000", 2020-11-12T17:23:59.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111113 2020-11-12T17:23:59.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:59.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.445538+0000", 2020-11-12T17:23:59.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00086618700000000003 2020-11-12T17:23:59.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.446404+0000", 2020-11-12T17:23:59.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.205445288 2020-11-12T17:23:59.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651849+0000", 2020-11-12T17:23:59.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2787000000000005e-05 2020-11-12T17:23:59.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651942+0000", 2020-11-12T17:23:59.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2173000000000003e-05 2020-11-12T17:23:59.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652004+0000", 2020-11-12T17:23:59.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20864906 2020-11-12T17:23:59.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.556 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.557 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:5672 3.7 e25/20 ondisk, result = 0)", 2020-11-12T17:23:59.557 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:59.557 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.080716141000003, 2020-11-12T17:23:59.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162, 2020-11-12T17:23:59.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.558 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:59.558 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:59.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452138+0000", 2020-11-12T17:23:59.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:23:59.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452124+0000", 2020-11-12T17:23:59.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6100000000000003e-05 2020-11-12T17:23:59.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.452160+0000", 2020-11-12T17:23:59.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199026693 2020-11-12T17:23:59.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651186+0000", 2020-11-12T17:23:59.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0820000000000001e-06 2020-11-12T17:23:59.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651194+0000", 2020-11-12T17:23:59.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00062788999999999998 2020-11-12T17:23:59.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651821+0000", 2020-11-12T17:23:59.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4558e-05 2020-11-12T17:23:59.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.651836+0000", 2020-11-12T17:23:59.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018151300000000001 2020-11-12T17:23:59.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:10.652017+0000", 2020-11-12T17:23:59.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199879162 2020-11-12T17:23:59.568 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.569 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.569 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.570 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:23:59.570 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:59.570 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.114366177000001, 2020-11-12T17:23:59.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:23:59.571 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.571 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.571 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.571 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.572 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:23:59.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.572 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:59.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:23:59.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:23:59.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:23:59.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:23:59.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:23:59.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:23:59.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:23:59.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:23:59.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:23:59.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:23:59.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:23:59.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:23:59.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:23:59.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:23:59.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:59.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:23:59.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:23:59.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:23:59.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:23:59.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:23:59.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:23:59.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:23:59.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:23:59.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:23:59.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:23:59.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.585 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.586 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:23:59.586 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:59.586 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.107422114999999, 2020-11-12T17:23:59.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:23:59.587 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.587 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:59.587 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:59.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:23:59.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:59.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:23:59.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:23:59.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:23:59.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:23:59.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:23:59.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:23:59.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:23:59.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:23:59.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:23:59.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:23:59.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:23:59.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:23:59.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:23:59.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:23:59.598 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.598 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.598 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.599 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19272 3.2 3:4d54f796:::benchmark_data_smithi036_14212_object2408:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:23:59.599 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:59.599 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.484255745999999, 2020-11-12T17:23:59.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899, 2020-11-12T17:23:59.599 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.600 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.600 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.600 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.600 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.601 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19272 2020-11-12T17:23:59.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.601 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:59.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048599+0000", 2020-11-12T17:23:59.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:23:59.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048566+0000", 2020-11-12T17:23:59.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108874 2020-11-12T17:23:59.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048675+0000", 2020-11-12T17:23:59.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3494e-05 2020-11-12T17:23:59.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048688+0000", 2020-11-12T17:23:59.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8549999999999996e-06 2020-11-12T17:23:59.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.048695+0000", 2020-11-12T17:23:59.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010513026 2020-11-12T17:23:59.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059208+0000", 2020-11-12T17:23:59.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107161 2020-11-12T17:23:59.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059315+0000", 2020-11-12T17:23:59.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019627499999999999 2020-11-12T17:23:59.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:23:59.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.059511+0000", 2020-11-12T17:23:59.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014392770000000001 2020-11-12T17:23:59.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.060951+0000", 2020-11-12T17:23:59.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18718517000000001 2020-11-12T17:23:59.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248136+0000", 2020-11-12T17:23:59.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099000000000003e-05 2020-11-12T17:23:59.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248198+0000", 2020-11-12T17:23:59.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7726999999999998e-05 2020-11-12T17:23:59.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.248256+0000", 2020-11-12T17:23:59.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199656899 2020-11-12T17:23:59.614 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.614 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.615 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.615 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:24712 3.7 3:ef6ddd74:::benchmark_data_smithi036_14212_object3088:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:59.615 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:44.648094+0000", 2020-11-12T17:23:59.615 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.884760269999999, 2020-11-12T17:23:59.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.207900908, 2020-11-12T17:23:59.616 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.616 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.616 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.616 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.617 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.617 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 24712 2020-11-12T17:23:59.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.617 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648094+0000", 2020-11-12T17:23:59.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648094+0000", 2020-11-12T17:23:59.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:59.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648062+0000", 2020-11-12T17:23:59.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3991000000000002e-05 2020-11-12T17:23:59.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648156+0000", 2020-11-12T17:23:59.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2483999999999999e-05 2020-11-12T17:23:59.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648169+0000", 2020-11-12T17:23:59.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0269999999999998e-06 2020-11-12T17:23:59.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.648176+0000", 2020-11-12T17:23:59.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042901199999999997 2020-11-12T17:23:59.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.652466+0000", 2020-11-12T17:23:59.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9704000000000003e-05 2020-11-12T17:23:59.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.652526+0000", 2020-11-12T17:23:59.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116524 2020-11-12T17:23:59.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:59.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.652642+0000", 2020-11-12T17:23:59.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003019538 2020-11-12T17:23:59.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.655662+0000", 2020-11-12T17:23:59.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20023754399999999 2020-11-12T17:23:59.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.855899+0000", 2020-11-12T17:23:59.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2182999999999999e-05 2020-11-12T17:23:59.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.855941+0000", 2020-11-12T17:23:59.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3601999999999999e-05 2020-11-12T17:23:59.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.855995+0000", 2020-11-12T17:23:59.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.207900908 2020-11-12T17:23:59.630 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.630 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.630 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.631 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:24944 3.7 3:e947d4ca:::benchmark_data_smithi036_14212_object3117:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:23:59.631 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:44.871894+0000", 2020-11-12T17:23:59.631 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.660960846, 2020-11-12T17:23:59.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21402005599999999, 2020-11-12T17:23:59.632 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.632 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.632 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.633 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.633 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.633 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 24944 2020-11-12T17:23:59.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.634 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871894+0000", 2020-11-12T17:23:59.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871894+0000", 2020-11-12T17:23:59.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999495 2020-11-12T17:23:59.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871843+0000", 2020-11-12T17:23:59.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014137899999999999 2020-11-12T17:23:59.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.871985+0000", 2020-11-12T17:23:59.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9230000000000001e-05 2020-11-12T17:23:59.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.872004+0000", 2020-11-12T17:23:59.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0258000000000001e-05 2020-11-12T17:23:59.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.872014+0000", 2020-11-12T17:23:59.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020382600000000001 2020-11-12T17:23:59.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.874052+0000", 2020-11-12T17:23:59.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3418999999999995e-05 2020-11-12T17:23:59.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.874136+0000", 2020-11-12T17:23:59.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100831 2020-11-12T17:23:59.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:59.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.874237+0000", 2020-11-12T17:23:59.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019406270000000001 2020-11-12T17:23:59.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:44.876177+0000", 2020-11-12T17:23:59.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20960147300000001 2020-11-12T17:23:59.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.085779+0000", 2020-11-12T17:23:59.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3523000000000007e-05 2020-11-12T17:23:59.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.085862+0000", 2020-11-12T17:23:59.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1502999999999998e-05 2020-11-12T17:23:59.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.085914+0000", 2020-11-12T17:23:59.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21402005599999999 2020-11-12T17:23:59.647 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.648 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.648 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.648 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25280 3.b 3:d39b0d08:::benchmark_data_smithi036_14212_object3159:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:23:59.649 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:23:59.649 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.331374738999999, 2020-11-12T17:23:59.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224130581, 2020-11-12T17:23:59.649 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.649 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.650 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.650 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.650 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.650 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25280 2020-11-12T17:23:59.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.651 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:23:59.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:23:59.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999604 2020-11-12T17:23:59.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201440+0000", 2020-11-12T17:23:59.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011655 2020-11-12T17:23:59.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201557+0000", 2020-11-12T17:23:59.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7612999999999999e-05 2020-11-12T17:23:59.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201574+0000", 2020-11-12T17:23:59.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9449999999999993e-06 2020-11-12T17:23:59.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201582+0000", 2020-11-12T17:23:59.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000790633 2020-11-12T17:23:59.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202373+0000", 2020-11-12T17:23:59.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107295 2020-11-12T17:23:59.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202480+0000", 2020-11-12T17:23:59.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000168703 2020-11-12T17:23:59.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:59.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202649+0000", 2020-11-12T17:23:59.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050285470000000004 2020-11-12T17:23:59.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.207677+0000", 2020-11-12T17:23:59.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21784867699999999 2020-11-12T17:23:59.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425526+0000", 2020-11-12T17:23:59.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8837e-05 2020-11-12T17:23:59.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425575+0000", 2020-11-12T17:23:59.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5524000000000001e-05 2020-11-12T17:23:59.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425610+0000", 2020-11-12T17:23:59.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224130581 2020-11-12T17:23:59.664 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.664 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.664 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.665 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:23:59.665 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:23:59.665 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.076136398999999, 2020-11-12T17:23:59.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:23:59.665 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.665 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.666 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.666 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.749 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.749 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:23:59.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.750 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:23:59.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:23:59.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:23:59.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:23:59.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:23:59.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:23:59.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:23:59.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:23:59.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:23:59.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:23:59.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:23:59.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:23:59.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:23:59.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:23:59.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:23:59.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:59.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:23:59.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:23:59.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:23:59.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:23:59.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:23:59.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:23:59.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:23:59.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:23:59.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:23:59.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:23:59.767 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.767 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.767 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.767 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:23:59.768 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:23:59.768 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.9335843290000003, 2020-11-12T17:23:59.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:23:59.768 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.768 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.769 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:23:59.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.769 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:23:59.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:23:59.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:23:59.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:23:59.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:23:59.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:23:59.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:23:59.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:23:59.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:23:59.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:23:59.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:23:59.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:23:59.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:23:59.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:23:59.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:23:59.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:23:59.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:23:59.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:23:59.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:23:59.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:23:59.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:23:59.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:23:59.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:23:59.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:23:59.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:23:59.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:23:59.781 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.781 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.782 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.782 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e48)", 2020-11-12T17:23:59.782 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:23:59.783 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.8567945310000002, 2020-11-12T17:23:59.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998, 2020-11-12T17:23:59.783 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.783 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:23:59.783 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.783 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.784 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.784 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:23:59.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.784 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:23:59.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:23:59.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:23:59.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676007+0000", 2020-11-12T17:23:59.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110902 2020-11-12T17:23:59.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676118+0000", 2020-11-12T17:23:59.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6195e-05 2020-11-12T17:23:59.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676135+0000", 2020-11-12T17:23:59.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3829999999999998e-06 2020-11-12T17:23:59.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676144+0000", 2020-11-12T17:23:59.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5806000000000001e-05 2020-11-12T17:23:59.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676200+0000", 2020-11-12T17:23:59.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9735999999999999e-05 2020-11-12T17:23:59.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:23:59.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676259+0000", 2020-11-12T17:23:59.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29976251100000001 2020-11-12T17:23:59.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976022+0000", 2020-11-12T17:23:59.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998 2020-11-12T17:23:59.790 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.790 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.790 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.791 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:33576 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:23:59.791 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:23:59.791 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.9249398830000004, 2020-11-12T17:23:59.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846, 2020-11-12T17:23:59.791 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.791 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:59.791 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:23:59.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:23:59.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:23:59.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607883+0000", 2020-11-12T17:23:59.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0716000000000004e-05 2020-11-12T17:23:59.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607964+0000", 2020-11-12T17:23:59.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28021348200000001 2020-11-12T17:23:59.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888177+0000", 2020-11-12T17:23:59.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0214000000000001e-05 2020-11-12T17:23:59.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888188+0000", 2020-11-12T17:23:59.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0760999999999994e-05 2020-11-12T17:23:59.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888278+0000", 2020-11-12T17:23:59.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0537e-05 2020-11-12T17:23:59.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888299+0000", 2020-11-12T17:23:59.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020659300000000001 2020-11-12T17:23:59.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888505+0000", 2020-11-12T17:23:59.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846 2020-11-12T17:23:59.797 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.797 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.798 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.798 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34328 3.8 3:12eb1396:::benchmark_data_smithi036_14212_object4290:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:23:59.798 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:23:59.798 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.9763949319999998, 2020-11-12T17:23:59.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999, 2020-11-12T17:23:59.798 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.799 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.799 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.799 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.799 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.799 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34328 2020-11-12T17:23:59.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.799 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:23:59.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:23:59.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999542 2020-11-12T17:23:59.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556414+0000", 2020-11-12T17:23:59.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133592 2020-11-12T17:23:59.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556547+0000", 2020-11-12T17:23:59.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8813000000000001e-05 2020-11-12T17:23:59.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556566+0000", 2020-11-12T17:23:59.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7660000000000004e-06 2020-11-12T17:23:59.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556575+0000", 2020-11-12T17:23:59.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011688914999999999 2020-11-12T17:23:59.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568264+0000", 2020-11-12T17:23:59.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108214 2020-11-12T17:23:59.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568372+0000", 2020-11-12T17:23:59.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189846 2020-11-12T17:23:59.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:59.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568562+0000", 2020-11-12T17:23:59.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016740710000000001 2020-11-12T17:23:59.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570236+0000", 2020-11-12T17:23:59.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29321335900000001 2020-11-12T17:23:59.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863449+0000", 2020-11-12T17:23:59.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7244999999999998e-05 2020-11-12T17:23:59.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863507+0000", 2020-11-12T17:23:59.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0704999999999994e-05 2020-11-12T17:23:59.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863587+0000", 2020-11-12T17:23:59.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999 2020-11-12T17:23:59.808 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.808 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.808 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.809 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34328 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:23:59.809 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:23:59.809 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.962038283, 2020-11-12T17:23:59.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998, 2020-11-12T17:23:59.809 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.809 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:59.809 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:23:59.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:23:59.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:23:59.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570784+0000", 2020-11-12T17:23:59.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2226999999999997e-05 2020-11-12T17:23:59.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570866+0000", 2020-11-12T17:23:59.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.290361445 2020-11-12T17:23:59.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861228+0000", 2020-11-12T17:23:59.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0240000000000003e-06 2020-11-12T17:23:59.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861237+0000", 2020-11-12T17:23:59.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021956749999999998 2020-11-12T17:23:59.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863432+0000", 2020-11-12T17:23:59.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2940000000000006e-06 2020-11-12T17:23:59.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863441+0000", 2020-11-12T17:23:59.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162399 2020-11-12T17:23:59.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863603+0000", 2020-11-12T17:23:59.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998 2020-11-12T17:23:59.815 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.815 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.816 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34664 3.8 3:12959a72:::benchmark_data_smithi036_14212_object4332:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:23:59.816 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.860740+0000", 2020-11-12T17:23:59.816 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.6721139579999997, 2020-11-12T17:23:59.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21315567899999999, 2020-11-12T17:23:59.817 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.817 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.817 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34664 2020-11-12T17:23:59.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.817 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.860740+0000", 2020-11-12T17:23:59.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.860740+0000", 2020-11-12T17:23:59.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:23:59.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.860718+0000", 2020-11-12T17:23:59.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1153e-05 2020-11-12T17:23:59.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.860799+0000", 2020-11-12T17:23:59.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7459e-05 2020-11-12T17:23:59.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.860817+0000", 2020-11-12T17:23:59.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3179999999999996e-06 2020-11-12T17:23:59.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.860826+0000", 2020-11-12T17:23:59.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081291809999999992 2020-11-12T17:23:59.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.868955+0000", 2020-11-12T17:23:59.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6751999999999998e-05 2020-11-12T17:23:59.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.869052+0000", 2020-11-12T17:23:59.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016607699999999999 2020-11-12T17:23:59.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:59.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.869218+0000", 2020-11-12T17:23:59.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055944790000000003 2020-11-12T17:23:59.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.874813+0000", 2020-11-12T17:23:59.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19891689000000001 2020-11-12T17:23:59.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.073730+0000", 2020-11-12T17:23:59.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4531999999999998e-05 2020-11-12T17:23:59.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.073794+0000", 2020-11-12T17:23:59.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102068 2020-11-12T17:23:59.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.073896+0000", 2020-11-12T17:23:59.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21315567899999999 2020-11-12T17:23:59.828 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.828 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.829 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.829 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:23:59.829 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:23:59.829 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.4620504199999997, 2020-11-12T17:23:59.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:23:59.829 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.837 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.837 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.837 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.837 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.838 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:23:59.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.838 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:23:59.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:23:59.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:23:59.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:23:59.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:23:59.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:23:59.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:23:59.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:23:59.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:23:59.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:23:59.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:23:59.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:23:59.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:23:59.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:23:59.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:23:59.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:59.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:23:59.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:23:59.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:23:59.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:23:59.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:23:59.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:23:59.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:23:59.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:23:59.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:23:59.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:23:59.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.854 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.854 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:23:59.854 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:23:59.854 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.4467291979999999, 2020-11-12T17:23:59.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:23:59.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.855 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:59.855 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:23:59.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:23:59.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:23:59.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:23:59.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:23:59.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:23:59.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:23:59.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:23:59.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:23:59.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:23:59.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:23:59.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:23:59.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:23:59.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:23:59.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:23:59.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:23:59.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:23:59.863 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.863 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.863 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.863 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:35560 3.8 3:1a61aca4:::benchmark_data_smithi036_14212_object4444:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e50)", 2020-11-12T17:23:59.863 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.732096+0000", 2020-11-12T17:23:59.864 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.8007586359999999, 2020-11-12T17:23:59.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25173599400000002, 2020-11-12T17:23:59.864 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.864 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.865 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35560 2020-11-12T17:23:59.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.865 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732096+0000", 2020-11-12T17:23:59.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732096+0000", 2020-11-12T17:23:59.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:23:59.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732052+0000", 2020-11-12T17:23:59.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000164792 2020-11-12T17:23:59.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732217+0000", 2020-11-12T17:23:59.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7034999999999999e-05 2020-11-12T17:23:59.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732234+0000", 2020-11-12T17:23:59.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2500000000000001e-05 2020-11-12T17:23:59.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732247+0000", 2020-11-12T17:23:59.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046061080000000003 2020-11-12T17:23:59.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.736853+0000", 2020-11-12T17:23:59.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012839000000000001 2020-11-12T17:23:59.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.736981+0000", 2020-11-12T17:23:59.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000227438 2020-11-12T17:23:59.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:23:59.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.737209+0000", 2020-11-12T17:23:59.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048624660000000002 2020-11-12T17:23:59.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.742071+0000", 2020-11-12T17:23:59.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24159429499999999 2020-11-12T17:23:59.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983665+0000", 2020-11-12T17:23:59.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101854 2020-11-12T17:23:59.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983767+0000", 2020-11-12T17:23:59.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4479000000000004e-05 2020-11-12T17:23:59.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983832+0000", 2020-11-12T17:23:59.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25173599400000002 2020-11-12T17:23:59.877 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.877 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.877 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.877 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:35560 3.8 e50/20 ondisk, result = 0)", 2020-11-12T17:23:59.878 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.740928+0000", 2020-11-12T17:23:59.878 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.7919267639999998, 2020-11-12T17:23:59.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.242910614, 2020-11-12T17:23:59.879 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.879 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:23:59.879 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.740928+0000", 2020-11-12T17:23:59.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.740928+0000", 2020-11-12T17:23:59.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:23:59.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.740903+0000", 2020-11-12T17:23:59.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5679000000000006e-05 2020-11-12T17:23:59.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.740968+0000", 2020-11-12T17:23:59.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24258650000000001 2020-11-12T17:23:59.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983555+0000", 2020-11-12T17:23:59.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4940000000000003e-06 2020-11-12T17:23:59.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983563+0000", 2020-11-12T17:23:59.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7237999999999995e-05 2020-11-12T17:23:59.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983640+0000", 2020-11-12T17:23:59.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3028e-05 2020-11-12T17:23:59.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983653+0000", 2020-11-12T17:23:59.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000184823 2020-11-12T17:23:59.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983838+0000", 2020-11-12T17:23:59.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.242910614 2020-11-12T17:23:59.890 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.890 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.890 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.891 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:35864 3.7 3:e9044870:::benchmark_data_smithi036_14212_object4482:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e50)", 2020-11-12T17:23:59.891 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:56.002818+0000", 2020-11-12T17:23:59.891 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.5300363739999998, 2020-11-12T17:23:59.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21651171599999999, 2020-11-12T17:23:59.891 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:23:59.891 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:23:59.891 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:23:59.892 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:23:59.892 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:23:59.892 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35864 2020-11-12T17:23:59.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.892 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:23:59.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:23:59.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.002818+0000", 2020-11-12T17:23:59.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:23:59.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:23:59.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.002818+0000", 2020-11-12T17:23:59.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999456 2020-11-12T17:23:59.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:23:59.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.002764+0000", 2020-11-12T17:23:59.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013903799999999999 2020-11-12T17:23:59.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:23:59.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.002903+0000", 2020-11-12T17:23:59.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1590000000000002e-05 2020-11-12T17:23:59.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:23:59.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.002924+0000", 2020-11-12T17:23:59.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3139999999999998e-06 2020-11-12T17:23:59.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:23:59.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.002932+0000", 2020-11-12T17:23:59.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029717279999999999 2020-11-12T17:23:59.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:23:59.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.005903+0000", 2020-11-12T17:23:59.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017960400000000001 2020-11-12T17:23:59.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:23:59.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.006083+0000", 2020-11-12T17:23:59.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00029755599999999998 2020-11-12T17:23:59.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:23:59.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.006381+0000", 2020-11-12T17:23:59.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001786237 2020-11-12T17:23:59.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:23:59.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.008167+0000", 2020-11-12T17:23:59.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21107917700000001 2020-11-12T17:23:59.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:23:59.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.219246+0000", 2020-11-12T17:23:59.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3157e-05 2020-11-12T17:23:59.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:23:59.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.219289+0000", 2020-11-12T17:23:59.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0565999999999998e-05 2020-11-12T17:23:59.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:23:59.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:23:59.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:23:59.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:56.219330+0000", 2020-11-12T17:23:59.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21651171599999999 2020-11-12T17:23:59.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.929 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:23:59.929 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:23:59.929 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:23:59.931 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:23:59.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 55 16 39076 39060 5.54773 6.70312 0.010893 0.0225175 2020-11-12T17:23:59.933 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:23:59.924+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:00.032 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:00.026+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:00.054 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:00.055 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:00.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.056 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39527 3.9 3:9fc5ce11:::benchmark_data_smithi036_14212_object4940:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:00.056 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.988245+0000", 2020-11-12T17:24:00.057 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.065060171, 2020-11-12T17:24:00.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.065083218999999998, 2020-11-12T17:24:00.058 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.058 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:00.058 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.059 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.060 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.060 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39527 2020-11-12T17:24:00.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.061 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988245+0000", 2020-11-12T17:24:00.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988245+0000", 2020-11-12T17:24:00.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:00.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988224+0000", 2020-11-12T17:24:00.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1870000000000001e-05 2020-11-12T17:24:00.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988296+0000", 2020-11-12T17:24:00.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4250000000000001e-05 2020-11-12T17:24:00.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988310+0000", 2020-11-12T17:24:00.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.973e-06 2020-11-12T17:24:00.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988317+0000", 2020-11-12T17:24:00.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0092359669999999994 2020-11-12T17:24:00.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.997553+0000", 2020-11-12T17:24:00.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017205399999999999 2020-11-12T17:24:00.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.997725+0000", 2020-11-12T17:24:00.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029574499999999998 2020-11-12T17:24:00.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:00.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.998021+0000", 2020-11-12T17:24:00.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041844100000000004 2020-11-12T17:24:00.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.002205+0000", 2020-11-12T17:24:00.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013960551999999999 2020-11-12T17:24:00.083 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.083 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.083 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.123 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39528 3.9 3:9fc5ce11:::benchmark_data_smithi036_14212_object4940:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:00.123 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.988459+0000", 2020-11-12T17:24:00.124 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.064845475, 2020-11-12T17:24:00.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.064928455999999996, 2020-11-12T17:24:00.125 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.126 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:00.126 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.126 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.127 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.128 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39528 2020-11-12T17:24:00.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.129 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988459+0000", 2020-11-12T17:24:00.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988459+0000", 2020-11-12T17:24:00.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:00.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988422+0000", 2020-11-12T17:24:00.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010812 2020-11-12T17:24:00.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988530+0000", 2020-11-12T17:24:00.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:24:00.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988544+0000", 2020-11-12T17:24:00.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1069999999999999e-06 2020-11-12T17:24:00.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.988551+0000", 2020-11-12T17:24:00.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011862615999999999 2020-11-12T17:24:00.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.000414+0000", 2020-11-12T17:24:00.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9240000000000005e-05 2020-11-12T17:24:00.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.000513+0000", 2020-11-12T17:24:00.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000190371 2020-11-12T17:24:00.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:00.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.000703+0000", 2020-11-12T17:24:00.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001816081 2020-11-12T17:24:00.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.002520+0000", 2020-11-12T17:24:00.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014060035 2020-11-12T17:24:00.142 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.142 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.143 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.143 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.143 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:24:00.144 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:24:00.145 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:00.148 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:00.150 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:00.144+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:00.250 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:00.244+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:00.310 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:00.311 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:00.311 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:00.311 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:00.311 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:00.324 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:00.373 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:00.370+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:00.430 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:24:00.442 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:00.443 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:00.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:00.444 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:00.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.444 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:24:00.444 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:00.445 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.677377722999999, 2020-11-12T17:24:00.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:24:00.445 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.445 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.446 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.446 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.446 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.446 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:24:00.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.447 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:00.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:00.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:24:00.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:24:00.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:24:00.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:24:00.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:24:00.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:24:00.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:24:00.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:24:00.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:24:00.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:24:00.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:24:00.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:24:00.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:24:00.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:00.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:24:00.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:24:00.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:24:00.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:24:00.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:24:00.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:24:00.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:24:00.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:24:00.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:24:00.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:24:00.463 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.463 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.463 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.464 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:24:00.464 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:00.464 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.670578872, 2020-11-12T17:24:00.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:24:00.464 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.465 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:00.465 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:00.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:00.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:00.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:24:00.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:24:00.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:24:00.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:24:00.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:24:00.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:24:00.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:24:00.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:24:00.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:24:00.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:24:00.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:24:00.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:24:00.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:24:00.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:24:00.474 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.474 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.474 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.474 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1104 3.9 3:9f55e211:::benchmark_data_smithi036_14212_object137:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:24:00.475 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:00.475 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.818784520999998, 2020-11-12T17:24:00.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001, 2020-11-12T17:24:00.475 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.475 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.476 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1104 2020-11-12T17:24:00.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.477 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:00.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:00.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:00.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617385+0000", 2020-11-12T17:24:00.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9141999999999994e-05 2020-11-12T17:24:00.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617484+0000", 2020-11-12T17:24:00.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2413e-05 2020-11-12T17:24:00.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617497+0000", 2020-11-12T17:24:00.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1659999999999999e-06 2020-11-12T17:24:00.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617503+0000", 2020-11-12T17:24:00.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032791000000000001 2020-11-12T17:24:00.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620782+0000", 2020-11-12T17:24:00.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102198 2020-11-12T17:24:00.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620884+0000", 2020-11-12T17:24:00.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114058 2020-11-12T17:24:00.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:00.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620998+0000", 2020-11-12T17:24:00.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018203270000000001 2020-11-12T17:24:00.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622818+0000", 2020-11-12T17:24:00.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.203924995 2020-11-12T17:24:00.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826743+0000", 2020-11-12T17:24:00.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012106 2020-11-12T17:24:00.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826865+0000", 2020-11-12T17:24:00.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014220699999999999 2020-11-12T17:24:00.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827007+0000", 2020-11-12T17:24:00.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001 2020-11-12T17:24:00.509 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.509 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.509 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.510 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1104 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:24:00.511 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:24:00.511 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.813855738999997, 2020-11-12T17:24:00.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999, 2020-11-12T17:24:00.511 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.511 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:00.511 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:24:00.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:24:00.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:24:00.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622338+0000", 2020-11-12T17:24:00.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5814e-05 2020-11-12T17:24:00.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622374+0000", 2020-11-12T17:24:00.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20244251299999999 2020-11-12T17:24:00.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824817+0000", 2020-11-12T17:24:00.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.117e-05 2020-11-12T17:24:00.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824828+0000", 2020-11-12T17:24:00.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001882332 2020-11-12T17:24:00.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826710+0000", 2020-11-12T17:24:00.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6818000000000001e-05 2020-11-12T17:24:00.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826727+0000", 2020-11-12T17:24:00.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031566199999999997 2020-11-12T17:24:00.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827043+0000", 2020-11-12T17:24:00.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999 2020-11-12T17:24:00.519 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.519 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.519 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.520 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:24:00.520 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:00.522 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.427320096000003, 2020-11-12T17:24:00.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:24:00.523 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.523 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.523 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.524 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.524 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.524 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:24:00.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.525 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:00.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:00.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:00.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:24:00.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:24:00.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:24:00.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:24:00.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:24:00.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:24:00.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:24:00.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:24:00.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:24:00.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:24:00.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:24:00.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:24:00.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:00.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:24:00.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:24:00.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:24:00.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:24:00.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:24:00.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:24:00.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:24:00.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:24:00.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:24:00.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:24:00.545 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.545 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.545 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.546 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:24:00.546 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:00.546 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.420104915000003, 2020-11-12T17:24:00.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:24:00.546 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.546 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:00.546 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:00.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:00.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:24:00.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:24:00.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:24:00.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:24:00.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:24:00.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:24:00.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:24:00.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:24:00.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:24:00.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:24:00.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:24:00.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:24:00.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:24:00.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:24:00.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:24:00.554 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.554 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.554 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.554 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:4896 3.3 3:c1830331:::benchmark_data_smithi036_14212_object611:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:00.554 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:24:00.555 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.620034992000001, 2020-11-12T17:24:00.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001, 2020-11-12T17:24:00.555 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.555 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.555 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.555 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.555 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.556 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 4896 2020-11-12T17:24:00.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.556 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:24:00.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816173+0000", 2020-11-12T17:24:00.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:24:00.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816142+0000", 2020-11-12T17:24:00.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7733999999999998e-05 2020-11-12T17:24:00.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816220+0000", 2020-11-12T17:24:00.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2221999999999999e-05 2020-11-12T17:24:00.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816232+0000", 2020-11-12T17:24:00.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4469999999999997e-06 2020-11-12T17:24:00.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.816237+0000", 2020-11-12T17:24:00.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012662909999999999 2020-11-12T17:24:00.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817504+0000", 2020-11-12T17:24:00.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167959 2020-11-12T17:24:00.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817672+0000", 2020-11-12T17:24:00.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025141300000000003 2020-11-12T17:24:00.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:00.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.817923+0000", 2020-11-12T17:24:00.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001128467 2020-11-12T17:24:00.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.819051+0000", 2020-11-12T17:24:00.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19242863199999999 2020-11-12T17:24:00.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011480+0000", 2020-11-12T17:24:00.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9741999999999996e-05 2020-11-12T17:24:00.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011560+0000", 2020-11-12T17:24:00.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4276e-05 2020-11-12T17:24:00.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.011614+0000", 2020-11-12T17:24:00.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19544125500000001 2020-11-12T17:24:00.566 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.567 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.567 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.567 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:00.568 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:00.568 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.749660024000001, 2020-11-12T17:24:00.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:24:00.568 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.569 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.569 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.569 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.569 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.569 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:24:00.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.569 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:00.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:00.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:00.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:24:00.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:24:00.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:24:00.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:24:00.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:24:00.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:24:00.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:24:00.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:24:00.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:24:00.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:24:00.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:24:00.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:24:00.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:00.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:24:00.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:24:00.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:24:00.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:24:00.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:24:00.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:24:00.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:24:00.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:24:00.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:24:00.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:24:00.578 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.578 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.579 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.579 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:00.579 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:00.579 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.749495121000002, 2020-11-12T17:24:00.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:24:00.580 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.580 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.580 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.580 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.580 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.580 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:24:00.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.581 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:00.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:00.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:00.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:24:00.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:24:00.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:24:00.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:24:00.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:24:00.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:24:00.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:24:00.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:24:00.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:24:00.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:24:00.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:24:00.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:24:00.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:00.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:24:00.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:24:00.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:24:00.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:24:00.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:24:00.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:24:00.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:24:00.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:24:00.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:24:00.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:24:00.591 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.592 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.592 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.592 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:24:00.592 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:00.592 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.745331886999999, 2020-11-12T17:24:00.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:24:00.593 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.593 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:00.593 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:00.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:00.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:24:00.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:24:00.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:24:00.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:24:00.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:24:00.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:24:00.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:24:00.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:24:00.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:24:00.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:24:00.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:24:00.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:24:00.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:24:00.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:24:00.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:24:00.600 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.600 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.600 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.601 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:24:00.601 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:00.601 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.744015052000002, 2020-11-12T17:24:00.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:24:00.601 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.601 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:00.601 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:00.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:00.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:00.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:24:00.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:24:00.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:24:00.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:24:00.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:24:00.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:24:00.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:24:00.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:24:00.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:24:00.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:24:00.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:24:00.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:24:00.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:24:00.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:24:00.609 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.609 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.609 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.610 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:24:00.610 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:00.610 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.88169542, 2020-11-12T17:24:00.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:24:00.610 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.610 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.610 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:00.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:00.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:24:00.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:24:00.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:24:00.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:24:00.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:24:00.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:24:00.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:24:00.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:24:00.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:24:00.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:24:00.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:24:00.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:24:00.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:24:00.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:24:00.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:24:00.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:24:00.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:24:00.617 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.617 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.617 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.618 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:24:00.618 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:00.618 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.553893451999997, 2020-11-12T17:24:00.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:24:00.618 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.618 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.618 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.619 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.619 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.619 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:24:00.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.619 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:00.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:00.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:24:00.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:24:00.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:24:00.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:24:00.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:24:00.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:24:00.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:24:00.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:24:00.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:24:00.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:24:00.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:24:00.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:24:00.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:24:00.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:00.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:24:00.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:24:00.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:24:00.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:24:00.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:24:00.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:24:00.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:24:00.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:24:00.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:24:00.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:24:00.628 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.628 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.628 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.629 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:24:00.629 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:00.629 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.546649743000003, 2020-11-12T17:24:00.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:24:00.629 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.630 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:00.630 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:00.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:00.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:00.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:24:00.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:24:00.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:24:00.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:24:00.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:24:00.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:24:00.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:24:00.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:24:00.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:24:00.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:24:00.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:24:00.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:24:00.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:24:00.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:24:00.636 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.636 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.636 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.636 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18078 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:24:00.636 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:24:00.637 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.550210098000001, 2020-11-12T17:24:00.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001, 2020-11-12T17:24:00.637 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.637 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.637 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.637 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.637 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.637 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18078 2020-11-12T17:24:00.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.638 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:24:00.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885998+0000", 2020-11-12T17:24:00.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999776 2020-11-12T17:24:00.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.885975+0000", 2020-11-12T17:24:00.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1489000000000006e-05 2020-11-12T17:24:00.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886047+0000", 2020-11-12T17:24:00.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7270000000000002e-06 2020-11-12T17:24:00.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886057+0000", 2020-11-12T17:24:00.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4660000000000001e-06 2020-11-12T17:24:00.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886061+0000", 2020-11-12T17:24:00.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001076579 2020-11-12T17:24:00.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887138+0000", 2020-11-12T17:24:00.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131815 2020-11-12T17:24:00.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887270+0000", 2020-11-12T17:24:00.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018425599999999999 2020-11-12T17:24:00.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:00.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.887454+0000", 2020-11-12T17:24:00.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048314439999999998 2020-11-12T17:24:00.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892285+0000", 2020-11-12T17:24:00.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18195460599999999 2020-11-12T17:24:00.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074240+0000", 2020-11-12T17:24:00.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000167078 2020-11-12T17:24:00.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074407+0000", 2020-11-12T17:24:00.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112014 2020-11-12T17:24:00.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074519+0000", 2020-11-12T17:24:00.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18852117800000001 2020-11-12T17:24:00.647 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.647 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.647 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.647 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18079 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:24:00.648 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:24:00.648 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.550100552, 2020-11-12T17:24:00.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999, 2020-11-12T17:24:00.648 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.648 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.648 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.648 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.648 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.649 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18079 2020-11-12T17:24:00.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.649 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:24:00.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886107+0000", 2020-11-12T17:24:00.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:00.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886083+0000", 2020-11-12T17:24:00.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1087999999999993e-05 2020-11-12T17:24:00.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886164+0000", 2020-11-12T17:24:00.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8720000000000008e-06 2020-11-12T17:24:00.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886173+0000", 2020-11-12T17:24:00.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2519999999999996e-06 2020-11-12T17:24:00.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886179+0000", 2020-11-12T17:24:00.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027277500000000001 2020-11-12T17:24:00.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.888907+0000", 2020-11-12T17:24:00.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019889199999999999 2020-11-12T17:24:00.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889106+0000", 2020-11-12T17:24:00.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028895700000000001 2020-11-12T17:24:00.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:00.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.889395+0000", 2020-11-12T17:24:00.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003372571 2020-11-12T17:24:00.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.892767+0000", 2020-11-12T17:24:00.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.181837265 2020-11-12T17:24:00.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074604+0000", 2020-11-12T17:24:00.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.135e-05 2020-11-12T17:24:00.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074666+0000", 2020-11-12T17:24:00.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7472999999999996e-05 2020-11-12T17:24:00.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074733+0000", 2020-11-12T17:24:00.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18862588299999999 2020-11-12T17:24:00.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.658 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.659 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:18080 3.3 3:c439c016:::benchmark_data_smithi036_14212_object2259:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:24:00.659 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:24:00.659 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.549599064999999, 2020-11-12T17:24:00.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999, 2020-11-12T17:24:00.659 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.659 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.660 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 18080 2020-11-12T17:24:00.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.660 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:24:00.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886609+0000", 2020-11-12T17:24:00.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:00.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886586+0000", 2020-11-12T17:24:00.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3144000000000002e-05 2020-11-12T17:24:00.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886669+0000", 2020-11-12T17:24:00.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6894000000000001e-05 2020-11-12T17:24:00.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886686+0000", 2020-11-12T17:24:00.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5079999999999999e-06 2020-11-12T17:24:00.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.886693+0000", 2020-11-12T17:24:00.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037501600000000002 2020-11-12T17:24:00.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890444+0000", 2020-11-12T17:24:00.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183449 2020-11-12T17:24:00.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890627+0000", 2020-11-12T17:24:00.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000305762 2020-11-12T17:24:00.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:00.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.890933+0000", 2020-11-12T17:24:00.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022402920000000001 2020-11-12T17:24:00.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:37.893173+0000", 2020-11-12T17:24:00.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18168999399999999 2020-11-12T17:24:00.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074863+0000", 2020-11-12T17:24:00.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012771700000000001 2020-11-12T17:24:00.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.074991+0000", 2020-11-12T17:24:00.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0248999999999999e-05 2020-11-12T17:24:00.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.075051+0000", 2020-11-12T17:24:00.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18844228299999999 2020-11-12T17:24:00.674 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.674 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.674 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.675 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:24:00.675 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:00.675 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.384302040000001, 2020-11-12T17:24:00.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:24:00.676 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.676 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.676 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.676 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.676 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.676 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:24:00.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.677 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:00.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:00.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:00.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:24:00.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:24:00.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:24:00.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:24:00.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:24:00.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:24:00.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:24:00.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:24:00.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:24:00.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:24:00.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:24:00.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:24:00.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:00.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:24:00.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:24:00.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:24:00.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:24:00.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:24:00.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:24:00.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:24:00.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:24:00.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:24:00.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:24:00.707 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.707 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.708 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.708 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:00.708 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:00.709 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.4434742829999996, 2020-11-12T17:24:00.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:24:00.709 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.709 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:00.710 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:00.710 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:00.710 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:00.710 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:24:00.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.711 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:00.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:24:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:24:00.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:24:00.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:24:00.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:24:00.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:24:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:24:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:24:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:24:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:24:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:24:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:24:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:24:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:24:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:24:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:24:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:24:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:24:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:24:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:24:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:24:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:24:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:24:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:24:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.435815474, 2020-11-12T17:24:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:24:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:24:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:24:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:24:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:24:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:24:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:24:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:24:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:24:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:24:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:24:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:24:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:24:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:24:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:24:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:24:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:00.728 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:00.729 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 56 16 39983 39967 5.57519 7.08594 0.00948926 0.0224007 2020-11-12T17:24:00.729 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:00.730 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:00.724+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:00.830 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:00.824+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:00.907 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:00.907 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:00.907 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:24:00.907 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:00.916 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:00.966 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:00.962+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:00.970 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:24:01.038 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:01.034+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:01.042 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:01.044 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:01.069 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:01.138 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:01.132+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:01.142 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:01.169 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:24:01.202 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:01.234 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:01.240 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:01.232+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:01.241 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:24:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.735196694000003, 2020-11-12T17:24:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:24:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:24:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:24:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:24:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:24:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:24:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:24:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:24:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:24:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:24:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:24:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:24:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:24:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:24:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:24:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:24:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:24:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.713187128999998, 2020-11-12T17:24:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:24:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:24:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:24:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:24:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:24:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:24:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:24:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:24:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:24:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:24:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:24:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:24:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:24:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:24:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:24:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:24:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:24:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:24:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:24:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:24:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:24:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:24:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:24:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:24:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:24:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.709787194999997, 2020-11-12T17:24:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:24:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:24:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:24:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:24:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:24:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:24:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:24:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:24:01.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:24:01.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:24:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:24:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:24:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:24:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:24:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:24:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:24744 3.4 e45/35 3:27e37414:::benchmark_data_smithi036_14212_object3092:head v 45'1584, mlcod=45'1580)", 2020-11-12T17:24:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:24:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.558872053000002, 2020-11-12T17:24:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999, 2020-11-12T17:24:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:24:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:24:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:24:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680526+0000", 2020-11-12T17:24:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3724e-05 2020-11-12T17:24:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680609+0000", 2020-11-12T17:24:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.154293649 2020-11-12T17:24:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834903+0000", 2020-11-12T17:24:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1653e-05 2020-11-12T17:24:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834915+0000", 2020-11-12T17:24:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5685000000000006e-05 2020-11-12T17:24:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834980+0000", 2020-11-12T17:24:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4757e-05 2020-11-12T17:24:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.835005+0000", 2020-11-12T17:24:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001426067 2020-11-12T17:24:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836431+0000", 2020-11-12T17:24:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5732999999999997e-05 2020-11-12T17:24:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836477+0000", 2020-11-12T17:24:01.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999 2020-11-12T17:24:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:28560 3.4 e47/35 3:202f80a5:::benchmark_data_smithi036_14212_object3569:head v 47'1808, mlcod=47'1801)", 2020-11-12T17:24:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.57707068, 2020-11-12T17:24:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697, 2020-11-12T17:24:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662339+0000", 2020-11-12T17:24:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9332000000000001e-05 2020-11-12T17:24:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662389+0000", 2020-11-12T17:24:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.240093907 2020-11-12T17:24:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902482+0000", 2020-11-12T17:24:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1109999999999996e-06 2020-11-12T17:24:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902489+0000", 2020-11-12T17:24:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0870000000000004e-05 2020-11-12T17:24:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902559+0000", 2020-11-12T17:24:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2245e-05 2020-11-12T17:24:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902592+0000", 2020-11-12T17:24:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029425010000000001 2020-11-12T17:24:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905534+0000", 2020-11-12T17:24:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8211e-05 2020-11-12T17:24:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905622+0000", 2020-11-12T17:24:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697 2020-11-12T17:24:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29088 3.4 e47/35 3:2728cac2:::benchmark_data_smithi036_14212_object3635:head v 47'1856, mlcod=47'1851)", 2020-11-12T17:24:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:24:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.137341810000001, 2020-11-12T17:24:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15063083799999999, 2020-11-12T17:24:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:24:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:24:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102067+0000", 2020-11-12T17:24:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8427000000000002e-05 2020-11-12T17:24:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102126+0000", 2020-11-12T17:24:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.145643039 2020-11-12T17:24:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247769+0000", 2020-11-12T17:24:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5070000000000003e-06 2020-11-12T17:24:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247776+0000", 2020-11-12T17:24:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9156000000000002e-05 2020-11-12T17:24:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247825+0000", 2020-11-12T17:24:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9045999999999999e-05 2020-11-12T17:24:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247854+0000", 2020-11-12T17:24:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004802054 2020-11-12T17:24:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.252656+0000", 2020-11-12T17:24:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8059000000000001e-05 2020-11-12T17:24:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.252714+0000", 2020-11-12T17:24:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15063083799999999 2020-11-12T17:24:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29440 3.4 e48/35 3:252d7780:::benchmark_data_smithi036_14212_object3679:head v 48'1880, mlcod=48'1871)", 2020-11-12T17:24:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.841439389, 2020-11-12T17:24:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999, 2020-11-12T17:24:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397961+0000", 2020-11-12T17:24:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5236999999999997e-05 2020-11-12T17:24:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.398046+0000", 2020-11-12T17:24:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23963379700000001 2020-11-12T17:24:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637680+0000", 2020-11-12T17:24:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.824e-06 2020-11-12T17:24:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637687+0000", 2020-11-12T17:24:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4215999999999998e-05 2020-11-12T17:24:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637732+0000", 2020-11-12T17:24:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8510000000000001e-05 2020-11-12T17:24:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637750+0000", 2020-11-12T17:24:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012233260000000001 2020-11-12T17:24:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.638973+0000", 2020-11-12T17:24:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8594999999999998e-05 2020-11-12T17:24:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.639022+0000", 2020-11-12T17:24:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999 2020-11-12T17:24:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29784 3.d e48/20 3:be9adc0e:::benchmark_data_smithi036_14212_object3722:head v 48'1664, mlcod=48'1656)", 2020-11-12T17:24:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:24:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.462741615000001, 2020-11-12T17:24:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20712350500000001, 2020-11-12T17:24:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:24:01.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:24:01.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:24:01.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776662+0000", 2020-11-12T17:24:01.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6710000000000002e-05 2020-11-12T17:24:01.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776749+0000", 2020-11-12T17:24:01.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20445004899999999 2020-11-12T17:24:01.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981199+0000", 2020-11-12T17:24:01.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:24:01.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981207+0000", 2020-11-12T17:24:01.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8742999999999997e-05 2020-11-12T17:24:01.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981256+0000", 2020-11-12T17:24:01.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9745999999999999e-05 2020-11-12T17:24:01.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981285+0000", 2020-11-12T17:24:01.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024615840000000002 2020-11-12T17:24:01.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.983747+0000", 2020-11-12T17:24:01.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0350999999999999e-05 2020-11-12T17:24:01.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.983807+0000", 2020-11-12T17:24:01.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20712350500000001 2020-11-12T17:24:01.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.342 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.342 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29991 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1679, mlcod=48'1673)", 2020-11-12T17:24:01.342 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:01.343 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.235261501, 2020-11-12T17:24:01.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001, 2020-11-12T17:24:01.343 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.343 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.343 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:01.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:01.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:01.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004127+0000", 2020-11-12T17:24:01.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012464900000000001 2020-11-12T17:24:01.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004251+0000", 2020-11-12T17:24:01.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28639012600000002 2020-11-12T17:24:01.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290641+0000", 2020-11-12T17:24:01.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:24:01.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290646+0000", 2020-11-12T17:24:01.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2363000000000002e-05 2020-11-12T17:24:01.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290679+0000", 2020-11-12T17:24:01.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3289999999999999e-05 2020-11-12T17:24:01.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290702+0000", 2020-11-12T17:24:01.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014675440000000001 2020-11-12T17:24:01.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292170+0000", 2020-11-12T17:24:01.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6585000000000001e-05 2020-11-12T17:24:01.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292226+0000", 2020-11-12T17:24:01.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001 2020-11-12T17:24:01.350 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.351 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.351 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.351 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:24:01.351 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:01.351 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.233897748, 2020-11-12T17:24:01.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:24:01.352 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.352 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.352 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:01.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:01.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:24:01.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:24:01.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:24:01.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:24:01.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:24:01.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:24:01.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:24:01.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:24:01.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:24:01.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:24:01.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:24:01.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:24:01.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:24:01.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:24:01.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:24:01.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:24:01.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:24:01.360 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.360 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.360 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.360 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30039 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1927, mlcod=48'1921)", 2020-11-12T17:24:01.361 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:01.361 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.174619071, 2020-11-12T17:24:01.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001, 2020-11-12T17:24:01.361 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.361 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.361 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:01.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:01.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999409 2020-11-12T17:24:01.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064747+0000", 2020-11-12T17:24:01.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019364299999999999 2020-11-12T17:24:01.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064941+0000", 2020-11-12T17:24:01.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.212994778 2020-11-12T17:24:01.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277936+0000", 2020-11-12T17:24:01.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7939999999999997e-06 2020-11-12T17:24:01.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277945+0000", 2020-11-12T17:24:01.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032420940000000001 2020-11-12T17:24:01.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281187+0000", 2020-11-12T17:24:01.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3390000000000001e-05 2020-11-12T17:24:01.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281211+0000", 2020-11-12T17:24:01.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062069380000000004 2020-11-12T17:24:01.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287418+0000", 2020-11-12T17:24:01.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109126 2020-11-12T17:24:01.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287527+0000", 2020-11-12T17:24:01.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001 2020-11-12T17:24:01.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.369 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.369 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.369 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30040 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1928, mlcod=48'1921)", 2020-11-12T17:24:01.369 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:01.370 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.17300032, 2020-11-12T17:24:01.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277, 2020-11-12T17:24:01.370 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.370 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.370 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:01.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:01.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:24:01.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066369+0000", 2020-11-12T17:24:01.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185513 2020-11-12T17:24:01.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066555+0000", 2020-11-12T17:24:01.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22267770000000001 2020-11-12T17:24:01.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289233+0000", 2020-11-12T17:24:01.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5750000000000001e-06 2020-11-12T17:24:01.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289236+0000", 2020-11-12T17:24:01.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7205e-05 2020-11-12T17:24:01.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289283+0000", 2020-11-12T17:24:01.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0210000000000001e-05 2020-11-12T17:24:01.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289304+0000", 2020-11-12T17:24:01.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018794020000000001 2020-11-12T17:24:01.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291183+0000", 2020-11-12T17:24:01.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2386999999999998e-05 2020-11-12T17:24:01.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291235+0000", 2020-11-12T17:24:01.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277 2020-11-12T17:24:01.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.377 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.378 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:33768 3.d e49/20 3:bed94f4a:::benchmark_data_smithi036_14212_object4220:head v 49'1880, mlcod=49'1874)", 2020-11-12T17:24:01.378 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:01.378 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.3248547000000004, 2020-11-12T17:24:01.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001, 2020-11-12T17:24:01.378 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.379 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.379 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:01.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:01.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:24:01.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914530+0000", 2020-11-12T17:24:01.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013119499999999999 2020-11-12T17:24:01.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914662+0000", 2020-11-12T17:24:01.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26915680600000003 2020-11-12T17:24:01.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183818+0000", 2020-11-12T17:24:01.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.61e-06 2020-11-12T17:24:01.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183826+0000", 2020-11-12T17:24:01.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2031999999999999e-05 2020-11-12T17:24:01.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183878+0000", 2020-11-12T17:24:01.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1192999999999998e-05 2020-11-12T17:24:01.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183909+0000", 2020-11-12T17:24:01.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055133250000000003 2020-11-12T17:24:01.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189422+0000", 2020-11-12T17:24:01.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4030999999999997e-05 2020-11-12T17:24:01.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189486+0000", 2020-11-12T17:24:01.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001 2020-11-12T17:24:01.404 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.404 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.404 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.405 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:38792 3.d e51/20 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head v 51'2208, mlcod=51'2199)", 2020-11-12T17:24:01.405 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.295493+0000", 2020-11-12T17:24:01.405 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.943931914, 2020-11-12T17:24:01.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.172836036, 2020-11-12T17:24:01.405 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.405 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.406 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295493+0000", 2020-11-12T17:24:01.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295493+0000", 2020-11-12T17:24:01.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:01.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295471+0000", 2020-11-12T17:24:01.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4578000000000003e-05 2020-11-12T17:24:01.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295546+0000", 2020-11-12T17:24:01.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16980322 2020-11-12T17:24:01.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.465349+0000", 2020-11-12T17:24:01.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4039999999999997e-06 2020-11-12T17:24:01.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.465354+0000", 2020-11-12T17:24:01.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0809999999999997e-05 2020-11-12T17:24:01.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.465394+0000", 2020-11-12T17:24:01.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0864000000000001e-05 2020-11-12T17:24:01.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.465425+0000", 2020-11-12T17:24:01.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028509049999999999 2020-11-12T17:24:01.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.468276+0000", 2020-11-12T17:24:01.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3350999999999998e-05 2020-11-12T17:24:01.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.468329+0000", 2020-11-12T17:24:01.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.172836036 2020-11-12T17:24:01.413 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.413 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.414 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.414 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39056 3.c 3:315372a6:::benchmark_data_smithi036_14212_object4881:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:01.414 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.550372+0000", 2020-11-12T17:24:01.415 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.6890536519999999, 2020-11-12T17:24:01.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.138729355, 2020-11-12T17:24:01.415 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.415 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:01.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:01.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:01.416 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39056 2020-11-12T17:24:01.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.416 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550372+0000", 2020-11-12T17:24:01.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550372+0000", 2020-11-12T17:24:01.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:01.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550336+0000", 2020-11-12T17:24:01.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012995500000000001 2020-11-12T17:24:01.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550466+0000", 2020-11-12T17:24:01.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2802999999999999e-05 2020-11-12T17:24:01.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550479+0000", 2020-11-12T17:24:01.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7909999999999999e-06 2020-11-12T17:24:01.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550488+0000", 2020-11-12T17:24:01.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077249559999999998 2020-11-12T17:24:01.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.558213+0000", 2020-11-12T17:24:01.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131884 2020-11-12T17:24:01.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.558345+0000", 2020-11-12T17:24:01.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025711799999999997 2020-11-12T17:24:01.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:01.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.558602+0000", 2020-11-12T17:24:01.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002521868 2020-11-12T17:24:01.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:01.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.561124+0000", 2020-11-12T17:24:01.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12785993700000001 2020-11-12T17:24:01.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:01.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.688984+0000", 2020-11-12T17:24:01.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1707999999999999e-05 2020-11-12T17:24:01.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.689056+0000", 2020-11-12T17:24:01.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.515e-05 2020-11-12T17:24:01.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.689101+0000", 2020-11-12T17:24:01.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.138729355 2020-11-12T17:24:01.426 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.426 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.426 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.427 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:24:01.427 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:01.427 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.4012037820000001, 2020-11-12T17:24:01.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:24:01.427 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.428 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.428 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:01.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:01.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:01.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:24:01.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:24:01.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:24:01.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:24:01.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:24:01.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:24:01.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:24:01.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:24:01.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:24:01.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:24:01.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:24:01.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:24:01.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:24:01.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:24:01.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:24:01.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:24:01.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.436 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.436 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39662 3.c 3:34828e81:::benchmark_data_smithi036_14212_object4957:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:01.437 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.159592+0000", 2020-11-12T17:24:01.437 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.0798328880000001, 2020-11-12T17:24:01.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.146164711, 2020-11-12T17:24:01.437 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.437 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:01.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:01.438 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:01.438 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39662 2020-11-12T17:24:01.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.438 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159592+0000", 2020-11-12T17:24:01.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159592+0000", 2020-11-12T17:24:01.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:01.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159557+0000", 2020-11-12T17:24:01.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102655 2020-11-12T17:24:01.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159659+0000", 2020-11-12T17:24:01.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4496999999999999e-05 2020-11-12T17:24:01.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159684+0000", 2020-11-12T17:24:01.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1528e-05 2020-11-12T17:24:01.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159695+0000", 2020-11-12T17:24:01.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042118199999999998 2020-11-12T17:24:01.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.163907+0000", 2020-11-12T17:24:01.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9568999999999997e-05 2020-11-12T17:24:01.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.163987+0000", 2020-11-12T17:24:01.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000140323 2020-11-12T17:24:01.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:01.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.164127+0000", 2020-11-12T17:24:01.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004264065 2020-11-12T17:24:01.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:01.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.168391+0000", 2020-11-12T17:24:01.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13708895199999999 2020-11-12T17:24:01.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:01.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.305480+0000", 2020-11-12T17:24:01.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015309500000000001 2020-11-12T17:24:01.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.305633+0000", 2020-11-12T17:24:01.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012395099999999999 2020-11-12T17:24:01.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.305757+0000", 2020-11-12T17:24:01.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.146164711 2020-11-12T17:24:01.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.449 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.449 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39663 3.c 3:34828e81:::benchmark_data_smithi036_14212_object4957:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:01.449 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.162688+0000", 2020-11-12T17:24:01.449 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.076737418, 2020-11-12T17:24:01.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14354562100000001, 2020-11-12T17:24:01.450 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.450 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:01.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:01.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:01.450 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39663 2020-11-12T17:24:01.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.451 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162688+0000", 2020-11-12T17:24:01.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162688+0000", 2020-11-12T17:24:01.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999514 2020-11-12T17:24:01.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162639+0000", 2020-11-12T17:24:01.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012288800000000001 2020-11-12T17:24:01.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162762+0000", 2020-11-12T17:24:01.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5840000000000001e-05 2020-11-12T17:24:01.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162778+0000", 2020-11-12T17:24:01.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6270000000000006e-06 2020-11-12T17:24:01.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162786+0000", 2020-11-12T17:24:01.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026948430000000002 2020-11-12T17:24:01.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.165481+0000", 2020-11-12T17:24:01.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1893999999999998e-05 2020-11-12T17:24:01.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.165573+0000", 2020-11-12T17:24:01.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014403800000000001 2020-11-12T17:24:01.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:01.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.165717+0000", 2020-11-12T17:24:01.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026869799999999998 2020-11-12T17:24:01.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:01.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.168404+0000", 2020-11-12T17:24:01.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13750731999999999 2020-11-12T17:24:01.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:01.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.305912+0000", 2020-11-12T17:24:01.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018462799999999999 2020-11-12T17:24:01.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306096+0000", 2020-11-12T17:24:01.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013736299999999999 2020-11-12T17:24:01.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306234+0000", 2020-11-12T17:24:01.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14354562100000001 2020-11-12T17:24:01.459 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.459 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.460 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39664 3.c 3:34828e81:::benchmark_data_smithi036_14212_object4957:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:01.460 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.162891+0000", 2020-11-12T17:24:01.460 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.0765342929999999, 2020-11-12T17:24:01.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14365513099999999, 2020-11-12T17:24:01.461 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.461 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:01.461 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:01.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:01.462 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39664 2020-11-12T17:24:01.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.462 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162891+0000", 2020-11-12T17:24:01.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162891+0000", 2020-11-12T17:24:01.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999337 2020-11-12T17:24:01.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162825+0000", 2020-11-12T17:24:01.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014095500000000001 2020-11-12T17:24:01.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162966+0000", 2020-11-12T17:24:01.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3232e-05 2020-11-12T17:24:01.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162979+0000", 2020-11-12T17:24:01.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5520000000000001e-06 2020-11-12T17:24:01.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162986+0000", 2020-11-12T17:24:01.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039515590000000003 2020-11-12T17:24:01.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.166937+0000", 2020-11-12T17:24:01.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8456999999999996e-05 2020-11-12T17:24:01.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.167036+0000", 2020-11-12T17:24:01.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015110500000000001 2020-11-12T17:24:01.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:01.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.167187+0000", 2020-11-12T17:24:01.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019868120000000001 2020-11-12T17:24:01.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:01.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.169174+0000", 2020-11-12T17:24:01.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13717552699999999 2020-11-12T17:24:01.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:01.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306349+0000", 2020-11-12T17:24:01.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6019000000000004e-05 2020-11-12T17:24:01.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306435+0000", 2020-11-12T17:24:01.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111123 2020-11-12T17:24:01.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306546+0000", 2020-11-12T17:24:01.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14365513099999999 2020-11-12T17:24:01.471 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.471 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.471 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.471 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:40088 3.2 e51/20 3:4e1f0a94:::benchmark_data_smithi036_14212_object5010:head v 51'2448, mlcod=51'2442)", 2020-11-12T17:24:01.471 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.706900+0000", 2020-11-12T17:24:01.472 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.53252487299999995, 2020-11-12T17:24:01.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16863108800000001, 2020-11-12T17:24:01.472 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:01.472 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:01.472 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:01.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:01.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.706900+0000", 2020-11-12T17:24:01.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:01.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:01.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.706900+0000", 2020-11-12T17:24:01.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:01.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:01.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.706875+0000", 2020-11-12T17:24:01.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9007999999999999e-05 2020-11-12T17:24:01.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:01.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.706964+0000", 2020-11-12T17:24:01.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16414546599999999 2020-11-12T17:24:01.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:01.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.871110+0000", 2020-11-12T17:24:01.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4799999999999998e-06 2020-11-12T17:24:01.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:01.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.871116+0000", 2020-11-12T17:24:01.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9098000000000002e-05 2020-11-12T17:24:01.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:01.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.871176+0000", 2020-11-12T17:24:01.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3824e-05 2020-11-12T17:24:01.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:01.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.871209+0000", 2020-11-12T17:24:01.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042714720000000001 2020-11-12T17:24:01.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:01.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.875481+0000", 2020-11-12T17:24:01.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0732000000000001e-05 2020-11-12T17:24:01.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:01.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:01.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:01.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.875532+0000", 2020-11-12T17:24:01.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16863108800000001 2020-11-12T17:24:01.479 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.479 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.479 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.479 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:01.479 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:01.479 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:01.481 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:01.482 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:01.482 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:01.482 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:01.482 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:24:01.482 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:24:01.482 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:24:01.483 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:24:01.483 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:24:01.483 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:24:01.483 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:24:01.483 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:24:01.483 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:24:01.484 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:01.485 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:01.474+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:01.568 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 57 16 40831 40815 5.5936 6.625 0.00923007 0.0223055 2020-11-12T17:24:01.582 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:01.576+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:01.648 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:01.648 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:01.658 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:01.709 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:01.706+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:03.927 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-12T17:24:03.934 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:24:03.935 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:24:03.935 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:24:03.937 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 58 16 41606 41590 5.60154 6.05469 0.0221955 0.0222874 2020-11-12T17:24:03.937 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 59 16 42520 42504 5.62761 7.14062 0.0108202 0.022197 2020-11-12T17:24:03.938 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:03.920+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:03.938 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:03.939 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:03.939 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:04.030 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:04.024+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:04.112 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:04.113 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:04.121 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:04.123 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:04.130 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:04.124+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:04.154 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:24:04.197 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:04.231 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:04.226+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:04.238 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:04.246 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:04.246 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:04.257 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:04.287 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:04.328 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:24:04.330 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:04.331 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:24:04.344 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2020-11-12T17:24:03.551380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":332775424,"num_objects":5080,"num_object_clones":0,"num_object_copies":10160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40624,"num_write_kb":324978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":402,"num_bytes_recovered":26345472,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40624,"ondisk_log_size":40624,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8704228,"kb_used_data":315556,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746270492,"statfs":{"total":773094113280,"available":764180983808,"internally_reserved":8589934592,"allocated":323129344,"data_stored":660370244,"data_compressed":4274908,"data_compressed_allocated":318869504,"data_compressed_original":658735104,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,2,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":75874304,"num_objects":1158,"num_object_clones":0,"num_object_copies":2316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9262,"num_write_kb":74096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001776"},"pg_stats":[{"pgid":"3.f","version":"52'2648","reported_seq":"2687","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.473452+0000","last_change":"2020-11-12T17:23:03.465552+0000","last_active":"2020-11-12T17:24:01.473452+0000","last_peered":"2020-11-12T17:24:01.473452+0000","last_clean":"2020-11-12T17:24:01.473452+0000","last_became_active":"2020-11-12T17:23:03.463508+0000","last_became_peered":"2020-11-12T17:23:03.463508+0000","last_unstale":"2020-11-12T17:24:01.473452+0000","last_undegraded":"2020-11-12T17:24:01.473452+0000","last_fullsized":"2020-11-12T17:24:01.473452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2648,"ondisk_log_size":2648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2648,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"52'2248","reported_seq":"2287","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.543722+0000","last_change":"2020-11-12T17:23:03.464759+0000","last_active":"2020-11-12T17:24:01.543722+0000","last_peered":"2020-11-12T17:24:01.543722+0000","last_clean":"2020-11-12T17:24:01.543722+0000","last_became_active":"2020-11-12T17:23:03.463495+0000","last_became_peered":"2020-11-12T17:23:03.463495+0000","last_unstale":"2020-11-12T17:24:01.543722+0000","last_undegraded":"2020-11-12T17:24:01.543722+0000","last_fullsized":"2020-11-12T17:24:01.543722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2248,"ondisk_log_size":2248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2248,"num_write_kb":17984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"51'2328","reported_seq":"2367","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.236149+0000","last_change":"2020-11-12T17:23:03.464197+0000","last_active":"2020-11-12T17:24:01.236149+0000","last_peered":"2020-11-12T17:24:01.236149+0000","last_clean":"2020-11-12T17:24:01.236149+0000","last_became_active":"2020-11-12T17:23:03.463663+0000","last_became_peered":"2020-11-12T17:23:03.463663+0000","last_unstale":"2020-11-12T17:24:01.236149+0000","last_undegraded":"2020-11-12T17:24:01.236149+0000","last_fullsized":"2020-11-12T17:24:01.236149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2328,"ondisk_log_size":2328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19070976,"num_objects":291,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2328,"num_write_kb":18624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"51'2880","reported_seq":"2919","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.891282+0000","last_change":"2020-11-12T17:23:03.464079+0000","last_active":"2020-11-12T17:24:00.891282+0000","last_peered":"2020-11-12T17:24:00.891282+0000","last_clean":"2020-11-12T17:24:00.891282+0000","last_became_active":"2020-11-12T17:23:03.463689+0000","last_became_peered":"2020-11-12T17:23:03.463689+0000","last_unstale":"2020-11-12T17:24:00.891282+0000","last_undegraded":"2020-11-12T17:24:00.891282+0000","last_fullsized":"2020-11-12T17:24:00.891282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2880,"ondisk_log_size":2880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2880,"num_write_kb":23040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"51'2632","reported_seq":"2670","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.153923+0000","last_change":"2020-11-12T17:23:03.462347+0000","last_active":"2020-11-12T17:24:01.153923+0000","last_peered":"2020-11-12T17:24:01.153923+0000","last_clean":"2020-11-12T17:24:01.153923+0000","last_became_active":"2020-11-12T17:23:03.461922+0000","last_became_peered":"2020-11-12T17:23:03.461922+0000","last_unstale":"2020-11-12T17:24:01.153923+0000","last_undegraded":"2020-11-12T17:24:01.153923+0000","last_fullsized":"2020-11-12T17:24:01.153923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2632,"ondisk_log_size":2632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2632,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"51'2552","reported_seq":"2843","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.566191+0000","last_change":"2020-11-12T17:23:32.849590+0000","last_active":"2020-11-12T17:24:00.566191+0000","last_peered":"2020-11-12T17:24:00.566191+0000","last_clean":"2020-11-12T17:24:00.566191+0000","last_became_active":"2020-11-12T17:23:19.676825+0000","last_became_peered":"2020-11-12T17:23:19.676825+0000","last_unstale":"2020-11-12T17:24:00.566191+0000","last_undegraded":"2020-11-12T17:24:00.566191+0000","last_fullsized":"2020-11-12T17:24:00.566191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2552,"ondisk_log_size":2552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2552,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":7995392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"51'2624","reported_seq":"2897","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.540394+0000","last_change":"2020-11-12T17:23:28.815702+0000","last_active":"2020-11-12T17:24:00.540394+0000","last_peered":"2020-11-12T17:24:00.540394+0000","last_clean":"2020-11-12T17:24:00.540394+0000","last_became_active":"2020-11-12T17:23:27.810569+0000","last_became_peered":"2020-11-12T17:23:27.810569+0000","last_unstale":"2020-11-12T17:24:00.540394+0000","last_undegraded":"2020-11-12T17:24:00.540394+0000","last_fullsized":"2020-11-12T17:24:00.540394+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2624,"ondisk_log_size":2624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2624,"num_write_kb":20992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":7405568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"52'2694","reported_seq":"2731","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.579660+0000","last_change":"2020-11-12T17:23:03.467661+0000","last_active":"2020-11-12T17:24:01.579660+0000","last_peered":"2020-11-12T17:24:01.579660+0000","last_clean":"2020-11-12T17:24:01.579660+0000","last_became_active":"2020-11-12T17:23:03.466462+0000","last_became_peered":"2020-11-12T17:23:03.466462+0000","last_unstale":"2020-11-12T17:24:01.579660+0000","last_undegraded":"2020-11-12T17:24:01.579660+0000","last_fullsized":"2020-11-12T17:24:01.579660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2694,"ondisk_log_size":2694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22069248,"num_objects":337,"num_object_clones":0,"num_object_copies":674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2694,"num_write_kb":21552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"42","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.414698+0000","last_change":"2020-11-12T17:22:51.722504+0000","last_active":"2020-11-12T17:23:58.414698+0000","last_peered":"2020-11-12T17:23:58.414698+0000","last_clean":"2020-11-12T17:23:58.414698+0000","last_became_active":"2020-11-12T17:22:51.721744+0000","last_became_peered":"2020-11-12T17:22:51.721744+0000","last_unstale":"2020-11-12T17:23:58.414698+0000","last_undegraded":"2020-11-12T17:23:58.414698+0000","last_fullsized":"2020-11-12T17:23:58.414698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'2472","reported_seq":"2511","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.482078+0000","last_change":"2020-11-12T17:23:03.464833+0000","last_active":"2020-11-12T17:24:01.482078+0000","last_peered":"2020-11-12T17:24:01.482078+0000","last_clean":"2020-11-12T17:24:01.482078+0000","last_became_active":"2020-11-12T17:23:03.464444+0000","last_became_peered":"2020-11-12T17:23:03.464444+0000","last_unstale":"2020-11-12T17:24:01.482078+0000","last_undegraded":"2020-11-12T17:24:01.482078+0000","last_fullsized":"2020-11-12T17:24:01.482078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2472,"ondisk_log_size":2472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2472,"num_write_kb":19776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"45","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.156515+0000","last_change":"2020-11-12T17:24:00.156515+0000","last_active":"2020-11-12T17:24:00.156515+0000","last_peered":"2020-11-12T17:24:00.156515+0000","last_clean":"2020-11-12T17:24:00.156515+0000","last_became_active":"2020-11-12T17:22:51.355473+0000","last_became_peered":"2020-11-12T17:22:51.355473+0000","last_unstale":"2020-11-12T17:24:00.156515+0000","last_undegraded":"2020-11-12T17:24:00.156515+0000","last_fullsized":"2020-11-12T17:24:00.156515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:00.156362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:00.156362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"51'2552","reported_seq":"2589","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.385504+0000","last_change":"2020-11-12T17:23:03.464964+0000","last_active":"2020-11-12T17:24:00.385504+0000","last_peered":"2020-11-12T17:24:00.385504+0000","last_clean":"2020-11-12T17:24:00.385504+0000","last_became_active":"2020-11-12T17:23:03.464617+0000","last_became_peered":"2020-11-12T17:23:03.464617+0000","last_unstale":"2020-11-12T17:24:00.385504+0000","last_undegraded":"2020-11-12T17:24:00.385504+0000","last_fullsized":"2020-11-12T17:24:00.385504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2552,"ondisk_log_size":2552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2552,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"27","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.410767+0000","last_change":"2020-11-12T17:23:27.984703+0000","last_active":"2020-11-12T17:23:58.410767+0000","last_peered":"2020-11-12T17:23:58.410767+0000","last_clean":"2020-11-12T17:23:58.410767+0000","last_became_active":"2020-11-12T17:23:27.983997+0000","last_became_peered":"2020-11-12T17:23:27.983997+0000","last_unstale":"2020-11-12T17:23:58.410767+0000","last_undegraded":"2020-11-12T17:23:58.410767+0000","last_fullsized":"2020-11-12T17:23:58.410767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"51'2288","reported_seq":"2495","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.311592+0000","last_change":"2020-11-12T17:23:28.324736+0000","last_active":"2020-11-12T17:24:01.311592+0000","last_peered":"2020-11-12T17:24:01.311592+0000","last_clean":"2020-11-12T17:24:01.311592+0000","last_became_active":"2020-11-12T17:23:27.951996+0000","last_became_peered":"2020-11-12T17:23:27.951996+0000","last_unstale":"2020-11-12T17:24:01.311592+0000","last_undegraded":"2020-11-12T17:24:01.311592+0000","last_fullsized":"2020-11-12T17:24:01.311592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2288,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2288,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":5177344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"50","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.420911+0000","last_change":"2020-11-12T17:23:27.788153+0000","last_active":"2020-11-12T17:23:58.420911+0000","last_peered":"2020-11-12T17:23:58.420911+0000","last_clean":"2020-11-12T17:23:58.420911+0000","last_became_active":"2020-11-12T17:23:27.787364+0000","last_became_peered":"2020-11-12T17:23:27.787364+0000","last_unstale":"2020-11-12T17:23:58.420911+0000","last_undegraded":"2020-11-12T17:23:58.420911+0000","last_fullsized":"2020-11-12T17:23:58.420911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"47","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.416495+0000","last_change":"2020-11-12T17:22:47.070011+0000","last_active":"2020-11-12T17:23:58.416495+0000","last_peered":"2020-11-12T17:23:58.416495+0000","last_clean":"2020-11-12T17:23:58.416495+0000","last_became_active":"2020-11-12T17:22:47.069110+0000","last_became_peered":"2020-11-12T17:22:47.069110+0000","last_unstale":"2020-11-12T17:23:58.416495+0000","last_undegraded":"2020-11-12T17:23:58.416495+0000","last_fullsized":"2020-11-12T17:23:58.416495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:22:42.530591+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"52'2496","reported_seq":"2535","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.575036+0000","last_change":"2020-11-12T17:23:03.467425+0000","last_active":"2020-11-12T17:24:01.575036+0000","last_peered":"2020-11-12T17:24:01.575036+0000","last_clean":"2020-11-12T17:24:01.575036+0000","last_became_active":"2020-11-12T17:23:03.467027+0000","last_became_peered":"2020-11-12T17:23:03.467027+0000","last_unstale":"2020-11-12T17:24:01.575036+0000","last_undegraded":"2020-11-12T17:24:01.575036+0000","last_fullsized":"2020-11-12T17:24:01.575036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2496,"ondisk_log_size":2496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2496,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"42","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.416320+0000","last_change":"2020-11-12T17:22:51.356607+0000","last_active":"2020-11-12T17:23:58.416320+0000","last_peered":"2020-11-12T17:23:58.416320+0000","last_clean":"2020-11-12T17:23:58.416320+0000","last_became_active":"2020-11-12T17:22:51.356123+0000","last_became_peered":"2020-11-12T17:22:51.356123+0000","last_unstale":"2020-11-12T17:23:58.416320+0000","last_undegraded":"2020-11-12T17:23:58.416320+0000","last_fullsized":"2020-11-12T17:23:58.416320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"51'2552","reported_seq":"2591","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.438102+0000","last_change":"2020-11-12T17:23:03.464134+0000","last_active":"2020-11-12T17:24:01.438102+0000","last_peered":"2020-11-12T17:24:01.438102+0000","last_clean":"2020-11-12T17:24:01.438102+0000","last_became_active":"2020-11-12T17:23:03.462984+0000","last_became_peered":"2020-11-12T17:23:03.462984+0000","last_unstale":"2020-11-12T17:24:01.438102+0000","last_undegraded":"2020-11-12T17:24:01.438102+0000","last_fullsized":"2020-11-12T17:24:01.438102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2552,"ondisk_log_size":2552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2552,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"42","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.416438+0000","last_change":"2020-11-12T17:22:51.723934+0000","last_active":"2020-11-12T17:23:58.416438+0000","last_peered":"2020-11-12T17:23:58.416438+0000","last_clean":"2020-11-12T17:23:58.416438+0000","last_became_active":"2020-11-12T17:22:51.723115+0000","last_became_peered":"2020-11-12T17:22:51.723115+0000","last_unstale":"2020-11-12T17:23:58.416438+0000","last_undegraded":"2020-11-12T17:23:58.416438+0000","last_fullsized":"2020-11-12T17:23:58.416438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"52'2504","reported_seq":"2729","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.530769+0000","last_change":"2020-11-12T17:23:28.145229+0000","last_active":"2020-11-12T17:24:01.530769+0000","last_peered":"2020-11-12T17:24:01.530769+0000","last_clean":"2020-11-12T17:24:01.530769+0000","last_became_active":"2020-11-12T17:23:27.761310+0000","last_became_peered":"2020-11-12T17:23:27.761310+0000","last_unstale":"2020-11-12T17:24:01.530769+0000","last_undegraded":"2020-11-12T17:24:01.530769+0000","last_fullsized":"2020-11-12T17:24:01.530769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2504,"ondisk_log_size":2504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2504,"num_write_kb":20032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":5767168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"51'2552","reported_seq":"2591","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.219136+0000","last_change":"2020-11-12T17:23:03.462388+0000","last_active":"2020-11-12T17:24:01.219136+0000","last_peered":"2020-11-12T17:24:01.219136+0000","last_clean":"2020-11-12T17:24:01.219136+0000","last_became_active":"2020-11-12T17:23:03.461966+0000","last_became_peered":"2020-11-12T17:23:03.461966+0000","last_unstale":"2020-11-12T17:24:01.219136+0000","last_undegraded":"2020-11-12T17:24:01.219136+0000","last_fullsized":"2020-11-12T17:24:01.219136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2552,"ondisk_log_size":2552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2552,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"58","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.414709+0000","last_change":"2020-11-12T17:23:15.616888+0000","last_active":"2020-11-12T17:23:58.414709+0000","last_peered":"2020-11-12T17:23:58.414709+0000","last_clean":"2020-11-12T17:23:58.414709+0000","last_became_active":"2020-11-12T17:23:15.616435+0000","last_became_peered":"2020-11-12T17:23:15.616435+0000","last_unstale":"2020-11-12T17:23:58.414709+0000","last_undegraded":"2020-11-12T17:23:58.414709+0000","last_fullsized":"2020-11-12T17:23:58.414709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"32","reported_epoch":"50","state":"active+clean","last_fresh":"2020-11-12T17:23:55.391214+0000","last_change":"2020-11-12T17:23:15.759410+0000","last_active":"2020-11-12T17:23:55.391214+0000","last_peered":"2020-11-12T17:23:55.391214+0000","last_clean":"2020-11-12T17:23:55.391214+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:23:55.391214+0000","last_undegraded":"2020-11-12T17:23:55.391214+0000","last_fullsized":"2020-11-12T17:23:55.391214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"52'2600","reported_seq":"2639","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.564730+0000","last_change":"2020-11-12T17:23:03.465090+0000","last_active":"2020-11-12T17:24:01.564730+0000","last_peered":"2020-11-12T17:24:01.564730+0000","last_clean":"2020-11-12T17:24:01.564730+0000","last_became_active":"2020-11-12T17:23:03.462088+0000","last_became_peered":"2020-11-12T17:23:03.462088+0000","last_unstale":"2020-11-12T17:24:01.564730+0000","last_undegraded":"2020-11-12T17:24:01.564730+0000","last_fullsized":"2020-11-12T17:24:01.564730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2600,"ondisk_log_size":2600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2600,"num_write_kb":20800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":332775424,"num_objects":5078,"num_object_clones":0,"num_object_copies":10156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40622,"num_write_kb":324976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":402,"num_bytes_recovered":26345472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331063296,"data_stored":683122688,"data_compressed":4436635,"data_compressed_allocated":331063296,"data_compressed_original":683122688,"omap_allocated":0,"internal_metadata":0},"log_size":40622,"ondisk_log_size":40622,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1094824,"kb_used_data":46240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93277016,"statfs":{"total":96636764160,"available":95515664384,"internally_reserved":1073741824,"allocated":47349760,"data_stored":100335454,"data_compressed":630079,"data_compressed_allocated":46825472,"data_compressed_original":100130816,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.448},{"interface":"front","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":7.4349999999999996,"5min":7.4349999999999996,"15min":7.4349999999999996},"last":1.048}]},{"osd":1,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.27,"5min":2.27,"15min":2.27},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":7.585,"5min":7.585,"15min":7.585},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.403}]},{"osd":2,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.5289999999999999},{"interface":"front","average":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":7.6310000000000002,"5min":7.6310000000000002,"15min":7.6310000000000002},"last":1.0860000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"min":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.327},{"interface":"front","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":7.5410000000000004,"5min":7.5410000000000004,"15min":7.5410000000000004},"last":1.5980000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":53.758000000000003,"5min":53.758000000000003,"15min":53.758000000000003},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":503.50200000000001,"5min":503.50200000000001,"15min":503.50200000000001},"last":1.284},{"interface":"front","average":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":2.097}]},{"osd":5,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.742,"5min":2.742,"15min":2.742},"min":{"1min":1.45,"5min":1.45,"15min":1.45},"max":{"1min":7.7169999999999996,"5min":7.7169999999999996,"15min":7.7169999999999996},"last":1.514},{"interface":"front","average":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":7.7480000000000002,"5min":7.7480000000000002,"15min":7.7480000000000002},"last":1.5740000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":7.6630000000000003,"5min":7.6630000000000003,"15min":7.6630000000000003},"last":1.365},{"interface":"front","average":{"1min":53.441000000000003,"5min":53.441000000000003,"15min":53.441000000000003},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":975.20899999999995,"5min":975.20899999999995,"15min":975.20899999999995},"last":1.7010000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1097068,"kb_used_data":48484,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93274772,"statfs":{"total":96636764160,"available":95513366528,"internally_reserved":1073741824,"allocated":49647616,"data_stored":103487687,"data_compressed":659919,"data_compressed_allocated":49119232,"data_compressed_original":103284736,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,2,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":1.825,"15min":1.825},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":1.0549999999999999},{"interface":"front","average":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":5.3079999999999998,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.7569999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":5.4329999999999998,"5min":5.4329999999999998,"15min":5.4329999999999998},"last":1.329},{"interface":"front","average":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":8.0969999999999995,"5min":8.0969999999999995,"15min":8.0969999999999995},"last":1.659}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.742,"5min":2.742,"15min":2.742},"min":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":1.6919999999999999},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"min":{"1min":1.024,"5min":1.024,"15min":1.024},"max":{"1min":8.202,"5min":8.202,"15min":8.202},"last":1.8260000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":1.123},{"interface":"front","average":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":1.7290000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.6680000000000001,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.8859999999999999},{"interface":"front","average":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"min":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.26}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":8.5299999999999994,"5min":8.5299999999999994,"15min":8.5299999999999994},"last":3.1880000000000002},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"min":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":1.8}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1108388,"kb_used_data":59804,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93263452,"statfs":{"total":96636764160,"available":95501774848,"internally_reserved":1073741824,"allocated":61239296,"data_stored":121696703,"data_compressed":811413,"data_compressed_allocated":60743680,"data_compressed_original":121495552,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":47.031999999999996,"5min":47.031999999999996,"15min":47.031999999999996},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":948.30899999999997,"5min":948.30899999999997,"15min":948.30899999999997},"last":1.4730000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":9.7530000000000001,"5min":9.7530000000000001,"15min":9.7530000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":162.126,"5min":162.126,"15min":162.126},"last":1.3799999999999999},{"interface":"front","average":{"1min":9.4280000000000008,"5min":9.4280000000000008,"15min":9.4280000000000008},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":163.59899999999999,"5min":163.59899999999999,"15min":163.59899999999999},"last":1.337}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.121},{"interface":"front","average":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.8720000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.423,"5min":3.423,"15min":3.423},"last":1.2210000000000001},{"interface":"front","average":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":4.3959999999999999,"5min":4.3959999999999999,"15min":4.3959999999999999},"last":5.2130000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.2729999999999999},{"interface":"front","average":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.53}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":33.646999999999998,"5min":33.646999999999998,"15min":33.646999999999998},"min":{"1min":1.218,"5min":1.218,"15min":1.218},"max":{"1min":665.13999999999999,"5min":665.13999999999999,"15min":665.13999999999999},"last":1.7170000000000001},{"interface":"front","average":{"1min":2.242,"5min":2.242,"15min":2.242},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.9199999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":3.6160000000000001,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.7709999999999999},{"interface":"front","average":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.2679999999999998,"5min":3.2679999999999998,"15min":3.2679999999999998},"last":1.8220000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1089272,"kb_used_data":40688,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93282568,"statfs":{"total":96636764160,"available":95521349632,"internally_reserved":1073741824,"allocated":41664512,"data_stored":82438005,"data_compressed":549466,"data_compressed_allocated":41115648,"data_compressed_original":82231296,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.972,"5min":1.972,"15min":1.972},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":1.579}]},{"osd":2,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":33.777999999999999,"5min":33.777999999999999,"15min":33.777999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":509.74799999999999,"5min":509.74799999999999,"15min":509.74799999999999},"last":1.056},{"interface":"front","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.3979999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.796,"15min":1.796},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.3089999999999999},{"interface":"front","average":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":4.2229999999999999,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":1.4790000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":1.355,"5min":1.355,"15min":1.355},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.024},{"interface":"front","average":{"1min":13.404999999999999,"5min":13.404999999999999,"15min":13.404999999999999},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":185.10400000000001,"5min":185.10400000000001,"15min":185.10400000000001},"last":1.4419999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.306,"5min":2.306,"15min":2.306},"min":{"1min":1.153,"5min":1.153,"15min":1.153},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":1.847},{"interface":"front","average":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"min":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":1.5409999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":3.9279999999999999,"5min":3.9279999999999999,"15min":3.9279999999999999},"last":1.8859999999999999},{"interface":"front","average":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"min":{"1min":1.466,"5min":1.466,"15min":1.466},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.623}]},{"osd":7,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"min":{"1min":1.611,"5min":1.611,"15min":1.611},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":2.0099999999999998},{"interface":"front","average":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"min":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":1.6879999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1063620,"kb_used_data":15036,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93308220,"statfs":{"total":96636764160,"available":95547617280,"internally_reserved":1073741824,"allocated":15396864,"data_stored":39393646,"data_compressed":205319,"data_compressed_allocated":14864384,"data_compressed_original":39190528,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.768,"15min":1.768},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.042},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"min":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.294}]},{"osd":1,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":2.254,"5min":2.254,"15min":2.254},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.6100000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":9.1400000000000006,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":1.5169999999999999},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"min":{"1min":1.417,"5min":1.417,"15min":1.417},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.3620000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":2.46,"5min":2.46,"15min":2.46},"min":{"1min":1.234,"5min":1.234,"15min":1.234},"max":{"1min":9.2550000000000008,"5min":9.2550000000000008,"15min":9.2550000000000008},"last":1.8500000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"min":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":8.7189999999999994,"5min":8.7189999999999994,"15min":8.7189999999999994},"last":1.4790000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":9.7710000000000008,"5min":9.7710000000000008,"15min":9.7710000000000008},"last":1.401},{"interface":"front","average":{"1min":22.742000000000001,"5min":22.742000000000001,"15min":22.742000000000001},"min":{"1min":1.609,"5min":1.609,"15min":1.609},"max":{"1min":445.34699999999998,"5min":445.34699999999998,"15min":445.34699999999998},"last":2.7639999999999998}]},{"osd":7,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":1.427},{"interface":"front","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":9.3059999999999992,"5min":9.3059999999999992,"15min":9.3059999999999992},"last":1.8069999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1090168,"kb_used_data":41584,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93281672,"statfs":{"total":96636764160,"available":95520432128,"internally_reserved":1073741824,"allocated":42582016,"data_stored":84288462,"data_compressed":561536,"data_compressed_allocated":42041344,"data_compressed_original":84082688,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":66.608000000000004,"5min":66.608000000000004,"15min":66.608000000000004},"last":1.2410000000000001},{"interface":"front","average":{"1min":5.3899999999999997,"5min":5.3899999999999997,"15min":5.3899999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":67.099999999999994,"5min":67.099999999999994,"15min":67.099999999999994},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":54.027000000000001,"5min":54.027000000000001,"15min":54.027000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":995.93899999999996,"5min":995.93899999999996,"15min":995.93899999999996},"last":1.298},{"interface":"front","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":0.82099999999999995}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":15.675000000000001,"5min":15.675000000000001,"15min":15.675000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":269.27100000000002,"5min":269.27100000000002,"15min":269.27100000000002},"last":1.4690000000000001},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"min":{"1min":1.399,"5min":1.399,"15min":1.399},"max":{"1min":3.2839999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.704}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":5.008},{"interface":"front","average":{"1min":1.944,"5min":1.944,"15min":1.944},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":1.2090000000000001},{"interface":"front","average":{"1min":50.664999999999999,"5min":50.664999999999999,"15min":50.664999999999999},"min":{"1min":1.23,"5min":1.23,"15min":1.23},"max":{"1min":920.76900000000001,"5min":920.76900000000001,"15min":920.76900000000001},"last":1.7490000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.7929999999999999},{"interface":"front","average":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.738,"5min":3.738,"15min":3.738},"last":1.3500000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":29.132999999999999,"5min":29.132999999999999,"15min":29.132999999999999},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":502.12900000000002,"5min":502.12900000000002,"15min":502.12900000000002},"last":1.609},{"interface":"front","average":{"1min":49.103999999999999,"5min":49.103999999999999,"15min":49.103999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":502.42099999999999,"5min":502.42099999999999,"15min":502.42099999999999},"last":1.514}]}]},{"osd":2,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049120,"kb_used_data":536,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322720,"statfs":{"total":96636764160,"available":95562465280,"internally_reserved":1073741824,"allocated":548864,"data_stored":206809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:46 2020","interfaces":[{"interface":"back","average":{"1min":29.021999999999998,"5min":29.021999999999998,"15min":29.021999999999998},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":502.62299999999999,"5min":502.62299999999999,"15min":502.62299999999999},"last":2.109},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":8.0899999999999999,"5min":8.0899999999999999,"15min":8.0899999999999999},"last":1.1040000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:23:46 2020","interfaces":[{"interface":"back","average":{"1min":4.5960000000000001,"5min":4.5960000000000001,"15min":4.5960000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":73.155000000000001,"5min":73.155000000000001,"15min":73.155000000000001},"last":2.343},{"interface":"front","average":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"min":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"max":{"1min":8.2349999999999994,"5min":8.2349999999999994,"15min":8.2349999999999994},"last":1.177}]},{"osd":3,"last update":"Thu Nov 12 17:23:46 2020","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.869,"15min":1.869},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":3.1520000000000001,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":2.5649999999999999},{"interface":"front","average":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":8.843,"5min":8.843,"15min":8.843},"last":1.96}]},{"osd":4,"last update":"Thu Nov 12 17:23:46 2020","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"min":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":2.9990000000000001},{"interface":"front","average":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":7.8659999999999997,"5min":7.8659999999999997,"15min":7.8659999999999997},"last":2.4369999999999998}]},{"osd":5,"last update":"Thu Nov 12 17:23:46 2020","interfaces":[{"interface":"back","average":{"1min":2.508,"5min":2.508,"15min":2.508},"min":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"max":{"1min":8.7430000000000003,"5min":8.7430000000000003,"15min":8.7430000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":18.492999999999999,"5min":18.492999999999999,"15min":18.492999999999999},"min":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"max":{"1min":382.05200000000002,"5min":382.05200000000002,"15min":382.05200000000002},"last":1.5009999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:23:46 2020","interfaces":[{"interface":"back","average":{"1min":2.625,"5min":2.625,"15min":2.625},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"max":{"1min":7.9400000000000004,"5min":7.9400000000000004,"15min":7.9400000000000004},"last":2.621},{"interface":"front","average":{"1min":2.472,"5min":2.472,"15min":2.472},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":8.5939999999999994,"5min":8.5939999999999994,"15min":8.5939999999999994},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:23:46 2020","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"min":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"max":{"1min":8.1769999999999996,"5min":8.1769999999999996,"15min":8.1769999999999996},"last":1.5469999999999999},{"interface":"front","average":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"min":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":8.0399999999999991},"last":2.4950000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1111768,"kb_used_data":63184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93260072,"statfs":{"total":96636764160,"available":95498313728,"internally_reserved":1073741824,"allocated":64700416,"data_stored":128523478,"data_compressed":857176,"data_compressed_allocated":64159744,"data_compressed_original":128319488,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.798,"15min":1.798},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":4.4290000000000003,"5min":4.4290000000000003,"15min":4.4290000000000003},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":10.403,"5min":10.403,"15min":10.403},"last":1.3939999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":22.77,"5min":22.77,"15min":22.77},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":440.65899999999999,"5min":440.65899999999999,"15min":440.65899999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.839,"5min":1.839,"15min":1.839},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":1.8009999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":2.347,"15min":2.347},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":4.9740000000000002,"5min":4.9740000000000002,"15min":4.9740000000000002},"last":1.452},{"interface":"front","average":{"1min":1.994,"5min":1.994,"15min":1.994},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":3.7389999999999999,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":1.131}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.5409999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":10.318,"5min":10.318,"15min":10.318},"last":2.3809999999999998},{"interface":"front","average":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":1.4970000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":32.210000000000001,"5min":32.210000000000001,"15min":32.210000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":622.07799999999997,"5min":622.07799999999997,"15min":622.07799999999997},"last":1.756},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"max":{"1min":10.436,"5min":10.436,"15min":10.436},"last":2.4319999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.625,"5min":2.625,"15min":2.625},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":5.0419999999999998,"5min":5.0419999999999998,"15min":5.0419999999999998},"last":1.516},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":11.497999999999999,"5min":11.497999999999999,"15min":11.497999999999999},"last":1.831}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":10.513999999999999,"5min":10.513999999999999,"15min":10.513999999999999},"last":2.4809999999999999},{"interface":"front","average":{"1min":30.190000000000001,"5min":30.190000000000001,"15min":30.190000000000001},"min":{"1min":1.101,"5min":1.101,"15min":1.101},"max":{"1min":577.35900000000004,"5min":577.35900000000004,"15min":577.35900000000004},"last":1.728}]}]}]}} 2020-11-12T17:24:05.658 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:24:05.662 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:04.346+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:05.663 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:05.663 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:05.663 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:05.663 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:05.663 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:05.664 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:05.664 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:05.658+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:05.665 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:05.665 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:24:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:24:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:24:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:24:05.666 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:24:05.666 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:24:05.666 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:24:05.666 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:24:05.666 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:24:04.566909+0000 min lat: 0.00161593 max lat: 14.2555 avg lat: 0.0220944 2020-11-12T17:24:05.666 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:24:05.667 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 60 16 43441 43425 5.65373 7.19531 0.0129133 0.0220944 2020-11-12T17:24:05.667 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 61 16 44289 44273 5.66964 6.625 0.00695277 0.0220315 2020-11-12T17:24:05.667 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:24:05.761 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:05.756+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:05.827 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:05.827 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:05.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:05.828 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:05.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.828 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:24:05.828 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:05.828 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.983006682999999, 2020-11-12T17:24:05.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:24:05.829 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:05.829 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:05.829 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:05.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:05.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:05.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:05.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:05.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:05.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:05.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:05.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:24:05.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:24:05.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:05.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:24:05.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:24:05.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:05.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:24:05.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:24:05.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:05.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:24:05.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:24:05.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:05.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:24:05.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:24:05.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:05.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:24:05.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:24:05.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:05.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:24:05.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:24:05.835 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:05.836 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:05.836 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:05.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.836 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:05.836 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:05.836 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.324356139999999, 2020-11-12T17:24:05.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:24:05.837 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:05.837 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:05.837 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:05.837 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:05.837 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:05.837 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:24:05.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.838 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:05.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:05.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:05.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:05.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:05.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:05.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:05.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:05.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:24:05.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:24:05.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:05.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:24:05.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:24:05.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:05.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:24:05.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:24:05.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:05.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:24:05.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:24:05.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:05.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:24:05.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:24:05.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:05.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:24:05.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:24:05.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:05.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:24:05.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:24:05.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:05.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:24:05.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:24:05.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:05.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:24:05.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:24:05.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:05.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:24:05.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:24:05.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:05.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:24:05.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:24:05.847 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:05.848 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:05.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:05.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.848 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:05.848 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:05.849 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.322751080000003, 2020-11-12T17:24:05.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:24:05.849 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:05.849 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:05.849 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:05.849 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:05.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:05.850 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:24:05.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.850 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:05.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:05.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:05.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:05.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:05.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:05.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:24:05.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:05.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:24:05.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:24:05.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:05.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:24:05.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:24:05.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:05.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:24:05.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:24:05.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:05.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:05.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:05.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:24:05.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:24:06.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:24:06.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:24:06.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:24:06.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:24:06.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:06.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:24:06.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:24:06.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:24:06.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:24:06.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:24:06.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:24:06.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:24:06.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:24:06.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:24:06.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:24:06.287 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.287 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.288 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5735 3.d e25/20 ondisk, result = 0)", 2020-11-12T17:24:06.289 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:06.289 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.316664557999999, 2020-11-12T17:24:06.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002, 2020-11-12T17:24:06.290 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.291 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:06.291 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:06.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:06.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:06.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508775+0000", 2020-11-12T17:24:06.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4838000000000001e-05 2020-11-12T17:24:06.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508810+0000", 2020-11-12T17:24:06.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30211893099999998 2020-11-12T17:24:06.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810929+0000", 2020-11-12T17:24:06.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3546e-05 2020-11-12T17:24:06.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810942+0000", 2020-11-12T17:24:06.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021619539999999998 2020-11-12T17:24:06.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813104+0000", 2020-11-12T17:24:06.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1251999999999998e-05 2020-11-12T17:24:06.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813135+0000", 2020-11-12T17:24:06.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033488000000000002 2020-11-12T17:24:06.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813470+0000", 2020-11-12T17:24:06.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002 2020-11-12T17:24:06.305 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.305 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.306 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.306 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5824 3.f 3:fffe6057:::benchmark_data_smithi036_14212_object727:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:06.307 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.609972+0000", 2020-11-12T17:24:06.307 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.215482092000002, 2020-11-12T17:24:06.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25372203199999999, 2020-11-12T17:24:06.308 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.309 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.310 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5824 2020-11-12T17:24:06.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.311 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.609972+0000", 2020-11-12T17:24:06.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.609972+0000", 2020-11-12T17:24:06.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999547 2020-11-12T17:24:06.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.609926+0000", 2020-11-12T17:24:06.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010851100000000001 2020-11-12T17:24:06.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610035+0000", 2020-11-12T17:24:06.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4929999999999999e-05 2020-11-12T17:24:06.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610050+0000", 2020-11-12T17:24:06.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1506e-05 2020-11-12T17:24:06.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610061+0000", 2020-11-12T17:24:06.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021358999999999999 2020-11-12T17:24:06.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610275+0000", 2020-11-12T17:24:06.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012656000000000001 2020-11-12T17:24:06.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610401+0000", 2020-11-12T17:24:06.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025522899999999999 2020-11-12T17:24:06.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:06.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610657+0000", 2020-11-12T17:24:06.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013916950000000001 2020-11-12T17:24:06.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.612048+0000", 2020-11-12T17:24:06.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25143695199999999 2020-11-12T17:24:06.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863485+0000", 2020-11-12T17:24:06.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114444 2020-11-12T17:24:06.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863600+0000", 2020-11-12T17:24:06.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3911000000000003e-05 2020-11-12T17:24:06.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863694+0000", 2020-11-12T17:24:06.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25372203199999999 2020-11-12T17:24:06.321 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.321 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.321 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.322 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:06.322 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:06.322 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.425256075999997, 2020-11-12T17:24:06.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:24:06.322 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.322 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.323 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.323 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.323 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.323 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:24:06.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.323 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:06.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:06.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:06.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:24:06.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:24:06.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:24:06.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:24:06.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:24:06.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:24:06.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:24:06.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:24:06.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:24:06.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:24:06.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:24:06.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:24:06.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:06.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:24:06.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:24:06.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:24:06.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:24:06.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:24:06.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:24:06.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:24:06.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:24:06.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:24:06.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:24:06.333 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.334 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.335 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.335 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:06.335 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:06.335 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.422809461, 2020-11-12T17:24:06.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:24:06.336 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.336 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.336 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.336 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.336 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.336 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:24:06.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.337 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:06.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:06.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:06.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:24:06.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:24:06.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:24:06.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:24:06.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:24:06.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:24:06.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:24:06.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:24:06.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:24:06.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:24:06.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:24:06.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:24:06.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:06.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:24:06.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:24:06.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:24:06.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:24:06.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:24:06.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:24:06.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:24:06.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:24:06.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:24:06.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:24:06.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.349 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.350 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.351 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:06.351 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:06.351 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.416985013999998, 2020-11-12T17:24:06.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:24:06.352 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.352 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:06.352 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:06.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:06.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:24:06.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:24:06.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:24:06.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:24:06.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:24:06.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:24:06.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:24:06.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:24:06.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:24:06.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:24:06.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:24:06.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:24:06.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:24:06.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:24:06.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:24:06.361 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.361 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.361 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.362 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:06.362 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:06.362 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.416917138000002, 2020-11-12T17:24:06.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:24:06.363 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.363 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:06.363 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:06.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:06.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:06.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:24:06.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:24:06.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:24:06.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:24:06.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:24:06.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:24:06.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:24:06.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:24:06.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:24:06.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:24:06.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:24:06.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:24:06.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:24:06.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:24:06.805 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.805 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.807 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e27)", 2020-11-12T17:24:06.807 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.950158+0000", 2020-11-12T17:24:06.808 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.875295328999997, 2020-11-12T17:24:06.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28929145499999998, 2020-11-12T17:24:06.808 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.809 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:24:06.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.810 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.810 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:24:06.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.811 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950158+0000", 2020-11-12T17:24:06.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950158+0000", 2020-11-12T17:24:06.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999318 2020-11-12T17:24:06.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950090+0000", 2020-11-12T17:24:06.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000168746 2020-11-12T17:24:06.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950259+0000", 2020-11-12T17:24:06.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8829000000000001e-05 2020-11-12T17:24:06.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950288+0000", 2020-11-12T17:24:06.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4751e-05 2020-11-12T17:24:06.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950303+0000", 2020-11-12T17:24:06.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4604999999999995e-05 2020-11-12T17:24:06.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950377+0000", 2020-11-12T17:24:06.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1074000000000003e-05 2020-11-12T17:24:06.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:06.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950468+0000", 2020-11-12T17:24:06.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28898143900000001 2020-11-12T17:24:06.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239450+0000", 2020-11-12T17:24:06.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28929145499999998 2020-11-12T17:24:06.817 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.817 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.817 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.818 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:19000 3.d 3:bfda9947:::benchmark_data_smithi036_14212_object2374:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:24:06.818 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:38.788839+0000", 2020-11-12T17:24:06.818 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.036614809, 2020-11-12T17:24:06.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.266452142, 2020-11-12T17:24:06.818 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.819 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.819 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.819 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.819 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.819 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 19000 2020-11-12T17:24:06.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.819 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788839+0000", 2020-11-12T17:24:06.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788839+0000", 2020-11-12T17:24:06.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:24:06.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788791+0000", 2020-11-12T17:24:06.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012816999999999999 2020-11-12T17:24:06.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788919+0000", 2020-11-12T17:24:06.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3277e-05 2020-11-12T17:24:06.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788932+0000", 2020-11-12T17:24:06.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4920000000000001e-06 2020-11-12T17:24:06.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788938+0000", 2020-11-12T17:24:06.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036962039999999998 2020-11-12T17:24:06.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.792634+0000", 2020-11-12T17:24:06.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017564999999999999 2020-11-12T17:24:06.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.792810+0000", 2020-11-12T17:24:06.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020317999999999999 2020-11-12T17:24:06.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:06.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.793013+0000", 2020-11-12T17:24:06.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037110009999999998 2020-11-12T17:24:06.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796724+0000", 2020-11-12T17:24:06.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25845033099999998 2020-11-12T17:24:06.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055174+0000", 2020-11-12T17:24:06.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1116000000000001e-05 2020-11-12T17:24:06.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055245+0000", 2020-11-12T17:24:06.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5658000000000002e-05 2020-11-12T17:24:06.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055291+0000", 2020-11-12T17:24:06.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.266452142 2020-11-12T17:24:06.829 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.829 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.829 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.830 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:19000 3.d e41/20 ondisk, result = 0)", 2020-11-12T17:24:06.830 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:38.796036+0000", 2020-11-12T17:24:06.830 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.029417666000001, 2020-11-12T17:24:06.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25926142699999999, 2020-11-12T17:24:06.830 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.830 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:06.830 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796036+0000", 2020-11-12T17:24:06.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796036+0000", 2020-11-12T17:24:06.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:24:06.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796018+0000", 2020-11-12T17:24:06.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5039e-05 2020-11-12T17:24:06.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796063+0000", 2020-11-12T17:24:06.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25902876499999999 2020-11-12T17:24:06.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055092+0000", 2020-11-12T17:24:06.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5549999999999997e-06 2020-11-12T17:24:06.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055099+0000", 2020-11-12T17:24:06.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6242000000000001e-05 2020-11-12T17:24:06.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055155+0000", 2020-11-12T17:24:06.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0560000000000001e-05 2020-11-12T17:24:06.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055166+0000", 2020-11-12T17:24:06.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131421 2020-11-12T17:24:06.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055297+0000", 2020-11-12T17:24:06.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25926142699999999 2020-11-12T17:24:06.837 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.837 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.837 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.838 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:24:06.838 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:06.838 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.29092687, 2020-11-12T17:24:06.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:24:06.838 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.838 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.838 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.839 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:24:06.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.839 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:06.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:06.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:24:06.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:24:06.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:24:06.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:24:06.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:24:06.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:24:06.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:24:06.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:24:06.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:24:06.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:24:06.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:24:06.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:24:06.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:24:06.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:06.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:24:06.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:24:06.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:24:06.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:24:06.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:24:06.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:24:06.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:24:06.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:24:06.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:24:06.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:24:06.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.851 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.851 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:24:06.852 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:06.852 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.283623151, 2020-11-12T17:24:06.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:24:06.852 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.852 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:06.852 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:06.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:06.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:06.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:24:06.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:24:06.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:24:06.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:24:06.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:24:06.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:24:06.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:24:06.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:24:06.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:24:06.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:24:06.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:24:06.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:24:06.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:24:06.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:24:06.859 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.859 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.860 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.860 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:06.860 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:06.860 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.910044658, 2020-11-12T17:24:06.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:24:06.861 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.861 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.861 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.861 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.861 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.861 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:24:06.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.862 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:06.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:06.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:06.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:24:06.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:24:06.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:24:06.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:24:06.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:24:06.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:24:06.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:24:06.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:24:06.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:24:06.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:24:06.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:24:06.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:24:06.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:06.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:24:06.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:24:06.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:24:06.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:24:06.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:24:06.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:24:06.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:24:06.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:24:06.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:24:06.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:24:06.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.871 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.872 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:24:06.872 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:06.872 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.898491537999998, 2020-11-12T17:24:06.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:24:06.872 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.872 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:06.872 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:06.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:06.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:06.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:24:06.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:24:06.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:24:06.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:24:06.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:24:06.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:24:06.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:24:06.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:24:06.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:24:06.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:24:06.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:24:06.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:24:06.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:24:06.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:24:06.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.879 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.879 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29991 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:06.879 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.999929+0000", 2020-11-12T17:24:06.880 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 15.825524571000001, 2020-11-12T17:24:06.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.292802063, 2020-11-12T17:24:06.880 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.880 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.880 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.880 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.880 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.880 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29991 2020-11-12T17:24:06.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.881 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.999929+0000", 2020-11-12T17:24:06.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.999929+0000", 2020-11-12T17:24:06.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:24:06.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.999895+0000", 2020-11-12T17:24:06.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010826 2020-11-12T17:24:06.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000003+0000", 2020-11-12T17:24:06.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.504e-05 2020-11-12T17:24:06.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000018+0000", 2020-11-12T17:24:06.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9989999999999997e-06 2020-11-12T17:24:06.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000024+0000", 2020-11-12T17:24:06.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037541160000000001 2020-11-12T17:24:06.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.003778+0000", 2020-11-12T17:24:06.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9364999999999997e-05 2020-11-12T17:24:06.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.003858+0000", 2020-11-12T17:24:06.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124258 2020-11-12T17:24:06.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:06.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.003982+0000", 2020-11-12T17:24:06.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023873649999999998 2020-11-12T17:24:06.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006369+0000", 2020-11-12T17:24:06.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28615247599999999 2020-11-12T17:24:06.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292522+0000", 2020-11-12T17:24:06.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3332999999999998e-05 2020-11-12T17:24:06.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292585+0000", 2020-11-12T17:24:06.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014610400000000001 2020-11-12T17:24:06.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292731+0000", 2020-11-12T17:24:06.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.292802063 2020-11-12T17:24:06.890 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.890 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.890 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.890 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:06.891 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:06.891 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 15.825371357, 2020-11-12T17:24:06.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:24:06.891 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.891 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.891 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.891 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.892 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.892 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:24:06.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.892 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:06.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:06.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:24:06.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:24:06.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:24:06.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:24:06.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:24:06.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:24:06.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:24:06.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:24:06.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:24:06.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:24:06.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:24:06.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:24:06.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:24:06.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:06.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:24:06.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:24:06.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:24:06.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:24:06.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:24:06.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:24:06.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:24:06.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:24:06.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:24:06.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:24:06.901 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.901 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.901 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.902 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:06.902 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:06.902 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.5380716440000004, 2020-11-12T17:24:06.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:24:06.902 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.902 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.902 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.903 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.903 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.903 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:24:06.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.903 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:06.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:06.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:06.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:06.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:24:06.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:24:06.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:06.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:24:06.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:24:06.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:06.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:24:06.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:24:06.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:06.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:24:06.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:24:06.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:06.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:24:06.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:24:06.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:06.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:24:06.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:24:06.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:06.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:24:06.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:24:06.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:06.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:24:06.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:24:06.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:06.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:24:06.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:24:06.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:06.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:24:06.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:24:06.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:06.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:24:06.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:24:06.912 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.912 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:06.912 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:06.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.913 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:06.913 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:06.913 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.9926786539999997, 2020-11-12T17:24:06.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:24:06.913 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:06.913 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:06.914 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:06.914 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:06.914 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:06.914 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:24:06.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.914 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:06.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:06.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:06.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:06.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:06.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:06.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:06.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:06.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:07.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:07.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:24:07.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:24:07.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:07.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:24:07.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:24:07.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:07.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:24:07.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:24:07.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:07.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:24:07.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:24:07.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:07.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:24:07.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:24:07.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:07.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:24:07.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:24:07.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:07.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:24:07.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:24:07.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:07.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:24:07.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:24:07.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:07.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:24:07.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:24:07.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:07.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:24:07.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:24:07.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:07.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:07.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:07.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:24:07.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:24:07.835 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:07.835 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:07.835 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:07.835 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:07.835 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:07.835 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:07.836 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:24:07.837 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:24:07.840 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:24:07.841 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2020-11-12T17:24:05.551850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":332775424,"num_objects":5080,"num_object_clones":0,"num_object_copies":10160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5080,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40624,"num_write_kb":324978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":402,"num_bytes_recovered":26345472,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40624,"ondisk_log_size":40624,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7655108,"kb_used_data":315020,"kb_used_omap":0,"kb_used_meta":7340032,"kb_avail":652947772,"statfs":{"total":676457349120,"available":668618518528,"internally_reserved":7516192768,"allocated":322580480,"data_stored":660163435,"data_compressed":4274908,"data_compressed_allocated":318869504,"data_compressed_original":658735104,"omap_allocated":0,"internal_metadata":7516192768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,2,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35266560,"num_objects":538,"num_object_clones":0,"num_object_copies":1076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4305,"num_write_kb":34440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.143986"},"pg_stats":[{"pgid":"3.f","version":"52'2648","reported_seq":"2687","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.473452+0000","last_change":"2020-11-12T17:23:03.465552+0000","last_active":"2020-11-12T17:24:01.473452+0000","last_peered":"2020-11-12T17:24:01.473452+0000","last_clean":"2020-11-12T17:24:01.473452+0000","last_became_active":"2020-11-12T17:23:03.463508+0000","last_became_peered":"2020-11-12T17:23:03.463508+0000","last_unstale":"2020-11-12T17:24:01.473452+0000","last_undegraded":"2020-11-12T17:24:01.473452+0000","last_fullsized":"2020-11-12T17:24:01.473452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2648,"ondisk_log_size":2648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2648,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"52'2248","reported_seq":"2287","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.543722+0000","last_change":"2020-11-12T17:23:03.464759+0000","last_active":"2020-11-12T17:24:01.543722+0000","last_peered":"2020-11-12T17:24:01.543722+0000","last_clean":"2020-11-12T17:24:01.543722+0000","last_became_active":"2020-11-12T17:23:03.463495+0000","last_became_peered":"2020-11-12T17:23:03.463495+0000","last_unstale":"2020-11-12T17:24:01.543722+0000","last_undegraded":"2020-11-12T17:24:01.543722+0000","last_fullsized":"2020-11-12T17:24:01.543722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2248,"ondisk_log_size":2248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18415616,"num_objects":281,"num_object_clones":0,"num_object_copies":562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2248,"num_write_kb":17984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"51'2328","reported_seq":"2367","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.236149+0000","last_change":"2020-11-12T17:23:03.464197+0000","last_active":"2020-11-12T17:24:01.236149+0000","last_peered":"2020-11-12T17:24:01.236149+0000","last_clean":"2020-11-12T17:24:01.236149+0000","last_became_active":"2020-11-12T17:23:03.463663+0000","last_became_peered":"2020-11-12T17:23:03.463663+0000","last_unstale":"2020-11-12T17:24:01.236149+0000","last_undegraded":"2020-11-12T17:24:01.236149+0000","last_fullsized":"2020-11-12T17:24:01.236149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2328,"ondisk_log_size":2328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19070976,"num_objects":291,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2328,"num_write_kb":18624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"51'2880","reported_seq":"2919","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.891282+0000","last_change":"2020-11-12T17:23:03.464079+0000","last_active":"2020-11-12T17:24:00.891282+0000","last_peered":"2020-11-12T17:24:00.891282+0000","last_clean":"2020-11-12T17:24:00.891282+0000","last_became_active":"2020-11-12T17:23:03.463689+0000","last_became_peered":"2020-11-12T17:23:03.463689+0000","last_unstale":"2020-11-12T17:24:00.891282+0000","last_undegraded":"2020-11-12T17:24:00.891282+0000","last_fullsized":"2020-11-12T17:24:00.891282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2880,"ondisk_log_size":2880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":360,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2880,"num_write_kb":23040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"51'2632","reported_seq":"2670","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.153923+0000","last_change":"2020-11-12T17:23:03.462347+0000","last_active":"2020-11-12T17:24:01.153923+0000","last_peered":"2020-11-12T17:24:01.153923+0000","last_clean":"2020-11-12T17:24:01.153923+0000","last_became_active":"2020-11-12T17:23:03.461922+0000","last_became_peered":"2020-11-12T17:23:03.461922+0000","last_unstale":"2020-11-12T17:24:01.153923+0000","last_undegraded":"2020-11-12T17:24:01.153923+0000","last_fullsized":"2020-11-12T17:24:01.153923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2632,"ondisk_log_size":2632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2632,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"51'2552","reported_seq":"2843","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.566191+0000","last_change":"2020-11-12T17:23:32.849590+0000","last_active":"2020-11-12T17:24:00.566191+0000","last_peered":"2020-11-12T17:24:00.566191+0000","last_clean":"2020-11-12T17:24:00.566191+0000","last_became_active":"2020-11-12T17:23:19.676825+0000","last_became_peered":"2020-11-12T17:23:19.676825+0000","last_unstale":"2020-11-12T17:24:00.566191+0000","last_undegraded":"2020-11-12T17:24:00.566191+0000","last_fullsized":"2020-11-12T17:24:00.566191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2552,"ondisk_log_size":2552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2552,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":7995392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"51'2624","reported_seq":"2897","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.540394+0000","last_change":"2020-11-12T17:23:28.815702+0000","last_active":"2020-11-12T17:24:00.540394+0000","last_peered":"2020-11-12T17:24:00.540394+0000","last_clean":"2020-11-12T17:24:00.540394+0000","last_became_active":"2020-11-12T17:23:27.810569+0000","last_became_peered":"2020-11-12T17:23:27.810569+0000","last_unstale":"2020-11-12T17:24:00.540394+0000","last_undegraded":"2020-11-12T17:24:00.540394+0000","last_fullsized":"2020-11-12T17:24:00.540394+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2624,"ondisk_log_size":2624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2624,"num_write_kb":20992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":7405568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"52'2694","reported_seq":"2731","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.579660+0000","last_change":"2020-11-12T17:23:03.467661+0000","last_active":"2020-11-12T17:24:01.579660+0000","last_peered":"2020-11-12T17:24:01.579660+0000","last_clean":"2020-11-12T17:24:01.579660+0000","last_became_active":"2020-11-12T17:23:03.466462+0000","last_became_peered":"2020-11-12T17:23:03.466462+0000","last_unstale":"2020-11-12T17:24:01.579660+0000","last_undegraded":"2020-11-12T17:24:01.579660+0000","last_fullsized":"2020-11-12T17:24:01.579660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2694,"ondisk_log_size":2694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22069248,"num_objects":337,"num_object_clones":0,"num_object_copies":674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":337,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2694,"num_write_kb":21552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"42","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.414698+0000","last_change":"2020-11-12T17:22:51.722504+0000","last_active":"2020-11-12T17:23:58.414698+0000","last_peered":"2020-11-12T17:23:58.414698+0000","last_clean":"2020-11-12T17:23:58.414698+0000","last_became_active":"2020-11-12T17:22:51.721744+0000","last_became_peered":"2020-11-12T17:22:51.721744+0000","last_unstale":"2020-11-12T17:23:58.414698+0000","last_undegraded":"2020-11-12T17:23:58.414698+0000","last_fullsized":"2020-11-12T17:23:58.414698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"52'2472","reported_seq":"2511","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.482078+0000","last_change":"2020-11-12T17:23:03.464833+0000","last_active":"2020-11-12T17:24:01.482078+0000","last_peered":"2020-11-12T17:24:01.482078+0000","last_clean":"2020-11-12T17:24:01.482078+0000","last_became_active":"2020-11-12T17:23:03.464444+0000","last_became_peered":"2020-11-12T17:23:03.464444+0000","last_unstale":"2020-11-12T17:24:01.482078+0000","last_undegraded":"2020-11-12T17:24:01.482078+0000","last_fullsized":"2020-11-12T17:24:01.482078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2472,"ondisk_log_size":2472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2472,"num_write_kb":19776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"45","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.156515+0000","last_change":"2020-11-12T17:24:00.156515+0000","last_active":"2020-11-12T17:24:00.156515+0000","last_peered":"2020-11-12T17:24:00.156515+0000","last_clean":"2020-11-12T17:24:00.156515+0000","last_became_active":"2020-11-12T17:22:51.355473+0000","last_became_peered":"2020-11-12T17:22:51.355473+0000","last_unstale":"2020-11-12T17:24:00.156515+0000","last_undegraded":"2020-11-12T17:24:00.156515+0000","last_fullsized":"2020-11-12T17:24:00.156515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:00.156362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:00.156362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"51'2552","reported_seq":"2589","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:00.385504+0000","last_change":"2020-11-12T17:23:03.464964+0000","last_active":"2020-11-12T17:24:00.385504+0000","last_peered":"2020-11-12T17:24:00.385504+0000","last_clean":"2020-11-12T17:24:00.385504+0000","last_became_active":"2020-11-12T17:23:03.464617+0000","last_became_peered":"2020-11-12T17:23:03.464617+0000","last_unstale":"2020-11-12T17:24:00.385504+0000","last_undegraded":"2020-11-12T17:24:00.385504+0000","last_fullsized":"2020-11-12T17:24:00.385504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2552,"ondisk_log_size":2552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2552,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"27","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.410767+0000","last_change":"2020-11-12T17:23:27.984703+0000","last_active":"2020-11-12T17:23:58.410767+0000","last_peered":"2020-11-12T17:23:58.410767+0000","last_clean":"2020-11-12T17:23:58.410767+0000","last_became_active":"2020-11-12T17:23:27.983997+0000","last_became_peered":"2020-11-12T17:23:27.983997+0000","last_unstale":"2020-11-12T17:23:58.410767+0000","last_undegraded":"2020-11-12T17:23:58.410767+0000","last_fullsized":"2020-11-12T17:23:58.410767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"51'2288","reported_seq":"2495","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.311592+0000","last_change":"2020-11-12T17:23:28.324736+0000","last_active":"2020-11-12T17:24:01.311592+0000","last_peered":"2020-11-12T17:24:01.311592+0000","last_clean":"2020-11-12T17:24:01.311592+0000","last_became_active":"2020-11-12T17:23:27.951996+0000","last_became_peered":"2020-11-12T17:23:27.951996+0000","last_unstale":"2020-11-12T17:24:01.311592+0000","last_undegraded":"2020-11-12T17:24:01.311592+0000","last_fullsized":"2020-11-12T17:24:01.311592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2288,"ondisk_log_size":2288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":286,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2288,"num_write_kb":18304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":5177344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"50","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.420911+0000","last_change":"2020-11-12T17:23:27.788153+0000","last_active":"2020-11-12T17:23:58.420911+0000","last_peered":"2020-11-12T17:23:58.420911+0000","last_clean":"2020-11-12T17:23:58.420911+0000","last_became_active":"2020-11-12T17:23:27.787364+0000","last_became_peered":"2020-11-12T17:23:27.787364+0000","last_unstale":"2020-11-12T17:23:58.420911+0000","last_undegraded":"2020-11-12T17:23:58.420911+0000","last_fullsized":"2020-11-12T17:23:58.420911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"47","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.416495+0000","last_change":"2020-11-12T17:22:47.070011+0000","last_active":"2020-11-12T17:23:58.416495+0000","last_peered":"2020-11-12T17:23:58.416495+0000","last_clean":"2020-11-12T17:23:58.416495+0000","last_became_active":"2020-11-12T17:22:47.069110+0000","last_became_peered":"2020-11-12T17:22:47.069110+0000","last_unstale":"2020-11-12T17:23:58.416495+0000","last_undegraded":"2020-11-12T17:23:58.416495+0000","last_fullsized":"2020-11-12T17:23:58.416495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:22:42.530591+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"52'2496","reported_seq":"2535","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.575036+0000","last_change":"2020-11-12T17:23:03.467425+0000","last_active":"2020-11-12T17:24:01.575036+0000","last_peered":"2020-11-12T17:24:01.575036+0000","last_clean":"2020-11-12T17:24:01.575036+0000","last_became_active":"2020-11-12T17:23:03.467027+0000","last_became_peered":"2020-11-12T17:23:03.467027+0000","last_unstale":"2020-11-12T17:24:01.575036+0000","last_undegraded":"2020-11-12T17:24:01.575036+0000","last_fullsized":"2020-11-12T17:24:01.575036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2496,"ondisk_log_size":2496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":312,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2496,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"42","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.416320+0000","last_change":"2020-11-12T17:22:51.356607+0000","last_active":"2020-11-12T17:23:58.416320+0000","last_peered":"2020-11-12T17:23:58.416320+0000","last_clean":"2020-11-12T17:23:58.416320+0000","last_became_active":"2020-11-12T17:22:51.356123+0000","last_became_peered":"2020-11-12T17:22:51.356123+0000","last_unstale":"2020-11-12T17:23:58.416320+0000","last_undegraded":"2020-11-12T17:23:58.416320+0000","last_fullsized":"2020-11-12T17:23:58.416320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"51'2552","reported_seq":"2591","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.438102+0000","last_change":"2020-11-12T17:23:03.464134+0000","last_active":"2020-11-12T17:24:01.438102+0000","last_peered":"2020-11-12T17:24:01.438102+0000","last_clean":"2020-11-12T17:24:01.438102+0000","last_became_active":"2020-11-12T17:23:03.462984+0000","last_became_peered":"2020-11-12T17:23:03.462984+0000","last_unstale":"2020-11-12T17:24:01.438102+0000","last_undegraded":"2020-11-12T17:24:01.438102+0000","last_fullsized":"2020-11-12T17:24:01.438102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2552,"ondisk_log_size":2552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2552,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"42","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.416438+0000","last_change":"2020-11-12T17:22:51.723934+0000","last_active":"2020-11-12T17:23:58.416438+0000","last_peered":"2020-11-12T17:23:58.416438+0000","last_clean":"2020-11-12T17:23:58.416438+0000","last_became_active":"2020-11-12T17:22:51.723115+0000","last_became_peered":"2020-11-12T17:22:51.723115+0000","last_unstale":"2020-11-12T17:23:58.416438+0000","last_undegraded":"2020-11-12T17:23:58.416438+0000","last_fullsized":"2020-11-12T17:23:58.416438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"52'2504","reported_seq":"2729","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.530769+0000","last_change":"2020-11-12T17:23:28.145229+0000","last_active":"2020-11-12T17:24:01.530769+0000","last_peered":"2020-11-12T17:24:01.530769+0000","last_clean":"2020-11-12T17:24:01.530769+0000","last_became_active":"2020-11-12T17:23:27.761310+0000","last_became_peered":"2020-11-12T17:23:27.761310+0000","last_unstale":"2020-11-12T17:24:01.530769+0000","last_undegraded":"2020-11-12T17:24:01.530769+0000","last_fullsized":"2020-11-12T17:24:01.530769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2504,"ondisk_log_size":2504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2504,"num_write_kb":20032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":5767168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"51'2552","reported_seq":"2591","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:24:01.219136+0000","last_change":"2020-11-12T17:23:03.462388+0000","last_active":"2020-11-12T17:24:01.219136+0000","last_peered":"2020-11-12T17:24:01.219136+0000","last_clean":"2020-11-12T17:24:01.219136+0000","last_became_active":"2020-11-12T17:23:03.461966+0000","last_became_peered":"2020-11-12T17:23:03.461966+0000","last_unstale":"2020-11-12T17:24:01.219136+0000","last_undegraded":"2020-11-12T17:24:01.219136+0000","last_fullsized":"2020-11-12T17:24:01.219136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2552,"ondisk_log_size":2552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2552,"num_write_kb":20416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"58","reported_epoch":"51","state":"active+clean","last_fresh":"2020-11-12T17:23:58.414709+0000","last_change":"2020-11-12T17:23:15.616888+0000","last_active":"2020-11-12T17:23:58.414709+0000","last_peered":"2020-11-12T17:23:58.414709+0000","last_clean":"2020-11-12T17:23:58.414709+0000","last_became_active":"2020-11-12T17:23:15.616435+0000","last_became_peered":"2020-11-12T17:23:15.616435+0000","last_unstale":"2020-11-12T17:23:58.414709+0000","last_undegraded":"2020-11-12T17:23:58.414709+0000","last_fullsized":"2020-11-12T17:23:58.414709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"32","reported_epoch":"50","state":"active+clean","last_fresh":"2020-11-12T17:23:55.391214+0000","last_change":"2020-11-12T17:23:15.759410+0000","last_active":"2020-11-12T17:23:55.391214+0000","last_peered":"2020-11-12T17:23:55.391214+0000","last_clean":"2020-11-12T17:23:55.391214+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:23:55.391214+0000","last_undegraded":"2020-11-12T17:23:55.391214+0000","last_fullsized":"2020-11-12T17:23:55.391214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"52'2600","reported_seq":"2639","reported_epoch":"52","state":"active+clean","last_fresh":"2020-11-12T17:24:01.564730+0000","last_change":"2020-11-12T17:23:03.465090+0000","last_active":"2020-11-12T17:24:01.564730+0000","last_peered":"2020-11-12T17:24:01.564730+0000","last_clean":"2020-11-12T17:24:01.564730+0000","last_became_active":"2020-11-12T17:23:03.462088+0000","last_became_peered":"2020-11-12T17:23:03.462088+0000","last_unstale":"2020-11-12T17:24:01.564730+0000","last_undegraded":"2020-11-12T17:24:01.564730+0000","last_fullsized":"2020-11-12T17:24:01.564730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":2600,"ondisk_log_size":2600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2600,"num_write_kb":20800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":332775424,"num_objects":5078,"num_object_clones":0,"num_object_copies":10156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40622,"num_write_kb":324976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":402,"num_bytes_recovered":26345472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331063296,"data_stored":683122688,"data_compressed":4436635,"data_compressed_allocated":331063296,"data_compressed_original":683122688,"omap_allocated":0,"internal_metadata":0},"log_size":40622,"ondisk_log_size":40622,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1094824,"kb_used_data":46240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93277016,"statfs":{"total":96636764160,"available":95515664384,"internally_reserved":1073741824,"allocated":47349760,"data_stored":100335454,"data_compressed":630079,"data_compressed_allocated":46825472,"data_compressed_original":100130816,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":1.448},{"interface":"front","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":7.4349999999999996,"5min":7.4349999999999996,"15min":7.4349999999999996},"last":1.048}]},{"osd":1,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.27,"5min":2.27,"15min":2.27},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":7.585,"5min":7.585,"15min":7.585},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.403}]},{"osd":2,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.5289999999999999},{"interface":"front","average":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":7.6310000000000002,"5min":7.6310000000000002,"15min":7.6310000000000002},"last":1.0860000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"min":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.327},{"interface":"front","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":7.5410000000000004,"5min":7.5410000000000004,"15min":7.5410000000000004},"last":1.5980000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":53.758000000000003,"5min":53.758000000000003,"15min":53.758000000000003},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":503.50200000000001,"5min":503.50200000000001,"15min":503.50200000000001},"last":1.284},{"interface":"front","average":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":2.097}]},{"osd":5,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.742,"5min":2.742,"15min":2.742},"min":{"1min":1.45,"5min":1.45,"15min":1.45},"max":{"1min":7.7169999999999996,"5min":7.7169999999999996,"15min":7.7169999999999996},"last":1.514},{"interface":"front","average":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":7.7480000000000002,"5min":7.7480000000000002,"15min":7.7480000000000002},"last":1.5740000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":7.6630000000000003,"5min":7.6630000000000003,"15min":7.6630000000000003},"last":1.365},{"interface":"front","average":{"1min":53.441000000000003,"5min":53.441000000000003,"15min":53.441000000000003},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":975.20899999999995,"5min":975.20899999999995,"15min":975.20899999999995},"last":1.7010000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1097068,"kb_used_data":48484,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93274772,"statfs":{"total":96636764160,"available":95513366528,"internally_reserved":1073741824,"allocated":49647616,"data_stored":103487687,"data_compressed":659919,"data_compressed_allocated":49119232,"data_compressed_original":103284736,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,2,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":1.825,"15min":1.825},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":1.0549999999999999},{"interface":"front","average":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":5.3079999999999998,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.7569999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":5.4329999999999998,"5min":5.4329999999999998,"15min":5.4329999999999998},"last":1.329},{"interface":"front","average":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":8.0969999999999995,"5min":8.0969999999999995,"15min":8.0969999999999995},"last":1.659}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.742,"5min":2.742,"15min":2.742},"min":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":1.6919999999999999},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"min":{"1min":1.024,"5min":1.024,"15min":1.024},"max":{"1min":8.202,"5min":8.202,"15min":8.202},"last":1.8260000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":1.123},{"interface":"front","average":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":1.7290000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.6680000000000001,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.8859999999999999},{"interface":"front","average":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"min":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.26}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":8.5299999999999994,"5min":8.5299999999999994,"15min":8.5299999999999994},"last":3.1880000000000002},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"min":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":1.8}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1108388,"kb_used_data":59804,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93263452,"statfs":{"total":96636764160,"available":95501774848,"internally_reserved":1073741824,"allocated":61239296,"data_stored":121696703,"data_compressed":811413,"data_compressed_allocated":60743680,"data_compressed_original":121495552,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":47.031999999999996,"5min":47.031999999999996,"15min":47.031999999999996},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":948.30899999999997,"5min":948.30899999999997,"15min":948.30899999999997},"last":1.4730000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":9.7530000000000001,"5min":9.7530000000000001,"15min":9.7530000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":162.126,"5min":162.126,"15min":162.126},"last":1.3799999999999999},{"interface":"front","average":{"1min":9.4280000000000008,"5min":9.4280000000000008,"15min":9.4280000000000008},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":163.59899999999999,"5min":163.59899999999999,"15min":163.59899999999999},"last":1.337}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.121},{"interface":"front","average":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":1.8720000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.423,"5min":3.423,"15min":3.423},"last":1.2210000000000001},{"interface":"front","average":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":4.3959999999999999,"5min":4.3959999999999999,"15min":4.3959999999999999},"last":5.2130000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.2729999999999999},{"interface":"front","average":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":1.53}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":33.646999999999998,"5min":33.646999999999998,"15min":33.646999999999998},"min":{"1min":1.218,"5min":1.218,"15min":1.218},"max":{"1min":665.13999999999999,"5min":665.13999999999999,"15min":665.13999999999999},"last":1.7170000000000001},{"interface":"front","average":{"1min":2.242,"5min":2.242,"15min":2.242},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.9199999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":3.6160000000000001,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.7709999999999999},{"interface":"front","average":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.2679999999999998,"5min":3.2679999999999998,"15min":3.2679999999999998},"last":1.8220000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1089272,"kb_used_data":40688,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93282568,"statfs":{"total":96636764160,"available":95521349632,"internally_reserved":1073741824,"allocated":41664512,"data_stored":82438005,"data_compressed":549466,"data_compressed_allocated":41115648,"data_compressed_original":82231296,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.972,"5min":1.972,"15min":1.972},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":1.579}]},{"osd":2,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":33.777999999999999,"5min":33.777999999999999,"15min":33.777999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":509.74799999999999,"5min":509.74799999999999,"15min":509.74799999999999},"last":1.056},{"interface":"front","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.3979999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":1.796,"5min":1.796,"15min":1.796},"min":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.3089999999999999},{"interface":"front","average":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":4.2229999999999999,"5min":4.2229999999999999,"15min":4.2229999999999999},"last":1.4790000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":1.355,"5min":1.355,"15min":1.355},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.024},{"interface":"front","average":{"1min":13.404999999999999,"5min":13.404999999999999,"15min":13.404999999999999},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":185.10400000000001,"5min":185.10400000000001,"15min":185.10400000000001},"last":1.4419999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.306,"5min":2.306,"15min":2.306},"min":{"1min":1.153,"5min":1.153,"15min":1.153},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":1.847},{"interface":"front","average":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"min":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":1.5409999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":3.9279999999999999,"5min":3.9279999999999999,"15min":3.9279999999999999},"last":1.8859999999999999},{"interface":"front","average":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"min":{"1min":1.466,"5min":1.466,"15min":1.466},"max":{"1min":3.6579999999999999,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.623}]},{"osd":7,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"min":{"1min":1.611,"5min":1.611,"15min":1.611},"max":{"1min":3.7120000000000002,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":2.0099999999999998},{"interface":"front","average":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"min":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"max":{"1min":3.6139999999999999,"5min":3.6139999999999999,"15min":3.6139999999999999},"last":1.6879999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1063620,"kb_used_data":15036,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93308220,"statfs":{"total":96636764160,"available":95547617280,"internally_reserved":1073741824,"allocated":15396864,"data_stored":39393646,"data_compressed":205319,"data_compressed_allocated":14864384,"data_compressed_original":39190528,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.768,"15min":1.768},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.042},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"min":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.294}]},{"osd":1,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":2.254,"5min":2.254,"15min":2.254},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.6100000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":9.1400000000000006,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":1.5169999999999999},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"min":{"1min":1.417,"5min":1.417,"15min":1.417},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.3620000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":2.46,"5min":2.46,"15min":2.46},"min":{"1min":1.234,"5min":1.234,"15min":1.234},"max":{"1min":9.2550000000000008,"5min":9.2550000000000008,"15min":9.2550000000000008},"last":1.8500000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"min":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":8.7189999999999994,"5min":8.7189999999999994,"15min":8.7189999999999994},"last":1.4790000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":9.7710000000000008,"5min":9.7710000000000008,"15min":9.7710000000000008},"last":1.401},{"interface":"front","average":{"1min":22.742000000000001,"5min":22.742000000000001,"15min":22.742000000000001},"min":{"1min":1.609,"5min":1.609,"15min":1.609},"max":{"1min":445.34699999999998,"5min":445.34699999999998,"15min":445.34699999999998},"last":2.7639999999999998}]},{"osd":7,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":1.427},{"interface":"front","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":9.3059999999999992,"5min":9.3059999999999992,"15min":9.3059999999999992},"last":1.8069999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1090168,"kb_used_data":41584,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93281672,"statfs":{"total":96636764160,"available":95520432128,"internally_reserved":1073741824,"allocated":42582016,"data_stored":84288462,"data_compressed":561536,"data_compressed_allocated":42041344,"data_compressed_original":84082688,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":66.608000000000004,"5min":66.608000000000004,"15min":66.608000000000004},"last":1.2410000000000001},{"interface":"front","average":{"1min":5.3899999999999997,"5min":5.3899999999999997,"15min":5.3899999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":67.099999999999994,"5min":67.099999999999994,"15min":67.099999999999994},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":54.027000000000001,"5min":54.027000000000001,"15min":54.027000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":995.93899999999996,"5min":995.93899999999996,"15min":995.93899999999996},"last":1.298},{"interface":"front","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":0.82099999999999995}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":15.675000000000001,"5min":15.675000000000001,"15min":15.675000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":269.27100000000002,"5min":269.27100000000002,"15min":269.27100000000002},"last":1.4690000000000001},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"min":{"1min":1.399,"5min":1.399,"15min":1.399},"max":{"1min":3.2839999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.704}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":5.008},{"interface":"front","average":{"1min":1.944,"5min":1.944,"15min":1.944},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":1.2090000000000001},{"interface":"front","average":{"1min":50.664999999999999,"5min":50.664999999999999,"15min":50.664999999999999},"min":{"1min":1.23,"5min":1.23,"15min":1.23},"max":{"1min":920.76900000000001,"5min":920.76900000000001,"15min":920.76900000000001},"last":1.7490000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":1.7929999999999999},{"interface":"front","average":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.738,"5min":3.738,"15min":3.738},"last":1.3500000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":29.132999999999999,"5min":29.132999999999999,"15min":29.132999999999999},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":502.12900000000002,"5min":502.12900000000002,"15min":502.12900000000002},"last":1.609},{"interface":"front","average":{"1min":49.103999999999999,"5min":49.103999999999999,"15min":49.103999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":502.42099999999999,"5min":502.42099999999999,"15min":502.42099999999999},"last":1.514}]}]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1111768,"kb_used_data":63184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93260072,"statfs":{"total":96636764160,"available":95498313728,"internally_reserved":1073741824,"allocated":64700416,"data_stored":128523478,"data_compressed":857176,"data_compressed_allocated":64159744,"data_compressed_original":128319488,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.798,"15min":1.798},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":4.4290000000000003,"5min":4.4290000000000003,"15min":4.4290000000000003},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":10.403,"5min":10.403,"15min":10.403},"last":1.3939999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":22.77,"5min":22.77,"15min":22.77},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":440.65899999999999,"5min":440.65899999999999,"15min":440.65899999999999},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.839,"5min":1.839,"15min":1.839},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":1.8009999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":2.347,"15min":2.347},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":4.9740000000000002,"5min":4.9740000000000002,"15min":4.9740000000000002},"last":1.452},{"interface":"front","average":{"1min":1.994,"5min":1.994,"15min":1.994},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":3.7389999999999999,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":1.131}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.5409999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":10.318,"5min":10.318,"15min":10.318},"last":2.3809999999999998},{"interface":"front","average":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":1.4970000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":32.210000000000001,"5min":32.210000000000001,"15min":32.210000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":622.07799999999997,"5min":622.07799999999997,"15min":622.07799999999997},"last":1.756},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"max":{"1min":10.436,"5min":10.436,"15min":10.436},"last":2.4319999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.625,"5min":2.625,"15min":2.625},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":5.0419999999999998,"5min":5.0419999999999998,"15min":5.0419999999999998},"last":1.516},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":11.497999999999999,"5min":11.497999999999999,"15min":11.497999999999999},"last":1.831}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":10.513999999999999,"5min":10.513999999999999,"15min":10.513999999999999},"last":2.4809999999999999},{"interface":"front","average":{"1min":30.190000000000001,"5min":30.190000000000001,"15min":30.190000000000001},"min":{"1min":1.101,"5min":1.101,"15min":1.101},"max":{"1min":577.35900000000004,"5min":577.35900000000004,"15min":577.35900000000004},"last":1.728}]}]}]}} 2020-11-12T17:24:07.842 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:24:07.847 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-12T17:24:07.847 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 62 16 45119 45103 5.68277 6.48438 0.0173175 0.0219866 2020-11-12T17:24:07.847 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 63 15 46086 46071 5.7126 7.5625 0.0113462 0.0218702 2020-11-12T17:24:07.848 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:07.832+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:07.849 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:07.938 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:07.934+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:08.039 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:08.039 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:08.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.040 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:46535 3.1 3:8795e6cc:::benchmark_data_smithi036_14212_object5816:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:08.040 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:08.019909+0000", 2020-11-12T17:24:08.040 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.017122136999999999, 2020-11-12T17:24:08.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017148864, 2020-11-12T17:24:08.040 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:08.040 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:08.041 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:08.041 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:08.041 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:08.041 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 46535 2020-11-12T17:24:08.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.041 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:08.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:08.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.019909+0000", 2020-11-12T17:24:08.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:08.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:08.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.019909+0000", 2020-11-12T17:24:08.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:24:08.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:08.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.019878+0000", 2020-11-12T17:24:08.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7208999999999998e-05 2020-11-12T17:24:08.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:08.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.019965+0000", 2020-11-12T17:24:08.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.503e-05 2020-11-12T17:24:08.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:08.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.019980+0000", 2020-11-12T17:24:08.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2889999999999997e-06 2020-11-12T17:24:08.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:08.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.019985+0000", 2020-11-12T17:24:08.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0094125589999999992 2020-11-12T17:24:08.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:08.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.029398+0000", 2020-11-12T17:24:08.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010848700000000001 2020-11-12T17:24:08.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:08.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.029506+0000", 2020-11-12T17:24:08.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021074700000000001 2020-11-12T17:24:08.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:08.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.029717+0000", 2020-11-12T17:24:08.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055336200000000004 2020-11-12T17:24:08.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:08.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.035251+0000", 2020-11-12T17:24:08.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015341894 2020-11-12T17:24:08.050 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:08.050 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:08.050 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:08.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.051 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:46536 3.1 3:8795e6cc:::benchmark_data_smithi036_14212_object5816:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:08.051 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:08.020036+0000", 2020-11-12T17:24:08.051 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.016994627000000002, 2020-11-12T17:24:08.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017100163000000002, 2020-11-12T17:24:08.051 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:08.051 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:08.052 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:08.052 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:08.052 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:08.052 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 46536 2020-11-12T17:24:08.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.052 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:08.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:08.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.020036+0000", 2020-11-12T17:24:08.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:08.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:08.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.020036+0000", 2020-11-12T17:24:08.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:24:08.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:08.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.020006+0000", 2020-11-12T17:24:08.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3240999999999997e-05 2020-11-12T17:24:08.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:08.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.020099+0000", 2020-11-12T17:24:08.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3091000000000001e-05 2020-11-12T17:24:08.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:08.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.020112+0000", 2020-11-12T17:24:08.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3900000000000004e-06 2020-11-12T17:24:08.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:08.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.020120+0000", 2020-11-12T17:24:08.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01175666 2020-11-12T17:24:08.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:08.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.031876+0000", 2020-11-12T17:24:08.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013138200000000001 2020-11-12T17:24:08.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:08.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.032008+0000", 2020-11-12T17:24:08.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100809 2020-11-12T17:24:08.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:08.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.032108+0000", 2020-11-12T17:24:08.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042659580000000002 2020-11-12T17:24:08.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:08.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:08.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:08.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:08.036374+0000", 2020-11-12T17:24:08.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016338275999999999 2020-11-12T17:24:08.060 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:08.061 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:08.061 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:08.061 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:08.061 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:24:08.061 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 2 2020-11-12T17:24:08.061 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:08.062 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:08.034+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:08.063 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:08.081 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:08.116 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:24:08.140 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:08.134+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:08.160 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:08.193 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:08.204 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:08.204 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:08.218 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:08.230 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:08.242 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:08.238+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:08.261 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:08.294 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:08.335 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:08.337 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:24:08.338 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:24:08.338 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:24:08.426 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:24:08.427 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:24:08.427 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:24:08.427 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:24:08.427 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:24:08.429 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:24:08.430 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:08.430 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:08.431 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:24:08.432 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:08.424+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:08.530 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:08.526+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:08.568 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 64 16 46926 46910 5.72575 6.55469 0.0187396 0.0218087 2020-11-12T17:24:08.596 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:08.596 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:08.606 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:24:08.632 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:08.626+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:08.732 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:08.732 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:08.733 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:08.724+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:08.744 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:24:08.840 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:08.834+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:08.908 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:08.909 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:08.921 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:24:08.941 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:08.938+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:09.043 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:09.036+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:09.047 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:09.047 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:09.059 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:24:09.144 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:09.138+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:09.233 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:09.234 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:09.244 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:24:09.246 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:09.240+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:09.347 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:09.340+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:09.378 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:09.380 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:09.391 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:09.472 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:09.464+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:09.568 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 65 16 47784 47768 5.74078 6.70312 0.0107392 0.0217529 2020-11-12T17:24:09.573 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:09.570+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:09.602 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:09.603 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:09.612 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:09.674 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:09.668+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:09.721 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:09.722 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:09.731 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:09.817 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:09.812+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:09.877 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:09.872+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:09.897 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:09.898 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:09.913 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:09.979 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:09.974+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:10.044 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:10.045 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:10.056 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:10.098 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:10.094+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:10.180 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:10.174+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:10.216 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:10.216 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:10.224 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:10.317 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:10.314+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:10.384 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:10.376+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:10.393 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:10.395 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:10.407 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:10.433 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:24:10.434 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:24:10.493 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:10.490+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:10.568 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 66 16 48615 48599 5.75215 6.49219 0.0106535 0.0217196 2020-11-12T17:24:10.583 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:10.683 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:10.686 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:10.687 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:24:10.687 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:10.687 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:10.680+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:10.688 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:10.714 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:10.756 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:10.786 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:10.780+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:10.790 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:10.822 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:10.855 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:10.856 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:24:10.856 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:24:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:24:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:24:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:24:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:24:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:24:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:24:10.868 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:10.869 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:10.869 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:10.869 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:10.870 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:10.881 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:10.894 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:10.890+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:10.995 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:10.988+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:11.012 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:11.013 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:11.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:11.013 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:11.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.013 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:24:11.014 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:11.014 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 60.506259849999999, 2020-11-12T17:24:11.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:24:11.014 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.014 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.014 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:11.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:11.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:11.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:24:11.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:24:11.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:24:11.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:24:11.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:24:11.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:24:11.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:24:11.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:24:11.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:24:11.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:24:11.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:24:11.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:24:11.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:24:11.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:24:11.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:24:11.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:24:11.024 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.024 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.024 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.025 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:11.025 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:11.025 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.484250285000002, 2020-11-12T17:24:11.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:24:11.025 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.025 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.025 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.026 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.026 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.026 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:24:11.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.026 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:11.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:11.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:11.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:24:11.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:24:11.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:24:11.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:24:11.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:24:11.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:24:11.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:24:11.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:24:11.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:24:11.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:24:11.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:24:11.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:24:11.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:11.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:24:11.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:24:11.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:24:11.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:24:11.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:24:11.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:24:11.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:24:11.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:24:11.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:24:11.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:24:11.039 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.041 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.041 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.041 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:24:11.042 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:11.042 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.480850351000001, 2020-11-12T17:24:11.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:24:11.042 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.042 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:11.042 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:11.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:11.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:11.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:24:11.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:24:11.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:24:11.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:24:11.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:24:11.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:24:11.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:24:11.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:24:11.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:24:11.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:24:11.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:24:11.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:24:11.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:24:11.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:24:11.049 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.049 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.050 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.050 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:24744 3.4 e45/35 3:27e37414:::benchmark_data_smithi036_14212_object3092:head v 45'1584, mlcod=45'1580)", 2020-11-12T17:24:11.050 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:24:11.050 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.329935208999999, 2020-11-12T17:24:11.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999, 2020-11-12T17:24:11.051 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.051 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.051 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:24:11.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680553+0000", 2020-11-12T17:24:11.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:24:11.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680526+0000", 2020-11-12T17:24:11.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3724e-05 2020-11-12T17:24:11.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.680609+0000", 2020-11-12T17:24:11.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.154293649 2020-11-12T17:24:11.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834903+0000", 2020-11-12T17:24:11.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1653e-05 2020-11-12T17:24:11.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834915+0000", 2020-11-12T17:24:11.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5685000000000006e-05 2020-11-12T17:24:11.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.834980+0000", 2020-11-12T17:24:11.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4757e-05 2020-11-12T17:24:11.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.835005+0000", 2020-11-12T17:24:11.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001426067 2020-11-12T17:24:11.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836431+0000", 2020-11-12T17:24:11.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5732999999999997e-05 2020-11-12T17:24:11.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.836477+0000", 2020-11-12T17:24:11.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15592349599999999 2020-11-12T17:24:11.057 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.058 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.058 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.058 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:28560 3.4 e47/35 3:202f80a5:::benchmark_data_smithi036_14212_object3569:head v 47'1808, mlcod=47'1801)", 2020-11-12T17:24:11.058 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:11.058 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.348133835999999, 2020-11-12T17:24:11.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697, 2020-11-12T17:24:11.059 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.059 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.059 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:11.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:11.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:11.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662339+0000", 2020-11-12T17:24:11.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9332000000000001e-05 2020-11-12T17:24:11.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662389+0000", 2020-11-12T17:24:11.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.240093907 2020-11-12T17:24:11.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902482+0000", 2020-11-12T17:24:11.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1109999999999996e-06 2020-11-12T17:24:11.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902489+0000", 2020-11-12T17:24:11.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0870000000000004e-05 2020-11-12T17:24:11.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902559+0000", 2020-11-12T17:24:11.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2245e-05 2020-11-12T17:24:11.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902592+0000", 2020-11-12T17:24:11.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029425010000000001 2020-11-12T17:24:11.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905534+0000", 2020-11-12T17:24:11.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8211e-05 2020-11-12T17:24:11.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905622+0000", 2020-11-12T17:24:11.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697 2020-11-12T17:24:11.066 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.067 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.067 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.067 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29088 3.4 e47/35 3:2728cac2:::benchmark_data_smithi036_14212_object3635:head v 47'1856, mlcod=47'1851)", 2020-11-12T17:24:11.067 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:24:11.067 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.908404965999999, 2020-11-12T17:24:11.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15063083799999999, 2020-11-12T17:24:11.068 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.068 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.068 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:24:11.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102084+0000", 2020-11-12T17:24:11.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:11.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102067+0000", 2020-11-12T17:24:11.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8427000000000002e-05 2020-11-12T17:24:11.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.102126+0000", 2020-11-12T17:24:11.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.145643039 2020-11-12T17:24:11.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247769+0000", 2020-11-12T17:24:11.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5070000000000003e-06 2020-11-12T17:24:11.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247776+0000", 2020-11-12T17:24:11.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9156000000000002e-05 2020-11-12T17:24:11.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247825+0000", 2020-11-12T17:24:11.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9045999999999999e-05 2020-11-12T17:24:11.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.247854+0000", 2020-11-12T17:24:11.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004802054 2020-11-12T17:24:11.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.252656+0000", 2020-11-12T17:24:11.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8059000000000001e-05 2020-11-12T17:24:11.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.252714+0000", 2020-11-12T17:24:11.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.15063083799999999 2020-11-12T17:24:11.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.075 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.075 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29440 3.4 e48/35 3:252d7780:::benchmark_data_smithi036_14212_object3679:head v 48'1880, mlcod=48'1871)", 2020-11-12T17:24:11.075 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:11.076 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.612502545000002, 2020-11-12T17:24:11.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999, 2020-11-12T17:24:11.076 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.076 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.076 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:11.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:11.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:11.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397961+0000", 2020-11-12T17:24:11.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5236999999999997e-05 2020-11-12T17:24:11.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.398046+0000", 2020-11-12T17:24:11.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23963379700000001 2020-11-12T17:24:11.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637680+0000", 2020-11-12T17:24:11.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.824e-06 2020-11-12T17:24:11.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637687+0000", 2020-11-12T17:24:11.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4215999999999998e-05 2020-11-12T17:24:11.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637732+0000", 2020-11-12T17:24:11.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8510000000000001e-05 2020-11-12T17:24:11.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637750+0000", 2020-11-12T17:24:11.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012233260000000001 2020-11-12T17:24:11.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.638973+0000", 2020-11-12T17:24:11.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8594999999999998e-05 2020-11-12T17:24:11.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.639022+0000", 2020-11-12T17:24:11.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999 2020-11-12T17:24:11.083 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.083 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.084 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29784 3.d e48/20 3:be9adc0e:::benchmark_data_smithi036_14212_object3722:head v 48'1664, mlcod=48'1656)", 2020-11-12T17:24:11.084 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:24:11.084 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.233804770999999, 2020-11-12T17:24:11.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20712350500000001, 2020-11-12T17:24:11.085 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.085 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.085 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:24:11.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776684+0000", 2020-11-12T17:24:11.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:24:11.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776662+0000", 2020-11-12T17:24:11.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6710000000000002e-05 2020-11-12T17:24:11.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.776749+0000", 2020-11-12T17:24:11.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20445004899999999 2020-11-12T17:24:11.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981199+0000", 2020-11-12T17:24:11.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:24:11.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981207+0000", 2020-11-12T17:24:11.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8742999999999997e-05 2020-11-12T17:24:11.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981256+0000", 2020-11-12T17:24:11.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9745999999999999e-05 2020-11-12T17:24:11.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.981285+0000", 2020-11-12T17:24:11.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024615840000000002 2020-11-12T17:24:11.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.983747+0000", 2020-11-12T17:24:11.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0350999999999999e-05 2020-11-12T17:24:11.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.983807+0000", 2020-11-12T17:24:11.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20712350500000001 2020-11-12T17:24:11.091 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.091 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.092 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.092 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29991 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1679, mlcod=48'1673)", 2020-11-12T17:24:11.092 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:11.092 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.006324657, 2020-11-12T17:24:11.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001, 2020-11-12T17:24:11.092 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.093 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.093 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:11.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:11.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:11.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004127+0000", 2020-11-12T17:24:11.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012464900000000001 2020-11-12T17:24:11.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004251+0000", 2020-11-12T17:24:11.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28639012600000002 2020-11-12T17:24:11.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290641+0000", 2020-11-12T17:24:11.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:24:11.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290646+0000", 2020-11-12T17:24:11.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2363000000000002e-05 2020-11-12T17:24:11.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290679+0000", 2020-11-12T17:24:11.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3289999999999999e-05 2020-11-12T17:24:11.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290702+0000", 2020-11-12T17:24:11.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014675440000000001 2020-11-12T17:24:11.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292170+0000", 2020-11-12T17:24:11.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6585000000000001e-05 2020-11-12T17:24:11.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292226+0000", 2020-11-12T17:24:11.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001 2020-11-12T17:24:11.099 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.099 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.100 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.100 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:24:11.100 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:11.100 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.004960904000001, 2020-11-12T17:24:11.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:24:11.100 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.101 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.101 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:11.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:11.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:24:11.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:24:11.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:24:11.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:24:11.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:24:11.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:24:11.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:24:11.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:24:11.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:24:11.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:24:11.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:24:11.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:24:11.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:24:11.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:24:11.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:24:11.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:24:11.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:24:11.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.108 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.109 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30039 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1927, mlcod=48'1921)", 2020-11-12T17:24:11.109 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:11.109 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.945682226999999, 2020-11-12T17:24:11.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001, 2020-11-12T17:24:11.110 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.110 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.110 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:11.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:11.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999409 2020-11-12T17:24:11.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064747+0000", 2020-11-12T17:24:11.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019364299999999999 2020-11-12T17:24:11.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064941+0000", 2020-11-12T17:24:11.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.212994778 2020-11-12T17:24:11.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277936+0000", 2020-11-12T17:24:11.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7939999999999997e-06 2020-11-12T17:24:11.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277945+0000", 2020-11-12T17:24:11.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032420940000000001 2020-11-12T17:24:11.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281187+0000", 2020-11-12T17:24:11.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3390000000000001e-05 2020-11-12T17:24:11.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281211+0000", 2020-11-12T17:24:11.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062069380000000004 2020-11-12T17:24:11.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287418+0000", 2020-11-12T17:24:11.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109126 2020-11-12T17:24:11.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287527+0000", 2020-11-12T17:24:11.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001 2020-11-12T17:24:11.117 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.117 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.117 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.117 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30040 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1928, mlcod=48'1921)", 2020-11-12T17:24:11.117 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:11.117 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.944063476, 2020-11-12T17:24:11.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277, 2020-11-12T17:24:11.118 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.118 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.118 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:11.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:11.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:24:11.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066369+0000", 2020-11-12T17:24:11.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185513 2020-11-12T17:24:11.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066555+0000", 2020-11-12T17:24:11.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22267770000000001 2020-11-12T17:24:11.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289233+0000", 2020-11-12T17:24:11.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5750000000000001e-06 2020-11-12T17:24:11.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289236+0000", 2020-11-12T17:24:11.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7205e-05 2020-11-12T17:24:11.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289283+0000", 2020-11-12T17:24:11.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0210000000000001e-05 2020-11-12T17:24:11.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289304+0000", 2020-11-12T17:24:11.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018794020000000001 2020-11-12T17:24:11.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291183+0000", 2020-11-12T17:24:11.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2386999999999998e-05 2020-11-12T17:24:11.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291235+0000", 2020-11-12T17:24:11.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277 2020-11-12T17:24:11.125 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.125 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.125 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.125 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:33768 3.d e49/20 3:bed94f4a:::benchmark_data_smithi036_14212_object4220:head v 49'1880, mlcod=49'1874)", 2020-11-12T17:24:11.125 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:11.125 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.095917856, 2020-11-12T17:24:11.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001, 2020-11-12T17:24:11.126 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.126 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.126 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:11.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:11.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:24:11.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914530+0000", 2020-11-12T17:24:11.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013119499999999999 2020-11-12T17:24:11.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914662+0000", 2020-11-12T17:24:11.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26915680600000003 2020-11-12T17:24:11.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183818+0000", 2020-11-12T17:24:11.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.61e-06 2020-11-12T17:24:11.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183826+0000", 2020-11-12T17:24:11.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2031999999999999e-05 2020-11-12T17:24:11.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183878+0000", 2020-11-12T17:24:11.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1192999999999998e-05 2020-11-12T17:24:11.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183909+0000", 2020-11-12T17:24:11.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055133250000000003 2020-11-12T17:24:11.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189422+0000", 2020-11-12T17:24:11.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4030999999999997e-05 2020-11-12T17:24:11.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189486+0000", 2020-11-12T17:24:11.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001 2020-11-12T17:24:11.133 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.133 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.133 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.134 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:38792 3.d e51/20 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head v 51'2208, mlcod=51'2199)", 2020-11-12T17:24:11.134 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.295493+0000", 2020-11-12T17:24:11.134 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.714995070000001, 2020-11-12T17:24:11.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.172836036, 2020-11-12T17:24:11.134 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.134 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.135 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295493+0000", 2020-11-12T17:24:11.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295493+0000", 2020-11-12T17:24:11.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:11.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295471+0000", 2020-11-12T17:24:11.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4578000000000003e-05 2020-11-12T17:24:11.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295546+0000", 2020-11-12T17:24:11.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16980322 2020-11-12T17:24:11.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.465349+0000", 2020-11-12T17:24:11.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4039999999999997e-06 2020-11-12T17:24:11.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.465354+0000", 2020-11-12T17:24:11.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0809999999999997e-05 2020-11-12T17:24:11.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.465394+0000", 2020-11-12T17:24:11.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0864000000000001e-05 2020-11-12T17:24:11.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.465425+0000", 2020-11-12T17:24:11.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028509049999999999 2020-11-12T17:24:11.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.468276+0000", 2020-11-12T17:24:11.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3350999999999998e-05 2020-11-12T17:24:11.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.468329+0000", 2020-11-12T17:24:11.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.172836036 2020-11-12T17:24:11.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.141 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.142 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39056 3.c 3:315372a6:::benchmark_data_smithi036_14212_object4881:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:11.142 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.550372+0000", 2020-11-12T17:24:11.142 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.460116808, 2020-11-12T17:24:11.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.138729355, 2020-11-12T17:24:11.142 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.142 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.143 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39056 2020-11-12T17:24:11.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.143 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550372+0000", 2020-11-12T17:24:11.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550372+0000", 2020-11-12T17:24:11.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:11.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550336+0000", 2020-11-12T17:24:11.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012995500000000001 2020-11-12T17:24:11.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550466+0000", 2020-11-12T17:24:11.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2802999999999999e-05 2020-11-12T17:24:11.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550479+0000", 2020-11-12T17:24:11.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7909999999999999e-06 2020-11-12T17:24:11.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.550488+0000", 2020-11-12T17:24:11.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077249559999999998 2020-11-12T17:24:11.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.558213+0000", 2020-11-12T17:24:11.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131884 2020-11-12T17:24:11.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.558345+0000", 2020-11-12T17:24:11.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025711799999999997 2020-11-12T17:24:11.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:11.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.558602+0000", 2020-11-12T17:24:11.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002521868 2020-11-12T17:24:11.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.561124+0000", 2020-11-12T17:24:11.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.12785993700000001 2020-11-12T17:24:11.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.688984+0000", 2020-11-12T17:24:11.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1707999999999999e-05 2020-11-12T17:24:11.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.689056+0000", 2020-11-12T17:24:11.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.515e-05 2020-11-12T17:24:11.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.689101+0000", 2020-11-12T17:24:11.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.138729355 2020-11-12T17:24:11.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.152 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.152 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:24:11.152 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:11.153 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.172266938, 2020-11-12T17:24:11.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:24:11.153 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.153 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.153 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:11.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:11.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:11.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:24:11.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:24:11.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:24:11.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:24:11.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:24:11.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:24:11.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:24:11.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:24:11.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:24:11.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:24:11.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:24:11.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:24:11.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:24:11.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:24:11.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:24:11.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:24:11.171 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.172 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.172 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.172 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39662 3.c 3:34828e81:::benchmark_data_smithi036_14212_object4957:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:11.172 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.159592+0000", 2020-11-12T17:24:11.172 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.850896044000001, 2020-11-12T17:24:11.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.146164711, 2020-11-12T17:24:11.173 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.173 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.173 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.173 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.173 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.173 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39662 2020-11-12T17:24:11.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.174 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159592+0000", 2020-11-12T17:24:11.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159592+0000", 2020-11-12T17:24:11.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:11.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159557+0000", 2020-11-12T17:24:11.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102655 2020-11-12T17:24:11.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159659+0000", 2020-11-12T17:24:11.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4496999999999999e-05 2020-11-12T17:24:11.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159684+0000", 2020-11-12T17:24:11.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1528e-05 2020-11-12T17:24:11.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.159695+0000", 2020-11-12T17:24:11.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042118199999999998 2020-11-12T17:24:11.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.163907+0000", 2020-11-12T17:24:11.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9568999999999997e-05 2020-11-12T17:24:11.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.163987+0000", 2020-11-12T17:24:11.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000140323 2020-11-12T17:24:11.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:11.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.164127+0000", 2020-11-12T17:24:11.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004264065 2020-11-12T17:24:11.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.168391+0000", 2020-11-12T17:24:11.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13708895199999999 2020-11-12T17:24:11.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.305480+0000", 2020-11-12T17:24:11.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015309500000000001 2020-11-12T17:24:11.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.305633+0000", 2020-11-12T17:24:11.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012395099999999999 2020-11-12T17:24:11.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.305757+0000", 2020-11-12T17:24:11.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.146164711 2020-11-12T17:24:11.190 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.190 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.190 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.191 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39663 3.c 3:34828e81:::benchmark_data_smithi036_14212_object4957:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:11.191 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.162688+0000", 2020-11-12T17:24:11.191 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.847800574000001, 2020-11-12T17:24:11.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14354562100000001, 2020-11-12T17:24:11.191 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.191 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.192 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.192 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.192 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.192 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39663 2020-11-12T17:24:11.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.192 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162688+0000", 2020-11-12T17:24:11.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162688+0000", 2020-11-12T17:24:11.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999514 2020-11-12T17:24:11.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162639+0000", 2020-11-12T17:24:11.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012288800000000001 2020-11-12T17:24:11.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162762+0000", 2020-11-12T17:24:11.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5840000000000001e-05 2020-11-12T17:24:11.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162778+0000", 2020-11-12T17:24:11.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6270000000000006e-06 2020-11-12T17:24:11.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162786+0000", 2020-11-12T17:24:11.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026948430000000002 2020-11-12T17:24:11.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.165481+0000", 2020-11-12T17:24:11.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1893999999999998e-05 2020-11-12T17:24:11.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.165573+0000", 2020-11-12T17:24:11.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014403800000000001 2020-11-12T17:24:11.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:11.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.165717+0000", 2020-11-12T17:24:11.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026869799999999998 2020-11-12T17:24:11.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.168404+0000", 2020-11-12T17:24:11.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13750731999999999 2020-11-12T17:24:11.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.305912+0000", 2020-11-12T17:24:11.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018462799999999999 2020-11-12T17:24:11.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306096+0000", 2020-11-12T17:24:11.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013736299999999999 2020-11-12T17:24:11.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306234+0000", 2020-11-12T17:24:11.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14354562100000001 2020-11-12T17:24:11.202 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.202 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.202 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.203 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39664 3.c 3:34828e81:::benchmark_data_smithi036_14212_object4957:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:11.203 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.162891+0000", 2020-11-12T17:24:11.203 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.847597449, 2020-11-12T17:24:11.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14365513099999999, 2020-11-12T17:24:11.203 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.203 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.203 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.204 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.204 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.204 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39664 2020-11-12T17:24:11.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.204 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162891+0000", 2020-11-12T17:24:11.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162891+0000", 2020-11-12T17:24:11.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999337 2020-11-12T17:24:11.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162825+0000", 2020-11-12T17:24:11.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014095500000000001 2020-11-12T17:24:11.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162966+0000", 2020-11-12T17:24:11.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3232e-05 2020-11-12T17:24:11.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162979+0000", 2020-11-12T17:24:11.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5520000000000001e-06 2020-11-12T17:24:11.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.162986+0000", 2020-11-12T17:24:11.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039515590000000003 2020-11-12T17:24:11.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.166937+0000", 2020-11-12T17:24:11.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8456999999999996e-05 2020-11-12T17:24:11.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.167036+0000", 2020-11-12T17:24:11.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015110500000000001 2020-11-12T17:24:11.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:11.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.167187+0000", 2020-11-12T17:24:11.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019868120000000001 2020-11-12T17:24:11.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.169174+0000", 2020-11-12T17:24:11.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13717552699999999 2020-11-12T17:24:11.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306349+0000", 2020-11-12T17:24:11.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6019000000000004e-05 2020-11-12T17:24:11.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306435+0000", 2020-11-12T17:24:11.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111123 2020-11-12T17:24:11.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.306546+0000", 2020-11-12T17:24:11.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.14365513099999999 2020-11-12T17:24:11.213 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.213 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.213 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.213 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:40088 3.2 e51/20 3:4e1f0a94:::benchmark_data_smithi036_14212_object5010:head v 51'2448, mlcod=51'2442)", 2020-11-12T17:24:11.214 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.706900+0000", 2020-11-12T17:24:11.214 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.303588029, 2020-11-12T17:24:11.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16863108800000001, 2020-11-12T17:24:11.214 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.214 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.214 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.706900+0000", 2020-11-12T17:24:11.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.706900+0000", 2020-11-12T17:24:11.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:11.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.706875+0000", 2020-11-12T17:24:11.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9007999999999999e-05 2020-11-12T17:24:11.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.706964+0000", 2020-11-12T17:24:11.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16414546599999999 2020-11-12T17:24:11.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.871110+0000", 2020-11-12T17:24:11.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4799999999999998e-06 2020-11-12T17:24:11.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.871116+0000", 2020-11-12T17:24:11.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9098000000000002e-05 2020-11-12T17:24:11.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.871176+0000", 2020-11-12T17:24:11.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3824e-05 2020-11-12T17:24:11.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.871209+0000", 2020-11-12T17:24:11.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042714720000000001 2020-11-12T17:24:11.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.875481+0000", 2020-11-12T17:24:11.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0732000000000001e-05 2020-11-12T17:24:11.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.875532+0000", 2020-11-12T17:24:11.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.16863108800000001 2020-11-12T17:24:11.221 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.221 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.221 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.222 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.222 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.222 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:11.223 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:11.218+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:11.224 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:11.325 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:11.320+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:11.367 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:24:11.396 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:11.396 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:11.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.397 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:49382 3.a 3.755a2eca (undecoded) ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:11.397 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:11.392676+0000", 2020-11-12T17:24:11.397 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0027232670000000001, 2020-11-12T17:24:11.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027417700000000001, 2020-11-12T17:24:11.398 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.398 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:11.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.399 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 49382 2020-11-12T17:24:11.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.399 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392676+0000", 2020-11-12T17:24:11.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392676+0000", 2020-11-12T17:24:11.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999809 2020-11-12T17:24:11.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392657+0000", 2020-11-12T17:24:11.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3220000000000002e-05 2020-11-12T17:24:11.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392710+0000", 2020-11-12T17:24:11.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5230000000000001e-06 2020-11-12T17:24:11.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392716+0000", 2020-11-12T17:24:11.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0570000000000001e-06 2020-11-12T17:24:11.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392719+0000", 2020-11-12T17:24:11.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3646999999999997e-05 2020-11-12T17:24:11.404 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.404 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.405 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.405 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:49377 3.a 3:53745aae:::benchmark_data_smithi036_14212_object6172:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:11.405 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:11.385010+0000", 2020-11-12T17:24:11.405 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.010389222, 2020-11-12T17:24:11.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010469701, 2020-11-12T17:24:11.406 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.406 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:11.406 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.406 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.407 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 49377 2020-11-12T17:24:11.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.407 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.385010+0000", 2020-11-12T17:24:11.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.385010+0000", 2020-11-12T17:24:11.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99998 2020-11-12T17:24:11.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.384990+0000", 2020-11-12T17:24:11.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7664999999999998e-05 2020-11-12T17:24:11.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.385048+0000", 2020-11-12T17:24:11.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.287e-05 2020-11-12T17:24:11.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.385060+0000", 2020-11-12T17:24:11.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5279999999999998e-06 2020-11-12T17:24:11.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.385068+0000", 2020-11-12T17:24:11.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9548999999999993e-05 2020-11-12T17:24:11.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.385147+0000", 2020-11-12T17:24:11.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3866000000000001e-05 2020-11-12T17:24:11.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op must wait for map", 2020-11-12T17:24:11.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.385161+0000", 2020-11-12T17:24:11.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040449589999999999 2020-11-12T17:24:11.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.389206+0000", 2020-11-12T17:24:11.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022415600000000001 2020-11-12T17:24:11.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.389430+0000", 2020-11-12T17:24:11.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026100400000000001 2020-11-12T17:24:11.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.389691+0000", 2020-11-12T17:24:11.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005506131 2020-11-12T17:24:11.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.395198+0000", 2020-11-12T17:24:11.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010187906 2020-11-12T17:24:11.419 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.419 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.419 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.420 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:49378 3.a 3:53745aae:::benchmark_data_smithi036_14212_object6172:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:11.420 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:11.386827+0000", 2020-11-12T17:24:11.420 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0085714970000000008, 2020-11-12T17:24:11.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0087903689999999993, 2020-11-12T17:24:11.420 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.420 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:11.420 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.421 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.421 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.421 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 49378 2020-11-12T17:24:11.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.421 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.386827+0000", 2020-11-12T17:24:11.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.386827+0000", 2020-11-12T17:24:11.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:11.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.386796+0000", 2020-11-12T17:24:11.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1623000000000001e-05 2020-11-12T17:24:11.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.386877+0000", 2020-11-12T17:24:11.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4829999999999999e-06 2020-11-12T17:24:11.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.386886+0000", 2020-11-12T17:24:11.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7260000000000002e-06 2020-11-12T17:24:11.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.386891+0000", 2020-11-12T17:24:11.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4218000000000002e-05 2020-11-12T17:24:11.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.386945+0000", 2020-11-12T17:24:11.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3129999999999999e-06 2020-11-12T17:24:11.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:24:11.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.386953+0000", 2020-11-12T17:24:11.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048888430000000004 2020-11-12T17:24:11.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.391842+0000", 2020-11-12T17:24:11.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9347999999999998e-05 2020-11-12T17:24:11.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.391941+0000", 2020-11-12T17:24:11.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022183000000000001 2020-11-12T17:24:11.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392163+0000", 2020-11-12T17:24:11.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053358249999999998 2020-11-12T17:24:11.430 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.430 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.430 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.431 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:49379 3.a 3:53745aae:::benchmark_data_smithi036_14212_object6172:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:11.431 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:11.387035+0000", 2020-11-12T17:24:11.431 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0083641440000000004, 2020-11-12T17:24:11.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0087185860000000004, 2020-11-12T17:24:11.431 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.431 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:11.431 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.432 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.432 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.432 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 49379 2020-11-12T17:24:11.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.432 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.387035+0000", 2020-11-12T17:24:11.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.387035+0000", 2020-11-12T17:24:11.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:11.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.387018+0000", 2020-11-12T17:24:11.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0748000000000003e-05 2020-11-12T17:24:11.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.387069+0000", 2020-11-12T17:24:11.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5320000000000003e-06 2020-11-12T17:24:11.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.387076+0000", 2020-11-12T17:24:11.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.409e-06 2020-11-12T17:24:11.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.387082+0000", 2020-11-12T17:24:11.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2281999999999999e-05 2020-11-12T17:24:11.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.387124+0000", 2020-11-12T17:24:11.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8899999999999998e-06 2020-11-12T17:24:11.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:24:11.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.387129+0000", 2020-11-12T17:24:11.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0065313530000000002 2020-11-12T17:24:11.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.393661+0000", 2020-11-12T17:24:11.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013299000000000001 2020-11-12T17:24:11.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.393794+0000", 2020-11-12T17:24:11.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000235582 2020-11-12T17:24:11.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.394029+0000", 2020-11-12T17:24:11.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0069944040000000001 2020-11-12T17:24:11.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.440 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.441 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.441 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:49380 3.a 3:53745aae:::benchmark_data_smithi036_14212_object6172:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:11.441 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:11.389801+0000", 2020-11-12T17:24:11.441 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0055982269999999999, 2020-11-12T17:24:11.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0060835350000000002, 2020-11-12T17:24:11.442 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.442 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:11.442 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.442 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.442 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.442 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 49380 2020-11-12T17:24:11.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.443 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.389801+0000", 2020-11-12T17:24:11.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.389801+0000", 2020-11-12T17:24:11.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:24:11.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.389780+0000", 2020-11-12T17:24:11.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3387999999999996e-05 2020-11-12T17:24:11.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.389853+0000", 2020-11-12T17:24:11.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4138000000000001e-05 2020-11-12T17:24:11.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.389867+0000", 2020-11-12T17:24:11.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1756000000000001e-05 2020-11-12T17:24:11.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.389879+0000", 2020-11-12T17:24:11.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053770880000000004 2020-11-12T17:24:11.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.395256+0000", 2020-11-12T17:24:11.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6193999999999996e-05 2020-11-12T17:24:11.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.395332+0000", 2020-11-12T17:24:11.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144649 2020-11-12T17:24:11.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.395477+0000", 2020-11-12T17:24:11.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056761930000000004 2020-11-12T17:24:11.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.449 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.450 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:49381 3.a 3.755a2eca (undecoded) ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:11.450 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:11.392581+0000", 2020-11-12T17:24:11.450 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.002817941, 2020-11-12T17:24:11.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033619330000000001, 2020-11-12T17:24:11.450 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.450 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:11.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.451 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.451 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.451 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 49381 2020-11-12T17:24:11.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.451 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392581+0000", 2020-11-12T17:24:11.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392581+0000", 2020-11-12T17:24:11.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999609 2020-11-12T17:24:11.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392542+0000", 2020-11-12T17:24:11.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6353000000000005e-05 2020-11-12T17:24:11.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392628+0000", 2020-11-12T17:24:11.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1749999999999994e-06 2020-11-12T17:24:11.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392637+0000", 2020-11-12T17:24:11.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6840000000000004e-06 2020-11-12T17:24:11.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.392642+0000", 2020-11-12T17:24:11.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1020999999999997e-05 2020-11-12T17:24:11.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.458 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.459 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:24:11.459 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 6 2020-11-12T17:24:11.459 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:11.461 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:11.461 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:11.454+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:11.561 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:11.558+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:11.568 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 67 16 49550 49534 5.77532 7.30469 0.0136151 0.0216334 2020-11-12T17:24:11.640 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:11.641 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:11.641 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:11.641 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:11.641 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:11.655 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:11.663 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:11.656+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:11.764 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:11.758+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:11.859 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:11.860 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:11.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:11.860 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:11.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.861 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:24:11.861 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:24:11.861 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.155014330999997, 2020-11-12T17:24:11.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:24:11.861 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.861 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:24:11.861 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.862 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.862 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.862 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:24:11.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.862 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:24:11.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:24:11.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:24:11.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:24:11.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:24:11.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:24:11.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:24:11.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:24:11.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:24:11.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:24:11.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:24:11.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:24:11.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:24:11.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:11.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:24:11.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:24:11.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:24:11.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:24:11.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:11.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:24:11.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:24:11.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:24:11.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:24:11.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:24:11.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:24:11.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.871 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.872 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:11.872 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:24:11.872 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.154611969999998, 2020-11-12T17:24:11.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:24:11.872 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.872 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.873 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.873 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.873 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.873 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:24:11.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.873 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:24:11.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:24:11.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:24:11.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:24:11.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:24:11.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:24:11.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:24:11.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:24:11.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:24:11.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:24:11.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:24:11.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:24:11.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:24:11.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:11.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:24:11.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:24:11.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:24:11.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:24:11.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:11.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:24:11.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:24:11.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:24:11.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:24:11.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:24:11.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:24:11.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:24:11.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:24:11.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:24:11.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:24:11.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:24:11.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:24:11.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:24:11.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:24:11.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:24:11.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:24:11.888 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.888 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.889 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.889 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:11.889 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:24:11.889 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.154287977000003, 2020-11-12T17:24:11.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:24:11.890 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.890 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.891 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:24:11.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.891 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:24:11.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:24:11.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:24:11.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:24:11.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:24:11.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:24:11.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:24:11.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:24:11.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:24:11.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:24:11.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:24:11.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:24:11.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:24:11.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:11.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:24:11.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:24:11.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:24:11.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:24:11.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:11.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:24:11.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:24:11.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:24:11.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:24:11.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:24:11.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:24:11.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:24:11.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:24:11.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:24:11.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:24:11.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:24:11.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:24:11.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:24:11.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:24:11.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:24:11.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:24:11.905 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.905 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.905 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.906 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:11.906 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:24:11.906 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.154044266, 2020-11-12T17:24:11.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:24:11.906 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.907 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.907 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.907 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.907 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.907 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:24:11.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.908 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:24:11.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:24:11.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:11.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:24:11.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:24:11.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:24:11.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:24:11.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:24:11.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:24:11.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:24:11.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:24:11.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:24:11.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:24:11.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:11.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:24:11.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:24:11.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:24:11.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:24:11.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:11.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:24:11.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:24:11.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:24:11.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:24:11.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:24:11.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:24:11.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:24:11.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:24:11.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:24:11.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:24:11.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:24:11.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:24:11.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:24:11.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:24:11.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:24:11.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:24:11.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.921 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.922 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:11.922 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:24:11.922 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.153806119000002, 2020-11-12T17:24:11.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:24:11.922 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.923 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.923 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.923 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.923 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.923 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:24:11.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.924 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:24:11.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:24:11.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:24:11.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:24:11.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:24:11.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:24:11.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:24:11.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:24:11.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:24:11.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:24:11.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:24:11.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:24:11.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:24:11.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:11.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:24:11.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:24:11.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:24:11.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:24:11.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:11.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:24:11.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:24:11.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:24:11.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:24:11.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:24:11.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:24:11.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:24:11.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:24:11.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:24:11.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:24:11.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:24:11.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:24:11.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:24:11.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:24:11.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:24:11.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:24:11.936 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.936 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.936 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.936 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:11.937 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:24:11.937 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.153604078999997, 2020-11-12T17:24:11.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:24:11.937 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.937 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.937 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.937 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.938 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.938 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:24:11.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.938 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:24:11.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:24:11.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:24:11.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:24:11.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:24:11.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:24:11.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:24:11.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:24:11.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:24:11.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:24:11.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:24:11.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:24:11.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:24:11.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:11.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:24:11.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:24:11.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:24:11.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:24:11.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:11.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:24:11.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:24:11.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:24:11.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:24:11.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:24:11.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:24:11.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:24:11.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:24:11.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:24:11.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:24:11.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:24:11.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:24:11.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:24:11.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:24:11.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:24:11.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:24:11.952 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.952 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.952 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.952 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:11.952 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:24:11.953 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.153398709000001, 2020-11-12T17:24:11.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:24:11.953 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.953 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.953 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.953 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.953 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.953 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:24:11.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.954 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:24:11.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:24:11.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:24:11.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:24:11.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:24:11.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:24:11.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:24:11.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:24:11.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:24:11.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:24:11.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:24:11.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:24:11.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:24:11.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:11.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:24:11.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:24:11.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:24:11.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:24:11.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:11.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:24:11.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:24:11.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:24:11.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:24:11.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:24:11.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:24:11.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:24:11.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:24:11.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:24:11.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:24:11.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:24:11.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:24:11.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:24:11.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:24:11.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:24:11.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:24:11.980 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.980 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.981 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.981 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:11.981 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:24:11.981 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.153212881999998, 2020-11-12T17:24:11.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:24:11.981 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.982 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.982 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.982 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.982 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.982 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:24:11.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.982 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:24:11.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:24:11.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:24:11.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:24:11.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:24:11.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:24:11.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:24:11.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:24:11.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:24:11.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:24:11.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:24:11.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:24:11.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:24:11.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:11.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:24:11.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:24:11.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:24:11.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:24:11.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:11.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:24:11.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:24:11.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:11.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:24:11.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:24:11.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:11.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:24:11.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:24:11.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:11.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:24:11.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:24:11.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:11.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:24:11.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:24:11.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:11.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:24:11.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:24:11.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:11.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:24:11.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:24:11.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:11.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:24:11.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:24:11.993 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.994 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:11.994 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:11.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.994 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:11.994 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:24:11.994 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.153015918000001, 2020-11-12T17:24:11.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:24:11.995 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:11.995 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:11.995 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:11.995 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:11.995 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:11.995 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:24:11.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.996 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:11.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:11.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:24:11.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:11.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:11.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:24:11.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:24:11.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:11.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:24:11.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:24:11.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:11.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:24:11.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:24:11.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:11.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:24:11.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:24:11.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:11.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:11.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:11.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:24:11.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:24:11.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:24:12.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:24:12.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:12.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:24:12.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:24:12.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:24:12.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:24:12.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:12.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:24:12.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:24:12.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:24:12.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:24:12.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:24:12.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:24:12.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:24:12.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:24:12.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:24:12.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:24:12.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:24:12.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:24:12.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:24:12.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:24:12.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:24:12.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:24:12.007 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.007 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.007 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.007 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:12.007 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:24:12.008 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.152819888000003, 2020-11-12T17:24:12.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:24:12.008 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.008 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.008 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.008 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.008 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.008 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:24:12.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.009 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:24:12.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:24:12.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:12.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:24:12.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:24:12.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:24:12.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:24:12.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:24:12.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:24:12.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:24:12.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:24:12.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:24:12.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:24:12.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:12.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:24:12.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:24:12.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:24:12.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:24:12.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:12.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:24:12.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:24:12.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:24:12.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:24:12.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:24:12.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:24:12.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:24:12.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:24:12.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:24:12.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:24:12.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:24:12.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:24:12.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:24:12.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:24:12.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:24:12.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:24:12.020 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.020 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.020 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.020 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:12.021 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:24:12.021 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.152639088000001, 2020-11-12T17:24:12.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:24:12.021 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.021 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.021 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.021 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.021 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.022 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:24:12.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.022 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:24:12.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:24:12.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:24:12.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:24:12.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:24:12.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:24:12.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:24:12.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:24:12.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:24:12.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:24:12.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:24:12.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:24:12.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:24:12.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:12.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:24:12.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:24:12.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:24:12.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:24:12.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:12.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:24:12.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:24:12.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:24:12.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:24:12.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:24:12.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:24:12.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:24:12.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:24:12.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:24:12.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:24:12.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:24:12.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:24:12.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:24:12.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:24:12.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:24:12.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:24:12.033 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.033 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.033 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.033 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:12.034 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:24:12.034 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.152443134999999, 2020-11-12T17:24:12.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:24:12.034 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.034 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.034 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.034 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.034 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.035 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:24:12.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.035 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:24:12.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:24:12.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:12.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:24:12.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:24:12.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:24:12.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:24:12.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:24:12.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:24:12.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:24:12.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:24:12.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:24:12.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:24:12.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:12.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:24:12.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:24:12.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:24:12.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:24:12.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:12.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:24:12.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:24:12.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:24:12.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:24:12.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:24:12.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:24:12.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:24:12.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:24:12.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:24:12.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:24:12.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:24:12.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:24:12.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:24:12.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:24:12.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:24:12.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:24:12.046 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.046 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.046 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.047 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:12.047 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:24:12.047 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.152249527000002, 2020-11-12T17:24:12.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:24:12.047 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.047 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.047 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.048 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.048 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.048 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:24:12.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.048 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:24:12.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:24:12.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:24:12.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:24:12.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:24:12.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:24:12.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:24:12.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:24:12.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:24:12.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:24:12.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:24:12.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:24:12.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:24:12.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:12.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:24:12.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:24:12.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:24:12.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:24:12.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:12.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:24:12.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:24:12.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:24:12.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:24:12.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:24:12.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:24:12.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:24:12.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:24:12.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:24:12.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:24:12.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:24:12.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:24:12.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:24:12.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:24:12.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:24:12.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:24:12.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.059 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.060 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:12.060 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:24:12.060 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.151937664000002, 2020-11-12T17:24:12.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:24:12.060 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.060 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.061 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.061 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.061 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.061 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:24:12.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.061 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:24:12.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:24:12.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:24:12.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:24:12.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:24:12.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:24:12.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:24:12.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:24:12.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:24:12.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:24:12.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:24:12.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:24:12.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:24:12.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:12.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:24:12.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:24:12.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:24:12.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:24:12.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:12.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:24:12.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:24:12.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:24:12.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:24:12.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:24:12.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:24:12.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:24:12.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:24:12.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:24:12.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:24:12.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:24:12.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:24:12.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:24:12.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:24:12.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:24:12.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:24:12.072 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.072 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.073 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:12.073 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:24:12.073 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.151650167, 2020-11-12T17:24:12.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:24:12.073 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.074 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.074 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.074 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.074 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.074 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:24:12.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.074 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:24:12.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:24:12.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:24:12.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:24:12.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:24:12.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:24:12.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:24:12.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:24:12.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:24:12.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:24:12.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:24:12.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:24:12.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:24:12.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:12.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:24:12.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:24:12.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:24:12.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:24:12.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:12.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:24:12.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:24:12.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:24:12.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:24:12.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:24:12.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:24:12.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:24:12.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:24:12.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:24:12.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:24:12.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:24:12.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:24:12.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:24:12.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:24:12.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:24:12.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:24:12.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.085 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.086 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:12.086 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:24:12.086 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.151429796000002, 2020-11-12T17:24:12.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:24:12.086 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.087 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.087 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.087 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.087 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.087 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:24:12.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.087 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:24:12.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:24:12.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:24:12.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:24:12.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:24:12.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:24:12.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:24:12.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:24:12.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:24:12.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:24:12.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:24:12.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:24:12.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:24:12.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:12.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:24:12.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:24:12.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:24:12.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:24:12.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:12.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:24:12.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:24:12.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:24:12.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:24:12.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:24:12.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:24:12.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:24:12.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:24:12.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:24:12.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:24:12.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:24:12.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:24:12.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:24:12.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:24:12.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:24:12.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:24:12.098 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.099 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.099 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.099 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:20904 3.0 e42/35 3:07649b2f:::benchmark_data_smithi036_14212_object2612:head v 42'1120, mlcod=42'1114)", 2020-11-12T17:24:12.099 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:24:12.099 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.210777491000002, 2020-11-12T17:24:12.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999, 2020-11-12T17:24:12.100 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.100 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.100 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:24:12.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:24:12.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:12.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613848+0000", 2020-11-12T17:24:12.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3206000000000004e-05 2020-11-12T17:24:12.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613911+0000", 2020-11-12T17:24:12.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38330512799999999 2020-11-12T17:24:12.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997216+0000", 2020-11-12T17:24:12.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8860000000000004e-06 2020-11-12T17:24:12.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997224+0000", 2020-11-12T17:24:12.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000129011 2020-11-12T17:24:12.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997353+0000", 2020-11-12T17:24:12.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9062999999999999e-05 2020-11-12T17:24:12.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997382+0000", 2020-11-12T17:24:12.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018580370000000001 2020-11-12T17:24:12.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999240+0000", 2020-11-12T17:24:12.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6116999999999998e-05 2020-11-12T17:24:12.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999296+0000", 2020-11-12T17:24:12.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999 2020-11-12T17:24:12.106 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.106 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.106 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.107 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:12.107 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:24:12.107 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.379975949999999, 2020-11-12T17:24:12.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:24:12.107 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.108 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.108 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:24:12.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.108 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:24:12.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:24:12.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:24:12.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:24:12.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:24:12.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:24:12.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:24:12.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:24:12.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:24:12.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:24:12.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:24:12.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:24:12.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:24:12.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:24:12.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:24:12.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:24:12.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:24:12.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:24:12.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:24:12.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:24:12.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:24:12.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:24:12.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:24:12.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:24:12.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:24:12.117 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.117 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.117 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.117 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:25496 3.a e46/31 ondisk, result = 0)", 2020-11-12T17:24:12.118 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:24:12.118 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.374048437999999, 2020-11-12T17:24:12.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999, 2020-11-12T17:24:12.118 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.118 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:12.118 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:24:12.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:24:12.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:12.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450588+0000", 2020-11-12T17:24:12.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5475000000000002e-05 2020-11-12T17:24:12.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450623+0000", 2020-11-12T17:24:12.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46380360799999998 2020-11-12T17:24:12.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914427+0000", 2020-11-12T17:24:12.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7369999999999995e-06 2020-11-12T17:24:12.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914436+0000", 2020-11-12T17:24:12.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001408212 2020-11-12T17:24:12.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915844+0000", 2020-11-12T17:24:12.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0029e-05 2020-11-12T17:24:12.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915854+0000", 2020-11-12T17:24:12.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014011899999999999 2020-11-12T17:24:12.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915994+0000", 2020-11-12T17:24:12.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999 2020-11-12T17:24:12.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.124 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.125 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:24:12.125 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:24:12.125 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.0596870489999999, 2020-11-12T17:24:12.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:24:12.125 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.126 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.126 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:24:12.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:24:12.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:12.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:24:12.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:24:12.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:24:12.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:24:12.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:24:12.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:24:12.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:24:12.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:24:12.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:24:12.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:24:12.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:24:12.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:24:12.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:24:12.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:24:12.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:24:12.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:24:12.135 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.136 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.136 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.136 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.136 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.137 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:12.138 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:12.140 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:12.132+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:12.244 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:12.238+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:12.279 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:12.280 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:12.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.280 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50168 3.f 3.dd8241cf (undecoded) ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.281 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.275406+0000", 2020-11-12T17:24:12.281 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0019663549999999999, 2020-11-12T17:24:12.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019839189999999998, 2020-11-12T17:24:12.281 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.282 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:12.282 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.282 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.282 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.283 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50168 2020-11-12T17:24:12.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.283 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275406+0000", 2020-11-12T17:24:12.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275406+0000", 2020-11-12T17:24:12.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:24:12.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275372+0000", 2020-11-12T17:24:12.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8393000000000005e-05 2020-11-12T17:24:12.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275470+0000", 2020-11-12T17:24:12.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1880000000000008e-06 2020-11-12T17:24:12.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275479+0000", 2020-11-12T17:24:12.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6209999999999998e-06 2020-11-12T17:24:12.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275486+0000", 2020-11-12T17:24:12.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.962e-05 2020-11-12T17:24:12.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.293 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.294 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.294 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:50158 3.f e55/20)", 2020-11-12T17:24:12.294 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.275655+0000", 2020-11-12T17:24:12.295 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0017179739999999999, 2020-11-12T17:24:12.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001791347, 2020-11-12T17:24:12.295 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.295 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:12.295 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275655+0000", 2020-11-12T17:24:12.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275655+0000", 2020-11-12T17:24:12.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:24:12.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275630+0000", 2020-11-12T17:24:12.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6396999999999995e-05 2020-11-12T17:24:12.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275697+0000", 2020-11-12T17:24:12.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9466000000000002e-05 2020-11-12T17:24:12.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275766+0000", 2020-11-12T17:24:12.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9789999999999996e-06 2020-11-12T17:24:12.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275773+0000", 2020-11-12T17:24:12.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011857 2020-11-12T17:24:12.303 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.303 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.303 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.304 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50158 3.f 3:ff2e9ba8:::benchmark_data_smithi036_14212_object6269:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.305 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.266266+0000", 2020-11-12T17:24:12.305 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.01110681, 2020-11-12T17:24:12.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011224034000000001, 2020-11-12T17:24:12.305 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.306 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:12.306 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.306 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.306 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.306 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50158 2020-11-12T17:24:12.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.306 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266266+0000", 2020-11-12T17:24:12.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266266+0000", 2020-11-12T17:24:12.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:24:12.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266239+0000", 2020-11-12T17:24:12.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2095000000000006e-05 2020-11-12T17:24:12.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266321+0000", 2020-11-12T17:24:12.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0659000000000001e-05 2020-11-12T17:24:12.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266332+0000", 2020-11-12T17:24:12.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2599999999999996e-06 2020-11-12T17:24:12.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266337+0000", 2020-11-12T17:24:12.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054899809999999997 2020-11-12T17:24:12.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271827+0000", 2020-11-12T17:24:12.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103522 2020-11-12T17:24:12.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271930+0000", 2020-11-12T17:24:12.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000179517 2020-11-12T17:24:12.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.272110+0000", 2020-11-12T17:24:12.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003166402 2020-11-12T17:24:12.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275276+0000", 2020-11-12T17:24:12.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0090103260000000008 2020-11-12T17:24:12.313 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.313 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.314 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.314 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50159 3.f 3:ff2e9ba8:::benchmark_data_smithi036_14212_object6269:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.314 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.266380+0000", 2020-11-12T17:24:12.315 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.010992539000000001, 2020-11-12T17:24:12.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011216679, 2020-11-12T17:24:12.315 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.315 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:12.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.316 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50159 2020-11-12T17:24:12.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.316 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266380+0000", 2020-11-12T17:24:12.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266380+0000", 2020-11-12T17:24:12.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:24:12.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266354+0000", 2020-11-12T17:24:12.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5797000000000006e-05 2020-11-12T17:24:12.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266430+0000", 2020-11-12T17:24:12.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.183e-06 2020-11-12T17:24:12.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266439+0000", 2020-11-12T17:24:12.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.216e-06 2020-11-12T17:24:12.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266443+0000", 2020-11-12T17:24:12.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007087632 2020-11-12T17:24:12.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.273531+0000", 2020-11-12T17:24:12.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119226 2020-11-12T17:24:12.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.273650+0000", 2020-11-12T17:24:12.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183227 2020-11-12T17:24:12.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.273833+0000", 2020-11-12T17:24:12.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007453103 2020-11-12T17:24:12.323 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.323 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.323 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.323 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50160 3.f 3:ff2e9ba8:::benchmark_data_smithi036_14212_object6269:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.323 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.266773+0000", 2020-11-12T17:24:12.324 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.010599673, 2020-11-12T17:24:12.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010913213999999999, 2020-11-12T17:24:12.324 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.324 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:12.324 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.324 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.324 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.324 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50160 2020-11-12T17:24:12.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.325 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266773+0000", 2020-11-12T17:24:12.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266773+0000", 2020-11-12T17:24:12.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:24:12.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266745+0000", 2020-11-12T17:24:12.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6193999999999995e-05 2020-11-12T17:24:12.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266832+0000", 2020-11-12T17:24:12.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1324e-05 2020-11-12T17:24:12.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266843+0000", 2020-11-12T17:24:12.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4260000000000002e-06 2020-11-12T17:24:12.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.266848+0000", 2020-11-12T17:24:12.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0086485610000000008 2020-11-12T17:24:12.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275497+0000", 2020-11-12T17:24:12.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120554 2020-11-12T17:24:12.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275617+0000", 2020-11-12T17:24:12.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000117679 2020-11-12T17:24:12.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.275735+0000", 2020-11-12T17:24:12.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0089619720000000003 2020-11-12T17:24:12.347 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.347 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.347 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.348 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50161 3.f 3:f38241bb:::benchmark_data_smithi036_14212_object6270:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.348 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.269589+0000", 2020-11-12T17:24:12.348 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0077838730000000002, 2020-11-12T17:24:12.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081666949999999999, 2020-11-12T17:24:12.349 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.349 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:12.349 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.349 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.349 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.352 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50161 2020-11-12T17:24:12.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.353 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269589+0000", 2020-11-12T17:24:12.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269589+0000", 2020-11-12T17:24:12.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:24:12.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269550+0000", 2020-11-12T17:24:12.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000104366 2020-11-12T17:24:12.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269655+0000", 2020-11-12T17:24:12.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1345999999999999e-05 2020-11-12T17:24:12.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269676+0000", 2020-11-12T17:24:12.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1130000000000003e-06 2020-11-12T17:24:12.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269683+0000", 2020-11-12T17:24:12.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0072675769999999999 2020-11-12T17:24:12.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.276951+0000", 2020-11-12T17:24:12.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021335500000000001 2020-11-12T17:24:12.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.277164+0000", 2020-11-12T17:24:12.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000200733 2020-11-12T17:24:12.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.277365+0000", 2020-11-12T17:24:12.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077759760000000004 2020-11-12T17:24:12.359 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.359 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.359 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.359 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50162 3.f 3.dd8241cf (undecoded) ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.360 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.269880+0000", 2020-11-12T17:24:12.360 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.007492805, 2020-11-12T17:24:12.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0079273539999999993, 2020-11-12T17:24:12.360 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.360 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:12.360 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.360 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.361 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.361 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50162 2020-11-12T17:24:12.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.361 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269880+0000", 2020-11-12T17:24:12.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269880+0000", 2020-11-12T17:24:12.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:24:12.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269847+0000", 2020-11-12T17:24:12.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4458999999999998e-05 2020-11-12T17:24:12.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269941+0000", 2020-11-12T17:24:12.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2662e-05 2020-11-12T17:24:12.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269954+0000", 2020-11-12T17:24:12.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3990000000000001e-06 2020-11-12T17:24:12.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.269960+0000", 2020-11-12T17:24:12.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0123999999999994e-05 2020-11-12T17:24:12.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.365 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.366 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50163 3.f 3.dd8241cf (undecoded) ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.366 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.270067+0000", 2020-11-12T17:24:12.366 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0073060449999999997, 2020-11-12T17:24:12.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078021879999999998, 2020-11-12T17:24:12.366 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.367 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:12.367 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.367 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.367 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.367 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50163 2020-11-12T17:24:12.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.367 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270067+0000", 2020-11-12T17:24:12.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270067+0000", 2020-11-12T17:24:12.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:24:12.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270033+0000", 2020-11-12T17:24:12.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9899e-05 2020-11-12T17:24:12.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270133+0000", 2020-11-12T17:24:12.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2998e-05 2020-11-12T17:24:12.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270146+0000", 2020-11-12T17:24:12.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1260000000000003e-06 2020-11-12T17:24:12.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270152+0000", 2020-11-12T17:24:12.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5482000000000006e-05 2020-11-12T17:24:12.372 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.372 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.372 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.373 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50164 3.f 3.dd8241cf (undecoded) ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.373 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.270217+0000", 2020-11-12T17:24:12.373 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0071559759999999997, 2020-11-12T17:24:12.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00769799, 2020-11-12T17:24:12.373 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.373 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:12.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.374 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.374 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50164 2020-11-12T17:24:12.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.374 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270217+0000", 2020-11-12T17:24:12.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270217+0000", 2020-11-12T17:24:12.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:12.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270185+0000", 2020-11-12T17:24:12.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9543000000000006e-05 2020-11-12T17:24:12.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270275+0000", 2020-11-12T17:24:12.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.04e-05 2020-11-12T17:24:12.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270285+0000", 2020-11-12T17:24:12.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0270000000000003e-06 2020-11-12T17:24:12.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.270290+0000", 2020-11-12T17:24:12.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3578000000000006e-05 2020-11-12T17:24:12.379 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.379 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.379 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.379 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50165 3.f 3.dd8241cf (undecoded) ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.379 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.271778+0000", 2020-11-12T17:24:12.380 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0055944460000000003, 2020-11-12T17:24:12.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0061708520000000001, 2020-11-12T17:24:12.380 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.380 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:12.380 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.380 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.380 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.381 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50165 2020-11-12T17:24:12.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.381 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271778+0000", 2020-11-12T17:24:12.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271778+0000", 2020-11-12T17:24:12.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:24:12.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271744+0000", 2020-11-12T17:24:12.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3993000000000006e-05 2020-11-12T17:24:12.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271838+0000", 2020-11-12T17:24:12.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.15e-05 2020-11-12T17:24:12.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271850+0000", 2020-11-12T17:24:12.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6700000000000002e-06 2020-11-12T17:24:12.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271855+0000", 2020-11-12T17:24:12.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6341999999999995e-05 2020-11-12T17:24:12.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.385 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.386 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50166 3.f 3.dd8241cf (undecoded) ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.386 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.271885+0000", 2020-11-12T17:24:12.386 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0054877959999999996, 2020-11-12T17:24:12.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0060986410000000001, 2020-11-12T17:24:12.386 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.386 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:12.386 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.387 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.387 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.387 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50166 2020-11-12T17:24:12.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.387 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271885+0000", 2020-11-12T17:24:12.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271885+0000", 2020-11-12T17:24:12.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:24:12.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271868+0000", 2020-11-12T17:24:12.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2868000000000003e-05 2020-11-12T17:24:12.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271921+0000", 2020-11-12T17:24:12.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0034000000000001e-05 2020-11-12T17:24:12.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271931+0000", 2020-11-12T17:24:12.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7120000000000002e-06 2020-11-12T17:24:12.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.271935+0000", 2020-11-12T17:24:12.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0163000000000001e-05 2020-11-12T17:24:12.391 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.391 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.392 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.392 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:50167 3.f 3.dd8241cf (undecoded) ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:12.392 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.272233+0000", 2020-11-12T17:24:12.392 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0051398679999999997, 2020-11-12T17:24:12.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0057917159999999997, 2020-11-12T17:24:12.392 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.393 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:12.393 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.393 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.393 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.393 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 50167 2020-11-12T17:24:12.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.393 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.272233+0000", 2020-11-12T17:24:12.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.272233+0000", 2020-11-12T17:24:12.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:24:12.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.272197+0000", 2020-11-12T17:24:12.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4547000000000001e-05 2020-11-12T17:24:12.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.272291+0000", 2020-11-12T17:24:12.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3923999999999999e-05 2020-11-12T17:24:12.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.272305+0000", 2020-11-12T17:24:12.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3969999999999997e-06 2020-11-12T17:24:12.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.272313+0000", 2020-11-12T17:24:12.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9719e-05 2020-11-12T17:24:12.398 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.398 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.398 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.398 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.398 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:24:12.398 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 12 2020-11-12T17:24:12.399 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:12.400 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:12.401 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:12.392+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:12.501 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:12.496+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:12.554 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:12.569 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:12.569 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:12.569 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:12.569 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:12.570 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 68 16 50419 50403 5.79021 6.78906 0.0050391 0.0215667 2020-11-12T17:24:12.571 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:12.621 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:12.618+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:12.700 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:24:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.855324240000002, 2020-11-12T17:24:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:24:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:12.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:24:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:24:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:24:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:24:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:24:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:24:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:24:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:24:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:24:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:24:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:24:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:24:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:24:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:24:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 62.196673697000001, 2020-11-12T17:24:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:24:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:24:12.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.717 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:24:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:24:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:24:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:24:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:24:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:24:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:24:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:24:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:24:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:24:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:24:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:24:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:24:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:24:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:24:12.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:24:12.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:24:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:24:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:24:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:24:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:24:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:24:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 62.195068636999999, 2020-11-12T17:24:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:24:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:24:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:24:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:24:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:24:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:24:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:24:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:24:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:24:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:24:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:24:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:24:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:24:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:24:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:24:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:24:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:24:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:24:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:24:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:24:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:24:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:24:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:24:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:24:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:24:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5735 3.d e25/20 ondisk, result = 0)", 2020-11-12T17:24:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 62.188982115000002, 2020-11-12T17:24:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002, 2020-11-12T17:24:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508775+0000", 2020-11-12T17:24:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4838000000000001e-05 2020-11-12T17:24:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508810+0000", 2020-11-12T17:24:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30211893099999998 2020-11-12T17:24:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810929+0000", 2020-11-12T17:24:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3546e-05 2020-11-12T17:24:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810942+0000", 2020-11-12T17:24:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021619539999999998 2020-11-12T17:24:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813104+0000", 2020-11-12T17:24:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1251999999999998e-05 2020-11-12T17:24:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813135+0000", 2020-11-12T17:24:12.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033488000000000002 2020-11-12T17:24:12.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813470+0000", 2020-11-12T17:24:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002 2020-11-12T17:24:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5824 3.f 3:fffe6057:::benchmark_data_smithi036_14212_object727:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.609972+0000", 2020-11-12T17:24:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 62.087799648999997, 2020-11-12T17:24:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25372203199999999, 2020-11-12T17:24:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5824 2020-11-12T17:24:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.609972+0000", 2020-11-12T17:24:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.609972+0000", 2020-11-12T17:24:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999547 2020-11-12T17:24:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.609926+0000", 2020-11-12T17:24:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010851100000000001 2020-11-12T17:24:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610035+0000", 2020-11-12T17:24:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4929999999999999e-05 2020-11-12T17:24:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610050+0000", 2020-11-12T17:24:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1506e-05 2020-11-12T17:24:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610061+0000", 2020-11-12T17:24:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021358999999999999 2020-11-12T17:24:12.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610275+0000", 2020-11-12T17:24:12.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012656000000000001 2020-11-12T17:24:12.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610401+0000", 2020-11-12T17:24:12.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025522899999999999 2020-11-12T17:24:12.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:12.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.610657+0000", 2020-11-12T17:24:12.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013916950000000001 2020-11-12T17:24:12.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.612048+0000", 2020-11-12T17:24:12.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25143695199999999 2020-11-12T17:24:12.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863485+0000", 2020-11-12T17:24:12.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114444 2020-11-12T17:24:12.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863600+0000", 2020-11-12T17:24:12.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3911000000000003e-05 2020-11-12T17:24:12.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.863694+0000", 2020-11-12T17:24:12.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25372203199999999 2020-11-12T17:24:12.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.766 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.767 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:12.767 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:12.767 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.297573632999999, 2020-11-12T17:24:12.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:24:12.768 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.768 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.768 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.769 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.769 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.769 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:24:12.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.769 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:12.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:12.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:12.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:24:12.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:24:12.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:24:12.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:24:12.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:24:12.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:24:12.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:24:12.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:24:12.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:24:12.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:24:12.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:24:12.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:24:12.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:12.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:24:12.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:24:12.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:24:12.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:24:12.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:24:12.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:24:12.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:24:12.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:24:12.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:24:12.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:24:12.891 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.892 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.892 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.892 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:12.892 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:12.892 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.295127018000002, 2020-11-12T17:24:12.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:24:12.893 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.893 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.893 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.893 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.893 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.893 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:24:12.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.894 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:12.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:12.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:12.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:24:12.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:24:12.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:24:12.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:24:12.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:24:12.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:24:12.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:24:12.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:24:12.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:24:12.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:24:12.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:24:12.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:24:12.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:12.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:24:12.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:24:12.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:24:12.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:24:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:24:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:24:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:24:12.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:24:12.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:24:12.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:24:12.941 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.941 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.941 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.942 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:12.942 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:12.942 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.289302571, 2020-11-12T17:24:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:24:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:24:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:24:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:24:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:24:12.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:24:12.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:24:12.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:24:12.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:24:12.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:24:12.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:24:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:24:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:24:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:24:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:24:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:24:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.289234694999998, 2020-11-12T17:24:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:24:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:12.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:24:12.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:24:12.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:24:12.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:24:12.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:24:12.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:24:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:24:12.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:24:12.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:24:12.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:24:12.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:24:12.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:24:12.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:24:12.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:24:12.961 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.961 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.961 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.962 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e27)", 2020-11-12T17:24:12.962 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.950158+0000", 2020-11-12T17:24:12.962 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 57.747612885999999, 2020-11-12T17:24:12.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28929145499999998, 2020-11-12T17:24:12.963 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.963 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:24:12.963 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.964 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.964 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.964 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:24:12.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.965 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950158+0000", 2020-11-12T17:24:12.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950158+0000", 2020-11-12T17:24:12.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999318 2020-11-12T17:24:12.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950090+0000", 2020-11-12T17:24:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000168746 2020-11-12T17:24:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950259+0000", 2020-11-12T17:24:12.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8829000000000001e-05 2020-11-12T17:24:12.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950288+0000", 2020-11-12T17:24:12.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4751e-05 2020-11-12T17:24:12.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950303+0000", 2020-11-12T17:24:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4604999999999995e-05 2020-11-12T17:24:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950377+0000", 2020-11-12T17:24:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1074000000000003e-05 2020-11-12T17:24:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950468+0000", 2020-11-12T17:24:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28898143900000001 2020-11-12T17:24:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239450+0000", 2020-11-12T17:24:12.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28929145499999998 2020-11-12T17:24:12.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.974 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.975 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:19000 3.d 3:bfda9947:::benchmark_data_smithi036_14212_object2374:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:24:12.975 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:38.788839+0000", 2020-11-12T17:24:12.975 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.908932366000002, 2020-11-12T17:24:12.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.266452142, 2020-11-12T17:24:12.975 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.976 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.976 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.976 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.976 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.976 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 19000 2020-11-12T17:24:12.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.976 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788839+0000", 2020-11-12T17:24:12.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788839+0000", 2020-11-12T17:24:12.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:24:12.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788791+0000", 2020-11-12T17:24:12.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012816999999999999 2020-11-12T17:24:12.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788919+0000", 2020-11-12T17:24:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3277e-05 2020-11-12T17:24:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788932+0000", 2020-11-12T17:24:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4920000000000001e-06 2020-11-12T17:24:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.788938+0000", 2020-11-12T17:24:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036962039999999998 2020-11-12T17:24:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.792634+0000", 2020-11-12T17:24:12.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017564999999999999 2020-11-12T17:24:12.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.792810+0000", 2020-11-12T17:24:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020317999999999999 2020-11-12T17:24:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.793013+0000", 2020-11-12T17:24:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037110009999999998 2020-11-12T17:24:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796724+0000", 2020-11-12T17:24:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25845033099999998 2020-11-12T17:24:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055174+0000", 2020-11-12T17:24:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1116000000000001e-05 2020-11-12T17:24:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055245+0000", 2020-11-12T17:24:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5658000000000002e-05 2020-11-12T17:24:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055291+0000", 2020-11-12T17:24:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.266452142 2020-11-12T17:24:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:19000 3.d e41/20 ondisk, result = 0)", 2020-11-12T17:24:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:38.796036+0000", 2020-11-12T17:24:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.901735223000003, 2020-11-12T17:24:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25926142699999999, 2020-11-12T17:24:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796036+0000", 2020-11-12T17:24:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796036+0000", 2020-11-12T17:24:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:24:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796018+0000", 2020-11-12T17:24:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5039e-05 2020-11-12T17:24:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:38.796063+0000", 2020-11-12T17:24:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25902876499999999 2020-11-12T17:24:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055092+0000", 2020-11-12T17:24:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5549999999999997e-06 2020-11-12T17:24:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055099+0000", 2020-11-12T17:24:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6242000000000001e-05 2020-11-12T17:24:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055155+0000", 2020-11-12T17:24:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0560000000000001e-05 2020-11-12T17:24:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055166+0000", 2020-11-12T17:24:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131421 2020-11-12T17:24:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:39.055297+0000", 2020-11-12T17:24:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25926142699999999 2020-11-12T17:24:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:24:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.163244426999999, 2020-11-12T17:24:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:24:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:24:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:24:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:24:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:24:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:24:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:24:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:24:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:24:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:24:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:24:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:24:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:24:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:24:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:24:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:24:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:24:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:24:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:24:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:24:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:24:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:24:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:24:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:24:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:24:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:24:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.155940707999999, 2020-11-12T17:24:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:24:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:24:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:24:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:24:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:24:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:24:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:24:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:24:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:24:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:24:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:24:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:24:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:24:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:24:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:24:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.782362214999999, 2020-11-12T17:24:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:24:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:24:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:24:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:24:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:24:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:24:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:24:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:24:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:24:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:24:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:24:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:24:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:24:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:24:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:24:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:24:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:24:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:24:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:13.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:24:13.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:24:13.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:13.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:24:13.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:24:13.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:13.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:24:13.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:24:13.031 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.032 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:13.032 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.032 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:24:13.032 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:13.032 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.770809095000001, 2020-11-12T17:24:13.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:24:13.033 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:13.033 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:13.033 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:13.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:13.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:13.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:13.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:13.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:13.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:13.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:13.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:24:13.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:24:13.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:13.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:24:13.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:24:13.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:13.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:24:13.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:24:13.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:13.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:24:13.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:24:13.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:13.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:24:13.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:24:13.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:13.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:24:13.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:24:13.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:13.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:24:13.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:24:13.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.040 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:13.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.040 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29991 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:13.041 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.999929+0000", 2020-11-12T17:24:13.041 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.697842128000001, 2020-11-12T17:24:13.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.292802063, 2020-11-12T17:24:13.041 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:13.041 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:13.041 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:13.041 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:13.041 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:13.042 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29991 2020-11-12T17:24:13.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.042 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:13.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:13.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.999929+0000", 2020-11-12T17:24:13.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:13.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:13.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.999929+0000", 2020-11-12T17:24:13.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:24:13.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:13.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.999895+0000", 2020-11-12T17:24:13.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010826 2020-11-12T17:24:13.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:13.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000003+0000", 2020-11-12T17:24:13.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.504e-05 2020-11-12T17:24:13.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:13.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000018+0000", 2020-11-12T17:24:13.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9989999999999997e-06 2020-11-12T17:24:13.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:13.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000024+0000", 2020-11-12T17:24:13.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037541160000000001 2020-11-12T17:24:13.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:13.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.003778+0000", 2020-11-12T17:24:13.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9364999999999997e-05 2020-11-12T17:24:13.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:13.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.003858+0000", 2020-11-12T17:24:13.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124258 2020-11-12T17:24:13.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:13.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.003982+0000", 2020-11-12T17:24:13.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023873649999999998 2020-11-12T17:24:13.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:13.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006369+0000", 2020-11-12T17:24:13.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28615247599999999 2020-11-12T17:24:13.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:13.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292522+0000", 2020-11-12T17:24:13.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3332999999999998e-05 2020-11-12T17:24:13.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:13.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292585+0000", 2020-11-12T17:24:13.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014610400000000001 2020-11-12T17:24:13.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:13.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292731+0000", 2020-11-12T17:24:13.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.292802063 2020-11-12T17:24:13.051 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.051 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:13.051 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.052 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:13.052 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:13.052 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.697688914, 2020-11-12T17:24:13.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:24:13.053 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:13.053 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:13.053 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:13.053 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:13.053 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:13.053 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:24:13.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.054 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:13.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:13.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:13.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:13.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:13.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:13.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:24:13.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:13.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:24:13.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:24:13.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:13.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:24:13.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:24:13.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:13.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:24:13.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:24:13.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:13.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:24:13.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:24:13.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:13.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:24:13.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:24:13.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:13.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:24:13.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:24:13.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:13.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:24:13.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:24:13.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:13.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:24:13.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:24:13.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:13.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:24:13.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:24:13.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:13.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:24:13.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:24:13.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:13.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:24:13.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:24:13.063 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.063 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:13.063 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.063 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:13.063 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:13.064 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.410389200999999, 2020-11-12T17:24:13.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:24:13.064 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:13.064 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:13.064 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:13.064 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:13.064 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:13.065 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:24:13.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.065 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:13.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:13.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:13.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:13.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:13.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:13.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:13.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:13.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:24:13.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:24:13.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:13.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:24:13.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:24:13.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:13.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:24:13.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:24:13.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:13.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:24:13.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:24:13.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:13.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:24:13.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:24:13.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:13.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:24:13.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:24:13.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:13.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:24:13.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:24:13.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:13.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:24:13.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:24:13.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:13.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:24:13.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:24:13.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:13.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:24:13.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:24:13.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:13.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:24:13.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:24:13.074 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.074 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:13.074 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.075 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:13.075 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:13.075 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.864996210999999, 2020-11-12T17:24:13.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:24:13.075 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:13.075 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:13.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:13.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:13.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:13.076 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:24:13.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.076 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:13.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:13.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:13.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:13.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:13.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:13.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:13.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:13.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:24:13.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:24:13.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:13.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:24:13.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:24:13.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:13.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:24:13.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:24:13.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:13.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:24:13.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:24:13.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:13.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:24:13.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:24:13.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:13.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:24:13.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:24:13.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:13.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:24:13.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:24:13.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:13.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:24:13.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:24:13.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:13.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:24:13.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:24:13.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:13.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:24:13.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:24:13.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:13.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:13.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:13.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:24:13.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:24:13.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.085 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:13.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.086 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:13.086 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:13.086 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:13.087 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:24:13.089 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:13.082+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:13.089 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:13.189 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:13.184+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:13.237 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:13.238 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:13.238 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:24:13.238 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:13.249 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:13.272 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:13.309 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:24:13.310 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:13.300+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:13.342 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:13.370 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:13.388 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:24:13.427 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:13.428 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:13.428 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:13.429 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:13.420+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:13.429 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:13.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:13.467 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:13.499 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:13.503 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:24:13.503 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:24:13.504 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:24:13.506 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:24:13.506 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:24:13.506 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:24:13.506 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:24:13.507 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:24:13.561 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:13.556+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:13.565 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:13.565 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:13.569 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 69 16 51264 51248 5.80197 6.60156 0.0104207 0.0215372 2020-11-12T17:24:13.578 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:24:13.629 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:13.626+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:13.730 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:13.726+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:13.766 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:13.767 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:13.780 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:24:13.831 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:13.826+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:13.899 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:13.900 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:13.915 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:24:13.932 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:13.926+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:14.033 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:14.030+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:14.045 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:14.045 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:14.060 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:24:14.135 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:14.128+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:14.193 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:14.194 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:14.203 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:24:14.236 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:14.230+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:14.337 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:14.332+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:14.377 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:14.377 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:14.393 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:24:14.395 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:14.390+0000 7f7b4b297700 -1 osd.4 55 handle_osd_map injecting map crc failure 2020-11-12T17:24:14.396 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:24:14.438 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:14.434+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:14.513 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:14.513 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:14.524 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:14.589 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 70 16 52065 52049 5.80847 6.25781 0.00876694 0.0215075 2020-11-12T17:24:14.590 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:14.584+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:14.690 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:14.686+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:21.227 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:24:21.236 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:24:21.238 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:21.238 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:21.238 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:21.239 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 71 16 52875 52859 5.81578 6.32812 0.0132538 0.021476 2020-11-12T17:24:21.239 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 72 16 53663 53647 5.8205 6.15625 0.0115787 0.0214668 2020-11-12T17:24:21.239 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 73 16 54540 54524 5.83462 6.85156 0.0290766 0.0214134 2020-11-12T17:24:21.239 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 74 16 55443 55427 5.8511 7.05469 0.010889 0.021346 2020-11-12T17:24:21.239 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 75 16 56010 55994 5.83214 4.42969 0.00930467 0.0213756 2020-11-12T17:24:21.240 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 76 16 56774 56758 5.83393 5.96875 0.0230872 0.0214064 2020-11-12T17:24:21.240 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:21.220+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:21.329 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:21.324+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:21.430 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:21.424+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:21.435 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:21.436 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:21.450 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:21.464 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:21.517 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:24:21.532 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:21.526+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:21.543 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:21.570 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 77 16 57538 57522 5.83568 5.96875 0.0163634 0.0214121 2020-11-12T17:24:21.581 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:21.600 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:21.606 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:21.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:21.607 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:21.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.607 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:21.607 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:21.607 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.178412562000005, 2020-11-12T17:24:21.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:24:21.608 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.608 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.608 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.608 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.608 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.608 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:24:21.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.609 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:21.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:21.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:24:21.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:24:21.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:24:21.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:24:21.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:24:21.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:24:21.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:24:21.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:24:21.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:24:21.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:24:21.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:24:21.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:24:21.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:24:21.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:21.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:24:21.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:24:21.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:24:21.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:24:21.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:24:21.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:24:21.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:24:21.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:24:21.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:24:21.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:24:21.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.621 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.621 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:24:21.621 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:21.621 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.171468500000003, 2020-11-12T17:24:21.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:24:21.622 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.622 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:21.622 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:21.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:21.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:24:21.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:24:21.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:24:21.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:24:21.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:24:21.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:24:21.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:24:21.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:24:21.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:24:21.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:24:21.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:24:21.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:24:21.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:24:21.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:24:21.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:24:21.712 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.713 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.713 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.713 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25280 3.b 3:d39b0d08:::benchmark_data_smithi036_14212_object3159:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:21.713 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:24:21.713 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.395421124000002, 2020-11-12T17:24:21.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224130581, 2020-11-12T17:24:21.714 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.714 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.714 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.714 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.714 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.714 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25280 2020-11-12T17:24:21.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.715 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:24:21.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201480+0000", 2020-11-12T17:24:21.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999604 2020-11-12T17:24:21.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201440+0000", 2020-11-12T17:24:21.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011655 2020-11-12T17:24:21.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201557+0000", 2020-11-12T17:24:21.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7612999999999999e-05 2020-11-12T17:24:21.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201574+0000", 2020-11-12T17:24:21.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9449999999999993e-06 2020-11-12T17:24:21.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.201582+0000", 2020-11-12T17:24:21.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000790633 2020-11-12T17:24:21.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202373+0000", 2020-11-12T17:24:21.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107295 2020-11-12T17:24:21.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202480+0000", 2020-11-12T17:24:21.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000168703 2020-11-12T17:24:21.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:21.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.202649+0000", 2020-11-12T17:24:21.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050285470000000004 2020-11-12T17:24:21.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.207677+0000", 2020-11-12T17:24:21.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21784867699999999 2020-11-12T17:24:21.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425526+0000", 2020-11-12T17:24:21.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8837e-05 2020-11-12T17:24:21.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425575+0000", 2020-11-12T17:24:21.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5524000000000001e-05 2020-11-12T17:24:21.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.425610+0000", 2020-11-12T17:24:21.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224130581 2020-11-12T17:24:21.725 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.725 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.725 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.725 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:21.725 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:21.726 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.140182783999997, 2020-11-12T17:24:21.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:24:21.726 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.726 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.726 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.726 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.727 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.727 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:24:21.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.727 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:21.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:21.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:21.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:24:21.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:24:21.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:24:21.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:24:21.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:24:21.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:24:21.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:24:21.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:24:21.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:24:21.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:24:21.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:24:21.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:24:21.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:21.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:24:21.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:24:21.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:24:21.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:24:21.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:24:21.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:24:21.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:24:21.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:24:21.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:24:21.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:24:21.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.737 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.737 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:21.737 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:21.738 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.997630714, 2020-11-12T17:24:21.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:24:21.738 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.738 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.738 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:24:21.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.739 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:21.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:21.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:21.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:24:21.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:24:21.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:24:21.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:24:21.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:24:21.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:24:21.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:24:21.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:24:21.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:24:21.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:24:21.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:24:21.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:24:21.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:21.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:24:21.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:24:21.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:24:21.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:24:21.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:24:21.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:24:21.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:24:21.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:24:21.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:24:21.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:24:21.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.748 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.749 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e48)", 2020-11-12T17:24:21.749 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:21.749 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.920840916, 2020-11-12T17:24:21.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998, 2020-11-12T17:24:21.749 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.749 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:24:21.749 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.750 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:24:21.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.750 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:21.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:21.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:24:21.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676007+0000", 2020-11-12T17:24:21.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110902 2020-11-12T17:24:21.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676118+0000", 2020-11-12T17:24:21.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6195e-05 2020-11-12T17:24:21.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676135+0000", 2020-11-12T17:24:21.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3829999999999998e-06 2020-11-12T17:24:21.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676144+0000", 2020-11-12T17:24:21.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5806000000000001e-05 2020-11-12T17:24:21.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676200+0000", 2020-11-12T17:24:21.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9735999999999999e-05 2020-11-12T17:24:21.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:21.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676259+0000", 2020-11-12T17:24:21.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29976251100000001 2020-11-12T17:24:21.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976022+0000", 2020-11-12T17:24:21.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998 2020-11-12T17:24:21.756 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.757 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.757 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.757 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:33576 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:21.757 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:21.757 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 27.988986268000001, 2020-11-12T17:24:21.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846, 2020-11-12T17:24:21.758 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.758 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:21.758 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:21.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:21.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:21.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607883+0000", 2020-11-12T17:24:21.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0716000000000004e-05 2020-11-12T17:24:21.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607964+0000", 2020-11-12T17:24:21.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28021348200000001 2020-11-12T17:24:21.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888177+0000", 2020-11-12T17:24:21.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0214000000000001e-05 2020-11-12T17:24:21.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888188+0000", 2020-11-12T17:24:21.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0760999999999994e-05 2020-11-12T17:24:21.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888278+0000", 2020-11-12T17:24:21.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0537e-05 2020-11-12T17:24:21.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888299+0000", 2020-11-12T17:24:21.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020659300000000001 2020-11-12T17:24:21.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888505+0000", 2020-11-12T17:24:21.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846 2020-11-12T17:24:21.764 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.765 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.765 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.765 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34328 3.8 3:12eb1396:::benchmark_data_smithi036_14212_object4290:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:21.765 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:21.765 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 27.040441316999999, 2020-11-12T17:24:21.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999, 2020-11-12T17:24:21.766 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.766 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.766 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.766 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.766 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.766 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34328 2020-11-12T17:24:21.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.767 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:21.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:21.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999542 2020-11-12T17:24:21.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556414+0000", 2020-11-12T17:24:21.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133592 2020-11-12T17:24:21.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556547+0000", 2020-11-12T17:24:21.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8813000000000001e-05 2020-11-12T17:24:21.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556566+0000", 2020-11-12T17:24:21.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7660000000000004e-06 2020-11-12T17:24:21.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556575+0000", 2020-11-12T17:24:21.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011688914999999999 2020-11-12T17:24:21.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568264+0000", 2020-11-12T17:24:21.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108214 2020-11-12T17:24:21.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568372+0000", 2020-11-12T17:24:21.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189846 2020-11-12T17:24:21.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:21.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568562+0000", 2020-11-12T17:24:21.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016740710000000001 2020-11-12T17:24:21.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570236+0000", 2020-11-12T17:24:21.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29321335900000001 2020-11-12T17:24:21.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863449+0000", 2020-11-12T17:24:21.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7244999999999998e-05 2020-11-12T17:24:21.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863507+0000", 2020-11-12T17:24:21.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0704999999999994e-05 2020-11-12T17:24:21.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863587+0000", 2020-11-12T17:24:21.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999 2020-11-12T17:24:21.782 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.782 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.783 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.784 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34328 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:21.784 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:21.784 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 27.026084667999999, 2020-11-12T17:24:21.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998, 2020-11-12T17:24:21.785 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.785 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:21.786 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:21.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:21.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:21.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570784+0000", 2020-11-12T17:24:21.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2226999999999997e-05 2020-11-12T17:24:21.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570866+0000", 2020-11-12T17:24:21.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.290361445 2020-11-12T17:24:21.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861228+0000", 2020-11-12T17:24:21.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0240000000000003e-06 2020-11-12T17:24:21.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861237+0000", 2020-11-12T17:24:21.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021956749999999998 2020-11-12T17:24:21.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863432+0000", 2020-11-12T17:24:21.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2940000000000006e-06 2020-11-12T17:24:21.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863441+0000", 2020-11-12T17:24:21.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162399 2020-11-12T17:24:21.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863603+0000", 2020-11-12T17:24:21.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998 2020-11-12T17:24:21.796 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.797 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.797 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.798 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:21.798 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:21.798 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.526096805000002, 2020-11-12T17:24:21.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:24:21.798 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.799 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.799 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.799 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.799 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.800 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:24:21.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.800 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:21.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:21.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:24:21.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:24:21.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:24:21.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:24:21.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:24:21.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:24:21.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:24:21.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:24:21.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:24:21.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:24:21.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:24:21.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:24:21.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:24:21.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:21.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:24:21.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:24:21.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:24:21.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:24:21.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:24:21.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:24:21.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:24:21.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:24:21.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:24:21.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:24:21.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.816 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.817 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:21.817 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:21.817 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.510775583000001, 2020-11-12T17:24:21.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:24:21.818 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.818 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:21.819 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:21.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:21.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:24:21.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:24:21.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:24:21.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:24:21.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:24:21.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:24:21.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:24:21.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:24:21.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:24:21.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:24:21.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:24:21.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:24:21.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:24:21.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:24:21.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:24:21.825 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.826 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.826 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:35560 3.8 3:1a61aca4:::benchmark_data_smithi036_14212_object4444:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e50)", 2020-11-12T17:24:21.826 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.732096+0000", 2020-11-12T17:24:21.826 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.864805020999999, 2020-11-12T17:24:21.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25173599400000002, 2020-11-12T17:24:21.827 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.827 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.827 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35560 2020-11-12T17:24:21.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.828 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732096+0000", 2020-11-12T17:24:21.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732096+0000", 2020-11-12T17:24:21.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:24:21.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732052+0000", 2020-11-12T17:24:21.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000164792 2020-11-12T17:24:21.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732217+0000", 2020-11-12T17:24:21.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7034999999999999e-05 2020-11-12T17:24:21.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732234+0000", 2020-11-12T17:24:21.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2500000000000001e-05 2020-11-12T17:24:21.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.732247+0000", 2020-11-12T17:24:21.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046061080000000003 2020-11-12T17:24:21.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.736853+0000", 2020-11-12T17:24:21.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012839000000000001 2020-11-12T17:24:21.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.736981+0000", 2020-11-12T17:24:21.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000227438 2020-11-12T17:24:21.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:21.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.737209+0000", 2020-11-12T17:24:21.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048624660000000002 2020-11-12T17:24:21.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.742071+0000", 2020-11-12T17:24:21.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24159429499999999 2020-11-12T17:24:21.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983665+0000", 2020-11-12T17:24:21.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101854 2020-11-12T17:24:21.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983767+0000", 2020-11-12T17:24:21.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4479000000000004e-05 2020-11-12T17:24:21.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983832+0000", 2020-11-12T17:24:21.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25173599400000002 2020-11-12T17:24:21.836 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.836 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.836 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.837 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:35560 3.8 e50/20 ondisk, result = 0)", 2020-11-12T17:24:21.837 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.740928+0000", 2020-11-12T17:24:21.837 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.855973149, 2020-11-12T17:24:21.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.242910614, 2020-11-12T17:24:21.837 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.837 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:21.838 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.740928+0000", 2020-11-12T17:24:21.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.740928+0000", 2020-11-12T17:24:21.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:21.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.740903+0000", 2020-11-12T17:24:21.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5679000000000006e-05 2020-11-12T17:24:21.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.740968+0000", 2020-11-12T17:24:21.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24258650000000001 2020-11-12T17:24:21.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983555+0000", 2020-11-12T17:24:21.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4940000000000003e-06 2020-11-12T17:24:21.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983563+0000", 2020-11-12T17:24:21.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7237999999999995e-05 2020-11-12T17:24:21.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983640+0000", 2020-11-12T17:24:21.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3028e-05 2020-11-12T17:24:21.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983653+0000", 2020-11-12T17:24:21.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000184823 2020-11-12T17:24:21.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.983838+0000", 2020-11-12T17:24:21.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.242910614 2020-11-12T17:24:21.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.844 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.844 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.844 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:44616 3.b 3:d1bb5cd6:::benchmark_data_smithi036_14212_object5576:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:21.844 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.110901+0000", 2020-11-12T17:24:21.844 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.486000127000001, 2020-11-12T17:24:21.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27299974599999999, 2020-11-12T17:24:21.845 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.845 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.845 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44616 2020-11-12T17:24:21.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.846 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.110901+0000", 2020-11-12T17:24:21.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.110901+0000", 2020-11-12T17:24:21.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:21.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.110870+0000", 2020-11-12T17:24:21.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1399999999999999e-05 2020-11-12T17:24:21.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.110962+0000", 2020-11-12T17:24:21.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1857e-05 2020-11-12T17:24:21.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.110974+0000", 2020-11-12T17:24:21.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7490000000000004e-06 2020-11-12T17:24:21.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.110979+0000", 2020-11-12T17:24:21.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047484659999999998 2020-11-12T17:24:21.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.115728+0000", 2020-11-12T17:24:21.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012791899999999999 2020-11-12T17:24:21.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.115856+0000", 2020-11-12T17:24:21.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013592399999999999 2020-11-12T17:24:21.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:21.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.115992+0000", 2020-11-12T17:24:21.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003031462 2020-11-12T17:24:21.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.119023+0000", 2020-11-12T17:24:21.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26477989800000001 2020-11-12T17:24:21.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.383803+0000", 2020-11-12T17:24:21.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8496999999999999e-05 2020-11-12T17:24:21.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.383861+0000", 2020-11-12T17:24:21.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9017000000000003e-05 2020-11-12T17:24:21.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.383900+0000", 2020-11-12T17:24:21.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27299974599999999 2020-11-12T17:24:21.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.854 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.855 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:44616 3.b e53/20 ondisk, result = 0)", 2020-11-12T17:24:21.855 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.119415+0000", 2020-11-12T17:24:21.855 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.477486235000001, 2020-11-12T17:24:21.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.264493068, 2020-11-12T17:24:21.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.856 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:21.856 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.119415+0000", 2020-11-12T17:24:21.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.119415+0000", 2020-11-12T17:24:21.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:21.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.119391+0000", 2020-11-12T17:24:21.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0790000000000005e-05 2020-11-12T17:24:21.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.119462+0000", 2020-11-12T17:24:21.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26010241899999997 2020-11-12T17:24:21.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.379564+0000", 2020-11-12T17:24:21.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:24:21.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.379572+0000", 2020-11-12T17:24:21.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042174939999999996 2020-11-12T17:24:21.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.383789+0000", 2020-11-12T17:24:21.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6239999999999996e-06 2020-11-12T17:24:21.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.383796+0000", 2020-11-12T17:24:21.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111711 2020-11-12T17:24:21.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.383908+0000", 2020-11-12T17:24:21.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.264493068 2020-11-12T17:24:21.862 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.862 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.862 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.862 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45136 3.b 3:d2ab465f:::benchmark_data_smithi036_14212_object5641:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:21.863 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.582679+0000", 2020-11-12T17:24:21.863 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.014221754999999, 2020-11-12T17:24:21.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22521344500000001, 2020-11-12T17:24:21.863 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.863 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.863 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.863 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.863 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.864 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45136 2020-11-12T17:24:21.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.864 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.582679+0000", 2020-11-12T17:24:21.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.582679+0000", 2020-11-12T17:24:21.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:24:21.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.582662+0000", 2020-11-12T17:24:21.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8304000000000003e-05 2020-11-12T17:24:21.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.582720+0000", 2020-11-12T17:24:21.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5130000000000001e-05 2020-11-12T17:24:21.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.582735+0000", 2020-11-12T17:24:21.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7660000000000001e-06 2020-11-12T17:24:21.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.582742+0000", 2020-11-12T17:24:21.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015885368 2020-11-12T17:24:21.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.598627+0000", 2020-11-12T17:24:21.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8412999999999996e-05 2020-11-12T17:24:21.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.598706+0000", 2020-11-12T17:24:21.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018770700000000001 2020-11-12T17:24:21.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:21.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.598894+0000", 2020-11-12T17:24:21.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001801602 2020-11-12T17:24:21.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.600695+0000", 2020-11-12T17:24:21.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20707784000000001 2020-11-12T17:24:21.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.807773+0000", 2020-11-12T17:24:21.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6278999999999993e-05 2020-11-12T17:24:21.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.807839+0000", 2020-11-12T17:24:21.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3238000000000001e-05 2020-11-12T17:24:21.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.807893+0000", 2020-11-12T17:24:21.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22521344500000001 2020-11-12T17:24:21.873 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.873 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.873 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.873 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45152 3.8 3:1ceaefb4:::benchmark_data_smithi036_14212_object5643:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:21.873 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.602097+0000", 2020-11-12T17:24:21.874 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.99480357, 2020-11-12T17:24:21.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26304599899999997, 2020-11-12T17:24:21.874 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.874 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.874 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.874 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.874 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.874 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45152 2020-11-12T17:24:21.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.875 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.602097+0000", 2020-11-12T17:24:21.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.602097+0000", 2020-11-12T17:24:21.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:24:21.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.602069+0000", 2020-11-12T17:24:21.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8589000000000002e-05 2020-11-12T17:24:21.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.602158+0000", 2020-11-12T17:24:21.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2785999999999999e-05 2020-11-12T17:24:21.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.602170+0000", 2020-11-12T17:24:21.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9269999999999996e-06 2020-11-12T17:24:21.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.602175+0000", 2020-11-12T17:24:21.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086781800000000006 2020-11-12T17:24:21.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.610854+0000", 2020-11-12T17:24:21.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3880000000000003e-05 2020-11-12T17:24:21.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.610937+0000", 2020-11-12T17:24:21.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000146775 2020-11-12T17:24:21.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:21.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.611084+0000", 2020-11-12T17:24:21.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024530649999999999 2020-11-12T17:24:21.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.613537+0000", 2020-11-12T17:24:21.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25149877999999998 2020-11-12T17:24:21.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.865036+0000", 2020-11-12T17:24:21.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5207000000000002e-05 2020-11-12T17:24:21.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.865091+0000", 2020-11-12T17:24:21.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2055999999999998e-05 2020-11-12T17:24:21.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.865143+0000", 2020-11-12T17:24:21.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26304599899999997 2020-11-12T17:24:21.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.883 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.884 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.884 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:21.884 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:21.884 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.733925620999999, 2020-11-12T17:24:21.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:24:21.885 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.885 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.885 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:24:21.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.885 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:21.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:21.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:21.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:24:21.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:24:21.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:24:21.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:24:21.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:24:21.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:24:21.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:24:21.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:24:21.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:24:21.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:24:21.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:24:21.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:24:21.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:21.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:24:21.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:24:21.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:24:21.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:24:21.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:24:21.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:24:21.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:24:21.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:24:21.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:24:21.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:24:21.903 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.903 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.904 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.904 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50544 3.8 3:13876818:::benchmark_data_smithi036_14212_object6317:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:21.904 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:21.904 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.8673006290000007, 2020-11-12T17:24:21.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998, 2020-11-12T17:24:21.904 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.905 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:21.905 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:21.905 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:21.905 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:21.905 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50544 2020-11-12T17:24:21.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.905 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:21.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:21.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:24:21.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729570+0000", 2020-11-12T17:24:21.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010924 2020-11-12T17:24:21.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729679+0000", 2020-11-12T17:24:21.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1567e-05 2020-11-12T17:24:21.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729691+0000", 2020-11-12T17:24:21.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0929999999999999e-06 2020-11-12T17:24:21.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729697+0000", 2020-11-12T17:24:21.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086737580000000002 2020-11-12T17:24:21.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738371+0000", 2020-11-12T17:24:21.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7824999999999993e-05 2020-11-12T17:24:21.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738459+0000", 2020-11-12T17:24:21.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017210899999999999 2020-11-12T17:24:21.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:21.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738631+0000", 2020-11-12T17:24:21.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027566969999999998 2020-11-12T17:24:21.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:21.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.741387+0000", 2020-11-12T17:24:21.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27686545000000001 2020-11-12T17:24:21.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:21.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018253+0000", 2020-11-12T17:24:21.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3428000000000002e-05 2020-11-12T17:24:21.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:21.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018336+0000", 2020-11-12T17:24:21.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5240999999999994e-05 2020-11-12T17:24:21.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018402+0000", 2020-11-12T17:24:21.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998 2020-11-12T17:24:21.914 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.914 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.914 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.915 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:50544 3.8 e55/20 ondisk, result = 0)", 2020-11-12T17:24:21.915 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:21.915 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.8543481939999999, 2020-11-12T17:24:21.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.275860253, 2020-11-12T17:24:21.915 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:21.915 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:21.915 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:21.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:21.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:21.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:21.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:21.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:21.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:24:21.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:21.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742526+0000", 2020-11-12T17:24:21.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6210999999999993e-05 2020-11-12T17:24:21.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:21.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742592+0000", 2020-11-12T17:24:21.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27212335799999998 2020-11-12T17:24:21.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:21.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.014715+0000", 2020-11-12T17:24:21.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3250000000000001e-06 2020-11-12T17:24:21.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:21.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.014720+0000", 2020-11-12T17:24:21.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035069239999999998 2020-11-12T17:24:21.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018227+0000", 2020-11-12T17:24:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3804e-05 2020-11-12T17:24:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018241+0000", 2020-11-12T17:24:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017238900000000001 2020-11-12T17:24:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018413+0000", 2020-11-12T17:24:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.275860253 2020-11-12T17:24:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:21.922 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:21.924 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:21.924 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:21.924 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:21.924 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:21.925 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:24:21.925 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:24:21.925 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:24:21.925 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:24:21.925 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:24:21.925 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:24:21.925 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:24:21.926 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:24:21.926 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:21.916+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:21.926 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:22.025 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:22.022+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:22.040 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:22.041 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:22.041 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:24:22.041 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:22.052 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:22.137 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:22.134+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:22.218 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:22.218 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:22.219 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:22.219 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:22.219 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:22.227 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:22.222+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:22.229 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:22.328 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:22.326+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:22.393 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:22.393 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:22.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:22.394 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:22.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.394 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:24:22.394 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:22.394 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.633313004000001, 2020-11-12T17:24:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:24:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:24:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:24:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:24:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:24:22.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:24:22.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:24:22.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:24:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:24:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:24:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:24:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:24:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:24:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:24:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:24:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:24:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:24:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:24:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:24:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:24:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:24:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:24:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:24:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:24:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:24:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:24:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.626514153000002, 2020-11-12T17:24:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:24:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:24:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:24:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:24:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:24:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:24:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:24:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:24:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:24:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:24:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:24:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:24:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:24:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:24:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:24:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1104 3.9 3:9f55e211:::benchmark_data_smithi036_14212_object137:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:24:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.774719802000007, 2020-11-12T17:24:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001, 2020-11-12T17:24:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1104 2020-11-12T17:24:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617385+0000", 2020-11-12T17:24:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9141999999999994e-05 2020-11-12T17:24:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617484+0000", 2020-11-12T17:24:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2413e-05 2020-11-12T17:24:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617497+0000", 2020-11-12T17:24:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1659999999999999e-06 2020-11-12T17:24:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617503+0000", 2020-11-12T17:24:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032791000000000001 2020-11-12T17:24:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620782+0000", 2020-11-12T17:24:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102198 2020-11-12T17:24:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620884+0000", 2020-11-12T17:24:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114058 2020-11-12T17:24:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620998+0000", 2020-11-12T17:24:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018203270000000001 2020-11-12T17:24:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622818+0000", 2020-11-12T17:24:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.203924995 2020-11-12T17:24:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826743+0000", 2020-11-12T17:24:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012106 2020-11-12T17:24:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826865+0000", 2020-11-12T17:24:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014220699999999999 2020-11-12T17:24:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827007+0000", 2020-11-12T17:24:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001 2020-11-12T17:24:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1104 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:24:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:24:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.76979102, 2020-11-12T17:24:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999, 2020-11-12T17:24:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:24:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622352+0000", 2020-11-12T17:24:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:24:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622338+0000", 2020-11-12T17:24:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5814e-05 2020-11-12T17:24:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622374+0000", 2020-11-12T17:24:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20244251299999999 2020-11-12T17:24:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824817+0000", 2020-11-12T17:24:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.117e-05 2020-11-12T17:24:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.824828+0000", 2020-11-12T17:24:22.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001882332 2020-11-12T17:24:22.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826710+0000", 2020-11-12T17:24:22.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6818000000000001e-05 2020-11-12T17:24:22.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826727+0000", 2020-11-12T17:24:22.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031566199999999997 2020-11-12T17:24:22.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827043+0000", 2020-11-12T17:24:22.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20469040499999999 2020-11-12T17:24:22.775 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.776 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.776 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.777 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:24:22.777 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:22.777 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.383255376999998, 2020-11-12T17:24:22.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:24:22.778 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.778 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.779 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:22.779 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:22.779 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:22.779 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:24:22.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.780 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:22.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:22.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:22.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:24:22.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:24:22.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:24:22.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:24:22.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:24:22.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:24:22.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:24:22.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:24:22.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:24:22.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:24:22.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:24:22.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:24:22.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:22.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:24:22.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:24:22.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:22.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:24:22.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:24:22.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:22.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:24:22.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:24:22.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:24:22.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:24:22.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:24:22.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:24:22.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.799 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.799 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:24:22.799 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:22.800 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.376040196000005, 2020-11-12T17:24:22.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:24:22.800 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.800 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:22.800 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:22.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:22.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:24:22.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:24:22.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:24:22.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:24:22.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:24:22.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:24:22.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:24:22.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:24:22.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:24:22.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:24:22.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:24:22.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:24:22.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:24:22.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:24:22.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:24:22.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.806 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.807 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:22.807 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:22.807 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.705595305000003, 2020-11-12T17:24:22.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:24:22.807 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.807 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.808 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:22.808 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:22.808 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:22.808 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:24:22.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.808 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:22.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:22.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:22.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:24:22.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:24:22.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:24:22.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:24:22.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:24:22.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:24:22.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:24:22.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:24:22.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:24:22.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:24:22.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:24:22.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:24:22.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:22.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:24:22.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:24:22.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:22.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:24:22.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:24:22.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:22.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:24:22.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:24:22.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:24:22.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:24:22.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:24:22.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:24:22.817 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.817 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.817 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.817 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:22.818 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:22.818 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.705430402000005, 2020-11-12T17:24:22.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:24:22.818 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.818 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.818 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:22.818 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:22.819 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:22.819 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:24:22.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.819 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:22.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:22.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:22.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:24:22.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:24:22.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:24:22.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:24:22.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:24:22.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:24:22.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:24:22.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:24:22.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:24:22.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:24:22.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:24:22.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:24:22.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:22.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:24:22.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:24:22.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:22.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:24:22.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:24:22.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:22.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:24:22.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:24:22.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:24:22.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:24:22.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:24:22.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:24:22.828 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.828 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.828 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.828 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:24:22.829 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:22.829 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.701267168000001, 2020-11-12T17:24:22.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:24:22.829 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.829 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:22.829 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:22.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:22.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:24:22.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:24:22.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:24:22.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:24:22.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:24:22.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:24:22.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:24:22.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:24:22.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:24:22.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:24:22.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:24:22.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:24:22.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:24:22.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:24:22.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:24:22.835 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.835 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.836 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.836 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:24:22.836 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:22.836 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.699950333000004, 2020-11-12T17:24:22.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:24:22.836 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.837 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:22.837 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:22.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:22.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:22.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:24:22.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:24:22.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:24:22.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:24:22.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:24:22.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:24:22.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:24:22.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:24:22.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:24:22.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:24:22.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:24:22.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:24:22.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:24:22.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:24:22.843 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.843 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.843 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.843 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:24:22.843 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:22.844 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.837630700999995, 2020-11-12T17:24:22.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:24:22.844 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.844 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.844 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:22.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:22.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:24:22.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:24:22.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:24:22.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:24:22.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:24:22.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:24:22.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:24:22.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:24:22.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:24:22.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:24:22.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:24:22.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:24:22.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:24:22.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:24:22.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:24:22.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:24:22.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:24:22.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.851 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.851 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:24:22.851 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:22.852 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.509828732999999, 2020-11-12T17:24:22.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:24:22.852 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.852 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:22.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:22.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:22.852 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:24:22.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.853 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:22.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:22.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:24:22.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:24:22.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:24:22.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:24:22.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:24:22.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:24:22.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:24:22.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:24:22.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:24:22.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:24:22.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:24:22.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:24:22.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:24:22.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:22.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:24:22.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:24:22.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:22.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:24:22.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:24:22.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:22.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:24:22.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:24:22.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:24:22.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:24:22.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:24:22.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:24:22.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.862 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.862 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.862 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:24:22.862 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:22.862 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.502585023999998, 2020-11-12T17:24:22.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:24:22.863 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.863 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:22.863 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:22.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:22.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:22.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:24:22.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:24:22.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:24:22.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:24:22.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:24:22.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:24:22.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:24:22.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:24:22.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:24:22.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:24:22.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:24:22.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:24:22.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:24:22.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:24:22.869 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.869 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.869 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.869 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:24:22.870 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:22.870 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 42.340237320999996, 2020-11-12T17:24:22.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:24:22.870 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.870 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.870 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:22.870 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:22.870 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:22.871 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:24:22.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.871 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:22.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:22.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:22.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:24:22.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:24:22.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:24:22.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:24:22.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:24:22.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:24:22.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:24:22.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:24:22.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:24:22.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:24:22.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:24:22.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:24:22.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:22.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:24:22.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:24:22.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:22.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:24:22.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:24:22.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:22.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:24:22.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:24:22.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:24:22.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:24:22.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:24:22.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:24:22.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.880 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.880 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.880 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:22.880 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:22.880 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.399409563999999, 2020-11-12T17:24:22.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:24:22.881 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.881 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.881 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:22.881 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:22.881 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:22.881 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:24:22.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.882 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:22.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:22.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:24:22.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:24:22.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:24:22.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:24:22.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:24:22.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:24:22.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:24:22.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:24:22.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:24:22.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:24:22.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:24:22.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:24:22.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:24:22.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:22.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:24:22.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:24:22.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:22.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:24:22.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:24:22.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:22.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:24:22.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:24:22.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:24:22.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:24:22.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:24:22.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:24:22.890 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.890 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.890 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.891 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:24:22.891 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:22.891 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.391750755, 2020-11-12T17:24:22.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:24:22.891 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.891 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:22.891 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:22.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:22.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:24:22.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:24:22.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:24:22.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:24:22.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:24:22.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:24:22.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:24:22.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:24:22.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:24:22.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:24:22.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:24:22.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:24:22.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:24:22.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:24:22.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:24:22.897 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.897 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.898 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.898 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39832 3.3 3:cb2faec6:::benchmark_data_smithi036_14212_object4978:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:22.898 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:24:22.898 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.015977019000001, 2020-11-12T17:24:22.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.229556766, 2020-11-12T17:24:22.899 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.899 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:22.899 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:22.899 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:22.899 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:22.899 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39832 2020-11-12T17:24:22.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.899 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:22.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:22.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:24:22.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:22.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:22.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:24:22.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999251 2020-11-12T17:24:22.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:22.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376091+0000", 2020-11-12T17:24:22.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018965799999999999 2020-11-12T17:24:22.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:22.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376281+0000", 2020-11-12T17:24:22.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7319999999999999e-05 2020-11-12T17:24:22.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:22.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376308+0000", 2020-11-12T17:24:22.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8396000000000001e-05 2020-11-12T17:24:22.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:22.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376327+0000", 2020-11-12T17:24:22.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006884991 2020-11-12T17:24:22.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:22.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383212+0000", 2020-11-12T17:24:22.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5163999999999999e-05 2020-11-12T17:24:22.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:22.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383307+0000", 2020-11-12T17:24:22.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015254400000000001 2020-11-12T17:24:22.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:22.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383459+0000", 2020-11-12T17:24:22.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041117929999999999 2020-11-12T17:24:22.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:22.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.387571+0000", 2020-11-12T17:24:22.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21802176100000001 2020-11-12T17:24:22.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:22.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605593+0000", 2020-11-12T17:24:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3146999999999996e-05 2020-11-12T17:24:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605666+0000", 2020-11-12T17:24:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6776e-05 2020-11-12T17:24:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:22.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605723+0000", 2020-11-12T17:24:22.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.229556766 2020-11-12T17:24:22.908 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.908 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:22.908 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:22.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:22.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:22.909 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:39832 3.3 e51/20 ondisk, result = 0)", 2020-11-12T17:24:22.909 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.386034+0000", 2020-11-12T17:24:22.909 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.006109275, 2020-11-12T17:24:22.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21969730200000001, 2020-11-12T17:24:22.909 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:22.909 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:24.442 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:24.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:24.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:24.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.386034+0000", 2020-11-12T17:24:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.386034+0000", 2020-11-12T17:24:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.385992+0000", 2020-11-12T17:24:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101897 2020-11-12T17:24:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.386094+0000", 2020-11-12T17:24:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21941154500000001 2020-11-12T17:24:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605506+0000", 2020-11-12T17:24:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.241e-06 2020-11-12T17:24:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605512+0000", 2020-11-12T17:24:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3314999999999999e-05 2020-11-12T17:24:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:24.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:24.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605575+0000", 2020-11-12T17:24:24.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9410000000000002e-06 2020-11-12T17:24:24.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:24.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:25.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605585+0000", 2020-11-12T17:24:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014588599999999999 2020-11-12T17:24:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605731+0000", 2020-11-12T17:24:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21969730200000001 2020-11-12T17:24:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:49760 3.a e55/31 3:56296e74:::benchmark_data_smithi036_14212_object6219:head v 55'3192, mlcod=55'3188)", 2020-11-12T17:24:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:11.825562+0000", 2020-11-12T17:24:25.262 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.5665814, 2020-11-12T17:24:25.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20892949199999999, 2020-11-12T17:24:25.262 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:25.263 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.825562+0000", 2020-11-12T17:24:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.825562+0000", 2020-11-12T17:24:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:24:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.825534+0000", 2020-11-12T17:24:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0915999999999995e-05 2020-11-12T17:24:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:11.825624+0000", 2020-11-12T17:24:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.205719823 2020-11-12T17:24:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.031344+0000", 2020-11-12T17:24:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-06 2020-11-12T17:24:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.031353+0000", 2020-11-12T17:24:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8449999999999996e-05 2020-11-12T17:24:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.031431+0000", 2020-11-12T17:24:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0253999999999999e-05 2020-11-12T17:24:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.031461+0000", 2020-11-12T17:24:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029712419999999998 2020-11-12T17:24:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.034432+0000", 2020-11-12T17:24:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8727000000000002e-05 2020-11-12T17:24:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.034491+0000", 2020-11-12T17:24:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20892949199999999 2020-11-12T17:24:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:25.882 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:25.882 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:25.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.883 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:50240 3.1 e55/20 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head v 55'3224, mlcod=55'3218)", 2020-11-12T17:24:25.883 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:24:25.883 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.025101210000001, 2020-11-12T17:24:25.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149, 2020-11-12T17:24:25.884 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:25.884 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:25.884 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:25.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:25.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:24:25.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:25.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:25.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:24:25.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:24:25.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:25.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367024+0000", 2020-11-12T17:24:25.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9963000000000002e-05 2020-11-12T17:24:25.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:25.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367084+0000", 2020-11-12T17:24:25.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23018651500000001 2020-11-12T17:24:25.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:25.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597271+0000", 2020-11-12T17:24:25.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2030000000000003e-06 2020-11-12T17:24:25.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:25.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597278+0000", 2020-11-12T17:24:25.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3430000000000002e-05 2020-11-12T17:24:25.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:25.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597331+0000", 2020-11-12T17:24:25.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2829000000000001e-05 2020-11-12T17:24:25.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:25.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597354+0000", 2020-11-12T17:24:25.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064125579999999996 2020-11-12T17:24:25.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:25.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603767+0000", 2020-11-12T17:24:25.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2398999999999997e-05 2020-11-12T17:24:25.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:25.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:25.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:25.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603829+0000", 2020-11-12T17:24:25.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149 2020-11-12T17:24:25.896 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:25.897 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:25.897 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:25.897 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:25.898 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:25.898 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:25.899 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:24:25.903 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:24:25.903 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 78 16 57836 57820 5.79071 2.32812 0.0124604 0.0214802 2020-11-12T17:24:25.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 79 16 58673 58657 5.80017 6.53906 0.0079808 0.0215428 2020-11-12T17:24:25.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:24:24.568633+0000 min lat: 0.00161593 max lat: 14.2555 avg lat: 0.0215259 2020-11-12T17:24:25.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:24:25.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 80 16 59440 59424 5.80256 5.99219 0.018858 0.0215259 2020-11-12T17:24:25.905 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 81 16 60222 60206 5.80635 6.10938 0.0129399 0.0215154 2020-11-12T17:24:25.906 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:25.894+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:25.907 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:26.001 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:25.996+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:26.110 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:26.111 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:26.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.111 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:60577 3.2 e57/20 3:4cea576e:::benchmark_data_smithi036_14212_object7572:head v 57'3745, mlcod=57'3743)", 2020-11-12T17:24:26.115 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:26.081692+0000", 2020-11-12T17:24:26.115 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0011275339999999999, 2020-11-12T17:24:26.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011459969999999999, 2020-11-12T17:24:26.116 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:26.116 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:26.116 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:26.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:26.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.081692+0000", 2020-11-12T17:24:26.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:26.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:26.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.081692+0000", 2020-11-12T17:24:26.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:24:26.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:26.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.081653+0000", 2020-11-12T17:24:26.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010432100000000001 2020-11-12T17:24:26.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:26.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.081758+0000", 2020-11-12T17:24:26.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3919999999999999e-05 2020-11-12T17:24:26.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:26.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.081812+0000", 2020-11-12T17:24:26.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9429999999999997e-06 2020-11-12T17:24:26.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:26.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.081817+0000", 2020-11-12T17:24:26.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2540000000000002e-05 2020-11-12T17:24:26.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:26.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.081870+0000", 2020-11-12T17:24:26.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4437999999999999e-05 2020-11-12T17:24:26.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:26.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.081894+0000", 2020-11-12T17:24:26.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020247200000000001 2020-11-12T17:24:26.121 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:26.122 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:26.122 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:26.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.122 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:60574 3.d e57/20 3:b514d34d:::benchmark_data_smithi036_14212_object7571:head v 57'3582, mlcod=57'3577)", 2020-11-12T17:24:26.122 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:26.082457+0000", 2020-11-12T17:24:26.122 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00036263799999999998, 2020-11-12T17:24:26.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000423039, 2020-11-12T17:24:26.123 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:26.123 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:26.123 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:26.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:26.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.082457+0000", 2020-11-12T17:24:26.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:26.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:26.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.082457+0000", 2020-11-12T17:24:26.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:26.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:26.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.082445+0000", 2020-11-12T17:24:26.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2809000000000003e-05 2020-11-12T17:24:26.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:26.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.082488+0000", 2020-11-12T17:24:26.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7638e-05 2020-11-12T17:24:26.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:26.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.082535+0000", 2020-11-12T17:24:26.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5129999999999998e-06 2020-11-12T17:24:26.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:26.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.082540+0000", 2020-11-12T17:24:26.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0343000000000001e-05 2020-11-12T17:24:26.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:26.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.082570+0000", 2020-11-12T17:24:26.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3025e-05 2020-11-12T17:24:26.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:26.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:26.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:26.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:26.082583+0000", 2020-11-12T17:24:26.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012628300000000001 2020-11-12T17:24:26.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:26.130 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:26.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:26.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:26.130 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:24:26.130 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:24:26.130 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:26.131 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:26.132 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:26.132 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:26.104+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:26.133 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:24:26.159 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:26.183 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:26.210 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:26.214 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:26.208+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:26.239 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:26.281 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:26.282 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:26.283 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:26.284 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:26.302 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:26.304 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:24:26.305 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:24:26.305 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:24:26.305 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:24:26.305 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:24:26.305 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:24:26.305 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:24:26.306 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:24:26.316 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:26.308+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:26.411 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:26.412 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:26.417 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:26.412+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:26.424 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:26.518 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:26.514+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:26.553 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:26.553 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:26.571 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 82 16 60958 60942 5.80565 5.75 0.00709223 0.0215229 2020-11-12T17:24:26.572 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:26.618 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:26.612+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:26.720 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:26.712+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:26.741 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:26.741 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:26.753 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:26.821 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:26.816+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:26.868 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:26.868 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:26.885 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:26.922 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:26.916+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:27.005 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:27.005 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:27.020 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:27.022 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:27.016+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:27.123 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:24:27.116+0000 7f7fecf48700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 12300) UID: 0 2020-11-12T17:24:27.151 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:27.151 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:27.163 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:27.225 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:27.222+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:27.279 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:27.280 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:27.292 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:27.337 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:27.332+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:27.410 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:27.411 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:27.421 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:27.464 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:27.460+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:27.529 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:27.526+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:27.569 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 83 16 61726 61710 5.80799 6 0.0114111 0.0215108 2020-11-12T17:24:27.580 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:27.580 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:27.588 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:27.632 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:27.628+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:27.718 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:27.718 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:27.729 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:24:27.772 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:27.768+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:27.833 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:27.830+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:27.848 INFO:tasks.thrashosds.thrasher:Recovered, killing an osd 2020-11-12T17:24:27.848 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2020-11-12T17:24:27.849 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-11-12T17:24:27.849 INFO:teuthology.orchestra.run:waiting for 300 2020-11-12T17:24:27.907 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:24:27.938 INFO:teuthology.orchestra.run.smithi036.stderr:admin_socket: exception getting command descriptions: exception: [Errno 104] Connection reset by peer 2020-11-12T17:24:27.938 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:27.928+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:27.939 DEBUG:teuthology.orchestra.run:got remote process result: 22 2020-11-12T17:24:27.940 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:24:27.948 INFO:tasks.ceph.osd.1:Stopped 2020-11-12T17:24:27.948 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd down 1 2020-11-12T17:24:28.034 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:28.030+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:28.082 INFO:teuthology.orchestra.run.smithi036.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2020-11-12T17:24:28.084 DEBUG:teuthology.orchestra.run:got remote process result: 22 2020-11-12T17:24:28.085 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:24:28.136 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:28.130+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:28.190 INFO:teuthology.orchestra.run.smithi036.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2020-11-12T17:24:28.192 DEBUG:teuthology.orchestra.run:got remote process result: 22 2020-11-12T17:24:28.193 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:28.237 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:28.232+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:28.308 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:28.309 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:28.317 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:28.319 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:24:28.320 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:24:28.312+0000 7f4952786700 -1 mon.a@0(leader).osd e57 definitely_dead 0 2020-11-12T17:24:28.338 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:28.334+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:28.431 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:28.431 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:28.438 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:28.440 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:28.434+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:28.485 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:28.541 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:28.538+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:28.558 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:28.558 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:28.568 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:28.569 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 84 16 62053 62037 5.76925 2.55469 0.444321 0.0215066 2020-11-12T17:24:28.638 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:24:28.639 INFO:teuthology.orchestra.run.smithi036.stderr:marked down osd.1. 2020-11-12T17:24:28.641 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:28.638+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:28.652 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 3, 4, 5, 7, 6] 2020-11-12T17:24:28.653 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 1 2020-11-12T17:24:28.686 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:28.687 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:28.696 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:28.845 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:28.840+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:28.848 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:28.849 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:28.858 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:28.963 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:28.963 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:28.972 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:28.991 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:24:28.984+0000 7f4952786700 -1 mon.a@0(leader).osd e58 definitely_dead 0 2020-11-12T17:24:29.128 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:29.128 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:29.137 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:29.250 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:29.251 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:29.258 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:29.402 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:28.734+0000 7f7b4b297700 -1 osd.4 57 handle_osd_map injecting map crc failure 2020-11-12T17:24:29.403 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:28.778+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:29.403 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:28.942+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:29.404 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:29.398+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:29.404 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:29.398+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:29.404 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:29.398+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:29.405 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:29.178+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:29.412 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:29.412 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:29.421 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:29.469 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:29.466+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:29.521 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:29.521 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:29.531 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:29.571 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 85 16 62054 62038 5.70146 0.0078125 1.32845 0.0215276 2020-11-12T17:24:29.573 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:29.570+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:29.633 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:29.630+0000 7f7b4fea9700 -1 osd.4 58 handle_osd_map injecting map crc failure 2020-11-12T17:24:29.643 INFO:teuthology.orchestra.run.smithi036.stderr:marked out osd.1. 2020-11-12T17:24:29.654 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:29.650+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:29.656 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.1 2020-11-12T17:24:29.656 INFO:tasks.thrashosds.thrasher:remote for osd 1 is ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:24:29.657 INFO:teuthology.orchestra.run.smithi036:> type ceph-objectstore-tool 2020-11-12T17:24:29.679 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:29.679 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:29.688 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:29.705 INFO:teuthology.orchestra.run.smithi036.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2020-11-12T17:24:29.705 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op list-pgs 2020-11-12T17:24:29.773 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:29.770+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:29.840 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:29.841 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:29.851 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:29.897 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:29.894+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:29.957 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:29.954+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:30.016 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:30.017 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:30.022 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:30.065 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:30.062+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:30.159 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:30.152+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:30.175 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:30.176 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:30.185 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:30.261 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:30.256+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:30.295 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:30.295 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:30.315 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:30.363 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:30.356+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:30.425 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:30.425 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:30.426 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:24:30.426 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:30.434 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:30.476 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:30.472+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:30.565 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:30.562+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:30.570 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 86 16 62054 62038 5.63517 0 - 0.0215276 2020-11-12T17:24:30.590 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:30.590 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:30.590 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:30.591 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:30.591 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:30.598 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:30.635 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:30.630+0000 7f7b4fea9700 -1 osd.4 59 handle_osd_map injecting map crc failure 2020-11-12T17:24:30.653 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:24:30.696 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:30.692+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:30.735 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:30.736 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:30.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:30.736 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:30.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.736 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:24:30.737 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:30.737 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.622721069999997, 2020-11-12T17:24:30.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:24:30.737 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.737 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.737 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.737 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.738 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:24:30.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.738 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:30.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:30.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:30.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:24:30.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:24:30.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:24:30.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:24:30.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:24:30.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:24:30.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:24:30.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:24:30.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:24:30.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:24:30.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:24:30.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:24:30.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:30.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:24:30.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:24:30.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:24:30.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:24:30.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:24:30.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:24:30.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:24:30.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:24:30.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:24:30.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:24:30.747 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.747 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.747 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.748 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:24:30.748 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:30.748 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.615629274, 2020-11-12T17:24:30.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:24:30.748 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.748 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:30.749 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:30.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:30.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:24:30.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:24:30.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:24:30.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:24:30.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:24:30.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:24:30.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:24:30.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:24:30.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:24:30.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:24:30.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:24:30.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:24:30.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:24:30.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:24:30.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:24:30.755 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.755 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.755 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.756 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:30.756 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:30.756 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.183592196000006, 2020-11-12T17:24:30.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999, 2020-11-12T17:24:30.756 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.756 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.756 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.756 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.757 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.757 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:24:30.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.757 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:30.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:30.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:24:30.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:24:30.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:24:30.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:24:30.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:24:30.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:24:30.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:24:30.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:24:30.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:24:30.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:24:30.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:24:30.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:24:30.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112811 2020-11-12T17:24:30.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:30.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550940+0000", 2020-11-12T17:24:30.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001154101 2020-11-12T17:24:30.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552095+0000", 2020-11-12T17:24:30.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25363090900000002 2020-11-12T17:24:30.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805725+0000", 2020-11-12T17:24:30.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8797999999999998e-05 2020-11-12T17:24:30.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805824+0000", 2020-11-12T17:24:30.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8110999999999998e-05 2020-11-12T17:24:30.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805902+0000", 2020-11-12T17:24:30.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999 2020-11-12T17:24:30.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.766 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.767 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:30.767 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:30.767 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.183069777, 2020-11-12T17:24:30.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:24:30.767 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.767 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.767 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.768 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:24:30.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.768 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:30.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:30.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:30.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:24:30.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:24:30.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:24:30.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:24:30.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:24:30.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:24:30.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:24:30.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:24:30.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:24:30.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:24:30.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:24:30.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:24:30.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:30.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:24:30.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:24:30.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:24:30.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:24:30.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:24:30.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:24:30.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:24:30.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:24:30.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:24:30.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:24:30.778 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.778 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.778 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.778 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9999 3.1 e26/20 ondisk, result = 0)", 2020-11-12T17:24:30.778 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:30.778 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.174707256999994, 2020-11-12T17:24:30.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145, 2020-11-12T17:24:30.779 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.779 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:30.779 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:30.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:30.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:30.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556869+0000", 2020-11-12T17:24:30.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1767999999999994e-05 2020-11-12T17:24:30.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556951+0000", 2020-11-12T17:24:30.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.248442731 2020-11-12T17:24:30.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805393+0000", 2020-11-12T17:24:30.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5503e-05 2020-11-12T17:24:30.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805409+0000", 2020-11-12T17:24:30.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027928399999999998 2020-11-12T17:24:30.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805688+0000", 2020-11-12T17:24:30.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2215e-05 2020-11-12T17:24:30.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805710+0000", 2020-11-12T17:24:30.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000226744 2020-11-12T17:24:30.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805937+0000", 2020-11-12T17:24:30.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145 2020-11-12T17:24:30.785 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.786 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.786 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:19200 3.6 3:6b800c56:::benchmark_data_smithi036_14212_object2399:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e41)", 2020-11-12T17:24:30.786 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:38.974706+0000", 2020-11-12T17:24:30.787 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 51.756892622999999, 2020-11-12T17:24:30.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22555055199999999, 2020-11-12T17:24:30.787 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.787 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.787 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.788 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.788 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.788 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19200 2020-11-12T17:24:30.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.788 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.974706+0000", 2020-11-12T17:24:30.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.974706+0000", 2020-11-12T17:24:30.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:30.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.974668+0000", 2020-11-12T17:24:30.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106136 2020-11-12T17:24:30.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.974775+0000", 2020-11-12T17:24:30.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6563e-05 2020-11-12T17:24:30.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.974791+0000", 2020-11-12T17:24:30.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468999999999999e-05 2020-11-12T17:24:30.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.974802+0000", 2020-11-12T17:24:30.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024134640000000001 2020-11-12T17:24:30.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.977215+0000", 2020-11-12T17:24:30.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6730999999999993e-05 2020-11-12T17:24:30.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.977302+0000", 2020-11-12T17:24:30.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014449600000000001 2020-11-12T17:24:30.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:30.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.977446+0000", 2020-11-12T17:24:30.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014358109999999999 2020-11-12T17:24:30.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:38.978882+0000", 2020-11-12T17:24:30.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.221256072 2020-11-12T17:24:30.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.200138+0000", 2020-11-12T17:24:30.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4609000000000004e-05 2020-11-12T17:24:30.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.200203+0000", 2020-11-12T17:24:30.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3368000000000001e-05 2020-11-12T17:24:30.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:39.200256+0000", 2020-11-12T17:24:30.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22555055199999999 2020-11-12T17:24:30.798 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.798 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.798 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.798 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:25512 3.b e46/20 3:d013695c:::benchmark_data_smithi036_14212_object3188:head v 46'1664, mlcod=46'1657)", 2020-11-12T17:24:30.798 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:30.798 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.270531304000002, 2020-11-12T17:24:30.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999, 2020-11-12T17:24:30.799 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.799 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.799 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:30.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:30.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:24:30.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461054+0000", 2020-11-12T17:24:30.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5973000000000002e-05 2020-11-12T17:24:30.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461100+0000", 2020-11-12T17:24:30.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27743074600000001 2020-11-12T17:24:30.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738530+0000", 2020-11-12T17:24:30.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6039999999999993e-06 2020-11-12T17:24:30.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738539+0000", 2020-11-12T17:24:30.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7942000000000006e-05 2020-11-12T17:24:30.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738627+0000", 2020-11-12T17:24:30.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1338000000000003e-05 2020-11-12T17:24:30.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738668+0000", 2020-11-12T17:24:30.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002001774 2020-11-12T17:24:30.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740670+0000", 2020-11-12T17:24:30.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7090999999999999e-05 2020-11-12T17:24:30.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740737+0000", 2020-11-12T17:24:30.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999 2020-11-12T17:24:30.805 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.806 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.806 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.806 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:24:30.806 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:30.806 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 42.232949683000001, 2020-11-12T17:24:30.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:24:30.807 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.807 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:30.807 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:30.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:30.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:30.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:24:30.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:24:30.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:24:30.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:24:30.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:24:30.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:24:30.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:24:30.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:24:30.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:24:30.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:24:30.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:24:30.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:24:30.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:24:30.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:24:30.813 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.813 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.813 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.814 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:28424 3.b e47/20 3:d6b3d883:::benchmark_data_smithi036_14212_object3552:head v 47'1832, mlcod=47'1825)", 2020-11-12T17:24:30.814 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:30.814 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 42.207778322000003, 2020-11-12T17:24:30.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002, 2020-11-12T17:24:30.814 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.814 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.815 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:30.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:30.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:30.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523784+0000", 2020-11-12T17:24:30.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100963 2020-11-12T17:24:30.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523885+0000", 2020-11-12T17:24:30.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29458836900000002 2020-11-12T17:24:30.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818473+0000", 2020-11-12T17:24:30.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1482e-05 2020-11-12T17:24:30.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818485+0000", 2020-11-12T17:24:30.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4080999999999998e-05 2020-11-12T17:24:30.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818559+0000", 2020-11-12T17:24:30.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9269e-05 2020-11-12T17:24:30.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818598+0000", 2020-11-12T17:24:30.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044328520000000001 2020-11-12T17:24:30.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823031+0000", 2020-11-12T17:24:30.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2584999999999998e-05 2020-11-12T17:24:30.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823094+0000", 2020-11-12T17:24:30.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002 2020-11-12T17:24:30.821 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.821 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.822 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.822 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:24:30.822 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:30.822 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.127347790999998, 2020-11-12T17:24:30.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:24:30.822 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.823 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.823 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:30.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:30.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:30.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:24:30.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:24:30.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:24:30.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:24:30.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:24:30.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:24:30.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:24:30.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:24:30.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:24:30.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:24:30.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:24:30.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:24:30.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:24:30.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:24:30.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:24:30.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:24:30.831 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.831 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.831 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.832 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43231 3.6 3:67cbc07e:::benchmark_data_smithi036_14212_object5403:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e52)", 2020-11-12T17:24:30.832 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.333783+0000", 2020-11-12T17:24:30.833 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.397815619999999, 2020-11-12T17:24:30.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22928810699999999, 2020-11-12T17:24:30.834 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.834 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.835 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43231 2020-11-12T17:24:30.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.835 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333783+0000", 2020-11-12T17:24:30.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333783+0000", 2020-11-12T17:24:30.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:24:30.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333766+0000", 2020-11-12T17:24:30.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8708999999999997e-05 2020-11-12T17:24:30.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333815+0000", 2020-11-12T17:24:30.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3200000000000002e-06 2020-11-12T17:24:30.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333822+0000", 2020-11-12T17:24:30.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5109999999999997e-06 2020-11-12T17:24:30.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333827+0000", 2020-11-12T17:24:30.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.008401492 2020-11-12T17:24:30.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.342228+0000", 2020-11-12T17:24:30.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010789 2020-11-12T17:24:30.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.342336+0000", 2020-11-12T17:24:30.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022754599999999999 2020-11-12T17:24:30.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:30.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.342563+0000", 2020-11-12T17:24:30.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035172010000000002 2020-11-12T17:24:30.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.346081+0000", 2020-11-12T17:24:30.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21689112699999999 2020-11-12T17:24:30.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.562972+0000", 2020-11-12T17:24:30.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6174999999999996e-05 2020-11-12T17:24:30.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.563038+0000", 2020-11-12T17:24:30.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2743000000000001e-05 2020-11-12T17:24:30.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.563071+0000", 2020-11-12T17:24:30.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22928810699999999 2020-11-12T17:24:30.846 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.846 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.847 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43232 3.6 3:67cbc07e:::benchmark_data_smithi036_14212_object5403:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e52)", 2020-11-12T17:24:30.847 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.333962+0000", 2020-11-12T17:24:30.847 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.397635766000001, 2020-11-12T17:24:30.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234228415, 2020-11-12T17:24:30.848 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.848 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.848 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.848 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.848 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.848 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43232 2020-11-12T17:24:30.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.849 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333962+0000", 2020-11-12T17:24:30.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333962+0000", 2020-11-12T17:24:30.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:30.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333946+0000", 2020-11-12T17:24:30.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2445999999999999e-05 2020-11-12T17:24:30.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333999+0000", 2020-11-12T17:24:30.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2269999999999996e-06 2020-11-12T17:24:30.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.334006+0000", 2020-11-12T17:24:30.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7709999999999997e-06 2020-11-12T17:24:30.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.334011+0000", 2020-11-12T17:24:30.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010388237 2020-11-12T17:24:30.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.344399+0000", 2020-11-12T17:24:30.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116328 2020-11-12T17:24:30.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.344515+0000", 2020-11-12T17:24:30.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000155721 2020-11-12T17:24:30.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:30.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.344671+0000", 2020-11-12T17:24:30.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025734880000000001 2020-11-12T17:24:30.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.347245+0000", 2020-11-12T17:24:30.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.220854892 2020-11-12T17:24:30.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.568099+0000", 2020-11-12T17:24:30.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2451000000000003e-05 2020-11-12T17:24:30.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.568152+0000", 2020-11-12T17:24:30.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9005999999999999e-05 2020-11-12T17:24:30.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.568191+0000", 2020-11-12T17:24:30.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234228415 2020-11-12T17:24:30.858 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.858 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.858 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.859 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43534 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:30.859 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:30.859 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.022696818, 2020-11-12T17:24:30.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002, 2020-11-12T17:24:30.859 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.860 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.860 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.860 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.860 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.860 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43534 2020-11-12T17:24:30.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.860 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:30.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:30.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:30.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708876+0000", 2020-11-12T17:24:30.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4095000000000002e-05 2020-11-12T17:24:30.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708940+0000", 2020-11-12T17:24:30.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960000000000007e-06 2020-11-12T17:24:30.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708949+0000", 2020-11-12T17:24:30.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.451e-06 2020-11-12T17:24:30.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708955+0000", 2020-11-12T17:24:30.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085037340000000006 2020-11-12T17:24:30.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717458+0000", 2020-11-12T17:24:30.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4234999999999997e-05 2020-11-12T17:24:30.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717523+0000", 2020-11-12T17:24:30.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012550500000000001 2020-11-12T17:24:30.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:30.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717648+0000", 2020-11-12T17:24:30.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040419740000000003 2020-11-12T17:24:30.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.721690+0000", 2020-11-12T17:24:30.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.247979797 2020-11-12T17:24:30.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969670+0000", 2020-11-12T17:24:30.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012950400000000001 2020-11-12T17:24:30.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969799+0000", 2020-11-12T17:24:30.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000181709 2020-11-12T17:24:30.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969981+0000", 2020-11-12T17:24:30.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002 2020-11-12T17:24:30.870 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.870 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.870 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.870 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43535 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:30.871 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:30.871 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.022377989999999, 2020-11-12T17:24:30.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003, 2020-11-12T17:24:30.871 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.871 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.871 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.871 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.872 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.872 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43535 2020-11-12T17:24:30.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.872 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:30.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:30.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:24:30.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709201+0000", 2020-11-12T17:24:30.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4987000000000001e-05 2020-11-12T17:24:30.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709256+0000", 2020-11-12T17:24:30.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9799999999999998e-06 2020-11-12T17:24:30.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709264+0000", 2020-11-12T17:24:30.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:24:30.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709268+0000", 2020-11-12T17:24:30.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01033796 2020-11-12T17:24:30.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719606+0000", 2020-11-12T17:24:30.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014753499999999999 2020-11-12T17:24:30.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719754+0000", 2020-11-12T17:24:30.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023477900000000001 2020-11-12T17:24:30.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:30.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719989+0000", 2020-11-12T17:24:30.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002308844 2020-11-12T17:24:30.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722298+0000", 2020-11-12T17:24:30.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27981983300000002 2020-11-12T17:24:30.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002117+0000", 2020-11-12T17:24:30.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4757000000000001e-05 2020-11-12T17:24:30.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002212+0000", 2020-11-12T17:24:30.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116928 2020-11-12T17:24:30.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002329+0000", 2020-11-12T17:24:30.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003 2020-11-12T17:24:30.886 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.888 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.888 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.888 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43536 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:30.889 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:30.889 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.022278458999999, 2020-11-12T17:24:30.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001, 2020-11-12T17:24:30.889 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.889 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.890 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43536 2020-11-12T17:24:30.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.890 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:30.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:30.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:24:30.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709302+0000", 2020-11-12T17:24:30.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3248999999999998e-05 2020-11-12T17:24:30.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709355+0000", 2020-11-12T17:24:30.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.34e-06 2020-11-12T17:24:30.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709363+0000", 2020-11-12T17:24:30.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.664e-06 2020-11-12T17:24:30.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709366+0000", 2020-11-12T17:24:30.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013071532 2020-11-12T17:24:30.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722438+0000", 2020-11-12T17:24:30.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141901 2020-11-12T17:24:30.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722580+0000", 2020-11-12T17:24:30.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118355 2020-11-12T17:24:30.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:30.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722698+0000", 2020-11-12T17:24:30.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014561839999999999 2020-11-12T17:24:30.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.724154+0000", 2020-11-12T17:24:30.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27825006499999999 2020-11-12T17:24:30.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002404+0000", 2020-11-12T17:24:30.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2908000000000001e-05 2020-11-12T17:24:30.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002477+0000", 2020-11-12T17:24:30.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020370300000000001 2020-11-12T17:24:30.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002681+0000", 2020-11-12T17:24:30.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001 2020-11-12T17:24:30.899 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.899 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.899 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.900 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:43534 3.6 e53/20 ondisk, result = 0)", 2020-11-12T17:24:30.900 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:30.900 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.005170134, 2020-11-12T17:24:30.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001, 2020-11-12T17:24:30.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.900 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:30.901 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:30.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:30.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:30.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726412+0000", 2020-11-12T17:24:30.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2086000000000003e-05 2020-11-12T17:24:30.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726454+0000", 2020-11-12T17:24:30.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24305705 2020-11-12T17:24:30.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969511+0000", 2020-11-12T17:24:30.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.49e-05 2020-11-12T17:24:30.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969526+0000", 2020-11-12T17:24:30.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010331999999999999 2020-11-12T17:24:30.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969629+0000", 2020-11-12T17:24:30.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1993000000000001e-05 2020-11-12T17:24:30.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969651+0000", 2020-11-12T17:24:30.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00033822300000000002 2020-11-12T17:24:30.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969989+0000", 2020-11-12T17:24:30.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001 2020-11-12T17:24:30.907 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.907 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.907 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.907 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43768 3.6 3:6f7b85f8:::benchmark_data_smithi036_14212_object5470:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:30.907 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:30.908 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.733545614000001, 2020-11-12T17:24:30.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001, 2020-11-12T17:24:30.908 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.908 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.908 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.908 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.908 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.909 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43768 2020-11-12T17:24:30.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.909 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:30.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:30.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:30.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998003+0000", 2020-11-12T17:24:30.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014095000000000001 2020-11-12T17:24:30.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998144+0000", 2020-11-12T17:24:30.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1143000000000001e-05 2020-11-12T17:24:30.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998165+0000", 2020-11-12T17:24:30.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3979999999999999e-06 2020-11-12T17:24:30.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998174+0000", 2020-11-12T17:24:30.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012056769 2020-11-12T17:24:30.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010231+0000", 2020-11-12T17:24:30.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102279 2020-11-12T17:24:30.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010333+0000", 2020-11-12T17:24:30.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014553299999999999 2020-11-12T17:24:30.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:30.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010478+0000", 2020-11-12T17:24:30.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037901779999999999 2020-11-12T17:24:30.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.014269+0000", 2020-11-12T17:24:30.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22457837 2020-11-12T17:24:30.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238847+0000", 2020-11-12T17:24:30.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2958000000000001e-05 2020-11-12T17:24:30.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238930+0000", 2020-11-12T17:24:30.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1814000000000002e-05 2020-11-12T17:24:30.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238982+0000", 2020-11-12T17:24:30.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001 2020-11-12T17:24:30.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.918 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.919 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50240 3.1 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:30.919 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:30.919 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.378501418999999, 2020-11-12T17:24:30.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003, 2020-11-12T17:24:30.919 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.919 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.920 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50240 2020-11-12T17:24:30.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.920 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:30.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:30.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:30.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353074+0000", 2020-11-12T17:24:30.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106903 2020-11-12T17:24:30.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353181+0000", 2020-11-12T17:24:30.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6804999999999999e-05 2020-11-12T17:24:30.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353198+0000", 2020-11-12T17:24:30.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3259999999999998e-06 2020-11-12T17:24:30.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353205+0000", 2020-11-12T17:24:30.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011916829 2020-11-12T17:24:30.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365122+0000", 2020-11-12T17:24:30.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111867 2020-11-12T17:24:30.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365234+0000", 2020-11-12T17:24:30.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011033500000000001 2020-11-12T17:24:30.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:30.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365344+0000", 2020-11-12T17:24:30.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002314876 2020-11-12T17:24:30.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.367659+0000", 2020-11-12T17:24:30.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23853026499999999 2020-11-12T17:24:30.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606189+0000", 2020-11-12T17:24:30.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3222999999999999e-05 2020-11-12T17:24:30.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606272+0000", 2020-11-12T17:24:30.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000165849 2020-11-12T17:24:30.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606438+0000", 2020-11-12T17:24:30.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003 2020-11-12T17:24:30.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.929 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.930 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.930 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50240 3.1 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e55)", 2020-11-12T17:24:30.930 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.372226+0000", 2020-11-12T17:24:30.930 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.359372255, 2020-11-12T17:24:30.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234079712, 2020-11-12T17:24:30.931 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.931 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:24:30.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.931 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50240 2020-11-12T17:24:30.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.931 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372226+0000", 2020-11-12T17:24:30.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372226+0000", 2020-11-12T17:24:30.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:24:30.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372195+0000", 2020-11-12T17:24:30.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103138 2020-11-12T17:24:30.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372298+0000", 2020-11-12T17:24:30.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1175999999999999e-05 2020-11-12T17:24:30.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372309+0000", 2020-11-12T17:24:30.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9009999999999999e-06 2020-11-12T17:24:30.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372315+0000", 2020-11-12T17:24:30.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3058000000000001e-05 2020-11-12T17:24:30.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372348+0000", 2020-11-12T17:24:30.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8007e-05 2020-11-12T17:24:30.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:30.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372426+0000", 2020-11-12T17:24:30.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23387923899999999 2020-11-12T17:24:30.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606306+0000", 2020-11-12T17:24:30.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234079712 2020-11-12T17:24:30.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.938 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.939 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:30.939 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:30.939 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.7808644569999998, 2020-11-12T17:24:30.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:24:30.939 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:30.940 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:30.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:30.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:30.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:30.940 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:24:30.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.940 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:30.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:30.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:30.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:30.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:30.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:30.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:24:30.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:30.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:24:30.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:24:30.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:30.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:24:30.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:24:30.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:30.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:24:30.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:24:30.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:30.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:24:30.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:24:30.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:30.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:24:30.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:24:30.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:30.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:24:30.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:24:30.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:30.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:24:30.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:24:30.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:30.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:24:30.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:24:30.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:30.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:24:30.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:24:30.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:30.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:24:30.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:24:30.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:30.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:30.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:30.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:24:30.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:24:30.949 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.949 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.949 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.949 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:30.950 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:30.950 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:30.951 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:24:30.952 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:30.946+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:31.052 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:31.046+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:31.119 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:31.120 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:31.131 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:24:31.176 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:31.172+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:31.250 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:31.251 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:31.254 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:31.248+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:31.264 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:24:31.355 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:31.348+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:31.435 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:31.436 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:31.447 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:31.489 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:31.484+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:31.559 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:31.552+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:31.572 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 87 16 62689 62673 5.62741 2.48047 0.0137724 0.0222059 2020-11-12T17:24:31.616 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:31.616 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:31.630 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:31.640 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:31.634+0000 7f9289d6e700 -1 osd.7 60 handle_osd_map injecting map crc failure 2020-11-12T17:24:31.647 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:24:31.661 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:31.658+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:31.764 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:31.756+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:31.796 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:31.796 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:31.808 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:31.864 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:31.858+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:31.964 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:31.958+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:31.982 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:31.982 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:31.993 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:32.067 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:32.062+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:32.129 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:32.130 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:32.141 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:32.185 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:32.182+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:32.268 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:32.262+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:32.320 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:32.320 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:32.334 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:32.379 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:32.374+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:32.471 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:32.464+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:32.512 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:32.513 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:32.524 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:32.570 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 88 16 63451 63435 5.63111 5.95312 0.0580936 0.0221894 2020-11-12T17:24:32.573 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:32.568+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:32.663 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:32.663 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:32.675 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:32.677 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:32.670+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:32.775 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:32.770+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:32.854 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:32.855 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:32.866 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:32.909 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:32.906+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:32.977 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:32.974+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:33.050 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:33.051 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:33.062 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:33.078 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:33.072+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:33.180 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:33.174+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:33.247 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:33.247 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:33.259 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:33.282 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:33.276+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:33.381 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:33.376+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:33.434 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:33.434 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:33.445 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:33.474 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:33.481 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:33.476+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:33.509 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:33.544 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:33.565 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:33.566 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:33.571 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 89 16 64209 64193 5.63437 5.92188 0.0164268 0.0221754 2020-11-12T17:24:33.571 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:33.578 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:33.609 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:33.629 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:33.626+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:33.662 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:24:33.683 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:33.678+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:33.710 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:33.710 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:33.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.711 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64256 3.d 3:bc245ff1:::benchmark_data_smithi036_14212_object8031:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:24:33.711 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.651809+0000", 2020-11-12T17:24:33.711 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.058341575999999999, 2020-11-12T17:24:33.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.058379519999999997, 2020-11-12T17:24:33.711 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:33.711 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:33.712 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:33.712 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:33.712 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:33.712 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64256 2020-11-12T17:24:33.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.712 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:33.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:33.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.651809+0000", 2020-11-12T17:24:33.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:33.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:33.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.651809+0000", 2020-11-12T17:24:33.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:33.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:33.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.651780+0000", 2020-11-12T17:24:33.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1664999999999998e-05 2020-11-12T17:24:33.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:33.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.651862+0000", 2020-11-12T17:24:33.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6549999999999999e-06 2020-11-12T17:24:33.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:33.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.651871+0000", 2020-11-12T17:24:33.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6110000000000004e-06 2020-11-12T17:24:33.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:33.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.651876+0000", 2020-11-12T17:24:33.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006105559 2020-11-12T17:24:33.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:33.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.657981+0000", 2020-11-12T17:24:33.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010969800000000001 2020-11-12T17:24:33.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:33.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.658091+0000", 2020-11-12T17:24:33.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017917399999999999 2020-11-12T17:24:33.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:33.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.658270+0000", 2020-11-12T17:24:33.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033225519999999999 2020-11-12T17:24:33.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:33.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:33.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:33.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.661593+0000", 2020-11-12T17:24:33.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0097839209999999992 2020-11-12T17:24:33.720 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:33.720 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:33.720 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:33.720 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:33.720 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:24:33.720 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:24:33.720 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:33.724 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:33.784 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:33.780+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:33.797 INFO:teuthology.orchestra.run.smithi036.stdout:3.6 2020-11-12T17:24:33.798 INFO:teuthology.orchestra.run.smithi036.stdout:3.4 2020-11-12T17:24:33.798 INFO:teuthology.orchestra.run.smithi036.stdout:3.8 2020-11-12T17:24:33.798 INFO:teuthology.orchestra.run.smithi036.stdout:3.0 2020-11-12T17:24:33.798 INFO:teuthology.orchestra.run.smithi036.stdout:2.6 2020-11-12T17:24:33.798 INFO:teuthology.orchestra.run.smithi036.stdout:2.4 2020-11-12T17:24:33.798 INFO:teuthology.orchestra.run.smithi036.stdout:2.2 2020-11-12T17:24:33.798 INFO:teuthology.orchestra.run.smithi036.stdout:2.0 2020-11-12T17:24:33.885 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:33.882+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:33.902 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:33.903 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:33.903 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:33.903 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:33.903 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:33.915 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:34.002 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:33.998+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:34.083 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:24:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.238233727999997, 2020-11-12T17:24:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:24:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:34.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:24:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:24:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:24:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:24:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:24:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:24:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:24:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:24:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:24:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:24:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:24:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:24:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:24:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:24:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 83.579583185000004, 2020-11-12T17:24:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:24:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.095 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:24:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:24:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:24:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:24:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:24:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:24:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:24:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:24:34.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:24:34.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:24:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:24:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:24:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:24:34.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:24:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:24:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:24:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:24:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:24:34.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:24:34.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:24:34.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:24:34.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:24:34.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:24:34.113 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.113 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.113 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.114 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:34.115 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:34.115 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 83.577978125000001, 2020-11-12T17:24:34.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:24:34.115 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.116 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.116 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.116 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.117 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.117 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:24:34.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.117 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:34.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:34.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:24:34.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:24:34.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:24:34.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:24:34.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:24:34.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:24:34.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:24:34.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:24:34.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:24:34.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:24:34.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:24:34.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:24:34.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:24:34.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:24:34.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:24:34.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:24:34.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:24:34.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:24:34.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:24:34.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:24:34.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:24:34.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:24:34.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:24:34.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.130 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.130 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5735 3.d e25/20 ondisk, result = 0)", 2020-11-12T17:24:34.131 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:34.131 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 83.571891602999997, 2020-11-12T17:24:34.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002, 2020-11-12T17:24:34.131 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.132 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:34.132 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:34.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:34.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:34.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508775+0000", 2020-11-12T17:24:34.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4838000000000001e-05 2020-11-12T17:24:34.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508810+0000", 2020-11-12T17:24:34.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30211893099999998 2020-11-12T17:24:34.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810929+0000", 2020-11-12T17:24:34.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3546e-05 2020-11-12T17:24:34.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810942+0000", 2020-11-12T17:24:34.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021619539999999998 2020-11-12T17:24:34.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813104+0000", 2020-11-12T17:24:34.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1251999999999998e-05 2020-11-12T17:24:34.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813135+0000", 2020-11-12T17:24:34.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033488000000000002 2020-11-12T17:24:34.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813470+0000", 2020-11-12T17:24:34.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002 2020-11-12T17:24:34.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.141 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.141 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:34.141 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:34.141 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.680483120999995, 2020-11-12T17:24:34.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:24:34.142 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.142 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.142 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.142 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.142 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.142 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:24:34.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.143 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:34.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:34.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:34.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:24:34.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:24:34.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:24:34.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:24:34.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:24:34.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:24:34.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:24:34.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:24:34.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:24:34.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:24:34.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:24:34.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:24:34.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:24:34.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:24:34.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:24:34.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:24:34.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:24:34.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:24:34.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:24:34.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:24:34.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:24:34.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:24:34.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.152 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.153 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.153 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:34.153 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:34.153 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.678036505999998, 2020-11-12T17:24:34.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:24:34.154 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.154 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.154 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.154 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.154 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.155 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:24:34.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.155 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:34.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:34.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:34.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:24:34.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:24:34.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:24:34.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:24:34.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:24:34.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:24:34.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:24:34.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:24:34.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:24:34.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:24:34.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:24:34.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:24:34.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:24:34.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:24:34.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:24:34.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:24:34.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:24:34.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:24:34.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:24:34.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:24:34.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:24:34.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:24:34.165 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.165 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.165 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.166 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:34.166 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:34.166 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.672212059000003, 2020-11-12T17:24:34.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:24:34.166 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.166 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:34.166 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:34.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:34.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:24:34.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:24:34.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:24:34.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:24:34.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:24:34.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:24:34.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:24:34.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:24:34.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:24:34.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:24:34.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:24:34.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:24:34.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:24:34.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:24:34.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:24:34.173 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.173 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.173 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.173 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:34.174 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:34.174 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.672144183, 2020-11-12T17:24:34.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:24:34.174 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.174 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:34.174 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:34.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:34.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:34.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:24:34.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:24:34.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:24:34.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:24:34.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:24:34.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:24:34.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:24:34.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:24:34.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:24:34.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:24:34.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:24:34.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:24:34.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:24:34.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:24:34.181 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.181 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.181 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.181 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e27)", 2020-11-12T17:24:34.181 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.950158+0000", 2020-11-12T17:24:34.182 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.130522373999995, 2020-11-12T17:24:34.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28929145499999998, 2020-11-12T17:24:34.182 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.182 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:24:34.182 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.182 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.182 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.182 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:24:34.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.183 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950158+0000", 2020-11-12T17:24:34.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950158+0000", 2020-11-12T17:24:34.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999318 2020-11-12T17:24:34.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950090+0000", 2020-11-12T17:24:34.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000168746 2020-11-12T17:24:34.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950259+0000", 2020-11-12T17:24:34.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8829000000000001e-05 2020-11-12T17:24:34.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950288+0000", 2020-11-12T17:24:34.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4751e-05 2020-11-12T17:24:34.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950303+0000", 2020-11-12T17:24:34.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4604999999999995e-05 2020-11-12T17:24:34.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950377+0000", 2020-11-12T17:24:34.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1074000000000003e-05 2020-11-12T17:24:34.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:34.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.950468+0000", 2020-11-12T17:24:34.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28898143900000001 2020-11-12T17:24:34.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239450+0000", 2020-11-12T17:24:34.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28929145499999998 2020-11-12T17:24:34.189 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.189 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.189 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.190 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:24:34.190 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:34.190 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.546153914999998, 2020-11-12T17:24:34.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:24:34.190 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.190 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.190 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.191 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.191 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.191 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:24:34.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.191 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:34.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:34.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:24:34.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:24:34.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:24:34.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:24:34.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:24:34.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:24:34.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:24:34.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:24:34.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:24:34.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:24:34.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:24:34.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:24:34.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:24:34.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:24:34.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:24:34.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:24:34.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:24:34.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:24:34.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:24:34.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:24:34.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:24:34.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:24:34.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:24:34.200 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.200 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.200 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.200 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:24:34.201 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:34.201 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.538850195999999, 2020-11-12T17:24:34.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:24:34.201 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.201 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:34.201 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:34.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:34.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:34.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:24:34.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:24:34.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:24:34.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:24:34.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:24:34.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:24:34.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:24:34.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:24:34.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:24:34.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:24:34.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:24:34.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:24:34.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:24:34.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:24:34.207 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.207 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.208 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.208 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:34.208 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:34.208 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.165271703000002, 2020-11-12T17:24:34.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:24:34.208 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.209 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.209 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.209 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.209 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.209 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:24:34.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.210 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:34.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:34.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:34.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:24:34.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:24:34.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:24:34.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:24:34.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:24:34.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:24:34.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:24:34.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:24:34.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:24:34.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:24:34.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:24:34.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:24:34.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:24:34.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:24:34.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:24:34.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:24:34.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:24:34.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:24:34.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:24:34.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:24:34.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:24:34.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:24:34.218 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.219 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.219 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.219 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:24:34.219 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:34.219 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.153718583, 2020-11-12T17:24:34.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:24:34.220 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.220 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:34.220 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:34.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:34.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:34.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:24:34.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:24:34.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:24:34.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:24:34.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:24:34.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:24:34.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:24:34.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:24:34.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:24:34.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:24:34.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:24:34.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:24:34.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:24:34.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:24:34.226 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.226 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.226 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.227 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29991 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:34.227 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.999929+0000", 2020-11-12T17:24:34.227 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.080751616000001, 2020-11-12T17:24:34.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.292802063, 2020-11-12T17:24:34.227 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.228 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.228 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.228 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.228 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.228 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29991 2020-11-12T17:24:34.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.228 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.999929+0000", 2020-11-12T17:24:34.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.999929+0000", 2020-11-12T17:24:34.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:24:34.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.999895+0000", 2020-11-12T17:24:34.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010826 2020-11-12T17:24:34.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000003+0000", 2020-11-12T17:24:34.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.504e-05 2020-11-12T17:24:34.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000018+0000", 2020-11-12T17:24:34.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9989999999999997e-06 2020-11-12T17:24:34.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000024+0000", 2020-11-12T17:24:34.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037541160000000001 2020-11-12T17:24:34.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.003778+0000", 2020-11-12T17:24:34.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9364999999999997e-05 2020-11-12T17:24:34.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.003858+0000", 2020-11-12T17:24:34.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124258 2020-11-12T17:24:34.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.003982+0000", 2020-11-12T17:24:34.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023873649999999998 2020-11-12T17:24:34.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006369+0000", 2020-11-12T17:24:34.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28615247599999999 2020-11-12T17:24:34.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292522+0000", 2020-11-12T17:24:34.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3332999999999998e-05 2020-11-12T17:24:34.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292585+0000", 2020-11-12T17:24:34.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014610400000000001 2020-11-12T17:24:34.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292731+0000", 2020-11-12T17:24:34.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.292802063 2020-11-12T17:24:34.238 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.238 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.238 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.238 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:34.239 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:34.239 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.080598402, 2020-11-12T17:24:34.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:24:34.239 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.239 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.239 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.239 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.240 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:24:34.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.240 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:34.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:34.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:24:34.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:24:34.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:24:34.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:24:34.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:24:34.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:24:34.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:24:34.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:24:34.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:24:34.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:24:34.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:24:34.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:24:34.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:24:34.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:24:34.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:24:34.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:24:34.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:24:34.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:24:34.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:24:34.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:24:34.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:24:34.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:24:34.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:24:34.249 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.249 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.249 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.250 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:34.250 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:34.250 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.793298688999997, 2020-11-12T17:24:34.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:24:34.250 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.250 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.250 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.251 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.251 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.251 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:24:34.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.251 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:34.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:34.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:34.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:24:34.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:24:34.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:24:34.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:24:34.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:24:34.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:24:34.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:24:34.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:24:34.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:24:34.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:24:34.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:24:34.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:24:34.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:24:34.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:24:34.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:24:34.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:24:34.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:24:34.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:24:34.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:24:34.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:24:34.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:24:34.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:24:34.260 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.260 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.260 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.261 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:34.261 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:34.261 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.247905699, 2020-11-12T17:24:34.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:24:34.261 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.261 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.262 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:34.262 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:34.262 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.262 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:24:34.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.262 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:34.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:34.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:34.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:24:34.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:24:34.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:24:34.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:24:34.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:24:34.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:24:34.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:24:34.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:24:34.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:24:34.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:24:34.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:24:34.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:24:34.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:34.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:24:34.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:24:34.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:34.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:24:34.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:24:34.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:24:34.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:24:34.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:24:34.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:24:34.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:24:34.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:24:34.271 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.271 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.271 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.271 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:24:34.272 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:24:34.272 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.255355439000001, 2020-11-12T17:24:34.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:24:34.272 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.272 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.272 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:24:34.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:24:34.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:34.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:24:34.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:24:34.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:24:34.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:24:34.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:24:34.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:24:34.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:24:34.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:24:34.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:24:34.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:24:34.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:24:34.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:24:34.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:24:34.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:24:34.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:24:34.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:24:34.279 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.279 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.280 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.280 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57960 3.7 e57/20 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head v 57'3648, mlcod=57'3642)", 2020-11-12T17:24:34.280 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:24:34.280 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.351622670999999, 2020-11-12T17:24:34.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998, 2020-11-12T17:24:34.281 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.281 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.281 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:24:34.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:24:34.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:34.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729033+0000", 2020-11-12T17:24:34.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001002 2020-11-12T17:24:34.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729133+0000", 2020-11-12T17:24:34.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30451762900000001 2020-11-12T17:24:34.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033650+0000", 2020-11-12T17:24:34.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2909999999999998e-06 2020-11-12T17:24:34.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033656+0000", 2020-11-12T17:24:34.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1718000000000003e-05 2020-11-12T17:24:34.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033697+0000", 2020-11-12T17:24:34.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2977999999999999e-05 2020-11-12T17:24:34.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033720+0000", 2020-11-12T17:24:34.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058524529999999996 2020-11-12T17:24:34.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039573+0000", 2020-11-12T17:24:34.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2095999999999997e-05 2020-11-12T17:24:34.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039625+0000", 2020-11-12T17:24:34.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998 2020-11-12T17:24:34.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.288 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.288 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:24:34.288 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:24:34.288 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.419519267, 2020-11-12T17:24:34.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:24:34.289 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:34.289 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.289 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:34.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:34.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:24:34.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:34.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:34.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:24:34.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:34.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:34.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:24:34.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:24:34.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:34.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:24:34.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:24:34.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:34.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:24:34.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:24:34.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:24:34.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:24:34.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:34.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:24:34.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:24:34.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:34.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:24:34.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:24:34.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:34.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:24:34.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:24:34.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:34.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:34.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:34.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:24:34.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:24:34.296 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.296 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.296 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.296 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:34.296 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:34.297 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:34.298 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:34.294+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:34.298 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:34.360 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op export --pgid 2.4 --file /var/log/ceph/exp.2.4.1 2020-11-12T17:24:34.408 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:34.404+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:34.443 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:34.443 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:34.444 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:24:34.444 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:34.451 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:34.451 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:24:34.451 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:34.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:34.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:24:34.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:24:34.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:24:34.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:24:34.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:24:34.452 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:24:34.456 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:34.456 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:34.461 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:34.505 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:34.500+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:34.570 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 90 8 64919 64911 5.63409 5.60938 0.0133415 0.0221792 2020-11-12T17:24:34.600 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:34.594+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:34.649 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:34.650 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:34.650 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:34.650 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:34.650 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:34.660 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:34.702 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:34.698+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:34.703 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:34.696+0000 7f658835a700 -1 osd.0 61 handle_osd_map injecting map crc failure 2020-11-12T17:24:34.708 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:24:34.799 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:34.800 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:34.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:34.800 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:34.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.801 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:24:34.801 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:34.801 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.686102766000005, 2020-11-12T17:24:34.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:24:34.802 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.802 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.802 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:34.802 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:34.803 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.803 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:24:34.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.803 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:34.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:34.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:34.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:24:34.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:24:34.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:24:34.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:24:34.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:24:34.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:24:34.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:24:34.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:24:34.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:24:34.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:24:34.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:24:34.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:24:34.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:34.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:24:34.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:24:34.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:34.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:24:34.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:24:34.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:24:34.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:24:34.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:24:34.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:24:34.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:24:34.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:24:34.825 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.826 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.827 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:24:34.828 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:34.828 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.679010969999993, 2020-11-12T17:24:34.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:24:34.829 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.829 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:34.829 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:34.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:34.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:24:34.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:24:34.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:24:34.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:24:34.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:24:34.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:24:34.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:24:34.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:24:34.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:24:34.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:24:34.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:24:34.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:24:34.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:24:34.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:24:34.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:24:34.836 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.837 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.837 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.837 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:34.837 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:34.837 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.246973892, 2020-11-12T17:24:34.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999, 2020-11-12T17:24:34.838 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.838 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.838 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:34.838 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:34.838 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.838 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:24:34.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.839 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:34.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:34.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:24:34.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:24:34.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:24:34.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:24:34.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:24:34.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:24:34.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:24:34.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:24:34.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:24:34.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:24:34.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:24:34.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:24:34.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112811 2020-11-12T17:24:34.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:34.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550940+0000", 2020-11-12T17:24:34.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001154101 2020-11-12T17:24:34.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:34.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552095+0000", 2020-11-12T17:24:34.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25363090900000002 2020-11-12T17:24:34.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805725+0000", 2020-11-12T17:24:34.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8797999999999998e-05 2020-11-12T17:24:34.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805824+0000", 2020-11-12T17:24:34.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8110999999999998e-05 2020-11-12T17:24:34.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805902+0000", 2020-11-12T17:24:34.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999 2020-11-12T17:24:34.849 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.849 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.850 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.850 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:34.850 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:34.850 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.246451472999993, 2020-11-12T17:24:34.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:24:34.851 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.851 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.851 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:34.851 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:34.851 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.852 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:24:34.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.852 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:34.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:34.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:34.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:24:34.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:24:34.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:24:34.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:24:34.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:24:34.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:24:34.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:24:34.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:24:34.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:24:34.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:24:34.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:24:34.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:24:34.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:34.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:24:34.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:24:34.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:34.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:24:34.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:24:34.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:24:34.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:24:34.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:24:34.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:24:34.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:24:34.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:24:34.863 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.863 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.863 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.864 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9999 3.1 e26/20 ondisk, result = 0)", 2020-11-12T17:24:34.864 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:34.864 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.238088953000002, 2020-11-12T17:24:34.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145, 2020-11-12T17:24:34.864 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.864 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:34.865 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:34.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:34.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:34.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556869+0000", 2020-11-12T17:24:34.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1767999999999994e-05 2020-11-12T17:24:34.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556951+0000", 2020-11-12T17:24:34.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.248442731 2020-11-12T17:24:34.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805393+0000", 2020-11-12T17:24:34.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5503e-05 2020-11-12T17:24:34.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805409+0000", 2020-11-12T17:24:34.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027928399999999998 2020-11-12T17:24:34.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805688+0000", 2020-11-12T17:24:34.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2215e-05 2020-11-12T17:24:34.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805710+0000", 2020-11-12T17:24:34.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000226744 2020-11-12T17:24:34.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805937+0000", 2020-11-12T17:24:34.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145 2020-11-12T17:24:34.872 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.872 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.872 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.873 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:25512 3.b e46/20 3:d013695c:::benchmark_data_smithi036_14212_object3188:head v 46'1664, mlcod=46'1657)", 2020-11-12T17:24:34.874 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:34.874 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.333913000000003, 2020-11-12T17:24:34.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999, 2020-11-12T17:24:34.875 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.875 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.875 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:34.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:34.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:24:34.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461054+0000", 2020-11-12T17:24:34.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5973000000000002e-05 2020-11-12T17:24:34.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461100+0000", 2020-11-12T17:24:34.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27743074600000001 2020-11-12T17:24:34.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738530+0000", 2020-11-12T17:24:34.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6039999999999993e-06 2020-11-12T17:24:34.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738539+0000", 2020-11-12T17:24:34.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7942000000000006e-05 2020-11-12T17:24:34.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738627+0000", 2020-11-12T17:24:34.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1338000000000003e-05 2020-11-12T17:24:34.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738668+0000", 2020-11-12T17:24:34.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002001774 2020-11-12T17:24:34.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740670+0000", 2020-11-12T17:24:34.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7090999999999999e-05 2020-11-12T17:24:34.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740737+0000", 2020-11-12T17:24:34.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999 2020-11-12T17:24:34.890 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.891 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.891 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.892 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:24:34.892 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:34.892 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.296331379000002, 2020-11-12T17:24:34.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:24:34.893 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.893 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:34.893 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:34.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:34.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:34.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:24:34.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:24:34.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:24:34.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:24:34.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:24:34.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:24:34.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:24:34.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:24:34.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:24:34.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:24:34.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:24:34.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:24:34.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:24:34.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:24:34.905 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.905 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.906 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.906 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:28424 3.b e47/20 3:d6b3d883:::benchmark_data_smithi036_14212_object3552:head v 47'1832, mlcod=47'1825)", 2020-11-12T17:24:34.906 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:34.907 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.271160018000003, 2020-11-12T17:24:34.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002, 2020-11-12T17:24:34.907 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.908 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.908 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:34.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:34.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:34.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523784+0000", 2020-11-12T17:24:34.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100963 2020-11-12T17:24:34.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523885+0000", 2020-11-12T17:24:34.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29458836900000002 2020-11-12T17:24:34.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818473+0000", 2020-11-12T17:24:34.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1482e-05 2020-11-12T17:24:34.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818485+0000", 2020-11-12T17:24:34.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4080999999999998e-05 2020-11-12T17:24:34.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818559+0000", 2020-11-12T17:24:34.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9269e-05 2020-11-12T17:24:34.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818598+0000", 2020-11-12T17:24:34.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044328520000000001 2020-11-12T17:24:34.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823031+0000", 2020-11-12T17:24:34.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2584999999999998e-05 2020-11-12T17:24:34.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823094+0000", 2020-11-12T17:24:34.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002 2020-11-12T17:24:34.916 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.916 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.916 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.917 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:24:34.917 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:34.917 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.190729486999999, 2020-11-12T17:24:34.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:24:34.917 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.917 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.918 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:34.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:34.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:34.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:24:34.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:24:34.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:24:34.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:24:34.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:24:34.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:24:34.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:24:34.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:24:34.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:24:34.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:24:34.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:24:34.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:24:34.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:24:34.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:24:34.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:24:34.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:24:34.926 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.927 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.928 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43232 3.6 3:67cbc07e:::benchmark_data_smithi036_14212_object5403:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e52)", 2020-11-12T17:24:34.928 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.333962+0000", 2020-11-12T17:24:34.928 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.461017462000001, 2020-11-12T17:24:34.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234228415, 2020-11-12T17:24:34.929 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.929 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.929 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:34.929 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:34.930 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.930 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43232 2020-11-12T17:24:34.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.930 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333962+0000", 2020-11-12T17:24:34.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333962+0000", 2020-11-12T17:24:34.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:34.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333946+0000", 2020-11-12T17:24:34.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2445999999999999e-05 2020-11-12T17:24:34.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333999+0000", 2020-11-12T17:24:34.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2269999999999996e-06 2020-11-12T17:24:34.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.334006+0000", 2020-11-12T17:24:34.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7709999999999997e-06 2020-11-12T17:24:34.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.334011+0000", 2020-11-12T17:24:34.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010388237 2020-11-12T17:24:34.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.344399+0000", 2020-11-12T17:24:34.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116328 2020-11-12T17:24:34.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.344515+0000", 2020-11-12T17:24:34.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000155721 2020-11-12T17:24:34.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:34.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.344671+0000", 2020-11-12T17:24:34.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025734880000000001 2020-11-12T17:24:34.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:34.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.347245+0000", 2020-11-12T17:24:34.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.220854892 2020-11-12T17:24:34.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.568099+0000", 2020-11-12T17:24:34.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2451000000000003e-05 2020-11-12T17:24:34.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.568152+0000", 2020-11-12T17:24:34.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9005999999999999e-05 2020-11-12T17:24:34.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.568191+0000", 2020-11-12T17:24:34.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234228415 2020-11-12T17:24:34.942 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.942 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.943 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.944 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43534 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:34.944 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:34.944 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.086078514, 2020-11-12T17:24:34.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002, 2020-11-12T17:24:34.945 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.945 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.945 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:34.945 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:34.946 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.946 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43534 2020-11-12T17:24:34.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.947 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:34.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:34.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:34.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708876+0000", 2020-11-12T17:24:34.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4095000000000002e-05 2020-11-12T17:24:34.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708940+0000", 2020-11-12T17:24:34.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960000000000007e-06 2020-11-12T17:24:34.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708949+0000", 2020-11-12T17:24:34.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.451e-06 2020-11-12T17:24:34.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708955+0000", 2020-11-12T17:24:34.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085037340000000006 2020-11-12T17:24:34.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717458+0000", 2020-11-12T17:24:34.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4234999999999997e-05 2020-11-12T17:24:34.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717523+0000", 2020-11-12T17:24:34.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012550500000000001 2020-11-12T17:24:34.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:34.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717648+0000", 2020-11-12T17:24:34.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040419740000000003 2020-11-12T17:24:34.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:34.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.721690+0000", 2020-11-12T17:24:34.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.247979797 2020-11-12T17:24:34.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969670+0000", 2020-11-12T17:24:34.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012950400000000001 2020-11-12T17:24:34.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969799+0000", 2020-11-12T17:24:34.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000181709 2020-11-12T17:24:34.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969981+0000", 2020-11-12T17:24:34.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002 2020-11-12T17:24:34.957 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.957 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.957 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.957 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43535 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:34.957 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:34.958 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.085759685999999, 2020-11-12T17:24:34.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003, 2020-11-12T17:24:34.958 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.958 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:34.959 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:34.959 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.959 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43535 2020-11-12T17:24:34.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.959 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:34.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:34.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:24:34.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709201+0000", 2020-11-12T17:24:34.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4987000000000001e-05 2020-11-12T17:24:34.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709256+0000", 2020-11-12T17:24:34.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9799999999999998e-06 2020-11-12T17:24:34.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709264+0000", 2020-11-12T17:24:34.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:24:34.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709268+0000", 2020-11-12T17:24:34.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01033796 2020-11-12T17:24:34.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719606+0000", 2020-11-12T17:24:34.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014753499999999999 2020-11-12T17:24:34.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719754+0000", 2020-11-12T17:24:34.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023477900000000001 2020-11-12T17:24:34.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:34.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719989+0000", 2020-11-12T17:24:34.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002308844 2020-11-12T17:24:34.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:34.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722298+0000", 2020-11-12T17:24:34.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27981983300000002 2020-11-12T17:24:34.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002117+0000", 2020-11-12T17:24:34.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4757000000000001e-05 2020-11-12T17:24:34.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002212+0000", 2020-11-12T17:24:34.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116928 2020-11-12T17:24:34.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002329+0000", 2020-11-12T17:24:34.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003 2020-11-12T17:24:34.968 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.968 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.968 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.968 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43536 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:34.969 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:34.969 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.085660154999999, 2020-11-12T17:24:34.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001, 2020-11-12T17:24:34.969 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.969 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.969 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:34.969 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:34.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.970 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43536 2020-11-12T17:24:34.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.970 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:34.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:34.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:24:34.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709302+0000", 2020-11-12T17:24:34.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3248999999999998e-05 2020-11-12T17:24:34.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709355+0000", 2020-11-12T17:24:34.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.34e-06 2020-11-12T17:24:34.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709363+0000", 2020-11-12T17:24:34.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.664e-06 2020-11-12T17:24:34.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709366+0000", 2020-11-12T17:24:34.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013071532 2020-11-12T17:24:34.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722438+0000", 2020-11-12T17:24:34.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141901 2020-11-12T17:24:34.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722580+0000", 2020-11-12T17:24:34.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118355 2020-11-12T17:24:34.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:34.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722698+0000", 2020-11-12T17:24:34.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014561839999999999 2020-11-12T17:24:34.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:34.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.724154+0000", 2020-11-12T17:24:34.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27825006499999999 2020-11-12T17:24:34.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:34.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002404+0000", 2020-11-12T17:24:34.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2908000000000001e-05 2020-11-12T17:24:34.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:34.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002477+0000", 2020-11-12T17:24:34.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020370300000000001 2020-11-12T17:24:34.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002681+0000", 2020-11-12T17:24:34.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001 2020-11-12T17:24:34.979 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.979 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.979 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.980 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:43534 3.6 e53/20 ondisk, result = 0)", 2020-11-12T17:24:34.980 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:34.980 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.068551830000001, 2020-11-12T17:24:34.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001, 2020-11-12T17:24:34.980 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.980 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:34.980 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:34.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:34.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:34.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726412+0000", 2020-11-12T17:24:34.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2086000000000003e-05 2020-11-12T17:24:34.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726454+0000", 2020-11-12T17:24:34.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24305705 2020-11-12T17:24:34.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969511+0000", 2020-11-12T17:24:34.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.49e-05 2020-11-12T17:24:34.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969526+0000", 2020-11-12T17:24:34.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010331999999999999 2020-11-12T17:24:34.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969629+0000", 2020-11-12T17:24:34.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1993000000000001e-05 2020-11-12T17:24:34.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969651+0000", 2020-11-12T17:24:34.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00033822300000000002 2020-11-12T17:24:34.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:34.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969989+0000", 2020-11-12T17:24:34.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001 2020-11-12T17:24:34.988 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.988 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:34.988 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:34.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.988 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43768 3.6 3:6f7b85f8:::benchmark_data_smithi036_14212_object5470:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:34.989 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:34.989 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.796927310000001, 2020-11-12T17:24:34.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001, 2020-11-12T17:24:34.989 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:34.990 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:34.990 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:34.990 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:34.991 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:34.991 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43768 2020-11-12T17:24:34.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.991 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:34.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:34.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:34.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:34.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:34.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:34.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:34.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:34.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998003+0000", 2020-11-12T17:24:34.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014095000000000001 2020-11-12T17:24:34.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:34.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998144+0000", 2020-11-12T17:24:34.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1143000000000001e-05 2020-11-12T17:24:34.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:34.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998165+0000", 2020-11-12T17:24:34.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3979999999999999e-06 2020-11-12T17:24:34.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:34.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998174+0000", 2020-11-12T17:24:34.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012056769 2020-11-12T17:24:34.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:34.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010231+0000", 2020-11-12T17:24:34.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102279 2020-11-12T17:24:34.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:34.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010333+0000", 2020-11-12T17:24:34.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014553299999999999 2020-11-12T17:24:34.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:34.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:34.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:34.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010478+0000", 2020-11-12T17:24:34.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037901779999999999 2020-11-12T17:24:35.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:35.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.014269+0000", 2020-11-12T17:24:35.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22457837 2020-11-12T17:24:35.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:35.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238847+0000", 2020-11-12T17:24:35.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2958000000000001e-05 2020-11-12T17:24:35.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238930+0000", 2020-11-12T17:24:35.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1814000000000002e-05 2020-11-12T17:24:35.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238982+0000", 2020-11-12T17:24:35.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001 2020-11-12T17:24:35.003 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.003 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.003 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.004 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50240 3.1 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:35.004 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:35.004 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 22.441883115, 2020-11-12T17:24:35.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003, 2020-11-12T17:24:35.005 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.005 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.005 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:35.005 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:35.005 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:35.005 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50240 2020-11-12T17:24:35.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.006 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:35.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:35.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:35.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353074+0000", 2020-11-12T17:24:35.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106903 2020-11-12T17:24:35.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353181+0000", 2020-11-12T17:24:35.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6804999999999999e-05 2020-11-12T17:24:35.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353198+0000", 2020-11-12T17:24:35.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3259999999999998e-06 2020-11-12T17:24:35.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353205+0000", 2020-11-12T17:24:35.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011916829 2020-11-12T17:24:35.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365122+0000", 2020-11-12T17:24:35.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111867 2020-11-12T17:24:35.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365234+0000", 2020-11-12T17:24:35.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011033500000000001 2020-11-12T17:24:35.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:35.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365344+0000", 2020-11-12T17:24:35.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002314876 2020-11-12T17:24:35.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:35.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.367659+0000", 2020-11-12T17:24:35.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23853026499999999 2020-11-12T17:24:35.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:35.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606189+0000", 2020-11-12T17:24:35.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3222999999999999e-05 2020-11-12T17:24:35.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606272+0000", 2020-11-12T17:24:35.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000165849 2020-11-12T17:24:35.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606438+0000", 2020-11-12T17:24:35.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003 2020-11-12T17:24:35.023 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.023 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.024 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.024 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50240 3.1 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e55)", 2020-11-12T17:24:35.025 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.372226+0000", 2020-11-12T17:24:35.025 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 22.422753951000001, 2020-11-12T17:24:35.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234079712, 2020-11-12T17:24:35.026 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.026 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:24:35.026 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:35.027 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:35.027 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:35.027 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50240 2020-11-12T17:24:35.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.028 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372226+0000", 2020-11-12T17:24:35.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372226+0000", 2020-11-12T17:24:35.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:24:35.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372195+0000", 2020-11-12T17:24:35.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103138 2020-11-12T17:24:35.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372298+0000", 2020-11-12T17:24:35.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1175999999999999e-05 2020-11-12T17:24:35.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372309+0000", 2020-11-12T17:24:35.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9009999999999999e-06 2020-11-12T17:24:35.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372315+0000", 2020-11-12T17:24:35.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3058000000000001e-05 2020-11-12T17:24:35.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372348+0000", 2020-11-12T17:24:35.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8007e-05 2020-11-12T17:24:35.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:35.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372426+0000", 2020-11-12T17:24:35.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23387923899999999 2020-11-12T17:24:35.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606306+0000", 2020-11-12T17:24:35.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234079712 2020-11-12T17:24:35.041 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.041 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.041 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.042 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:35.043 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:35.043 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 12.844246153, 2020-11-12T17:24:35.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:24:35.043 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.044 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.044 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:35.044 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:35.045 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:35.045 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:24:35.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.045 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:35.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:35.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:24:35.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:24:35.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:24:35.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:24:35.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:24:35.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:24:35.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:24:35.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:24:35.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:24:35.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:24:35.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:24:35.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:24:35.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:24:35.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:35.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:24:35.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:24:35.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:35.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:24:35.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:24:35.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:35.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:24:35.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:24:35.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:24:35.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:24:35.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:24:35.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:24:35.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.065 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.066 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:24:35.066 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:24:35.067 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.8484043510000001, 2020-11-12T17:24:35.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:24:35.067 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.067 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:35.068 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:24:35.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:24:35.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:24:35.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:24:35.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:24:35.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:24:35.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:24:35.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:24:35.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:24:35.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:24:35.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:24:35.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:24:35.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:24:35.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:24:35.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:24:35.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:24:35.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:24:35.075 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.075 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.076 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.076 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.0 61/59 [PushOp(3:042ba977:::benchmark_data_smithi036_14212_object4310:head, version: 49'1968, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:042ba977:::benchmark_data_smithi036_14212_object4310:head@49'1968, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:24:35.076 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.050172+0000", 2020-11-12T17:24:35.076 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.74480771000000001, 2020-11-12T17:24:35.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23349060299999999, 2020-11-12T17:24:35.076 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.077 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:35.077 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.050172+0000", 2020-11-12T17:24:35.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.050172+0000", 2020-11-12T17:24:35.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:35.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.050142+0000", 2020-11-12T17:24:35.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109824 2020-11-12T17:24:35.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.050252+0000", 2020-11-12T17:24:35.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23115501199999999 2020-11-12T17:24:35.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.281407+0000", 2020-11-12T17:24:35.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5068000000000001e-05 2020-11-12T17:24:35.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.281432+0000", 2020-11-12T17:24:35.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010723 2020-11-12T17:24:35.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.281539+0000", 2020-11-12T17:24:35.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1657999999999999e-05 2020-11-12T17:24:35.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.281551+0000", 2020-11-12T17:24:35.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002112264 2020-11-12T17:24:35.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.283663+0000", 2020-11-12T17:24:35.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23349060299999999 2020-11-12T17:24:35.083 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.083 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.083 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.083 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.083 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.083 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:35.085 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:24:35.085 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:35.080+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:35.186 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:35.182+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:35.257 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:35.258 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:35.258 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:24:35.258 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:35.269 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:24:35.287 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:35.282+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:35.390 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:35.391 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:35.391 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:35.391 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:35.391 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:35.392 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:35.384+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:35.392 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:24:35.491 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:35.486+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:35.571 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Total time run: 90.6611 2020-11-12T17:24:35.571 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Total writes made: 64919 2020-11-12T17:24:35.571 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Write size: 8192 2020-11-12T17:24:35.571 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Object size: 65536 2020-11-12T17:24:35.572 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Bandwidth (MB/sec): 5.59424 2020-11-12T17:24:35.572 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev Bandwidth: 3.10771 2020-11-12T17:24:35.572 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max bandwidth (MB/sec): 10.6484 2020-11-12T17:24:35.572 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min bandwidth (MB/sec): 0 2020-11-12T17:24:35.572 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Average IOPS: 716 2020-11-12T17:24:35.572 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev IOPS: 397.795 2020-11-12T17:24:35.572 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max IOPS: 1363 2020-11-12T17:24:35.573 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min IOPS: 0 2020-11-12T17:24:35.573 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Average Latency(s): 0.0221891 2020-11-12T17:24:35.573 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev Latency(s): 0.226588 2020-11-12T17:24:35.573 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max latency(s): 14.2555 2020-11-12T17:24:35.573 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min latency(s): 0.00161593 2020-11-12T17:24:35.580 INFO:teuthology.orchestra.run.smithi036.stderr:Exporting 2.4 info 2.4( empty local-lis/les=17/18 n=0 ec=17/17 lis/c=17/17 les/c/f=18/18/0 sis=17) 2020-11-12T17:24:35.581 INFO:teuthology.orchestra.run.smithi036.stderr:Export successful 2020-11-12T17:24:35.582 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:35.582 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:35.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:35.582 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:35.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.583 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:24:35.583 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:24:35.583 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.911896498000004, 2020-11-12T17:24:35.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:24:35.583 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.583 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.583 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:24:35.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:24:35.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:35.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:24:35.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:24:35.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:24:35.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:24:35.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:24:35.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:24:35.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:24:35.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:24:35.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:24:35.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:24:35.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:24:35.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:24:35.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:24:35.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:24:35.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:24:35.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:24:35.590 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.591 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.591 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.591 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:24:35.591 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:24:35.591 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.910989702999998, 2020-11-12T17:24:35.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:24:35.592 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.592 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.592 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:24:35.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:24:35.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:24:35.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:24:35.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:24:35.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:24:35.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:24:35.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:24:35.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:24:35.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:24:35.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:24:35.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:24:35.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:24:35.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:24:35.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:24:35.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:24:35.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:24:35.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:24:35.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:24:35.616 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.616 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.616 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.617 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:24:35.617 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:24:35.618 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.910287479999994, 2020-11-12T17:24:35.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:24:35.618 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.619 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.619 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:24:35.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:24:35.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:35.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:24:35.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:24:35.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:24:35.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:24:35.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:24:35.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:24:35.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:24:35.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:24:35.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:24:35.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:24:35.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:24:35.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:24:35.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:24:35.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:24:35.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:24:35.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:24:35.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.631 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.631 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:24:35.632 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:24:35.632 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.905781284, 2020-11-12T17:24:35.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:24:35.632 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.632 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.632 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:24:35.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:24:35.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:35.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:24:35.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:24:35.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:24:35.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:24:35.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:24:35.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:24:35.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:24:35.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:24:35.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:24:35.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:24:35.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:24:35.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:24:35.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:24:35.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:24:35.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:24:35.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:24:35.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.642 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.643 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:24:35.643 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:24:35.644 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.402240302999999, 2020-11-12T17:24:35.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:24:35.644 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.644 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.645 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:24:35.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:24:35.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:24:35.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:24:35.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:24:35.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:24:35.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:24:35.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:24:35.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:24:35.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:24:35.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:24:35.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:24:35.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:24:35.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:24:35.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:24:35.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:24:35.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:24:35.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:24:35.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:24:35.660 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.660 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.660 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.661 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:24:35.661 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:24:35.662 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.401314061999997, 2020-11-12T17:24:35.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:24:35.662 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.662 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.663 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:24:35.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:24:35.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:24:35.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:24:35.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:24:35.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:24:35.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:24:35.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:24:35.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:24:35.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:24:35.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:24:35.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:24:35.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:24:35.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:24:35.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:24:35.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:24:35.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:24:35.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:24:35.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:24:35.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.677 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.678 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:24:35.678 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:24:35.678 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.398966552000005, 2020-11-12T17:24:35.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:24:35.678 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.679 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.679 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:24:35.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:24:35.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:24:35.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:24:35.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:24:35.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:24:35.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:24:35.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:24:35.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:24:35.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:24:35.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:24:35.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:24:35.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:24:35.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:24:35.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:24:35.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:24:35.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:24:35.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:24:35.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:24:35.687 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.688 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.688 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.690 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:24:35.690 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:24:35.690 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.398201760000006, 2020-11-12T17:24:35.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:24:35.690 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.690 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:24:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:24:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:24:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:24:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:24:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:24:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:24:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:24:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:24:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:24:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:24:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:24:35.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:24:35.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:24:35.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:24:35.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:24:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:24:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:24:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:24:35.702 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.702 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.702 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:24:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:24:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.315975281999997, 2020-11-12T17:24:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:24:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:24:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:24:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:24:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:24:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:24:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:24:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:24:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:24:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:24:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:24:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:24:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:24:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:24:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:24:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:24:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:24:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:24:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:24:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:24:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:24:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.723861849000002, 2020-11-12T17:24:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:24:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:24:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:24:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:24:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:24:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:24:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:24:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:24:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:24:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:24:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:24:35.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:24:35.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:24:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:24:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:24:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:24:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:24:35.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:24:35.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:24:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:24:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.726 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:24:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:24:35.728 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.695201552, 2020-11-12T17:24:35.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:24:35.728 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.728 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:24:35.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:24:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:24:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:24:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:24:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:24:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:24:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:24:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:24:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:24:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:24:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:24:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:24:35.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:24:35.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:24:35.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:24:35.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:24:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:24:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.744 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:24:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:24:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.782604840999994, 2020-11-12T17:24:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:24:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:24:35.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:24:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:24:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:24:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:24:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:24:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:24:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:24:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:24:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:24:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:24:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:24:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:24:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:24:35.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:24:35.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:24:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:24:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:24:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:24:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:24:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:24:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.711465196999995, 2020-11-12T17:24:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:24:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:24:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:24:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:24:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:24:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:24:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:24:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:24:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:24:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:24:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:24:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:24:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:24:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:24:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:24:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:24:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:24:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:24:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:24:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:24:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:24:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.602077906000005, 2020-11-12T17:24:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:24:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:24:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:24:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:24:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:24:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:24:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:24:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:24:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:24:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:24:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:24:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:24:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:24:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:24:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:24:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:24:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:24:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:24:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:24:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:24:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:24:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:24:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.531542067000004, 2020-11-12T17:24:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:24:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:24:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:24:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:24:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:24:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:24:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:24:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:24:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:24:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:24:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:24:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:24:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:24:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:24:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:24:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:24:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:24:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:24:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:24:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:24:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:24:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.362176129000005, 2020-11-12T17:24:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:24:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:24:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:24:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:24:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:24:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:24:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:24:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:24:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:24:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:24:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:24:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:24:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:24:35.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:24:35.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:24:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:24:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:24:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:24:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:24:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:24:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:24:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:24:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.033550257000002, 2020-11-12T17:24:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:24:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:24:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:24:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:24:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:24:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:24:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:24:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:24:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:24:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:24:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:24:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:24:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:24:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:24:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:24:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:24:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:24:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:24:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:24:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:24:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:24:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:24:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.377086895000005, 2020-11-12T17:24:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:24:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:24:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:24:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:24:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:24:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:24:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:24:35.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:24:35.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:24:35.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:24:35.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:24:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:24:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:24:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:24:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:24:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:24:35.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:24:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:24:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:24:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:24:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:24:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:24:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.374446172000006, 2020-11-12T17:24:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:24:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:24:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:24:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:24:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:24:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:24:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:24:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:24:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:24:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:24:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:24:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:24:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:24:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:24:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:24:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:24:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:24:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:24:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:24:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:24:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:24:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.890200132999993, 2020-11-12T17:24:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:24:35.826 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.826 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:35.826 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:24:35.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:24:35.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:24:35.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:24:35.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:24:35.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:24:35.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:24:35.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:24:35.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:24:35.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:24:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:24:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:24:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:24:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:24:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:24:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:24:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:24:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:24:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:24:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.843 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:35.844 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Cleaning up (deleting benchmark objects) 2020-11-12T17:24:35.844 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:35.838+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:35.845 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:35.948 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:35.940+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:35.981 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:35.982 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:35.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.982 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:65415 3.c e62/20 3:3213c1ff:::benchmark_data_smithi036_14212_object493:head v 62'4336, mlcod=62'4334)", 2020-11-12T17:24:35.983 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:35.977822+0000", 2020-11-12T17:24:35.983 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0023348190000000001, 2020-11-12T17:24:35.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023791340000000002, 2020-11-12T17:24:35.983 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.983 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:35.984 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.977822+0000", 2020-11-12T17:24:35.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.977822+0000", 2020-11-12T17:24:35.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:24:35.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.977807+0000", 2020-11-12T17:24:35.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8736999999999998e-05 2020-11-12T17:24:35.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:35.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.977856+0000", 2020-11-12T17:24:35.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8623999999999998e-05 2020-11-12T17:24:35.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:35.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.977934+0000", 2020-11-12T17:24:35.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6899999999999997e-06 2020-11-12T17:24:35.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:35.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.977940+0000", 2020-11-12T17:24:35.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6823000000000001e-05 2020-11-12T17:24:35.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:35.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.977997+0000", 2020-11-12T17:24:35.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7892999999999999e-05 2020-11-12T17:24:35.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:35.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.978025+0000", 2020-11-12T17:24:35.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020282300000000001 2020-11-12T17:24:35.992 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.992 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:35.992 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:35.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.993 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:65421 3.2 3.4d1fe962 (undecoded) ondisk+write+known_if_redirected e62)", 2020-11-12T17:24:35.993 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:35.979082+0000", 2020-11-12T17:24:35.993 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0010743180000000001, 2020-11-12T17:24:35.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001214978, 2020-11-12T17:24:35.993 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:35.993 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:35.994 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:35.994 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:35.994 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:35.994 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 65421 2020-11-12T17:24:35.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.994 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:35.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:35.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979082+0000", 2020-11-12T17:24:35.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:35.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:35.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979082+0000", 2020-11-12T17:24:35.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:35.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:35.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:35.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979057+0000", 2020-11-12T17:24:35.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5739999999999998e-05 2020-11-12T17:24:35.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:35.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979113+0000", 2020-11-12T17:24:36.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0949e-05 2020-11-12T17:24:36.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979124+0000", 2020-11-12T17:24:36.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.178e-06 2020-11-12T17:24:36.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979130+0000", 2020-11-12T17:24:36.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7375e-05 2020-11-12T17:24:36.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.004 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.005 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:65422 3.b 3:dd572051:::benchmark_data_smithi036_14212_object500:head [delete] snapc 0=[] ondisk+write+known_if_redirected e62)", 2020-11-12T17:24:36.005 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:35.979551+0000", 2020-11-12T17:24:36.006 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00060577099999999996, 2020-11-12T17:24:36.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00083332299999999996, 2020-11-12T17:24:36.006 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.006 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:36.007 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.007 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.007 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.008 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 65422 2020-11-12T17:24:36.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.008 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979551+0000", 2020-11-12T17:24:36.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979551+0000", 2020-11-12T17:24:36.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:24:36.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979498+0000", 2020-11-12T17:24:36.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109388 2020-11-12T17:24:36.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979608+0000", 2020-11-12T17:24:36.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8298999999999999e-05 2020-11-12T17:24:36.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979626+0000", 2020-11-12T17:24:36.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6470000000000004e-06 2020-11-12T17:24:36.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979635+0000", 2020-11-12T17:24:36.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4406000000000006e-05 2020-11-12T17:24:36.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979699+0000", 2020-11-12T17:24:36.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000208507 2020-11-12T17:24:36.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.979908+0000", 2020-11-12T17:24:36.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020219199999999999 2020-11-12T17:24:36.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:36.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.980110+0000", 2020-11-12T17:24:36.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00055880800000000005 2020-11-12T17:24:36.020 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.020 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.020 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.021 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.021 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:24:36.021 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 3 2020-11-12T17:24:36.021 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:36.023 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:36.047 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:36.042+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:36.127 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --force --op remove --pgid 2.4 2020-11-12T17:24:36.148 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:36.142+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:36.206 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:36.207 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:36.219 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:36.249 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:36.246+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:36.350 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:36.346+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:36.369 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:36.370 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:36.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:36.370 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:36.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.371 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:36.371 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:36.371 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.945720194000003, 2020-11-12T17:24:36.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:24:36.372 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.372 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.373 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.373 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.373 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.373 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:24:36.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.374 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:36.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:36.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:24:36.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:24:36.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:24:36.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:24:36.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:24:36.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:24:36.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:24:36.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:24:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:24:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:24:36.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:24:36.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:24:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:24:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:24:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:24:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:24:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:24:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:24:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:24:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:24:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:24:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:24:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:24:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.393 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.393 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.394 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:24:36.394 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:36.394 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.938776132000001, 2020-11-12T17:24:36.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:24:36.394 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:24:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:24:36.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:24:36.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:24:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:24:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:24:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:24:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:24:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:24:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:24:36.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:24:36.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:24:36.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:24:36.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:24:36.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:24:36.404 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.404 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:36.406 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.907490416000002, 2020-11-12T17:24:36.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:24:36.406 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.406 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:24:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:24:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:24:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:24:36.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:24:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:24:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:24:36.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:24:36.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:24:36.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:24:36.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:24:36.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:24:36.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:24:36.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:36.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:24:36.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:24:36.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:24:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:24:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:24:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:24:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:24:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:24:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:24:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:24:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.764938346000001, 2020-11-12T17:24:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:24:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:24:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:24:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:24:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:24:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:24:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:24:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:24:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:24:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:24:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:24:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:24:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:24:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:24:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:24:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:24:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:24:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:24:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:24:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:24:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:24:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:24:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:24:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:24:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e48)", 2020-11-12T17:24:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.688148548000001, 2020-11-12T17:24:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998, 2020-11-12T17:24:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:24:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:24:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:24:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676007+0000", 2020-11-12T17:24:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110902 2020-11-12T17:24:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676118+0000", 2020-11-12T17:24:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6195e-05 2020-11-12T17:24:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676135+0000", 2020-11-12T17:24:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3829999999999998e-06 2020-11-12T17:24:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676144+0000", 2020-11-12T17:24:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5806000000000001e-05 2020-11-12T17:24:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676200+0000", 2020-11-12T17:24:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9735999999999999e-05 2020-11-12T17:24:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676259+0000", 2020-11-12T17:24:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29976251100000001 2020-11-12T17:24:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976022+0000", 2020-11-12T17:24:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998 2020-11-12T17:24:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:33576 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 42.756293900000003, 2020-11-12T17:24:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846, 2020-11-12T17:24:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607883+0000", 2020-11-12T17:24:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0716000000000004e-05 2020-11-12T17:24:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607964+0000", 2020-11-12T17:24:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28021348200000001 2020-11-12T17:24:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888177+0000", 2020-11-12T17:24:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0214000000000001e-05 2020-11-12T17:24:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888188+0000", 2020-11-12T17:24:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0760999999999994e-05 2020-11-12T17:24:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888278+0000", 2020-11-12T17:24:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0537e-05 2020-11-12T17:24:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888299+0000", 2020-11-12T17:24:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020659300000000001 2020-11-12T17:24:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888505+0000", 2020-11-12T17:24:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846 2020-11-12T17:24:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34328 3.8 3:12eb1396:::benchmark_data_smithi036_14212_object4290:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.807748949, 2020-11-12T17:24:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999, 2020-11-12T17:24:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34328 2020-11-12T17:24:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999542 2020-11-12T17:24:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556414+0000", 2020-11-12T17:24:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133592 2020-11-12T17:24:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556547+0000", 2020-11-12T17:24:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8813000000000001e-05 2020-11-12T17:24:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556566+0000", 2020-11-12T17:24:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7660000000000004e-06 2020-11-12T17:24:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556575+0000", 2020-11-12T17:24:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011688914999999999 2020-11-12T17:24:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568264+0000", 2020-11-12T17:24:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108214 2020-11-12T17:24:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568372+0000", 2020-11-12T17:24:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189846 2020-11-12T17:24:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568562+0000", 2020-11-12T17:24:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016740710000000001 2020-11-12T17:24:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570236+0000", 2020-11-12T17:24:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29321335900000001 2020-11-12T17:24:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863449+0000", 2020-11-12T17:24:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7244999999999998e-05 2020-11-12T17:24:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863507+0000", 2020-11-12T17:24:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0704999999999994e-05 2020-11-12T17:24:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863587+0000", 2020-11-12T17:24:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999 2020-11-12T17:24:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34328 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.793392300000001, 2020-11-12T17:24:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998, 2020-11-12T17:24:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570784+0000", 2020-11-12T17:24:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2226999999999997e-05 2020-11-12T17:24:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570866+0000", 2020-11-12T17:24:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.290361445 2020-11-12T17:24:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861228+0000", 2020-11-12T17:24:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0240000000000003e-06 2020-11-12T17:24:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861237+0000", 2020-11-12T17:24:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021956749999999998 2020-11-12T17:24:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863432+0000", 2020-11-12T17:24:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2940000000000006e-06 2020-11-12T17:24:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863441+0000", 2020-11-12T17:24:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162399 2020-11-12T17:24:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863603+0000", 2020-11-12T17:24:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998 2020-11-12T17:24:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.293404437, 2020-11-12T17:24:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:24:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:24:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:24:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:24:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:24:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:24:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:24:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:24:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:24:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:24:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:24:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:24:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:24:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:24:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:24:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:24:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:24:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:24:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:24:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:24:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:24:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:24:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:24:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:24:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:24:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.278083215000002, 2020-11-12T17:24:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:24:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:24:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:24:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:24:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:24:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:24:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:24:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:24:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:24:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:24:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:24:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:24:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:24:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:24:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:24:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:24:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.501233252999999, 2020-11-12T17:24:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:24:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:24:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:24:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:24:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:24:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:24:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:24:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:24:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:24:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:24:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:24:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:24:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:24:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:24:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:24:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:24:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:24:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:24:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:24:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:24:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:24:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:24:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:24:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:24:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50544 3.8 3:13876818:::benchmark_data_smithi036_14212_object6317:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.634608261, 2020-11-12T17:24:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998, 2020-11-12T17:24:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50544 2020-11-12T17:24:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:24:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729570+0000", 2020-11-12T17:24:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010924 2020-11-12T17:24:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729679+0000", 2020-11-12T17:24:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1567e-05 2020-11-12T17:24:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729691+0000", 2020-11-12T17:24:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0929999999999999e-06 2020-11-12T17:24:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729697+0000", 2020-11-12T17:24:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086737580000000002 2020-11-12T17:24:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738371+0000", 2020-11-12T17:24:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7824999999999993e-05 2020-11-12T17:24:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738459+0000", 2020-11-12T17:24:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017210899999999999 2020-11-12T17:24:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738631+0000", 2020-11-12T17:24:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027566969999999998 2020-11-12T17:24:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.741387+0000", 2020-11-12T17:24:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27686545000000001 2020-11-12T17:24:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018253+0000", 2020-11-12T17:24:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3428000000000002e-05 2020-11-12T17:24:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018336+0000", 2020-11-12T17:24:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5240999999999994e-05 2020-11-12T17:24:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018402+0000", 2020-11-12T17:24:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998 2020-11-12T17:24:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:50544 3.8 e55/20 ondisk, result = 0)", 2020-11-12T17:24:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.621655826000001, 2020-11-12T17:24:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.275860253, 2020-11-12T17:24:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:24:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742526+0000", 2020-11-12T17:24:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6210999999999993e-05 2020-11-12T17:24:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742592+0000", 2020-11-12T17:24:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27212335799999998 2020-11-12T17:24:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.014715+0000", 2020-11-12T17:24:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3250000000000001e-06 2020-11-12T17:24:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.014720+0000", 2020-11-12T17:24:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035069239999999998 2020-11-12T17:24:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018227+0000", 2020-11-12T17:24:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3804e-05 2020-11-12T17:24:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018241+0000", 2020-11-12T17:24:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017238900000000001 2020-11-12T17:24:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018413+0000", 2020-11-12T17:24:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.275860253 2020-11-12T17:24:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:24:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.544786411, 2020-11-12T17:24:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:24:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:24:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:24:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:24:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:24:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:24:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:24:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:24:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:24:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:24:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:24:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:24:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:24:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:24:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:24:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:24:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:24:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:24:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:24:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:24:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:24:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:24:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:24:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:24:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:24:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:24:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:24:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:24:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:24:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.415852927, 2020-11-12T17:24:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:24:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:24:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:24:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:24:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:24:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:24:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:24:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:24:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:24:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:24:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:24:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:24:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:24:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:24:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:24:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:24:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:24:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:24:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:24:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:24:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:24:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.643834641, 2020-11-12T17:24:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:24:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:24:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:24:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:24:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:24:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:24:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:24:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:24:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:24:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:24:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:24:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:24:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:24:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:24:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:24:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:24:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:24:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:24:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:24:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:24:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:24:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:24:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:24:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:24:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:24:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:24:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:24:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 12.721714652999999, 2020-11-12T17:24:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:24:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:24:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:24:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:24:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:24:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:24:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:24:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:24:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:24:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:24:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:24:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:24:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:24:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:24:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:24:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:24:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:24:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:24:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:24:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:24:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:24:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:24:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:24:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:24:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:24:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:24:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:59416 3.c e57/20 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head v 57'3976, mlcod=57'3970)", 2020-11-12T17:24:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:24:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.831375088, 2020-11-12T17:24:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998, 2020-11-12T17:24:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:24:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:24:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532795+0000", 2020-11-12T17:24:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014490099999999999 2020-11-12T17:24:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532940+0000", 2020-11-12T17:24:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29738320899999998 2020-11-12T17:24:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830323+0000", 2020-11-12T17:24:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3199999999999996e-06 2020-11-12T17:24:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830330+0000", 2020-11-12T17:24:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9622999999999994e-05 2020-11-12T17:24:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830399+0000", 2020-11-12T17:24:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4766999999999999e-05 2020-11-12T17:24:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830424+0000", 2020-11-12T17:24:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038976610000000002 2020-11-12T17:24:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834322+0000", 2020-11-12T17:24:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7682999999999994e-05 2020-11-12T17:24:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834410+0000", 2020-11-12T17:24:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998 2020-11-12T17:24:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:60400 3.b 3:d9185304:::benchmark_data_smithi036_14212_object7549:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:24:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.550381376000001, 2020-11-12T17:24:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002, 2020-11-12T17:24:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60400 2020-11-12T17:24:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:24:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:24:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:24:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813806+0000", 2020-11-12T17:24:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0312999999999997e-05 2020-11-12T17:24:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813866+0000", 2020-11-12T17:24:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5310000000000007e-06 2020-11-12T17:24:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813875+0000", 2020-11-12T17:24:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9999999999999999e-06 2020-11-12T17:24:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813882+0000", 2020-11-12T17:24:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045585469999999996 2020-11-12T17:24:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818441+0000", 2020-11-12T17:24:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025338699999999999 2020-11-12T17:24:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818694+0000", 2020-11-12T17:24:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192215 2020-11-12T17:24:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818887+0000", 2020-11-12T17:24:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019573659999999999 2020-11-12T17:24:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.820844+0000", 2020-11-12T17:24:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27823403299999999 2020-11-12T17:24:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099078+0000", 2020-11-12T17:24:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8301000000000003e-05 2020-11-12T17:24:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099136+0000", 2020-11-12T17:24:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4981000000000003e-05 2020-11-12T17:24:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099171+0000", 2020-11-12T17:24:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002 2020-11-12T17:24:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:60400 3.b e57/20 ondisk, result = 0)", 2020-11-12T17:24:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:24:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.540936107, 2020-11-12T17:24:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166, 2020-11-12T17:24:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:24:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:24:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823242+0000", 2020-11-12T17:24:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9956000000000005e-05 2020-11-12T17:24:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823322+0000", 2020-11-12T17:24:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.270552615 2020-11-12T17:24:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093875+0000", 2020-11-12T17:24:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2374e-05 2020-11-12T17:24:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093887+0000", 2020-11-12T17:24:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051711070000000003 2020-11-12T17:24:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099058+0000", 2020-11-12T17:24:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0665e-05 2020-11-12T17:24:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099069+0000", 2020-11-12T17:24:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000115362 2020-11-12T17:24:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099184+0000", 2020-11-12T17:24:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166 2020-11-12T17:24:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:36.604 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:36.604 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:24:36.606 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:36.607 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:36.600+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:36.707 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:36.702+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:36.724 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:24:36.749 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:36.749 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:36.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.749 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:66208 3.3 3:c09282b7:::benchmark_data_smithi036_14212_object1286:head [delete] snapc 0=[] ondisk+write+known_if_redirected e62)", 2020-11-12T17:24:36.749 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:36.741867+0000", 2020-11-12T17:24:36.750 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0072350119999999999, 2020-11-12T17:24:36.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007257983, 2020-11-12T17:24:36.750 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:36.750 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:36.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:36.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:36.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:36.751 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 66208 2020-11-12T17:24:36.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.751 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:36.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:36.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.741867+0000", 2020-11-12T17:24:36.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:36.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:36.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.741867+0000", 2020-11-12T17:24:36.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:24:36.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:36.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.741834+0000", 2020-11-12T17:24:36.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4795000000000005e-05 2020-11-12T17:24:36.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:36.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.741909+0000", 2020-11-12T17:24:36.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5421999999999999e-05 2020-11-12T17:24:36.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:36.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.741924+0000", 2020-11-12T17:24:36.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4940000000000003e-06 2020-11-12T17:24:36.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.741933+0000", 2020-11-12T17:24:36.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1948999999999998e-05 2020-11-12T17:24:36.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:36.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.742005+0000", 2020-11-12T17:24:36.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162149 2020-11-12T17:24:36.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:36.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.742167+0000", 2020-11-12T17:24:36.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000158744 2020-11-12T17:24:36.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:36.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.742326+0000", 2020-11-12T17:24:36.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003228426 2020-11-12T17:24:36.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:36.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.745554+0000", 2020-11-12T17:24:36.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036866920000000001 2020-11-12T17:24:36.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:36.758 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:36.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:36.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.758 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:66210 3.e e62/20 3:77000cf4:::benchmark_data_smithi036_14212_object1288:head v 62'3684, mlcod=62'3682)", 2020-11-12T17:24:36.758 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:36.745927+0000", 2020-11-12T17:24:36.758 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0031752949999999999, 2020-11-12T17:24:36.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032599809999999999, 2020-11-12T17:24:36.760 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:36.760 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:36.760 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:36.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:36.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.745927+0000", 2020-11-12T17:24:36.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:36.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:36.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.745927+0000", 2020-11-12T17:24:36.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:36.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:36.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.745902+0000", 2020-11-12T17:24:36.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7869999999999998e-05 2020-11-12T17:24:36.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:36.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.745979+0000", 2020-11-12T17:24:36.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9750999999999998e-05 2020-11-12T17:24:36.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:36.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.746039+0000", 2020-11-12T17:24:36.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4640000000000003e-06 2020-11-12T17:24:36.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:36.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.746046+0000", 2020-11-12T17:24:36.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00092172200000000004 2020-11-12T17:24:36.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:36.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.746967+0000", 2020-11-12T17:24:36.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1535999999999998e-05 2020-11-12T17:24:36.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:36.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:36.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:36.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:36.746989+0000", 2020-11-12T17:24:36.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00106196 2020-11-12T17:24:36.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:36.766 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:36.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:36.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:36.766 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:24:36.766 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:24:36.766 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:36.768 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:36.810 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:36.800+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:36.819 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:36.863 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:36.899 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:36.909 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:36.906+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:36.933 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:36.965 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:36.966 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:36.970 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:36.983 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:37.010 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:37.004+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:37.017 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:37.051 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:37.052 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:24:37.052 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:37.052 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:37.052 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:24:37.052 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:24:37.052 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:24:37.053 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:24:37.053 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:24:37.053 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:24:37.056 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:37.056 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:37.111 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:37.104+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:37.200 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:37.200 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:37.212 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:37.206+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:37.216 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:37.313 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:37.310+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:37.332 INFO:teuthology.orchestra.run.smithi036.stdout: marking collection for removal 2020-11-12T17:24:37.332 INFO:teuthology.orchestra.run.smithi036.stdout:setting '_remove' omap key 2020-11-12T17:24:37.333 INFO:teuthology.orchestra.run.smithi036.stdout:finish_remove_pgs 2.4_head removing 2.4 2020-11-12T17:24:37.335 INFO:teuthology.orchestra.run.smithi036.stdout:Remove successful 2020-11-12T17:24:37.417 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:37.414+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:37.422 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:37.423 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:37.437 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:37.531 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:37.526+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:37.615 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:37.610+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:37.635 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:37.636 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:37.650 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:37.717 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:37.712+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:37.739 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:24:37.819 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:37.812+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:37.849 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:37.849 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:37.861 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:37.921 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:37.918+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:37.922 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.4.1 2020-11-12T17:24:38.016 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:38.017 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:38.025 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:38.018+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:38.030 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:38.121 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:38.118+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:38.219 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:38.220 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:38.223 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:38.216+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:38.237 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:38.328 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:38.322+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:38.422 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:38.423 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:38.425 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:38.422+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:38.437 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:38.526 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:38.522+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:38.619 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:38.619 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:38.627 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:38.622+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:38.634 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:38.727 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:38.722+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:38.823 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:38.824 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:38.828 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:38.826+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:38.837 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:38.931 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:38.926+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:39.029 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:39.030 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:39.030 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:39.026+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:39.043 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:39.057 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:24:39.131 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:39.126+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:39.192 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:39.193 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:39.205 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:39.232 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:39.226+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:39.242 INFO:teuthology.orchestra.run.smithi036.stdout:get_pg_num_history pg_num_history pg_num_history(e57 pg_nums {1={11=1},2={17=8},3={20=16}} deleted_pools ) 2020-11-12T17:24:39.242 INFO:teuthology.orchestra.run.smithi036.stdout:Importing pgid 2.4 2020-11-12T17:24:39.242 INFO:teuthology.orchestra.run.smithi036.stdout:write_pg epoch 56 info 2.4( empty local-lis/les=17/18 n=0 ec=17/17 lis/c=17/17 les/c/f=18/18/0 sis=17) 2020-11-12T17:24:39.247 INFO:teuthology.orchestra.run.smithi036.stdout:Import successful 2020-11-12T17:24:39.281 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:39.320 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:39.333 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:39.328+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:39.345 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:39.345 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:39.346 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:39.346 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:39.346 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:39.349 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:39.358 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:39.385 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:39.422 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:39.434 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:39.428+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:39.455 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:39.493 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:39.494 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:24:39.494 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:39.494 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:39.495 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:24:39.495 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:24:39.495 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:24:39.495 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:24:39.495 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:24:39.495 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:24:39.497 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:39.498 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:39.529 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:39.529 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:39.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:39.530 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:39.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.530 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:24:39.530 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.413558481999999, 2020-11-12T17:24:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:24:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.531 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.532 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:24:39.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.532 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:24:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:24:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:24:39.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:24:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:24:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:24:39.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:24:39.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:24:39.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:24:39.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:24:39.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:24:39.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:24:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:24:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:24:39.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:24:39.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:24:39.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:24:39.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:24:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:24:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:24:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:24:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:24:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:24:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.406466686000002, 2020-11-12T17:24:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:24:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:24:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:24:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:24:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:24:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:24:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:24:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:24:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:24:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:24:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:24:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:24:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:24:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:24:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:24:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:24:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 84.974429607999994, 2020-11-12T17:24:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999, 2020-11-12T17:24:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:24:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:24:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:24:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:24:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:24:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:24:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:24:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:24:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:24:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:24:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:24:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:24:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:24:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112811 2020-11-12T17:24:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550940+0000", 2020-11-12T17:24:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001154101 2020-11-12T17:24:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552095+0000", 2020-11-12T17:24:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25363090900000002 2020-11-12T17:24:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805725+0000", 2020-11-12T17:24:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8797999999999998e-05 2020-11-12T17:24:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805824+0000", 2020-11-12T17:24:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8110999999999998e-05 2020-11-12T17:24:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805902+0000", 2020-11-12T17:24:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999 2020-11-12T17:24:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 84.973907189000002, 2020-11-12T17:24:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:24:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:24:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:24:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:24:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:24:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:24:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:24:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:24:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:24:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:24:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:24:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:24:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:24:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:24:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:24:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:24:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:24:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:24:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:24:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:24:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:24:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:24:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:24:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:24:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9999 3.1 e26/20 ondisk, result = 0)", 2020-11-12T17:24:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 84.965544668999996, 2020-11-12T17:24:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145, 2020-11-12T17:24:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556869+0000", 2020-11-12T17:24:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1767999999999994e-05 2020-11-12T17:24:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556951+0000", 2020-11-12T17:24:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.248442731 2020-11-12T17:24:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805393+0000", 2020-11-12T17:24:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5503e-05 2020-11-12T17:24:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805409+0000", 2020-11-12T17:24:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027928399999999998 2020-11-12T17:24:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805688+0000", 2020-11-12T17:24:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2215e-05 2020-11-12T17:24:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805710+0000", 2020-11-12T17:24:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000226744 2020-11-12T17:24:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805937+0000", 2020-11-12T17:24:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145 2020-11-12T17:24:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:25512 3.b e46/20 3:d013695c:::benchmark_data_smithi036_14212_object3188:head v 46'1664, mlcod=46'1657)", 2020-11-12T17:24:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.061368715999997, 2020-11-12T17:24:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999, 2020-11-12T17:24:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:24:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461054+0000", 2020-11-12T17:24:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5973000000000002e-05 2020-11-12T17:24:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461100+0000", 2020-11-12T17:24:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27743074600000001 2020-11-12T17:24:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738530+0000", 2020-11-12T17:24:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6039999999999993e-06 2020-11-12T17:24:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738539+0000", 2020-11-12T17:24:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7942000000000006e-05 2020-11-12T17:24:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738627+0000", 2020-11-12T17:24:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1338000000000003e-05 2020-11-12T17:24:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738668+0000", 2020-11-12T17:24:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002001774 2020-11-12T17:24:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740670+0000", 2020-11-12T17:24:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7090999999999999e-05 2020-11-12T17:24:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740737+0000", 2020-11-12T17:24:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999 2020-11-12T17:24:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:24:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 51.023787095000003, 2020-11-12T17:24:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:24:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:24:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:24:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:24:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:24:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:24:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:24:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:24:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:24:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:24:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:24:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:24:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:24:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:24:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:24:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:28424 3.b e47/20 3:d6b3d883:::benchmark_data_smithi036_14212_object3552:head v 47'1832, mlcod=47'1825)", 2020-11-12T17:24:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.998615733999998, 2020-11-12T17:24:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002, 2020-11-12T17:24:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523784+0000", 2020-11-12T17:24:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100963 2020-11-12T17:24:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523885+0000", 2020-11-12T17:24:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29458836900000002 2020-11-12T17:24:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818473+0000", 2020-11-12T17:24:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1482e-05 2020-11-12T17:24:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818485+0000", 2020-11-12T17:24:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4080999999999998e-05 2020-11-12T17:24:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818559+0000", 2020-11-12T17:24:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9269e-05 2020-11-12T17:24:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818598+0000", 2020-11-12T17:24:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044328520000000001 2020-11-12T17:24:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823031+0000", 2020-11-12T17:24:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2584999999999998e-05 2020-11-12T17:24:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823094+0000", 2020-11-12T17:24:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002 2020-11-12T17:24:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:24:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 48.918185203, 2020-11-12T17:24:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:24:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:24:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:24:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:24:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:24:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:24:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:24:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:24:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:24:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:24:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:24:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:24:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:24:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:24:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:24:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:24:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:24:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43232 3.6 3:67cbc07e:::benchmark_data_smithi036_14212_object5403:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e52)", 2020-11-12T17:24:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.333962+0000", 2020-11-12T17:24:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 35.188473178000002, 2020-11-12T17:24:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234228415, 2020-11-12T17:24:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43232 2020-11-12T17:24:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333962+0000", 2020-11-12T17:24:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333962+0000", 2020-11-12T17:24:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333946+0000", 2020-11-12T17:24:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2445999999999999e-05 2020-11-12T17:24:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.333999+0000", 2020-11-12T17:24:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2269999999999996e-06 2020-11-12T17:24:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.334006+0000", 2020-11-12T17:24:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7709999999999997e-06 2020-11-12T17:24:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.334011+0000", 2020-11-12T17:24:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010388237 2020-11-12T17:24:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.344399+0000", 2020-11-12T17:24:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116328 2020-11-12T17:24:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.344515+0000", 2020-11-12T17:24:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000155721 2020-11-12T17:24:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.344671+0000", 2020-11-12T17:24:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025734880000000001 2020-11-12T17:24:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.347245+0000", 2020-11-12T17:24:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.220854892 2020-11-12T17:24:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.568099+0000", 2020-11-12T17:24:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2451000000000003e-05 2020-11-12T17:24:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.568152+0000", 2020-11-12T17:24:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9005999999999999e-05 2020-11-12T17:24:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.568191+0000", 2020-11-12T17:24:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234228415 2020-11-12T17:24:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43534 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.813534230000002, 2020-11-12T17:24:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002, 2020-11-12T17:24:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43534 2020-11-12T17:24:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708876+0000", 2020-11-12T17:24:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4095000000000002e-05 2020-11-12T17:24:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708940+0000", 2020-11-12T17:24:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960000000000007e-06 2020-11-12T17:24:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708949+0000", 2020-11-12T17:24:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.451e-06 2020-11-12T17:24:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708955+0000", 2020-11-12T17:24:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085037340000000006 2020-11-12T17:24:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717458+0000", 2020-11-12T17:24:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4234999999999997e-05 2020-11-12T17:24:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717523+0000", 2020-11-12T17:24:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012550500000000001 2020-11-12T17:24:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717648+0000", 2020-11-12T17:24:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040419740000000003 2020-11-12T17:24:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.721690+0000", 2020-11-12T17:24:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.247979797 2020-11-12T17:24:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969670+0000", 2020-11-12T17:24:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012950400000000001 2020-11-12T17:24:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969799+0000", 2020-11-12T17:24:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000181709 2020-11-12T17:24:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969981+0000", 2020-11-12T17:24:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002 2020-11-12T17:24:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43535 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.813215401999997, 2020-11-12T17:24:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003, 2020-11-12T17:24:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43535 2020-11-12T17:24:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:24:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709201+0000", 2020-11-12T17:24:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4987000000000001e-05 2020-11-12T17:24:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709256+0000", 2020-11-12T17:24:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9799999999999998e-06 2020-11-12T17:24:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709264+0000", 2020-11-12T17:24:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:24:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709268+0000", 2020-11-12T17:24:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01033796 2020-11-12T17:24:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719606+0000", 2020-11-12T17:24:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014753499999999999 2020-11-12T17:24:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719754+0000", 2020-11-12T17:24:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023477900000000001 2020-11-12T17:24:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719989+0000", 2020-11-12T17:24:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002308844 2020-11-12T17:24:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722298+0000", 2020-11-12T17:24:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27981983300000002 2020-11-12T17:24:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002117+0000", 2020-11-12T17:24:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4757000000000001e-05 2020-11-12T17:24:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002212+0000", 2020-11-12T17:24:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116928 2020-11-12T17:24:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002329+0000", 2020-11-12T17:24:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003 2020-11-12T17:24:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43536 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.813115871000001, 2020-11-12T17:24:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001, 2020-11-12T17:24:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43536 2020-11-12T17:24:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:24:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709302+0000", 2020-11-12T17:24:39.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3248999999999998e-05 2020-11-12T17:24:39.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709355+0000", 2020-11-12T17:24:39.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.34e-06 2020-11-12T17:24:39.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709363+0000", 2020-11-12T17:24:39.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.664e-06 2020-11-12T17:24:39.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709366+0000", 2020-11-12T17:24:39.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013071532 2020-11-12T17:24:39.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722438+0000", 2020-11-12T17:24:39.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141901 2020-11-12T17:24:39.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722580+0000", 2020-11-12T17:24:39.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118355 2020-11-12T17:24:39.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:39.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722698+0000", 2020-11-12T17:24:39.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014561839999999999 2020-11-12T17:24:39.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.724154+0000", 2020-11-12T17:24:39.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27825006499999999 2020-11-12T17:24:39.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002404+0000", 2020-11-12T17:24:39.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2908000000000001e-05 2020-11-12T17:24:39.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002477+0000", 2020-11-12T17:24:39.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020370300000000001 2020-11-12T17:24:39.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002681+0000", 2020-11-12T17:24:39.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001 2020-11-12T17:24:39.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.663 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.663 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:43534 3.6 e53/20 ondisk, result = 0)", 2020-11-12T17:24:39.663 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:39.663 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.796007545999998, 2020-11-12T17:24:39.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001, 2020-11-12T17:24:39.664 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.664 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:39.664 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:39.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:39.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:39.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726412+0000", 2020-11-12T17:24:39.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2086000000000003e-05 2020-11-12T17:24:39.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726454+0000", 2020-11-12T17:24:39.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24305705 2020-11-12T17:24:39.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969511+0000", 2020-11-12T17:24:39.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.49e-05 2020-11-12T17:24:39.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969526+0000", 2020-11-12T17:24:39.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010331999999999999 2020-11-12T17:24:39.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969629+0000", 2020-11-12T17:24:39.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1993000000000001e-05 2020-11-12T17:24:39.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969651+0000", 2020-11-12T17:24:39.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00033822300000000002 2020-11-12T17:24:39.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969989+0000", 2020-11-12T17:24:39.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001 2020-11-12T17:24:39.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.670 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.671 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43768 3.6 3:6f7b85f8:::benchmark_data_smithi036_14212_object5470:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:39.671 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:39.671 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.524383026000002, 2020-11-12T17:24:39.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001, 2020-11-12T17:24:39.671 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.671 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.671 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.671 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.672 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.672 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43768 2020-11-12T17:24:39.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.672 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:39.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:39.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:39.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998003+0000", 2020-11-12T17:24:39.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014095000000000001 2020-11-12T17:24:39.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998144+0000", 2020-11-12T17:24:39.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1143000000000001e-05 2020-11-12T17:24:39.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998165+0000", 2020-11-12T17:24:39.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3979999999999999e-06 2020-11-12T17:24:39.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998174+0000", 2020-11-12T17:24:39.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012056769 2020-11-12T17:24:39.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010231+0000", 2020-11-12T17:24:39.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102279 2020-11-12T17:24:39.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010333+0000", 2020-11-12T17:24:39.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014553299999999999 2020-11-12T17:24:39.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:39.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010478+0000", 2020-11-12T17:24:39.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037901779999999999 2020-11-12T17:24:39.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.014269+0000", 2020-11-12T17:24:39.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22457837 2020-11-12T17:24:39.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238847+0000", 2020-11-12T17:24:39.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2958000000000001e-05 2020-11-12T17:24:39.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238930+0000", 2020-11-12T17:24:39.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1814000000000002e-05 2020-11-12T17:24:39.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238982+0000", 2020-11-12T17:24:39.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001 2020-11-12T17:24:39.681 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.681 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.682 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.682 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50240 3.1 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:39.682 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:39.682 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 27.169338831000001, 2020-11-12T17:24:39.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003, 2020-11-12T17:24:39.682 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.683 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.683 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.683 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.683 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.683 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50240 2020-11-12T17:24:39.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.683 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:39.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:39.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:39.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353074+0000", 2020-11-12T17:24:39.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106903 2020-11-12T17:24:39.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353181+0000", 2020-11-12T17:24:39.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6804999999999999e-05 2020-11-12T17:24:39.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353198+0000", 2020-11-12T17:24:39.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3259999999999998e-06 2020-11-12T17:24:39.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353205+0000", 2020-11-12T17:24:39.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011916829 2020-11-12T17:24:39.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365122+0000", 2020-11-12T17:24:39.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111867 2020-11-12T17:24:39.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365234+0000", 2020-11-12T17:24:39.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011033500000000001 2020-11-12T17:24:39.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:39.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365344+0000", 2020-11-12T17:24:39.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002314876 2020-11-12T17:24:39.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.367659+0000", 2020-11-12T17:24:39.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23853026499999999 2020-11-12T17:24:39.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606189+0000", 2020-11-12T17:24:39.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3222999999999999e-05 2020-11-12T17:24:39.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606272+0000", 2020-11-12T17:24:39.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000165849 2020-11-12T17:24:39.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606438+0000", 2020-11-12T17:24:39.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003 2020-11-12T17:24:39.692 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.692 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.692 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.692 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50240 3.1 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e55)", 2020-11-12T17:24:39.692 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.372226+0000", 2020-11-12T17:24:39.693 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 27.150209666999999, 2020-11-12T17:24:39.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234079712, 2020-11-12T17:24:39.693 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.693 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:24:39.693 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.693 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.693 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.694 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50240 2020-11-12T17:24:39.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.694 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372226+0000", 2020-11-12T17:24:39.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372226+0000", 2020-11-12T17:24:39.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:24:39.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372195+0000", 2020-11-12T17:24:39.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103138 2020-11-12T17:24:39.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372298+0000", 2020-11-12T17:24:39.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1175999999999999e-05 2020-11-12T17:24:39.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372309+0000", 2020-11-12T17:24:39.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9009999999999999e-06 2020-11-12T17:24:39.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372315+0000", 2020-11-12T17:24:39.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3058000000000001e-05 2020-11-12T17:24:39.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372348+0000", 2020-11-12T17:24:39.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8007e-05 2020-11-12T17:24:39.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:39.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.372426+0000", 2020-11-12T17:24:39.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23387923899999999 2020-11-12T17:24:39.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606306+0000", 2020-11-12T17:24:39.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.234079712 2020-11-12T17:24:39.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.700 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.700 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:39.700 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:39.701 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 17.571701869000002, 2020-11-12T17:24:39.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:24:39.701 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.701 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:39.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:39.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:39.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:39.701 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:24:39.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.702 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:39.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:39.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:24:39.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:24:39.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:24:39.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:24:39.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:24:39.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:24:39.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:24:39.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:24:39.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:24:39.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:24:39.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:24:39.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:24:39.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:24:39.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:39.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:24:39.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:24:39.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:39.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:24:39.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:24:39.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:39.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:24:39.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:24:39.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:39.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:24:39.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:24:39.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:24:39.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:24:39.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.710 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.711 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:24:39.711 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:24:39.711 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.5758600670000007, 2020-11-12T17:24:39.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:24:39.711 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.711 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:39.712 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:24:39.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:24:39.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:24:39.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:24:39.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:24:39.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:24:39.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:24:39.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:24:39.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:24:39.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:24:39.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:24:39.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:24:39.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:24:39.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:39.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:24:39.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:24:39.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:24:39.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:24:39.717 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.717 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.718 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.718 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:24:39.718 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:24:39.718 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.6407566679999999, 2020-11-12T17:24:39.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:24:39.718 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:39.719 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:24:39.719 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:39.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:39.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:24:39.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:39.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:39.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:24:39.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:24:39.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:39.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:24:39.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:24:39.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:39.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:24:39.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:24:39.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:39.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:24:39.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:24:39.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:39.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:24:39.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:24:39.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:39.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:24:39.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:24:39.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:39.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:39.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:39.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:24:39.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:24:39.724 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.724 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.724 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.724 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:39.724 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:39.725 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:39.726 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:24:39.727 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:39.722+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:39.754 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:24:39.811 INFO:teuthology.orchestra.run.smithi036:> sudo rm -f /var/log/ceph/exp.2.4.1 2020-11-12T17:24:39.828 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:39.822+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:39.873 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-12T17:24:39.910 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:39.911 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:39.911 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:24:39.911 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:39.923 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:24:39.928 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:39.922+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:40.031 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:40.026+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:40.130 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:40.126+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:40.154 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:40.154 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:40.154 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:40.154 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:40.155 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:40.167 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:24:40.233 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:40.226+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:40.316 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:40.316 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:24:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:24:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.653283811999998, 2020-11-12T17:24:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:24:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:24:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:24:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:24:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:24:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:24:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:24:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:24:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:24:40.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:24:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:24:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:24:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:24:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:24:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:24:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:24:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:24:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:24:40.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:24:40.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.327 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:24:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:24:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.652377017000006, 2020-11-12T17:24:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:24:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:24:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:24:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:24:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:24:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:24:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:24:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:24:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:24:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:24:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:24:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:24:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:24:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:24:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:24:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:24:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:24:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:24:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:24:40.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:24:40.336 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.336 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.336 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.336 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:24:40.336 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:24:40.337 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.651674794000002, 2020-11-12T17:24:40.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:24:40.337 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.337 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.337 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:24:40.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:24:40.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:40.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:24:40.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:24:40.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:24:40.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:24:40.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:24:40.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:24:40.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:24:40.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:24:40.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:24:40.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:24:40.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:24:40.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:24:40.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:24:40.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:24:40.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:24:40.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:24:40.346 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.346 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.346 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.346 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:24:40.346 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:24:40.347 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.647168597999993, 2020-11-12T17:24:40.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:24:40.347 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.347 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.347 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:24:40.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:24:40.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:40.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:24:40.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:24:40.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:24:40.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:24:40.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:24:40.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:24:40.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:24:40.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:24:40.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:24:40.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:24:40.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:24:40.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:24:40.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:24:40.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:24:40.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:24:40.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:24:40.354 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.354 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.354 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.355 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:24:40.355 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:24:40.355 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.143627617000007, 2020-11-12T17:24:40.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:24:40.355 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.355 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.355 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:24:40.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:24:40.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:24:40.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:24:40.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:24:40.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:24:40.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:24:40.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:24:40.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:24:40.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:24:40.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:24:40.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:24:40.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:24:40.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:24:40.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:24:40.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:24:40.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:24:40.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:24:40.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:24:40.362 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.362 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.362 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.363 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:24:40.363 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:24:40.363 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.142701376000005, 2020-11-12T17:24:40.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:24:40.363 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.364 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.364 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:24:40.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:24:40.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:24:40.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:24:40.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:24:40.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:24:40.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:24:40.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:24:40.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:24:40.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:24:40.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:24:40.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:24:40.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:24:40.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:24:40.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:24:40.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:24:40.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:24:40.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:24:40.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:24:40.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.371 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.371 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:24:40.371 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:24:40.372 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.140353865999998, 2020-11-12T17:24:40.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:24:40.372 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.372 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.372 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:24:40.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:24:40.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:24:40.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:24:40.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:24:40.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:24:40.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:24:40.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:24:40.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:24:40.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:24:40.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:24:40.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:24:40.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:24:40.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:24:40.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:24:40.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:24:40.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:24:40.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:24:40.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:24:40.379 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.379 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.379 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.380 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:24:40.380 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:24:40.380 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.139589074, 2020-11-12T17:24:40.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:24:40.380 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.380 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.380 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:24:40.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:24:40.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:24:40.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:24:40.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:24:40.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:24:40.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:24:40.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:24:40.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:24:40.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:24:40.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:24:40.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:24:40.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:24:40.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:24:40.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:24:40.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:24:40.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:24:40.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:24:40.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:24:40.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.393 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.393 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.393 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:24:40.393 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:24:40.393 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.057362596000004, 2020-11-12T17:24:40.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:24:40.394 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.394 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.394 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:24:40.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:24:40.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:40.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:24:40.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:24:40.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:24:40.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:24:40.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:24:40.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:24:40.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:24:40.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:24:40.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:24:40.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:24:40.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:24:40.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:24:40.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:24:40.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:24:40.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:24:40.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:24:40.401 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.401 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.401 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.401 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:24:40.402 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:24:40.402 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 91.465249162999996, 2020-11-12T17:24:40.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:24:40.402 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.402 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.402 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:24:40.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:24:40.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:24:40.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:24:40.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:24:40.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:24:40.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:24:40.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:24:40.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:24:40.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:24:40.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:24:40.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:24:40.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:24:40.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:24:40.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:24:40.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:24:40.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:24:40.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:24:40.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:24:40.411 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.411 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.411 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.412 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:24:40.412 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:24:40.412 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.436588865999994, 2020-11-12T17:24:40.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:24:40.412 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.413 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.413 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:24:40.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:24:40.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:40.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:24:40.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:24:40.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:24:40.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:24:40.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:24:40.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:24:40.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:24:40.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:24:40.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:24:40.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:24:40.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:24:40.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:24:40.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:24:40.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:24:40.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:24:40.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:24:40.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.420 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.421 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.421 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:24:40.421 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:24:40.421 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.523992155000002, 2020-11-12T17:24:40.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:24:40.421 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.422 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.422 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:24:40.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:24:40.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:24:40.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:24:40.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:24:40.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:24:40.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:24:40.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:24:40.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:24:40.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:24:40.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:24:40.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:24:40.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:24:40.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:24:40.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:24:40.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:24:40.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:24:40.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:24:40.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:24:40.428 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.428 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.429 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.429 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:24:40.429 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:24:40.429 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.452852511000003, 2020-11-12T17:24:40.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:24:40.430 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.430 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.430 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:24:40.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:24:40.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:40.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:24:40.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:24:40.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:24:40.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:24:40.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:24:40.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:24:40.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:24:40.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:24:40.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:24:40.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:24:40.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:24:40.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:24:40.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:24:40.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:24:40.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:24:40.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:24:40.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.437 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.437 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:24:40.437 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:24:40.438 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.343465219999999, 2020-11-12T17:24:40.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:24:40.438 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.438 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.438 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:24:40.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:24:40.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:24:40.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:24:40.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:24:40.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:24:40.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:24:40.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:24:40.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:24:40.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:24:40.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:24:40.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:24:40.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:24:40.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:24:40.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:24:40.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:24:40.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:24:40.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:24:40.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:24:40.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.445 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.446 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.446 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:24:40.446 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:24:40.446 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.272929380999997, 2020-11-12T17:24:40.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:24:40.446 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.447 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.447 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:24:40.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:24:40.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:40.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:24:40.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:24:40.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:24:40.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:24:40.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:24:40.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:24:40.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:24:40.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:24:40.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:24:40.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:24:40.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:24:40.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:24:40.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:24:40.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:24:40.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:24:40.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:24:40.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.454 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.454 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:24:40.454 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:24:40.454 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.103563442999999, 2020-11-12T17:24:40.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:24:40.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.455 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.455 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:24:40.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:24:40.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:24:40.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:24:40.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:24:40.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:24:40.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:24:40.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:24:40.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:24:40.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:24:40.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:24:40.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:24:40.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:24:40.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:24:40.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:24:40.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:24:40.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:24:40.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:24:40.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:24:40.462 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.462 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.462 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.462 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:24:40.463 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:24:40.463 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.774937570999995, 2020-11-12T17:24:40.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:24:40.463 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.463 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.463 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:24:40.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:24:40.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:24:40.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:24:40.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:24:40.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:24:40.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:24:40.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:24:40.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:24:40.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:24:40.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:24:40.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:24:40.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:24:40.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:24:40.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:24:40.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:24:40.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:24:40.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:24:40.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:24:40.470 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.470 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.470 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.471 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:24:40.471 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:24:40.471 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.118474208999999, 2020-11-12T17:24:40.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:24:40.471 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.471 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.471 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:24:40.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:24:40.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:24:40.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:24:40.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:24:40.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:24:40.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:24:40.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:24:40.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:24:40.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:24:40.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:24:40.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:24:40.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:24:40.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:24:40.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:24:40.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:24:40.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:24:40.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:24:40.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:24:40.478 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.478 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.478 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.479 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:24:40.479 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:24:40.479 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.115833486, 2020-11-12T17:24:40.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:24:40.479 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.479 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.479 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:24:40.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:24:40.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:40.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:24:40.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:24:40.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:24:40.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:24:40.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:24:40.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:24:40.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:24:40.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:24:40.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:24:40.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:24:40.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:24:40.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:24:40.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:24:40.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:24:40.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:24:40.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:24:40.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.486 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.487 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:24:40.487 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:24:40.487 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.631587447000001, 2020-11-12T17:24:40.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:24:40.487 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.487 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:40.487 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:24:40.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:24:40.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:24:40.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:24:40.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:24:40.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:24:40.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:24:40.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:24:40.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:24:40.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:24:40.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:24:40.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:24:40.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:24:40.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:24:40.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:24:40.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:40.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:24:40.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:24:40.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:40.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:24:40.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:24:40.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.496 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.496 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.496 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:40.496 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:24:40.497 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":63,"fsid":"8c8a6bcc-49d4-47d1-904f-e20798ef8e1f","created":"2020-11-12T17:22:37.581394+0000","modified":"2020-11-12T17:24:37.723416+0000","last_up_change":"2020-11-12T17:24:28.613249+0000","last_in_change":"2020-11-12T17:24:29.625503+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-12T17:22:41.596657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-12T17:22:49.905816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2020-11-12T17:23:01.837897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"bd1d5457-5d54-4074-b378-9da417f42976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6801","nonce":12304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6802","nonce":12304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6806","nonce":12304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6804","nonce":12304}]},"public_addr":"172.21.15.36:6801/12304","cluster_addr":"172.21.15.36:6802/12304","heartbeat_back_addr":"172.21.15.36:6806/12304","heartbeat_front_addr":"172.21.15.36:6804/12304","state":["exists","up"]},{"osd":1,"uuid":"37152eee-a8d8-40f1-8e27-2899e7b94c98","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6812","nonce":12307}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6814","nonce":12307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6816","nonce":12307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6815","nonce":12307}]},"public_addr":"172.21.15.36:6812/12307","cluster_addr":"172.21.15.36:6814/12307","heartbeat_back_addr":"172.21.15.36:6816/12307","heartbeat_front_addr":"172.21.15.36:6815/12307","state":["exists"]},{"osd":2,"uuid":"d8ec2abb-38bf-4863-969a-482c4fa44f41","up":1,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6803","nonce":12306}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6805","nonce":12306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6808","nonce":12306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6807","nonce":12306}]},"public_addr":"172.21.15.36:6803/12306","cluster_addr":"172.21.15.36:6805/12306","heartbeat_back_addr":"172.21.15.36:6808/12306","heartbeat_front_addr":"172.21.15.36:6807/12306","state":["exists","up"]},{"osd":3,"uuid":"799d3499-577c-4510-a00c-9b2e126fc449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6809","nonce":12305}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6810","nonce":12305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6813","nonce":12305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6811","nonce":12305}]},"public_addr":"172.21.15.36:6809/12305","cluster_addr":"172.21.15.36:6810/12305","heartbeat_back_addr":"172.21.15.36:6813/12305","heartbeat_front_addr":"172.21.15.36:6811/12305","state":["exists","up"]},{"osd":4,"uuid":"c36e3100-aadc-4117-b495-24fb08a34148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6804","nonce":12499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6805","nonce":12499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6807","nonce":12499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6806","nonce":12499}]},"public_addr":"172.21.15.205:6804/12499","cluster_addr":"172.21.15.205:6805/12499","heartbeat_back_addr":"172.21.15.205:6807/12499","heartbeat_front_addr":"172.21.15.205:6806/12499","state":["exists","up"]},{"osd":5,"uuid":"b152141f-b530-448e-8dff-fe200559eff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6808","nonce":12525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6810","nonce":12525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6814","nonce":12525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6812","nonce":12525}]},"public_addr":"172.21.15.205:6808/12525","cluster_addr":"172.21.15.205:6810/12525","heartbeat_back_addr":"172.21.15.205:6814/12525","heartbeat_front_addr":"172.21.15.205:6812/12525","state":["exists","up"]},{"osd":6,"uuid":"62a140ba-7f94-4bb6-8a62-fda077f81354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6809","nonce":12524}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6811","nonce":12524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6815","nonce":12524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6813","nonce":12524}]},"public_addr":"172.21.15.205:6809/12524","cluster_addr":"172.21.15.205:6811/12524","heartbeat_back_addr":"172.21.15.205:6815/12524","heartbeat_front_addr":"172.21.15.205:6813/12524","state":["exists","up"]},{"osd":7,"uuid":"32879bd7-780c-4da6-9838-5850b6277902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6800","nonce":12522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6801","nonce":12522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6803","nonce":12522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6802","nonce":12522}]},"public_addr":"172.21.15.205:6800/12522","cluster_addr":"172.21.15.205:6801/12522","heartbeat_back_addr":"172.21.15.205:6803/12522","heartbeat_front_addr":"172.21.15.205:6802/12522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:23:44.207908+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":65536,"last_purged_snaps_scrub":"2020-11-12T17:23:44.389603+0000","dead_epoch":58},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":65536,"last_purged_snaps_scrub":"2020-11-12T17:23:44.907194+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:23:44.449151+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:23:44.143154+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:23:45.068596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:23:44.217907+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:23:44.087692+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-12T17:24:40.498 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:40.499 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'unique_pool_0', 'create_time': '2020-11-12T17:23:01.837897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}] 2020-11-12T17:24:40.500 INFO:teuthology.orchestra.run.smithi036:> CEPH_ARGS='--filestore-merge-threshold 1 --filestore-split-multiple 1' sudo -E ceph-objectstore-tool --no-mon-config --log-file=/var/log/ceph/objectstore_tool.$pid.log --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op apply-layout-settings --pool device_health_metrics 2020-11-12T17:24:40.500 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:40.492+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:40.599 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:40.594+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:40.693 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:40.694 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:40.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.694 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:70418 3.2 3:406a92e5:::benchmark_data_smithi036_14212_object5496:head [delete] snapc 0=[] ondisk+write+known_if_redirected e63)", 2020-11-12T17:24:40.694 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:40.687430+0000", 2020-11-12T17:24:40.695 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0047814659999999998, 2020-11-12T17:24:40.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048103210000000002, 2020-11-12T17:24:40.695 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.695 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:40.695 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:40.695 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:40.695 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:40.695 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70418 2020-11-12T17:24:40.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.696 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687430+0000", 2020-11-12T17:24:40.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687430+0000", 2020-11-12T17:24:40.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:24:40.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687399+0000", 2020-11-12T17:24:40.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9431999999999995e-05 2020-11-12T17:24:40.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687468+0000", 2020-11-12T17:24:40.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3125999999999999e-05 2020-11-12T17:24:40.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687481+0000", 2020-11-12T17:24:40.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8759999999999999e-06 2020-11-12T17:24:40.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687488+0000", 2020-11-12T17:24:40.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000303882 2020-11-12T17:24:40.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687792+0000", 2020-11-12T17:24:40.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017222400000000001 2020-11-12T17:24:40.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687964+0000", 2020-11-12T17:24:40.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144623 2020-11-12T17:24:40.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:40.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.688109+0000", 2020-11-12T17:24:40.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040600360000000004 2020-11-12T17:24:40.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:40.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.692169+0000", 2020-11-12T17:24:40.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047390890000000001 2020-11-12T17:24:40.703 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.703 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.703 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.704 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:70419 3.8 3:101da1a8:::benchmark_data_smithi036_14212_object5497:head [delete] snapc 0=[] ondisk+write+known_if_redirected e63)", 2020-11-12T17:24:40.704 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:40.687566+0000", 2020-11-12T17:24:40.704 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0046453939999999997, 2020-11-12T17:24:40.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048063330000000003, 2020-11-12T17:24:40.704 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.705 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:40.705 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:40.705 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:40.705 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:40.705 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70419 2020-11-12T17:24:40.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.706 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687566+0000", 2020-11-12T17:24:40.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687566+0000", 2020-11-12T17:24:40.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:24:40.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687515+0000", 2020-11-12T17:24:40.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0394000000000002e-05 2020-11-12T17:24:40.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687605+0000", 2020-11-12T17:24:40.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.076e-05 2020-11-12T17:24:40.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687616+0000", 2020-11-12T17:24:40.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4349999999999996e-06 2020-11-12T17:24:40.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687622+0000", 2020-11-12T17:24:40.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010795010000000001 2020-11-12T17:24:40.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.688701+0000", 2020-11-12T17:24:40.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148391 2020-11-12T17:24:40.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.688850+0000", 2020-11-12T17:24:40.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015775000000000001 2020-11-12T17:24:40.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:40.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.689007+0000", 2020-11-12T17:24:40.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014413150000000001 2020-11-12T17:24:40.712 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.713 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.713 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.713 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:70417 3.5 e63/20 3:a805985e:::benchmark_data_smithi036_14212_object5495:head v 63'4237, mlcod=63'4234)", 2020-11-12T17:24:40.714 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:40.687310+0000", 2020-11-12T17:24:40.714 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0049017410000000003, 2020-11-12T17:24:40.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051648579999999996, 2020-11-12T17:24:40.714 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.714 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:40.714 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687310+0000", 2020-11-12T17:24:40.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687310+0000", 2020-11-12T17:24:40.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:24:40.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687281+0000", 2020-11-12T17:24:40.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5037000000000006e-05 2020-11-12T17:24:40.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687366+0000", 2020-11-12T17:24:40.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000369305 2020-11-12T17:24:40.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687735+0000", 2020-11-12T17:24:40.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1290000000000004e-06 2020-11-12T17:24:40.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.687741+0000", 2020-11-12T17:24:40.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036666899999999998 2020-11-12T17:24:40.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:40.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.691407+0000", 2020-11-12T17:24:40.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6786000000000001e-05 2020-11-12T17:24:40.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:40.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.691434+0000", 2020-11-12T17:24:40.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041244530000000001 2020-11-12T17:24:40.720 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.720 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.720 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.721 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:70422 3.c e63/20)", 2020-11-12T17:24:40.721 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:40.691677+0000", 2020-11-12T17:24:40.721 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00053439199999999996, 2020-11-12T17:24:40.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000845713, 2020-11-12T17:24:40.721 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:40.721 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:24:40.721 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:40.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:40.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.691677+0000", 2020-11-12T17:24:40.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:40.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:40.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.691677+0000", 2020-11-12T17:24:40.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:24:40.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:40.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.691655+0000", 2020-11-12T17:24:40.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3429000000000005e-05 2020-11-12T17:24:40.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:40.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.691728+0000", 2020-11-12T17:24:40.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000165036 2020-11-12T17:24:40.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:40.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.691893+0000", 2020-11-12T17:24:40.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2059999999999999e-06 2020-11-12T17:24:40.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:40.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:40.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:40.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:40.691896+0000", 2020-11-12T17:24:40.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021934400000000001 2020-11-12T17:24:40.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.726 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:40.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:40.726 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:24:40.726 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 4 2020-11-12T17:24:40.727 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:40.728 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:40.729 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:40.724+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:40.778 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:24:40.834 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:40.826+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:40.928 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:40.928 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:40.928 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:40.928 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:40.928 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:40.932 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:40.926+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:40.947 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:41.033 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:41.030+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:41.088 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.664810474000006, 2020-11-12T17:24:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:24:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:24:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:41.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:24:41.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:24:41.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:24:41.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:24:41.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:24:41.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:24:41.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:24:41.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:24:41.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:24:41.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:24:41.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:24:41.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:24:41.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:24:41.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:41.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:24:41.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:24:41.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:24:41.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:24:41.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:24:41.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:24:41.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:24:41.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:24:41.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:24:41.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:24:41.102 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.102 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.102 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.102 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:24:41.103 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:41.103 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.657866412000004, 2020-11-12T17:24:41.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:24:41.103 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.103 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:41.103 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:41.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:41.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:24:41.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:24:41.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:24:41.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:24:41.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:24:41.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:24:41.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:24:41.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:24:41.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:24:41.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:24:41.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:24:41.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:24:41.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:24:41.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:24:41.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:24:41.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.111 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.112 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:41.112 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:41.112 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.626580695999998, 2020-11-12T17:24:41.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:24:41.112 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.113 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.113 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.113 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.113 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.113 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:24:41.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.113 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:41.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:41.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:41.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:24:41.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:24:41.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:24:41.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:24:41.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:24:41.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:24:41.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:24:41.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:24:41.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:24:41.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:24:41.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:24:41.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:24:41.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:41.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:24:41.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:24:41.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:24:41.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:24:41.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:24:41.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:24:41.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:24:41.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:24:41.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:24:41.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:24:41.125 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.126 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.126 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.126 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:41.126 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:41.126 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.484028625999997, 2020-11-12T17:24:41.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:24:41.127 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.127 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.127 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.127 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.127 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.128 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:24:41.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.128 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:41.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:41.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:41.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:24:41.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:24:41.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:24:41.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:24:41.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:24:41.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:24:41.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:24:41.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:24:41.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:24:41.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:24:41.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:24:41.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:24:41.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:41.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:24:41.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:24:41.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:24:41.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:24:41.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:24:41.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:24:41.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:24:41.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:24:41.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:24:41.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:24:41.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.138 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.139 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e48)", 2020-11-12T17:24:41.139 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:41.139 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.407238827999997, 2020-11-12T17:24:41.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998, 2020-11-12T17:24:41.140 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.140 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:24:41.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.140 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:24:41.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.141 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:41.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:41.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:24:41.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676007+0000", 2020-11-12T17:24:41.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110902 2020-11-12T17:24:41.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676118+0000", 2020-11-12T17:24:41.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6195e-05 2020-11-12T17:24:41.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676135+0000", 2020-11-12T17:24:41.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3829999999999998e-06 2020-11-12T17:24:41.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676144+0000", 2020-11-12T17:24:41.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5806000000000001e-05 2020-11-12T17:24:41.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676200+0000", 2020-11-12T17:24:41.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9735999999999999e-05 2020-11-12T17:24:41.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:41.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676259+0000", 2020-11-12T17:24:41.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29976251100000001 2020-11-12T17:24:41.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976022+0000", 2020-11-12T17:24:41.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998 2020-11-12T17:24:41.149 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.149 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.149 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.149 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:33576 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:41.149 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:41.150 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 47.475384179999999, 2020-11-12T17:24:41.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846, 2020-11-12T17:24:41.150 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.150 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:41.151 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:41.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:41.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:41.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607883+0000", 2020-11-12T17:24:41.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0716000000000004e-05 2020-11-12T17:24:41.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607964+0000", 2020-11-12T17:24:41.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28021348200000001 2020-11-12T17:24:41.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888177+0000", 2020-11-12T17:24:41.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0214000000000001e-05 2020-11-12T17:24:41.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888188+0000", 2020-11-12T17:24:41.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0760999999999994e-05 2020-11-12T17:24:41.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888278+0000", 2020-11-12T17:24:41.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0537e-05 2020-11-12T17:24:41.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888299+0000", 2020-11-12T17:24:41.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020659300000000001 2020-11-12T17:24:41.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888505+0000", 2020-11-12T17:24:41.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846 2020-11-12T17:24:41.157 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.157 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.157 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.158 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34328 3.8 3:12eb1396:::benchmark_data_smithi036_14212_object4290:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:41.158 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:41.158 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.526839228999997, 2020-11-12T17:24:41.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999, 2020-11-12T17:24:41.159 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.159 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.159 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34328 2020-11-12T17:24:41.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.160 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:41.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:41.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999542 2020-11-12T17:24:41.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556414+0000", 2020-11-12T17:24:41.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133592 2020-11-12T17:24:41.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556547+0000", 2020-11-12T17:24:41.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8813000000000001e-05 2020-11-12T17:24:41.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556566+0000", 2020-11-12T17:24:41.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7660000000000004e-06 2020-11-12T17:24:41.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556575+0000", 2020-11-12T17:24:41.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011688914999999999 2020-11-12T17:24:41.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568264+0000", 2020-11-12T17:24:41.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108214 2020-11-12T17:24:41.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568372+0000", 2020-11-12T17:24:41.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189846 2020-11-12T17:24:41.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:41.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568562+0000", 2020-11-12T17:24:41.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016740710000000001 2020-11-12T17:24:41.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570236+0000", 2020-11-12T17:24:41.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29321335900000001 2020-11-12T17:24:41.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863449+0000", 2020-11-12T17:24:41.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7244999999999998e-05 2020-11-12T17:24:41.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863507+0000", 2020-11-12T17:24:41.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0704999999999994e-05 2020-11-12T17:24:41.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863587+0000", 2020-11-12T17:24:41.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999 2020-11-12T17:24:41.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.169 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.169 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.169 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34328 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:41.169 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:41.169 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.512482579999997, 2020-11-12T17:24:41.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998, 2020-11-12T17:24:41.170 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.170 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:41.170 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:41.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:41.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:41.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570784+0000", 2020-11-12T17:24:41.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2226999999999997e-05 2020-11-12T17:24:41.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570866+0000", 2020-11-12T17:24:41.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.290361445 2020-11-12T17:24:41.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861228+0000", 2020-11-12T17:24:41.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0240000000000003e-06 2020-11-12T17:24:41.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861237+0000", 2020-11-12T17:24:41.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021956749999999998 2020-11-12T17:24:41.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863432+0000", 2020-11-12T17:24:41.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2940000000000006e-06 2020-11-12T17:24:41.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863441+0000", 2020-11-12T17:24:41.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162399 2020-11-12T17:24:41.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863603+0000", 2020-11-12T17:24:41.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998 2020-11-12T17:24:41.176 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.177 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.177 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:41.177 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:41.177 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.012494717000003, 2020-11-12T17:24:41.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:24:41.178 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.178 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.178 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.178 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.178 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.178 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:24:41.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.179 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:41.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:41.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:24:41.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:24:41.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:24:41.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:24:41.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:24:41.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:24:41.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:24:41.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:24:41.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:24:41.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:24:41.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:24:41.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:24:41.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:24:41.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:41.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:24:41.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:24:41.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:24:41.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:24:41.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:24:41.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:24:41.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:24:41.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:24:41.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:24:41.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:24:41.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.188 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.188 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:41.188 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:41.188 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.997173494999998, 2020-11-12T17:24:41.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:24:41.189 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.189 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:41.189 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:41.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:41.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:24:41.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:24:41.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:24:41.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:24:41.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:24:41.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:24:41.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:24:41.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:24:41.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:24:41.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:24:41.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:24:41.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:24:41.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:24:41.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:24:41.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:24:41.195 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.195 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.195 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.196 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:41.196 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:41.196 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.220323532999998, 2020-11-12T17:24:41.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:24:41.196 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.196 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.196 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.196 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.197 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.197 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:24:41.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.197 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:41.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:41.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:41.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:24:41.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:24:41.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:24:41.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:24:41.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:24:41.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:24:41.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:24:41.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:24:41.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:24:41.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:24:41.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:24:41.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:24:41.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:41.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:24:41.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:24:41.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:24:41.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:24:41.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:24:41.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:24:41.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:24:41.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:24:41.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:24:41.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:24:41.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.206 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.206 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50544 3.8 3:13876818:::benchmark_data_smithi036_14212_object6317:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:41.206 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:41.207 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 28.353698541, 2020-11-12T17:24:41.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998, 2020-11-12T17:24:41.207 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.207 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.207 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.207 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.207 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.207 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50544 2020-11-12T17:24:41.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.208 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:41.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:41.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:24:41.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729570+0000", 2020-11-12T17:24:41.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010924 2020-11-12T17:24:41.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729679+0000", 2020-11-12T17:24:41.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1567e-05 2020-11-12T17:24:41.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729691+0000", 2020-11-12T17:24:41.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0929999999999999e-06 2020-11-12T17:24:41.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729697+0000", 2020-11-12T17:24:41.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086737580000000002 2020-11-12T17:24:41.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738371+0000", 2020-11-12T17:24:41.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7824999999999993e-05 2020-11-12T17:24:41.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738459+0000", 2020-11-12T17:24:41.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017210899999999999 2020-11-12T17:24:41.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:41.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738631+0000", 2020-11-12T17:24:41.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027566969999999998 2020-11-12T17:24:41.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.741387+0000", 2020-11-12T17:24:41.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27686545000000001 2020-11-12T17:24:41.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018253+0000", 2020-11-12T17:24:41.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3428000000000002e-05 2020-11-12T17:24:41.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018336+0000", 2020-11-12T17:24:41.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5240999999999994e-05 2020-11-12T17:24:41.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018402+0000", 2020-11-12T17:24:41.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998 2020-11-12T17:24:41.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.217 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.218 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:50544 3.8 e55/20 ondisk, result = 0)", 2020-11-12T17:24:41.218 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:41.218 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 28.340746106000001, 2020-11-12T17:24:41.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.275860253, 2020-11-12T17:24:41.218 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.218 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:41.219 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:41.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:41.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:24:41.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742526+0000", 2020-11-12T17:24:41.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6210999999999993e-05 2020-11-12T17:24:41.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742592+0000", 2020-11-12T17:24:41.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27212335799999998 2020-11-12T17:24:41.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.014715+0000", 2020-11-12T17:24:41.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3250000000000001e-06 2020-11-12T17:24:41.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.014720+0000", 2020-11-12T17:24:41.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035069239999999998 2020-11-12T17:24:41.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018227+0000", 2020-11-12T17:24:41.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3804e-05 2020-11-12T17:24:41.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018241+0000", 2020-11-12T17:24:41.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017238900000000001 2020-11-12T17:24:41.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018413+0000", 2020-11-12T17:24:41.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.275860253 2020-11-12T17:24:41.224 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.225 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.225 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.225 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:41.225 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:24:41.225 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.263876691, 2020-11-12T17:24:41.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:24:41.226 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.226 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.226 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:24:41.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.227 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:24:41.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:24:41.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:24:41.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:24:41.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:24:41.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:24:41.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:24:41.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:24:41.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:24:41.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:24:41.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:24:41.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:24:41.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:24:41.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:24:41.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:24:41.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:41.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:24:41.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:24:41.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:24:41.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:24:41.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:24:41.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:24:41.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:24:41.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:24:41.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:24:41.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:24:41.236 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.236 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.236 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.236 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:24:41.236 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:24:41.236 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.134943206999999, 2020-11-12T17:24:41.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:24:41.237 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.237 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.237 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:24:41.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:24:41.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:24:41.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:24:41.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:24:41.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:24:41.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:24:41.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:24:41.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:24:41.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:24:41.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:24:41.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:24:41.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:24:41.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:24:41.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:24:41.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:24:41.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:24:41.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:24:41.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:24:41.243 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.244 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.244 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.244 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:41.244 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:24:41.244 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.362924921000001, 2020-11-12T17:24:41.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:24:41.245 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.245 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.245 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.245 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.245 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.245 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:24:41.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:24:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:24:41.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:41.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:24:41.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:24:41.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:24:41.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:24:41.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:24:41.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:24:41.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:24:41.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:24:41.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:24:41.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:24:41.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:24:41.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:24:41.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:41.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:24:41.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:24:41.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:24:41.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:24:41.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:24:41.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:24:41.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:24:41.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:24:41.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:24:41.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:24:41.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.255 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.256 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:41.256 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:24:41.256 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 17.440804932999999, 2020-11-12T17:24:41.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:24:41.256 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.256 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.256 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.257 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.257 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.257 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:24:41.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.257 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:24:41.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:24:41.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:41.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:24:41.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:24:41.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:24:41.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:24:41.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:24:41.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:24:41.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:24:41.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:24:41.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:24:41.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:24:41.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:24:41.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:24:41.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:41.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:24:41.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:24:41.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:24:41.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:24:41.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:24:41.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:24:41.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:24:41.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:24:41.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:24:41.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:24:41.266 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.266 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.267 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.267 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:59416 3.c e57/20 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head v 57'3976, mlcod=57'3970)", 2020-11-12T17:24:41.267 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:24:41.267 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.550465368000001, 2020-11-12T17:24:41.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998, 2020-11-12T17:24:41.267 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.268 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.268 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:24:41.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:24:41.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:41.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532795+0000", 2020-11-12T17:24:41.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014490099999999999 2020-11-12T17:24:41.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532940+0000", 2020-11-12T17:24:41.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29738320899999998 2020-11-12T17:24:41.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830323+0000", 2020-11-12T17:24:41.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3199999999999996e-06 2020-11-12T17:24:41.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830330+0000", 2020-11-12T17:24:41.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9622999999999994e-05 2020-11-12T17:24:41.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830399+0000", 2020-11-12T17:24:41.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4766999999999999e-05 2020-11-12T17:24:41.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830424+0000", 2020-11-12T17:24:41.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038976610000000002 2020-11-12T17:24:41.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834322+0000", 2020-11-12T17:24:41.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7682999999999994e-05 2020-11-12T17:24:41.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834410+0000", 2020-11-12T17:24:41.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998 2020-11-12T17:24:41.275 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.275 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.275 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.275 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:60400 3.b 3:d9185304:::benchmark_data_smithi036_14212_object7549:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:41.275 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:24:41.276 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.269471656, 2020-11-12T17:24:41.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002, 2020-11-12T17:24:41.276 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.276 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:41.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:41.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:41.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.277 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60400 2020-11-12T17:24:41.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.277 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:24:41.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:24:41.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:24:41.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813806+0000", 2020-11-12T17:24:41.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0312999999999997e-05 2020-11-12T17:24:41.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813866+0000", 2020-11-12T17:24:41.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5310000000000007e-06 2020-11-12T17:24:41.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813875+0000", 2020-11-12T17:24:41.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9999999999999999e-06 2020-11-12T17:24:41.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813882+0000", 2020-11-12T17:24:41.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045585469999999996 2020-11-12T17:24:41.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818441+0000", 2020-11-12T17:24:41.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025338699999999999 2020-11-12T17:24:41.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818694+0000", 2020-11-12T17:24:41.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192215 2020-11-12T17:24:41.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:41.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818887+0000", 2020-11-12T17:24:41.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019573659999999999 2020-11-12T17:24:41.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:41.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.820844+0000", 2020-11-12T17:24:41.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27823403299999999 2020-11-12T17:24:41.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:41.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099078+0000", 2020-11-12T17:24:41.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8301000000000003e-05 2020-11-12T17:24:41.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:41.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099136+0000", 2020-11-12T17:24:41.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4981000000000003e-05 2020-11-12T17:24:41.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099171+0000", 2020-11-12T17:24:41.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002 2020-11-12T17:24:41.285 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.286 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.286 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:60400 3.b e57/20 ondisk, result = 0)", 2020-11-12T17:24:41.287 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:24:41.287 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.260026387, 2020-11-12T17:24:41.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166, 2020-11-12T17:24:41.287 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:41.287 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:41.287 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:41.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:41.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:24:41.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:41.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:41.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:24:41.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:41.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:41.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823242+0000", 2020-11-12T17:24:41.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9956000000000005e-05 2020-11-12T17:24:41.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:41.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823322+0000", 2020-11-12T17:24:41.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.270552615 2020-11-12T17:24:41.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:41.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093875+0000", 2020-11-12T17:24:41.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2374e-05 2020-11-12T17:24:41.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093887+0000", 2020-11-12T17:24:41.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051711070000000003 2020-11-12T17:24:41.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:41.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099058+0000", 2020-11-12T17:24:41.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0665e-05 2020-11-12T17:24:41.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:41.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099069+0000", 2020-11-12T17:24:41.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000115362 2020-11-12T17:24:41.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:41.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:41.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:41.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099184+0000", 2020-11-12T17:24:41.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166 2020-11-12T17:24:41.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.293 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.294 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:41.294 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:41.294 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:41.295 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:41.290+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:41.296 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:41.396 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:41.392+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:41.440 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:41.441 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:41.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.441 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:71297 3.3 3:cc27ad38:::benchmark_data_smithi036_14212_object6375:head [delete] snapc 0=[] ondisk+write+known_if_redirected e64)", 2020-11-12T17:24:41.441 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:41.434200+0000", 2020-11-12T17:24:41.441 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0062019340000000001, 2020-11-12T17:24:41.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062311279999999998, 2020-11-12T17:24:41.441 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:41.442 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:41.442 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:41.442 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:41.442 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.442 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71297 2020-11-12T17:24:41.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.442 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:41.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:41.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.434200+0000", 2020-11-12T17:24:41.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:41.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:41.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.434200+0000", 2020-11-12T17:24:41.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:24:41.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:41.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.434182+0000", 2020-11-12T17:24:41.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8331999999999997e-05 2020-11-12T17:24:41.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:41.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.434231+0000", 2020-11-12T17:24:41.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4215e-05 2020-11-12T17:24:41.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:41.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.434245+0000", 2020-11-12T17:24:41.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3869999999999997e-06 2020-11-12T17:24:41.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.434252+0000", 2020-11-12T17:24:41.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:24:41.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:41.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.434297+0000", 2020-11-12T17:24:41.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015995899999999999 2020-11-12T17:24:41.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:41.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.434457+0000", 2020-11-12T17:24:41.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013174199999999999 2020-11-12T17:24:41.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:41.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.434589+0000", 2020-11-12T17:24:41.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037773680000000001 2020-11-12T17:24:41.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:41.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.438366+0000", 2020-11-12T17:24:41.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041653929999999999 2020-11-12T17:24:41.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:41.449 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:41.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:41.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.451 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:71288 3.6 e64/59 3:6daf43ce:::benchmark_data_smithi036_14212_object6366:head v 64'4652, mlcod=64'4650)", 2020-11-12T17:24:41.451 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:41.427565+0000", 2020-11-12T17:24:41.451 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.012837104, 2020-11-12T17:24:41.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013096926, 2020-11-12T17:24:41.451 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:41.451 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:41.451 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:41.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:41.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.427565+0000", 2020-11-12T17:24:41.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:41.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:41.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.427565+0000", 2020-11-12T17:24:41.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999776 2020-11-12T17:24:41.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:41.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.427543+0000", 2020-11-12T17:24:41.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8575e-05 2020-11-12T17:24:41.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:41.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.427612+0000", 2020-11-12T17:24:41.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012650804999999999 2020-11-12T17:24:41.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:41.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.440262+0000", 2020-11-12T17:24:41.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2710000000000001e-06 2020-11-12T17:24:41.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.440266+0000", 2020-11-12T17:24:41.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3958000000000002e-05 2020-11-12T17:24:41.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:41.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.440310+0000", 2020-11-12T17:24:41.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0630000000000003e-05 2020-11-12T17:24:41.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:41.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.440340+0000", 2020-11-12T17:24:41.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012775013999999999 2020-11-12T17:24:41.457 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:41.457 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:41.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:41.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.458 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:71294 3.9 3:9e0d65e3:::benchmark_data_smithi036_14212_object6372:head [delete] snapc 0=[] ondisk+write+known_if_redirected e64)", 2020-11-12T17:24:41.458 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:41.429626+0000", 2020-11-12T17:24:41.458 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.010776446, 2020-11-12T17:24:41.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011105155, 2020-11-12T17:24:41.458 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:41.459 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:41.459 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:41.459 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:41.459 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:41.459 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71294 2020-11-12T17:24:41.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.459 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:41.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:41.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.429626+0000", 2020-11-12T17:24:41.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:41.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:41.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.429626+0000", 2020-11-12T17:24:41.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:41.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:41.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.429597+0000", 2020-11-12T17:24:41.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000004e-05 2020-11-12T17:24:41.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:41.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.429662+0000", 2020-11-12T17:24:41.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1936999999999999e-05 2020-11-12T17:24:41.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:41.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.429674+0000", 2020-11-12T17:24:41.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8039999999999998e-06 2020-11-12T17:24:41.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:41.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.429680+0000", 2020-11-12T17:24:41.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033792779999999999 2020-11-12T17:24:41.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:41.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.433059+0000", 2020-11-12T17:24:41.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166491 2020-11-12T17:24:41.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:41.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.433226+0000", 2020-11-12T17:24:41.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139827 2020-11-12T17:24:41.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:41.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.433366+0000", 2020-11-12T17:24:41.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043187030000000001 2020-11-12T17:24:41.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:41.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:41.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:41.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:41.437684+0000", 2020-11-12T17:24:41.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080584109999999997 2020-11-12T17:24:41.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:41.466 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:41.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:41.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:41.467 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:24:41.467 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 3 2020-11-12T17:24:41.467 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:41.468 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:41.496 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:41.492+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:41.499 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:24:41.598 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:41.594+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:41.608 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:41.608 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:41.609 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:41.609 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:41.609 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:41.622 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:41.674 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:41.699 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:41.692+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:41.704 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:41.745 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:41.751 INFO:teuthology.orchestra.run.smithi036.stderr:Nothing to do for non-filestore backend 2020-11-12T17:24:41.778 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:41.800 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:41.794+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:41.809 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:41.810 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:41.812 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:41.834 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:41.852 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:41.886 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:41.886 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:24:41.887 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:41.887 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:41.887 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:24:41.887 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:24:41.887 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:24:41.887 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:24:41.887 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:24:41.888 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:24:41.891 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:41.891 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:41.919 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:41.914+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:42.003 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:41.996+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:42.018 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:42.019 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:42.030 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:42.104 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:42.100+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:42.205 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:42.200+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:42.217 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:42.217 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:42.231 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:42.306 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:42.302+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:42.317 INFO:teuthology.orchestra.run.smithi036:> CEPH_ARGS='--filestore-merge-threshold 1 --filestore-split-multiple 1' sudo -E ceph-objectstore-tool --no-mon-config --log-file=/var/log/ceph/objectstore_tool.$pid.log --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op apply-layout-settings --pool rbd 2020-11-12T17:24:42.374 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:42.375 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:42.388 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:42.414 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:42.408+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:42.515 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:42.510+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:42.594 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:42.595 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:42.607 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:42.615 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:42.608+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:42.716 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:42.710+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:42.785 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:24:42.788 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:42.788 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:42.804 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:42.849 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:42.846+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:42.919 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:42.912+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:42.985 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:42.985 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:42.999 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:43.045 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:43.042+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:43.113 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:43.114 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:43.121 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:43.118+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:43.123 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:43.224 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:43.218+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:43.274 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:43.274 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:43.283 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:43.325 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:43.322+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:43.426 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:43.422+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:43.435 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:43.435 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:43.445 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:43.515 INFO:teuthology.orchestra.run.smithi036.stderr:Nothing to do for non-filestore backend 2020-11-12T17:24:43.527 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:43.522+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:43.563 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:43.564 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:43.573 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:43.628 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:43.626+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:43.678 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:43.679 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:43.688 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:43.729 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:43.726+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:43.749 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Removed 8115 objects 2020-11-12T17:24:43.750 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Clean up completed and total clean up time :8.17029 2020-11-12T17:24:43.802 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:24:43.804 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:43.804 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:43.818 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:24:43.831 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:43.826+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:43.854 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:43.848+0000 7f6583748700 -1 osd.0 64 handle_osd_map injecting map crc failure 2020-11-12T17:24:43.854 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:43.850+0000 7f2809aaf700 -1 osd.6 64 handle_osd_map injecting map crc failure 2020-11-12T17:24:43.893 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:24:43.924 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:43.926 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:43.933 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:43.930+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:43.935 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:24:44.034 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:44.030+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:44.050 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:44.062 INFO:teuthology.orchestra.run.smithi036:> CEPH_ARGS='--filestore-merge-threshold 1 --filestore-split-multiple 1' sudo -E ceph-objectstore-tool --no-mon-config --log-file=/var/log/ceph/objectstore_tool.$pid.log --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op apply-layout-settings --pool unique_pool_0 2020-11-12T17:24:44.083 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:44.087 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:44.088 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:44.097 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:24:44.114 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:44.135 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:44.130+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:44.149 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:44.189 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:44.216 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:24:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:24:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.552951878000002, 2020-11-12T17:24:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:24:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:24:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:24:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:24:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:24:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:24:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:24:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:24:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:24:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:24:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:24:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:24:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:24:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:24:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:24:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:24:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:24:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:24:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:24:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:24:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:24:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.552045082999996, 2020-11-12T17:24:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:24:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:24:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:24:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:24:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:24:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:24:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:24:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:24:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:24:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:24:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:24:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:24:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:24:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:24:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:24:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:24:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:24:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:24:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:24:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:24:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:24:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:24:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.551342860000005, 2020-11-12T17:24:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:24:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:24:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:24:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:24:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:24:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:24:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:24:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:24:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:24:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:24:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:24:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:24:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:24:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:24:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:24:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:24:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:24:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:24:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:24:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:24:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:24:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.546836663999997, 2020-11-12T17:24:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:24:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:24:44.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:24:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:24:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:24:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:24:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:24:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:24:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:24:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:24:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:24:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:24:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:24:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:24:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:24:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:24:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:24:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:24:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:24:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:24:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:24:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.043295682999997, 2020-11-12T17:24:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:24:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:24:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:24:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:24:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:24:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:24:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:24:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:24:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:24:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:24:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:24:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:24:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:24:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:24:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:24:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:24:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:24:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:24:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:24:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:24:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:24:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:24:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.042369441999995, 2020-11-12T17:24:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:24:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:24:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:24:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:24:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:24:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:24:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:24:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:24:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:24:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:24:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:24:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:24:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:24:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:24:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:24:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:24:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:24:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:24:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:24:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:24:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:24:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:24:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.040021932000002, 2020-11-12T17:24:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:24:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:24:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:24:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:24:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:24:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:24:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:24:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:24:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:24:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:24:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:24:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:24:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:24:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:24:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:24:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:24:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:24:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:24:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:24:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:24:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:24:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:24:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.039257140000004, 2020-11-12T17:24:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:24:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:24:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:24:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:24:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:24:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:24:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:24:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:24:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:24:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:24:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:24:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:24:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:24:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:24:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:24:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:24:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:24:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:24:44.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:24:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:24:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.287 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:24:44.287 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:24:44.287 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 97.957030661999994, 2020-11-12T17:24:44.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:24:44.287 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.288 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.288 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:24:44.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:24:44.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:44.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:24:44.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:24:44.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:24:44.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:24:44.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:24:44.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:24:44.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:24:44.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:24:44.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:24:44.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:24:44.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:24:44.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:24:44.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:24:44.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:24:44.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:24:44.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:24:44.295 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.295 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.295 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.296 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:24:44.296 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:24:44.296 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.364917229, 2020-11-12T17:24:44.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:24:44.296 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.297 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.297 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:24:44.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:24:44.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:24:44.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:24:44.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:24:44.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:24:44.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:24:44.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:24:44.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:24:44.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:24:44.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:24:44.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:24:44.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:24:44.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:24:44.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:24:44.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:24:44.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:24:44.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:24:44.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:24:44.305 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.305 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.305 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.306 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:24:44.306 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:24:44.306 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.336256931999998, 2020-11-12T17:24:44.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:24:44.306 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.306 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.307 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:24:44.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:24:44.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:44.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:24:44.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:24:44.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:24:44.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:24:44.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:24:44.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:24:44.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:24:44.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:24:44.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:24:44.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:24:44.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:24:44.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:24:44.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:24:44.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:24:44.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:24:44.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:24:44.315 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.316 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.316 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.316 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:24:44.316 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:24:44.316 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.423660221000006, 2020-11-12T17:24:44.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:24:44.317 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.317 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.317 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:24:44.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:24:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:24:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:24:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:24:44.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:24:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:24:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:24:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:24:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:24:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:24:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:24:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:24:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:24:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:24:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:24:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:24:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:24:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:24:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:24:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:24:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.352520577000007, 2020-11-12T17:24:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:24:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:24:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:24:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:24:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:24:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:24:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:24:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:24:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:24:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:24:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:24:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:24:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:24:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:24:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:24:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:24:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:24:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:24:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:24:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:24:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:24:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.243133286000003, 2020-11-12T17:24:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:24:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:24:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:24:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:24:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:24:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:24:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:24:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:24:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:24:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:24:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:24:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:24:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:24:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:24:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:24:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:24:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:24:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:24:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:24:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:24:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:24:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:24:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.172597447000001, 2020-11-12T17:24:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:24:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:24:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:24:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:24:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:24:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:24:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:24:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:24:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:24:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:24:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:24:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:24:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:24:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:24:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:24:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:24:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:24:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:24:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:24:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:24:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:24:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.003231509000003, 2020-11-12T17:24:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:24:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:24:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:24:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:24:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:24:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:24:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:24:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:24:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:24:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:24:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:24:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:24:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:24:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:24:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:24:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:24:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:24:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:24:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:24:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:24:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:24:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:24:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.674605636999999, 2020-11-12T17:24:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:24:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:24:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:24:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:24:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:24:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:24:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:24:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:24:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:24:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:24:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:24:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:24:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:24:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:24:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:24:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:24:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:24:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:24:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:24:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:24:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:24:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:24:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.018142275000002, 2020-11-12T17:24:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:24:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:24:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:24:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:24:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:24:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:24:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:24:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:24:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:24:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:24:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:24:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:24:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:24:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:24:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:24:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:24:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:24:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:24:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:24:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:24:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:24:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:24:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.015501552000003, 2020-11-12T17:24:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:24:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:24:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:24:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:24:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:24:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:24:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:24:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:24:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:24:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:24:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:24:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:24:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:24:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:24:44.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:24:44.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:24:44.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:24:44.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:24:44.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:24:44.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.397 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.398 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:24:44.398 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:24:44.398 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.531255513000005, 2020-11-12T17:24:44.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:24:44.398 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.399 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:24:44.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:24:44.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:24:44.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:24:44.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:24:44.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:24:44.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:24:44.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:24:44.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:24:44.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:24:44.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:24:44.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:24:44.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:24:44.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:24:44.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:24:44.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:24:44.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:24:44.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:24:44.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:24:44.407 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.407 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.407 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.407 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.407 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.407 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:44.409 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:44.410 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:44.410 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:24:44.410 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:44.410 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:44.410 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:24:44.411 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:24:44.411 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:24:44.411 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:24:44.411 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:24:44.411 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:24:44.412 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:44.412 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:44.412 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:44.406+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:44.413 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:44.510 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:44.506+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:44.567 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:44.567 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:44.568 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:24:44.568 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:44.577 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:44.611 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:44.606+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:44.689 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:44.690 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:44.690 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:44.690 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:44.690 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:44.698 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:44.711 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:44.710+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:44.812 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:44.804+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:44.815 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:44.815 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:44.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:44.815 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:44.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.816 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:44.816 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:44.816 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.393862338000005, 2020-11-12T17:24:44.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:24:44.816 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.816 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:44.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:44.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:44.817 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:24:44.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.817 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:44.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:24:44.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:24:44.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:24:44.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:24:44.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:24:44.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:24:44.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:24:44.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:24:44.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:24:44.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:24:44.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:24:44.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:24:44.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:24:44.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:24:44.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:44.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:24:44.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:24:44.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:44.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:24:44.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:24:44.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:44.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:24:44.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:24:44.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:24:44.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:24:44.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:24:44.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:24:44.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.826 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.827 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:24:44.827 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:44.827 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.386918276000003, 2020-11-12T17:24:44.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:24:44.827 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.827 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:44.827 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:44.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:24:44.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:24:44.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:24:44.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:24:44.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:24:44.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:24:44.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:24:44.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:24:44.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:24:44.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:24:44.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:24:44.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:24:44.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:24:44.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:24:44.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:24:44.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:24:44.834 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.834 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.834 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.835 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:44.835 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:44.835 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 59.355632559999997, 2020-11-12T17:24:44.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:24:44.835 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.835 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.835 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:44.835 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:44.836 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:44.836 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:24:44.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.836 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:44.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:24:44.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:44.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:24:44.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:24:44.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:24:44.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:24:44.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:24:44.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:24:44.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:24:44.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:24:44.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:24:44.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:24:44.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:24:44.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:24:44.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:44.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:24:44.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:24:44.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:44.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:24:44.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:24:44.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:44.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:24:44.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:24:44.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:24:44.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:24:44.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:24:44.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:24:44.848 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.848 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.848 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.848 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:44.849 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:44.849 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.213080490000003, 2020-11-12T17:24:44.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:24:44.849 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.849 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:44.849 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:44.849 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:44.850 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:44.850 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:24:44.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.850 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:44.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:24:44.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:44.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:24:44.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:24:44.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:24:44.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:24:44.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:24:44.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:24:44.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:24:44.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:24:44.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:44.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:24:44.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:24:44.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:44.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:24:44.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:24:44.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:44.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:24:44.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:24:44.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:44.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:24:44.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:24:44.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:44.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:24:44.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:24:44.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:44.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:24:44.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:24:44.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:44.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:24:44.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:24:44.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.860 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:44.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:44.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.861 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e48)", 2020-11-12T17:24:44.861 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:44.861 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.136290692000003, 2020-11-12T17:24:44.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998, 2020-11-12T17:24:44.861 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:44.861 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:24:44.861 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:44.862 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:44.862 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:44.862 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:24:44.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.862 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:44.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:44.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:44.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:44.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:44.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:24:44.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:24:44.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:44.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676007+0000", 2020-11-12T17:24:44.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110902 2020-11-12T17:24:44.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:44.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676118+0000", 2020-11-12T17:24:44.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6195e-05 2020-11-12T17:24:44.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:44.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676135+0000", 2020-11-12T17:24:44.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3829999999999998e-06 2020-11-12T17:24:44.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:44.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676144+0000", 2020-11-12T17:24:44.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5806000000000001e-05 2020-11-12T17:24:44.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:44.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:44.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676200+0000", 2020-11-12T17:24:45.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9735999999999999e-05 2020-11-12T17:24:45.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:45.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676259+0000", 2020-11-12T17:24:45.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29976251100000001 2020-11-12T17:24:45.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976022+0000", 2020-11-12T17:24:45.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998 2020-11-12T17:24:45.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.111 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.112 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:33576 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:45.112 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:45.112 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 51.204436043999998, 2020-11-12T17:24:45.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846, 2020-11-12T17:24:45.112 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.112 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:45.112 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:45.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:24:45.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:24:45.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607883+0000", 2020-11-12T17:24:45.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0716000000000004e-05 2020-11-12T17:24:45.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607964+0000", 2020-11-12T17:24:45.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28021348200000001 2020-11-12T17:24:45.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888177+0000", 2020-11-12T17:24:45.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0214000000000001e-05 2020-11-12T17:24:45.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888188+0000", 2020-11-12T17:24:45.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0760999999999994e-05 2020-11-12T17:24:45.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888278+0000", 2020-11-12T17:24:45.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0537e-05 2020-11-12T17:24:45.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888299+0000", 2020-11-12T17:24:45.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020659300000000001 2020-11-12T17:24:45.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888505+0000", 2020-11-12T17:24:45.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846 2020-11-12T17:24:45.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.119 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.119 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34328 3.8 3:12eb1396:::benchmark_data_smithi036_14212_object4290:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:45.120 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:45.120 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.255891093000002, 2020-11-12T17:24:45.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999, 2020-11-12T17:24:45.120 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.120 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.120 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:45.120 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:45.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.121 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34328 2020-11-12T17:24:45.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.121 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:45.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:24:45.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999542 2020-11-12T17:24:45.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556414+0000", 2020-11-12T17:24:45.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133592 2020-11-12T17:24:45.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556547+0000", 2020-11-12T17:24:45.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8813000000000001e-05 2020-11-12T17:24:45.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556566+0000", 2020-11-12T17:24:45.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7660000000000004e-06 2020-11-12T17:24:45.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556575+0000", 2020-11-12T17:24:45.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011688914999999999 2020-11-12T17:24:45.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568264+0000", 2020-11-12T17:24:45.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108214 2020-11-12T17:24:45.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568372+0000", 2020-11-12T17:24:45.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189846 2020-11-12T17:24:45.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:45.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568562+0000", 2020-11-12T17:24:45.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016740710000000001 2020-11-12T17:24:45.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:45.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570236+0000", 2020-11-12T17:24:45.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29321335900000001 2020-11-12T17:24:45.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863449+0000", 2020-11-12T17:24:45.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7244999999999998e-05 2020-11-12T17:24:45.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863507+0000", 2020-11-12T17:24:45.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0704999999999994e-05 2020-11-12T17:24:45.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863587+0000", 2020-11-12T17:24:45.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999 2020-11-12T17:24:45.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.130 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.131 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34328 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:45.131 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:45.131 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.241534444000003, 2020-11-12T17:24:45.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998, 2020-11-12T17:24:45.131 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.131 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:45.132 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:45.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:24:45.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:45.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570784+0000", 2020-11-12T17:24:45.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2226999999999997e-05 2020-11-12T17:24:45.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570866+0000", 2020-11-12T17:24:45.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.290361445 2020-11-12T17:24:45.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861228+0000", 2020-11-12T17:24:45.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0240000000000003e-06 2020-11-12T17:24:45.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861237+0000", 2020-11-12T17:24:45.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021956749999999998 2020-11-12T17:24:45.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863432+0000", 2020-11-12T17:24:45.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2940000000000006e-06 2020-11-12T17:24:45.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863441+0000", 2020-11-12T17:24:45.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162399 2020-11-12T17:24:45.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863603+0000", 2020-11-12T17:24:45.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998 2020-11-12T17:24:45.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.138 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.139 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:45.139 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:45.139 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.741546581000001, 2020-11-12T17:24:45.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:24:45.139 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.139 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:45.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:45.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.140 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:24:45.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.140 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:45.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:24:45.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:24:45.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:24:45.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:24:45.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:24:45.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:24:45.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:24:45.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:24:45.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:24:45.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:24:45.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:24:45.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:24:45.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:24:45.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:24:45.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:45.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:24:45.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:24:45.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:45.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:24:45.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:24:45.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:24:45.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:24:45.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:24:45.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:24:45.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:24:45.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:24:45.151 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.151 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.151 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.152 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:24:45.152 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:45.152 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.726225358999997, 2020-11-12T17:24:45.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:24:45.152 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.153 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:45.153 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:45.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:24:45.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:24:45.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:24:45.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:24:45.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:24:45.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:24:45.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:24:45.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:24:45.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:24:45.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:24:45.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:24:45.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:24:45.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:24:45.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:24:45.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:24:45.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:24:45.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.159 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.160 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:45.160 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:45.160 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 37.949375396999997, 2020-11-12T17:24:45.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:24:45.160 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.161 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.161 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:45.161 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:45.161 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.161 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:24:45.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.161 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:45.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:24:45.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:45.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:24:45.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:24:45.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:24:45.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:24:45.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:24:45.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:24:45.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:24:45.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:24:45.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:24:45.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:24:45.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:24:45.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:24:45.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:45.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:24:45.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:24:45.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:45.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:24:45.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:24:45.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:24:45.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:24:45.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:24:45.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:24:45.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:24:45.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:24:45.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.180 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50544 3.8 3:13876818:::benchmark_data_smithi036_14212_object6317:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:45.180 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:45.181 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 32.082750404999999, 2020-11-12T17:24:45.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998, 2020-11-12T17:24:45.181 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.181 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.181 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:45.181 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:45.181 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.182 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50544 2020-11-12T17:24:45.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.182 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:45.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:24:45.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:24:45.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729570+0000", 2020-11-12T17:24:45.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010924 2020-11-12T17:24:45.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729679+0000", 2020-11-12T17:24:45.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1567e-05 2020-11-12T17:24:45.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729691+0000", 2020-11-12T17:24:45.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0929999999999999e-06 2020-11-12T17:24:45.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729697+0000", 2020-11-12T17:24:45.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086737580000000002 2020-11-12T17:24:45.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738371+0000", 2020-11-12T17:24:45.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7824999999999993e-05 2020-11-12T17:24:45.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738459+0000", 2020-11-12T17:24:45.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017210899999999999 2020-11-12T17:24:45.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:45.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738631+0000", 2020-11-12T17:24:45.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027566969999999998 2020-11-12T17:24:45.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:45.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.741387+0000", 2020-11-12T17:24:45.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27686545000000001 2020-11-12T17:24:45.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018253+0000", 2020-11-12T17:24:45.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3428000000000002e-05 2020-11-12T17:24:45.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018336+0000", 2020-11-12T17:24:45.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5240999999999994e-05 2020-11-12T17:24:45.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018402+0000", 2020-11-12T17:24:45.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998 2020-11-12T17:24:45.192 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.192 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.192 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.192 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:50544 3.8 e55/20 ondisk, result = 0)", 2020-11-12T17:24:45.192 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:45.193 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 32.069797970000003, 2020-11-12T17:24:45.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.275860253, 2020-11-12T17:24:45.193 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.193 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:45.193 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:45.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742553+0000", 2020-11-12T17:24:45.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:24:45.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742526+0000", 2020-11-12T17:24:45.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6210999999999993e-05 2020-11-12T17:24:45.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.742592+0000", 2020-11-12T17:24:45.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27212335799999998 2020-11-12T17:24:45.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.014715+0000", 2020-11-12T17:24:45.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3250000000000001e-06 2020-11-12T17:24:45.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.014720+0000", 2020-11-12T17:24:45.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035069239999999998 2020-11-12T17:24:45.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018227+0000", 2020-11-12T17:24:45.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3804e-05 2020-11-12T17:24:45.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018241+0000", 2020-11-12T17:24:45.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017238900000000001 2020-11-12T17:24:45.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018413+0000", 2020-11-12T17:24:45.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.275860253 2020-11-12T17:24:45.200 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.200 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.201 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.201 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:45.201 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:24:45.202 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 22.992928554999999, 2020-11-12T17:24:45.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:24:45.202 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.202 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.202 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:45.202 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:45.202 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.203 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:24:45.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.203 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:24:45.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:24:45.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:24:45.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:24:45.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:24:45.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:24:45.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:24:45.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:24:45.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:24:45.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:24:45.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:24:45.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:24:45.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:24:45.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:24:45.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:24:45.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:45.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:24:45.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:24:45.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:45.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:24:45.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:24:45.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:24:45.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:24:45.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:24:45.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:24:45.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:24:45.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:24:45.212 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.213 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.213 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:24:45.213 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:24:45.213 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 22.863995071000002, 2020-11-12T17:24:45.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:24:45.214 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.214 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.214 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:24:45.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:24:45.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:24:45.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:24:45.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:24:45.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:24:45.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:24:45.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:24:45.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:24:45.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:24:45.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:24:45.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:24:45.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:24:45.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:24:45.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:24:45.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:24:45.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:24:45.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:24:45.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:24:45.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.227 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.228 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:45.228 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:24:45.228 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 22.091976785, 2020-11-12T17:24:45.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:24:45.228 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.228 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.229 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:45.229 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:45.229 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.229 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:24:45.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.229 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:24:45.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:24:45.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:45.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:24:45.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:24:45.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:24:45.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:24:45.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:24:45.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:24:45.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:24:45.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:24:45.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:24:45.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:24:45.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:24:45.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:24:45.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:45.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:24:45.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:24:45.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:45.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:24:45.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:24:45.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:24:45.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:24:45.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:24:45.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:24:45.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:24:45.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:24:45.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.238 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.239 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:45.239 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:24:45.239 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 21.169856797000001, 2020-11-12T17:24:45.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:24:45.239 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.239 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.239 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:45.240 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:45.240 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.240 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:24:45.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.240 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:24:45.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:24:45.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:45.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:24:45.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:24:45.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:24:45.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:24:45.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:24:45.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:24:45.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:24:45.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:24:45.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:24:45.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:24:45.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:24:45.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:24:45.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:45.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:24:45.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:24:45.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:45.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:24:45.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:24:45.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:24:45.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:24:45.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:24:45.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:24:45.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:24:45.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:24:45.249 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.249 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.250 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.250 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:59416 3.c e57/20 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head v 57'3976, mlcod=57'3970)", 2020-11-12T17:24:45.250 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:24:45.250 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.279517232, 2020-11-12T17:24:45.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998, 2020-11-12T17:24:45.251 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.251 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.251 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:24:45.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:24:45.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:45.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532795+0000", 2020-11-12T17:24:45.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014490099999999999 2020-11-12T17:24:45.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532940+0000", 2020-11-12T17:24:45.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29738320899999998 2020-11-12T17:24:45.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830323+0000", 2020-11-12T17:24:45.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3199999999999996e-06 2020-11-12T17:24:45.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830330+0000", 2020-11-12T17:24:45.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9622999999999994e-05 2020-11-12T17:24:45.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830399+0000", 2020-11-12T17:24:45.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4766999999999999e-05 2020-11-12T17:24:45.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830424+0000", 2020-11-12T17:24:45.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038976610000000002 2020-11-12T17:24:45.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834322+0000", 2020-11-12T17:24:45.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7682999999999994e-05 2020-11-12T17:24:45.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834410+0000", 2020-11-12T17:24:45.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998 2020-11-12T17:24:45.258 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.259 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.259 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.259 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:60400 3.b 3:d9185304:::benchmark_data_smithi036_14212_object7549:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:45.259 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:24:45.260 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.998523519999999, 2020-11-12T17:24:45.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002, 2020-11-12T17:24:45.260 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.260 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.260 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:45.260 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:45.260 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.261 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60400 2020-11-12T17:24:45.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.261 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:24:45.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:24:45.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:24:45.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813806+0000", 2020-11-12T17:24:45.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0312999999999997e-05 2020-11-12T17:24:45.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813866+0000", 2020-11-12T17:24:45.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5310000000000007e-06 2020-11-12T17:24:45.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813875+0000", 2020-11-12T17:24:45.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9999999999999999e-06 2020-11-12T17:24:45.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813882+0000", 2020-11-12T17:24:45.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045585469999999996 2020-11-12T17:24:45.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818441+0000", 2020-11-12T17:24:45.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025338699999999999 2020-11-12T17:24:45.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818694+0000", 2020-11-12T17:24:45.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192215 2020-11-12T17:24:45.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:45.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818887+0000", 2020-11-12T17:24:45.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019573659999999999 2020-11-12T17:24:45.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:45.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.820844+0000", 2020-11-12T17:24:45.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27823403299999999 2020-11-12T17:24:45.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099078+0000", 2020-11-12T17:24:45.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8301000000000003e-05 2020-11-12T17:24:45.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:45.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099136+0000", 2020-11-12T17:24:45.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4981000000000003e-05 2020-11-12T17:24:45.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099171+0000", 2020-11-12T17:24:45.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002 2020-11-12T17:24:45.270 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.270 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.270 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.271 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:60400 3.b e57/20 ondisk, result = 0)", 2020-11-12T17:24:45.271 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:24:45.271 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.989078250999999, 2020-11-12T17:24:45.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166, 2020-11-12T17:24:45.271 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:45.271 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:45.271 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:45.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:45.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:24:45.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:45.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:45.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:24:45.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:45.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:45.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823242+0000", 2020-11-12T17:24:45.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9956000000000005e-05 2020-11-12T17:24:45.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:45.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823322+0000", 2020-11-12T17:24:45.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.270552615 2020-11-12T17:24:45.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:45.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093875+0000", 2020-11-12T17:24:45.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2374e-05 2020-11-12T17:24:45.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093887+0000", 2020-11-12T17:24:45.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051711070000000003 2020-11-12T17:24:45.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:45.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099058+0000", 2020-11-12T17:24:45.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0665e-05 2020-11-12T17:24:45.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:45.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099069+0000", 2020-11-12T17:24:45.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000115362 2020-11-12T17:24:45.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:45.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:45.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:45.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099184+0000", 2020-11-12T17:24:45.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166 2020-11-12T17:24:45.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.277 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:45.278 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:45.278 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:45.279 INFO:teuthology.orchestra.run.smithi036.stderr:Nothing to do for non-filestore backend 2020-11-12T17:24:45.280 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:45.281 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:45.274+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:45.380 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:45.378+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:45.395 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:45.396 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:45.396 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:24:45.396 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:45.405 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:45.482 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:45.476+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:45.566 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:45.566 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:45.566 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:45.567 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:45.567 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:45.574 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:45.625 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:45.618+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:45.685 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:45.680+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:45.689 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:45.689 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:45.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:45.689 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:45.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.690 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:24:45.690 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:45.690 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.92764276299999, 2020-11-12T17:24:45.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:24:45.690 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.690 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.691 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:45.691 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:45.691 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.691 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:24:45.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.691 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:45.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:45.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:24:45.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:24:45.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:24:45.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:24:45.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:24:45.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:24:45.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:24:45.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:24:45.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:24:45.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:24:45.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:24:45.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:24:45.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:24:45.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:45.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:24:45.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:24:45.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:45.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:24:45.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:24:45.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:24:45.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:24:45.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:24:45.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:24:45.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:24:45.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:24:45.711 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.711 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.711 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.711 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:24:45.711 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:45.712 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.920843912, 2020-11-12T17:24:45.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:24:45.712 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.712 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:45.712 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:45.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:45.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:24:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:24:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:24:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:24:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:24:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:24:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:24:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:24:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:24:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:24:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:24:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:24:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:24:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:24:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1104 3.9 3:9f55e211:::benchmark_data_smithi036_14212_object137:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:24:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.069049561, 2020-11-12T17:24:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001, 2020-11-12T17:24:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1104 2020-11-12T17:24:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617385+0000", 2020-11-12T17:24:45.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9141999999999994e-05 2020-11-12T17:24:45.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617484+0000", 2020-11-12T17:24:45.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2413e-05 2020-11-12T17:24:45.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617497+0000", 2020-11-12T17:24:45.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1659999999999999e-06 2020-11-12T17:24:45.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617503+0000", 2020-11-12T17:24:45.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032791000000000001 2020-11-12T17:24:45.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620782+0000", 2020-11-12T17:24:45.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102198 2020-11-12T17:24:45.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620884+0000", 2020-11-12T17:24:45.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114058 2020-11-12T17:24:45.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:45.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620998+0000", 2020-11-12T17:24:45.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018203270000000001 2020-11-12T17:24:45.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:45.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622818+0000", 2020-11-12T17:24:45.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.203924995 2020-11-12T17:24:45.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826743+0000", 2020-11-12T17:24:45.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012106 2020-11-12T17:24:45.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826865+0000", 2020-11-12T17:24:45.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014220699999999999 2020-11-12T17:24:45.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827007+0000", 2020-11-12T17:24:45.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001 2020-11-12T17:24:45.730 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.730 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.730 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:24:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 99.677585136000005, 2020-11-12T17:24:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:24:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:24:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:24:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:24:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:24:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:24:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:24:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:24:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:24:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:24:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:24:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:24:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:24:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:24:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:24:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:24:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:24:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:24:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:24:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:24:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:24:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:24:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:24:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:24:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:24:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 99.670369954999998, 2020-11-12T17:24:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:24:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:24:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:24:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:24:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:24:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:24:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:24:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:24:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:24:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:24:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:24:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:24:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:24:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:24:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:24:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:24:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 94.999925063999996, 2020-11-12T17:24:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:24:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:24:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:24:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:24:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:24:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:24:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:24:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:24:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:24:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:24:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:24:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:24:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:24:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:24:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:24:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:24:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:24:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:24:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:24:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:24:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:24:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:24:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:24:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:24:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.762 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:45.762 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:45.762 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 94.999760160999998, 2020-11-12T17:24:45.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:24:45.762 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.762 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:24:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:24:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:24:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:24:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:24:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:24:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:24:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:24:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:24:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:24:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:24:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:24:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:24:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:24:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:24:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:24:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:24:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:24:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:24:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:24:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:24:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:24:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:24:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:24:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 94.995596926999994, 2020-11-12T17:24:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:24:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:24:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:24:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:24:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:24:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:24:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:24:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:24:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:24:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:24:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:24:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:24:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:24:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:24:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:24:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:24:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.782 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:24:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 94.994280091999997, 2020-11-12T17:24:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:24:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:24:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:24:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:24:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:24:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:24:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:24:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:24:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:24:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:24:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:24:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:24:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:24:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:24:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:24:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:24:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 91.131960460000002, 2020-11-12T17:24:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:24:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:24:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:24:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:24:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:24:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:24:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:24:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:24:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:24:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:24:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:24:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:24:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:24:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:24:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:24:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:24:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:24:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:24:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:24:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 86.804158491999999, 2020-11-12T17:24:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:24:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:24:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:24:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:24:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:24:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:24:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:24:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:24:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:24:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:24:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:24:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:24:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:24:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:24:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:24:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:24:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:24:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:24:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:24:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:24:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:24:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:24:45.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:24:45.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:24:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:24:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:24:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 86.796914783000005, 2020-11-12T17:24:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:24:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:24:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:24:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:24:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:24:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:24:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:24:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:24:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:24:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:24:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:24:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:24:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:24:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:24:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:24:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:24:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 65.634567079999997, 2020-11-12T17:24:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:24:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:24:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:24:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:24:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:24:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:24:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:24:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:24:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:24:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:24:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:24:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:24:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:24:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:24:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:24:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:24:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:24:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:24:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:24:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:24:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:24:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:24:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:24:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:24:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.693739323000003, 2020-11-12T17:24:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:24:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:24:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:24:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:24:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:24:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:24:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:24:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:24:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:24:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:24:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:24:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:24:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:24:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:24:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:24:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:24:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:24:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:24:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:24:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:24:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:24:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:24:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:24:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:24:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:24:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:24:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.686080513999997, 2020-11-12T17:24:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:24:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:24:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:24:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:24:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:24:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:24:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:24:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:24:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:24:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:24:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:24:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:24:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:24:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:24:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:24:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:24:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39832 3.3 3:cb2faec6:::benchmark_data_smithi036_14212_object4978:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:24:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.310306777999998, 2020-11-12T17:24:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.229556766, 2020-11-12T17:24:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39832 2020-11-12T17:24:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:24:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:24:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999251 2020-11-12T17:24:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376091+0000", 2020-11-12T17:24:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018965799999999999 2020-11-12T17:24:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376281+0000", 2020-11-12T17:24:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7319999999999999e-05 2020-11-12T17:24:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376308+0000", 2020-11-12T17:24:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8396000000000001e-05 2020-11-12T17:24:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376327+0000", 2020-11-12T17:24:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006884991 2020-11-12T17:24:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383212+0000", 2020-11-12T17:24:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5163999999999999e-05 2020-11-12T17:24:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383307+0000", 2020-11-12T17:24:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015254400000000001 2020-11-12T17:24:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383459+0000", 2020-11-12T17:24:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041117929999999999 2020-11-12T17:24:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.387571+0000", 2020-11-12T17:24:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21802176100000001 2020-11-12T17:24:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605593+0000", 2020-11-12T17:24:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3146999999999996e-05 2020-11-12T17:24:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605666+0000", 2020-11-12T17:24:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6776e-05 2020-11-12T17:24:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605723+0000", 2020-11-12T17:24:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.229556766 2020-11-12T17:24:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:39832 3.3 e51/20 ondisk, result = 0)", 2020-11-12T17:24:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.386034+0000", 2020-11-12T17:24:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.300439034, 2020-11-12T17:24:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21969730200000001, 2020-11-12T17:24:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.386034+0000", 2020-11-12T17:24:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.386034+0000", 2020-11-12T17:24:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.385992+0000", 2020-11-12T17:24:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101897 2020-11-12T17:24:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.386094+0000", 2020-11-12T17:24:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21941154500000001 2020-11-12T17:24:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605506+0000", 2020-11-12T17:24:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.241e-06 2020-11-12T17:24:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605512+0000", 2020-11-12T17:24:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3314999999999999e-05 2020-11-12T17:24:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605575+0000", 2020-11-12T17:24:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9410000000000002e-06 2020-11-12T17:24:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605585+0000", 2020-11-12T17:24:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014588599999999999 2020-11-12T17:24:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605731+0000", 2020-11-12T17:24:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21969730200000001 2020-11-12T17:24:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:50240 3.1 e55/20 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head v 55'3224, mlcod=55'3218)", 2020-11-12T17:24:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:24:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.319430969000003, 2020-11-12T17:24:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149, 2020-11-12T17:24:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:24:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:24:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:24:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367024+0000", 2020-11-12T17:24:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9963000000000002e-05 2020-11-12T17:24:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367084+0000", 2020-11-12T17:24:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23018651500000001 2020-11-12T17:24:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597271+0000", 2020-11-12T17:24:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2030000000000003e-06 2020-11-12T17:24:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597278+0000", 2020-11-12T17:24:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3430000000000002e-05 2020-11-12T17:24:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597331+0000", 2020-11-12T17:24:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2829000000000001e-05 2020-11-12T17:24:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597354+0000", 2020-11-12T17:24:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064125579999999996 2020-11-12T17:24:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603767+0000", 2020-11-12T17:24:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2398999999999997e-05 2020-11-12T17:24:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603829+0000", 2020-11-12T17:24:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149 2020-11-12T17:24:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(osd.4.0:8091 3.9 e56/35 ondisk, result = 0)", 2020-11-12T17:24:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:24:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 23.306651483, 2020-11-12T17:24:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999, 2020-11-12T17:24:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:24:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:24:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:24:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379795+0000", 2020-11-12T17:24:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8462999999999998e-05 2020-11-12T17:24:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379864+0000", 2020-11-12T17:24:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23719935 2020-11-12T17:24:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617063+0000", 2020-11-12T17:24:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5229999999999998e-06 2020-11-12T17:24:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617071+0000", 2020-11-12T17:24:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0618999999999995e-05 2020-11-12T17:24:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617151+0000", 2020-11-12T17:24:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4123e-05 2020-11-12T17:24:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617165+0000", 2020-11-12T17:24:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4392e-05 2020-11-12T17:24:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617260+0000", 2020-11-12T17:24:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999 2020-11-12T17:24:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:24:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:24:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.800825409, 2020-11-12T17:24:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:24:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:24:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:24:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:24:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:24:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:24:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:24:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:24:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:24:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:24:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:24:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:24:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:24:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:24:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:24:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:24:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:24:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:24:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:45.895 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:45.895 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:24:45.897 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2020-11-12T17:24:45.898 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2020-11-12T17:24:45.899 INFO:tasks.thrashosds.thrasher:Waiting for clean again 2020-11-12T17:24:45.899 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-12T17:24:45.899 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:24:45.900 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:45.812+0000 7fc24d2e3700 -1 osd.3 66 handle_osd_map injecting map crc failure 2020-11-12T17:24:45.900 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:45.892+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:45.901 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:45.814+0000 7f280e6c1700 -1 osd.6 66 handle_osd_map injecting map crc failure 2020-11-12T17:24:45.901 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:45.997 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:45.992+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:46.060 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:24:46.061 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:46.070 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:46.098 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:46.092+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:46.176 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:46.176 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:46.177 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:46.177 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:46.177 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:46.186 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:46.225 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:24:46.227 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:24:46.234 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:46.230+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:46.238 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2020-11-12T17:24:45.817692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75685912,"num_objects":1158,"num_object_clones":0,"num_object_copies":2316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1158,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":71882,"num_write_kb":519355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2321,"num_bytes_recovered":152109056,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72362,"ondisk_log_size":72362,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":6385844,"kb_used_data":94244,"kb_used_omap":0,"kb_used_meta":6291456,"kb_avail":559845196,"statfs":{"total":579820584960,"available":573281480704,"internally_reserved":6442450944,"allocated":96505856,"data_stored":207868046,"data_compressed":1259666,"data_compressed_allocated":92856320,"data_compressed_original":206356480,"omap_allocated":0,"internal_metadata":6442450944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-311230464,"num_objects":-4749,"num_object_clones":0,"num_object_copies":-9498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4749,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":13565952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.056815"},"pg_stats":[{"pgid":"3.f","version":"64'4609","reported_seq":"4659","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.528656+0000","last_change":"2020-11-12T17:23:03.465552+0000","last_active":"2020-11-12T17:24:41.528656+0000","last_peered":"2020-11-12T17:24:41.528656+0000","last_clean":"2020-11-12T17:24:41.528656+0000","last_became_active":"2020-11-12T17:23:03.463508+0000","last_became_peered":"2020-11-12T17:23:03.463508+0000","last_unstale":"2020-11-12T17:24:41.528656+0000","last_undegraded":"2020-11-12T17:24:41.528656+0000","last_fullsized":"2020-11-12T17:24:41.528656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4609,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4609,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"64'3976","reported_seq":"4027","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.584093+0000","last_change":"2020-11-12T17:23:03.464759+0000","last_active":"2020-11-12T17:24:41.584093+0000","last_peered":"2020-11-12T17:24:41.584093+0000","last_clean":"2020-11-12T17:24:41.584093+0000","last_became_active":"2020-11-12T17:23:03.463495+0000","last_became_peered":"2020-11-12T17:23:03.463495+0000","last_unstale":"2020-11-12T17:24:41.584093+0000","last_undegraded":"2020-11-12T17:24:41.584093+0000","last_fullsized":"2020-11-12T17:24:41.584093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":3976,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3976,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"64'4278","reported_seq":"4333","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.557799+0000","last_change":"2020-11-12T17:24:17.056341+0000","last_active":"2020-11-12T17:24:41.557799+0000","last_peered":"2020-11-12T17:24:41.557799+0000","last_clean":"2020-11-12T17:24:41.557799+0000","last_became_active":"2020-11-12T17:23:03.463663+0000","last_became_peered":"2020-11-12T17:23:03.463663+0000","last_unstale":"2020-11-12T17:24:41.557799+0000","last_undegraded":"2020-11-12T17:24:41.557799+0000","last_fullsized":"2020-11-12T17:24:41.557799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3096","last_scrub_stamp":"2020-11-12T17:24:17.056264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:17.056264+0000","log_size":4278,"ondisk_log_size":4278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7536664,"num_objects":116,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4278,"num_write_kb":31233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"64'4740","reported_seq":"4791","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.596877+0000","last_change":"2020-11-12T17:23:03.464079+0000","last_active":"2020-11-12T17:24:41.596877+0000","last_peered":"2020-11-12T17:24:41.596877+0000","last_clean":"2020-11-12T17:24:41.596877+0000","last_became_active":"2020-11-12T17:23:03.463689+0000","last_became_peered":"2020-11-12T17:23:03.463689+0000","last_unstale":"2020-11-12T17:24:41.596877+0000","last_undegraded":"2020-11-12T17:24:41.596877+0000","last_fullsized":"2020-11-12T17:24:41.596877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4740,"ondisk_log_size":4740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4740,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"64'4536","reported_seq":"4590","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.575137+0000","last_change":"2020-11-12T17:24:14.824877+0000","last_active":"2020-11-12T17:24:41.575137+0000","last_peered":"2020-11-12T17:24:41.575137+0000","last_clean":"2020-11-12T17:24:41.575137+0000","last_became_active":"2020-11-12T17:23:03.461922+0000","last_became_peered":"2020-11-12T17:23:03.461922+0000","last_unstale":"2020-11-12T17:24:41.575137+0000","last_undegraded":"2020-11-12T17:24:41.575137+0000","last_fullsized":"2020-11-12T17:24:41.575137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3320","last_scrub_stamp":"2020-11-12T17:24:14.824752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:14.824752+0000","log_size":4536,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4536,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"64'4716","reported_seq":"5026","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-12T17:24:43.860187+0000","last_change":"2020-11-12T17:24:15.170940+0000","last_active":"2020-11-12T17:24:43.860187+0000","last_peered":"2020-11-12T17:24:43.860187+0000","last_clean":"2020-11-12T17:24:43.860187+0000","last_became_active":"2020-11-12T17:23:19.676825+0000","last_became_peered":"2020-11-12T17:23:19.676825+0000","last_unstale":"2020-11-12T17:24:43.860187+0000","last_undegraded":"2020-11-12T17:24:43.860187+0000","last_fullsized":"2020-11-12T17:24:43.860187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3320","last_scrub_stamp":"2020-11-12T17:24:15.170816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:15.170816+0000","log_size":4716,"ondisk_log_size":4716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4716,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":7995392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"64'5262","reported_seq":"5553","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:43.294571+0000","last_change":"2020-11-12T17:24:23.194754+0000","last_active":"2020-11-12T17:24:43.294571+0000","last_peered":"2020-11-12T17:24:43.294571+0000","last_clean":"2020-11-12T17:24:43.294571+0000","last_became_active":"2020-11-12T17:23:27.810569+0000","last_became_peered":"2020-11-12T17:23:27.810569+0000","last_unstale":"2020-11-12T17:24:43.294571+0000","last_undegraded":"2020-11-12T17:24:43.294571+0000","last_fullsized":"2020-11-12T17:24:43.294571+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4259","last_scrub_stamp":"2020-11-12T17:24:23.194679+0000","last_deep_scrub":"57'4259","last_deep_scrub_stamp":"2020-11-12T17:24:23.194679+0000","last_clean_scrub_stamp":"2020-11-12T17:24:23.194679+0000","log_size":5262,"ondisk_log_size":5262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4995,"num_write_kb":35520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":7405568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"64'4580","reported_seq":"5633","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.560510+0000","last_change":"2020-11-12T17:24:36.795116+0000","last_active":"2020-11-12T17:24:41.560510+0000","last_peered":"2020-11-12T17:24:41.560510+0000","last_clean":"2020-11-12T17:24:41.560510+0000","last_became_active":"2020-11-12T17:24:30.757984+0000","last_became_peered":"2020-11-12T17:24:30.757984+0000","last_unstale":"2020-11-12T17:24:41.560510+0000","last_undegraded":"2020-11-12T17:24:41.560510+0000","last_fullsized":"2020-11-12T17:24:41.560510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4580,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4580,"num_write_kb":33280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":500,"num_bytes_recovered":32768000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.742579+0000","last_change":"2020-11-12T17:24:30.646835+0000","last_active":"2020-11-12T17:24:37.742579+0000","last_peered":"2020-11-12T17:24:37.742579+0000","last_clean":"2020-11-12T17:24:37.742579+0000","last_became_active":"2020-11-12T17:24:30.646312+0000","last_became_peered":"2020-11-12T17:24:30.646312+0000","last_unstale":"2020-11-12T17:24:37.742579+0000","last_undegraded":"2020-11-12T17:24:37.742579+0000","last_fullsized":"2020-11-12T17:24:37.742579+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:18.299871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:18.299871+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'4303","reported_seq":"4357","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.571640+0000","last_change":"2020-11-12T17:24:13.360816+0000","last_active":"2020-11-12T17:24:41.571640+0000","last_peered":"2020-11-12T17:24:41.571640+0000","last_clean":"2020-11-12T17:24:41.571640+0000","last_became_active":"2020-11-12T17:23:03.464444+0000","last_became_peered":"2020-11-12T17:23:03.464444+0000","last_unstale":"2020-11-12T17:24:41.571640+0000","last_undegraded":"2020-11-12T17:24:41.571640+0000","last_fullsized":"2020-11-12T17:24:41.571640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3080","last_scrub_stamp":"2020-11-12T17:24:13.360686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:13.360686+0000","log_size":4303,"ondisk_log_size":4303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4303,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"66","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.744577+0000","last_change":"2020-11-12T17:24:30.654277+0000","last_active":"2020-11-12T17:24:37.744577+0000","last_peered":"2020-11-12T17:24:37.744577+0000","last_clean":"2020-11-12T17:24:37.744577+0000","last_became_active":"2020-11-12T17:24:30.653733+0000","last_became_peered":"2020-11-12T17:24:30.653733+0000","last_unstale":"2020-11-12T17:24:37.744577+0000","last_undegraded":"2020-11-12T17:24:37.744577+0000","last_fullsized":"2020-11-12T17:24:37.744577+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:00.156362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:00.156362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"64'4590","reported_seq":"4642","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:43.076035+0000","last_change":"2020-11-12T17:23:03.464964+0000","last_active":"2020-11-12T17:24:43.076035+0000","last_peered":"2020-11-12T17:24:43.076035+0000","last_clean":"2020-11-12T17:24:43.076035+0000","last_became_active":"2020-11-12T17:23:03.464617+0000","last_became_peered":"2020-11-12T17:23:03.464617+0000","last_unstale":"2020-11-12T17:24:43.076035+0000","last_undegraded":"2020-11-12T17:24:43.076035+0000","last_fullsized":"2020-11-12T17:24:43.076035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4590,"ondisk_log_size":4590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4590,"num_write_kb":32640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"39","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.737124+0000","last_change":"2020-11-12T17:23:27.984703+0000","last_active":"2020-11-12T17:24:37.737124+0000","last_peered":"2020-11-12T17:24:37.737124+0000","last_clean":"2020-11-12T17:24:37.737124+0000","last_became_active":"2020-11-12T17:23:27.983997+0000","last_became_peered":"2020-11-12T17:23:27.983997+0000","last_unstale":"2020-11-12T17:24:37.737124+0000","last_undegraded":"2020-11-12T17:24:37.737124+0000","last_fullsized":"2020-11-12T17:24:37.737124+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"64'4194","reported_seq":"5303","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-12T17:24:43.860186+0000","last_change":"2020-11-12T17:24:35.441569+0000","last_active":"2020-11-12T17:24:43.860186+0000","last_peered":"2020-11-12T17:24:43.860186+0000","last_clean":"2020-11-12T17:24:43.860186+0000","last_became_active":"2020-11-12T17:24:30.786072+0000","last_became_peered":"2020-11-12T17:24:30.786072+0000","last_unstale":"2020-11-12T17:24:43.860186+0000","last_undegraded":"2020-11-12T17:24:43.860186+0000","last_fullsized":"2020-11-12T17:24:43.860186+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3224","last_scrub_stamp":"2020-11-12T17:24:20.376036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:20.376036+0000","log_size":4194,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4194,"num_write_kb":29824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":518,"num_bytes_recovered":33947648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"65","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.744506+0000","last_change":"2020-11-12T17:24:15.328590+0000","last_active":"2020-11-12T17:24:37.744506+0000","last_peered":"2020-11-12T17:24:37.744506+0000","last_clean":"2020-11-12T17:24:37.744506+0000","last_became_active":"2020-11-12T17:23:27.787364+0000","last_became_peered":"2020-11-12T17:23:27.787364+0000","last_unstale":"2020-11-12T17:24:37.744506+0000","last_undegraded":"2020-11-12T17:24:37.744506+0000","last_fullsized":"2020-11-12T17:24:37.744506+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:15.328459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:15.328459+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"62","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.741731+0000","last_change":"2020-11-12T17:24:12.812989+0000","last_active":"2020-11-12T17:24:37.741731+0000","last_peered":"2020-11-12T17:24:37.741731+0000","last_clean":"2020-11-12T17:24:37.741731+0000","last_became_active":"2020-11-12T17:22:47.069110+0000","last_became_peered":"2020-11-12T17:22:47.069110+0000","last_unstale":"2020-11-12T17:24:37.741731+0000","last_undegraded":"2020-11-12T17:24:37.741731+0000","last_fullsized":"2020-11-12T17:24:37.741731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:24:12.812899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:24:12.812899+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"64'4455","reported_seq":"4506","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.568749+0000","last_change":"2020-11-12T17:23:03.467425+0000","last_active":"2020-11-12T17:24:41.568749+0000","last_peered":"2020-11-12T17:24:41.568749+0000","last_clean":"2020-11-12T17:24:41.568749+0000","last_became_active":"2020-11-12T17:23:03.467027+0000","last_became_peered":"2020-11-12T17:23:03.467027+0000","last_unstale":"2020-11-12T17:24:41.568749+0000","last_undegraded":"2020-11-12T17:24:41.568749+0000","last_fullsized":"2020-11-12T17:24:41.568749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4455,"ondisk_log_size":4455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4455,"num_write_kb":32448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"66","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.741838+0000","last_change":"2020-11-12T17:24:30.649974+0000","last_active":"2020-11-12T17:24:37.741838+0000","last_peered":"2020-11-12T17:24:37.741838+0000","last_clean":"2020-11-12T17:24:37.741838+0000","last_became_active":"2020-11-12T17:24:30.649571+0000","last_became_peered":"2020-11-12T17:24:30.649571+0000","last_unstale":"2020-11-12T17:24:37.741838+0000","last_undegraded":"2020-11-12T17:24:37.741838+0000","last_fullsized":"2020-11-12T17:24:37.741838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:11.795281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:11.795281+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"64'4417","reported_seq":"4471","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.584150+0000","last_change":"2020-11-12T17:24:12.251153+0000","last_active":"2020-11-12T17:24:41.584150+0000","last_peered":"2020-11-12T17:24:41.584150+0000","last_clean":"2020-11-12T17:24:41.584150+0000","last_became_active":"2020-11-12T17:23:03.462984+0000","last_became_peered":"2020-11-12T17:23:03.462984+0000","last_unstale":"2020-11-12T17:24:41.584150+0000","last_undegraded":"2020-11-12T17:24:41.584150+0000","last_fullsized":"2020-11-12T17:24:41.584150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3208","last_scrub_stamp":"2020-11-12T17:24:12.251020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:12.251020+0000","log_size":4417,"ondisk_log_size":4417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4417,"num_write_kb":32000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"57","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.741217+0000","last_change":"2020-11-12T17:24:14.829837+0000","last_active":"2020-11-12T17:24:37.741217+0000","last_peered":"2020-11-12T17:24:37.741217+0000","last_clean":"2020-11-12T17:24:37.741217+0000","last_became_active":"2020-11-12T17:22:51.723115+0000","last_became_peered":"2020-11-12T17:22:51.723115+0000","last_unstale":"2020-11-12T17:24:37.741217+0000","last_undegraded":"2020-11-12T17:24:37.741217+0000","last_fullsized":"2020-11-12T17:24:37.741217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:24:14.829737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"64'4360","reported_seq":"5551","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.583182+0000","last_change":"2020-11-12T17:24:37.214790+0000","last_active":"2020-11-12T17:24:41.583182+0000","last_peered":"2020-11-12T17:24:41.583182+0000","last_clean":"2020-11-12T17:24:41.583182+0000","last_became_active":"2020-11-12T17:24:30.809224+0000","last_became_peered":"2020-11-12T17:24:30.809224+0000","last_unstale":"2020-11-12T17:24:41.583182+0000","last_undegraded":"2020-11-12T17:24:41.583182+0000","last_fullsized":"2020-11-12T17:24:41.583182+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4360,"ondisk_log_size":4360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6152192,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4360,"num_write_kb":31672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":563,"num_bytes_recovered":36896768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"64'4678","reported_seq":"4732","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.582302+0000","last_change":"2020-11-12T17:24:38.781974+0000","last_active":"2020-11-12T17:24:41.582302+0000","last_peered":"2020-11-12T17:24:41.582302+0000","last_clean":"2020-11-12T17:24:41.582302+0000","last_became_active":"2020-11-12T17:23:03.461966+0000","last_became_peered":"2020-11-12T17:23:03.461966+0000","last_unstale":"2020-11-12T17:24:41.582302+0000","last_undegraded":"2020-11-12T17:24:41.582302+0000","last_fullsized":"2020-11-12T17:24:41.582302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'4466","last_scrub_stamp":"2020-11-12T17:24:38.781884+0000","last_deep_scrub":"63'4466","last_deep_scrub_stamp":"2020-11-12T17:24:38.781884+0000","last_clean_scrub_stamp":"2020-11-12T17:24:38.781884+0000","log_size":4678,"ondisk_log_size":4678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4465,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"45","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-12T17:24:43.860252+0000","last_change":"2020-11-12T17:24:30.652630+0000","last_active":"2020-11-12T17:24:43.860252+0000","last_peered":"2020-11-12T17:24:43.860252+0000","last_clean":"2020-11-12T17:24:43.860252+0000","last_became_active":"2020-11-12T17:24:30.652206+0000","last_became_peered":"2020-11-12T17:24:30.652206+0000","last_unstale":"2020-11-12T17:24:43.860252+0000","last_undegraded":"2020-11-12T17:24:43.860252+0000","last_fullsized":"2020-11-12T17:24:43.860252+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:16.370222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:16.370222+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"50","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-12T17:24:43.860160+0000","last_change":"2020-11-12T17:24:18.165744+0000","last_active":"2020-11-12T17:24:43.860160+0000","last_peered":"2020-11-12T17:24:43.860160+0000","last_clean":"2020-11-12T17:24:43.860160+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:24:43.860160+0000","last_undegraded":"2020-11-12T17:24:43.860160+0000","last_fullsized":"2020-11-12T17:24:43.860160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:24:18.165582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"64'4666","reported_seq":"5741","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.568790+0000","last_change":"2020-11-12T17:24:38.618030+0000","last_active":"2020-11-12T17:24:41.568790+0000","last_peered":"2020-11-12T17:24:41.568790+0000","last_clean":"2020-11-12T17:24:41.568790+0000","last_became_active":"2020-11-12T17:24:30.766880+0000","last_became_peered":"2020-11-12T17:24:30.766880+0000","last_unstale":"2020-11-12T17:24:41.568790+0000","last_undegraded":"2020-11-12T17:24:41.568790+0000","last_fullsized":"2020-11-12T17:24:41.568790+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3728","last_scrub_stamp":"2020-11-12T17:24:19.676454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:19.676454+0000","log_size":4666,"ondisk_log_size":4666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4666,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":33095680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":75685912,"num_objects":1156,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1156,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":71880,"num_write_kb":519353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2321,"num_bytes_recovered":152109056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":138219520,"data_stored":288866352,"data_compressed":1858953,"data_compressed_allocated":138211328,"data_compressed_original":288866304,"omap_allocated":0,"internal_metadata":0},"log_size":72360,"ondisk_log_size":72360,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1076956,"kb_used_data":28276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93294884,"statfs":{"total":96636764160,"available":95533961216,"internally_reserved":1073741824,"allocated":28954624,"data_stored":64668220,"data_compressed":385710,"data_compressed_allocated":28368896,"data_compressed_original":64421888,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":2.8740000000000001},{"interface":"front","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":7.4349999999999996,"5min":7.4349999999999996,"15min":7.4349999999999996},"last":2.8919999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.27,"5min":2.27,"15min":2.27},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":7.585,"5min":7.585,"15min":7.585},"last":1.452},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.94599999999999995}]},{"osd":2,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":7.6310000000000002,"5min":7.6310000000000002,"15min":7.6310000000000002},"last":2.9769999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"min":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":7.5410000000000004,"5min":7.5410000000000004,"15min":7.5410000000000004},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":53.758000000000003,"5min":53.758000000000003,"15min":53.758000000000003},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":503.50200000000001,"5min":503.50200000000001,"15min":503.50200000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.742,"5min":2.742,"15min":2.742},"min":{"1min":1.45,"5min":1.45,"15min":1.45},"max":{"1min":7.7169999999999996,"5min":7.7169999999999996,"15min":7.7169999999999996},"last":2.8570000000000002},{"interface":"front","average":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":7.7480000000000002,"5min":7.7480000000000002,"15min":7.7480000000000002},"last":2.9089999999999998}]},{"osd":6,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":7.6630000000000003,"5min":7.6630000000000003,"15min":7.6630000000000003},"last":0.84299999999999997},{"interface":"front","average":{"1min":53.441000000000003,"5min":53.441000000000003,"15min":53.441000000000003},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":975.20899999999995,"5min":975.20899999999995,"15min":975.20899999999995},"last":0.94299999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1067316,"kb_used_data":18732,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93304524,"statfs":{"total":96636764160,"available":95543832576,"internally_reserved":1073741824,"allocated":19181568,"data_stored":37400323,"data_compressed":249425,"data_compressed_allocated":18575360,"data_compressed_original":37150720,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":1.825,"15min":1.825},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":1.046},{"interface":"front","average":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":5.3079999999999998,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":2.5680000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.042}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":5.4329999999999998,"5min":5.4329999999999998,"15min":5.4329999999999998},"last":2.6099999999999999},{"interface":"front","average":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":8.0969999999999995,"5min":8.0969999999999995,"15min":8.0969999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.742,"5min":2.742,"15min":2.742},"min":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":2.8650000000000002},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"min":{"1min":1.024,"5min":1.024,"15min":1.024},"max":{"1min":8.202,"5min":8.202,"15min":8.202},"last":2.2229999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":1.0800000000000001},{"interface":"front","average":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":2.6459999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.6680000000000001,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"min":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.3100000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":8.5299999999999994,"5min":8.5299999999999994,"15min":8.5299999999999994},"last":2.899},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"min":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.65100000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049160,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322680,"statfs":{"total":96636764160,"available":95562424320,"internally_reserved":1073741824,"allocated":589824,"data_stored":252749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":2.6640000000000001},{"interface":"front","average":{"1min":47.031999999999996,"5min":47.031999999999996,"15min":47.031999999999996},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":948.30899999999997,"5min":948.30899999999997,"15min":948.30899999999997},"last":2.2709999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":9.7530000000000001,"5min":9.7530000000000001,"15min":9.7530000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":162.126,"5min":162.126,"15min":162.126},"last":1.5289999999999999},{"interface":"front","average":{"1min":9.4280000000000008,"5min":9.4280000000000008,"15min":9.4280000000000008},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":163.59899999999999,"5min":163.59899999999999,"15min":163.59899999999999},"last":2.3929999999999998}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.9179999999999999},{"interface":"front","average":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":2.169}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.423,"5min":3.423,"15min":3.423},"last":1.8480000000000001},{"interface":"front","average":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":4.3959999999999999,"5min":4.3959999999999999,"15min":4.3959999999999999},"last":2.6070000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":2.3780000000000001},{"interface":"front","average":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":2.851}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":33.646999999999998,"5min":33.646999999999998,"15min":33.646999999999998},"min":{"1min":1.218,"5min":1.218,"15min":1.218},"max":{"1min":665.13999999999999,"5min":665.13999999999999,"15min":665.13999999999999},"last":1.966},{"interface":"front","average":{"1min":2.242,"5min":2.242,"15min":2.242},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":2.7879999999999998}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":3.6160000000000001,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":2.7370000000000001},{"interface":"front","average":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.2679999999999998,"5min":3.2679999999999998,"15min":3.2679999999999998},"last":2.5}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049200,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322640,"statfs":{"total":96636764160,"available":95562383360,"internally_reserved":1073741824,"allocated":630784,"data_stored":259390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.768,"15min":1.768},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"min":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.613}]},{"osd":1,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":2.254,"5min":2.254,"15min":2.254},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.343}]},{"osd":2,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":9.1400000000000006,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":0.95999999999999996},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"min":{"1min":1.417,"5min":1.417,"15min":1.417},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.6499999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.5720000000000001},{"interface":"front","average":{"1min":2.46,"5min":2.46,"15min":2.46},"min":{"1min":1.234,"5min":1.234,"15min":1.234},"max":{"1min":9.2550000000000008,"5min":9.2550000000000008,"15min":9.2550000000000008},"last":1.4019999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"min":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.702},{"interface":"front","average":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":8.7189999999999994,"5min":8.7189999999999994,"15min":8.7189999999999994},"last":2.1509999999999998}]},{"osd":5,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":9.7710000000000008,"5min":9.7710000000000008,"15min":9.7710000000000008},"last":1.8460000000000001},{"interface":"front","average":{"1min":22.742000000000001,"5min":22.742000000000001,"15min":22.742000000000001},"min":{"1min":1.609,"5min":1.609,"15min":1.609},"max":{"1min":445.34699999999998,"5min":445.34699999999998,"15min":445.34699999999998},"last":2.2370000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":1.8839999999999999},{"interface":"front","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":9.3059999999999992,"5min":9.3059999999999992,"15min":9.3059999999999992},"last":1.4370000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1069800,"kb_used_data":21216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93302040,"statfs":{"total":96636764160,"available":95541288960,"internally_reserved":1073741824,"allocated":21725184,"data_stored":55425758,"data_compressed":291451,"data_compressed_allocated":21106688,"data_compressed_original":55173120,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":66.608000000000004,"5min":66.608000000000004,"15min":66.608000000000004},"last":1.3480000000000001},{"interface":"front","average":{"1min":5.3899999999999997,"5min":5.3899999999999997,"15min":5.3899999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":67.099999999999994,"5min":67.099999999999994,"15min":67.099999999999994},"last":1.4430000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":54.027000000000001,"5min":54.027000000000001,"15min":54.027000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":995.93899999999996,"5min":995.93899999999996,"15min":995.93899999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":1.079}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":15.675000000000001,"5min":15.675000000000001,"15min":15.675000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":269.27100000000002,"5min":269.27100000000002,"15min":269.27100000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"min":{"1min":1.399,"5min":1.399,"15min":1.399},"max":{"1min":3.2839999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.944,"5min":1.944,"15min":1.944},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":0.85499999999999998},{"interface":"front","average":{"1min":50.664999999999999,"5min":50.664999999999999,"15min":50.664999999999999},"min":{"1min":1.23,"5min":1.23,"15min":1.23},"max":{"1min":920.76900000000001,"5min":920.76900000000001,"15min":920.76900000000001},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":3.5329999999999999},{"interface":"front","average":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.738,"5min":3.738,"15min":3.738},"last":931.65200000000004}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":29.132999999999999,"5min":29.132999999999999,"15min":29.132999999999999},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":502.12900000000002,"5min":502.12900000000002,"15min":502.12900000000002},"last":1.135},{"interface":"front","average":{"1min":49.103999999999999,"5min":49.103999999999999,"15min":49.103999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":502.42099999999999,"5min":502.42099999999999,"15min":502.42099999999999},"last":1.173}]}]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1073412,"kb_used_data":24828,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93298428,"statfs":{"total":96636764160,"available":95537590272,"internally_reserved":1073741824,"allocated":25423872,"data_stored":49861606,"data_compressed":333080,"data_compressed_allocated":24805376,"data_compressed_original":49610752,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.798,"15min":1.798},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":4.4290000000000003,"5min":4.4290000000000003,"15min":4.4290000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":10.403,"5min":10.403,"15min":10.403},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":22.77,"5min":22.77,"15min":22.77},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":440.65899999999999,"5min":440.65899999999999,"15min":440.65899999999999},"last":2.085},{"interface":"front","average":{"1min":1.839,"5min":1.839,"15min":1.839},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":2.1349999999999998}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":2.347,"15min":2.347},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":4.9740000000000002,"5min":4.9740000000000002,"15min":4.9740000000000002},"last":2.4049999999999998},{"interface":"front","average":{"1min":1.994,"5min":1.994,"15min":1.994},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":3.7389999999999999,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.5409999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":10.318,"5min":10.318,"15min":10.318},"last":0.76200000000000001},{"interface":"front","average":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":2.4820000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":32.210000000000001,"5min":32.210000000000001,"15min":32.210000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":622.07799999999997,"5min":622.07799999999997,"15min":622.07799999999997},"last":3.6059999999999999},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"max":{"1min":10.436,"5min":10.436,"15min":10.436},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.625,"5min":2.625,"15min":2.625},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":5.0419999999999998,"5min":5.0419999999999998,"15min":5.0419999999999998},"last":2.4470000000000001},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":11.497999999999999,"5min":11.497999999999999,"15min":11.497999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":10.513999999999999,"5min":10.513999999999999,"15min":10.513999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":30.190000000000001,"5min":30.190000000000001,"15min":30.190000000000001},"min":{"1min":1.101,"5min":1.101,"15min":1.101},"max":{"1min":577.35900000000004,"5min":577.35900000000004,"15min":577.35900000000004},"last":2.524}]}]}]}} 2020-11-12T17:24:46.243 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:24:46.287 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:24:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 95.780389584000005, 2020-11-12T17:24:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:24:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:46.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:24:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:24:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:24:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:24:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:24:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:24:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:24:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:24:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:24:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:24:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:24:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:24:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:24:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:24:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:24:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:24:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 91.758380019000001, 2020-11-12T17:24:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:24:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:24:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:24:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:24:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:24:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:24:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:24:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:24:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:24:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:24:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:24:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:24:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:24:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:24:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:24:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:24:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:24:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:24:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:24:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:24:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:24:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:24:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:24:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:24:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:24:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 91.754980085, 2020-11-12T17:24:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:24:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:24:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:24:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:24:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:24:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:24:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:24:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:24:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:24:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:24:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:24:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:24:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:24:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:24:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:24:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.317 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.317 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.317 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:28560 3.4 e47/35 3:202f80a5:::benchmark_data_smithi036_14212_object3569:head v 47'1808, mlcod=47'1801)", 2020-11-12T17:24:46.317 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:46.317 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 57.622263570000001, 2020-11-12T17:24:46.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697, 2020-11-12T17:24:46.318 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.318 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.318 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:46.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:46.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:46.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662339+0000", 2020-11-12T17:24:46.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9332000000000001e-05 2020-11-12T17:24:46.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662389+0000", 2020-11-12T17:24:46.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.240093907 2020-11-12T17:24:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902482+0000", 2020-11-12T17:24:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1109999999999996e-06 2020-11-12T17:24:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902489+0000", 2020-11-12T17:24:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0870000000000004e-05 2020-11-12T17:24:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902559+0000", 2020-11-12T17:24:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2245e-05 2020-11-12T17:24:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902592+0000", 2020-11-12T17:24:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029425010000000001 2020-11-12T17:24:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905534+0000", 2020-11-12T17:24:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8211e-05 2020-11-12T17:24:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905622+0000", 2020-11-12T17:24:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697 2020-11-12T17:24:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29440 3.4 e48/35 3:252d7780:::benchmark_data_smithi036_14212_object3679:head v 48'1880, mlcod=48'1871)", 2020-11-12T17:24:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.886632278999997, 2020-11-12T17:24:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999, 2020-11-12T17:24:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397961+0000", 2020-11-12T17:24:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5236999999999997e-05 2020-11-12T17:24:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.398046+0000", 2020-11-12T17:24:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23963379700000001 2020-11-12T17:24:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637680+0000", 2020-11-12T17:24:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.824e-06 2020-11-12T17:24:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637687+0000", 2020-11-12T17:24:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4215999999999998e-05 2020-11-12T17:24:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637732+0000", 2020-11-12T17:24:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8510000000000001e-05 2020-11-12T17:24:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637750+0000", 2020-11-12T17:24:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012233260000000001 2020-11-12T17:24:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.638973+0000", 2020-11-12T17:24:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8594999999999998e-05 2020-11-12T17:24:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.639022+0000", 2020-11-12T17:24:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999 2020-11-12T17:24:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29991 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1679, mlcod=48'1673)", 2020-11-12T17:24:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.280454390999999, 2020-11-12T17:24:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001, 2020-11-12T17:24:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004127+0000", 2020-11-12T17:24:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012464900000000001 2020-11-12T17:24:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004251+0000", 2020-11-12T17:24:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28639012600000002 2020-11-12T17:24:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290641+0000", 2020-11-12T17:24:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:24:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290646+0000", 2020-11-12T17:24:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2363000000000002e-05 2020-11-12T17:24:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290679+0000", 2020-11-12T17:24:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3289999999999999e-05 2020-11-12T17:24:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290702+0000", 2020-11-12T17:24:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014675440000000001 2020-11-12T17:24:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292170+0000", 2020-11-12T17:24:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6585000000000001e-05 2020-11-12T17:24:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292226+0000", 2020-11-12T17:24:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001 2020-11-12T17:24:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:24:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.279090638, 2020-11-12T17:24:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:24:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:24:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:24:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:24:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:24:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:24:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:24:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:24:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:24:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:24:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:24:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:24:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:24:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:24:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:24:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:24:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:24:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:24:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30039 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1927, mlcod=48'1921)", 2020-11-12T17:24:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.219811960999998, 2020-11-12T17:24:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001, 2020-11-12T17:24:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999409 2020-11-12T17:24:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064747+0000", 2020-11-12T17:24:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019364299999999999 2020-11-12T17:24:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064941+0000", 2020-11-12T17:24:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.212994778 2020-11-12T17:24:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277936+0000", 2020-11-12T17:24:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7939999999999997e-06 2020-11-12T17:24:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277945+0000", 2020-11-12T17:24:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032420940000000001 2020-11-12T17:24:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281187+0000", 2020-11-12T17:24:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3390000000000001e-05 2020-11-12T17:24:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281211+0000", 2020-11-12T17:24:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062069380000000004 2020-11-12T17:24:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287418+0000", 2020-11-12T17:24:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109126 2020-11-12T17:24:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287527+0000", 2020-11-12T17:24:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001 2020-11-12T17:24:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30040 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1928, mlcod=48'1921)", 2020-11-12T17:24:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.218193210000003, 2020-11-12T17:24:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277, 2020-11-12T17:24:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:24:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066369+0000", 2020-11-12T17:24:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185513 2020-11-12T17:24:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066555+0000", 2020-11-12T17:24:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22267770000000001 2020-11-12T17:24:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289233+0000", 2020-11-12T17:24:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5750000000000001e-06 2020-11-12T17:24:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289236+0000", 2020-11-12T17:24:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7205e-05 2020-11-12T17:24:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289283+0000", 2020-11-12T17:24:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0210000000000001e-05 2020-11-12T17:24:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289304+0000", 2020-11-12T17:24:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018794020000000001 2020-11-12T17:24:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291183+0000", 2020-11-12T17:24:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2386999999999998e-05 2020-11-12T17:24:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291235+0000", 2020-11-12T17:24:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277 2020-11-12T17:24:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.368 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.368 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:33768 3.d e49/20 3:bed94f4a:::benchmark_data_smithi036_14212_object4220:head v 49'1880, mlcod=49'1874)", 2020-11-12T17:24:46.368 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:46.368 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.370047589999999, 2020-11-12T17:24:46.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001, 2020-11-12T17:24:46.369 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.369 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.369 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:46.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:46.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:24:46.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914530+0000", 2020-11-12T17:24:46.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013119499999999999 2020-11-12T17:24:46.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914662+0000", 2020-11-12T17:24:46.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26915680600000003 2020-11-12T17:24:46.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183818+0000", 2020-11-12T17:24:46.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.61e-06 2020-11-12T17:24:46.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183826+0000", 2020-11-12T17:24:46.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2031999999999999e-05 2020-11-12T17:24:46.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183878+0000", 2020-11-12T17:24:46.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1192999999999998e-05 2020-11-12T17:24:46.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183909+0000", 2020-11-12T17:24:46.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055133250000000003 2020-11-12T17:24:46.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189422+0000", 2020-11-12T17:24:46.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4030999999999997e-05 2020-11-12T17:24:46.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189486+0000", 2020-11-12T17:24:46.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001 2020-11-12T17:24:46.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.377 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.377 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:24:46.377 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:46.378 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.446396671999999, 2020-11-12T17:24:46.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:24:46.378 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.378 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.378 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:46.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:46.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:46.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:24:46.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:24:46.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:24:46.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:24:46.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:24:46.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:24:46.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:24:46.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:24:46.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:24:46.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:24:46.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:24:46.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:24:46.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:24:46.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:24:46.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:24:46.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:24:46.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.385 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.385 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:46.385 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:24:46.385 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 24.339105295, 2020-11-12T17:24:46.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:24:46.386 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.386 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.386 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:46.386 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:46.386 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:46.386 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:24:46.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.387 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:24:46.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:24:46.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:24:46.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:24:46.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:24:46.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:24:46.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:24:46.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:24:46.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:24:46.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:24:46.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:24:46.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:24:46.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:24:46.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:24:46.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:24:46.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:46.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:24:46.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:24:46.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:46.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:24:46.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:24:46.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:46.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:24:46.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:24:46.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:24:46.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:24:46.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:24:46.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:24:46.399 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.399 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.399 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.400 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:59040 3.d e57/20 3:b34b9c19:::benchmark_data_smithi036_14212_object7379:head v 57'3416, mlcod=57'3410)", 2020-11-12T17:24:46.400 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.018580+0000", 2020-11-12T17:24:46.401 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.266037978, 2020-11-12T17:24:46.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25110908799999998, 2020-11-12T17:24:46.401 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.401 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.402 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018580+0000", 2020-11-12T17:24:46.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018580+0000", 2020-11-12T17:24:46.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:24:46.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018552+0000", 2020-11-12T17:24:46.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9864000000000006e-05 2020-11-12T17:24:46.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018631+0000", 2020-11-12T17:24:46.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24583041 2020-11-12T17:24:46.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264462+0000", 2020-11-12T17:24:46.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.798e-06 2020-11-12T17:24:46.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264469+0000", 2020-11-12T17:24:46.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2987999999999999e-05 2020-11-12T17:24:46.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264552+0000", 2020-11-12T17:24:46.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3086e-05 2020-11-12T17:24:46.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264595+0000", 2020-11-12T17:24:46.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050248309999999996 2020-11-12T17:24:46.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.269620+0000", 2020-11-12T17:24:46.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9807000000000004e-05 2020-11-12T17:24:46.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.269689+0000", 2020-11-12T17:24:46.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25110908799999998 2020-11-12T17:24:46.410 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.410 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.410 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.411 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:59416 3.c 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:46.411 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:24:46.411 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.756709879999999, 2020-11-12T17:24:46.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998, 2020-11-12T17:24:46.411 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.411 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.412 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:46.412 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:46.412 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:46.412 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59416 2020-11-12T17:24:46.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.412 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:24:46.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:24:46.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:46.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527883+0000", 2020-11-12T17:24:46.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2643000000000002e-05 2020-11-12T17:24:46.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527956+0000", 2020-11-12T17:24:46.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:24:46.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527969+0000", 2020-11-12T17:24:46.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2689999999999996e-06 2020-11-12T17:24:46.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527976+0000", 2020-11-12T17:24:46.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043768990000000001 2020-11-12T17:24:46.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532353+0000", 2020-11-12T17:24:46.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011210299999999999 2020-11-12T17:24:46.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532465+0000", 2020-11-12T17:24:46.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017931699999999999 2020-11-12T17:24:46.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:46.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532644+0000", 2020-11-12T17:24:46.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002342341 2020-11-12T17:24:46.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:46.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.534986+0000", 2020-11-12T17:24:46.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30120883700000001 2020-11-12T17:24:46.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:46.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836195+0000", 2020-11-12T17:24:46.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0408999999999995e-05 2020-11-12T17:24:46.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836276+0000", 2020-11-12T17:24:46.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1774999999999997e-05 2020-11-12T17:24:46.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836337+0000", 2020-11-12T17:24:46.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998 2020-11-12T17:24:46.423 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.423 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.423 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.424 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:24:46.424 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:24:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.862004220999999, 2020-11-12T17:24:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:24:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:24:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:24:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:24:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:24:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:24:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:24:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:24:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:24:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:24:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:24:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:24:46.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:24:46.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:24:46.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:24:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:24:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:24:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:64408 3.d e61/20 3:b728e6a9:::benchmark_data_smithi036_14212_object8050:head v 61'3888, mlcod=61'3882)", 2020-11-12T17:24:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:24:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.415519740000001, 2020-11-12T17:24:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25887154299999998, 2020-11-12T17:24:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:24:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:24:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:24:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869075+0000", 2020-11-12T17:24:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5099999999999994e-05 2020-11-12T17:24:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869170+0000", 2020-11-12T17:24:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25377307599999999 2020-11-12T17:24:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122943+0000", 2020-11-12T17:24:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0360000000000001e-06 2020-11-12T17:24:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122950+0000", 2020-11-12T17:24:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4113999999999998e-05 2020-11-12T17:24:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122994+0000", 2020-11-12T17:24:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5396999999999998e-05 2020-11-12T17:24:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.123010+0000", 2020-11-12T17:24:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049051490000000001 2020-11-12T17:24:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.127915+0000", 2020-11-12T17:24:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5053999999999998e-05 2020-11-12T17:24:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.127970+0000", 2020-11-12T17:24:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25887154299999998 2020-11-12T17:24:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:2022763f:::benchmark_data_smithi036_14212_object3453:head)])", 2020-11-12T17:24:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.113218+0000", 2020-11-12T17:24:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.171400199000001, 2020-11-12T17:24:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.232486375, 2020-11-12T17:24:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:24:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.113218+0000", 2020-11-12T17:24:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.113218+0000", 2020-11-12T17:24:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:24:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.113187+0000", 2020-11-12T17:24:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1377000000000004e-05 2020-11-12T17:24:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.113268+0000", 2020-11-12T17:24:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21628209500000001 2020-11-12T17:24:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.329550+0000", 2020-11-12T17:24:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0895e-05 2020-11-12T17:24:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.329561+0000", 2020-11-12T17:24:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.015706984 2020-11-12T17:24:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.345268+0000", 2020-11-12T17:24:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00043616800000000002 2020-11-12T17:24:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.345704+0000", 2020-11-12T17:24:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.232486375 2020-11-12T17:24:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:24:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:24:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.742993834, 2020-11-12T17:24:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:24:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:24:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:24:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:24:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:24:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:24:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:24:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:24:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:24:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:24:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:24:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:24:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:24:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:24:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:24:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:24:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:24:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:24:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:24:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:24:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:24:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:24:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:24:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:24:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:24:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:24:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:24:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:24:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:24:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.72685583, 2020-11-12T17:24:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:24:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:24:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:24:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:24:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:24:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:24:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:24:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:24:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:24:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:24:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:24:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:24:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:24:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:24:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:24:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:24:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:24:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:24:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:24:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:24:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.722128151, 2020-11-12T17:24:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:24:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:24:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:24:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:24:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:24:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:24:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:24:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:24:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:24:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:24:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:24:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:24:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:24:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:24:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:24:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:24:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:24:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:24:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:24:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:24:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:46.496 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:46.497 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:24:46.498 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:46.494+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:46.499 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:46.557 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:24:46.559 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:24:46.570 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2020-11-12T17:24:45.817692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75685912,"num_objects":1158,"num_object_clones":0,"num_object_copies":2316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1158,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":71882,"num_write_kb":519355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2321,"num_bytes_recovered":152109056,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72362,"ondisk_log_size":72362,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":6385844,"kb_used_data":94244,"kb_used_omap":0,"kb_used_meta":6291456,"kb_avail":559845196,"statfs":{"total":579820584960,"available":573281480704,"internally_reserved":6442450944,"allocated":96505856,"data_stored":207868046,"data_compressed":1259666,"data_compressed_allocated":92856320,"data_compressed_original":206356480,"omap_allocated":0,"internal_metadata":6442450944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-311230464,"num_objects":-4749,"num_object_clones":0,"num_object_copies":-9498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-207,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4749,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4749,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":13565952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.056815"},"pg_stats":[{"pgid":"3.f","version":"64'4609","reported_seq":"4659","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.528656+0000","last_change":"2020-11-12T17:23:03.465552+0000","last_active":"2020-11-12T17:24:41.528656+0000","last_peered":"2020-11-12T17:24:41.528656+0000","last_clean":"2020-11-12T17:24:41.528656+0000","last_became_active":"2020-11-12T17:23:03.463508+0000","last_became_peered":"2020-11-12T17:23:03.463508+0000","last_unstale":"2020-11-12T17:24:41.528656+0000","last_undegraded":"2020-11-12T17:24:41.528656+0000","last_fullsized":"2020-11-12T17:24:41.528656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4609,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4609,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"64'3976","reported_seq":"4027","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.584093+0000","last_change":"2020-11-12T17:23:03.464759+0000","last_active":"2020-11-12T17:24:41.584093+0000","last_peered":"2020-11-12T17:24:41.584093+0000","last_clean":"2020-11-12T17:24:41.584093+0000","last_became_active":"2020-11-12T17:23:03.463495+0000","last_became_peered":"2020-11-12T17:23:03.463495+0000","last_unstale":"2020-11-12T17:24:41.584093+0000","last_undegraded":"2020-11-12T17:24:41.584093+0000","last_fullsized":"2020-11-12T17:24:41.584093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":3976,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3976,"num_write_kb":28928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"64'4278","reported_seq":"4333","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.557799+0000","last_change":"2020-11-12T17:24:17.056341+0000","last_active":"2020-11-12T17:24:41.557799+0000","last_peered":"2020-11-12T17:24:41.557799+0000","last_clean":"2020-11-12T17:24:41.557799+0000","last_became_active":"2020-11-12T17:23:03.463663+0000","last_became_peered":"2020-11-12T17:23:03.463663+0000","last_unstale":"2020-11-12T17:24:41.557799+0000","last_undegraded":"2020-11-12T17:24:41.557799+0000","last_fullsized":"2020-11-12T17:24:41.557799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3096","last_scrub_stamp":"2020-11-12T17:24:17.056264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:17.056264+0000","log_size":4278,"ondisk_log_size":4278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7536664,"num_objects":116,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4278,"num_write_kb":31233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"64'4740","reported_seq":"4791","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.596877+0000","last_change":"2020-11-12T17:23:03.464079+0000","last_active":"2020-11-12T17:24:41.596877+0000","last_peered":"2020-11-12T17:24:41.596877+0000","last_clean":"2020-11-12T17:24:41.596877+0000","last_became_active":"2020-11-12T17:23:03.463689+0000","last_became_peered":"2020-11-12T17:23:03.463689+0000","last_unstale":"2020-11-12T17:24:41.596877+0000","last_undegraded":"2020-11-12T17:24:41.596877+0000","last_fullsized":"2020-11-12T17:24:41.596877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4740,"ondisk_log_size":4740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4740,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"64'4536","reported_seq":"4590","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.575137+0000","last_change":"2020-11-12T17:24:14.824877+0000","last_active":"2020-11-12T17:24:41.575137+0000","last_peered":"2020-11-12T17:24:41.575137+0000","last_clean":"2020-11-12T17:24:41.575137+0000","last_became_active":"2020-11-12T17:23:03.461922+0000","last_became_peered":"2020-11-12T17:23:03.461922+0000","last_unstale":"2020-11-12T17:24:41.575137+0000","last_undegraded":"2020-11-12T17:24:41.575137+0000","last_fullsized":"2020-11-12T17:24:41.575137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3320","last_scrub_stamp":"2020-11-12T17:24:14.824752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:14.824752+0000","log_size":4536,"ondisk_log_size":4536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4536,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"64'4716","reported_seq":"5026","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-12T17:24:43.860187+0000","last_change":"2020-11-12T17:24:15.170940+0000","last_active":"2020-11-12T17:24:43.860187+0000","last_peered":"2020-11-12T17:24:43.860187+0000","last_clean":"2020-11-12T17:24:43.860187+0000","last_became_active":"2020-11-12T17:23:19.676825+0000","last_became_peered":"2020-11-12T17:23:19.676825+0000","last_unstale":"2020-11-12T17:24:43.860187+0000","last_undegraded":"2020-11-12T17:24:43.860187+0000","last_fullsized":"2020-11-12T17:24:43.860187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3320","last_scrub_stamp":"2020-11-12T17:24:15.170816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:15.170816+0000","log_size":4716,"ondisk_log_size":4716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4716,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":7995392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"64'5262","reported_seq":"5553","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:43.294571+0000","last_change":"2020-11-12T17:24:23.194754+0000","last_active":"2020-11-12T17:24:43.294571+0000","last_peered":"2020-11-12T17:24:43.294571+0000","last_clean":"2020-11-12T17:24:43.294571+0000","last_became_active":"2020-11-12T17:23:27.810569+0000","last_became_peered":"2020-11-12T17:23:27.810569+0000","last_unstale":"2020-11-12T17:24:43.294571+0000","last_undegraded":"2020-11-12T17:24:43.294571+0000","last_fullsized":"2020-11-12T17:24:43.294571+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'4259","last_scrub_stamp":"2020-11-12T17:24:23.194679+0000","last_deep_scrub":"57'4259","last_deep_scrub_stamp":"2020-11-12T17:24:23.194679+0000","last_clean_scrub_stamp":"2020-11-12T17:24:23.194679+0000","log_size":5262,"ondisk_log_size":5262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4995,"num_write_kb":35520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":7405568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"64'4580","reported_seq":"5633","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.560510+0000","last_change":"2020-11-12T17:24:36.795116+0000","last_active":"2020-11-12T17:24:41.560510+0000","last_peered":"2020-11-12T17:24:41.560510+0000","last_clean":"2020-11-12T17:24:41.560510+0000","last_became_active":"2020-11-12T17:24:30.757984+0000","last_became_peered":"2020-11-12T17:24:30.757984+0000","last_unstale":"2020-11-12T17:24:41.560510+0000","last_undegraded":"2020-11-12T17:24:41.560510+0000","last_fullsized":"2020-11-12T17:24:41.560510+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4580,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4580,"num_write_kb":33280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":500,"num_bytes_recovered":32768000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"17","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.742579+0000","last_change":"2020-11-12T17:24:30.646835+0000","last_active":"2020-11-12T17:24:37.742579+0000","last_peered":"2020-11-12T17:24:37.742579+0000","last_clean":"2020-11-12T17:24:37.742579+0000","last_became_active":"2020-11-12T17:24:30.646312+0000","last_became_peered":"2020-11-12T17:24:30.646312+0000","last_unstale":"2020-11-12T17:24:37.742579+0000","last_undegraded":"2020-11-12T17:24:37.742579+0000","last_fullsized":"2020-11-12T17:24:37.742579+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:18.299871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:18.299871+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"64'4303","reported_seq":"4357","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.571640+0000","last_change":"2020-11-12T17:24:13.360816+0000","last_active":"2020-11-12T17:24:41.571640+0000","last_peered":"2020-11-12T17:24:41.571640+0000","last_clean":"2020-11-12T17:24:41.571640+0000","last_became_active":"2020-11-12T17:23:03.464444+0000","last_became_peered":"2020-11-12T17:23:03.464444+0000","last_unstale":"2020-11-12T17:24:41.571640+0000","last_undegraded":"2020-11-12T17:24:41.571640+0000","last_fullsized":"2020-11-12T17:24:41.571640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3080","last_scrub_stamp":"2020-11-12T17:24:13.360686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:13.360686+0000","log_size":4303,"ondisk_log_size":4303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4303,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"66","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.744577+0000","last_change":"2020-11-12T17:24:30.654277+0000","last_active":"2020-11-12T17:24:37.744577+0000","last_peered":"2020-11-12T17:24:37.744577+0000","last_clean":"2020-11-12T17:24:37.744577+0000","last_became_active":"2020-11-12T17:24:30.653733+0000","last_became_peered":"2020-11-12T17:24:30.653733+0000","last_unstale":"2020-11-12T17:24:37.744577+0000","last_undegraded":"2020-11-12T17:24:37.744577+0000","last_fullsized":"2020-11-12T17:24:37.744577+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:00.156362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:00.156362+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"64'4590","reported_seq":"4642","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:43.076035+0000","last_change":"2020-11-12T17:23:03.464964+0000","last_active":"2020-11-12T17:24:43.076035+0000","last_peered":"2020-11-12T17:24:43.076035+0000","last_clean":"2020-11-12T17:24:43.076035+0000","last_became_active":"2020-11-12T17:23:03.464617+0000","last_became_peered":"2020-11-12T17:23:03.464617+0000","last_unstale":"2020-11-12T17:24:43.076035+0000","last_undegraded":"2020-11-12T17:24:43.076035+0000","last_fullsized":"2020-11-12T17:24:43.076035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4590,"ondisk_log_size":4590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4590,"num_write_kb":32640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"39","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.737124+0000","last_change":"2020-11-12T17:23:27.984703+0000","last_active":"2020-11-12T17:24:37.737124+0000","last_peered":"2020-11-12T17:24:37.737124+0000","last_clean":"2020-11-12T17:24:37.737124+0000","last_became_active":"2020-11-12T17:23:27.983997+0000","last_became_peered":"2020-11-12T17:23:27.983997+0000","last_unstale":"2020-11-12T17:24:37.737124+0000","last_undegraded":"2020-11-12T17:24:37.737124+0000","last_fullsized":"2020-11-12T17:24:37.737124+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:22:50.324059+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"64'4194","reported_seq":"5303","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-12T17:24:43.860186+0000","last_change":"2020-11-12T17:24:35.441569+0000","last_active":"2020-11-12T17:24:43.860186+0000","last_peered":"2020-11-12T17:24:43.860186+0000","last_clean":"2020-11-12T17:24:43.860186+0000","last_became_active":"2020-11-12T17:24:30.786072+0000","last_became_peered":"2020-11-12T17:24:30.786072+0000","last_unstale":"2020-11-12T17:24:43.860186+0000","last_undegraded":"2020-11-12T17:24:43.860186+0000","last_fullsized":"2020-11-12T17:24:43.860186+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3224","last_scrub_stamp":"2020-11-12T17:24:20.376036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:20.376036+0000","log_size":4194,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4194,"num_write_kb":29824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":518,"num_bytes_recovered":33947648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"65","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.744506+0000","last_change":"2020-11-12T17:24:15.328590+0000","last_active":"2020-11-12T17:24:37.744506+0000","last_peered":"2020-11-12T17:24:37.744506+0000","last_clean":"2020-11-12T17:24:37.744506+0000","last_became_active":"2020-11-12T17:23:27.787364+0000","last_became_peered":"2020-11-12T17:23:27.787364+0000","last_unstale":"2020-11-12T17:24:37.744506+0000","last_undegraded":"2020-11-12T17:24:37.744506+0000","last_fullsized":"2020-11-12T17:24:37.744506+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:15.328459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:15.328459+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"62","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.741731+0000","last_change":"2020-11-12T17:24:12.812989+0000","last_active":"2020-11-12T17:24:37.741731+0000","last_peered":"2020-11-12T17:24:37.741731+0000","last_clean":"2020-11-12T17:24:37.741731+0000","last_became_active":"2020-11-12T17:22:47.069110+0000","last_became_peered":"2020-11-12T17:22:47.069110+0000","last_unstale":"2020-11-12T17:24:37.741731+0000","last_undegraded":"2020-11-12T17:24:37.741731+0000","last_fullsized":"2020-11-12T17:24:37.741731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:24:12.812899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:24:12.812899+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"64'4455","reported_seq":"4506","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.568749+0000","last_change":"2020-11-12T17:23:03.467425+0000","last_active":"2020-11-12T17:24:41.568749+0000","last_peered":"2020-11-12T17:24:41.568749+0000","last_clean":"2020-11-12T17:24:41.568749+0000","last_became_active":"2020-11-12T17:23:03.467027+0000","last_became_peered":"2020-11-12T17:23:03.467027+0000","last_unstale":"2020-11-12T17:24:41.568749+0000","last_undegraded":"2020-11-12T17:24:41.568749+0000","last_fullsized":"2020-11-12T17:24:41.568749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4455,"ondisk_log_size":4455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4455,"num_write_kb":32448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"66","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.741838+0000","last_change":"2020-11-12T17:24:30.649974+0000","last_active":"2020-11-12T17:24:37.741838+0000","last_peered":"2020-11-12T17:24:37.741838+0000","last_clean":"2020-11-12T17:24:37.741838+0000","last_became_active":"2020-11-12T17:24:30.649571+0000","last_became_peered":"2020-11-12T17:24:30.649571+0000","last_unstale":"2020-11-12T17:24:37.741838+0000","last_undegraded":"2020-11-12T17:24:37.741838+0000","last_fullsized":"2020-11-12T17:24:37.741838+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:11.795281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:11.795281+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"64'4417","reported_seq":"4471","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.584150+0000","last_change":"2020-11-12T17:24:12.251153+0000","last_active":"2020-11-12T17:24:41.584150+0000","last_peered":"2020-11-12T17:24:41.584150+0000","last_clean":"2020-11-12T17:24:41.584150+0000","last_became_active":"2020-11-12T17:23:03.462984+0000","last_became_peered":"2020-11-12T17:23:03.462984+0000","last_unstale":"2020-11-12T17:24:41.584150+0000","last_undegraded":"2020-11-12T17:24:41.584150+0000","last_fullsized":"2020-11-12T17:24:41.584150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"55'3208","last_scrub_stamp":"2020-11-12T17:24:12.251020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:12.251020+0000","log_size":4417,"ondisk_log_size":4417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4417,"num_write_kb":32000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"57","reported_epoch":"63","state":"active+clean","last_fresh":"2020-11-12T17:24:37.741217+0000","last_change":"2020-11-12T17:24:14.829837+0000","last_active":"2020-11-12T17:24:37.741217+0000","last_peered":"2020-11-12T17:24:37.741217+0000","last_clean":"2020-11-12T17:24:37.741217+0000","last_became_active":"2020-11-12T17:22:51.723115+0000","last_became_peered":"2020-11-12T17:22:51.723115+0000","last_unstale":"2020-11-12T17:24:37.741217+0000","last_undegraded":"2020-11-12T17:24:37.741217+0000","last_fullsized":"2020-11-12T17:24:37.741217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:24:14.829737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"64'4360","reported_seq":"5551","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.583182+0000","last_change":"2020-11-12T17:24:37.214790+0000","last_active":"2020-11-12T17:24:41.583182+0000","last_peered":"2020-11-12T17:24:41.583182+0000","last_clean":"2020-11-12T17:24:41.583182+0000","last_became_active":"2020-11-12T17:24:30.809224+0000","last_became_peered":"2020-11-12T17:24:30.809224+0000","last_unstale":"2020-11-12T17:24:41.583182+0000","last_undegraded":"2020-11-12T17:24:41.583182+0000","last_fullsized":"2020-11-12T17:24:41.583182+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:23:02.421163+0000","log_size":4360,"ondisk_log_size":4360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6152192,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4360,"num_write_kb":31672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":563,"num_bytes_recovered":36896768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"64'4678","reported_seq":"4732","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.582302+0000","last_change":"2020-11-12T17:24:38.781974+0000","last_active":"2020-11-12T17:24:41.582302+0000","last_peered":"2020-11-12T17:24:41.582302+0000","last_clean":"2020-11-12T17:24:41.582302+0000","last_became_active":"2020-11-12T17:23:03.461966+0000","last_became_peered":"2020-11-12T17:23:03.461966+0000","last_unstale":"2020-11-12T17:24:41.582302+0000","last_undegraded":"2020-11-12T17:24:41.582302+0000","last_fullsized":"2020-11-12T17:24:41.582302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'4466","last_scrub_stamp":"2020-11-12T17:24:38.781884+0000","last_deep_scrub":"63'4466","last_deep_scrub_stamp":"2020-11-12T17:24:38.781884+0000","last_clean_scrub_stamp":"2020-11-12T17:24:38.781884+0000","log_size":4678,"ondisk_log_size":4678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4465,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"45","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-12T17:24:43.860252+0000","last_change":"2020-11-12T17:24:30.652630+0000","last_active":"2020-11-12T17:24:43.860252+0000","last_peered":"2020-11-12T17:24:43.860252+0000","last_clean":"2020-11-12T17:24:43.860252+0000","last_became_active":"2020-11-12T17:24:30.652206+0000","last_became_peered":"2020-11-12T17:24:30.652206+0000","last_unstale":"2020-11-12T17:24:43.860252+0000","last_undegraded":"2020-11-12T17:24:43.860252+0000","last_fullsized":"2020-11-12T17:24:43.860252+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:16.370222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:16.370222+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"50","reported_epoch":"65","state":"active+clean","last_fresh":"2020-11-12T17:24:43.860160+0000","last_change":"2020-11-12T17:24:18.165744+0000","last_active":"2020-11-12T17:24:43.860160+0000","last_peered":"2020-11-12T17:24:43.860160+0000","last_clean":"2020-11-12T17:24:43.860160+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:24:43.860160+0000","last_undegraded":"2020-11-12T17:24:43.860160+0000","last_fullsized":"2020-11-12T17:24:43.860160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:24:18.165582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"64'4666","reported_seq":"5741","reported_epoch":"64","state":"active+clean","last_fresh":"2020-11-12T17:24:41.568790+0000","last_change":"2020-11-12T17:24:38.618030+0000","last_active":"2020-11-12T17:24:41.568790+0000","last_peered":"2020-11-12T17:24:41.568790+0000","last_clean":"2020-11-12T17:24:41.568790+0000","last_became_active":"2020-11-12T17:24:30.766880+0000","last_became_peered":"2020-11-12T17:24:30.766880+0000","last_unstale":"2020-11-12T17:24:41.568790+0000","last_undegraded":"2020-11-12T17:24:41.568790+0000","last_fullsized":"2020-11-12T17:24:41.568790+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"56'3728","last_scrub_stamp":"2020-11-12T17:24:19.676454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:23:02.421163+0000","last_clean_scrub_stamp":"2020-11-12T17:24:19.676454+0000","log_size":4666,"ondisk_log_size":4666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4666,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":33095680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":75685912,"num_objects":1156,"num_object_clones":0,"num_object_copies":2312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1156,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":71880,"num_write_kb":519353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2321,"num_bytes_recovered":152109056,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":138219520,"data_stored":288866352,"data_compressed":1858953,"data_compressed_allocated":138211328,"data_compressed_original":288866304,"omap_allocated":0,"internal_metadata":0},"log_size":72360,"ondisk_log_size":72360,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1076956,"kb_used_data":28276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93294884,"statfs":{"total":96636764160,"available":95533961216,"internally_reserved":1073741824,"allocated":28954624,"data_stored":64668220,"data_compressed":385710,"data_compressed_allocated":28368896,"data_compressed_original":64421888,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":2.8740000000000001},{"interface":"front","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":7.4349999999999996,"5min":7.4349999999999996,"15min":7.4349999999999996},"last":2.8919999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.27,"5min":2.27,"15min":2.27},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":7.585,"5min":7.585,"15min":7.585},"last":1.452},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.94599999999999995}]},{"osd":2,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":7.6310000000000002,"5min":7.6310000000000002,"15min":7.6310000000000002},"last":2.9769999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"min":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.1180000000000001},{"interface":"front","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":7.5410000000000004,"5min":7.5410000000000004,"15min":7.5410000000000004},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":53.758000000000003,"5min":53.758000000000003,"15min":53.758000000000003},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":503.50200000000001,"5min":503.50200000000001,"15min":503.50200000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.742,"5min":2.742,"15min":2.742},"min":{"1min":1.45,"5min":1.45,"15min":1.45},"max":{"1min":7.7169999999999996,"5min":7.7169999999999996,"15min":7.7169999999999996},"last":2.8570000000000002},{"interface":"front","average":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":7.7480000000000002,"5min":7.7480000000000002,"15min":7.7480000000000002},"last":2.9089999999999998}]},{"osd":6,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":7.6630000000000003,"5min":7.6630000000000003,"15min":7.6630000000000003},"last":0.84299999999999997},{"interface":"front","average":{"1min":53.441000000000003,"5min":53.441000000000003,"15min":53.441000000000003},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":975.20899999999995,"5min":975.20899999999995,"15min":975.20899999999995},"last":0.94299999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1067316,"kb_used_data":18732,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93304524,"statfs":{"total":96636764160,"available":95543832576,"internally_reserved":1073741824,"allocated":19181568,"data_stored":37400323,"data_compressed":249425,"data_compressed_allocated":18575360,"data_compressed_original":37150720,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":1.825,"15min":1.825},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":1.046},{"interface":"front","average":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":5.3079999999999998,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":2.5680000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.042}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":5.4329999999999998,"5min":5.4329999999999998,"15min":5.4329999999999998},"last":2.6099999999999999},{"interface":"front","average":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":8.0969999999999995,"5min":8.0969999999999995,"15min":8.0969999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.742,"5min":2.742,"15min":2.742},"min":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":2.8650000000000002},{"interface":"front","average":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"min":{"1min":1.024,"5min":1.024,"15min":1.024},"max":{"1min":8.202,"5min":8.202,"15min":8.202},"last":2.2229999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":1.0800000000000001},{"interface":"front","average":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":8.3680000000000003,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":2.6459999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.6680000000000001,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"min":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.3100000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":8.5299999999999994,"5min":8.5299999999999994,"15min":8.5299999999999994},"last":2.899},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.9049999999999998,"15min":2.9049999999999998},"min":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"max":{"1min":8.3200000000000003,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.65100000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049160,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322680,"statfs":{"total":96636764160,"available":95562424320,"internally_reserved":1073741824,"allocated":589824,"data_stored":252749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":2.6640000000000001},{"interface":"front","average":{"1min":47.031999999999996,"5min":47.031999999999996,"15min":47.031999999999996},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":948.30899999999997,"5min":948.30899999999997,"15min":948.30899999999997},"last":2.2709999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":9.7530000000000001,"5min":9.7530000000000001,"15min":9.7530000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":162.126,"5min":162.126,"15min":162.126},"last":1.5289999999999999},{"interface":"front","average":{"1min":9.4280000000000008,"5min":9.4280000000000008,"15min":9.4280000000000008},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":163.59899999999999,"5min":163.59899999999999,"15min":163.59899999999999},"last":2.3929999999999998}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.9179999999999999},{"interface":"front","average":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":2.169}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":3.423,"5min":3.423,"15min":3.423},"last":1.8480000000000001},{"interface":"front","average":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":4.3959999999999999,"5min":4.3959999999999999,"15min":4.3959999999999999},"last":2.6070000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0529999999999999,"5min":2.0529999999999999,"15min":2.0529999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":2.3780000000000001},{"interface":"front","average":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":3.5190000000000001,"5min":3.5190000000000001,"15min":3.5190000000000001},"last":2.851}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":33.646999999999998,"5min":33.646999999999998,"15min":33.646999999999998},"min":{"1min":1.218,"5min":1.218,"15min":1.218},"max":{"1min":665.13999999999999,"5min":665.13999999999999,"15min":665.13999999999999},"last":1.966},{"interface":"front","average":{"1min":2.242,"5min":2.242,"15min":2.242},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":2.7879999999999998}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":3.6160000000000001,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":2.7370000000000001},{"interface":"front","average":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":3.2679999999999998,"5min":3.2679999999999998,"15min":3.2679999999999998},"last":2.5}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049200,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322640,"statfs":{"total":96636764160,"available":95562383360,"internally_reserved":1073741824,"allocated":630784,"data_stored":259390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.768,"15min":1.768},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"min":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.613}]},{"osd":1,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":2.254,"5min":2.254,"15min":2.254},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.343}]},{"osd":2,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":2.073,"15min":2.073},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":9.1400000000000006,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":0.95999999999999996},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"min":{"1min":1.417,"5min":1.417,"15min":1.417},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.6499999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":4.2130000000000001,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.5720000000000001},{"interface":"front","average":{"1min":2.46,"5min":2.46,"15min":2.46},"min":{"1min":1.234,"5min":1.234,"15min":1.234},"max":{"1min":9.2550000000000008,"5min":9.2550000000000008,"15min":9.2550000000000008},"last":1.4019999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.2309999999999999,"5min":2.2309999999999999,"15min":2.2309999999999999},"min":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"max":{"1min":3.4910000000000001,"5min":3.4910000000000001,"15min":3.4910000000000001},"last":1.702},{"interface":"front","average":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":8.7189999999999994,"5min":8.7189999999999994,"15min":8.7189999999999994},"last":2.1509999999999998}]},{"osd":5,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":9.7710000000000008,"5min":9.7710000000000008,"15min":9.7710000000000008},"last":1.8460000000000001},{"interface":"front","average":{"1min":22.742000000000001,"5min":22.742000000000001,"15min":22.742000000000001},"min":{"1min":1.609,"5min":1.609,"15min":1.609},"max":{"1min":445.34699999999998,"5min":445.34699999999998,"15min":445.34699999999998},"last":2.2370000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":8.8339999999999996,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":1.8839999999999999},{"interface":"front","average":{"1min":2.524,"5min":2.524,"15min":2.524},"min":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":9.3059999999999992,"5min":9.3059999999999992,"15min":9.3059999999999992},"last":1.4370000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1069800,"kb_used_data":21216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93302040,"statfs":{"total":96636764160,"available":95541288960,"internally_reserved":1073741824,"allocated":21725184,"data_stored":55425758,"data_compressed":291451,"data_compressed_allocated":21106688,"data_compressed_original":55173120,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":66.608000000000004,"5min":66.608000000000004,"15min":66.608000000000004},"last":1.3480000000000001},{"interface":"front","average":{"1min":5.3899999999999997,"5min":5.3899999999999997,"15min":5.3899999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":67.099999999999994,"5min":67.099999999999994,"15min":67.099999999999994},"last":1.4430000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":54.027000000000001,"5min":54.027000000000001,"15min":54.027000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":995.93899999999996,"5min":995.93899999999996,"15min":995.93899999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":1.079}]},{"osd":3,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":15.675000000000001,"5min":15.675000000000001,"15min":15.675000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":269.27100000000002,"5min":269.27100000000002,"15min":269.27100000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"min":{"1min":1.399,"5min":1.399,"15min":1.399},"max":{"1min":3.2839999999999998,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.944,"5min":1.944,"15min":1.944},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":0.85499999999999998},{"interface":"front","average":{"1min":50.664999999999999,"5min":50.664999999999999,"15min":50.664999999999999},"min":{"1min":1.23,"5min":1.23,"15min":1.23},"max":{"1min":920.76900000000001,"5min":920.76900000000001,"15min":920.76900000000001},"last":1.0589999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":3.5249999999999999,"5min":3.5249999999999999,"15min":3.5249999999999999},"last":3.5329999999999999},{"interface":"front","average":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"min":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"max":{"1min":3.738,"5min":3.738,"15min":3.738},"last":931.65200000000004}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":29.132999999999999,"5min":29.132999999999999,"15min":29.132999999999999},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":502.12900000000002,"5min":502.12900000000002,"15min":502.12900000000002},"last":1.135},{"interface":"front","average":{"1min":49.103999999999999,"5min":49.103999999999999,"15min":49.103999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":502.42099999999999,"5min":502.42099999999999,"15min":502.42099999999999},"last":1.173}]}]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1073412,"kb_used_data":24828,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93298428,"statfs":{"total":96636764160,"available":95537590272,"internally_reserved":1073741824,"allocated":25423872,"data_stored":49861606,"data_compressed":333080,"data_compressed_allocated":24805376,"data_compressed_original":49610752,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.798,"15min":1.798},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":4.4290000000000003,"5min":4.4290000000000003,"15min":4.4290000000000003},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":10.403,"5min":10.403,"15min":10.403},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":22.77,"5min":22.77,"15min":22.77},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":440.65899999999999,"5min":440.65899999999999,"15min":440.65899999999999},"last":2.085},{"interface":"front","average":{"1min":1.839,"5min":1.839,"15min":1.839},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":2.1349999999999998}]},{"osd":2,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.347,"5min":2.347,"15min":2.347},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":4.9740000000000002,"5min":4.9740000000000002,"15min":4.9740000000000002},"last":2.4049999999999998},{"interface":"front","average":{"1min":1.994,"5min":1.994,"15min":1.994},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":3.7389999999999999,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.5409999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":10.318,"5min":10.318,"15min":10.318},"last":0.76200000000000001},{"interface":"front","average":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":5.1029999999999998,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":2.4820000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":32.210000000000001,"5min":32.210000000000001,"15min":32.210000000000001},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":622.07799999999997,"5min":622.07799999999997,"15min":622.07799999999997},"last":3.6059999999999999},{"interface":"front","average":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"max":{"1min":10.436,"5min":10.436,"15min":10.436},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.625,"5min":2.625,"15min":2.625},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":5.0419999999999998,"5min":5.0419999999999998,"15min":5.0419999999999998},"last":2.4470000000000001},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"min":{"1min":1.21,"5min":1.21,"15min":1.21},"max":{"1min":11.497999999999999,"5min":11.497999999999999,"15min":11.497999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":10.513999999999999,"5min":10.513999999999999,"15min":10.513999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":30.190000000000001,"5min":30.190000000000001,"15min":30.190000000000001},"min":{"1min":1.101,"5min":1.101,"15min":1.101},"max":{"1min":577.35900000000004,"5min":577.35900000000004,"15min":577.35900000000004},"last":2.524}]}]}]}} 2020-11-12T17:24:48.677 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-12T17:24:48.678 INFO:tasks.thrashosds.thrasher:Waiting for trim 2020-11-12T17:24:48.682 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:48.682 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:48.683 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:24:48.683 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:48.683 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:48.684 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:48.684 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:48.684 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:48.684 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:48.685 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:48.685 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:48.685 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:46.824+0000 7fc24d2e3700 -1 osd.3 67 handle_osd_map injecting map crc failure 2020-11-12T17:24:48.685 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'unique_pool_0' removed 2020-11-12T17:24:48.686 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:24:48.686 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:24:48.687 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:48.687 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:48.687 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:24:48.687 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:24:48.688 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:24:48.688 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:24:48.688 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:24:48.688 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:24:48.689 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:48.689 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:48.690 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:48.691 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2020-11-12T17:24:48.692 INFO:tasks.radosbench:Beginning radosbench... 2020-11-12T17:24:48.692 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2020-11-12T17:24:48.693 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create unique_pool_1 16 2020-11-12T17:24:48.694 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:48.682+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:48.790 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:48.786+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:48.822 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:48.822 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:48.831 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:48.892 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:48.890+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:48.994 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:48.986+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:49.010 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:49.011 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:49.021 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:49.088 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:49.084+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:49.190 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:49.190 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:49.191 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:49.184+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:49.201 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:49.293 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:49.290+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:49.305 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:49.306 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:49.313 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:49.394 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:49.392+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:49.465 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:49.465 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:49.474 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:49.498 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:49.494+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:49.595 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:49.595 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:49.600 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:49.592+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:49.608 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:49.703 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:49.696+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:49.768 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:49.769 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:49.778 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:49.820 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:49.816+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:49.845 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'unique_pool_1' created 2020-11-12T17:24:49.861 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2020-11-12T17:24:49.905 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:49.900+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:49.934 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:49.935 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:49.941 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:24:50.006 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:50.002+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:50.099 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:50.099 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:50.107 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:50.100+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:50.109 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:24:50.209 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:50.206+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:50.257 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:50.257 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:50.266 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:24:50.316 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:50.312+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:50.373 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:50.373 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:50.382 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:50.412 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:50.406+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:50.513 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:50.510+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:50.537 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:50.537 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:50.546 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:50.613 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:50.608+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:50.658 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:50.659 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:50.668 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:50.687 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:24:50.691 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:24:50.715 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:50.710+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:50.818 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:50.810+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:50.823 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:50.824 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:50.842 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:50.856 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:50.850+0000 7f9a0b6b4700 -1 osd.5 69 handle_osd_map injecting map crc failure 2020-11-12T17:24:50.860 INFO:teuthology.orchestra.run.smithi036.stderr:enabled application 'rados' on pool 'unique_pool_1' 2020-11-12T17:24:50.870 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:50.900 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:50.917 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:50.914+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:50.923 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:50.951 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:50.958 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:50.958 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:50.958 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:24:50.959 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:50.971 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:50.987 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:51.012 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:51.019 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:51.012+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:51.041 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:51.043 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:24:51.043 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:51.043 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:51.043 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:24:51.043 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:24:51.044 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:24:51.044 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:24:51.044 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:24:51.044 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:24:51.045 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:51.045 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:51.119 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:51.114+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:51.124 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:51.124 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:51.124 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:51.124 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:51.124 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:51.132 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:51.220 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:51.218+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:51.291 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:51.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:24:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.530048354, 2020-11-12T17:24:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:24:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.292 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:24:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:24:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:24:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:24:51.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:24:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:24:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:24:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:24:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:24:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:24:51.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:24:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:24:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:24:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:24:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:24:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:51.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:24:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:24:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:24:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:24:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:24:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:24:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:24:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:24:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:24:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:24:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:24:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.523249503, 2020-11-12T17:24:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:24:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.304 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:24:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:24:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:24:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:24:51.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:24:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:24:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:24:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:24:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:24:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:24:51.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:24:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:24:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:24:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:24:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:24:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1104 3.9 3:9f55e211:::benchmark_data_smithi036_14212_object137:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:24:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 105.67145515199999, 2020-11-12T17:24:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001, 2020-11-12T17:24:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.312 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1104 2020-11-12T17:24:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:51.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617423+0000", 2020-11-12T17:24:51.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:51.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617385+0000", 2020-11-12T17:24:51.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9141999999999994e-05 2020-11-12T17:24:51.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617484+0000", 2020-11-12T17:24:51.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2413e-05 2020-11-12T17:24:51.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617497+0000", 2020-11-12T17:24:51.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1659999999999999e-06 2020-11-12T17:24:51.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.617503+0000", 2020-11-12T17:24:51.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032791000000000001 2020-11-12T17:24:51.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620782+0000", 2020-11-12T17:24:51.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102198 2020-11-12T17:24:51.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620884+0000", 2020-11-12T17:24:51.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114058 2020-11-12T17:24:51.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:51.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.620998+0000", 2020-11-12T17:24:51.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018203270000000001 2020-11-12T17:24:51.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.622818+0000", 2020-11-12T17:24:51.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.203924995 2020-11-12T17:24:51.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826743+0000", 2020-11-12T17:24:51.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012106 2020-11-12T17:24:51.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.826865+0000", 2020-11-12T17:24:51.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014220699999999999 2020-11-12T17:24:51.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.827007+0000", 2020-11-12T17:24:51.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.20958339000000001 2020-11-12T17:24:51.322 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.322 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.322 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.323 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:24:51.323 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:51.323 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 105.279990727, 2020-11-12T17:24:51.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:24:51.324 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.324 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.324 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.324 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.324 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.324 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:24:51.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.324 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:51.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:24:51.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:51.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:24:51.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:24:51.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:24:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:24:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:24:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:24:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:24:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:24:51.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:24:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:24:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:24:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:24:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:24:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:24:51.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:24:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:24:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:24:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:24:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:24:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:24:51.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:24:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:24:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.333 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:24:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 105.27277554600001, 2020-11-12T17:24:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:24:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.334 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:24:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:24:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:24:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:24:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:24:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:24:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:24:51.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:24:51.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:24:51.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:24:51.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:24:51.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:24:51.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:24:51.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:24:51.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:24:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:24:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:51.341 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.602330655, 2020-11-12T17:24:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:24:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.342 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:24:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:51.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:24:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:24:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:24:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:24:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:24:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:24:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:24:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:24:51.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:24:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:24:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:24:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:24:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:24:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:24:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:24:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:24:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:24:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:24:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:24:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:24:51.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:24:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:24:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:24:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:24:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.352 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.602165752, 2020-11-12T17:24:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:24:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.353 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:24:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:24:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:51.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:24:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:24:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:24:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:24:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:24:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:24:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:24:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:24:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:24:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:24:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:24:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:24:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:24:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:24:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:24:51.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:24:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:24:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:24:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:24:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:24:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:24:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:24:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:24:51.363 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.598002518, 2020-11-12T17:24:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:24:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:24:51.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:24:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:24:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:24:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:24:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:24:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:24:51.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:24:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:24:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:24:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:24:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:24:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:24:51.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:24:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:24:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:24:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.370 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:24:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.596685683, 2020-11-12T17:24:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:24:51.371 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:24:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:24:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:24:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:24:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:24:51.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:24:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:24:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:24:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:24:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:24:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:24:51.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:24:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:24:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:24:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:24:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.378 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:24:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.734366050999995, 2020-11-12T17:24:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:24:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:24:51.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:24:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:24:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:24:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:24:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:24:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:24:51.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:24:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:24:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:24:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:24:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:24:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:24:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:24:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:24:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:24:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:24:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:24:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:24:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.406564083000006, 2020-11-12T17:24:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:24:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.387 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:24:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:24:51.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:24:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:24:51.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:24:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:24:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:24:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:24:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:24:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:24:51.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:24:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:24:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:24:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:24:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:24:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:24:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:24:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:24:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:24:51.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:24:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:24:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:24:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:24:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:24:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:24:51.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:24:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:24:51.398 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.399320373999998, 2020-11-12T17:24:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:24:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:24:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:51.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:24:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:24:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:24:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:24:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:24:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:24:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:24:51.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:24:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:24:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:24:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:24:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:24:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:24:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:24:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.406 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:24:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.236972671000004, 2020-11-12T17:24:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:24:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.407 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:24:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:24:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:24:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:24:51.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:24:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:24:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:24:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:24:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:24:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:24:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:24:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:24:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:24:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:24:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:24:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:24:51.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:24:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:24:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:24:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:24:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:24:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:24:51.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:24:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:24:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:24:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 57.296144914000003, 2020-11-12T17:24:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:24:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.418 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:24:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:24:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:24:51.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:24:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:24:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:24:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:24:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:24:51.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:24:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:24:51.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:24:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:24:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:24:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:24:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:24:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:51.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:24:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:24:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:24:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:24:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:24:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:24:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:24:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:24:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:24:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:24:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.428 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:24:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 57.288486104999997, 2020-11-12T17:24:51.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:24:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:24:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:24:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:24:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:24:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:24:51.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:24:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:24:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:24:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:24:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:24:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:24:51.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:24:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:24:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:24:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:24:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:24:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39832 3.3 3:cb2faec6:::benchmark_data_smithi036_14212_object4978:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:24:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.912712368999998, 2020-11-12T17:24:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.229556766, 2020-11-12T17:24:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39832 2020-11-12T17:24:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:24:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:24:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999251 2020-11-12T17:24:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376091+0000", 2020-11-12T17:24:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018965799999999999 2020-11-12T17:24:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376281+0000", 2020-11-12T17:24:51.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7319999999999999e-05 2020-11-12T17:24:51.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376308+0000", 2020-11-12T17:24:51.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8396000000000001e-05 2020-11-12T17:24:51.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376327+0000", 2020-11-12T17:24:51.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006884991 2020-11-12T17:24:51.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383212+0000", 2020-11-12T17:24:51.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5163999999999999e-05 2020-11-12T17:24:51.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383307+0000", 2020-11-12T17:24:51.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015254400000000001 2020-11-12T17:24:51.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:24:51.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383459+0000", 2020-11-12T17:24:51.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041117929999999999 2020-11-12T17:24:51.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.387571+0000", 2020-11-12T17:24:51.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21802176100000001 2020-11-12T17:24:51.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605593+0000", 2020-11-12T17:24:51.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3146999999999996e-05 2020-11-12T17:24:51.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605666+0000", 2020-11-12T17:24:51.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6776e-05 2020-11-12T17:24:51.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605723+0000", 2020-11-12T17:24:51.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.229556766 2020-11-12T17:24:51.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.447 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.447 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:39832 3.3 e51/20 ondisk, result = 0)", 2020-11-12T17:24:51.448 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.386034+0000", 2020-11-12T17:24:51.448 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.902844625, 2020-11-12T17:24:51.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21969730200000001, 2020-11-12T17:24:51.448 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.448 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.448 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.386034+0000", 2020-11-12T17:24:51.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.386034+0000", 2020-11-12T17:24:51.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:51.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.385992+0000", 2020-11-12T17:24:51.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101897 2020-11-12T17:24:51.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.386094+0000", 2020-11-12T17:24:51.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21941154500000001 2020-11-12T17:24:51.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605506+0000", 2020-11-12T17:24:51.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.241e-06 2020-11-12T17:24:51.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605512+0000", 2020-11-12T17:24:51.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3314999999999999e-05 2020-11-12T17:24:51.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605575+0000", 2020-11-12T17:24:51.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9410000000000002e-06 2020-11-12T17:24:51.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605585+0000", 2020-11-12T17:24:51.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014588599999999999 2020-11-12T17:24:51.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605731+0000", 2020-11-12T17:24:51.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21969730200000001 2020-11-12T17:24:51.454 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.455 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.455 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:50240 3.1 e55/20 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head v 55'3224, mlcod=55'3218)", 2020-11-12T17:24:51.455 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:24:51.455 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 38.921836560000003, 2020-11-12T17:24:51.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149, 2020-11-12T17:24:51.456 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.456 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.456 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:24:51.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:24:51.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:24:51.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367024+0000", 2020-11-12T17:24:51.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9963000000000002e-05 2020-11-12T17:24:51.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367084+0000", 2020-11-12T17:24:51.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23018651500000001 2020-11-12T17:24:51.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597271+0000", 2020-11-12T17:24:51.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2030000000000003e-06 2020-11-12T17:24:51.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597278+0000", 2020-11-12T17:24:51.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3430000000000002e-05 2020-11-12T17:24:51.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597331+0000", 2020-11-12T17:24:51.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2829000000000001e-05 2020-11-12T17:24:51.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597354+0000", 2020-11-12T17:24:51.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064125579999999996 2020-11-12T17:24:51.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603767+0000", 2020-11-12T17:24:51.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2398999999999997e-05 2020-11-12T17:24:51.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603829+0000", 2020-11-12T17:24:51.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149 2020-11-12T17:24:51.463 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.463 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.463 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.463 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(osd.4.0:8091 3.9 e56/35 ondisk, result = 0)", 2020-11-12T17:24:51.463 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:24:51.463 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.909057074, 2020-11-12T17:24:51.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999, 2020-11-12T17:24:51.464 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.464 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.464 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:24:51.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:24:51.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:24:51.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379795+0000", 2020-11-12T17:24:51.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8462999999999998e-05 2020-11-12T17:24:51.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379864+0000", 2020-11-12T17:24:51.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23719935 2020-11-12T17:24:51.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617063+0000", 2020-11-12T17:24:51.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5229999999999998e-06 2020-11-12T17:24:51.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617071+0000", 2020-11-12T17:24:51.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0618999999999995e-05 2020-11-12T17:24:51.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617151+0000", 2020-11-12T17:24:51.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4123e-05 2020-11-12T17:24:51.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617165+0000", 2020-11-12T17:24:51.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4392e-05 2020-11-12T17:24:51.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617260+0000", 2020-11-12T17:24:51.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999 2020-11-12T17:24:51.470 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.470 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.470 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.471 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:24:51.471 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:24:51.471 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.403231000000002, 2020-11-12T17:24:51.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:24:51.471 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.471 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.471 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:24:51.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:24:51.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:24:51.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:24:51.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:24:51.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:24:51.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:24:51.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:24:51.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:24:51.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:24:51.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:24:51.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:24:51.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:24:51.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:24:51.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:24:51.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:24:51.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:24:51.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.478 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.479 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.479 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.479 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:51.480 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:51.476+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:51.481 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:51.581 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:51.580+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:51.648 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:24:51.649 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:51.660 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:51.683 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:51.676+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:51.771 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:51.771 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:51.771 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:51.772 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:51.772 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:51.780 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:51.829 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:51.826+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:51.869 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:24:51.874 INFO:teuthology.orchestra.run.smithi036:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_1 bench 90 write' 2020-11-12T17:24:51.880 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2020-11-12T17:24:51.880 INFO:teuthology.orchestra.run:waiting for 3000 2020-11-12T17:24:51.886 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:51.882+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:51.899 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:24:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.388054156, 2020-11-12T17:24:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:24:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:51.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:51.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:24:51.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:24:51.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:24:51.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:24:51.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:24:51.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:24:51.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:24:51.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:24:51.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:24:51.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:24:51.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:24:51.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:24:51.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:24:51.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:24:51.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:24:51.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:24:51.909 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.909 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.909 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.910 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:51.910 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:51.910 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 97.366044591000005, 2020-11-12T17:24:51.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:24:51.910 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.910 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:51.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:51.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:51.911 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:24:51.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.911 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:51.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:51.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:51.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:24:51.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:24:51.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:24:51.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:24:51.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:24:51.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:24:51.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:24:51.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:24:51.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:24:51.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:24:51.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:24:51.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:24:51.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:51.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:24:51.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:24:51.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:51.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:24:51.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:24:51.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:51.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:24:51.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:24:51.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:24:51.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:24:51.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:24:51.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:24:51.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.921 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.922 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.922 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:24:51.922 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:51.922 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 97.362644657000004, 2020-11-12T17:24:51.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:24:51.923 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.923 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:51.923 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:51.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:51.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:51.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:24:51.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:24:51.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:24:51.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:24:51.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:24:51.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:24:51.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:24:51.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:24:51.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:24:51.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:24:51.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:24:51.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:24:51.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:24:51.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:24:51.930 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.930 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.930 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.931 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:28560 3.4 e47/35 3:202f80a5:::benchmark_data_smithi036_14212_object3569:head v 47'1808, mlcod=47'1801)", 2020-11-12T17:24:51.931 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:51.931 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.229928141999999, 2020-11-12T17:24:51.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697, 2020-11-12T17:24:51.931 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.931 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.932 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:51.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:51.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:51.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662339+0000", 2020-11-12T17:24:51.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9332000000000001e-05 2020-11-12T17:24:51.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662389+0000", 2020-11-12T17:24:51.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.240093907 2020-11-12T17:24:51.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902482+0000", 2020-11-12T17:24:51.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1109999999999996e-06 2020-11-12T17:24:51.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902489+0000", 2020-11-12T17:24:51.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0870000000000004e-05 2020-11-12T17:24:51.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902559+0000", 2020-11-12T17:24:51.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2245e-05 2020-11-12T17:24:51.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902592+0000", 2020-11-12T17:24:51.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029425010000000001 2020-11-12T17:24:51.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905534+0000", 2020-11-12T17:24:51.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8211e-05 2020-11-12T17:24:51.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905622+0000", 2020-11-12T17:24:51.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697 2020-11-12T17:24:51.939 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.939 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.939 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.939 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29440 3.4 e48/35 3:252d7780:::benchmark_data_smithi036_14212_object3679:head v 48'1880, mlcod=48'1871)", 2020-11-12T17:24:51.939 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:51.940 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 62.494296851000001, 2020-11-12T17:24:51.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999, 2020-11-12T17:24:51.940 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.940 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.940 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:51.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:51.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:51.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397961+0000", 2020-11-12T17:24:51.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5236999999999997e-05 2020-11-12T17:24:51.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.398046+0000", 2020-11-12T17:24:51.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23963379700000001 2020-11-12T17:24:51.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637680+0000", 2020-11-12T17:24:51.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.824e-06 2020-11-12T17:24:51.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637687+0000", 2020-11-12T17:24:51.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4215999999999998e-05 2020-11-12T17:24:51.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637732+0000", 2020-11-12T17:24:51.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8510000000000001e-05 2020-11-12T17:24:51.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637750+0000", 2020-11-12T17:24:51.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012233260000000001 2020-11-12T17:24:51.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.638973+0000", 2020-11-12T17:24:51.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8594999999999998e-05 2020-11-12T17:24:51.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.639022+0000", 2020-11-12T17:24:51.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999 2020-11-12T17:24:51.947 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.947 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.947 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.948 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29991 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1679, mlcod=48'1673)", 2020-11-12T17:24:51.948 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:51.948 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 61.888118962999997, 2020-11-12T17:24:51.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001, 2020-11-12T17:24:51.949 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.949 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.949 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:51.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:51.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:51.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004127+0000", 2020-11-12T17:24:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012464900000000001 2020-11-12T17:24:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004251+0000", 2020-11-12T17:24:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28639012600000002 2020-11-12T17:24:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290641+0000", 2020-11-12T17:24:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:24:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290646+0000", 2020-11-12T17:24:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2363000000000002e-05 2020-11-12T17:24:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290679+0000", 2020-11-12T17:24:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3289999999999999e-05 2020-11-12T17:24:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290702+0000", 2020-11-12T17:24:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014675440000000001 2020-11-12T17:24:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292170+0000", 2020-11-12T17:24:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6585000000000001e-05 2020-11-12T17:24:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292226+0000", 2020-11-12T17:24:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001 2020-11-12T17:24:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:24:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 61.886755209999997, 2020-11-12T17:24:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:24:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:24:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:24:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:24:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:24:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:24:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:24:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:24:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:24:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:24:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:24:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:24:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:24:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:24:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:24:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:24:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:24:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:24:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30039 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1927, mlcod=48'1921)", 2020-11-12T17:24:51.966 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:51.966 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 61.827476533000002, 2020-11-12T17:24:51.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001, 2020-11-12T17:24:51.966 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.966 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.966 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:51.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064806+0000", 2020-11-12T17:24:51.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999409 2020-11-12T17:24:51.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064747+0000", 2020-11-12T17:24:51.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019364299999999999 2020-11-12T17:24:51.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.064941+0000", 2020-11-12T17:24:51.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.212994778 2020-11-12T17:24:51.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277936+0000", 2020-11-12T17:24:51.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7939999999999997e-06 2020-11-12T17:24:51.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.277945+0000", 2020-11-12T17:24:51.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032420940000000001 2020-11-12T17:24:51.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281187+0000", 2020-11-12T17:24:51.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3390000000000001e-05 2020-11-12T17:24:51.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.281211+0000", 2020-11-12T17:24:51.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062069380000000004 2020-11-12T17:24:51.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287418+0000", 2020-11-12T17:24:51.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109126 2020-11-12T17:24:51.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.287527+0000", 2020-11-12T17:24:51.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22272067500000001 2020-11-12T17:24:51.973 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.973 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.974 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:30040 3.4 e48/35 3:2a4d1175:::benchmark_data_smithi036_14212_object3754:head v 48'1928, mlcod=48'1921)", 2020-11-12T17:24:51.974 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:51.974 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 61.825857782, 2020-11-12T17:24:51.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277, 2020-11-12T17:24:51.975 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.975 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.975 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:51.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066425+0000", 2020-11-12T17:24:51.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:24:51.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066369+0000", 2020-11-12T17:24:51.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185513 2020-11-12T17:24:51.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.066555+0000", 2020-11-12T17:24:51.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.22267770000000001 2020-11-12T17:24:51.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289233+0000", 2020-11-12T17:24:51.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5750000000000001e-06 2020-11-12T17:24:51.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289236+0000", 2020-11-12T17:24:51.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7205e-05 2020-11-12T17:24:51.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289283+0000", 2020-11-12T17:24:51.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0210000000000001e-05 2020-11-12T17:24:51.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.289304+0000", 2020-11-12T17:24:51.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018794020000000001 2020-11-12T17:24:51.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291183+0000", 2020-11-12T17:24:51.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2386999999999998e-05 2020-11-12T17:24:51.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.291235+0000", 2020-11-12T17:24:51.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.224810277 2020-11-12T17:24:51.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.982 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.982 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:33768 3.d e49/20 3:bed94f4a:::benchmark_data_smithi036_14212_object4220:head v 49'1880, mlcod=49'1874)", 2020-11-12T17:24:51.983 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:51.983 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 57.977712162000003, 2020-11-12T17:24:51.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001, 2020-11-12T17:24:51.983 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.983 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.983 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:51.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:51.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:24:51.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914530+0000", 2020-11-12T17:24:51.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013119499999999999 2020-11-12T17:24:51.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914662+0000", 2020-11-12T17:24:51.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26915680600000003 2020-11-12T17:24:51.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183818+0000", 2020-11-12T17:24:51.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.61e-06 2020-11-12T17:24:51.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183826+0000", 2020-11-12T17:24:51.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2031999999999999e-05 2020-11-12T17:24:51.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183878+0000", 2020-11-12T17:24:51.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1192999999999998e-05 2020-11-12T17:24:51.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183909+0000", 2020-11-12T17:24:51.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055133250000000003 2020-11-12T17:24:51.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189422+0000", 2020-11-12T17:24:51.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4030999999999997e-05 2020-11-12T17:24:51.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189486+0000", 2020-11-12T17:24:51.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001 2020-11-12T17:24:51.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.990 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.991 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:24:51.991 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:51.991 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.054061244000003, 2020-11-12T17:24:51.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:24:51.992 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:51.992 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:51.992 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:51.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:51.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:51.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:51.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:51.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:51.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:51.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:51.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:24:51.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:24:51.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:51.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:24:51.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:24:51.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:51.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:24:51.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:24:51.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:51.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:24:51.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:24:51.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:51.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:24:51.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:24:51.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:51.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:24:51.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:24:51.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:51.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:24:51.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:24:51.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:51.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:24:51.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:24:51.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.999 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:51.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:51.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:51.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:51.999 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:51.999 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:24:52.000 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.946769867, 2020-11-12T17:24:52.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:24:52.000 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.000 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.001 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:24:52.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.001 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:24:52.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:24:52.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:24:52.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:24:52.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:24:52.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:24:52.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:24:52.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:24:52.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:24:52.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:24:52.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:24:52.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:24:52.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:24:52.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:24:52.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:24:52.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:52.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:24:52.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:24:52.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:24:52.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:24:52.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:24:52.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:24:52.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:24:52.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:24:52.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:24:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:24:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.011 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:59040 3.d e57/20 3:b34b9c19:::benchmark_data_smithi036_14212_object7379:head v 57'3416, mlcod=57'3410)", 2020-11-12T17:24:52.011 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.018580+0000", 2020-11-12T17:24:52.011 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.873702550000001, 2020-11-12T17:24:52.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25110908799999998, 2020-11-12T17:24:52.011 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.011 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.011 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018580+0000", 2020-11-12T17:24:52.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018580+0000", 2020-11-12T17:24:52.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:24:52.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018552+0000", 2020-11-12T17:24:52.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9864000000000006e-05 2020-11-12T17:24:52.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018631+0000", 2020-11-12T17:24:52.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24583041 2020-11-12T17:24:52.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264462+0000", 2020-11-12T17:24:52.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.798e-06 2020-11-12T17:24:52.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264469+0000", 2020-11-12T17:24:52.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2987999999999999e-05 2020-11-12T17:24:52.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264552+0000", 2020-11-12T17:24:52.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3086e-05 2020-11-12T17:24:52.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264595+0000", 2020-11-12T17:24:52.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050248309999999996 2020-11-12T17:24:52.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.269620+0000", 2020-11-12T17:24:52.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9807000000000004e-05 2020-11-12T17:24:52.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.269689+0000", 2020-11-12T17:24:52.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25110908799999998 2020-11-12T17:24:52.018 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.018 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.019 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.019 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:59416 3.c 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:52.019 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:24:52.019 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.364374452, 2020-11-12T17:24:52.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998, 2020-11-12T17:24:52.020 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.020 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.020 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.020 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.020 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.020 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59416 2020-11-12T17:24:52.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.021 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:24:52.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:24:52.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:52.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527883+0000", 2020-11-12T17:24:52.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2643000000000002e-05 2020-11-12T17:24:52.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527956+0000", 2020-11-12T17:24:52.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:24:52.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527969+0000", 2020-11-12T17:24:52.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2689999999999996e-06 2020-11-12T17:24:52.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527976+0000", 2020-11-12T17:24:52.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043768990000000001 2020-11-12T17:24:52.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532353+0000", 2020-11-12T17:24:52.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011210299999999999 2020-11-12T17:24:52.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532465+0000", 2020-11-12T17:24:52.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017931699999999999 2020-11-12T17:24:52.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:52.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532644+0000", 2020-11-12T17:24:52.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002342341 2020-11-12T17:24:52.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.534986+0000", 2020-11-12T17:24:52.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30120883700000001 2020-11-12T17:24:52.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836195+0000", 2020-11-12T17:24:52.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0408999999999995e-05 2020-11-12T17:24:52.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836276+0000", 2020-11-12T17:24:52.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1774999999999997e-05 2020-11-12T17:24:52.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836337+0000", 2020-11-12T17:24:52.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998 2020-11-12T17:24:52.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.029 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.030 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:24:52.030 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:24:52.030 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.469668793, 2020-11-12T17:24:52.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:24:52.030 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.031 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:24:52.031 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:24:52.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:24:52.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:24:52.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:24:52.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:24:52.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:24:52.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:24:52.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:24:52.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:24:52.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:24:52.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:24:52.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:24:52.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:24:52.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:24:52.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:24:52.036 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.036 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.036 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.037 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:64408 3.d e61/20 3:b728e6a9:::benchmark_data_smithi036_14212_object8050:head v 61'3888, mlcod=61'3882)", 2020-11-12T17:24:52.037 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:24:52.037 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.023184312000001, 2020-11-12T17:24:52.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25887154299999998, 2020-11-12T17:24:52.037 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.038 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.038 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:24:52.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:24:52.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:24:52.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869075+0000", 2020-11-12T17:24:52.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5099999999999994e-05 2020-11-12T17:24:52.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869170+0000", 2020-11-12T17:24:52.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25377307599999999 2020-11-12T17:24:52.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122943+0000", 2020-11-12T17:24:52.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0360000000000001e-06 2020-11-12T17:24:52.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122950+0000", 2020-11-12T17:24:52.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4113999999999998e-05 2020-11-12T17:24:52.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122994+0000", 2020-11-12T17:24:52.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5396999999999998e-05 2020-11-12T17:24:52.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.123010+0000", 2020-11-12T17:24:52.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049051490000000001 2020-11-12T17:24:52.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.127915+0000", 2020-11-12T17:24:52.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5053999999999998e-05 2020-11-12T17:24:52.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.127970+0000", 2020-11-12T17:24:52.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25887154299999998 2020-11-12T17:24:52.045 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.045 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.045 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.046 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:2022763f:::benchmark_data_smithi036_14212_object3453:head)])", 2020-11-12T17:24:52.046 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.113218+0000", 2020-11-12T17:24:52.046 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.779064771000002, 2020-11-12T17:24:52.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.232486375, 2020-11-12T17:24:52.046 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.047 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:24:52.047 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.113218+0000", 2020-11-12T17:24:52.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.113218+0000", 2020-11-12T17:24:52.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:24:52.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.113187+0000", 2020-11-12T17:24:52.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1377000000000004e-05 2020-11-12T17:24:52.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.113268+0000", 2020-11-12T17:24:52.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21628209500000001 2020-11-12T17:24:52.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.329550+0000", 2020-11-12T17:24:52.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0895e-05 2020-11-12T17:24:52.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.329561+0000", 2020-11-12T17:24:52.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.015706984 2020-11-12T17:24:52.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.345268+0000", 2020-11-12T17:24:52.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00043616800000000002 2020-11-12T17:24:52.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.345704+0000", 2020-11-12T17:24:52.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.232486375 2020-11-12T17:24:52.052 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.053 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.053 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.053 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:24:52.053 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:24:52.053 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.350658406000001, 2020-11-12T17:24:52.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:24:52.054 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.054 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.054 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.054 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.054 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.054 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:24:52.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.055 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:24:52.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:24:52.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:24:52.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:24:52.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:24:52.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:24:52.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:24:52.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:24:52.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:24:52.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:24:52.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:24:52.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:24:52.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:24:52.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:24:52.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:24:52.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:52.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:24:52.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:24:52.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:24:52.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:24:52.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:24:52.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:24:52.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:24:52.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:24:52.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:24:52.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:24:52.064 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.065 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.065 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.065 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:24:52.065 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:24:52.065 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.334520401999999, 2020-11-12T17:24:52.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:24:52.066 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.066 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:52.066 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:24:52.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:24:52.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:24:52.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:24:52.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:24:52.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:24:52.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:24:52.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:24:52.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:24:52.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:24:52.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:24:52.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:24:52.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:24:52.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:24:52.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:24:52.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:24:52.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:24:52.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.073 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.074 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:24:52.074 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:24:52.074 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.329792723000001, 2020-11-12T17:24:52.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:24:52.074 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.074 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:24:52.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.075 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:24:52.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.075 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:24:52.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:24:52.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:24:52.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:24:52.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:24:52.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:24:52.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:24:52.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:24:52.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:24:52.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:24:52.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:24:52.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:24:52.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:24:52.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:52.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:24:52.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:24:52.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:24:52.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:24:52.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.084 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.084 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.084 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:52.086 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:hints = 1 2020-11-12T17:24:52.086 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2020-11-12T17:24:52.086 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Object prefix: benchmark_data_smithi036_18856 2020-11-12T17:24:52.087 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:24:52.087 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 0 0 0 0 0 0 - 0 2020-11-12T17:24:52.087 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:52.080+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:52.087 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:52.187 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:52.182+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:52.254 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:416 4.a 4:58b2dcfa:::benchmark_data_smithi036_18856_object51:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:24:52.258 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.213911+0000", 2020-11-12T17:24:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.040336216000000001, 2020-11-12T17:24:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.040362442999999998, 2020-11-12T17:24:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.261 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:52.261 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:24:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:24:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 416 2020-11-12T17:24:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.213911+0000", 2020-11-12T17:24:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.213911+0000", 2020-11-12T17:24:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:24:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.213883+0000", 2020-11-12T17:24:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2902e-05 2020-11-12T17:24:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.213966+0000", 2020-11-12T17:24:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0774000000000001e-05 2020-11-12T17:24:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.213977+0000", 2020-11-12T17:24:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9119999999999997e-06 2020-11-12T17:24:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.213982+0000", 2020-11-12T17:24:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030364960000000001 2020-11-12T17:24:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.217018+0000", 2020-11-12T17:24:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2452000000000002e-05 2020-11-12T17:24:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.217111+0000", 2020-11-12T17:24:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017027599999999999 2020-11-12T17:24:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.217281+0000", 2020-11-12T17:24:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050542690000000001 2020-11-12T17:24:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.222335+0000", 2020-11-12T17:24:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084242239999999993 2020-11-12T17:24:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:24:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:24:52.271 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:52.272 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:52.289 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:52.284+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:52.392 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:52.386+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:52.448 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:52.448 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:52.449 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:52.462 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:52.491 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:52.484+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:52.591 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:52.586+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:52.632 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:52.632 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:52.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:52.633 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:52.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.633 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:24:52.633 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:24:52.634 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.958917666999994, 2020-11-12T17:24:52.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:24:52.635 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.635 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:24:52.635 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.638 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.638 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.638 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:24:52.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.639 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:24:52.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:24:52.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:24:52.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:24:52.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:24:52.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:24:52.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:24:52.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:24:52.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:24:52.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:24:52.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:24:52.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:24:52.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:24:52.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:24:52.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:24:52.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:24:52.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:24:52.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:24:52.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:24:52.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:24:52.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:24:52.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:24:52.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:24:52.651 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.651 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.651 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.652 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.652 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:24:52.652 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.958515305999995, 2020-11-12T17:24:52.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:24:52.653 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.653 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.653 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.653 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.653 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.653 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:24:52.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.654 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:24:52.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:24:52.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:24:52.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:24:52.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:24:52.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:24:52.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:24:52.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:24:52.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:24:52.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:24:52.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:24:52.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:24:52.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:24:52.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:24:52.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:24:52.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:24:52.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:24:52.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:24:52.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:24:52.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:24:52.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:24:52.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:24:52.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:24:52.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:24:52.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:24:52.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:24:52.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:24:52.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:24:52.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:24:52.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:24:52.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:24:52.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:24:52.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:24:52.667 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.668 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.668 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.668 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.669 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:24:52.669 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.958191313, 2020-11-12T17:24:52.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:24:52.669 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.669 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.669 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.670 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.670 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.670 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:24:52.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.670 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:24:52.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:24:52.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:24:52.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:24:52.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:24:52.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:24:52.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:24:52.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:24:52.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:24:52.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:24:52.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:24:52.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:24:52.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:24:52.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:24:52.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:24:52.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:24:52.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:24:52.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:24:52.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:24:52.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:24:52.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:24:52.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:24:52.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:24:52.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:24:52.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:24:52.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:24:52.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:24:52.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:24:52.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:24:52.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:24:52.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:24:52.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:24:52.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:24:52.682 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.682 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.682 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.682 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.683 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:24:52.683 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.957947602000004, 2020-11-12T17:24:52.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:24:52.683 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.683 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.683 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.683 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.683 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.684 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:24:52.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.684 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:24:52.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:24:52.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:52.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:24:52.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:24:52.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:24:52.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:24:52.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:24:52.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:24:52.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:24:52.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:24:52.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:24:52.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:24:52.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:24:52.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:24:52.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:24:52.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:24:52.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:24:52.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:24:52.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:24:52.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:24:52.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:24:52.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:24:52.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:24:52.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:24:52.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:24:52.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:24:52.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:24:52.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:24:52.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:24:52.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:24:52.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:24:52.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:24:52.696 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.696 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.696 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.696 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.696 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:24:52.696 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.957709455, 2020-11-12T17:24:52.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:24:52.697 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.697 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.697 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.697 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.697 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.697 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:24:52.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.698 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:24:52.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:24:52.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:24:52.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:24:52.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:24:52.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:24:52.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:24:52.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:24:52.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:24:52.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:24:52.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:24:52.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:24:52.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:24:52.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:24:52.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:24:52.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:24:52.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:24:52.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:24:52.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:24:52.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:24:52.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:24:52.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:24:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:24:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:24:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:24:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:24:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:24:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:24:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:24:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:24:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:24:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:24:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:24:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:24:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.957507414999995, 2020-11-12T17:24:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:24:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:24:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:24:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:24:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:24:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:24:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:24:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:24:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:24:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:24:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:24:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:24:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:24:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:24:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:24:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:24:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:24:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:24:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:24:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:24:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:24:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:24:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:24:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:24:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:24:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:24:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:24:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:24:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:24:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:24:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:24:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:24:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:24:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:24:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:24:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:24:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.957302045000006, 2020-11-12T17:24:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:24:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.725 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.725 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.725 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:24:52.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.725 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:24:52.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:24:52.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:24:52.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:24:52.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:24:52.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:24:52.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:24:52.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:24:52.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:24:52.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:24:52.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:24:52.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:24:52.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:24:52.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:24:52.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:24:52.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:24:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:24:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:24:52.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:24:52.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:24:52.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:24:52.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:24:52.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:24:52.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:24:52.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:24:52.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:24:52.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:24:52.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:24:52.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:24:52.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:24:52.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:24:52.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:24:52.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:24:52.736 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.737 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.737 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.737 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.737 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:24:52.737 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.957116217999996, 2020-11-12T17:24:52.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:24:52.738 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.738 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.738 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.738 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.738 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.738 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:24:52.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.739 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:24:52.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:24:52.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:24:52.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:24:52.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:24:52.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:24:52.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:24:52.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:24:52.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:24:52.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:24:52.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:24:52.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:24:52.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:24:52.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:24:52.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:24:52.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:24:52.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:24:52.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:24:52.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:24:52.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:24:52.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:24:52.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:24:52.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:24:52.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:24:52.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:24:52.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:24:52.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:24:52.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:24:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:24:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:24:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:24:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:24:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:24:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:24:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.956919253999999, 2020-11-12T17:24:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:24:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:24:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:24:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:24:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:24:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:24:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:24:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:24:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:24:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:24:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:24:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:24:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:24:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:24:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:24:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:24:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:24:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:24:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:24:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:24:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:24:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:24:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:24:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:24:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:24:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:24:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:24:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:24:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:24:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:24:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:24:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:24:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:24:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:24:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:24:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:24:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.956723224000001, 2020-11-12T17:24:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:24:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:24:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.767 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:24:52.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:24:52.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:52.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:24:52.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:24:52.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:24:52.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:24:52.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:24:52.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:24:52.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:24:52.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:24:52.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:24:52.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:24:52.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:24:52.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:24:52.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:24:52.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:24:52.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:24:52.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:24:52.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:24:52.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:24:52.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:24:52.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:24:52.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:24:52.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:24:52.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:24:52.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:24:52.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:24:52.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:24:52.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:24:52.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:24:52.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:24:52.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:24:52.778 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.778 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.778 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.779 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.779 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:24:52.779 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.956542424000006, 2020-11-12T17:24:52.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:24:52.779 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.779 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.780 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.780 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.780 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.780 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:24:52.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.780 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:24:52.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:24:52.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:24:52.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:24:52.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:24:52.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:24:52.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:24:52.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:24:52.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:24:52.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:24:52.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:24:52.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:24:52.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:24:52.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:24:52.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:24:52.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:24:52.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:24:52.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:24:52.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:24:52.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:24:52.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:24:52.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:24:52.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:24:52.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:24:52.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:24:52.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:24:52.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:24:52.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:24:52.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:24:52.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:24:52.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:24:52.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:24:52.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:24:52.791 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.791 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.792 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.792 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.792 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:24:52.792 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.956346471000003, 2020-11-12T17:24:52.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:24:52.793 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.793 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.793 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.793 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.793 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.793 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:24:52.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.793 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:24:52.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:24:52.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:52.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:24:52.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:24:52.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:24:52.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:24:52.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:24:52.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:24:52.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:24:52.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:24:52.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:24:52.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:24:52.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:24:52.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:24:52.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:24:52.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:24:52.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:24:52.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:24:52.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:24:52.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:24:52.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:24:52.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:24:52.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:24:52.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:24:52.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:24:52.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:24:52.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:24:52.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:24:52.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:24:52.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:24:52.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:24:52.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:24:52.805 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.805 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.805 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.806 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.806 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:24:52.806 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.956152863, 2020-11-12T17:24:52.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:24:52.806 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.806 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.806 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.807 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.807 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.807 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:24:52.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.807 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:24:52.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:24:52.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:24:52.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:24:52.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:24:52.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:24:52.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:24:52.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:24:52.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:24:52.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:24:52.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:24:52.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:24:52.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:24:52.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:24:52.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:24:52.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:24:52.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:24:52.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:24:52.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:24:52.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:24:52.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:24:52.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:24:52.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:24:52.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:24:52.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:24:52.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:24:52.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:24:52.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:24:52.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:24:52.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:24:52.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:24:52.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:24:52.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:24:52.818 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.818 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.819 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.819 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.819 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:24:52.819 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.955841000000007, 2020-11-12T17:24:52.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:24:52.820 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.820 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.820 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:24:52.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.820 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:24:52.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:24:52.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:24:52.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:24:52.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:24:52.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:24:52.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:24:52.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:24:52.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:24:52.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:24:52.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:24:52.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:24:52.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:24:52.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:24:52.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:24:52.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:24:52.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:24:52.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:24:52.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:24:52.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:24:52.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:24:52.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:24:52.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:24:52.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:24:52.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:24:52.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:24:52.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:24:52.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:24:52.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:24:52.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:24:52.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:24:52.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:24:52.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:24:52.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.832 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.832 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.833 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:24:52.833 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.955553503000004, 2020-11-12T17:24:52.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:24:52.833 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.833 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.833 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.833 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.834 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.834 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:24:52.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.834 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:24:52.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:24:52.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:24:52.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:24:52.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:24:52.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:24:52.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:24:52.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:24:52.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:24:52.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:24:52.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:24:52.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:24:52.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:24:52.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:24:52.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:24:52.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:24:52.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:24:52.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:24:52.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:24:52.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:24:52.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:24:52.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:24:52.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:24:52.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:24:52.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:24:52.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:24:52.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:24:52.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:24:52.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:24:52.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:24:52.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:24:52.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:24:52.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:24:52.845 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.845 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.846 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.846 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:52.846 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:24:52.846 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.955333132000007, 2020-11-12T17:24:52.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:24:52.846 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.847 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.847 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.847 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.847 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.847 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:24:52.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.847 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:24:52.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:24:52.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:24:52.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:24:52.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:24:52.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:24:52.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:24:52.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:24:52.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:24:52.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:24:52.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:24:52.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:24:52.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:24:52.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:52.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:24:52.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:24:52.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:24:52.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:24:52.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:52.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:24:52.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:24:52.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:24:52.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:24:52.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:24:52.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:24:52.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:24:52.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:24:52.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:24:52.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:24:52.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:24:52.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:24:52.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:24:52.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:24:52.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:24:52.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:24:52.859 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.859 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.859 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.860 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:20904 3.0 e42/35 3:07649b2f:::benchmark_data_smithi036_14212_object2612:head v 42'1120, mlcod=42'1114)", 2020-11-12T17:24:52.860 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:24:52.860 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 72.014680827000007, 2020-11-12T17:24:52.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999, 2020-11-12T17:24:52.860 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.861 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.861 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:24:52.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:24:52.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:52.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613848+0000", 2020-11-12T17:24:52.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3206000000000004e-05 2020-11-12T17:24:52.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613911+0000", 2020-11-12T17:24:52.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38330512799999999 2020-11-12T17:24:52.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997216+0000", 2020-11-12T17:24:52.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8860000000000004e-06 2020-11-12T17:24:52.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997224+0000", 2020-11-12T17:24:52.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000129011 2020-11-12T17:24:52.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997353+0000", 2020-11-12T17:24:52.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9062999999999999e-05 2020-11-12T17:24:52.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997382+0000", 2020-11-12T17:24:52.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018580370000000001 2020-11-12T17:24:52.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999240+0000", 2020-11-12T17:24:52.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6116999999999998e-05 2020-11-12T17:24:52.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999296+0000", 2020-11-12T17:24:52.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999 2020-11-12T17:24:52.867 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.867 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.867 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.868 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:52.868 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:24:52.868 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.183879286000007, 2020-11-12T17:24:52.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:24:52.868 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.869 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.869 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:52.869 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:52.869 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:52.869 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:24:52.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.869 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:24:52.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:24:52.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:24:52.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:24:52.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:24:52.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:24:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:24:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:24:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:24:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:24:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:24:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:24:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:24:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:24:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:24:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:24:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:24:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:24:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:24:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:24:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:24:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:24:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:24:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:24:52.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:24:52.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.878 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:25496 3.a e46/31 ondisk, result = 0)", 2020-11-12T17:24:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:24:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.177951773999993, 2020-11-12T17:24:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999, 2020-11-12T17:24:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:24:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:24:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450588+0000", 2020-11-12T17:24:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5475000000000002e-05 2020-11-12T17:24:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450623+0000", 2020-11-12T17:24:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46380360799999998 2020-11-12T17:24:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914427+0000", 2020-11-12T17:24:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7369999999999995e-06 2020-11-12T17:24:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914436+0000", 2020-11-12T17:24:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001408212 2020-11-12T17:24:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915844+0000", 2020-11-12T17:24:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0029e-05 2020-11-12T17:24:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915854+0000", 2020-11-12T17:24:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014011899999999999 2020-11-12T17:24:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915994+0000", 2020-11-12T17:24:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999 2020-11-12T17:24:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:24:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:24:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 47.863590385000002, 2020-11-12T17:24:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:24:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:24:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:52.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:52.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:24:52.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:52.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:24:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:24:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:24:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:24:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:52.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:24:52.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:24:52.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:52.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:24:52.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:24:52.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:52.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:24:52.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:24:52.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:52.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:24:52.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:24:52.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:24:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:24:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:24:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:24:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.894 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:52.894 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:52.894 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:52.896 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:52.896 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:52.890+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:52.928 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 1 16 1191 1175 9.17919 9.17969 0.00611979 0.012975 2020-11-12T17:24:52.998 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:52.992+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:53.047 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:24:53.051 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:24:53.052 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:53.064 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:53.118 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:53.110+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:53.185 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:53.185 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:53.185 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:53.186 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:53.186 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:53.199 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:53.202 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:53.196+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:53.215 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:53.244 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:53.270 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:53.297 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:53.303 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:53.298+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:53.324 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:53.354 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:53.373 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:53.374 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:53.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:53.374 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:53.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.375 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:24:53.375 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:53.375 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 104.529412232, 2020-11-12T17:24:53.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:24:53.375 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.375 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:53.375 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:53.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:53.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:53.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:24:53.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:24:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:24:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:24:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:24:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:24:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:24:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:24:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:24:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:24:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:24:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:24:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:24:53.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:24:53.382 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.382 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.382 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 102.87076168900001, 2020-11-12T17:24:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:24:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:24:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:53.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:24:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:24:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:24:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:24:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:24:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:24:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:24:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:24:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:24:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:24:53.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:24:53.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:24:53.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:24:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:24:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:24:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:24:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:24:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:24:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:24:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:24:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:24:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:24:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 102.869156629, 2020-11-12T17:24:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:24:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:24:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:24:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:24:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:24:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:24:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:24:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:24:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:24:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:24:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:24:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:24:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:24:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:24:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:24:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:24:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:24:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:24:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:24:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:24:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:24:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:24:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:24:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:24:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:24:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5735 3.d e25/20 ondisk, result = 0)", 2020-11-12T17:24:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 102.863070107, 2020-11-12T17:24:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002, 2020-11-12T17:24:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508775+0000", 2020-11-12T17:24:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4838000000000001e-05 2020-11-12T17:24:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508810+0000", 2020-11-12T17:24:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30211893099999998 2020-11-12T17:24:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810929+0000", 2020-11-12T17:24:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3546e-05 2020-11-12T17:24:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810942+0000", 2020-11-12T17:24:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021619539999999998 2020-11-12T17:24:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813104+0000", 2020-11-12T17:24:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1251999999999998e-05 2020-11-12T17:24:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813135+0000", 2020-11-12T17:24:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033488000000000002 2020-11-12T17:24:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813470+0000", 2020-11-12T17:24:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002 2020-11-12T17:24:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.416 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:53.416 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:53.416 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 98.971661624999996, 2020-11-12T17:24:53.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:24:53.416 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.416 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.417 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:53.417 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:53.417 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:53.417 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:24:53.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.417 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:24:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:24:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:24:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:24:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:24:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:24:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:24:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:24:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:24:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:24:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:24:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:24:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:24:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:24:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:24:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:24:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:24:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:24:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:24:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:24:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:24:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:24:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 98.969215009999999, 2020-11-12T17:24:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:24:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:24:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:24:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:24:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:24:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:24:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:24:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:24:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:24:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:24:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:24:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:24:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:24:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:24:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:24:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:24:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:24:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:24:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:53.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:24:53.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:24:53.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:24:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:24:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:24:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:24:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 98.963390563000004, 2020-11-12T17:24:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:24:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:24:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:24:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:24:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:24:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:24:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:24:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:24:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:24:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:24:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:24:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:24:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:24:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:24:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:24:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:24:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 98.963322687000002, 2020-11-12T17:24:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:24:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:53.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:53.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:24:53.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:24:53.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:24:53.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:24:53.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:24:53.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:24:53.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:24:53.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:24:53.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:24:53.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:24:53.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:24:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:24:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:24:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:24:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.454 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.454 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.454 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:24:53.454 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.837332419000006, 2020-11-12T17:24:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:24:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:24:53.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.456 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:53.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:24:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:24:53.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:24:53.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:24:53.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:24:53.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:24:53.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:24:53.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:24:53.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:24:53.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:24:53.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:24:53.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:24:53.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:24:53.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:53.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:24:53.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:24:53.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:53.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:24:53.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:24:53.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:53.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:24:53.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:24:53.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:24:53.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:24:53.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:24:53.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:24:53.469 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.469 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.469 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.470 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:24:53.470 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:53.471 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.8300287, 2020-11-12T17:24:53.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:24:53.471 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.471 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:53.471 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:53.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:53.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:53.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:24:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:24:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:24:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:24:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:24:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:24:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:24:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:24:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:24:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:24:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:24:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:24:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:24:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:24:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.456450207000003, 2020-11-12T17:24:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:24:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:24:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:24:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:24:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:24:53.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:24:53.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:24:53.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:24:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:24:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:24:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:24:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:24:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:24:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:24:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:24:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:24:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:24:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:24:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:24:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:24:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:24:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:24:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:24:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:24:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.490 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:24:53.490 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:53.490 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.444897087000001, 2020-11-12T17:24:53.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:24:53.490 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.490 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:53.490 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:24:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:24:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:24:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:24:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:24:53.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:24:53.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:24:53.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:24:53.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:24:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:24:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:24:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:24:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:24:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:24:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.371776906000001, 2020-11-12T17:24:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:24:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:24:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:53.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:53.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:24:53.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:24:53.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:24:53.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:24:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:24:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:24:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:24:53.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:24:53.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:24:53.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:24:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:24:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:24:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:24:53.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:53.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:24:53.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:24:53.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:53.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:24:53.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:24:53.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:53.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:24:53.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:24:53.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:24:53.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:24:53.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:24:53.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:24:53.508 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.508 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.508 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.509 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:53.509 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:53.509 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.084477192999998, 2020-11-12T17:24:53.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:24:53.509 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.509 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.510 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:53.510 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:53.510 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:53.510 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:24:53.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.510 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:53.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:53.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:53.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:24:53.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:24:53.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:24:53.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:24:53.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:24:53.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:24:53.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:24:53.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:24:53.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:24:53.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:24:53.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:24:53.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:24:53.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:53.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:24:53.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:24:53.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:53.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:24:53.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:24:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:24:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:24:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:24:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:24:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:24:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:24:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 53.539084203000002, 2020-11-12T17:24:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:24:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:24:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:24:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:24:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:24:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:24:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:24:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:24:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:24:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:24:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:24:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:24:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:24:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:24:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:24:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:24:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:24:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:24:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:24:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:24:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:24:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:24:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:24:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:24:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:24:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:24:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.546533943, 2020-11-12T17:24:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:24:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:24:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:24:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:24:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:24:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:24:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:24:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:24:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:24:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:24:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:24:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:24:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:24:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:24:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:24:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:24:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:24:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:24:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:24:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57960 3.7 e57/20 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head v 57'3648, mlcod=57'3642)", 2020-11-12T17:24:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:24:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.642801174999999, 2020-11-12T17:24:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998, 2020-11-12T17:24:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:24:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:24:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729033+0000", 2020-11-12T17:24:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001002 2020-11-12T17:24:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729133+0000", 2020-11-12T17:24:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30451762900000001 2020-11-12T17:24:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033650+0000", 2020-11-12T17:24:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2909999999999998e-06 2020-11-12T17:24:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033656+0000", 2020-11-12T17:24:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1718000000000003e-05 2020-11-12T17:24:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033697+0000", 2020-11-12T17:24:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2977999999999999e-05 2020-11-12T17:24:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033720+0000", 2020-11-12T17:24:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058524529999999996 2020-11-12T17:24:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039573+0000", 2020-11-12T17:24:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2095999999999997e-05 2020-11-12T17:24:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039625+0000", 2020-11-12T17:24:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998 2020-11-12T17:24:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:24:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:24:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.710697771, 2020-11-12T17:24:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:24:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:24:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:24:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:24:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:24:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:24:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:24:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:24:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:24:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:24:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:24:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:24:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:24:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:24:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:24:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:24:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:24:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:24:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:24:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:936 4.6 e71/69 4:6403dfdf:::benchmark_data_smithi036_18856_object116:head v 71'64, mlcod=71'59)", 2020-11-12T17:24:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.698306+0000", 2020-11-12T17:24:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.67355323600000006, 2020-11-12T17:24:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29785980400000001, 2020-11-12T17:24:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.698306+0000", 2020-11-12T17:24:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.698306+0000", 2020-11-12T17:24:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:24:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.698290+0000", 2020-11-12T17:24:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7007000000000003e-05 2020-11-12T17:24:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.698367+0000", 2020-11-12T17:24:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29608595399999998 2020-11-12T17:24:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.994453+0000", 2020-11-12T17:24:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1240000000000004e-06 2020-11-12T17:24:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.994458+0000", 2020-11-12T17:24:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6438000000000003e-05 2020-11-12T17:24:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.994525+0000", 2020-11-12T17:24:53.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2838e-05 2020-11-12T17:24:53.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.994558+0000", 2020-11-12T17:24:53.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001522086 2020-11-12T17:24:53.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.996080+0000", 2020-11-12T17:24:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6240000000000001e-05 2020-11-12T17:24:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.996166+0000", 2020-11-12T17:24:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29785980400000001 2020-11-12T17:24:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:1240 4.a e71/69 4:5ae32822:::benchmark_data_smithi036_18856_object154:head v 71'104, mlcod=71'98)", 2020-11-12T17:24:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:24:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.39448323099999999, 2020-11-12T17:24:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295, 2020-11-12T17:24:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:24:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:24:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:24:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977341+0000", 2020-11-12T17:24:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013138399999999999 2020-11-12T17:24:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977473+0000", 2020-11-12T17:24:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011075199999998 2020-11-12T17:24:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337584+0000", 2020-11-12T17:24:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2939999999999994e-06 2020-11-12T17:24:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337593+0000", 2020-11-12T17:24:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0656999999999996e-05 2020-11-12T17:24:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337684+0000", 2020-11-12T17:24:53.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819999999999997e-05 2020-11-12T17:24:53.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:53.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337715+0000", 2020-11-12T17:24:53.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031310180000000002 2020-11-12T17:24:53.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:53.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340846+0000", 2020-11-12T17:24:53.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2611000000000002e-05 2020-11-12T17:24:53.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:53.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:53.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:53.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340889+0000", 2020-11-12T17:24:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295 2020-11-12T17:24:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:53.572 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:53.575 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:53.575 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:24:53.575 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:53.576 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:53.576 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:24:53.576 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:24:53.576 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:24:53.576 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:24:53.576 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:24:53.576 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:24:53.577 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:53.577 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:53.577 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:53.570+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:53.578 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:53.674 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:53.668+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:53.749 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:53.750 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:53.761 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:53.775 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:53.770+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:53.878 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:53.874+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:53.881 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:24:53.921 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:53.921 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:53.928 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 2 16 2257 2241 8.75322 8.32812 0.00860518 0.0140663 2020-11-12T17:24:53.929 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:54.016 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:54.012+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:54.079 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:54.074+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:54.081 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:54.081 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:54.092 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:24:54.180 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:54.174+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:54.256 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:54.256 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:54.265 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:24:54.281 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:54.278+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:54.382 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:54.378+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:54.389 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:54.390 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:54.400 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:24:54.483 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:54.476+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:54.518 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:54.519 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:54.529 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:54.584 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:54.578+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:54.686 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:54.682+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:54.691 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:54.692 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:54.702 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:54.787 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:54.780+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:54.829 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:54.829 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:54.840 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:54.873 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:24:54.890 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:54.884+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:54.928 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 3 16 3186 3170 8.25448 7.25781 0.00661218 0.014939 2020-11-12T17:24:54.988 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:54.988 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:54.989 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:54.986+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:54.999 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:55.090 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:55.086+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:55.138 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:55.139 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:55.150 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:55.194 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:55.190+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:55.292 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:55.284+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:55.320 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:55.320 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:55.331 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:55.394 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:55.388+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:55.445 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:55.445 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:55.456 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:55.501 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:55.498+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:55.581 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:24:55.585 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:55.586 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:55.594 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:55.590+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:55.599 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:24:55.696 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:55.692+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:55.747 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:55.774 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:55.775 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:55.777 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:55.786 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:24:55.796 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:55.792+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:55.804 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:55.838 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:55.873 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:55.897 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:55.892+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:55.908 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:55.916 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:55.916 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:55.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:55.917 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:55.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.917 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:24:55.917 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:55.917 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 105.410012534, 2020-11-12T17:24:55.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:24:55.918 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:55.918 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:55.918 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:55.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:55.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:55.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:55.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:55.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:24:55.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:55.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:55.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:24:55.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:24:55.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:55.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:24:55.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:24:55.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:55.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:24:55.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:24:55.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:55.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:24:55.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:24:55.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:55.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:24:55.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:24:55.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:55.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:24:55.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:24:55.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:55.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:24:55.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:24:55.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:55.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:24:55.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:24:55.926 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.926 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:55.927 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.927 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:55.927 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:55.927 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.388002969, 2020-11-12T17:24:55.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:24:55.928 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:55.928 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:55.928 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:55.928 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:55.928 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:55.928 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:24:55.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.929 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:55.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:55.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:55.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:55.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:55.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:24:55.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:55.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:55.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:24:55.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:24:55.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:55.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:24:55.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:24:55.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:55.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:24:55.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:24:55.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:55.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:24:55.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:24:55.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:55.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:24:55.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:24:55.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:55.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:24:55.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:24:55.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:55.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:24:55.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:24:55.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:55.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:24:55.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:24:55.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:55.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:24:55.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:24:55.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:55.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:24:55.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:24:55.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:55.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:24:55.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:24:55.941 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.941 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:55.941 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.941 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:24:55.941 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:55.942 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.384603035, 2020-11-12T17:24:55.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:24:55.942 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:55.942 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:55.942 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:55.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:55.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:55.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:55.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:55.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:24:55.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:55.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:55.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:24:55.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:24:55.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:55.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:24:55.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:24:55.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:55.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:24:55.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:24:55.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:55.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:24:55.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:24:55.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:55.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:24:55.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:24:55.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:55.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:24:55.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:24:55.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:55.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:24:55.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:24:55.949 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.949 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:55.949 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.950 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:28560 3.4 e47/35 3:202f80a5:::benchmark_data_smithi036_14212_object3569:head v 47'1808, mlcod=47'1801)", 2020-11-12T17:24:55.950 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:55.950 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.251886519999999, 2020-11-12T17:24:55.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697, 2020-11-12T17:24:55.950 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:55.950 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:55.951 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:55.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:55.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:55.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:55.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:55.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662355+0000", 2020-11-12T17:24:55.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:55.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:55.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662339+0000", 2020-11-12T17:24:55.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9332000000000001e-05 2020-11-12T17:24:55.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:55.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.662389+0000", 2020-11-12T17:24:55.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.240093907 2020-11-12T17:24:55.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:55.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902482+0000", 2020-11-12T17:24:55.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1109999999999996e-06 2020-11-12T17:24:55.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:55.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902489+0000", 2020-11-12T17:24:55.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0870000000000004e-05 2020-11-12T17:24:55.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:55.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902559+0000", 2020-11-12T17:24:55.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2245e-05 2020-11-12T17:24:55.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:55.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.902592+0000", 2020-11-12T17:24:55.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029425010000000001 2020-11-12T17:24:55.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:55.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905534+0000", 2020-11-12T17:24:55.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8211e-05 2020-11-12T17:24:55.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:55.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:48.905622+0000", 2020-11-12T17:24:55.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.243267697 2020-11-12T17:24:55.960 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.960 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:55.960 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.961 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29440 3.4 e48/35 3:252d7780:::benchmark_data_smithi036_14212_object3679:head v 48'1880, mlcod=48'1871)", 2020-11-12T17:24:55.961 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:55.961 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 66.516255228999995, 2020-11-12T17:24:55.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999, 2020-11-12T17:24:55.961 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:55.961 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:55.961 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:55.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:55.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:55.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:55.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:55.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397986+0000", 2020-11-12T17:24:55.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:55.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:55.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.397961+0000", 2020-11-12T17:24:55.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5236999999999997e-05 2020-11-12T17:24:55.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:55.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.398046+0000", 2020-11-12T17:24:55.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23963379700000001 2020-11-12T17:24:55.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:55.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637680+0000", 2020-11-12T17:24:55.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.824e-06 2020-11-12T17:24:55.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:55.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637687+0000", 2020-11-12T17:24:55.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4215999999999998e-05 2020-11-12T17:24:55.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:55.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637732+0000", 2020-11-12T17:24:55.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8510000000000001e-05 2020-11-12T17:24:55.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:55.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.637750+0000", 2020-11-12T17:24:55.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012233260000000001 2020-11-12T17:24:55.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:55.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.638973+0000", 2020-11-12T17:24:55.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8594999999999998e-05 2020-11-12T17:24:55.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:55.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:49.639022+0000", 2020-11-12T17:24:55.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24103607099999999 2020-11-12T17:24:55.968 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.968 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:55.968 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.969 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29991 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1679, mlcod=48'1673)", 2020-11-12T17:24:55.969 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:55.969 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 65.910077341000004, 2020-11-12T17:24:55.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001, 2020-11-12T17:24:55.969 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:55.970 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:55.970 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:55.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:55.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:55.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:55.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:55.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:24:55.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:55.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:55.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004127+0000", 2020-11-12T17:24:55.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012464900000000001 2020-11-12T17:24:55.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:55.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004251+0000", 2020-11-12T17:24:55.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28639012600000002 2020-11-12T17:24:55.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:55.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290641+0000", 2020-11-12T17:24:55.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:24:55.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:55.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290646+0000", 2020-11-12T17:24:55.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2363000000000002e-05 2020-11-12T17:24:55.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:55.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290679+0000", 2020-11-12T17:24:55.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3289999999999999e-05 2020-11-12T17:24:55.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:55.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290702+0000", 2020-11-12T17:24:55.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014675440000000001 2020-11-12T17:24:55.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:55.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292170+0000", 2020-11-12T17:24:55.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6585000000000001e-05 2020-11-12T17:24:55.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:55.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292226+0000", 2020-11-12T17:24:55.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001 2020-11-12T17:24:55.977 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.977 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:55.977 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.977 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:24:55.977 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:55.977 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 65.908713587999998, 2020-11-12T17:24:55.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:24:55.978 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:55.978 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:55.978 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:55.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:55.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:55.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:55.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:55.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:24:55.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:24:55.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:55.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:24:55.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:24:55.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:55.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:24:55.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:24:55.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:55.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:24:55.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:24:55.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:55.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:24:55.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:24:55.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:55.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:24:55.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:24:55.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:55.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:24:55.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:24:55.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:55.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:24:55.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:24:55.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:55.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:24:55.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:24:55.985 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.985 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:55.985 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.986 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:33768 3.d e49/20 3:bed94f4a:::benchmark_data_smithi036_14212_object4220:head v 49'1880, mlcod=49'1874)", 2020-11-12T17:24:55.986 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:55.986 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 61.999670539999997, 2020-11-12T17:24:55.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001, 2020-11-12T17:24:55.986 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:55.987 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:55.987 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:55.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:55.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:55.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:55.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:55.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:24:55.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:24:55.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:55.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914530+0000", 2020-11-12T17:24:55.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013119499999999999 2020-11-12T17:24:55.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:55.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914662+0000", 2020-11-12T17:24:55.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26915680600000003 2020-11-12T17:24:55.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:55.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183818+0000", 2020-11-12T17:24:55.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.61e-06 2020-11-12T17:24:55.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:55.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183826+0000", 2020-11-12T17:24:55.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2031999999999999e-05 2020-11-12T17:24:55.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:55.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183878+0000", 2020-11-12T17:24:55.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1192999999999998e-05 2020-11-12T17:24:55.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:55.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183909+0000", 2020-11-12T17:24:55.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055133250000000003 2020-11-12T17:24:55.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:55.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189422+0000", 2020-11-12T17:24:55.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4030999999999997e-05 2020-11-12T17:24:55.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:55.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189486+0000", 2020-11-12T17:24:55.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001 2020-11-12T17:24:55.994 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.994 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:55.994 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:55.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.994 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:24:55.994 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:55.995 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.076019621999997, 2020-11-12T17:24:55.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:24:55.995 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:55.995 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:55.995 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:55.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:55.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:55.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:55.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:55.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:24:55.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:55.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:55.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:24:55.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:24:55.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:55.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:24:55.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:24:55.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:55.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:24:55.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:24:55.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:55.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:24:55.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:24:55.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:55.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:55.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:55.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:24:56.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:24:56.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:24:56.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:24:56.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:24:56.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:24:56.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:24:56.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:24:56.002 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.002 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.002 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.002 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:56.003 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:24:56.003 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.968728245000001, 2020-11-12T17:24:56.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:24:56.003 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.003 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.004 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.004 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:24:56.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.004 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:24:56.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:24:56.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:24:56.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:24:56.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:24:56.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:24:56.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:24:56.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:24:56.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:24:56.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:24:56.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:24:56.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:24:56.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:24:56.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:24:56.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:24:56.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:56.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:24:56.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:24:56.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:24:56.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:24:56.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:24:56.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:24:56.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:24:56.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:24:56.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:24:56.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:24:56.013 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.014 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.014 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:59040 3.d e57/20 3:b34b9c19:::benchmark_data_smithi036_14212_object7379:head v 57'3416, mlcod=57'3410)", 2020-11-12T17:24:56.015 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.018580+0000", 2020-11-12T17:24:56.015 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.895660928000002, 2020-11-12T17:24:56.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25110908799999998, 2020-11-12T17:24:56.015 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.015 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.015 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018580+0000", 2020-11-12T17:24:56.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018580+0000", 2020-11-12T17:24:56.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:24:56.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018552+0000", 2020-11-12T17:24:56.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9864000000000006e-05 2020-11-12T17:24:56.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.018631+0000", 2020-11-12T17:24:56.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24583041 2020-11-12T17:24:56.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264462+0000", 2020-11-12T17:24:56.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.798e-06 2020-11-12T17:24:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264469+0000", 2020-11-12T17:24:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2987999999999999e-05 2020-11-12T17:24:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264552+0000", 2020-11-12T17:24:56.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3086e-05 2020-11-12T17:24:56.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.264595+0000", 2020-11-12T17:24:56.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050248309999999996 2020-11-12T17:24:56.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.269620+0000", 2020-11-12T17:24:56.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9807000000000004e-05 2020-11-12T17:24:56.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.269689+0000", 2020-11-12T17:24:56.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25110908799999998 2020-11-12T17:24:56.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.022 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.023 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:59416 3.c 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:24:56.023 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:24:56.023 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.386332830000001, 2020-11-12T17:24:56.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998, 2020-11-12T17:24:56.023 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.023 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.024 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.024 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.024 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.024 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59416 2020-11-12T17:24:56.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.024 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:24:56.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:24:56.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:56.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527883+0000", 2020-11-12T17:24:56.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2643000000000002e-05 2020-11-12T17:24:56.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527956+0000", 2020-11-12T17:24:56.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:24:56.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527969+0000", 2020-11-12T17:24:56.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2689999999999996e-06 2020-11-12T17:24:56.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527976+0000", 2020-11-12T17:24:56.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043768990000000001 2020-11-12T17:24:56.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532353+0000", 2020-11-12T17:24:56.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011210299999999999 2020-11-12T17:24:56.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532465+0000", 2020-11-12T17:24:56.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017931699999999999 2020-11-12T17:24:56.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:56.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532644+0000", 2020-11-12T17:24:56.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002342341 2020-11-12T17:24:56.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.534986+0000", 2020-11-12T17:24:56.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30120883700000001 2020-11-12T17:24:56.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836195+0000", 2020-11-12T17:24:56.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0408999999999995e-05 2020-11-12T17:24:56.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836276+0000", 2020-11-12T17:24:56.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1774999999999997e-05 2020-11-12T17:24:56.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836337+0000", 2020-11-12T17:24:56.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998 2020-11-12T17:24:56.033 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.033 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.033 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.034 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:24:56.034 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:24:56.034 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.491627171000001, 2020-11-12T17:24:56.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:24:56.034 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.034 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:24:56.034 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:24:56.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:24:56.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:24:56.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:24:56.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:24:56.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:24:56.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:24:56.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:24:56.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:24:56.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:24:56.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:24:56.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:24:56.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:24:56.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:24:56.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:24:56.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.040 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.041 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:64408 3.d e61/20 3:b728e6a9:::benchmark_data_smithi036_14212_object8050:head v 61'3888, mlcod=61'3882)", 2020-11-12T17:24:56.041 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:24:56.041 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.045142689999999, 2020-11-12T17:24:56.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25887154299999998, 2020-11-12T17:24:56.041 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.041 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.042 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:24:56.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:24:56.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:24:56.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869075+0000", 2020-11-12T17:24:56.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5099999999999994e-05 2020-11-12T17:24:56.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869170+0000", 2020-11-12T17:24:56.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25377307599999999 2020-11-12T17:24:56.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122943+0000", 2020-11-12T17:24:56.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0360000000000001e-06 2020-11-12T17:24:56.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122950+0000", 2020-11-12T17:24:56.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4113999999999998e-05 2020-11-12T17:24:56.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122994+0000", 2020-11-12T17:24:56.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5396999999999998e-05 2020-11-12T17:24:56.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.123010+0000", 2020-11-12T17:24:56.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049051490000000001 2020-11-12T17:24:56.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.127915+0000", 2020-11-12T17:24:56.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5053999999999998e-05 2020-11-12T17:24:56.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.127970+0000", 2020-11-12T17:24:56.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25887154299999998 2020-11-12T17:24:56.048 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.048 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.048 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.049 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:24:56.049 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:24:56.049 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.372616784000002, 2020-11-12T17:24:56.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:24:56.049 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.050 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.050 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.050 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.050 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.050 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:24:56.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.050 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:24:56.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:24:56.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:24:56.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:24:56.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:24:56.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:24:56.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:24:56.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:24:56.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:24:56.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:24:56.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:24:56.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:24:56.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:24:56.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:24:56.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:24:56.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:24:56.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:24:56.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:24:56.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:24:56.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:24:56.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:24:56.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:24:56.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:24:56.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:24:56.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:24:56.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:24:56.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.059 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.060 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:24:56.060 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:24:56.060 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.35647878, 2020-11-12T17:24:56.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:24:56.060 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.060 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:56.060 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:24:56.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:24:56.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:24:56.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:24:56.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:24:56.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:24:56.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:24:56.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:24:56.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:24:56.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:24:56.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:24:56.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:24:56.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:24:56.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:24:56.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:24:56.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:24:56.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:24:56.066 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.067 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.067 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.067 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:24:56.067 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:24:56.067 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.351751101000001, 2020-11-12T17:24:56.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:24:56.068 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.068 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:24:56.068 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.068 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.068 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.068 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:24:56.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.070 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:24:56.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:24:56.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:24:56.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:24:56.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:24:56.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:24:56.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:24:56.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:24:56.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:24:56.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:24:56.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:24:56.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:24:56.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:24:56.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:24:56.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:24:56.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:24:56.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:24:56.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:24:56.078 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.078 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.078 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.079 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:424 4.8 4:15a22128:::benchmark_data_smithi036_18856_object52:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:24:56.079 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:24:56.079 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.693721364, 2020-11-12T17:24:56.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002, 2020-11-12T17:24:56.079 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.079 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.079 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.079 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:24:56.080 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:24:56.080 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 424 2020-11-12T17:24:56.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.080 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:24:56.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:24:56.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:56.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220491+0000", 2020-11-12T17:24:56.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7780000000000003e-05 2020-11-12T17:24:56.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220579+0000", 2020-11-12T17:24:56.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1511e-05 2020-11-12T17:24:56.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220590+0000", 2020-11-12T17:24:56.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9410000000000004e-06 2020-11-12T17:24:56.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220596+0000", 2020-11-12T17:24:56.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027076259999999999 2020-11-12T17:24:56.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223304+0000", 2020-11-12T17:24:56.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102644 2020-11-12T17:24:56.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223406+0000", 2020-11-12T17:24:56.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017898600000000001 2020-11-12T17:24:56.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:56.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223585+0000", 2020-11-12T17:24:56.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000774389 2020-11-12T17:24:56.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224360+0000", 2020-11-12T17:24:56.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30234014999999997 2020-11-12T17:24:56.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526700+0000", 2020-11-12T17:24:56.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5360999999999999e-05 2020-11-12T17:24:56.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526775+0000", 2020-11-12T17:24:56.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6470000000000001e-05 2020-11-12T17:24:56.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526812+0000", 2020-11-12T17:24:56.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002 2020-11-12T17:24:56.089 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.089 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.089 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.089 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:424 4.8 e71/69 ondisk, result = 0)", 2020-11-12T17:24:56.090 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:24:56.090 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.6892698249999998, 2020-11-12T17:24:56.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474, 2020-11-12T17:24:56.090 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.090 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:56.090 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:24:56.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:24:56.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:56.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224949+0000", 2020-11-12T17:24:56.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8579000000000003e-05 2020-11-12T17:24:56.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.225008+0000", 2020-11-12T17:24:56.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30161437000000002 2020-11-12T17:24:56.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526622+0000", 2020-11-12T17:24:56.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1900000000000003e-06 2020-11-12T17:24:56.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526628+0000", 2020-11-12T17:24:56.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8828000000000001e-05 2020-11-12T17:24:56.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526676+0000", 2020-11-12T17:24:56.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1576000000000001e-05 2020-11-12T17:24:56.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526688+0000", 2020-11-12T17:24:56.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012879999999999999 2020-11-12T17:24:56.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526817+0000", 2020-11-12T17:24:56.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474 2020-11-12T17:24:56.096 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.096 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.097 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.097 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:1040 4.8 4:126104a9:::benchmark_data_smithi036_18856_object129:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:24:56.097 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.790320+0000", 2020-11-12T17:24:56.097 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.1239214080000002, 2020-11-12T17:24:56.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966277599999999, 2020-11-12T17:24:56.098 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.098 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.098 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.098 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:24:56.098 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:24:56.098 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1040 2020-11-12T17:24:56.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.098 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.790320+0000", 2020-11-12T17:24:56.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.790320+0000", 2020-11-12T17:24:56.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:24:56.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.790283+0000", 2020-11-12T17:24:56.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010402400000000001 2020-11-12T17:24:56.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.790387+0000", 2020-11-12T17:24:56.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3042e-05 2020-11-12T17:24:56.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.790400+0000", 2020-11-12T17:24:56.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7509999999999997e-06 2020-11-12T17:24:56.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.790406+0000", 2020-11-12T17:24:56.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044225660000000002 2020-11-12T17:24:56.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.794828+0000", 2020-11-12T17:24:56.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000113479 2020-11-12T17:24:56.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.794942+0000", 2020-11-12T17:24:56.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000199815 2020-11-12T17:24:56.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:56.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.795141+0000", 2020-11-12T17:24:56.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015218499999999999 2020-11-12T17:24:56.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.796663+0000", 2020-11-12T17:24:56.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.233194451 2020-11-12T17:24:56.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.029858+0000", 2020-11-12T17:24:56.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9950999999999997e-05 2020-11-12T17:24:56.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.029898+0000", 2020-11-12T17:24:56.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4931000000000004e-05 2020-11-12T17:24:56.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.029983+0000", 2020-11-12T17:24:56.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966277599999999 2020-11-12T17:24:56.107 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.107 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.107 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.108 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.108 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:56.109 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 4 16 4404 4388 8.56955 9.51562 0.0247427 0.0145487 2020-11-12T17:24:56.110 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:56.110 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:24:56.110 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:56.110 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:56.110 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:24:56.111 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:24:56.111 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:24:56.111 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:24:56.111 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:24:56.111 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:24:56.111 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:56.112 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:56.112 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:56.104+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:56.112 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:24:56.211 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:56.206+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:56.253 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:56.253 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:56.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.254 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:4608 4.a 4:514234a6:::benchmark_data_smithi036_18856_object575:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2020-11-12T17:24:56.254 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:56.061270+0000", 2020-11-12T17:24:56.254 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.19048342200000001, 2020-11-12T17:24:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.19051791300000001, 2020-11-12T17:24:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:24:56.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:24:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:24:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 4608 2020-11-12T17:24:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.061270+0000", 2020-11-12T17:24:56.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.061270+0000", 2020-11-12T17:24:56.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:24:56.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.061238+0000", 2020-11-12T17:24:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000104879 2020-11-12T17:24:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.061343+0000", 2020-11-12T17:24:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5698000000000001e-05 2020-11-12T17:24:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.061358+0000", 2020-11-12T17:24:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:24:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.061367+0000", 2020-11-12T17:24:56.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043243149999999996 2020-11-12T17:24:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.065691+0000", 2020-11-12T17:24:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000118201 2020-11-12T17:24:56.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.065809+0000", 2020-11-12T17:24:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000146532 2020-11-12T17:24:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:56.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.065956+0000", 2020-11-12T17:24:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014463760000000001 2020-11-12T17:24:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:56.067402+0000", 2020-11-12T17:24:56.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0061319069999999998 2020-11-12T17:24:56.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.267 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.267 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:24:56.267 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:24:56.268 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:56.269 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:24:56.317 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:56.314+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:56.412 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:56.408+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:56.446 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:56.446 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:56.446 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:56.447 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:56.447 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:56.458 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:24:56.521 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:56.518+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:56.591 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:56.591 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:56.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:56.592 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:56.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.592 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:24:56.592 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:24:56.592 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.917965444999993, 2020-11-12T17:24:56.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:24:56.592 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.593 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:24:56.593 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.593 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.593 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.593 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:24:56.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.596 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:24:56.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:24:56.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:24:56.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:24:56.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:24:56.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:24:56.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:24:56.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:24:56.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:24:56.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:24:56.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:24:56.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:24:56.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:24:56.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:24:56.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:24:56.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:24:56.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:24:56.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:24:56.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:24:56.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:24:56.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:24:56.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:24:56.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:24:56.611 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.611 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.611 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.612 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.612 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:24:56.612 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.917563083999994, 2020-11-12T17:24:56.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:24:56.612 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.612 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.612 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.612 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.613 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.613 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:24:56.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.613 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:24:56.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:24:56.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:24:56.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:24:56.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:24:56.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:24:56.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:24:56.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:24:56.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:24:56.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:24:56.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:24:56.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:24:56.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:24:56.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:24:56.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:24:56.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:24:56.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:24:56.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:24:56.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:24:56.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:24:56.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:24:56.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:24:56.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:24:56.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:24:56.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:24:56.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:24:56.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:24:56.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:24:56.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:24:56.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:24:56.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:24:56.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:24:56.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:24:56.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.625 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.625 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.625 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:24:56.626 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.917239090999999, 2020-11-12T17:24:56.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:24:56.626 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.626 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.626 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.626 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.626 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.627 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:24:56.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.627 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:24:56.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:24:56.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:24:56.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:24:56.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:24:56.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:24:56.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:24:56.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:24:56.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:24:56.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:24:56.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:24:56.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:24:56.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:24:56.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:24:56.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:24:56.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:24:56.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:24:56.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:24:56.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:24:56.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:24:56.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:24:56.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:24:56.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:24:56.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:24:56.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:24:56.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:24:56.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:24:56.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:24:56.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:24:56.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:24:56.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:24:56.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:24:56.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:24:56.639 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.639 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.639 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.639 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.639 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:24:56.639 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.916995380000003, 2020-11-12T17:24:56.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:24:56.640 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.640 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.640 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.640 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.640 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.640 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:24:56.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.641 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:24:56.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:24:56.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:56.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:24:56.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:24:56.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:24:56.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:24:56.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:24:56.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:24:56.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:24:56.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:24:56.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:24:56.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:24:56.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:24:56.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:24:56.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:24:56.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:24:56.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:24:56.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:24:56.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:24:56.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:24:56.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:24:56.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:24:56.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:24:56.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:24:56.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:24:56.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:24:56.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:24:56.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:24:56.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:24:56.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:24:56.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:24:56.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:24:56.652 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.652 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.652 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.653 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.653 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:24:56.653 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.916757232999998, 2020-11-12T17:24:56.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:24:56.653 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.653 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.654 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.654 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.654 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.654 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:24:56.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.654 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:24:56.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:24:56.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:24:56.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:24:56.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:24:56.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:24:56.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:24:56.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:24:56.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:24:56.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:24:56.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:24:56.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:24:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:24:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:24:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:24:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:24:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:24:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:24:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:24:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:24:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:24:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:24:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:24:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:24:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:24:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:24:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:24:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:24:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:24:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:24:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:24:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:24:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:24:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:24:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.916555192999994, 2020-11-12T17:24:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:24:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:24:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:24:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:24:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:24:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:24:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:24:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:24:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:24:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:24:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:24:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:24:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:24:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:24:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:24:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:24:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:24:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:24:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:24:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:24:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:24:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:24:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:24:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:24:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:24:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:24:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:24:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:24:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:24:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:24:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:24:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:24:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:24:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:24:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:24:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:24:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.916349823000004, 2020-11-12T17:24:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:24:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:24:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:24:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:24:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:24:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:24:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:24:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:24:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:24:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:24:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:24:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:24:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:24:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:24:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:24:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:24:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:24:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:24:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:24:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:24:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:24:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:24:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:24:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:24:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:24:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:24:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:24:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:24:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:24:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:24:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:24:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:24:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:24:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:24:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:24:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:24:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.916163995999995, 2020-11-12T17:24:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:24:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:24:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:24:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:24:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:24:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:24:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:24:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:24:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:24:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:24:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:24:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:24:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:24:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:24:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:24:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:24:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:24:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:24:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:24:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:24:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:24:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:24:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:24:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:24:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:24:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:24:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:24:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:24:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:24:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:24:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:24:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:24:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:24:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:24:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:24:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:24:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.915967031999998, 2020-11-12T17:24:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:24:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:24:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:24:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:24:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:24:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:24:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:24:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:24:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:24:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:24:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:24:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:24:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:24:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:24:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:24:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:24:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:24:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:24:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:24:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:24:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:24:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:24:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:24:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:24:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:24:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:24:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:24:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:24:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:24:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:24:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:24:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:24:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:24:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:24:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:24:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:24:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.915771002, 2020-11-12T17:24:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:24:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:24:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:24:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:24:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:24:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:24:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:24:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:24:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:24:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:24:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:24:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:24:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:24:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:24:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:24:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:24:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:24:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:24:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:24:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:24:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:24:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:24:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:24:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:24:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:24:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:24:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:24:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:24:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:24:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:24:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:24:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:24:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:24:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:24:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:24:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.915590202000004, 2020-11-12T17:24:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:24:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:24:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:24:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:24:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:24:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:24:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:24:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:24:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:24:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:24:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:24:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:24:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:24:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:24:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:24:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:24:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:24:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:24:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:24:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:24:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:24:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:24:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:24:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:24:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:24:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:24:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:24:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:24:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:24:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:24:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:24:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:24:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:24:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:24:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:24:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:24:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.915394249000002, 2020-11-12T17:24:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:24:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:24:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:24:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:24:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:24:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:24:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:24:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:24:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:24:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:24:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:24:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:24:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:24:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:24:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:24:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:24:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:24:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:24:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:24:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:24:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:24:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:24:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:24:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:24:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:24:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:24:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:24:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:24:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:24:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:24:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:24:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:24:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:24:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:24:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:24:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.915200640999998, 2020-11-12T17:24:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:24:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:24:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:24:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:24:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:24:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:24:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:24:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:24:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:24:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:24:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:24:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:24:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:24:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:24:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:24:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:24:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:24:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:24:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:24:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:24:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:24:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:24:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:24:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:24:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:24:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:24:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:24:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:24:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:24:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:24:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:24:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:24:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:24:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:24:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:24:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:24:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.914888778000005, 2020-11-12T17:24:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:24:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:24:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:24:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:24:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:24:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:24:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:24:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:24:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:24:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:24:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:24:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:24:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:24:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:24:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:24:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:24:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:24:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:24:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:24:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:24:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:24:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:24:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:24:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:24:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:24:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:24:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:24:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:24:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:24:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:24:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:24:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:24:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:24:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:24:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:24:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:24:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.914601281000003, 2020-11-12T17:24:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:24:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:24:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:24:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:24:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:24:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:24:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:24:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:24:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:24:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:24:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:24:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:24:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:24:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:24:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:24:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:24:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:24:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:24:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:24:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:24:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:24:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:24:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:24:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:24:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:24:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:24:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:24:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:24:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:24:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:24:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:24:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:24:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:24:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:24:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:24:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:24:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:24:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.914380910000006, 2020-11-12T17:24:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:24:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:24:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:24:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:24:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:24:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:24:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:24:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:24:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:24:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:24:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:24:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:24:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:24:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:24:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:24:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:24:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:24:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:24:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:24:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:24:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:24:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:24:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:24:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:24:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:24:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:24:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:24:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:24:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:24:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:24:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:24:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:24:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:24:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:24:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:24:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:24:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:24:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:20904 3.0 e42/35 3:07649b2f:::benchmark_data_smithi036_14212_object2612:head v 42'1120, mlcod=42'1114)", 2020-11-12T17:24:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:24:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 75.973728605000005, 2020-11-12T17:24:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999, 2020-11-12T17:24:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:24:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:24:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613848+0000", 2020-11-12T17:24:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3206000000000004e-05 2020-11-12T17:24:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613911+0000", 2020-11-12T17:24:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38330512799999999 2020-11-12T17:24:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997216+0000", 2020-11-12T17:24:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8860000000000004e-06 2020-11-12T17:24:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997224+0000", 2020-11-12T17:24:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000129011 2020-11-12T17:24:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997353+0000", 2020-11-12T17:24:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9062999999999999e-05 2020-11-12T17:24:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997382+0000", 2020-11-12T17:24:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018580370000000001 2020-11-12T17:24:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999240+0000", 2020-11-12T17:24:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6116999999999998e-05 2020-11-12T17:24:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999296+0000", 2020-11-12T17:24:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999 2020-11-12T17:24:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:24:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.142927064000006, 2020-11-12T17:24:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:24:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:24:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:24:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:24:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:24:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:24:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:24:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:24:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:24:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:24:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:24:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:24:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:24:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:24:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:24:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:24:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:24:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:24:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:24:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:24:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:24:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:24:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:24:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:24:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:24:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:24:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:24:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:25496 3.a e46/31 ondisk, result = 0)", 2020-11-12T17:24:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:24:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.136999552000006, 2020-11-12T17:24:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999, 2020-11-12T17:24:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:24:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:24:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450588+0000", 2020-11-12T17:24:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5475000000000002e-05 2020-11-12T17:24:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450623+0000", 2020-11-12T17:24:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46380360799999998 2020-11-12T17:24:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914427+0000", 2020-11-12T17:24:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7369999999999995e-06 2020-11-12T17:24:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914436+0000", 2020-11-12T17:24:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001408212 2020-11-12T17:24:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915844+0000", 2020-11-12T17:24:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0029e-05 2020-11-12T17:24:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915854+0000", 2020-11-12T17:24:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014011899999999999 2020-11-12T17:24:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915994+0000", 2020-11-12T17:24:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999 2020-11-12T17:24:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:24:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:24:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.822638163000001, 2020-11-12T17:24:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:24:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:24:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:24:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:24:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:24:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:24:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:24:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:24:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:24:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:24:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:24:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:24:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:24:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:24:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:24:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:24:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:24:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:24:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:24:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:56.848 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:56.849 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:24:56.850 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:56.846+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:56.890 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:24:56.929 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 5 15 5695 5680 8.87423 10.0938 0.00585162 0.0140164 2020-11-12T17:24:56.950 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:56.946+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:57.027 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:57.028 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:57.028 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:24:57.028 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:57.040 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:24:57.085 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:57.082+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:57.152 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:57.144+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:57.219 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:57.220 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:24:57.220 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:24:57.220 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:24:57.220 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:57.235 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:24:57.284 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:57.282+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:57.353 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:57.350+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:57.372 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:24:57.373 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:24:57.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:24:57.374 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:24:57.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.374 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:24:57.375 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:57.375 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 108.52812221400001, 2020-11-12T17:24:57.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:24:57.376 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.376 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:57.377 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:57.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:24:57.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:57.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:24:57.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:24:57.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:24:57.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:24:57.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:24:57.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:24:57.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:24:57.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:24:57.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:24:57.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:24:57.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:24:57.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:24:57.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:24:57.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:24:57.390 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.391 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.391 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.392 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:57.392 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:57.393 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.869471671, 2020-11-12T17:24:57.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:24:57.393 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.393 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.394 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:57.394 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:57.394 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:57.394 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:24:57.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.394 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:24:57.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:24:57.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:24:57.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:24:57.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:24:57.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:24:57.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:24:57.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:24:57.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:24:57.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:24:57.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:24:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:24:57.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:24:57.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:24:57.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:57.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:24:57.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:24:57.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:57.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:24:57.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:24:57.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:24:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:24:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:24:57.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:24:57.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:24:57.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:24:57.414 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.415 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.416 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:24:57.416 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:57.416 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.867866611, 2020-11-12T17:24:57.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:24:57.417 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.417 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.417 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:57.418 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:57.418 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:24:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:24:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:24:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:24:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:24:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:24:57.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:24:57.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:24:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:24:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:24:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:24:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:24:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:24:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:24:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:24:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:24:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:24:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:24:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:24:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:24:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:24:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:24:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:24:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:24:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:24:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5735 3.d e25/20 ondisk, result = 0)", 2020-11-12T17:24:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.86178008900001, 2020-11-12T17:24:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002, 2020-11-12T17:24:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:24:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:24:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508775+0000", 2020-11-12T17:24:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4838000000000001e-05 2020-11-12T17:24:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508810+0000", 2020-11-12T17:24:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30211893099999998 2020-11-12T17:24:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810929+0000", 2020-11-12T17:24:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3546e-05 2020-11-12T17:24:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810942+0000", 2020-11-12T17:24:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021619539999999998 2020-11-12T17:24:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813104+0000", 2020-11-12T17:24:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1251999999999998e-05 2020-11-12T17:24:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813135+0000", 2020-11-12T17:24:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033488000000000002 2020-11-12T17:24:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813470+0000", 2020-11-12T17:24:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002 2020-11-12T17:24:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 102.970371607, 2020-11-12T17:24:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:24:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:24:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:24:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:24:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:24:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:24:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:24:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:24:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:24:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:24:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:24:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:24:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:24:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:24:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:24:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:24:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:24:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:24:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:24:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:24:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:24:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:24:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:24:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:24:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:24:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 102.96792499199999, 2020-11-12T17:24:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:24:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:24:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:24:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:24:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:24:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:24:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:24:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:24:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:24:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:24:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:24:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:24:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:24:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:24:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:24:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:24:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:24:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:24:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:24:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:24:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:24:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:24:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:24:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:24:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:24:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 102.962100545, 2020-11-12T17:24:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:24:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:24:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:24:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:24:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:24:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:24:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:24:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:24:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:24:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:24:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:24:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:24:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:24:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:24:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:24:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:24:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:24:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:24:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 102.962032669, 2020-11-12T17:24:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:24:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:24:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:24:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:24:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:24:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:24:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:24:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:24:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:24:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:24:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:24:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:24:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:24:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:24:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:24:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:24:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:24:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:24:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 72.836042401, 2020-11-12T17:24:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:24:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:24:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:24:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:24:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:24:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:24:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:24:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:24:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:24:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:24:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:24:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:24:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:24:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:24:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:24:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:24:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:24:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:24:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:24:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:24:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:24:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:24:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:24:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:24:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:24:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:24:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:24:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 72.828738681999994, 2020-11-12T17:24:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:24:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:24:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:24:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:24:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:24:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:24:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:24:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:24:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:24:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:24:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:24:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:24:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:24:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:24:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:24:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:24:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:24:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:24:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 72.455160188999997, 2020-11-12T17:24:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:24:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:24:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:24:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:24:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:24:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:24:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:24:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:24:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:24:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:24:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:24:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:24:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:24:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:24:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:24:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:24:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:24:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:24:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:24:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:24:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:24:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:24:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:24:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:24:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:24:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:24:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:24:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 72.443607068999995, 2020-11-12T17:24:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:24:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:24:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:24:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:24:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:24:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:24:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:24:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:24:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:24:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:24:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:24:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:24:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:24:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:24:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:24:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:24:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:24:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:24:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:24:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.370486888000002, 2020-11-12T17:24:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:24:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:24:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:24:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:24:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:24:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:24:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:24:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:24:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:24:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:24:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:24:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:24:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:24:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:24:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:24:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:24:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:24:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:24:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:24:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:24:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:24:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:24:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:24:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:24:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:24:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:24:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.083187174999999, 2020-11-12T17:24:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:24:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:24:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:24:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:24:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:24:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:24:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:24:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:24:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:24:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:24:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:24:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:24:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:24:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:24:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:24:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:24:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:24:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:24:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:24:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:24:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:24:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:24:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:24:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:24:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:24:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:24:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:24:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 57.537794185000003, 2020-11-12T17:24:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:24:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:24:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:24:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:24:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:24:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:24:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:24:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:24:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:24:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:24:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:24:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:24:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:24:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:24:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:24:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:24:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:24:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:24:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:24:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:24:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:24:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:24:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:24:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:24:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:24:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:24:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:24:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:24:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:24:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:24:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:24:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.545243925000001, 2020-11-12T17:24:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:24:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:24:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:24:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:24:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:24:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:24:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:24:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:24:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:24:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:24:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:24:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:24:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:24:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:24:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:24:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:24:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:24:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:24:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:24:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:24:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57960 3.7 e57/20 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head v 57'3648, mlcod=57'3642)", 2020-11-12T17:24:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:24:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.641511156999997, 2020-11-12T17:24:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998, 2020-11-12T17:24:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:24:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:24:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729033+0000", 2020-11-12T17:24:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001002 2020-11-12T17:24:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729133+0000", 2020-11-12T17:24:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30451762900000001 2020-11-12T17:24:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033650+0000", 2020-11-12T17:24:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2909999999999998e-06 2020-11-12T17:24:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033656+0000", 2020-11-12T17:24:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1718000000000003e-05 2020-11-12T17:24:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033697+0000", 2020-11-12T17:24:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2977999999999999e-05 2020-11-12T17:24:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033720+0000", 2020-11-12T17:24:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058524529999999996 2020-11-12T17:24:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039573+0000", 2020-11-12T17:24:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2095999999999997e-05 2020-11-12T17:24:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039625+0000", 2020-11-12T17:24:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998 2020-11-12T17:24:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:24:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:24:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.709407753000001, 2020-11-12T17:24:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:24:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:24:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:24:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:24:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:24:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:24:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:24:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:24:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:24:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:24:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:24:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:24:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:24:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:24:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:24:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:24:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:24:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:24:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:24:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:936 4.6 e71/69 4:6403dfdf:::benchmark_data_smithi036_18856_object116:head v 71'64, mlcod=71'59)", 2020-11-12T17:24:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.698306+0000", 2020-11-12T17:24:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.6722632180000003, 2020-11-12T17:24:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29785980400000001, 2020-11-12T17:24:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.698306+0000", 2020-11-12T17:24:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.698306+0000", 2020-11-12T17:24:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:24:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.698290+0000", 2020-11-12T17:24:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7007000000000003e-05 2020-11-12T17:24:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.698367+0000", 2020-11-12T17:24:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29608595399999998 2020-11-12T17:24:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.994453+0000", 2020-11-12T17:24:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1240000000000004e-06 2020-11-12T17:24:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.994458+0000", 2020-11-12T17:24:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6438000000000003e-05 2020-11-12T17:24:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.994525+0000", 2020-11-12T17:24:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2838e-05 2020-11-12T17:24:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.994558+0000", 2020-11-12T17:24:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001522086 2020-11-12T17:24:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.996080+0000", 2020-11-12T17:24:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6240000000000001e-05 2020-11-12T17:24:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.996166+0000", 2020-11-12T17:24:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29785980400000001 2020-11-12T17:24:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:1240 4.a e71/69 4:5ae32822:::benchmark_data_smithi036_18856_object154:head v 71'104, mlcod=71'98)", 2020-11-12T17:24:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:24:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.393193213, 2020-11-12T17:24:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295, 2020-11-12T17:24:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:24:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:24:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:24:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:24:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:24:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:24:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:24:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:24:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:24:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977341+0000", 2020-11-12T17:24:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013138399999999999 2020-11-12T17:24:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:24:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977473+0000", 2020-11-12T17:24:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011075199999998 2020-11-12T17:24:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:24:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337584+0000", 2020-11-12T17:24:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2939999999999994e-06 2020-11-12T17:24:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:24:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337593+0000", 2020-11-12T17:24:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0656999999999996e-05 2020-11-12T17:24:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:24:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337684+0000", 2020-11-12T17:24:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819999999999997e-05 2020-11-12T17:24:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:24:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337715+0000", 2020-11-12T17:24:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031310180000000002 2020-11-12T17:24:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:24:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340846+0000", 2020-11-12T17:24:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2611000000000002e-05 2020-11-12T17:24:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:24:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:24:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:24:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340889+0000", 2020-11-12T17:24:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295 2020-11-12T17:24:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:24:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:24:57.631 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:24:57.633 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:57.630+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:57.633 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:24:57.733 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:24:57.728+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:24:57.757 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:57.757 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:57.758 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:24:57.758 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:57.768 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:24:57.834 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:57.830+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:57.909 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:24:57.910 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:57.906+0000 7f2809aaf700 -1 osd.6 72 handle_osd_map injecting map crc failure 2020-11-12T17:24:57.928 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 6 16 7133 7117 9.26612 11.2266 0.00853482 0.0134368 2020-11-12T17:24:57.935 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:24:57.930+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:24:57.937 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:57.938 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:57.938 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:24:57.939 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:24:57.939 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:57.946 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:24:57.961 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:57.956+0000 7f6583748700 -1 osd.0 72 handle_osd_map injecting map crc failure 2020-11-12T17:24:58.035 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:58.028+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:58.085 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:58.086 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:24:58.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:24:58.086 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:24:58.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.086 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:24:58.087 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:58.087 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.973565964, 2020-11-12T17:24:58.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:24:58.087 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.087 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:58.088 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:58.088 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:24:58.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.088 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:58.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:24:58.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:24:58.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:24:58.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:24:58.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:24:58.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:24:58.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:24:58.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:24:58.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:24:58.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:24:58.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:24:58.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:24:58.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:24:58.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:24:58.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:58.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:24:58.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:24:58.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:24:58.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:24:58.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:24:58.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:24:58.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:24:58.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:24:58.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:24:58.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:24:58.098 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.098 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.098 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.098 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:24:58.099 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:58.099 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.966474168, 2020-11-12T17:24:58.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:24:58.099 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.099 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:58.099 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:58.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:24:58.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:24:58.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:24:58.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:24:58.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:24:58.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:24:58.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:24:58.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:24:58.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:24:58.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:24:58.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:24:58.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:24:58.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:24:58.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:24:58.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:24:58.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:24:58.107 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.108 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.108 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:58.108 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:58.109 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 103.53443709, 2020-11-12T17:24:58.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999, 2020-11-12T17:24:58.109 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.109 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:58.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:58.109 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:24:58.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.110 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:58.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:24:58.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:24:58.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:24:58.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:24:58.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:24:58.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:24:58.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:24:58.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:24:58.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:24:58.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:24:58.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:24:58.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:24:58.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:24:58.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112811 2020-11-12T17:24:58.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:58.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550940+0000", 2020-11-12T17:24:58.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001154101 2020-11-12T17:24:58.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552095+0000", 2020-11-12T17:24:58.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25363090900000002 2020-11-12T17:24:58.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805725+0000", 2020-11-12T17:24:58.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8797999999999998e-05 2020-11-12T17:24:58.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805824+0000", 2020-11-12T17:24:58.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8110999999999998e-05 2020-11-12T17:24:58.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805902+0000", 2020-11-12T17:24:58.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999 2020-11-12T17:24:58.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.119 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.119 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:24:58.120 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:58.120 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 103.53391467100001, 2020-11-12T17:24:58.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:24:58.120 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.120 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:58.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:58.121 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:24:58.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.121 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:58.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:24:58.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:24:58.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:24:58.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:24:58.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:24:58.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:24:58.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:24:58.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:24:58.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:24:58.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:24:58.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:24:58.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:24:58.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:24:58.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:24:58.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:58.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:24:58.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:24:58.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:24:58.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:24:58.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:24:58.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:24:58.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:24:58.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:24:58.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:24:58.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:24:58.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.130 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.131 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.131 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9999 3.1 e26/20 ondisk, result = 0)", 2020-11-12T17:24:58.131 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:58.131 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 103.525552151, 2020-11-12T17:24:58.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145, 2020-11-12T17:24:58.131 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.132 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:58.132 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:58.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:24:58.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:24:58.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556869+0000", 2020-11-12T17:24:58.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1767999999999994e-05 2020-11-12T17:24:58.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556951+0000", 2020-11-12T17:24:58.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.248442731 2020-11-12T17:24:58.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805393+0000", 2020-11-12T17:24:58.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5503e-05 2020-11-12T17:24:58.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805409+0000", 2020-11-12T17:24:58.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027928399999999998 2020-11-12T17:24:58.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805688+0000", 2020-11-12T17:24:58.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2215e-05 2020-11-12T17:24:58.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805710+0000", 2020-11-12T17:24:58.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000226744 2020-11-12T17:24:58.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805937+0000", 2020-11-12T17:24:58.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145 2020-11-12T17:24:58.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.138 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.138 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:25512 3.b e46/20 3:d013695c:::benchmark_data_smithi036_14212_object3188:head v 46'1664, mlcod=46'1657)", 2020-11-12T17:24:58.139 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:58.139 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 72.621376197999993, 2020-11-12T17:24:58.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999, 2020-11-12T17:24:58.139 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.139 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.139 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:58.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:24:58.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:24:58.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461054+0000", 2020-11-12T17:24:58.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5973000000000002e-05 2020-11-12T17:24:58.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461100+0000", 2020-11-12T17:24:58.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27743074600000001 2020-11-12T17:24:58.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738530+0000", 2020-11-12T17:24:58.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6039999999999993e-06 2020-11-12T17:24:58.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738539+0000", 2020-11-12T17:24:58.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7942000000000006e-05 2020-11-12T17:24:58.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738627+0000", 2020-11-12T17:24:58.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1338000000000003e-05 2020-11-12T17:24:58.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738668+0000", 2020-11-12T17:24:58.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002001774 2020-11-12T17:24:58.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740670+0000", 2020-11-12T17:24:58.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7090999999999999e-05 2020-11-12T17:24:58.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740737+0000", 2020-11-12T17:24:58.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999 2020-11-12T17:24:58.147 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.147 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.147 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.148 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:24:58.148 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:58.148 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.583794577000006, 2020-11-12T17:24:58.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:24:58.148 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.148 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:58.148 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:58.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:24:58.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:24:58.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:24:58.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:24:58.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:24:58.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:24:58.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:24:58.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:24:58.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:24:58.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:24:58.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:24:58.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:24:58.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:24:58.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:24:58.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:24:58.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:24:58.154 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.155 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.155 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.155 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:28424 3.b e47/20 3:d6b3d883:::benchmark_data_smithi036_14212_object3552:head v 47'1832, mlcod=47'1825)", 2020-11-12T17:24:58.155 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:58.155 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.558623216000001, 2020-11-12T17:24:58.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002, 2020-11-12T17:24:58.156 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.156 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.156 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:58.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:24:58.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:24:58.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523784+0000", 2020-11-12T17:24:58.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100963 2020-11-12T17:24:58.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523885+0000", 2020-11-12T17:24:58.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29458836900000002 2020-11-12T17:24:58.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818473+0000", 2020-11-12T17:24:58.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1482e-05 2020-11-12T17:24:58.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818485+0000", 2020-11-12T17:24:58.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4080999999999998e-05 2020-11-12T17:24:58.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818559+0000", 2020-11-12T17:24:58.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9269e-05 2020-11-12T17:24:58.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818598+0000", 2020-11-12T17:24:58.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044328520000000001 2020-11-12T17:24:58.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823031+0000", 2020-11-12T17:24:58.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2584999999999998e-05 2020-11-12T17:24:58.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823094+0000", 2020-11-12T17:24:58.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002 2020-11-12T17:24:58.163 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.163 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.163 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.163 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:24:58.163 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:58.164 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.478192684999996, 2020-11-12T17:24:58.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:24:58.164 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.164 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.164 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:58.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:24:58.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:58.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:24:58.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:24:58.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:24:58.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:24:58.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:24:58.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:24:58.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:24:58.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:24:58.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:24:58.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:24:58.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:24:58.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:24:58.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:24:58.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:24:58.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:24:58.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:24:58.171 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.171 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.171 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.172 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43534 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:58.172 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:58.172 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 53.373541711999998, 2020-11-12T17:24:58.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002, 2020-11-12T17:24:58.172 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.172 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.172 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.173 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:58.173 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:58.173 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43534 2020-11-12T17:24:58.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.173 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:58.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:24:58.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:24:58.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708876+0000", 2020-11-12T17:24:58.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4095000000000002e-05 2020-11-12T17:24:58.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708940+0000", 2020-11-12T17:24:58.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960000000000007e-06 2020-11-12T17:24:58.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708949+0000", 2020-11-12T17:24:58.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.451e-06 2020-11-12T17:24:58.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708955+0000", 2020-11-12T17:24:58.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085037340000000006 2020-11-12T17:24:58.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717458+0000", 2020-11-12T17:24:58.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4234999999999997e-05 2020-11-12T17:24:58.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717523+0000", 2020-11-12T17:24:58.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012550500000000001 2020-11-12T17:24:58.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:58.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717648+0000", 2020-11-12T17:24:58.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040419740000000003 2020-11-12T17:24:58.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.721690+0000", 2020-11-12T17:24:58.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.247979797 2020-11-12T17:24:58.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969670+0000", 2020-11-12T17:24:58.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012950400000000001 2020-11-12T17:24:58.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969799+0000", 2020-11-12T17:24:58.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000181709 2020-11-12T17:24:58.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969981+0000", 2020-11-12T17:24:58.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002 2020-11-12T17:24:58.195 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.195 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.195 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.196 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43535 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:58.196 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:58.196 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 53.373222884, 2020-11-12T17:24:58.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003, 2020-11-12T17:24:58.197 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.197 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.197 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43535 2020-11-12T17:24:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:24:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:24:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709201+0000", 2020-11-12T17:24:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4987000000000001e-05 2020-11-12T17:24:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709256+0000", 2020-11-12T17:24:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9799999999999998e-06 2020-11-12T17:24:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709264+0000", 2020-11-12T17:24:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:24:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709268+0000", 2020-11-12T17:24:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01033796 2020-11-12T17:24:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719606+0000", 2020-11-12T17:24:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014753499999999999 2020-11-12T17:24:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719754+0000", 2020-11-12T17:24:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023477900000000001 2020-11-12T17:24:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719989+0000", 2020-11-12T17:24:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002308844 2020-11-12T17:24:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722298+0000", 2020-11-12T17:24:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27981983300000002 2020-11-12T17:24:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002117+0000", 2020-11-12T17:24:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4757000000000001e-05 2020-11-12T17:24:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002212+0000", 2020-11-12T17:24:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116928 2020-11-12T17:24:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002329+0000", 2020-11-12T17:24:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003 2020-11-12T17:24:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43536 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 53.373123352999997, 2020-11-12T17:24:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001, 2020-11-12T17:24:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43536 2020-11-12T17:24:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:58.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:24:58.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:24:58.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709302+0000", 2020-11-12T17:24:58.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3248999999999998e-05 2020-11-12T17:24:58.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709355+0000", 2020-11-12T17:24:58.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.34e-06 2020-11-12T17:24:58.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709363+0000", 2020-11-12T17:24:58.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.664e-06 2020-11-12T17:24:58.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709366+0000", 2020-11-12T17:24:58.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013071532 2020-11-12T17:24:58.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722438+0000", 2020-11-12T17:24:58.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141901 2020-11-12T17:24:58.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722580+0000", 2020-11-12T17:24:58.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118355 2020-11-12T17:24:58.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:58.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722698+0000", 2020-11-12T17:24:58.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014561839999999999 2020-11-12T17:24:58.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.724154+0000", 2020-11-12T17:24:58.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27825006499999999 2020-11-12T17:24:58.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002404+0000", 2020-11-12T17:24:58.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2908000000000001e-05 2020-11-12T17:24:58.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002477+0000", 2020-11-12T17:24:58.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020370300000000001 2020-11-12T17:24:58.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002681+0000", 2020-11-12T17:24:58.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001 2020-11-12T17:24:58.226 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.226 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.227 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:43534 3.6 e53/20 ondisk, result = 0)", 2020-11-12T17:24:58.227 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:58.227 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 53.356015028000002, 2020-11-12T17:24:58.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001, 2020-11-12T17:24:58.228 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.228 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:58.228 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:58.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:24:58.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:24:58.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726412+0000", 2020-11-12T17:24:58.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2086000000000003e-05 2020-11-12T17:24:58.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726454+0000", 2020-11-12T17:24:58.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24305705 2020-11-12T17:24:58.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969511+0000", 2020-11-12T17:24:58.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.49e-05 2020-11-12T17:24:58.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969526+0000", 2020-11-12T17:24:58.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010331999999999999 2020-11-12T17:24:58.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969629+0000", 2020-11-12T17:24:58.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1993000000000001e-05 2020-11-12T17:24:58.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969651+0000", 2020-11-12T17:24:58.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00033822300000000002 2020-11-12T17:24:58.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969989+0000", 2020-11-12T17:24:58.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001 2020-11-12T17:24:58.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.235 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.235 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43768 3.6 3:6f7b85f8:::benchmark_data_smithi036_14212_object5470:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:24:58.235 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:58.236 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 53.084390507999998, 2020-11-12T17:24:58.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001, 2020-11-12T17:24:58.236 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.236 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.236 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.236 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:58.236 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:58.236 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43768 2020-11-12T17:24:58.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.237 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:58.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:24:58.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:24:58.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998003+0000", 2020-11-12T17:24:58.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014095000000000001 2020-11-12T17:24:58.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998144+0000", 2020-11-12T17:24:58.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1143000000000001e-05 2020-11-12T17:24:58.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998165+0000", 2020-11-12T17:24:58.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3979999999999999e-06 2020-11-12T17:24:58.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998174+0000", 2020-11-12T17:24:58.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012056769 2020-11-12T17:24:58.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010231+0000", 2020-11-12T17:24:58.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102279 2020-11-12T17:24:58.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010333+0000", 2020-11-12T17:24:58.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014553299999999999 2020-11-12T17:24:58.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:58.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010478+0000", 2020-11-12T17:24:58.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037901779999999999 2020-11-12T17:24:58.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.014269+0000", 2020-11-12T17:24:58.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22457837 2020-11-12T17:24:58.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238847+0000", 2020-11-12T17:24:58.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2958000000000001e-05 2020-11-12T17:24:58.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238930+0000", 2020-11-12T17:24:58.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1814000000000002e-05 2020-11-12T17:24:58.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238982+0000", 2020-11-12T17:24:58.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001 2020-11-12T17:24:58.246 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.246 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.246 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.247 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50240 3.1 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:24:58.247 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:58.247 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.729346313000001, 2020-11-12T17:24:58.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003, 2020-11-12T17:24:58.247 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.247 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.247 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.248 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:58.248 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:58.248 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50240 2020-11-12T17:24:58.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.248 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:58.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:24:58.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:24:58.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353074+0000", 2020-11-12T17:24:58.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106903 2020-11-12T17:24:58.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353181+0000", 2020-11-12T17:24:58.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6804999999999999e-05 2020-11-12T17:24:58.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353198+0000", 2020-11-12T17:24:58.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3259999999999998e-06 2020-11-12T17:24:58.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353205+0000", 2020-11-12T17:24:58.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011916829 2020-11-12T17:24:58.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365122+0000", 2020-11-12T17:24:58.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111867 2020-11-12T17:24:58.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365234+0000", 2020-11-12T17:24:58.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011033500000000001 2020-11-12T17:24:58.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:58.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365344+0000", 2020-11-12T17:24:58.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002314876 2020-11-12T17:24:58.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.367659+0000", 2020-11-12T17:24:58.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23853026499999999 2020-11-12T17:24:58.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606189+0000", 2020-11-12T17:24:58.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3222999999999999e-05 2020-11-12T17:24:58.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606272+0000", 2020-11-12T17:24:58.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000165849 2020-11-12T17:24:58.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606438+0000", 2020-11-12T17:24:58.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003 2020-11-12T17:24:58.259 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.259 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.259 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.259 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:24:58.260 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:58.260 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.131709350999998, 2020-11-12T17:24:58.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:24:58.260 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.260 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.260 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.260 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:24:58.261 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:24:58.261 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:24:58.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.261 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:58.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:24:58.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:24:58.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:24:58.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:24:58.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:24:58.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:24:58.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:24:58.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:24:58.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:24:58.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:24:58.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:24:58.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:24:58.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:24:58.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:24:58.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:24:58.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:24:58.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:24:58.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:24:58.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:24:58.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:24:58.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:24:58.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:24:58.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:24:58.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:24:58.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:24:58.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.270 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.270 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.270 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:24:58.270 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:24:58.270 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 27.135867549, 2020-11-12T17:24:58.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:24:58.271 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.271 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:24:58.271 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:24:58.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:24:58.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:24:58.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:24:58.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:24:58.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:24:58.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:24:58.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:24:58.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:24:58.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:24:58.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:24:58.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:24:58.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:24:58.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:24:58.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:24:58.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:24:58.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:24:58.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.277 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.278 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:24:58.278 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:24:58.278 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.200764150000001, 2020-11-12T17:24:58.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:24:58.278 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.279 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:24:58.279 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:24:58.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:24:58.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:24:58.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:24:58.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:24:58.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:24:58.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:24:58.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:24:58.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:24:58.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:24:58.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:24:58.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:24:58.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:24:58.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:24:58.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:24:58.284 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.284 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.285 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.285 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:304 4.b 4:d3839b57:::benchmark_data_smithi036_18856_object37:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:24:58.285 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:24:58.285 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.9445985930000003, 2020-11-12T17:24:58.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999, 2020-11-12T17:24:58.286 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.286 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.286 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.286 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:24:58.286 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:24:58.286 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 304 2020-11-12T17:24:58.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.287 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:24:58.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:24:58.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:58.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137813+0000", 2020-11-12T17:24:58.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9074999999999998e-05 2020-11-12T17:24:58.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137892+0000", 2020-11-12T17:24:58.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8020000000000003e-06 2020-11-12T17:24:58.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137902+0000", 2020-11-12T17:24:58.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7619999999999995e-06 2020-11-12T17:24:58.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137909+0000", 2020-11-12T17:24:58.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040533879999999998 2020-11-12T17:24:58.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.141963+0000", 2020-11-12T17:24:58.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162048 2020-11-12T17:24:58.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142125+0000", 2020-11-12T17:24:58.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00039201500000000001 2020-11-12T17:24:58.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:24:58.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142517+0000", 2020-11-12T17:24:58.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010951820000000001 2020-11-12T17:24:58.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.143612+0000", 2020-11-12T17:24:58.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.286564975 2020-11-12T17:24:58.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430177+0000", 2020-11-12T17:24:58.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8254000000000002e-05 2020-11-12T17:24:58.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430235+0000", 2020-11-12T17:24:58.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9767000000000001e-05 2020-11-12T17:24:58.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430275+0000", 2020-11-12T17:24:58.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999 2020-11-12T17:24:58.296 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.297 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.297 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.297 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:936 4.6 4:6403dfdf:::benchmark_data_smithi036_18856_object116:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:24:58.297 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:24:58.298 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3901543700000003, 2020-11-12T17:24:58.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001, 2020-11-12T17:24:58.298 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:24:58.298 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:24:58.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:24:58.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:24:58.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:24:58.299 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 936 2020-11-12T17:24:58.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.299 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:24:58.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:24:58.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:24:58.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:24:58.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:24:58.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:24:58.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:24:58.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:24:58.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692257+0000", 2020-11-12T17:24:58.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8807999999999994e-05 2020-11-12T17:24:58.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:24:58.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692346+0000", 2020-11-12T17:24:58.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1438e-05 2020-11-12T17:24:58.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:24:58.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692357+0000", 2020-11-12T17:24:58.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0989999999999998e-06 2020-11-12T17:24:58.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:24:58.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692362+0000", 2020-11-12T17:24:58.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036699900000000001 2020-11-12T17:24:58.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:24:58.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696032+0000", 2020-11-12T17:24:58.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021269999999999999 2020-11-12T17:24:58.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:24:58.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696245+0000", 2020-11-12T17:24:58.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00032215999999999999 2020-11-12T17:24:58.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:24:58.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696567+0000", 2020-11-12T17:24:58.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001477368 2020-11-12T17:24:58.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:24:58.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.698044+0000", 2020-11-12T17:24:58.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29849877600000002 2020-11-12T17:24:58.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:24:58.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996543+0000", 2020-11-12T17:24:58.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4288000000000004e-05 2020-11-12T17:24:58.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:24:58.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996617+0000", 2020-11-12T17:24:58.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1554999999999997e-05 2020-11-12T17:24:58.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:24:58.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:24:58.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:24:58.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996669+0000", 2020-11-12T17:24:58.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001 2020-11-12T17:24:58.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.310 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:24:58.310 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:24:58.311 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:58.311 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:24:58.313 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:24:58.314 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:58.308+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:58.414 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:58.408+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:58.481 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:24:58.481 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:24:58.482 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:24:58.482 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:24:58.494 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:24:58.515 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:58.510+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:58.516 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:24:58.547 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:24:58.578 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:24:58.614 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:24:58.617 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:58.614+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:58.639 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:58.639 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:58.646 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:24:58.649 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:24:58.678 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:24:58.711 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:24:58.711 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:24:58.711 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:24:58.711 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:24:58.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:24:58.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:24:58.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:24:58.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:24:58.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:24:58.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:24:58.714 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:24:58.715 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:24:58.756 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:58.752+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:58.802 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:58.803 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:58.815 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:24:58.819 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:58.814+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:58.926 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:58.918+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:58.928 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 7 16 8422 8406 9.38092 10.0703 0.0053593 0.0132783 2020-11-12T17:24:58.985 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:58.986 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:58.998 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:24:59.021 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:59.018+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:59.112 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:59.113 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:59.126 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:59.118+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:59.127 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:24:59.224 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:24:59.222+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:24:59.242 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:59.242 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:59.251 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:24:59.325 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:59.322+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:59.380 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:59.381 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:59.392 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:24:59.426 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:24:59.420+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:24:59.527 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:59.522+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:59.553 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:59.554 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:59.566 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:24:59.628 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:59.624+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:59.729 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:24:59.726+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:24:59.743 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:59.744 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:59.756 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:24:59.831 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:24:59.824+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:24:59.926 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:24:59.928 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:24:59.928 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:24:59.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 8 16 9624 9608 9.38204 9.39062 0.00876821 0.0132664 2020-11-12T17:24:59.933 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:24:59.926+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:24:59.941 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:00.033 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:00.028+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:00.124 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:00.124 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:00.134 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:00.128+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:00.135 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:00.236 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:00.232+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:00.260 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:00.260 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:00.273 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:00.337 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:00.332+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:00.390 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:00.390 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:00.401 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:00.445 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:00.442+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:00.523 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:00.524 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:00.536 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:00.577 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:00.574+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:00.641 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:00.636+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:00.691 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:00.691 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:00.703 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:00.717 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:00.764 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:00.760+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:00.819 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:00.819 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:00.830 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:00.843 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:00.836+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:00.889 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:00.922 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:00.923 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:25:00.929 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 9 16 10518 10502 9.11528 6.98438 0.00793658 0.0136695 2020-11-12T17:25:00.945 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:00.942+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:00.950 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:00.951 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:00.951 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:00.965 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:00.978 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:01.006 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:01.042 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:01.057 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:01.054+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:01.074 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:25:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:01.076 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:01.076 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:01.076 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:01.078 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:01.080 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:01.140 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:01.140 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:01.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:01.140 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:01.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.141 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:25:01.141 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:01.141 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 112.294848437, 2020-11-12T17:25:01.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:25:01.141 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.141 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:01.142 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:01.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:01.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:01.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:25:01.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:25:01.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:25:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:25:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:25:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:25:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:25:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:25:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:25:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:25:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:25:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:25:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:25:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:25:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 110.63619789400001, 2020-11-12T17:25:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:25:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.155 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.155 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:01.155 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:01.155 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.155 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:25:01.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.155 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:25:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:25:01.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:25:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:25:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:25:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:25:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:25:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:25:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:25:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:25:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:25:01.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:25:01.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:01.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:25:01.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:25:01.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:01.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:25:01.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:25:01.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:25:01.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:25:01.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:25:01.166 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.166 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.166 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.167 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:01.167 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:01.167 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 110.634592834, 2020-11-12T17:25:01.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:25:01.167 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.167 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.167 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:01.168 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:01.168 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.168 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:25:01.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.168 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:01.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:01.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:01.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:25:01.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:25:01.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:25:01.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:25:01.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:25:01.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:25:01.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:25:01.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:25:01.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:25:01.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:25:01.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:25:01.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:25:01.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:01.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:25:01.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:25:01.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:01.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:25:01.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:25:01.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:25:01.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:25:01.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:25:01.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:25:01.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:25:01.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:25:01.179 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.179 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.179 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.179 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5735 3.d e25/20 ondisk, result = 0)", 2020-11-12T17:25:01.180 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:25:01.180 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 110.628506312, 2020-11-12T17:25:01.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002, 2020-11-12T17:25:01.180 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.180 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:01.180 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:25:01.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508789+0000", 2020-11-12T17:25:01.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:01.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508775+0000", 2020-11-12T17:25:01.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4838000000000001e-05 2020-11-12T17:25:01.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.508810+0000", 2020-11-12T17:25:01.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30211893099999998 2020-11-12T17:25:01.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810929+0000", 2020-11-12T17:25:01.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3546e-05 2020-11-12T17:25:01.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810942+0000", 2020-11-12T17:25:01.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021619539999999998 2020-11-12T17:25:01.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813104+0000", 2020-11-12T17:25:01.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1251999999999998e-05 2020-11-12T17:25:01.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813135+0000", 2020-11-12T17:25:01.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033488000000000002 2020-11-12T17:25:01.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813470+0000", 2020-11-12T17:25:01.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30468113600000002 2020-11-12T17:25:01.186 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.187 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.187 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.187 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:01.187 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:01.187 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.73709783, 2020-11-12T17:25:01.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:25:01.188 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.188 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.188 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:01.188 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:01.188 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.188 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:25:01.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.189 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:01.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:01.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:01.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:25:01.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:25:01.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:25:01.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:25:01.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:25:01.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:25:01.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:25:01.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:25:01.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:25:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:25:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:25:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:25:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:25:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:25:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:25:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:25:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:25:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:25:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:25:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:25:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:25:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:25:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.734651215, 2020-11-12T17:25:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:25:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:25:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:01.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:01.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:01.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:25:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:25:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:25:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:25:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:25:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:25:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:25:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:25:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:25:01.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:25:01.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:25:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:25:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:25:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:25:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:25:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:25:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:25:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:25:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:25:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:25:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:25:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:25:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.728826768, 2020-11-12T17:25:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:25:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:25:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:25:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:25:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:25:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:25:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:25:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:25:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:25:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:25:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:25:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:25:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:25:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:25:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:25:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.728758892, 2020-11-12T17:25:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:25:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:01.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:01.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:25:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:25:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:25:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:25:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:25:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:25:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:25:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:25:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:25:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:25:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:25:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:25:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:25:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:25:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:25:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.602768624000007, 2020-11-12T17:25:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:25:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:25:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:25:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:25:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:25:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:25:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:25:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:25:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:25:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:25:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:25:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:25:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:25:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:25:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:25:01.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:01.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:25:01.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:25:01.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:25:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:25:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:25:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:25:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:25:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:25:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:25:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:25:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:25:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.595464905, 2020-11-12T17:25:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:25:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:25:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:25:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:25:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:25:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:25:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:25:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:25:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:25:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:25:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:25:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:25:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:25:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:25:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:25:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.221886412000003, 2020-11-12T17:25:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:25:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:25:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:25:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:25:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:25:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:25:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:25:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:25:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:25:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:25:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:25:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:25:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:25:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:25:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:25:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:25:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:25:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:25:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:25:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:25:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:25:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:25:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:25:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:25:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:25:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.210333292000001, 2020-11-12T17:25:01.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:25:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:01.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:25:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:25:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:25:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:25:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:25:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:25:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:25:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:25:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:25:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:25:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:25:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:25:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:25:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:25:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.137213110999994, 2020-11-12T17:25:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:25:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:25:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:25:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:25:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:25:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:25:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:25:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:25:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:25:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:25:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:25:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:25:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:25:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:25:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:25:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:25:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:25:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:25:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:25:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:25:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:25:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:25:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:25:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:25:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 61.849913397999998, 2020-11-12T17:25:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:25:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:25:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:25:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:25:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:25:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:25:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:25:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:25:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:25:01.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:25:01.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:25:01.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:25:01.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:25:01.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:25:01.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:25:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:25:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:25:01.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:25:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:25:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:25:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:25:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:25:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:25:01.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:25:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:01.283 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 61.304520408000002, 2020-11-12T17:25:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:25:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:25:01.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:25:01.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:25:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:25:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:25:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:25:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:25:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:25:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:25:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:25:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:25:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:25:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:25:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:25:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:25:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:25:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:25:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:25:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:25:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:25:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:25:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:25:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:25:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:25:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.311970148, 2020-11-12T17:25:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:25:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.295 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:01.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:25:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:25:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:25:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:25:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:25:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:25:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:25:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:25:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:25:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:25:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:25:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:25:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:25:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:25:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:25:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:25:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57960 3.7 e57/20 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head v 57'3648, mlcod=57'3642)", 2020-11-12T17:25:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 38.408237380000003, 2020-11-12T17:25:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998, 2020-11-12T17:25:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729033+0000", 2020-11-12T17:25:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001002 2020-11-12T17:25:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729133+0000", 2020-11-12T17:25:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30451762900000001 2020-11-12T17:25:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033650+0000", 2020-11-12T17:25:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2909999999999998e-06 2020-11-12T17:25:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033656+0000", 2020-11-12T17:25:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1718000000000003e-05 2020-11-12T17:25:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033697+0000", 2020-11-12T17:25:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2977999999999999e-05 2020-11-12T17:25:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033720+0000", 2020-11-12T17:25:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058524529999999996 2020-11-12T17:25:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039573+0000", 2020-11-12T17:25:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2095999999999997e-05 2020-11-12T17:25:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039625+0000", 2020-11-12T17:25:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998 2020-11-12T17:25:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:25:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.476133976, 2020-11-12T17:25:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:25:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:25:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:25:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:25:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:25:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:25:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:25:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:25:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:25:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:25:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:25:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:25:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:25:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:25:01.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:25:01.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:25:01.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:25:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:1240 4.a e71/69 4:5ae32822:::benchmark_data_smithi036_18856_object154:head v 71'104, mlcod=71'98)", 2020-11-12T17:25:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:01.318 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 8.1599194359999991, 2020-11-12T17:25:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295, 2020-11-12T17:25:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:01.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:01.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977341+0000", 2020-11-12T17:25:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013138399999999999 2020-11-12T17:25:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977473+0000", 2020-11-12T17:25:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011075199999998 2020-11-12T17:25:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337584+0000", 2020-11-12T17:25:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2939999999999994e-06 2020-11-12T17:25:01.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337593+0000", 2020-11-12T17:25:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0656999999999996e-05 2020-11-12T17:25:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337684+0000", 2020-11-12T17:25:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819999999999997e-05 2020-11-12T17:25:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337715+0000", 2020-11-12T17:25:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031310180000000002 2020-11-12T17:25:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340846+0000", 2020-11-12T17:25:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2611000000000002e-05 2020-11-12T17:25:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340889+0000", 2020-11-12T17:25:01.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295 2020-11-12T17:25:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:7176 4.0 e73/69 4:0798add9:::benchmark_data_smithi036_18856_object896:head v 73'408, mlcod=73'401)", 2020-11-12T17:25:01.326 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.1765089039999999, 2020-11-12T17:25:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002, 2020-11-12T17:25:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:25:01.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960758+0000", 2020-11-12T17:25:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6748000000000003e-05 2020-11-12T17:25:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:01.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960855+0000", 2020-11-12T17:25:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31998174899999998 2020-11-12T17:25:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280837+0000", 2020-11-12T17:25:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8499999999999996e-06 2020-11-12T17:25:01.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280844+0000", 2020-11-12T17:25:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7806000000000002e-05 2020-11-12T17:25:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:01.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280902+0000", 2020-11-12T17:25:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5435e-05 2020-11-12T17:25:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280927+0000", 2020-11-12T17:25:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003038785 2020-11-12T17:25:01.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.283966+0000", 2020-11-12T17:25:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:25:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:01.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.284022+0000", 2020-11-12T17:25:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002 2020-11-12T17:25:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:01.334 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:01.334 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:01.336 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:01.337 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:01.332+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:01.437 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:01.434+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:01.465 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:01.465 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:01.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.466 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:11134 4.7 e74/69 4:e57da1ec:::benchmark_data_smithi036_18856_object1391:head v 74'702, mlcod=74'698)", 2020-11-12T17:25:01.466 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:01.457411+0000", 2020-11-12T17:25:01.470 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0064294369999999997, 2020-11-12T17:25:01.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006448507, 2020-11-12T17:25:01.470 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.471 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.471 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.457411+0000", 2020-11-12T17:25:01.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.457411+0000", 2020-11-12T17:25:01.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999958 2020-11-12T17:25:01.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.457369+0000", 2020-11-12T17:25:01.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013352000000000001 2020-11-12T17:25:01.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.457503+0000", 2020-11-12T17:25:01.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010723299999999999 2020-11-12T17:25:01.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.457610+0000", 2020-11-12T17:25:01.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0299999999999994e-06 2020-11-12T17:25:01.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.457618+0000", 2020-11-12T17:25:01.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.02e-05 2020-11-12T17:25:01.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.457668+0000", 2020-11-12T17:25:01.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2918999999999999e-05 2020-11-12T17:25:01.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.457691+0000", 2020-11-12T17:25:01.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028000900000000001 2020-11-12T17:25:01.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.476 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.477 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:11135 4.7 e74/69 4:e57da1ec:::benchmark_data_smithi036_18856_object1391:head v 74'703, mlcod=74'698)", 2020-11-12T17:25:01.477 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:01.458317+0000", 2020-11-12T17:25:01.477 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0055235320000000003, 2020-11-12T17:25:01.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055855319999999998, 2020-11-12T17:25:01.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.478 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.478 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.458317+0000", 2020-11-12T17:25:01.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.458317+0000", 2020-11-12T17:25:01.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999723 2020-11-12T17:25:01.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.458289+0000", 2020-11-12T17:25:01.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4946999999999997e-05 2020-11-12T17:25:01.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.458384+0000", 2020-11-12T17:25:01.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4704999999999999e-05 2020-11-12T17:25:01.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.458439+0000", 2020-11-12T17:25:01.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4810000000000003e-06 2020-11-12T17:25:01.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.458445+0000", 2020-11-12T17:25:01.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0964999999999997e-05 2020-11-12T17:25:01.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.458496+0000", 2020-11-12T17:25:01.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.639e-05 2020-11-12T17:25:01.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.458523+0000", 2020-11-12T17:25:01.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020561700000000001 2020-11-12T17:25:01.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.484 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.485 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:11136 4.7 e74/69 4:e57da1ec:::benchmark_data_smithi036_18856_object1391:head v 74'704, mlcod=74'698)", 2020-11-12T17:25:01.485 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:01.459128+0000", 2020-11-12T17:25:01.485 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0047129370000000004, 2020-11-12T17:25:01.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048126769999999996, 2020-11-12T17:25:01.485 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.485 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.486 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.459128+0000", 2020-11-12T17:25:01.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.459128+0000", 2020-11-12T17:25:01.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:25:01.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.459114+0000", 2020-11-12T17:25:01.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6737999999999999e-05 2020-11-12T17:25:01.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.459161+0000", 2020-11-12T17:25:01.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4783999999999998e-05 2020-11-12T17:25:01.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.459196+0000", 2020-11-12T17:25:01.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3989999999999997e-06 2020-11-12T17:25:01.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.459200+0000", 2020-11-12T17:25:01.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6328000000000002e-05 2020-11-12T17:25:01.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.459236+0000", 2020-11-12T17:25:01.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5116000000000001e-05 2020-11-12T17:25:01.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.459252+0000", 2020-11-12T17:25:01.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000124065 2020-11-12T17:25:01.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.492 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.493 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:11137 4.7 e74/69 4:e90494b6:::benchmark_data_smithi036_18856_object1392:head v 74'705, mlcod=74'699)", 2020-11-12T17:25:01.493 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:01.460122+0000", 2020-11-12T17:25:01.493 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0037187040000000002, 2020-11-12T17:25:01.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038542049999999999, 2020-11-12T17:25:01.494 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.494 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.494 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460122+0000", 2020-11-12T17:25:01.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460122+0000", 2020-11-12T17:25:01.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:25:01.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460108+0000", 2020-11-12T17:25:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8375999999999999e-05 2020-11-12T17:25:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460157+0000", 2020-11-12T17:25:01.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6044000000000002e-05 2020-11-12T17:25:01.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460203+0000", 2020-11-12T17:25:01.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0730000000000001e-06 2020-11-12T17:25:01.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460209+0000", 2020-11-12T17:25:01.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7569999999999999e-05 2020-11-12T17:25:01.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460266+0000", 2020-11-12T17:25:01.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9814e-05 2020-11-12T17:25:01.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460286+0000", 2020-11-12T17:25:01.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016444699999999999 2020-11-12T17:25:01.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.502 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.502 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.502 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:11138 4.7 e74/69 4:e90494b6:::benchmark_data_smithi036_18856_object1392:head v 74'706, mlcod=74'699)", 2020-11-12T17:25:01.502 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:01.460950+0000", 2020-11-12T17:25:01.502 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0028903560000000002, 2020-11-12T17:25:01.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003062717, 2020-11-12T17:25:01.503 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.503 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.503 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460950+0000", 2020-11-12T17:25:01.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460950+0000", 2020-11-12T17:25:01.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:25:01.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460937+0000", 2020-11-12T17:25:01.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8964000000000001e-05 2020-11-12T17:25:01.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.460985+0000", 2020-11-12T17:25:01.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2079999999999998e-05 2020-11-12T17:25:01.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461018+0000", 2020-11-12T17:25:01.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4939999999999997e-06 2020-11-12T17:25:01.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461022+0000", 2020-11-12T17:25:01.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2623999999999998e-05 2020-11-12T17:25:01.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461055+0000", 2020-11-12T17:25:01.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7329e-05 2020-11-12T17:25:01.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461072+0000", 2020-11-12T17:25:01.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012187 2020-11-12T17:25:01.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.511 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.511 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:11139 4.7 e74/69 4:e90494b6:::benchmark_data_smithi036_18856_object1392:head v 74'707, mlcod=74'699)", 2020-11-12T17:25:01.512 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:01.461767+0000", 2020-11-12T17:25:01.512 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0020738280000000002, 2020-11-12T17:25:01.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022818370000000001, 2020-11-12T17:25:01.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.512 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.512 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461767+0000", 2020-11-12T17:25:01.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461767+0000", 2020-11-12T17:25:01.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:25:01.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461753+0000", 2020-11-12T17:25:01.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8752999999999999e-05 2020-11-12T17:25:01.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461802+0000", 2020-11-12T17:25:01.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0932e-05 2020-11-12T17:25:01.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461853+0000", 2020-11-12T17:25:01.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3089999999999998e-06 2020-11-12T17:25:01.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461860+0000", 2020-11-12T17:25:01.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3253000000000002e-05 2020-11-12T17:25:01.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461893+0000", 2020-11-12T17:25:01.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7334e-05 2020-11-12T17:25:01.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.461910+0000", 2020-11-12T17:25:01.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014379599999999999 2020-11-12T17:25:01.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.521 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.521 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:11140 4.7 e74/69 4:e90494b6:::benchmark_data_smithi036_18856_object1392:head v 74'708, mlcod=74'700)", 2020-11-12T17:25:01.521 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:01.462684+0000", 2020-11-12T17:25:01.521 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00115643, 2020-11-12T17:25:01.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001400159, 2020-11-12T17:25:01.522 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.522 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.462684+0000", 2020-11-12T17:25:01.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.462684+0000", 2020-11-12T17:25:01.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:01.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.462662+0000", 2020-11-12T17:25:01.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8401999999999998e-05 2020-11-12T17:25:01.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.462750+0000", 2020-11-12T17:25:01.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8964999999999997e-05 2020-11-12T17:25:01.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.462789+0000", 2020-11-12T17:25:01.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3699999999999997e-06 2020-11-12T17:25:01.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.462794+0000", 2020-11-12T17:25:01.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4421999999999997e-05 2020-11-12T17:25:01.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.462828+0000", 2020-11-12T17:25:01.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7056000000000001e-05 2020-11-12T17:25:01.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.462845+0000", 2020-11-12T17:25:01.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016121399999999999 2020-11-12T17:25:01.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.529 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.530 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:11141 4.7 e74/69)", 2020-11-12T17:25:01.530 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:01.463464+0000", 2020-11-12T17:25:01.530 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00037635700000000002, 2020-11-12T17:25:01.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00065447599999999997, 2020-11-12T17:25:01.531 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.531 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:01.531 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.463464+0000", 2020-11-12T17:25:01.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.463464+0000", 2020-11-12T17:25:01.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:25:01.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.463451+0000", 2020-11-12T17:25:01.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9529e-05 2020-11-12T17:25:01.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.463500+0000", 2020-11-12T17:25:01.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6717000000000001e-05 2020-11-12T17:25:01.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.463537+0000", 2020-11-12T17:25:01.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7950000000000004e-06 2020-11-12T17:25:01.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:01.463543+0000", 2020-11-12T17:25:01.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8450999999999998e-05 2020-11-12T17:25:01.535 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.535 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.536 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.536 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.536 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:25:01.536 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 8 2020-11-12T17:25:01.536 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:01.538 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:01.538 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:01.534+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:01.640 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:01.634+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:01.657 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:01.658 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:01.658 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:01.658 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:01.658 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:01.670 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:01.741 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:01.736+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:01.789 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:01.789 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:01.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:01.790 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:01.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.790 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:01.790 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:01.790 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.676421905, 2020-11-12T17:25:01.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:25:01.791 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.791 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.791 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.791 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:01.791 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.791 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:25:01.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.792 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:01.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:01.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:01.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:25:01.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:25:01.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:25:01.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:25:01.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:25:01.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:25:01.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:25:01.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:25:01.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:25:01.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:25:01.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:25:01.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:25:01.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:01.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:25:01.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:25:01.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:25:01.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:25:01.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:25:01.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:25:01.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:25:01.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:25:01.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:25:01.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:25:01.804 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.804 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.804 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.804 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:25:01.804 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:01.805 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.669330109, 2020-11-12T17:25:01.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:25:01.805 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.805 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.805 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:01.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:01.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:01.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:25:01.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:25:01.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:25:01.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:25:01.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:25:01.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:25:01.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:25:01.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:25:01.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:25:01.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:25:01.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:25:01.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:25:01.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:25:01.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:25:01.813 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.813 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.813 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.813 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:01.813 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:25:01.814 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.23729303099999, 2020-11-12T17:25:01.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999, 2020-11-12T17:25:01.814 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.814 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.814 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.814 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:01.814 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.814 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:25:01.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.815 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:25:01.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:25:01.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:25:01.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:25:01.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:25:01.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:25:01.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:25:01.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:25:01.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:25:01.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:25:01.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:25:01.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:25:01.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:25:01.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:25:01.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112811 2020-11-12T17:25:01.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:01.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550940+0000", 2020-11-12T17:25:01.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001154101 2020-11-12T17:25:01.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552095+0000", 2020-11-12T17:25:01.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25363090900000002 2020-11-12T17:25:01.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805725+0000", 2020-11-12T17:25:01.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8797999999999998e-05 2020-11-12T17:25:01.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805824+0000", 2020-11-12T17:25:01.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8110999999999998e-05 2020-11-12T17:25:01.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805902+0000", 2020-11-12T17:25:01.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999 2020-11-12T17:25:01.824 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.824 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.825 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.825 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:01.825 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:01.825 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.236770612, 2020-11-12T17:25:01.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:25:01.826 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.826 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.826 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.826 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:01.826 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.826 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:25:01.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.826 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:01.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:01.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:01.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:25:01.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:25:01.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:25:01.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:25:01.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:25:01.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:25:01.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:25:01.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:25:01.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:25:01.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:25:01.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:25:01.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:25:01.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:01.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:25:01.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:25:01.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:25:01.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:25:01.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:25:01.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:25:01.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:25:01.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:25:01.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:25:01.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:25:01.838 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.838 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.838 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.839 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9999 3.1 e26/20 ondisk, result = 0)", 2020-11-12T17:25:01.839 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:25:01.839 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.228408092, 2020-11-12T17:25:01.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145, 2020-11-12T17:25:01.839 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.839 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.839 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:25:01.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:25:01.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:01.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556869+0000", 2020-11-12T17:25:01.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1767999999999994e-05 2020-11-12T17:25:01.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556951+0000", 2020-11-12T17:25:01.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.248442731 2020-11-12T17:25:01.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805393+0000", 2020-11-12T17:25:01.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5503e-05 2020-11-12T17:25:01.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805409+0000", 2020-11-12T17:25:01.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027928399999999998 2020-11-12T17:25:01.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805688+0000", 2020-11-12T17:25:01.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2215e-05 2020-11-12T17:25:01.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805710+0000", 2020-11-12T17:25:01.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000226744 2020-11-12T17:25:01.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805937+0000", 2020-11-12T17:25:01.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145 2020-11-12T17:25:01.848 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.848 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.848 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.849 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:25512 3.b e46/20 3:d013695c:::benchmark_data_smithi036_14212_object3188:head v 46'1664, mlcod=46'1657)", 2020-11-12T17:25:01.849 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:25:01.850 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.324232139000003, 2020-11-12T17:25:01.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999, 2020-11-12T17:25:01.850 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.850 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.850 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:25:01.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:25:01.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:25:01.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461054+0000", 2020-11-12T17:25:01.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5973000000000002e-05 2020-11-12T17:25:01.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461100+0000", 2020-11-12T17:25:01.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27743074600000001 2020-11-12T17:25:01.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738530+0000", 2020-11-12T17:25:01.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6039999999999993e-06 2020-11-12T17:25:01.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738539+0000", 2020-11-12T17:25:01.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7942000000000006e-05 2020-11-12T17:25:01.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738627+0000", 2020-11-12T17:25:01.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1338000000000003e-05 2020-11-12T17:25:01.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738668+0000", 2020-11-12T17:25:01.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002001774 2020-11-12T17:25:01.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740670+0000", 2020-11-12T17:25:01.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7090999999999999e-05 2020-11-12T17:25:01.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740737+0000", 2020-11-12T17:25:01.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999 2020-11-12T17:25:01.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.860 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.860 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:25:01.860 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:01.861 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.286650518000002, 2020-11-12T17:25:01.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:25:01.861 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.861 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.861 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:01.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:01.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:01.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:25:01.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:25:01.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:25:01.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:25:01.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:25:01.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:25:01.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:25:01.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:25:01.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:25:01.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:25:01.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:25:01.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:25:01.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:25:01.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:25:01.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.868 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.869 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:28424 3.b e47/20 3:d6b3d883:::benchmark_data_smithi036_14212_object3552:head v 47'1832, mlcod=47'1825)", 2020-11-12T17:25:01.869 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:01.869 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.261479156999997, 2020-11-12T17:25:01.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002, 2020-11-12T17:25:01.869 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.869 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.869 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:01.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:01.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:01.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523784+0000", 2020-11-12T17:25:01.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100963 2020-11-12T17:25:01.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523885+0000", 2020-11-12T17:25:01.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29458836900000002 2020-11-12T17:25:01.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818473+0000", 2020-11-12T17:25:01.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1482e-05 2020-11-12T17:25:01.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818485+0000", 2020-11-12T17:25:01.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4080999999999998e-05 2020-11-12T17:25:01.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818559+0000", 2020-11-12T17:25:01.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9269e-05 2020-11-12T17:25:01.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818598+0000", 2020-11-12T17:25:01.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044328520000000001 2020-11-12T17:25:01.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823031+0000", 2020-11-12T17:25:01.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2584999999999998e-05 2020-11-12T17:25:01.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823094+0000", 2020-11-12T17:25:01.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002 2020-11-12T17:25:01.878 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.878 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.878 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.878 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:25:01.878 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:01.879 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 71.181048626000006, 2020-11-12T17:25:01.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:25:01.879 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.879 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.879 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:01.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:01.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:01.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:25:01.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:25:01.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:25:01.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:25:01.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:25:01.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:01.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:25:01.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:25:01.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:25:01.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:25:01.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:25:01.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:25:01.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:25:01.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:25:01.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:25:01.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:25:01.886 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.887 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.887 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43534 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:01.888 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:25:01.888 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.076397653000001, 2020-11-12T17:25:01.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002, 2020-11-12T17:25:01.888 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.888 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.888 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:01.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.889 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43534 2020-11-12T17:25:01.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.889 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:25:01.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:25:01.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:01.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708876+0000", 2020-11-12T17:25:01.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4095000000000002e-05 2020-11-12T17:25:01.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708940+0000", 2020-11-12T17:25:01.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960000000000007e-06 2020-11-12T17:25:01.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708949+0000", 2020-11-12T17:25:01.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.451e-06 2020-11-12T17:25:01.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708955+0000", 2020-11-12T17:25:01.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085037340000000006 2020-11-12T17:25:01.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717458+0000", 2020-11-12T17:25:01.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4234999999999997e-05 2020-11-12T17:25:01.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717523+0000", 2020-11-12T17:25:01.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012550500000000001 2020-11-12T17:25:01.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:01.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717648+0000", 2020-11-12T17:25:01.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040419740000000003 2020-11-12T17:25:01.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.721690+0000", 2020-11-12T17:25:01.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.247979797 2020-11-12T17:25:01.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969670+0000", 2020-11-12T17:25:01.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012950400000000001 2020-11-12T17:25:01.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969799+0000", 2020-11-12T17:25:01.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000181709 2020-11-12T17:25:01.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969981+0000", 2020-11-12T17:25:01.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002 2020-11-12T17:25:01.898 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.899 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.899 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.899 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43535 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:01.899 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:01.899 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.076078825000003, 2020-11-12T17:25:01.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003, 2020-11-12T17:25:01.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.900 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.900 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.900 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:01.900 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.900 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43535 2020-11-12T17:25:01.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.901 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:01.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:01.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:01.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709201+0000", 2020-11-12T17:25:01.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4987000000000001e-05 2020-11-12T17:25:01.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709256+0000", 2020-11-12T17:25:01.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9799999999999998e-06 2020-11-12T17:25:01.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709264+0000", 2020-11-12T17:25:01.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:25:01.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709268+0000", 2020-11-12T17:25:01.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01033796 2020-11-12T17:25:01.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719606+0000", 2020-11-12T17:25:01.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014753499999999999 2020-11-12T17:25:01.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719754+0000", 2020-11-12T17:25:01.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023477900000000001 2020-11-12T17:25:01.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:01.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719989+0000", 2020-11-12T17:25:01.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002308844 2020-11-12T17:25:01.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722298+0000", 2020-11-12T17:25:01.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27981983300000002 2020-11-12T17:25:01.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002117+0000", 2020-11-12T17:25:01.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4757000000000001e-05 2020-11-12T17:25:01.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002212+0000", 2020-11-12T17:25:01.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116928 2020-11-12T17:25:01.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002329+0000", 2020-11-12T17:25:01.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003 2020-11-12T17:25:01.911 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.911 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.911 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.911 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43536 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:01.912 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:01.912 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.075979294, 2020-11-12T17:25:01.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001, 2020-11-12T17:25:01.912 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.913 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:01.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.913 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43536 2020-11-12T17:25:01.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.913 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:01.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:01.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:01.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709302+0000", 2020-11-12T17:25:01.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3248999999999998e-05 2020-11-12T17:25:01.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709355+0000", 2020-11-12T17:25:01.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.34e-06 2020-11-12T17:25:01.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709363+0000", 2020-11-12T17:25:01.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.664e-06 2020-11-12T17:25:01.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709366+0000", 2020-11-12T17:25:01.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013071532 2020-11-12T17:25:01.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722438+0000", 2020-11-12T17:25:01.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141901 2020-11-12T17:25:01.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722580+0000", 2020-11-12T17:25:01.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118355 2020-11-12T17:25:01.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:01.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722698+0000", 2020-11-12T17:25:01.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014561839999999999 2020-11-12T17:25:01.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.724154+0000", 2020-11-12T17:25:01.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27825006499999999 2020-11-12T17:25:01.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002404+0000", 2020-11-12T17:25:01.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2908000000000001e-05 2020-11-12T17:25:01.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002477+0000", 2020-11-12T17:25:01.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020370300000000001 2020-11-12T17:25:01.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002681+0000", 2020-11-12T17:25:01.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001 2020-11-12T17:25:01.922 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.923 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.923 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.923 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:43534 3.6 e53/20 ondisk, result = 0)", 2020-11-12T17:25:01.923 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:25:01.923 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.058870968999997, 2020-11-12T17:25:01.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001, 2020-11-12T17:25:01.924 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.924 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.924 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:25:01.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:25:01.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:25:01.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726412+0000", 2020-11-12T17:25:01.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2086000000000003e-05 2020-11-12T17:25:01.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726454+0000", 2020-11-12T17:25:01.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24305705 2020-11-12T17:25:01.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969511+0000", 2020-11-12T17:25:01.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.49e-05 2020-11-12T17:25:01.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969526+0000", 2020-11-12T17:25:01.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010331999999999999 2020-11-12T17:25:01.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969629+0000", 2020-11-12T17:25:01.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1993000000000001e-05 2020-11-12T17:25:01.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969651+0000", 2020-11-12T17:25:01.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00033822300000000002 2020-11-12T17:25:01.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969989+0000", 2020-11-12T17:25:01.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001 2020-11-12T17:25:01.930 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.930 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.931 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.931 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43768 3.6 3:6f7b85f8:::benchmark_data_smithi036_14212_object5470:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:01.931 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:25:01.931 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 56.787246449000001, 2020-11-12T17:25:01.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001, 2020-11-12T17:25:01.932 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.932 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.932 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.932 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:01.932 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.932 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43768 2020-11-12T17:25:01.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.933 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:25:01.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:25:01.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:01.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998003+0000", 2020-11-12T17:25:01.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014095000000000001 2020-11-12T17:25:01.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998144+0000", 2020-11-12T17:25:01.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1143000000000001e-05 2020-11-12T17:25:01.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998165+0000", 2020-11-12T17:25:01.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3979999999999999e-06 2020-11-12T17:25:01.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998174+0000", 2020-11-12T17:25:01.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012056769 2020-11-12T17:25:01.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010231+0000", 2020-11-12T17:25:01.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102279 2020-11-12T17:25:01.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010333+0000", 2020-11-12T17:25:01.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014553299999999999 2020-11-12T17:25:01.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:01.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010478+0000", 2020-11-12T17:25:01.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037901779999999999 2020-11-12T17:25:01.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.014269+0000", 2020-11-12T17:25:01.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22457837 2020-11-12T17:25:01.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238847+0000", 2020-11-12T17:25:01.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2958000000000001e-05 2020-11-12T17:25:01.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238930+0000", 2020-11-12T17:25:01.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1814000000000002e-05 2020-11-12T17:25:01.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238982+0000", 2020-11-12T17:25:01.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001 2020-11-12T17:25:01.944 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.944 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.945 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.945 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50240 3.1 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:25:01.945 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:25:01.945 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.432202254000003, 2020-11-12T17:25:01.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003, 2020-11-12T17:25:01.945 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.946 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.946 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.946 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:01.946 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.946 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50240 2020-11-12T17:25:01.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.946 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:25:01.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:25:01.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:01.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353074+0000", 2020-11-12T17:25:01.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106903 2020-11-12T17:25:01.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353181+0000", 2020-11-12T17:25:01.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6804999999999999e-05 2020-11-12T17:25:01.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353198+0000", 2020-11-12T17:25:01.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3259999999999998e-06 2020-11-12T17:25:01.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353205+0000", 2020-11-12T17:25:01.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011916829 2020-11-12T17:25:01.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365122+0000", 2020-11-12T17:25:01.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111867 2020-11-12T17:25:01.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365234+0000", 2020-11-12T17:25:01.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011033500000000001 2020-11-12T17:25:01.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:01.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365344+0000", 2020-11-12T17:25:01.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002314876 2020-11-12T17:25:01.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.367659+0000", 2020-11-12T17:25:01.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23853026499999999 2020-11-12T17:25:01.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606189+0000", 2020-11-12T17:25:01.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3222999999999999e-05 2020-11-12T17:25:01.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606272+0000", 2020-11-12T17:25:01.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000165849 2020-11-12T17:25:01.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606438+0000", 2020-11-12T17:25:01.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003 2020-11-12T17:25:01.955 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.955 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.955 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.834565292000001, 2020-11-12T17:25:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:25:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:25:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:25:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:25:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:25:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:25:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:25:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:25:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:25:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:25:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:25:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:25:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:25:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:25:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:25:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:25:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:25:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:25:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:25:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:25:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:25:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:25:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:25:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:25:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:25:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.83872349, 2020-11-12T17:25:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:25:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:25:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:25:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:25:01.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:25:01.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:25:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:25:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:25:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:25:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:25:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:25:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:25:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:25:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:25:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:25:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:25:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.903620091000001, 2020-11-12T17:25:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:25:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:25:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:25:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:25:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:25:01.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:25:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:25:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:25:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:25:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:25:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:25:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:25:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:25:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:25:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:304 4.b 4:d3839b57:::benchmark_data_smithi036_18856_object37:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.6474545339999995, 2020-11-12T17:25:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999, 2020-11-12T17:25:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 304 2020-11-12T17:25:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137813+0000", 2020-11-12T17:25:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9074999999999998e-05 2020-11-12T17:25:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137892+0000", 2020-11-12T17:25:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8020000000000003e-06 2020-11-12T17:25:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137902+0000", 2020-11-12T17:25:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7619999999999995e-06 2020-11-12T17:25:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137909+0000", 2020-11-12T17:25:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040533879999999998 2020-11-12T17:25:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.141963+0000", 2020-11-12T17:25:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162048 2020-11-12T17:25:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142125+0000", 2020-11-12T17:25:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00039201500000000001 2020-11-12T17:25:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142517+0000", 2020-11-12T17:25:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010951820000000001 2020-11-12T17:25:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.143612+0000", 2020-11-12T17:25:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.286564975 2020-11-12T17:25:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430177+0000", 2020-11-12T17:25:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8254000000000002e-05 2020-11-12T17:25:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430235+0000", 2020-11-12T17:25:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9767000000000001e-05 2020-11-12T17:25:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430275+0000", 2020-11-12T17:25:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999 2020-11-12T17:25:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:936 4.6 4:6403dfdf:::benchmark_data_smithi036_18856_object116:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.0930103110000005, 2020-11-12T17:25:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001, 2020-11-12T17:25:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 936 2020-11-12T17:25:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692257+0000", 2020-11-12T17:25:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8807999999999994e-05 2020-11-12T17:25:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692346+0000", 2020-11-12T17:25:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1438e-05 2020-11-12T17:25:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692357+0000", 2020-11-12T17:25:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0989999999999998e-06 2020-11-12T17:25:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692362+0000", 2020-11-12T17:25:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036699900000000001 2020-11-12T17:25:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696032+0000", 2020-11-12T17:25:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021269999999999999 2020-11-12T17:25:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696245+0000", 2020-11-12T17:25:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00032215999999999999 2020-11-12T17:25:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696567+0000", 2020-11-12T17:25:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001477368 2020-11-12T17:25:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.698044+0000", 2020-11-12T17:25:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29849877600000002 2020-11-12T17:25:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996543+0000", 2020-11-12T17:25:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4288000000000004e-05 2020-11-12T17:25:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996617+0000", 2020-11-12T17:25:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1554999999999997e-05 2020-11-12T17:25:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996669+0000", 2020-11-12T17:25:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001 2020-11-12T17:25:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.013 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:02.016 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:02.017 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 10 16 11715 11699 9.13883 9.35156 0.00997031 0.0136453 2020-11-12T17:25:02.017 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:02.008+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:02.117 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:02.112+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:02.192 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:02.193 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:02.193 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:02.193 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:02.205 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:25:02.217 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:02.214+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:02.318 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:02.312+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:02.366 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:02.367 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:02.375 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:25:02.420 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:02.414+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:02.520 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:02.516+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:02.533 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:02.533 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:02.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:02.534 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:02.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.534 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:25:02.534 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:02.534 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.87117734500001, 2020-11-12T17:25:02.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:25:02.534 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.535 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.535 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:02.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:02.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:02.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:25:02.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:25:02.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:25:02.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:25:02.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:25:02.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:25:02.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:25:02.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:25:02.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:25:02.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:25:02.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:25:02.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:25:02.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:25:02.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:25:02.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:25:02.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:25:02.541 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.542 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:25:02.542 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:02.542 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.87027055, 2020-11-12T17:25:02.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:25:02.543 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.543 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.543 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:02.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:25:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:25:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:25:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:25:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:25:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:25:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:25:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:25:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:25:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:25:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:25:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:25:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:25:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:25:02.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:25:02.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.550 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.869568327, 2020-11-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:25:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:25:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:25:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:25:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:25:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:25:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:25:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:25:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:25:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:25:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:25:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.865062131, 2020-11-12T17:25:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:25:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:25:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:25:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:25:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:25:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:25:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:25:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:25:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:25:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:25:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:25:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:25:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:25:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:25:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.36152115, 2020-11-12T17:25:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:25:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:25:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:25:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:25:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:25:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:25:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:25:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:25:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:25:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:25:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:25:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:25:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:25:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:25:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:25:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:25:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:25:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:25:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.360594909, 2020-11-12T17:25:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:25:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:25:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:25:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:25:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:25:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:25:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:25:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:25:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:25:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:25:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:25:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:25:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:25:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:25:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:25:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:25:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:25:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:25:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:25:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.35824739900001, 2020-11-12T17:25:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:25:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:25:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:25:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:25:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:25:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:25:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:25:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:25:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:25:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:25:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:25:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:25:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:25:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:25:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:25:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:25:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:25:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:25:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:25:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.35748260699999, 2020-11-12T17:25:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:25:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:25:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:25:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:25:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:25:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:25:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:25:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:25:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:25:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:25:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:25:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:25:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:25:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:25:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:25:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:25:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:25:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:25:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.275256129, 2020-11-12T17:25:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:25:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:25:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:25:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:25:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:25:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:25:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:25:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:25:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:25:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:25:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:25:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:25:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:25:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:25:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:25:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:25:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:25:02.616 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.617 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.623 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.624 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:25:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.683142696, 2020-11-12T17:25:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:25:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:02.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:25:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:25:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:25:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:25:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:25:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:25:02.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:25:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:25:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:25:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:25:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:25:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:25:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:25:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:25:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:25:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:25:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:25:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:25:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.654482399, 2020-11-12T17:25:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:25:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:25:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:25:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:25:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:25:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:25:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:25:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:25:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:25:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:25:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:25:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:25:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:25:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:25:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:25:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:25:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:25:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:25:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.741885688, 2020-11-12T17:25:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:25:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:25:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:25:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:25:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:25:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:25:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:25:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:25:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:25:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:25:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:25:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:25:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:25:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:25:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:25:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:25:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:25:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:25:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:02.678 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.670746044, 2020-11-12T17:25:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:25:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:25:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:25:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:25:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:25:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:25:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:25:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:25:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:25:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:25:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:25:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:25:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:25:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:25:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:25:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:25:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:25:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:25:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.56135875299999, 2020-11-12T17:25:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:25:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:25:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:25:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:25:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:25:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:25:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:25:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:25:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:25:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:25:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:25:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:25:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:25:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:25:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:25:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:25:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:25:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:25:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.49082291400001, 2020-11-12T17:25:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:25:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:25:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:25:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:25:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:25:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:25:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:25:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:25:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:25:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:25:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:25:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:25:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:25:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:25:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:25:02.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:25:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:25:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:25:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.32145697599999, 2020-11-12T17:25:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:25:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:25:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:25:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:25:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:25:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:25:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:25:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:25:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:25:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:25:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:25:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:25:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:25:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:25:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:25:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:25:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:25:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:25:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:25:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.992831104, 2020-11-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:25:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:25:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:25:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:25:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:25:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:25:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:25:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:25:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:25:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:25:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:25:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.33636774199999, 2020-11-12T17:25:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:25:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:25:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:25:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:25:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:25:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:25:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:25:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:25:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:25:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:25:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:25:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:25:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:25:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:25:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:25:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:25:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:25:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:25:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.33372701899999, 2020-11-12T17:25:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:25:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:25:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:25:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:25:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:25:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:25:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:25:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:25:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:25:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:25:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:25:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:25:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:25:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:25:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:25:02.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:25:02.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:25:02.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.744 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.745 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.746 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:25:02.746 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:02.746 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 103.84948098, 2020-11-12T17:25:02.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:25:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:02.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:02.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:02.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:25:02.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:02.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:25:02.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:25:02.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:02.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:25:02.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:25:02.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:02.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:25:02.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:25:02.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:02.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:25:02.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:25:02.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:02.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:25:02.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:25:02.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:02.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:25:02.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:25:02.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:02.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:25:02.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:25:02.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:02.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:02.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:02.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:25:02.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:25:02.754 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.754 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.754 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.754 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:02.754 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:02.754 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:02.756 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:02.757 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:02.752+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:02.857 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:02.852+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:02.921 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:02.921 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:02.922 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:02.922 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:02.928 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 11 16 12956 12940 9.18935 9.69531 0.00981543 0.013585 2020-11-12T17:25:02.931 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:02.938 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:25:02.972 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:02.968+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:03.059 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:03.052+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:03.079 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:03.079 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:03.080 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:03.080 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:03.080 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:03.082 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:03.089 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:03.161 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:03.158+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:03.244 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:03.261 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:03.256+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:03.272 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:03.272 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:03.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:03.272 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:03.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.273 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:03.273 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:03.273 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.84916991, 2020-11-12T17:25:03.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:25:03.274 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.274 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.274 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.274 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.275 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.275 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:25:03.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.275 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:03.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:03.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:25:03.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:25:03.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:25:03.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:25:03.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:25:03.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:25:03.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:25:03.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:25:03.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:25:03.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:25:03.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:25:03.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:25:03.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:25:03.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:03.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:25:03.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:25:03.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:25:03.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:25:03.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:25:03.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:25:03.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:25:03.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:25:03.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:25:03.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:25:03.288 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.288 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.288 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.288 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:25:03.289 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:03.289 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.842225848, 2020-11-12T17:25:03.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:25:03.289 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.289 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:03.289 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:03.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:03.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:03.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:25:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:25:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:25:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:25:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:25:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:25:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:25:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:25:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:25:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:25:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:25:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:25:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:25:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:25:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:25:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.810940131999999, 2020-11-12T17:25:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:25:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:25:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:25:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:25:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:25:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:25:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:25:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:25:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:25:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:25:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:25:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:25:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:25:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:25:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:25:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:25:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:25:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:25:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:25:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:25:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:25:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:25:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:25:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:25:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:25:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:25:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 72.668388062000005, 2020-11-12T17:25:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:25:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:25:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:25:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:25:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:25:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:25:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:25:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:25:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:25:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:25:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:25:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:25:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:25:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:25:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:25:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:25:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:25:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:25:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:25:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:25:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:25:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:25:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:25:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:25:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e48)", 2020-11-12T17:25:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:25:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 72.591598263999998, 2020-11-12T17:25:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998, 2020-11-12T17:25:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:25:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:25:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:25:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:25:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:25:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676007+0000", 2020-11-12T17:25:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110902 2020-11-12T17:25:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676118+0000", 2020-11-12T17:25:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6195e-05 2020-11-12T17:25:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676135+0000", 2020-11-12T17:25:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3829999999999998e-06 2020-11-12T17:25:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676144+0000", 2020-11-12T17:25:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5806000000000001e-05 2020-11-12T17:25:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676200+0000", 2020-11-12T17:25:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9735999999999999e-05 2020-11-12T17:25:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676259+0000", 2020-11-12T17:25:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29976251100000001 2020-11-12T17:25:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976022+0000", 2020-11-12T17:25:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998 2020-11-12T17:25:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:33576 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:25:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.659743616, 2020-11-12T17:25:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846, 2020-11-12T17:25:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607883+0000", 2020-11-12T17:25:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0716000000000004e-05 2020-11-12T17:25:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607964+0000", 2020-11-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28021348200000001 2020-11-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888177+0000", 2020-11-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0214000000000001e-05 2020-11-12T17:25:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888188+0000", 2020-11-12T17:25:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0760999999999994e-05 2020-11-12T17:25:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888278+0000", 2020-11-12T17:25:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0537e-05 2020-11-12T17:25:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888299+0000", 2020-11-12T17:25:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020659300000000001 2020-11-12T17:25:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888505+0000", 2020-11-12T17:25:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846 2020-11-12T17:25:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34328 3.8 3:12eb1396:::benchmark_data_smithi036_14212_object4290:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.711198664999998, 2020-11-12T17:25:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999, 2020-11-12T17:25:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34328 2020-11-12T17:25:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999542 2020-11-12T17:25:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556414+0000", 2020-11-12T17:25:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133592 2020-11-12T17:25:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556547+0000", 2020-11-12T17:25:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8813000000000001e-05 2020-11-12T17:25:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556566+0000", 2020-11-12T17:25:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7660000000000004e-06 2020-11-12T17:25:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556575+0000", 2020-11-12T17:25:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011688914999999999 2020-11-12T17:25:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568264+0000", 2020-11-12T17:25:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108214 2020-11-12T17:25:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568372+0000", 2020-11-12T17:25:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189846 2020-11-12T17:25:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568562+0000", 2020-11-12T17:25:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016740710000000001 2020-11-12T17:25:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570236+0000", 2020-11-12T17:25:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29321335900000001 2020-11-12T17:25:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863449+0000", 2020-11-12T17:25:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7244999999999998e-05 2020-11-12T17:25:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863507+0000", 2020-11-12T17:25:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0704999999999994e-05 2020-11-12T17:25:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863587+0000", 2020-11-12T17:25:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999 2020-11-12T17:25:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34328 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:25:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.696842016000005, 2020-11-12T17:25:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998, 2020-11-12T17:25:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:25:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:25:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570784+0000", 2020-11-12T17:25:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2226999999999997e-05 2020-11-12T17:25:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570866+0000", 2020-11-12T17:25:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.290361445 2020-11-12T17:25:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861228+0000", 2020-11-12T17:25:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0240000000000003e-06 2020-11-12T17:25:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861237+0000", 2020-11-12T17:25:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021956749999999998 2020-11-12T17:25:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863432+0000", 2020-11-12T17:25:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2940000000000006e-06 2020-11-12T17:25:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863441+0000", 2020-11-12T17:25:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162399 2020-11-12T17:25:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863603+0000", 2020-11-12T17:25:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998 2020-11-12T17:25:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.196854153000004, 2020-11-12T17:25:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:25:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:25:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:25:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:25:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:25:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:25:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:25:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:25:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:25:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:25:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:25:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:25:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:25:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:25:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:25:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:25:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:25:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:25:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:25:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:25:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:25:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:25:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:25:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:25:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:25:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.181532931000007, 2020-11-12T17:25:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:25:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:25:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:25:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:25:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:25:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:25:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:25:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:25:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:25:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:25:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:25:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:25:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:25:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:25:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 56.404682969, 2020-11-12T17:25:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:25:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:25:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:25:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:25:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:25:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:25:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:25:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:25:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:25:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:25:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:25:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:25:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:25:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:25:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:25:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:25:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:25:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:25:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:25:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:25:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:25:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:25:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:25:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:25:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50544 3.8 3:13876818:::benchmark_data_smithi036_14212_object6317:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:25:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:25:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.538057977000001, 2020-11-12T17:25:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998, 2020-11-12T17:25:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50544 2020-11-12T17:25:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:25:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:25:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:25:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729570+0000", 2020-11-12T17:25:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010924 2020-11-12T17:25:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729679+0000", 2020-11-12T17:25:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1567e-05 2020-11-12T17:25:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729691+0000", 2020-11-12T17:25:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0929999999999999e-06 2020-11-12T17:25:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729697+0000", 2020-11-12T17:25:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086737580000000002 2020-11-12T17:25:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738371+0000", 2020-11-12T17:25:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7824999999999993e-05 2020-11-12T17:25:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738459+0000", 2020-11-12T17:25:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017210899999999999 2020-11-12T17:25:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738631+0000", 2020-11-12T17:25:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027566969999999998 2020-11-12T17:25:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.741387+0000", 2020-11-12T17:25:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27686545000000001 2020-11-12T17:25:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018253+0000", 2020-11-12T17:25:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3428000000000002e-05 2020-11-12T17:25:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018336+0000", 2020-11-12T17:25:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5240999999999994e-05 2020-11-12T17:25:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018402+0000", 2020-11-12T17:25:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998 2020-11-12T17:25:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.448236127000001, 2020-11-12T17:25:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:25:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:25:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:25:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:25:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:25:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:25:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:25:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:25:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:25:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:25:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:25:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:25:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:25:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:25:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:25:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:25:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:25:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:25:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:25:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:25:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:25:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:25:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:25:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:25:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:25:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.319302643, 2020-11-12T17:25:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:25:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:25:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:25:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:25:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:25:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:25:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:25:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:25:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:25:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:25:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:25:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:25:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:25:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:25:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:25:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:25:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:25:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:25:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.547284357000002, 2020-11-12T17:25:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:25:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:25:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:25:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:25:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:25:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:25:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:25:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:25:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:25:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:25:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:25:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:25:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:25:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:25:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:25:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:25:03.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:25:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:25:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:25:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:25:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:25:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:25:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:25:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:25:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.625164368999997, 2020-11-12T17:25:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:25:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:25:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:25:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:25:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:25:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:25:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:25:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:25:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:25:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:25:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:25:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:25:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:25:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:25:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:25:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:25:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:25:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:25:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:25:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:25:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:25:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:25:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:25:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:25:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:25:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:59416 3.c e57/20 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head v 57'3976, mlcod=57'3970)", 2020-11-12T17:25:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 38.734824803999999, 2020-11-12T17:25:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998, 2020-11-12T17:25:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532795+0000", 2020-11-12T17:25:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014490099999999999 2020-11-12T17:25:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532940+0000", 2020-11-12T17:25:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29738320899999998 2020-11-12T17:25:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830323+0000", 2020-11-12T17:25:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3199999999999996e-06 2020-11-12T17:25:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830330+0000", 2020-11-12T17:25:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9622999999999994e-05 2020-11-12T17:25:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830399+0000", 2020-11-12T17:25:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4766999999999999e-05 2020-11-12T17:25:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830424+0000", 2020-11-12T17:25:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038976610000000002 2020-11-12T17:25:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834322+0000", 2020-11-12T17:25:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7682999999999994e-05 2020-11-12T17:25:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834410+0000", 2020-11-12T17:25:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998 2020-11-12T17:25:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:60400 3.b 3:d9185304:::benchmark_data_smithi036_14212_object7549:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:25:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 37.453831092000001, 2020-11-12T17:25:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002, 2020-11-12T17:25:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60400 2020-11-12T17:25:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:25:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:25:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:25:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813806+0000", 2020-11-12T17:25:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0312999999999997e-05 2020-11-12T17:25:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813866+0000", 2020-11-12T17:25:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5310000000000007e-06 2020-11-12T17:25:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813875+0000", 2020-11-12T17:25:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9999999999999999e-06 2020-11-12T17:25:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813882+0000", 2020-11-12T17:25:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045585469999999996 2020-11-12T17:25:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818441+0000", 2020-11-12T17:25:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025338699999999999 2020-11-12T17:25:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818694+0000", 2020-11-12T17:25:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192215 2020-11-12T17:25:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818887+0000", 2020-11-12T17:25:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019573659999999999 2020-11-12T17:25:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.820844+0000", 2020-11-12T17:25:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27823403299999999 2020-11-12T17:25:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099078+0000", 2020-11-12T17:25:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8301000000000003e-05 2020-11-12T17:25:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099136+0000", 2020-11-12T17:25:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4981000000000003e-05 2020-11-12T17:25:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099171+0000", 2020-11-12T17:25:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002 2020-11-12T17:25:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:60400 3.b e57/20 ondisk, result = 0)", 2020-11-12T17:25:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:25:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 37.444385822999998, 2020-11-12T17:25:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166, 2020-11-12T17:25:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:25:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:25:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823242+0000", 2020-11-12T17:25:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9956000000000005e-05 2020-11-12T17:25:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823322+0000", 2020-11-12T17:25:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.270552615 2020-11-12T17:25:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093875+0000", 2020-11-12T17:25:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2374e-05 2020-11-12T17:25:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093887+0000", 2020-11-12T17:25:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051711070000000003 2020-11-12T17:25:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099058+0000", 2020-11-12T17:25:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0665e-05 2020-11-12T17:25:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099069+0000", 2020-11-12T17:25:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000115362 2020-11-12T17:25:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099184+0000", 2020-11-12T17:25:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166 2020-11-12T17:25:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:25:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3106107229999999, 2020-11-12T17:25:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:25:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:25:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:25:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:25:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:25:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:25:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:25:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:25:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:25:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:25:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:25:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:25:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:25:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:25:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:25:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:25:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:25:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:25:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:25:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:25:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:25:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:25:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:25:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:25:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:03.532 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:03.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:03.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:03.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:03.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:03.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:03.537 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:03.537 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:03.539 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:03.539 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:03.539 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:03.540 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:25:03.540 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:03.540 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:03.540 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:03.540 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:03.540 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:03.541 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:03.541 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:03.541 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:03.528+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:03.636 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:03.632+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:03.672 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:03.673 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:03.684 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:03.737 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:03.732+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:03.812 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:03.812 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:03.824 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:03.868 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:03.866+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:03.928 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 12 16 13985 13969 9.09344 8.03906 0.0133881 0.0136978 2020-11-12T17:25:03.940 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:03.934+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:03.954 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:03.954 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:03.960 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:25:03.965 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:03.994 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:03.990+0000 7f9a0b6b4700 -1 osd.5 74 handle_osd_map injecting map crc failure 2020-11-12T17:25:04.040 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:04.038+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:04.123 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:04.123 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:04.135 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:04.177 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:04.174+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:04.243 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:04.236+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:04.311 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:04.312 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:04.322 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:04.344 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:04.340+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:04.444 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:04.442+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:04.456 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:04.629 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:04.631 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:04.632 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:04.626+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:04.735 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:04.730+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:04.786 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:04.787 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:04.795 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:04.835 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:04.828+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:04.929 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 13 16 14779 14763 8.87104 6.20312 0.112222 0.0137023 2020-11-12T17:25:04.935 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:04.932+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:04.956 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:04.957 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:04.965 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:05.037 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:05.032+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:05.075 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:05.076 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:05.085 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:05.137 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:05.132+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:05.188 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:05.189 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:05.197 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:05.244 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:05.242+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:05.298 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:05.298 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:05.307 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:05.349 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:05.346+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:05.444 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:05.436+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:05.486 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:05.486 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:05.487 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:05.541 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:05.545 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:05.542+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:05.617 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:05.618 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:05.630 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:05.676 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:05.672+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:05.719 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:05.746 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:05.742+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:05.747 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:05.757 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:05.757 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:05.757 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:05.757 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:05.758 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:05.769 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:05.781 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:05.811 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:05.838 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:05.847 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:05.840+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:05.881 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:05.913 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:05.914 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:05.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:05.915 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:05.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.915 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:05.916 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:05.916 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.801371254, 2020-11-12T17:25:05.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:25:05.917 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:05.917 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:05.918 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:05.918 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:05.918 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:05.918 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:25:05.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.919 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:05.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:05.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:05.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:05.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:05.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:05.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:05.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:25:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:25:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:25:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:25:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:05.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:25:05.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:25:05.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:05.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:25:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:25:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:25:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:25:05.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:25:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:25:05.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:25:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:25:05.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:25:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:25:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:25:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:25:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:05.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:25:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:25:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:25:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:25:05.932 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:25:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:05.933 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.79427945800001, 2020-11-12T17:25:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:25:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:25:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:25:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:25:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:25:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:25:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:25:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:25:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:25:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:25:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:25:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:25:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:25:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:25:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:25:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9999 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:25:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.36224238, 2020-11-12T17:25:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999, 2020-11-12T17:25:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9999 2020-11-12T17:25:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:25:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548006+0000", 2020-11-12T17:25:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:25:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.547971+0000", 2020-11-12T17:25:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104956 2020-11-12T17:25:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548076+0000", 2020-11-12T17:25:05.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.236e-05 2020-11-12T17:25:05.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548088+0000", 2020-11-12T17:25:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:25:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:05.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548094+0000", 2020-11-12T17:25:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026373519999999999 2020-11-12T17:25:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550731+0000", 2020-11-12T17:25:05.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6403999999999994e-05 2020-11-12T17:25:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550828+0000", 2020-11-12T17:25:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000112811 2020-11-12T17:25:05.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.550940+0000", 2020-11-12T17:25:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001154101 2020-11-12T17:25:05.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552095+0000", 2020-11-12T17:25:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25363090900000002 2020-11-12T17:25:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805725+0000", 2020-11-12T17:25:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8797999999999998e-05 2020-11-12T17:25:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:05.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805824+0000", 2020-11-12T17:25:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8110999999999998e-05 2020-11-12T17:25:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805902+0000", 2020-11-12T17:25:05.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25789630099999999 2020-11-12T17:25:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.956 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.36171996100001, 2020-11-12T17:25:05.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:25:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:25:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:05.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:05.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:05.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:05.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:25:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:25:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:25:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:25:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:25:05.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:25:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:25:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:25:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:25:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:25:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:25:05.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:25:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:25:05.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:25:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:25:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:25:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:25:05.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:25:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:25:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:25:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:25:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:25:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9999 3.1 e26/20 ondisk, result = 0)", 2020-11-12T17:25:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:25:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.353357441, 2020-11-12T17:25:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145, 2020-11-12T17:25:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:05.972 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:05.974 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:05.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:05.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:25:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556891+0000", 2020-11-12T17:25:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:05.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:05.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556869+0000", 2020-11-12T17:25:05.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1767999999999994e-05 2020-11-12T17:25:05.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.556951+0000", 2020-11-12T17:25:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.248442731 2020-11-12T17:25:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:05.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805393+0000", 2020-11-12T17:25:05.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5503e-05 2020-11-12T17:25:05.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805409+0000", 2020-11-12T17:25:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027928399999999998 2020-11-12T17:25:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805688+0000", 2020-11-12T17:25:05.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2215e-05 2020-11-12T17:25:05.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:05.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805710+0000", 2020-11-12T17:25:05.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000226744 2020-11-12T17:25:05.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.805937+0000", 2020-11-12T17:25:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.249046145 2020-11-12T17:25:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:05.981 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:05.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.982 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:25512 3.b e46/20 3:d013695c:::benchmark_data_smithi036_14212_object3188:head v 46'1664, mlcod=46'1657)", 2020-11-12T17:25:05.982 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:25:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.449181487999994, 2020-11-12T17:25:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999, 2020-11-12T17:25:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:25:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461067+0000", 2020-11-12T17:25:05.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:25:05.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:05.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:05.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:05.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461054+0000", 2020-11-12T17:25:05.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5973000000000002e-05 2020-11-12T17:25:05.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.461100+0000", 2020-11-12T17:25:06.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27743074600000001 2020-11-12T17:25:06.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738530+0000", 2020-11-12T17:25:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6039999999999993e-06 2020-11-12T17:25:06.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738539+0000", 2020-11-12T17:25:06.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7942000000000006e-05 2020-11-12T17:25:06.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738627+0000", 2020-11-12T17:25:06.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1338000000000003e-05 2020-11-12T17:25:06.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.738668+0000", 2020-11-12T17:25:06.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002001774 2020-11-12T17:25:06.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740670+0000", 2020-11-12T17:25:06.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7090999999999999e-05 2020-11-12T17:25:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.740737+0000", 2020-11-12T17:25:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27967023299999999 2020-11-12T17:25:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.074 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:25:06.075 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.411599867000007, 2020-11-12T17:25:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:25:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.076 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:06.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:06.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:06.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:25:06.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:25:06.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:25:06.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:25:06.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:25:06.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:25:06.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:25:06.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:25:06.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:25:06.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:25:06.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:25:06.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:25:06.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:25:06.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:25:06.087 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.088 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.088 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.089 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:28424 3.b e47/20 3:d6b3d883:::benchmark_data_smithi036_14212_object3552:head v 47'1832, mlcod=47'1825)", 2020-11-12T17:25:06.093 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:06.093 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.386428506000001, 2020-11-12T17:25:06.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002, 2020-11-12T17:25:06.094 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.094 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.094 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:06.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:06.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:06.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523784+0000", 2020-11-12T17:25:06.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100963 2020-11-12T17:25:06.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523885+0000", 2020-11-12T17:25:06.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29458836900000002 2020-11-12T17:25:06.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818473+0000", 2020-11-12T17:25:06.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1482e-05 2020-11-12T17:25:06.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818485+0000", 2020-11-12T17:25:06.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4080999999999998e-05 2020-11-12T17:25:06.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818559+0000", 2020-11-12T17:25:06.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9269e-05 2020-11-12T17:25:06.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818598+0000", 2020-11-12T17:25:06.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044328520000000001 2020-11-12T17:25:06.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823031+0000", 2020-11-12T17:25:06.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2584999999999998e-05 2020-11-12T17:25:06.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823094+0000", 2020-11-12T17:25:06.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002 2020-11-12T17:25:06.110 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.111 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.112 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:25:06.112 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:06.113 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 75.305997974999997, 2020-11-12T17:25:06.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:25:06.113 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.113 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.113 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:06.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:06.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:06.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:25:06.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:25:06.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:25:06.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:25:06.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:25:06.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:06.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:25:06.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:25:06.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:25:06.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:25:06.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:25:06.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:25:06.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:25:06.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:25:06.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:25:06.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:25:06.122 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.122 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.122 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.122 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43534 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:06.122 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:25:06.123 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 61.201347001999999, 2020-11-12T17:25:06.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002, 2020-11-12T17:25:06.123 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.123 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.123 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:06.123 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:06.123 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:06.124 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43534 2020-11-12T17:25:06.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.125 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:25:06.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708901+0000", 2020-11-12T17:25:06.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:06.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708876+0000", 2020-11-12T17:25:06.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4095000000000002e-05 2020-11-12T17:25:06.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708940+0000", 2020-11-12T17:25:06.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0960000000000007e-06 2020-11-12T17:25:06.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708949+0000", 2020-11-12T17:25:06.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.451e-06 2020-11-12T17:25:06.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.708955+0000", 2020-11-12T17:25:06.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085037340000000006 2020-11-12T17:25:06.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717458+0000", 2020-11-12T17:25:06.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4234999999999997e-05 2020-11-12T17:25:06.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717523+0000", 2020-11-12T17:25:06.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012550500000000001 2020-11-12T17:25:06.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:06.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.717648+0000", 2020-11-12T17:25:06.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040419740000000003 2020-11-12T17:25:06.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:06.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.721690+0000", 2020-11-12T17:25:06.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.247979797 2020-11-12T17:25:06.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:06.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969670+0000", 2020-11-12T17:25:06.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012950400000000001 2020-11-12T17:25:06.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969799+0000", 2020-11-12T17:25:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000181709 2020-11-12T17:25:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969981+0000", 2020-11-12T17:25:06.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26107975500000002 2020-11-12T17:25:06.135 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.135 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.135 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.141 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43535 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:06.142 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:06.144 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 61.201028174000001, 2020-11-12T17:25:06.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003, 2020-11-12T17:25:06.144 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.144 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.145 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:06.145 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:06.145 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:06.146 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43535 2020-11-12T17:25:06.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.146 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:06.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:06.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:06.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709201+0000", 2020-11-12T17:25:06.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4987000000000001e-05 2020-11-12T17:25:06.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709256+0000", 2020-11-12T17:25:06.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9799999999999998e-06 2020-11-12T17:25:06.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709264+0000", 2020-11-12T17:25:06.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:25:06.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709268+0000", 2020-11-12T17:25:06.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01033796 2020-11-12T17:25:06.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719606+0000", 2020-11-12T17:25:06.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014753499999999999 2020-11-12T17:25:06.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719754+0000", 2020-11-12T17:25:06.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023477900000000001 2020-11-12T17:25:06.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:06.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719989+0000", 2020-11-12T17:25:06.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002308844 2020-11-12T17:25:06.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:06.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722298+0000", 2020-11-12T17:25:06.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27981983300000002 2020-11-12T17:25:06.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:06.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002117+0000", 2020-11-12T17:25:06.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4757000000000001e-05 2020-11-12T17:25:06.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002212+0000", 2020-11-12T17:25:06.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116928 2020-11-12T17:25:06.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002329+0000", 2020-11-12T17:25:06.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003 2020-11-12T17:25:06.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.166 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.167 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43536 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:06.167 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:06.167 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 61.200928642999997, 2020-11-12T17:25:06.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001, 2020-11-12T17:25:06.168 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.168 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.168 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:06.168 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:06.169 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:06.169 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43536 2020-11-12T17:25:06.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.169 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:06.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:06.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:06.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709302+0000", 2020-11-12T17:25:06.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3248999999999998e-05 2020-11-12T17:25:06.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709355+0000", 2020-11-12T17:25:06.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.34e-06 2020-11-12T17:25:06.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709363+0000", 2020-11-12T17:25:06.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.664e-06 2020-11-12T17:25:06.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709366+0000", 2020-11-12T17:25:06.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013071532 2020-11-12T17:25:06.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722438+0000", 2020-11-12T17:25:06.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141901 2020-11-12T17:25:06.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722580+0000", 2020-11-12T17:25:06.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118355 2020-11-12T17:25:06.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:06.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722698+0000", 2020-11-12T17:25:06.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014561839999999999 2020-11-12T17:25:06.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:06.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.724154+0000", 2020-11-12T17:25:06.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27825006499999999 2020-11-12T17:25:06.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:06.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002404+0000", 2020-11-12T17:25:06.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2908000000000001e-05 2020-11-12T17:25:06.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002477+0000", 2020-11-12T17:25:06.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020370300000000001 2020-11-12T17:25:06.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002681+0000", 2020-11-12T17:25:06.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001 2020-11-12T17:25:06.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.178 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.179 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:43534 3.6 e53/20 ondisk, result = 0)", 2020-11-12T17:25:06.179 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:25:06.179 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 61.183820318000002, 2020-11-12T17:25:06.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001, 2020-11-12T17:25:06.179 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.179 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:06.179 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:25:06.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726428+0000", 2020-11-12T17:25:06.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:25:06.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726412+0000", 2020-11-12T17:25:06.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2086000000000003e-05 2020-11-12T17:25:06.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.726454+0000", 2020-11-12T17:25:06.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24305705 2020-11-12T17:25:06.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969511+0000", 2020-11-12T17:25:06.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.49e-05 2020-11-12T17:25:06.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969526+0000", 2020-11-12T17:25:06.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010331999999999999 2020-11-12T17:25:06.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969629+0000", 2020-11-12T17:25:06.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1993000000000001e-05 2020-11-12T17:25:06.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969651+0000", 2020-11-12T17:25:06.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00033822300000000002 2020-11-12T17:25:06.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.969989+0000", 2020-11-12T17:25:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24356134700000001 2020-11-12T17:25:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.187 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43768 3.6 3:6f7b85f8:::benchmark_data_smithi036_14212_object5470:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:06.187 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:25:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.912195797999999, 2020-11-12T17:25:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001, 2020-11-12T17:25:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43768 2020-11-12T17:25:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:25:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998053+0000", 2020-11-12T17:25:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998003+0000", 2020-11-12T17:25:06.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014095000000000001 2020-11-12T17:25:06.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998144+0000", 2020-11-12T17:25:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1143000000000001e-05 2020-11-12T17:25:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998165+0000", 2020-11-12T17:25:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3979999999999999e-06 2020-11-12T17:25:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.998174+0000", 2020-11-12T17:25:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012056769 2020-11-12T17:25:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010231+0000", 2020-11-12T17:25:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102279 2020-11-12T17:25:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010333+0000", 2020-11-12T17:25:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014553299999999999 2020-11-12T17:25:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.010478+0000", 2020-11-12T17:25:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037901779999999999 2020-11-12T17:25:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.014269+0000", 2020-11-12T17:25:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22457837 2020-11-12T17:25:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238847+0000", 2020-11-12T17:25:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2958000000000001e-05 2020-11-12T17:25:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238930+0000", 2020-11-12T17:25:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1814000000000002e-05 2020-11-12T17:25:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.238982+0000", 2020-11-12T17:25:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24092903900000001 2020-11-12T17:25:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50240 3.1 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:25:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:25:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 53.557151603000001, 2020-11-12T17:25:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003, 2020-11-12T17:25:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50240 2020-11-12T17:25:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:25:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353097+0000", 2020-11-12T17:25:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353074+0000", 2020-11-12T17:25:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106903 2020-11-12T17:25:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353181+0000", 2020-11-12T17:25:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6804999999999999e-05 2020-11-12T17:25:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353198+0000", 2020-11-12T17:25:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3259999999999998e-06 2020-11-12T17:25:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.353205+0000", 2020-11-12T17:25:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011916829 2020-11-12T17:25:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365122+0000", 2020-11-12T17:25:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111867 2020-11-12T17:25:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365234+0000", 2020-11-12T17:25:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011033500000000001 2020-11-12T17:25:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.365344+0000", 2020-11-12T17:25:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002314876 2020-11-12T17:25:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.367659+0000", 2020-11-12T17:25:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23853026499999999 2020-11-12T17:25:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606189+0000", 2020-11-12T17:25:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3222999999999999e-05 2020-11-12T17:25:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606272+0000", 2020-11-12T17:25:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000165849 2020-11-12T17:25:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.606438+0000", 2020-11-12T17:25:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25334149700000003 2020-11-12T17:25:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:06.211 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.959514640999998, 2020-11-12T17:25:06.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:25:06.211 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:25:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:06.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:25:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:25:06.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:25:06.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:25:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:25:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:25:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:25:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:25:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:25:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:25:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:25:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:25:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:25:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:25:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:25:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:25:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:25:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:25:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:25:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:25:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:25:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:25:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:25:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.224 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:06.226 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:06.226 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.963672838999997, 2020-11-12T17:25:06.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:25:06.226 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.226 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:25:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:25:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:25:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:25:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:25:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:25:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:25:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:25:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:25:06.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:25:06.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:25:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:25:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:25:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:25:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:25:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 31.028569439999998, 2020-11-12T17:25:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:25:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:25:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:06.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:06.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:06.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:25:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:25:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:25:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:25:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:25:06.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:25:06.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:25:06.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:25:06.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:25:06.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:25:06.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:25:06.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:25:06.247 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.247 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.248 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.248 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:304 4.b 4:d3839b57:::benchmark_data_smithi036_18856_object37:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:06.249 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:06.249 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.772403883000001, 2020-11-12T17:25:06.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999, 2020-11-12T17:25:06.250 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.250 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.250 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:06.251 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:06.251 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:06.251 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 304 2020-11-12T17:25:06.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.252 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:06.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:06.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:06.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137813+0000", 2020-11-12T17:25:06.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9074999999999998e-05 2020-11-12T17:25:06.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137892+0000", 2020-11-12T17:25:06.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8020000000000003e-06 2020-11-12T17:25:06.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137902+0000", 2020-11-12T17:25:06.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7619999999999995e-06 2020-11-12T17:25:06.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137909+0000", 2020-11-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040533879999999998 2020-11-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.141963+0000", 2020-11-12T17:25:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162048 2020-11-12T17:25:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142125+0000", 2020-11-12T17:25:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00039201500000000001 2020-11-12T17:25:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142517+0000", 2020-11-12T17:25:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010951820000000001 2020-11-12T17:25:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.143612+0000", 2020-11-12T17:25:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.286564975 2020-11-12T17:25:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430177+0000", 2020-11-12T17:25:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8254000000000002e-05 2020-11-12T17:25:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430235+0000", 2020-11-12T17:25:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9767000000000001e-05 2020-11-12T17:25:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430275+0000", 2020-11-12T17:25:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999 2020-11-12T17:25:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:936 4.6 4:6403dfdf:::benchmark_data_smithi036_18856_object116:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.21795966, 2020-11-12T17:25:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001, 2020-11-12T17:25:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 936 2020-11-12T17:25:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692257+0000", 2020-11-12T17:25:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8807999999999994e-05 2020-11-12T17:25:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692346+0000", 2020-11-12T17:25:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1438e-05 2020-11-12T17:25:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692357+0000", 2020-11-12T17:25:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0989999999999998e-06 2020-11-12T17:25:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692362+0000", 2020-11-12T17:25:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036699900000000001 2020-11-12T17:25:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696032+0000", 2020-11-12T17:25:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021269999999999999 2020-11-12T17:25:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696245+0000", 2020-11-12T17:25:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00032215999999999999 2020-11-12T17:25:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696567+0000", 2020-11-12T17:25:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001477368 2020-11-12T17:25:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.698044+0000", 2020-11-12T17:25:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29849877600000002 2020-11-12T17:25:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996543+0000", 2020-11-12T17:25:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4288000000000004e-05 2020-11-12T17:25:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996617+0000", 2020-11-12T17:25:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1554999999999997e-05 2020-11-12T17:25:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996669+0000", 2020-11-12T17:25:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001 2020-11-12T17:25:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.279 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.279 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.279 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:06.279 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:25:06.281 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:06.281 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:06.282 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:06.282 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:06.282 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:25:06.282 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:06.282 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:06.282 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:06.283 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:06.283 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:06.283 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:06.283 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:06.284 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:06.284 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 14 16 15459 15443 8.61682 5.3125 0.00610249 0.0144685 2020-11-12T17:25:06.284 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:06.278+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:06.384 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:06.378+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:06.448 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:06.448 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:06.449 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:06.449 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:06.459 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:25:06.504 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:06.500+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:06.586 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:06.580+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:06.636 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:06.636 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:06.636 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:06.637 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:06.637 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:06.637 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:25:06.724 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:06.720+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:06.787 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:06.782+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:06.798 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:06.799 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:06.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:06.799 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:06.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.800 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:25:06.800 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:06.800 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.136888838, 2020-11-12T17:25:06.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:25:06.800 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.801 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.801 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:06.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:06.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:06.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:25:06.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:25:06.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:25:06.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:25:06.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:25:06.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:25:06.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:25:06.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:25:06.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:25:06.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:25:06.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:25:06.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:25:06.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:25:06.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:25:06.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:25:06.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:25:06.808 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.809 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.809 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.809 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:25:06.809 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:06.809 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.135982043, 2020-11-12T17:25:06.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:25:06.810 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.810 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.810 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:06.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:06.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:06.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:25:06.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:25:06.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:25:06.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:25:06.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:25:06.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:06.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:25:06.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:25:06.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:25:06.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:25:06.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:25:06.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:25:06.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:25:06.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:25:06.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:25:06.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:25:06.820 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.820 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.820 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.821 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:25:06.821 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:06.821 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.13527981999999, 2020-11-12T17:25:06.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:25:06.821 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.821 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.822 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:06.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:06.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:06.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:25:06.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:25:06.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:25:06.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:25:06.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:25:06.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:25:06.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:25:06.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:25:06.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:25:06.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:25:06.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:25:06.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:25:06.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:25:06.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:25:06.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:25:06.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:25:06.831 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.831 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.831 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.832 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:25:06.832 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:06.832 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.130773624, 2020-11-12T17:25:06.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:25:06.833 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.833 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.833 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:06.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:06.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:06.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:25:06.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:25:06.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:25:06.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:25:06.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:25:06.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:25:06.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:25:06.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:25:06.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:25:06.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:25:06.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:25:06.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:25:06.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:25:06.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:25:06.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:25:06.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:25:06.841 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.841 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.842 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.842 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:25:06.842 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:06.843 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.627232643, 2020-11-12T17:25:06.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:25:06.843 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.843 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.843 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:06.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:06.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:06.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:25:06.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:25:06.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:25:06.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:25:06.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:25:06.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:25:06.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:25:06.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:25:06.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:25:06.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:25:06.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:25:06.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:25:06.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:25:06.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:25:06.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:25:06.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:25:06.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.853 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.854 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:25:06.854 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:06.854 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.626306402, 2020-11-12T17:25:06.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:25:06.854 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.854 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.854 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:06.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:06.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:25:06.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:25:06.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:25:06.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:25:06.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:25:06.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:25:06.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:25:06.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:25:06.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:25:06.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:25:06.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:25:06.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:25:06.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:25:06.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:25:06.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:25:06.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:25:06.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:25:06.864 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.864 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.864 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.865 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:25:06.865 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:06.865 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.623958892, 2020-11-12T17:25:06.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:25:06.865 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.866 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.866 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:06.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:06.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:25:06.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:25:06.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:25:06.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:25:06.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:25:06.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:25:06.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:25:06.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:25:06.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:25:06.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:25:06.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:25:06.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:25:06.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:25:06.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:25:06.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:25:06.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:25:06.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:25:06.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.880 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.881 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:25:06.881 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:06.882 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.62319410000001, 2020-11-12T17:25:06.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:25:06.882 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.883 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.883 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:06.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:06.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:06.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:25:06.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:25:06.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:25:06.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:25:06.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:25:06.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:25:06.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:25:06.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:25:06.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:25:06.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:25:06.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:25:06.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:25:06.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:25:06.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:25:06.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:25:06.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:25:06.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.897 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.898 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:25:06.898 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:06.898 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.540967622, 2020-11-12T17:25:06.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:25:06.899 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.899 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.899 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:06.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:06.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:06.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:25:06.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:25:06.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:25:06.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:25:06.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:25:06.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:25:06.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:25:06.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:25:06.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:25:06.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:25:06.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:25:06.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:25:06.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:25:06.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:25:06.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:25:06.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:25:06.910 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.911 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.911 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.912 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:25:06.912 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:06.912 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.948854189, 2020-11-12T17:25:06.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:25:06.913 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.913 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.913 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:06.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:06.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:25:06.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:25:06.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:25:06.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:25:06.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:25:06.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:25:06.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:25:06.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:25:06.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:25:06.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:25:06.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:25:06.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:25:06.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:25:06.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:25:06.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:25:06.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:25:06.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:25:06.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.928 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.929 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:25:06.929 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:06.929 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.920193892, 2020-11-12T17:25:06.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:25:06.929 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.930 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.930 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:06.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:06.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:06.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:25:06.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:25:06.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:25:06.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:25:06.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:25:06.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:25:06.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:25:06.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:25:06.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:25:06.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:25:06.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:25:06.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:25:06.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:25:06.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:25:06.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:25:06.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:25:06.941 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.941 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.941 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.942 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:25:06.942 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:06.942 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.00759718099999, 2020-11-12T17:25:06.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:25:06.942 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.942 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.943 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:06.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:06.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:06.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:25:06.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:25:06.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:25:06.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:25:06.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:25:06.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:25:06.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:25:06.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:25:06.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:25:06.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:25:06.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:25:06.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:25:06.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:25:06.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:25:06.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:25:06.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:25:06.951 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.951 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.951 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.952 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:25:06.952 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:06.952 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.936457537, 2020-11-12T17:25:06.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:25:06.953 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.953 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.953 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:06.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:06.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:06.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:25:06.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:25:06.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:25:06.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:25:06.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:25:06.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:25:06.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:25:06.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:25:06.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:25:06.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:25:06.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:25:06.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:25:06.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:25:06.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:25:06.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:25:06.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:25:06.966 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.966 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.968 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:25:06.968 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:06.968 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.82707024600001, 2020-11-12T17:25:06.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:25:06.968 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.968 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.968 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:06.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:06.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:06.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:25:06.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:25:06.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:25:06.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:25:06.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:25:06.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:25:06.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:25:06.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:25:06.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:25:06.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:25:06.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:25:06.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:25:06.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:25:06.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:25:06.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:25:06.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:25:06.976 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.976 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.976 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.976 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:25:06.977 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:06.977 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.756534407, 2020-11-12T17:25:06.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:25:06.977 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.977 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.982 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:06.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:06.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:06.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:25:06.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:25:06.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:25:06.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:25:06.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:25:06.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:25:06.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:25:06.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:25:06.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:25:06.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:25:06.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:25:06.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:25:06.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:25:06.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:25:06.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:25:06.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:25:06.990 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.990 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.990 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.990 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:25:06.990 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:06.991 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.58716846900001, 2020-11-12T17:25:06.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:25:06.991 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:06.991 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:06.991 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:06.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:06.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:06.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:06.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:06.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:06.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:25:06.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:06.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:25:06.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:25:06.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:06.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:25:06.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:25:06.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:06.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:25:06.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:25:06.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:06.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:25:06.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:25:06.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:06.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:25:06.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:25:06.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:06.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:25:06.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:25:06.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:06.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:25:06.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:25:06.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:06.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:25:06.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:25:06.998 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.999 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:06.999 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:06.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:06.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:06.999 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:25:06.999 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:06.999 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.258542597, 2020-11-12T17:25:07.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:25:07.000 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.000 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.000 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:07.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:07.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:25:07.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:25:07.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:25:07.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:25:07.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:25:07.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:25:07.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:25:07.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:25:07.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:25:07.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:25:07.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:25:07.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:25:07.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:25:07.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:25:07.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:25:07.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:25:07.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:25:07.007 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.007 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.007 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.007 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:25:07.007 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:07.008 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.60207923500001, 2020-11-12T17:25:07.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:25:07.008 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.008 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.008 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:07.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:07.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:07.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:25:07.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:25:07.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:25:07.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:25:07.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:25:07.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:25:07.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:25:07.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:25:07.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:25:07.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:25:07.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:25:07.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:25:07.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:25:07.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:25:07.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:25:07.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:25:07.015 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.015 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.015 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.016 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:25:07.016 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:07.016 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.59943851200001, 2020-11-12T17:25:07.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:25:07.016 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.016 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.017 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:07.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:07.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:07.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:25:07.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:25:07.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:25:07.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:25:07.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:25:07.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:25:07.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:25:07.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:25:07.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:25:07.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:25:07.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:25:07.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:25:07.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:25:07.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:25:07.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:25:07.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:25:07.024 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.024 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.024 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.025 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:25:07.025 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:07.025 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.11519247299999, 2020-11-12T17:25:07.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:25:07.025 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.025 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.025 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:07.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:07.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:25:07.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:25:07.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:25:07.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:25:07.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:25:07.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:25:07.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:25:07.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:25:07.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:25:07.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:25:07.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:25:07.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:25:07.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:25:07.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:25:07.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:25:07.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:25:07.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:25:07.036 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.036 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.036 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.036 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.036 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.036 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:07.038 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:06.950+0000 7f7b4fea9700 -1 osd.4 75 handle_osd_map injecting map crc failure 2020-11-12T17:25:07.039 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:06.954+0000 7f9a0b6b4700 -1 osd.5 75 handle_osd_map injecting map crc failure 2020-11-12T17:25:07.039 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 15 16 16631 16615 8.65274 9.15625 0.00901931 0.0144334 2020-11-12T17:25:07.039 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:25:07.040 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:07.032+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:07.040 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:07.139 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:07.132+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:07.202 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:07.202 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:07.203 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:07.203 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:07.212 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:07.257 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:07.252+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:07.342 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:07.338+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:07.369 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:07.366+0000 7f7b4fea9700 -1 osd.4 76 handle_osd_map injecting map crc failure 2020-11-12T17:25:07.375 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:07.377 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:07.388 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:07.443 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:07.436+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:07.507 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.085990415, 2020-11-12T17:25:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:25:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:25:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:25:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:25:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:25:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:25:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:25:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:25:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:25:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:25:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:25:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:25:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:25:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:25:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:25:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:25:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:25:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:25:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:25:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:25:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:25:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:25:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:25:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:25:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:25:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:25:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.079046353, 2020-11-12T17:25:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:25:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:25:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:25:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:25:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:25:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:25:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:25:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:25:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:25:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:25:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:25:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:25:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:25:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:25:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:25:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:25:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 82.047760636999996, 2020-11-12T17:25:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:25:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:25:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:25:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:25:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:25:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:25:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:25:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:25:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:25:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:25:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:25:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:25:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:25:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:25:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:25:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:25:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:25:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:25:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:25:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:25:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:25:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:25:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:25:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:25:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:25:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:25:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.905208567000003, 2020-11-12T17:25:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:25:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:25:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:25:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:25:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:25:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:25:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:25:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:25:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:25:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:25:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:25:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:25:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:25:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:25:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:25:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:25:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:25:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:25:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:25:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:25:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:25:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:25:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:25:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:25:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e48)", 2020-11-12T17:25:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:25:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.828418768999995, 2020-11-12T17:25:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998, 2020-11-12T17:25:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:25:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:25:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:25:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:25:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:25:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676007+0000", 2020-11-12T17:25:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110902 2020-11-12T17:25:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676118+0000", 2020-11-12T17:25:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6195e-05 2020-11-12T17:25:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676135+0000", 2020-11-12T17:25:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3829999999999998e-06 2020-11-12T17:25:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676144+0000", 2020-11-12T17:25:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5806000000000001e-05 2020-11-12T17:25:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676200+0000", 2020-11-12T17:25:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9735999999999999e-05 2020-11-12T17:25:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676259+0000", 2020-11-12T17:25:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29976251100000001 2020-11-12T17:25:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976022+0000", 2020-11-12T17:25:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998 2020-11-12T17:25:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:33576 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:25:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.896564120999997, 2020-11-12T17:25:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846, 2020-11-12T17:25:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:25:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:25:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607883+0000", 2020-11-12T17:25:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0716000000000004e-05 2020-11-12T17:25:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607964+0000", 2020-11-12T17:25:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28021348200000001 2020-11-12T17:25:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888177+0000", 2020-11-12T17:25:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0214000000000001e-05 2020-11-12T17:25:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888188+0000", 2020-11-12T17:25:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0760999999999994e-05 2020-11-12T17:25:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888278+0000", 2020-11-12T17:25:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0537e-05 2020-11-12T17:25:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888299+0000", 2020-11-12T17:25:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020659300000000001 2020-11-12T17:25:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888505+0000", 2020-11-12T17:25:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846 2020-11-12T17:25:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34328 3.8 3:12eb1396:::benchmark_data_smithi036_14212_object4290:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 72.948019169999995, 2020-11-12T17:25:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999, 2020-11-12T17:25:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34328 2020-11-12T17:25:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999542 2020-11-12T17:25:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556414+0000", 2020-11-12T17:25:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133592 2020-11-12T17:25:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556547+0000", 2020-11-12T17:25:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8813000000000001e-05 2020-11-12T17:25:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556566+0000", 2020-11-12T17:25:07.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7660000000000004e-06 2020-11-12T17:25:07.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556575+0000", 2020-11-12T17:25:07.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011688914999999999 2020-11-12T17:25:07.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568264+0000", 2020-11-12T17:25:07.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108214 2020-11-12T17:25:07.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568372+0000", 2020-11-12T17:25:07.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189846 2020-11-12T17:25:07.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:07.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568562+0000", 2020-11-12T17:25:07.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016740710000000001 2020-11-12T17:25:07.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570236+0000", 2020-11-12T17:25:07.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29321335900000001 2020-11-12T17:25:07.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863449+0000", 2020-11-12T17:25:07.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7244999999999998e-05 2020-11-12T17:25:07.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863507+0000", 2020-11-12T17:25:07.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0704999999999994e-05 2020-11-12T17:25:07.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863587+0000", 2020-11-12T17:25:07.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999 2020-11-12T17:25:07.691 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.691 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.691 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.692 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34328 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:07.692 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:25:07.692 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 72.933662521000002, 2020-11-12T17:25:07.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998, 2020-11-12T17:25:07.692 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.692 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:07.693 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:25:07.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:25:07.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:07.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570784+0000", 2020-11-12T17:25:07.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2226999999999997e-05 2020-11-12T17:25:07.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570866+0000", 2020-11-12T17:25:07.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.290361445 2020-11-12T17:25:07.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861228+0000", 2020-11-12T17:25:07.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0240000000000003e-06 2020-11-12T17:25:07.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861237+0000", 2020-11-12T17:25:07.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021956749999999998 2020-11-12T17:25:07.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863432+0000", 2020-11-12T17:25:07.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2940000000000006e-06 2020-11-12T17:25:07.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863441+0000", 2020-11-12T17:25:07.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162399 2020-11-12T17:25:07.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863603+0000", 2020-11-12T17:25:07.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998 2020-11-12T17:25:07.699 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.700 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.700 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:07.700 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:07.701 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 72.433674658000001, 2020-11-12T17:25:07.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:25:07.701 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.701 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.701 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:25:07.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.702 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:07.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:07.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:25:07.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:25:07.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:25:07.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:25:07.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:25:07.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:25:07.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:25:07.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:25:07.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:25:07.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:25:07.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:25:07.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:25:07.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:25:07.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:07.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:25:07.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:25:07.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:25:07.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:25:07.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:25:07.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:25:07.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:25:07.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:25:07.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:25:07.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:25:07.715 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.715 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.716 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.716 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:07.716 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:07.716 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 72.418353436000004, 2020-11-12T17:25:07.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:25:07.717 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.717 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:07.717 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:07.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:07.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:07.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:25:07.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:25:07.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:25:07.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:25:07.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:25:07.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:25:07.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:25:07.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:25:07.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:25:07.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:07.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:25:07.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:25:07.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:25:07.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:25:07.725 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.725 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.725 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.726 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:07.726 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:07.726 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.641503473999997, 2020-11-12T17:25:07.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:25:07.726 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.726 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.726 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.727 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.727 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.727 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:25:07.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.727 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:07.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:07.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:07.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:25:07.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:25:07.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:25:07.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:25:07.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:25:07.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:25:07.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:25:07.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:25:07.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:25:07.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:25:07.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:25:07.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:25:07.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:07.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:25:07.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:25:07.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:25:07.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:25:07.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:25:07.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:25:07.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:25:07.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:25:07.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:25:07.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:25:07.736 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.736 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.736 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.737 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50544 3.8 3:13876818:::benchmark_data_smithi036_14212_object6317:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:25:07.737 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:25:07.737 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.774878481999998, 2020-11-12T17:25:07.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998, 2020-11-12T17:25:07.737 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.737 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.738 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50544 2020-11-12T17:25:07.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.739 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:25:07.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:25:07.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:25:07.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729570+0000", 2020-11-12T17:25:07.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010924 2020-11-12T17:25:07.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729679+0000", 2020-11-12T17:25:07.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1567e-05 2020-11-12T17:25:07.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729691+0000", 2020-11-12T17:25:07.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0929999999999999e-06 2020-11-12T17:25:07.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729697+0000", 2020-11-12T17:25:07.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086737580000000002 2020-11-12T17:25:07.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738371+0000", 2020-11-12T17:25:07.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7824999999999993e-05 2020-11-12T17:25:07.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738459+0000", 2020-11-12T17:25:07.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017210899999999999 2020-11-12T17:25:07.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:07.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738631+0000", 2020-11-12T17:25:07.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027566969999999998 2020-11-12T17:25:07.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.741387+0000", 2020-11-12T17:25:07.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27686545000000001 2020-11-12T17:25:07.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018253+0000", 2020-11-12T17:25:07.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3428000000000002e-05 2020-11-12T17:25:07.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018336+0000", 2020-11-12T17:25:07.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5240999999999994e-05 2020-11-12T17:25:07.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018402+0000", 2020-11-12T17:25:07.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998 2020-11-12T17:25:07.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.748 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.748 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:07.748 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:07.748 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.685056631999998, 2020-11-12T17:25:07.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:25:07.749 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.749 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.749 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.749 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.750 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:25:07.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.750 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:07.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:07.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:07.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:25:07.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:25:07.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:25:07.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:25:07.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:25:07.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:25:07.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:25:07.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:25:07.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:25:07.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:25:07.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:25:07.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:25:07.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:07.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:25:07.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:25:07.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:25:07.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:25:07.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:25:07.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:25:07.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:25:07.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:25:07.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:25:07.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:25:07.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.759 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.760 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.760 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:25:07.760 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:07.761 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.556123147999998, 2020-11-12T17:25:07.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:25:07.761 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.761 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.761 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:07.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:07.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:25:07.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:25:07.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:25:07.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:25:07.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:25:07.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:25:07.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:25:07.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:25:07.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:25:07.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:25:07.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:25:07.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:25:07.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:25:07.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:25:07.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:25:07.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:25:07.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:25:07.768 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.768 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.769 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.769 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:07.769 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:07.770 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.784104862, 2020-11-12T17:25:07.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:25:07.770 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.770 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.770 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.770 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.770 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.771 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:25:07.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.771 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:07.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:07.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:07.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:25:07.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:25:07.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:25:07.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:25:07.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:25:07.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:25:07.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:25:07.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:25:07.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:25:07.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:25:07.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:25:07.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:25:07.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:07.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:25:07.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:25:07.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:25:07.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:25:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:25:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:25:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:25:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:25:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:25:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:25:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.861984874000001, 2020-11-12T17:25:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:25:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:25:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:25:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:25:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:25:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:25:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:25:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:25:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:25:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:25:07.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:25:07.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:25:07.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:25:07.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:25:07.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:25:07.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:07.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:25:07.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:25:07.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:25:07.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:25:07.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:25:07.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:25:07.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:25:07.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:25:07.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:25:07.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:25:07.792 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.792 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.792 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.793 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:59416 3.c e57/20 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head v 57'3976, mlcod=57'3970)", 2020-11-12T17:25:07.793 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:07.793 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 42.971645309000003, 2020-11-12T17:25:07.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998, 2020-11-12T17:25:07.794 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.794 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.794 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:07.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:07.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:07.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532795+0000", 2020-11-12T17:25:07.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014490099999999999 2020-11-12T17:25:07.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532940+0000", 2020-11-12T17:25:07.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29738320899999998 2020-11-12T17:25:07.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830323+0000", 2020-11-12T17:25:07.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3199999999999996e-06 2020-11-12T17:25:07.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830330+0000", 2020-11-12T17:25:07.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9622999999999994e-05 2020-11-12T17:25:07.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830399+0000", 2020-11-12T17:25:07.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4766999999999999e-05 2020-11-12T17:25:07.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830424+0000", 2020-11-12T17:25:07.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038976610000000002 2020-11-12T17:25:07.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834322+0000", 2020-11-12T17:25:07.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7682999999999994e-05 2020-11-12T17:25:07.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834410+0000", 2020-11-12T17:25:07.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998 2020-11-12T17:25:07.802 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.802 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.802 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.803 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:60400 3.b 3:d9185304:::benchmark_data_smithi036_14212_object7549:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:07.803 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:25:07.803 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.690651596999999, 2020-11-12T17:25:07.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002, 2020-11-12T17:25:07.803 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.804 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.804 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.804 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:07.804 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:07.804 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60400 2020-11-12T17:25:07.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.805 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:25:07.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:25:07.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:25:07.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813806+0000", 2020-11-12T17:25:07.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0312999999999997e-05 2020-11-12T17:25:07.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813866+0000", 2020-11-12T17:25:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5310000000000007e-06 2020-11-12T17:25:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813875+0000", 2020-11-12T17:25:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9999999999999999e-06 2020-11-12T17:25:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813882+0000", 2020-11-12T17:25:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045585469999999996 2020-11-12T17:25:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818441+0000", 2020-11-12T17:25:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025338699999999999 2020-11-12T17:25:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818694+0000", 2020-11-12T17:25:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192215 2020-11-12T17:25:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818887+0000", 2020-11-12T17:25:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019573659999999999 2020-11-12T17:25:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.820844+0000", 2020-11-12T17:25:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27823403299999999 2020-11-12T17:25:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099078+0000", 2020-11-12T17:25:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8301000000000003e-05 2020-11-12T17:25:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099136+0000", 2020-11-12T17:25:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4981000000000003e-05 2020-11-12T17:25:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099171+0000", 2020-11-12T17:25:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002 2020-11-12T17:25:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:60400 3.b e57/20 ondisk, result = 0)", 2020-11-12T17:25:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:25:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.681206328000002, 2020-11-12T17:25:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166, 2020-11-12T17:25:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:25:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:25:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823242+0000", 2020-11-12T17:25:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9956000000000005e-05 2020-11-12T17:25:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823322+0000", 2020-11-12T17:25:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.270552615 2020-11-12T17:25:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093875+0000", 2020-11-12T17:25:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2374e-05 2020-11-12T17:25:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093887+0000", 2020-11-12T17:25:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051711070000000003 2020-11-12T17:25:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099058+0000", 2020-11-12T17:25:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0665e-05 2020-11-12T17:25:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099069+0000", 2020-11-12T17:25:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000115362 2020-11-12T17:25:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099184+0000", 2020-11-12T17:25:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166 2020-11-12T17:25:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:25:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.5474312280000007, 2020-11-12T17:25:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:25:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:25:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:25:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:25:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:25:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:25:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:25:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:25:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:25:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:25:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:25:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:25:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:25:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:25:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:25:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:25:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:25:07.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:25:07.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:25:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:25:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:25:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:25:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:25:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:25:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:07.838 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:07.839 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:07.840 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:07.834+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:07.929 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 16 16 17867 17851 8.7154 9.65625 0.00715276 0.0143149 2020-11-12T17:25:07.940 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:07.934+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:07.968 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:07.969 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:07.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.969 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:17898 4.5 e77/69 4:afdde7a0:::benchmark_data_smithi036_18856_object2237:head v 77'1210, mlcod=77'1204)", 2020-11-12T17:25:07.969 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:07.959772+0000", 2020-11-12T17:25:07.969 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0092041029999999999, 2020-11-12T17:25:07.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0092216840000000008, 2020-11-12T17:25:07.970 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:07.970 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:07.970 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:07.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:07.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.959772+0000", 2020-11-12T17:25:07.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:07.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:07.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.959772+0000", 2020-11-12T17:25:07.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:07.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:07.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.959745+0000", 2020-11-12T17:25:07.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9485000000000001e-05 2020-11-12T17:25:07.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:07.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.959835+0000", 2020-11-12T17:25:07.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050339429999999999 2020-11-12T17:25:07.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:07.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.964869+0000", 2020-11-12T17:25:07.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2949999999999999e-06 2020-11-12T17:25:07.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.964875+0000", 2020-11-12T17:25:07.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000117631 2020-11-12T17:25:07.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:07.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.964993+0000", 2020-11-12T17:25:07.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.47e-05 2020-11-12T17:25:07.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:07.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.965008+0000", 2020-11-12T17:25:07.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052353820000000002 2020-11-12T17:25:07.976 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:07.976 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:07.976 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:07.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.977 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:17899 4.5 e77/69 4:afdde7a0:::benchmark_data_smithi036_18856_object2237:head v 77'1211, mlcod=77'1206)", 2020-11-12T17:25:07.977 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:07.962955+0000", 2020-11-12T17:25:07.977 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0060215709999999999, 2020-11-12T17:25:07.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0060814950000000001, 2020-11-12T17:25:07.977 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:07.977 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:07.978 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:07.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:07.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.962955+0000", 2020-11-12T17:25:07.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:07.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:07.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.962955+0000", 2020-11-12T17:25:07.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:07.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:07.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.962930+0000", 2020-11-12T17:25:07.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9234999999999997e-05 2020-11-12T17:25:07.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:07.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.962999+0000", 2020-11-12T17:25:07.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002846211 2020-11-12T17:25:07.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:07.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.965845+0000", 2020-11-12T17:25:07.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9970000000000004e-06 2020-11-12T17:25:07.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.965851+0000", 2020-11-12T17:25:07.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5141000000000001e-05 2020-11-12T17:25:07.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:07.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.965887+0000", 2020-11-12T17:25:07.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9038999999999998e-05 2020-11-12T17:25:07.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:07.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.965906+0000", 2020-11-12T17:25:07.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029510029999999998 2020-11-12T17:25:07.983 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:07.983 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:07.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:07.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.984 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:17900 4.5 e77/69 4:afdde7a0:::benchmark_data_smithi036_18856_object2237:head v 77'1212, mlcod=77'1206)", 2020-11-12T17:25:07.984 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:07.963848+0000", 2020-11-12T17:25:07.984 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0051280659999999997, 2020-11-12T17:25:07.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052254060000000001, 2020-11-12T17:25:07.985 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:07.985 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:07.985 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:07.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:07.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.963848+0000", 2020-11-12T17:25:07.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:07.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:07.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.963848+0000", 2020-11-12T17:25:07.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:07.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:07.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.963823+0000", 2020-11-12T17:25:07.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6977000000000006e-05 2020-11-12T17:25:07.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:07.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.963890+0000", 2020-11-12T17:25:07.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026021579999999998 2020-11-12T17:25:07.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:07.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.966492+0000", 2020-11-12T17:25:07.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1840000000000002e-06 2020-11-12T17:25:07.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.966500+0000", 2020-11-12T17:25:07.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8365999999999997e-05 2020-11-12T17:25:07.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:07.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.966548+0000", 2020-11-12T17:25:07.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5106999999999999e-05 2020-11-12T17:25:07.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:07.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.966573+0000", 2020-11-12T17:25:07.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027249119999999999 2020-11-12T17:25:07.991 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:07.991 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:07.991 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:07.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.991 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:17901 4.5 e77/69 4:afdde7a0:::benchmark_data_smithi036_18856_object2237:head v 77'1213, mlcod=77'1206)", 2020-11-12T17:25:07.992 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:07.964784+0000", 2020-11-12T17:25:07.992 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0041922390000000004, 2020-11-12T17:25:07.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043247809999999998, 2020-11-12T17:25:07.992 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:07.992 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:07.992 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:07.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:07.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.964784+0000", 2020-11-12T17:25:07.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:07.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:07.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.964784+0000", 2020-11-12T17:25:07.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:25:07.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:07.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.964756+0000", 2020-11-12T17:25:07.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9766999999999996e-05 2020-11-12T17:25:07.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:07.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.964845+0000", 2020-11-12T17:25:07.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025656139999999999 2020-11-12T17:25:07.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:07.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.967411+0000", 2020-11-12T17:25:07.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4539999999999998e-06 2020-11-12T17:25:07.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:07.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.967417+0000", 2020-11-12T17:25:07.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7431e-05 2020-11-12T17:25:07.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:07.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.967464+0000", 2020-11-12T17:25:07.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1526e-05 2020-11-12T17:25:07.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:07.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:07.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:07.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:07.967486+0000", 2020-11-12T17:25:07.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027015170000000001 2020-11-12T17:25:07.998 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:07.998 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:07.998 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:07.998 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:07.999 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:07.999 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 4 2020-11-12T17:25:07.999 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:08.000 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:08.045 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:08.040+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:08.142 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:08.138+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:08.186 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:08.187 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:08.187 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:08.187 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:08.187 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:08.200 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:08.242 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:08.236+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:08.284 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:08.344 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:08.340+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:08.371 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:08.371 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:08.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 123.609796421, 2020-11-12T17:25:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:25:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:25:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.374 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:25:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:25:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:25:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:25:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:25:08.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:25:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:25:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:25:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:25:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:25:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:25:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:25:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:25:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:25:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:25:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:25:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:25:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:25:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:25:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:25:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:25:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:25:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:25:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:25:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 123.60299757, 2020-11-12T17:25:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:25:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:25:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:25:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:25:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:25:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:25:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:25:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:25:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:25:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:25:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:25:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:25:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:25:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:25:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:25:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:25:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:25:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.35973879399999, 2020-11-12T17:25:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:25:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:25:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:25:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:25:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:25:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:25:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:25:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:25:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:25:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:25:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:25:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:25:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:25:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:25:08.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:25:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:25:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:25:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:25:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:25:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:25:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:25:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:25:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:25:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:25:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:25:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:25:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.409 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:25:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:25:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.352523613, 2020-11-12T17:25:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:25:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:25:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:25:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:25:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:25:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:25:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:25:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:25:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:25:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:25:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:25:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:25:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:25:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:25:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:25:08.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:25:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:25:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:25:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.682078722, 2020-11-12T17:25:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:25:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:25:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:25:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:25:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:25:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:25:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:25:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:25:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:25:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:25:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:25:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:25:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:25:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:25:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:25:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:25:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:25:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:25:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:25:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:25:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:25:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:25:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:25:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:25:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.681913819, 2020-11-12T17:25:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:25:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:25:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:25:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:25:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:25:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:25:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:25:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:25:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:25:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:25:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:25:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:25:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:25:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:25:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:25:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:25:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:25:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:25:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:25:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:25:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:25:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:25:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:25:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:25:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.677750585, 2020-11-12T17:25:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:25:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:25:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:25:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:25:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:25:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:25:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:25:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:25:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:25:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:25:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:25:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:25:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:25:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:25:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:25:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:25:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.67643375, 2020-11-12T17:25:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:25:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:25:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:25:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:25:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:25:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:25:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:25:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:25:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:25:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:25:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:25:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:25:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:25:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:25:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:25:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:25:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:25:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 113.81411411800001, 2020-11-12T17:25:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:25:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:25:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:25:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:25:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:25:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:25:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:25:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:25:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:25:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:25:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:25:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:25:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:25:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:25:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:25:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:25:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:25:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:25:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:25:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:25:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:25:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 109.48631215, 2020-11-12T17:25:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:25:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:25:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:25:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:25:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:25:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:25:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:25:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:25:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:25:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:25:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:25:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:25:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:25:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:25:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:25:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:25:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:25:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:25:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:25:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:25:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:25:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:25:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:25:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:25:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:25:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:25:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 109.479068441, 2020-11-12T17:25:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:25:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:25:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:25:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:25:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:25:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:25:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:25:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:25:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:25:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:25:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:25:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:25:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:25:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:25:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:25:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:25:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:25:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 88.316720738000001, 2020-11-12T17:25:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:25:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:25:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:25:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:25:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:25:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:25:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:25:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:25:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:25:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:25:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:25:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:25:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:25:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:25:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:25:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:25:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:25:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:25:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:25:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:25:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:25:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:25:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:25:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:25:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:25:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:25:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 74.375892981000007, 2020-11-12T17:25:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:25:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:25:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:25:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:25:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:25:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:25:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:25:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:25:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:25:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:25:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:25:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:25:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:25:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:25:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:25:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:25:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:25:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:25:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:25:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:25:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:25:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:25:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:25:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:25:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:25:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 74.368234172000001, 2020-11-12T17:25:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:25:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:25:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:25:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:25:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:25:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:25:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:25:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:25:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:25:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:25:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:25:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:25:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:25:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:25:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:25:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:25:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39832 3.3 3:cb2faec6:::benchmark_data_smithi036_14212_object4978:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:25:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.992460436000002, 2020-11-12T17:25:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.229556766, 2020-11-12T17:25:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39832 2020-11-12T17:25:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:25:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376166+0000", 2020-11-12T17:25:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999251 2020-11-12T17:25:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376091+0000", 2020-11-12T17:25:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018965799999999999 2020-11-12T17:25:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376281+0000", 2020-11-12T17:25:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7319999999999999e-05 2020-11-12T17:25:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376308+0000", 2020-11-12T17:25:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8396000000000001e-05 2020-11-12T17:25:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.376327+0000", 2020-11-12T17:25:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006884991 2020-11-12T17:25:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383212+0000", 2020-11-12T17:25:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5163999999999999e-05 2020-11-12T17:25:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383307+0000", 2020-11-12T17:25:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015254400000000001 2020-11-12T17:25:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.383459+0000", 2020-11-12T17:25:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041117929999999999 2020-11-12T17:25:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.387571+0000", 2020-11-12T17:25:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.21802176100000001 2020-11-12T17:25:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605593+0000", 2020-11-12T17:25:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3146999999999996e-05 2020-11-12T17:25:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605666+0000", 2020-11-12T17:25:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6776e-05 2020-11-12T17:25:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.605723+0000", 2020-11-12T17:25:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.229556766 2020-11-12T17:25:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:50240 3.1 e55/20 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head v 55'3224, mlcod=55'3218)", 2020-11-12T17:25:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:25:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.001584627, 2020-11-12T17:25:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149, 2020-11-12T17:25:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:25:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:25:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367024+0000", 2020-11-12T17:25:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9963000000000002e-05 2020-11-12T17:25:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367084+0000", 2020-11-12T17:25:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23018651500000001 2020-11-12T17:25:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597271+0000", 2020-11-12T17:25:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2030000000000003e-06 2020-11-12T17:25:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597278+0000", 2020-11-12T17:25:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3430000000000002e-05 2020-11-12T17:25:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597331+0000", 2020-11-12T17:25:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2829000000000001e-05 2020-11-12T17:25:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597354+0000", 2020-11-12T17:25:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064125579999999996 2020-11-12T17:25:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603767+0000", 2020-11-12T17:25:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2398999999999997e-05 2020-11-12T17:25:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603829+0000", 2020-11-12T17:25:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149 2020-11-12T17:25:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(osd.4.0:8091 3.9 e56/35 ondisk, result = 0)", 2020-11-12T17:25:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:25:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.988805141, 2020-11-12T17:25:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999, 2020-11-12T17:25:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:25:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:25:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379795+0000", 2020-11-12T17:25:08.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8462999999999998e-05 2020-11-12T17:25:08.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379864+0000", 2020-11-12T17:25:08.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23719935 2020-11-12T17:25:08.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617063+0000", 2020-11-12T17:25:08.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5229999999999998e-06 2020-11-12T17:25:08.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617071+0000", 2020-11-12T17:25:08.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0618999999999995e-05 2020-11-12T17:25:08.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617151+0000", 2020-11-12T17:25:08.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4123e-05 2020-11-12T17:25:08.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617165+0000", 2020-11-12T17:25:08.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4392e-05 2020-11-12T17:25:08.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617260+0000", 2020-11-12T17:25:08.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999 2020-11-12T17:25:08.541 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.541 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.541 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.541 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:08.541 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:08.542 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.482979067000002, 2020-11-12T17:25:08.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:25:08.542 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.542 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:08.542 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:08.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:08.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:08.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:25:08.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:25:08.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:25:08.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:25:08.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:25:08.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:25:08.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:25:08.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:25:08.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:25:08.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:25:08.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:25:08.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:25:08.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:25:08.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:25:08.548 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.548 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.548 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.549 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:304 4.b e71/69 4:d3839b57:::benchmark_data_smithi036_18856_object37:head v 71'32, mlcod=71'28)", 2020-11-12T17:25:08.549 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:08.549 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.224323024, 2020-11-12T17:25:08.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998, 2020-11-12T17:25:08.549 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.549 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.550 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:08.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:08.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9998965 2020-11-12T17:25:08.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144200+0000", 2020-11-12T17:25:08.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166613 2020-11-12T17:25:08.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144366+0000", 2020-11-12T17:25:08.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.282020573 2020-11-12T17:25:08.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426387+0000", 2020-11-12T17:25:08.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1779999999999996e-06 2020-11-12T17:25:08.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426391+0000", 2020-11-12T17:25:08.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7170999999999999e-05 2020-11-12T17:25:08.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426448+0000", 2020-11-12T17:25:08.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9868e-05 2020-11-12T17:25:08.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426468+0000", 2020-11-12T17:25:08.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036033319999999999 2020-11-12T17:25:08.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430072+0000", 2020-11-12T17:25:08.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6007000000000001e-05 2020-11-12T17:25:08.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430128+0000", 2020-11-12T17:25:08.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998 2020-11-12T17:25:08.556 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.556 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.556 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.557 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:12912 4.9 4:91c4a289:::benchmark_data_smithi036_18856_object1613:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:08.557 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.896117+0000", 2020-11-12T17:25:08.557 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.4725096070000001, 2020-11-12T17:25:08.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25992880699999998, 2020-11-12T17:25:08.557 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:08.557 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:08.558 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:08.558 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:08.558 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:08.558 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12912 2020-11-12T17:25:08.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.558 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:08.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:08.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896117+0000", 2020-11-12T17:25:08.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:08.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:08.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896117+0000", 2020-11-12T17:25:08.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:08.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:08.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896083+0000", 2020-11-12T17:25:08.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5064999999999999e-05 2020-11-12T17:25:08.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:08.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896178+0000", 2020-11-12T17:25:08.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0964e-05 2020-11-12T17:25:08.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:08.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896189+0000", 2020-11-12T17:25:08.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.699e-06 2020-11-12T17:25:08.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:08.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896195+0000", 2020-11-12T17:25:08.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036739390000000002 2020-11-12T17:25:08.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:08.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.899869+0000", 2020-11-12T17:25:08.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5804999999999997e-05 2020-11-12T17:25:08.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:08.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.899944+0000", 2020-11-12T17:25:08.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110425 2020-11-12T17:25:08.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:08.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.900055+0000", 2020-11-12T17:25:08.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050734650000000001 2020-11-12T17:25:08.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:08.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.905128+0000", 2020-11-12T17:25:08.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25056899199999999 2020-11-12T17:25:08.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:08.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:03.155697+0000", 2020-11-12T17:25:08.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000207414 2020-11-12T17:25:08.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:08.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:03.155905+0000", 2020-11-12T17:25:08.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014098 2020-11-12T17:25:08.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:08.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:08.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:08.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:03.156046+0000", 2020-11-12T17:25:08.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25992880699999998 2020-11-12T17:25:08.567 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.567 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.567 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.567 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:08.567 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:08.567 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:08.569 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:08.569 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:08.569 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:08.569 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:08.570 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:08.570 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:08.577 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:08.574+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:08.587 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:08.621 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:08.622 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:08.626 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:08.627 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:08.627 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:25:08.628 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:08.628 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:08.629 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:08.629 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:08.632 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:08.635 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:08.636 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:08.679 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:08.674+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:08.723 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:08.724 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:08.734 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:08.808 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:08.802+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:08.881 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:08.876+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:08.929 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 17 16 18797 18781 8.63008 7.26562 0.0507269 0.0143957 2020-11-12T17:25:08.936 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:08.937 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:08.951 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:08.983 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:08.976+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:09.042 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:25:09.081 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:09.074+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:09.110 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:09.111 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:09.125 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:09.188 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:09.180+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:09.288 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:09.280+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:09.318 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:09.319 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:09.328 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:09.386 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:09.382+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:09.444 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:09.445 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:09.455 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:09.523 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:09.498+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:09.590 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:09.586+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:09.627 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:09.628 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:09.633 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:09.731 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:09.726+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:09.791 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:09.786+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:09.823 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:09.824 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:09.832 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:09.891 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:09.884+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:09.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 18 16 19492 19476 8.45226 5.42969 0.010695 0.0147666 2020-11-12T17:25:09.973 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:25:09.974 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:09.970+0000 7f7b4b297700 -1 osd.4 77 handle_osd_map injecting map crc failure 2020-11-12T17:25:09.997 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:09.990+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:10.016 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:10.017 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:10.028 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:10.093 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:10.088+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:10.197 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:10.194+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:10.207 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:10.207 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:10.222 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:10.296 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:10.292+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:10.351 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:10.352 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:10.361 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:10.399 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:10.394+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:10.501 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:10.498+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:10.534 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:10.535 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:10.551 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:10.602 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:10.596+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:10.638 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:10.675 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:10.676 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:10.687 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:10.732 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:10.728+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:10.799 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:10.804 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:10.798+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:10.828 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:10.850 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:10.850 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:10.851 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:10.851 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:10.857 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:10.860 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:25:10.891 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:10.907 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:10.902+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:10.929 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 19 16 20408 20392 8.38401 7.15625 0.0247348 0.0148888 2020-11-12T17:25:10.935 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:10.976 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:11.001 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:11.002 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:11.002 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:11.002 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:11.002 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:11.006 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:11.000+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:11.014 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:25:11.017 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:11.017 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:11.018 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:11.018 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:11.018 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:25:11.018 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:11.018 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:11.018 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:11.019 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:11.019 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:11.020 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:11.020 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:11.107 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:11.102+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:11.140 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:11.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:25:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.477410365, 2020-11-12T17:25:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:25:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:25:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:25:11.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:25:11.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:25:11.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:25:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:25:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:25:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:25:11.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:25:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:25:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:25:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:25:11.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:25:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:25:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:25:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:25:11.155 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:25:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:11.156 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.47650357000001, 2020-11-12T17:25:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:25:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:11.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:25:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:25:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:25:11.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:25:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:25:11.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:25:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:25:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:25:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:25:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:25:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:25:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:25:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:25:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:25:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:25:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:25:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.475801347, 2020-11-12T17:25:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:25:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.167 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:25:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:25:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:25:11.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:25:11.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:25:11.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:25:11.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:25:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:25:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:25:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:25:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:25:11.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:25:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:25:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:25:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:25:11.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:25:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:25:11.177 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.47129515100001, 2020-11-12T17:25:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:25:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.178 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:11.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:25:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:25:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:25:11.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:25:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:25:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:25:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:25:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:25:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:25:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:25:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:25:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:25:11.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:25:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:25:11.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:25:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:25:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.188 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:25:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:11.189 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 124.96775417000001, 2020-11-12T17:25:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:25:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:25:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:25:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:25:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:25:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:25:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:25:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:25:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:25:11.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:25:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:25:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:25:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:25:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:25:11.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:25:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:25:11.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:25:11.208 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:25:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 124.966827929, 2020-11-12T17:25:11.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:25:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.211 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:25:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:25:11.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:25:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:25:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:25:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:25:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:25:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:25:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:25:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:25:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:25:11.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:25:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:25:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:25:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:25:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:25:11.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:25:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:25:11.219 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:11.220 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 124.964480419, 2020-11-12T17:25:11.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:25:11.220 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.220 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.220 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:11.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:11.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:25:11.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:25:11.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:25:11.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:25:11.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:25:11.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:25:11.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:25:11.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:25:11.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:25:11.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:25:11.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:25:11.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:25:11.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:25:11.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:25:11.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:25:11.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:25:11.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:25:11.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.228 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.228 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.228 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:25:11.228 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:11.228 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 124.963715627, 2020-11-12T17:25:11.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:25:11.229 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.229 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.229 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:11.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:11.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:11.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:25:11.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:25:11.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:25:11.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:25:11.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:25:11.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:25:11.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:25:11.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:25:11.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:25:11.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:25:11.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:25:11.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:25:11.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:25:11.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:25:11.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:25:11.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:25:11.236 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.236 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.236 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.237 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:25:11.237 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:11.237 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 124.881489149, 2020-11-12T17:25:11.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:25:11.237 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.238 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.238 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:11.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:11.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:11.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:25:11.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:25:11.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:25:11.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:25:11.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:25:11.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:25:11.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:25:11.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:25:11.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:25:11.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:25:11.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:25:11.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:25:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:25:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:25:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:25:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:25:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:25:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.289375716, 2020-11-12T17:25:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:25:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.246 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:25:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:25:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:25:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:25:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:25:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:25:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:25:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:25:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:25:11.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:25:11.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:25:11.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:25:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:25:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:25:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:25:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:25:11.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:25:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:25:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 121.26071541899999, 2020-11-12T17:25:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:25:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.263 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:11.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:25:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:25:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:25:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:25:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:25:11.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:25:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:25:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:25:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:25:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:25:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:25:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:25:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:25:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:25:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:25:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:25:11.273 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:25:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.348118708, 2020-11-12T17:25:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:25:11.275 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:11.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:11.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:25:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:25:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:25:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:25:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:25:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:25:11.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:25:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:25:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:25:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:25:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:25:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:25:11.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:25:11.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:25:11.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:25:11.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:25:11.284 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.284 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.284 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.284 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:25:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.276979064, 2020-11-12T17:25:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:25:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:11.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:25:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:25:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:25:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:25:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:25:11.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:25:11.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:25:11.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:25:11.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:25:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:25:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:25:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:25:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:25:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:25:11.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:25:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:25:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.292 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:25:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.167591773, 2020-11-12T17:25:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:25:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.293 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:25:11.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:25:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:25:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:25:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:25:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:25:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:25:11.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:25:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:25:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:25:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:25:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:25:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:25:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:25:11.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:25:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:25:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.300 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:25:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.097055934, 2020-11-12T17:25:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:25:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.301 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:25:11.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:25:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:25:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:25:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:25:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:25:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:25:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:25:11.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:25:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:25:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:25:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:25:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:25:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:25:11.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:25:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:25:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.308 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:25:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.927689996, 2020-11-12T17:25:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:25:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.309 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:25:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:25:11.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:25:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:25:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:25:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:25:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:25:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:25:11.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:25:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:25:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:25:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:25:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:25:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:25:11.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:25:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:25:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:25:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.316 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:25:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.59906412399999, 2020-11-12T17:25:11.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:25:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:25:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:25:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:25:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:25:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:25:11.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:25:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:25:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:25:11.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:25:11.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:25:11.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:25:11.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:25:11.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:25:11.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:25:11.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:25:11.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:25:11.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:25:11.324 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.325 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.325 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.325 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:25:11.325 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:11.325 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.942600762, 2020-11-12T17:25:11.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:25:11.326 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.326 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.326 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:11.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:11.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:11.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:25:11.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:25:11.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:25:11.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:25:11.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:25:11.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:25:11.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:25:11.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:25:11.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:25:11.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:25:11.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:25:11.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:25:11.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:25:11.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:25:11.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:25:11.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:25:11.332 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.332 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.333 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.333 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:25:11.333 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:11.333 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.939960039, 2020-11-12T17:25:11.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:25:11.334 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.334 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.334 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:11.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:11.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:11.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:25:11.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:25:11.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:25:11.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:25:11.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:25:11.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:25:11.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:25:11.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:25:11.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:25:11.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:25:11.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:25:11.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:25:11.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:25:11.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:25:11.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:25:11.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:25:11.341 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.341 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.341 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.341 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:25:11.341 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:11.342 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.455714, 2020-11-12T17:25:11.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:25:11.342 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.342 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.342 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:11.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:11.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:25:11.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:25:11.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:25:11.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:25:11.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:25:11.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:25:11.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:25:11.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:25:11.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:25:11.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:25:11.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:25:11.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:25:11.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:25:11.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:25:11.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:25:11.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:25:11.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:25:11.349 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.349 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.349 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.349 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.349 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.349 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:11.351 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:11.351 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:11.346+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:11.452 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:11.448+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:11.470 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:11.471 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:11.471 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:11.471 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:11.481 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:11.572 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:11.568+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:11.651 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:11.652 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:11.652 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:11.652 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:11.652 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:11.655 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:11.650+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:11.667 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:11.756 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:11.750+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:11.825 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:11.825 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:11.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:11.825 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:11.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.826 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:11.826 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:11.826 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.403830716, 2020-11-12T17:25:11.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:25:11.826 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.826 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:11.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:11.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:11.827 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:25:11.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.827 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:11.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:11.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:25:11.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:25:11.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:25:11.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:25:11.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:25:11.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:25:11.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:25:11.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:25:11.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:25:11.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:25:11.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:25:11.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:25:11.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:25:11.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:11.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:25:11.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:25:11.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:11.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:25:11.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:25:11.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:11.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:25:11.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:25:11.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:25:11.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:25:11.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:25:11.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:25:11.846 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.846 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.848 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:25:11.848 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:11.848 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.396886654, 2020-11-12T17:25:11.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:25:11.849 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.849 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:11.849 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:11.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:11.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:11.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:25:11.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:25:11.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:25:11.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:25:11.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:25:11.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:25:11.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:25:11.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:25:11.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:25:11.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:25:11.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:25:11.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:25:11.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:25:11.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:25:11.862 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.862 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.862 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.863 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:25512 3.b 3:d013695c:::benchmark_data_smithi036_14212_object3188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:11.863 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:25:11.863 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.365600938, 2020-11-12T17:25:11.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998, 2020-11-12T17:25:11.864 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.864 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:11.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:11.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:11.864 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25512 2020-11-12T17:25:11.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.865 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:25:11.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456718+0000", 2020-11-12T17:25:11.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:11.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456695+0000", 2020-11-12T17:25:11.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5754999999999996e-05 2020-11-12T17:25:11.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456761+0000", 2020-11-12T17:25:11.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6989999999999998e-06 2020-11-12T17:25:11.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456771+0000", 2020-11-12T17:25:11.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:25:11.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.456776+0000", 2020-11-12T17:25:11.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038619959999999999 2020-11-12T17:25:11.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460638+0000", 2020-11-12T17:25:11.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103997 2020-11-12T17:25:11.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460742+0000", 2020-11-12T17:25:11.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178529 2020-11-12T17:25:11.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:11.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.460920+0000", 2020-11-12T17:25:11.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005224518 2020-11-12T17:25:11.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:11.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.466145+0000", 2020-11-12T17:25:11.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27518218700000002 2020-11-12T17:25:11.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:11.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741327+0000", 2020-11-12T17:25:11.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7435000000000006e-05 2020-11-12T17:25:11.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741414+0000", 2020-11-12T17:25:11.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2145000000000003e-05 2020-11-12T17:25:11.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:45.741467+0000", 2020-11-12T17:25:11.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28474856999999998 2020-11-12T17:25:11.877 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.877 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.877 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.878 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:11.878 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:11.878 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.223048868000006, 2020-11-12T17:25:11.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:25:11.878 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.878 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.879 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:11.879 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:11.879 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:11.879 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:25:11.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.879 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:11.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:11.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:11.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:25:11.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:25:11.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:25:11.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:25:11.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:25:11.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:25:11.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:25:11.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:25:11.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:25:11.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:25:11.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:25:11.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:25:11.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:11.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:25:11.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:25:11.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:11.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:25:11.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:25:11.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:11.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:25:11.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:25:11.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:25:11.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:25:11.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:25:11.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:25:11.891 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.891 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.891 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.892 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e48)", 2020-11-12T17:25:11.892 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:25:11.892 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.146259069999999, 2020-11-12T17:25:11.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998, 2020-11-12T17:25:11.893 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.893 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:25:11.893 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:11.893 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:11.893 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:11.893 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:25:11.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.894 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:25:11.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676060+0000", 2020-11-12T17:25:11.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999475 2020-11-12T17:25:11.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676007+0000", 2020-11-12T17:25:11.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110902 2020-11-12T17:25:11.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676118+0000", 2020-11-12T17:25:11.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6195e-05 2020-11-12T17:25:11.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676135+0000", 2020-11-12T17:25:11.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3829999999999998e-06 2020-11-12T17:25:11.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676144+0000", 2020-11-12T17:25:11.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5806000000000001e-05 2020-11-12T17:25:11.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676200+0000", 2020-11-12T17:25:11.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9735999999999999e-05 2020-11-12T17:25:11.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:11.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.676259+0000", 2020-11-12T17:25:11.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29976251100000001 2020-11-12T17:25:11.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976022+0000", 2020-11-12T17:25:11.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29996204799999998 2020-11-12T17:25:11.903 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.903 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.904 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.904 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:33576 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:11.904 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:25:11.904 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 78.214404422000001, 2020-11-12T17:25:11.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846, 2020-11-12T17:25:11.911 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.911 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:11.911 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:25:11.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607915+0000", 2020-11-12T17:25:11.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:11.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607883+0000", 2020-11-12T17:25:11.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0716000000000004e-05 2020-11-12T17:25:11.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.607964+0000", 2020-11-12T17:25:11.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28021348200000001 2020-11-12T17:25:11.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888177+0000", 2020-11-12T17:25:11.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0214000000000001e-05 2020-11-12T17:25:11.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888188+0000", 2020-11-12T17:25:11.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0760999999999994e-05 2020-11-12T17:25:11.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888278+0000", 2020-11-12T17:25:11.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0537e-05 2020-11-12T17:25:11.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888299+0000", 2020-11-12T17:25:11.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020659300000000001 2020-11-12T17:25:11.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:53.888505+0000", 2020-11-12T17:25:11.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.280590846 2020-11-12T17:25:11.921 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.922 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.922 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.922 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34328 3.8 3:12eb1396:::benchmark_data_smithi036_14212_object4290:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:11.922 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:11.922 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.265859470999999, 2020-11-12T17:25:11.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999, 2020-11-12T17:25:11.923 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.923 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:11.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:11.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:11.923 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34328 2020-11-12T17:25:11.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.924 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:11.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:11.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999542 2020-11-12T17:25:11.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556414+0000", 2020-11-12T17:25:11.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133592 2020-11-12T17:25:11.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556547+0000", 2020-11-12T17:25:11.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8813000000000001e-05 2020-11-12T17:25:11.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556566+0000", 2020-11-12T17:25:11.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7660000000000004e-06 2020-11-12T17:25:11.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556575+0000", 2020-11-12T17:25:11.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011688914999999999 2020-11-12T17:25:11.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568264+0000", 2020-11-12T17:25:11.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108214 2020-11-12T17:25:11.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568372+0000", 2020-11-12T17:25:11.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189846 2020-11-12T17:25:11.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:11.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568562+0000", 2020-11-12T17:25:11.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016740710000000001 2020-11-12T17:25:11.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:11.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570236+0000", 2020-11-12T17:25:11.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29321335900000001 2020-11-12T17:25:11.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:11.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863449+0000", 2020-11-12T17:25:11.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7244999999999998e-05 2020-11-12T17:25:11.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863507+0000", 2020-11-12T17:25:11.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0704999999999994e-05 2020-11-12T17:25:11.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863587+0000", 2020-11-12T17:25:11.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999 2020-11-12T17:25:11.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.937 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.938 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34328 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:11.938 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:25:11.938 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.251502822000006, 2020-11-12T17:25:11.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998, 2020-11-12T17:25:11.938 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.938 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:11.939 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:25:11.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570816+0000", 2020-11-12T17:25:11.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:11.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570784+0000", 2020-11-12T17:25:11.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2226999999999997e-05 2020-11-12T17:25:11.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570866+0000", 2020-11-12T17:25:11.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.290361445 2020-11-12T17:25:11.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861228+0000", 2020-11-12T17:25:11.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0240000000000003e-06 2020-11-12T17:25:11.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.861237+0000", 2020-11-12T17:25:11.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021956749999999998 2020-11-12T17:25:11.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863432+0000", 2020-11-12T17:25:11.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2940000000000006e-06 2020-11-12T17:25:11.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863441+0000", 2020-11-12T17:25:11.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162399 2020-11-12T17:25:11.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863603+0000", 2020-11-12T17:25:11.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29278696399999998 2020-11-12T17:25:11.946 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.946 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.946 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.946 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:11.946 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:11.947 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.751514959000005, 2020-11-12T17:25:11.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:25:11.947 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.947 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.947 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:11.947 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:11.948 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:11.948 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:25:11.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.948 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:11.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:11.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:25:11.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:25:11.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:25:11.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:25:11.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:25:11.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:25:11.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:25:11.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:25:11.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:25:11.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:25:11.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:25:11.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:25:11.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:25:11.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:11.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:25:11.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:25:11.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:11.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:25:11.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:25:11.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:11.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:25:11.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:25:11.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:25:11.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:25:11.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:25:11.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:25:11.958 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.958 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.959 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:11.959 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:11.959 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.736193736999994, 2020-11-12T17:25:11.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:25:11.960 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.960 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:11.960 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:11.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:11.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:11.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:25:11.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:25:11.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:25:11.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:25:11.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:25:11.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:25:11.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:25:11.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:25:11.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:25:11.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:11.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:25:11.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:25:11.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:25:11.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:25:11.970 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.970 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.970 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.971 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:11.971 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:11.972 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 64.959343774999994, 2020-11-12T17:25:11.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:25:11.972 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.972 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.973 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:11.973 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:11.973 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:11.973 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:25:11.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.974 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:11.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:11.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:11.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:25:11.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:25:11.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:25:11.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:25:11.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:25:11.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:25:11.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:25:11.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:25:11.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:25:11.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:25:11.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:25:11.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:25:11.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:11.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:25:11.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:25:11.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:11.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:25:11.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:25:11.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:11.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:25:11.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:25:11.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:11.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:25:11.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:25:11.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:11.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:25:11.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:25:11.986 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.987 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:11.987 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:11.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.987 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:50544 3.8 3:13876818:::benchmark_data_smithi036_14212_object6317:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e55)", 2020-11-12T17:25:11.988 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:25:11.988 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 59.092718783000002, 2020-11-12T17:25:11.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998, 2020-11-12T17:25:11.989 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:11.989 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:11.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:11.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:11.990 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:11.990 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 50544 2020-11-12T17:25:11.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.990 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:11.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:11.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:25:11.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:11.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:11.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729600+0000", 2020-11-12T17:25:11.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:25:11.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:11.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729570+0000", 2020-11-12T17:25:11.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010924 2020-11-12T17:25:11.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:11.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729679+0000", 2020-11-12T17:25:11.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1567e-05 2020-11-12T17:25:11.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:11.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729691+0000", 2020-11-12T17:25:11.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0929999999999999e-06 2020-11-12T17:25:11.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:11.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.729697+0000", 2020-11-12T17:25:11.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086737580000000002 2020-11-12T17:25:11.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:11.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738371+0000", 2020-11-12T17:25:11.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7824999999999993e-05 2020-11-12T17:25:11.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:11.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:11.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738459+0000", 2020-11-12T17:25:11.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017210899999999999 2020-11-12T17:25:11.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:11.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:12.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.738631+0000", 2020-11-12T17:25:12.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027566969999999998 2020-11-12T17:25:12.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:12.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:12.741387+0000", 2020-11-12T17:25:12.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27686545000000001 2020-11-12T17:25:12.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018253+0000", 2020-11-12T17:25:12.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3428000000000002e-05 2020-11-12T17:25:12.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:12.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018336+0000", 2020-11-12T17:25:12.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5240999999999994e-05 2020-11-12T17:25:12.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:12.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:13.018402+0000", 2020-11-12T17:25:12.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28880130399999998 2020-11-12T17:25:12.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.004 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.005 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:12.005 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:12.005 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.002896933000002, 2020-11-12T17:25:12.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:25:12.005 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:12.006 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:12.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:12.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.006 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:25:12.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.007 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:12.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:12.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:12.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:12.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:12.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:12.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:12.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:12.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:25:12.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:25:12.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:12.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:25:12.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:25:12.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:12.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:25:12.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:25:12.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:25:12.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:25:12.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:12.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:25:12.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:25:12.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:12.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:25:12.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:25:12.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:12.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:25:12.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:25:12.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:12.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:25:12.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:25:12.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:25:12.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:25:12.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:12.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:25:12.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:25:12.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:12.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:25:12.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:25:12.022 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.023 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.023 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.023 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:25:12.024 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:12.024 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.873963449000001, 2020-11-12T17:25:12.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:25:12.024 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:12.024 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.024 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:12.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:12.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:12.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:12.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:12.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:12.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:25:12.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:12.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:25:12.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:25:12.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:12.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:25:12.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:25:12.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:12.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:25:12.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:25:12.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:25:12.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:25:12.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:12.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:25:12.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:25:12.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:12.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:25:12.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:25:12.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:12.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:25:12.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:25:12.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:12.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:25:12.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:25:12.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.040 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.041 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:12.041 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:12.042 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.101945163000003, 2020-11-12T17:25:12.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:25:12.042 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:12.043 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.043 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:12.043 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:12.043 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.044 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:25:12.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.044 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:12.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:12.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:12.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:12.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:12.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:12.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:12.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:12.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:25:12.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:25:12.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:12.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:25:12.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:25:12.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:12.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:25:12.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:25:12.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:25:12.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:25:12.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:12.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:25:12.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:25:12.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:12.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:25:12.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:25:12.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:12.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:25:12.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:25:12.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:12.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:25:12.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:25:12.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:25:12.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:25:12.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:12.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:25:12.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:25:12.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:12.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:25:12.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:25:12.063 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.063 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.064 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.064 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:12.065 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:12.065 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 48.179825174999998, 2020-11-12T17:25:12.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:25:12.066 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:12.066 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.066 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:12.067 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:12.067 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.067 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:25:12.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.068 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:12.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:12.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:12.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:12.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:12.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:12.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:25:12.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:12.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:25:12.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:25:12.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:12.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:25:12.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:25:12.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:12.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:25:12.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:25:12.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:25:12.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:25:12.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:12.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:25:12.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:25:12.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:12.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:25:12.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:25:12.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:12.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:25:12.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:25:12.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:12.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:25:12.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:25:12.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:25:12.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:25:12.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:12.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:25:12.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:25:12.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:12.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:25:12.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:25:12.076 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.076 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.077 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.077 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:59416 3.c e57/20 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head v 57'3976, mlcod=57'3970)", 2020-11-12T17:25:12.077 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:12.077 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 47.28948561, 2020-11-12T17:25:12.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998, 2020-11-12T17:25:12.078 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:12.078 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.078 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:12.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:12.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:12.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:12.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:12.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:12.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:12.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:12.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532795+0000", 2020-11-12T17:25:12.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014490099999999999 2020-11-12T17:25:12.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:12.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532940+0000", 2020-11-12T17:25:12.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29738320899999998 2020-11-12T17:25:12.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:12.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830323+0000", 2020-11-12T17:25:12.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3199999999999996e-06 2020-11-12T17:25:12.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830330+0000", 2020-11-12T17:25:12.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9622999999999994e-05 2020-11-12T17:25:12.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:12.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830399+0000", 2020-11-12T17:25:12.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4766999999999999e-05 2020-11-12T17:25:12.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:12.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830424+0000", 2020-11-12T17:25:12.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038976610000000002 2020-11-12T17:25:12.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:12.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834322+0000", 2020-11-12T17:25:12.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7682999999999994e-05 2020-11-12T17:25:12.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:12.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834410+0000", 2020-11-12T17:25:12.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998 2020-11-12T17:25:12.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.084 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.085 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.085 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:60400 3.b 3:d9185304:::benchmark_data_smithi036_14212_object7549:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:12.085 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:25:12.085 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.008491898000003, 2020-11-12T17:25:12.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002, 2020-11-12T17:25:12.086 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:12.086 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.086 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:12.086 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:12.086 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.086 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60400 2020-11-12T17:25:12.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.087 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:12.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:12.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:25:12.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:12.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:12.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813827+0000", 2020-11-12T17:25:12.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:25:12.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:12.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813806+0000", 2020-11-12T17:25:12.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0312999999999997e-05 2020-11-12T17:25:12.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:12.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813866+0000", 2020-11-12T17:25:12.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5310000000000007e-06 2020-11-12T17:25:12.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:12.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813875+0000", 2020-11-12T17:25:12.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9999999999999999e-06 2020-11-12T17:25:12.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.813882+0000", 2020-11-12T17:25:12.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045585469999999996 2020-11-12T17:25:12.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:12.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818441+0000", 2020-11-12T17:25:12.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025338699999999999 2020-11-12T17:25:12.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:12.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818694+0000", 2020-11-12T17:25:12.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192215 2020-11-12T17:25:12.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:12.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.818887+0000", 2020-11-12T17:25:12.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019573659999999999 2020-11-12T17:25:12.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:12.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.820844+0000", 2020-11-12T17:25:12.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27823403299999999 2020-11-12T17:25:12.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099078+0000", 2020-11-12T17:25:12.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8301000000000003e-05 2020-11-12T17:25:12.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:12.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099136+0000", 2020-11-12T17:25:12.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4981000000000003e-05 2020-11-12T17:25:12.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:12.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099171+0000", 2020-11-12T17:25:12.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28534420100000002 2020-11-12T17:25:12.096 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.096 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.096 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.097 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:60400 3.b e57/20 ondisk, result = 0)", 2020-11-12T17:25:12.097 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:25:12.097 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.999046628999999, 2020-11-12T17:25:12.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166, 2020-11-12T17:25:12.097 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:12.097 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:12.098 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:12.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:12.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:25:12.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:12.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:12.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823272+0000", 2020-11-12T17:25:12.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:12.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:12.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823242+0000", 2020-11-12T17:25:12.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9956000000000005e-05 2020-11-12T17:25:12.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:12.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:25.823322+0000", 2020-11-12T17:25:12.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.270552615 2020-11-12T17:25:12.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:12.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093875+0000", 2020-11-12T17:25:12.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2374e-05 2020-11-12T17:25:12.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.093887+0000", 2020-11-12T17:25:12.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051711070000000003 2020-11-12T17:25:12.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:12.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099058+0000", 2020-11-12T17:25:12.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0665e-05 2020-11-12T17:25:12.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:12.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099069+0000", 2020-11-12T17:25:12.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000115362 2020-11-12T17:25:12.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:12.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:26.099184+0000", 2020-11-12T17:25:12.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27591166 2020-11-12T17:25:12.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.104 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.105 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:25:12.105 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:12.105 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.865271528999999, 2020-11-12T17:25:12.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:25:12.105 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:12.105 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.106 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:12.106 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:12.106 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:12.106 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:25:12.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.106 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:12.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:12.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:12.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:12.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:12.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:12.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:12.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:12.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:25:12.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:25:12.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:25:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:25:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:25:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:25:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:25:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:25:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:25:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:25:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:25:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:25:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:25:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:25:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:25:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:25:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:25:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:25:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:25:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:25:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:25:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:25:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:12.115 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:12.116 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:25:12.117 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:25:11.928996+0000 min lat: 0.00228632 max lat: 0.869783 avg lat: 0.0148697 2020-11-12T17:25:12.118 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:25:12.118 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 20 16 21516 21500 8.39758 8.65625 0.00922261 0.0148697 2020-11-12T17:25:12.118 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:12.114+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:12.119 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:12.218 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:12.214+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:12.239 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:12.240 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:12.240 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:25:12.241 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:12.251 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:12.319 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:12.312+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:12.420 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:12.421 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:12.421 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:12.421 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:12.421 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:12.422 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:12.416+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:12.432 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:12.522 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:12.518+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:12.567 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:12.567 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:12.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:12.568 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:12.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.568 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:12.568 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:12.568 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.806633572, 2020-11-12T17:25:12.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:25:12.569 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.569 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.570 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.570 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:12.570 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.570 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:25:12.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.570 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:12.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:12.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:25:12.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:25:12.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:25:12.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:25:12.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:25:12.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:25:12.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:25:12.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:25:12.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:25:12.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:25:12.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:25:12.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:25:12.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:25:12.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:12.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:25:12.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:25:12.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:12.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:25:12.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:25:12.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:25:12.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:25:12.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:25:12.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:25:12.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:25:12.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:25:12.582 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.582 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.582 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.583 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:25:12.583 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:12.583 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.799834721, 2020-11-12T17:25:12.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:25:12.583 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.584 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:12.584 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:12.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:12.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:12.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:25:12.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:25:12.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:25:12.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:25:12.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:25:12.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:25:12.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:25:12.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:25:12.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:25:12.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:25:12.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:25:12.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:25:12.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:25:12.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:25:12.592 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.592 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.592 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.593 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:25:12.593 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:25:12.593 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 126.55657594500001, 2020-11-12T17:25:12.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:25:12.593 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.594 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.594 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.594 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:12.594 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.594 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:25:12.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.594 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:25:12.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:25:12.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:12.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:25:12.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:25:12.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:25:12.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:25:12.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:25:12.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:25:12.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:25:12.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:25:12.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:25:12.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:25:12.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:25:12.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:25:12.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:12.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:25:12.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:25:12.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:12.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:25:12.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:25:12.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:25:12.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:25:12.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:25:12.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:25:12.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:25:12.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:25:12.603 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.603 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.603 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.604 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:25:12.604 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:25:12.604 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 126.549360764, 2020-11-12T17:25:12.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:25:12.604 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.604 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:12.604 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:25:12.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:25:12.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:25:12.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:25:12.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:25:12.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:25:12.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:25:12.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:25:12.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:25:12.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:25:12.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:25:12.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:25:12.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:25:12.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:25:12.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:25:12.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:25:12.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:25:12.610 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.610 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.611 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.611 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:12.611 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:12.611 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.878915873, 2020-11-12T17:25:12.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:25:12.611 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.612 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.612 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.612 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:12.612 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.612 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:25:12.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.613 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:12.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:12.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:12.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:25:12.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:25:12.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:25:12.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:25:12.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:25:12.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:25:12.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:25:12.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:25:12.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:25:12.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:25:12.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:25:12.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:25:12.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:12.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:25:12.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:25:12.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:12.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:25:12.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:25:12.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:25:12.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:25:12.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:25:12.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:25:12.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:25:12.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:25:12.621 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.621 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.622 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.622 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:12.622 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:12.622 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.87875097, 2020-11-12T17:25:12.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:25:12.623 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.623 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.623 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.623 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:12.623 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.623 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:25:12.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.623 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:12.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:12.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:12.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:25:12.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:25:12.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:25:12.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:25:12.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:25:12.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:25:12.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:25:12.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:25:12.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:25:12.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:25:12.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:25:12.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:25:12.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:12.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:25:12.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:25:12.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:12.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:25:12.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:25:12.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:25:12.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:25:12.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:25:12.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:25:12.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:25:12.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:25:12.632 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.632 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.633 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.633 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:12.633 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:12.633 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.874587736, 2020-11-12T17:25:12.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:25:12.634 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.634 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:12.634 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:12.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:12.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:25:12.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:25:12.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:25:12.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:25:12.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:25:12.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:25:12.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:25:12.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:25:12.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:25:12.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:25:12.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:25:12.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:25:12.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:25:12.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:25:12.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:25:12.640 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.640 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.640 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.644 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:12.644 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:12.644 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.873270901, 2020-11-12T17:25:12.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:25:12.645 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.645 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:12.645 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:12.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:12.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:12.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:25:12.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:25:12.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:25:12.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:25:12.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:25:12.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:25:12.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:25:12.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:25:12.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:25:12.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:25:12.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:25:12.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:25:12.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:25:12.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:25:12.651 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.651 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.651 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.652 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:25:12.652 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:25:12.652 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 118.010951269, 2020-11-12T17:25:12.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:25:12.652 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.652 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.652 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:25:12.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:25:12.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:25:12.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:25:12.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:25:12.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:25:12.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:25:12.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:25:12.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:25:12.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:25:12.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:25:12.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:25:12.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:25:12.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:25:12.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:25:12.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:25:12.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:25:12.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:25:12.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:25:12.659 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.659 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.659 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.660 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:25:12.660 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:12.660 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 113.683149301, 2020-11-12T17:25:12.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:25:12.660 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.661 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:12.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.661 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:25:12.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.661 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:12.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:12.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:25:12.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:25:12.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:25:12.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:25:12.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:25:12.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:25:12.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:25:12.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:25:12.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:25:12.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:25:12.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:25:12.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:25:12.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:25:12.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:12.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:25:12.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:25:12.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:12.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:25:12.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:25:12.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:25:12.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:25:12.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:25:12.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:25:12.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:25:12.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:25:12.670 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.670 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.670 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.671 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:25:12.671 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:12.671 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 113.67590559200001, 2020-11-12T17:25:12.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:25:12.671 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.671 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:12.671 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:12.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:12.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:12.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:25:12.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:25:12.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:25:12.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:25:12.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:25:12.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:25:12.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:25:12.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:25:12.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:25:12.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:25:12.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:25:12.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:25:12.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:25:12.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:25:12.677 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.677 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.678 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.678 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:25:12.678 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:25:12.678 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.513557888999998, 2020-11-12T17:25:12.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:25:12.679 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.679 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.679 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.679 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:12.679 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.679 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:25:12.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.679 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:25:12.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:25:12.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:12.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:25:12.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:25:12.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:25:12.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:25:12.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:25:12.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:25:12.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:25:12.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:25:12.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:25:12.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:25:12.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:25:12.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:25:12.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:12.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:25:12.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:25:12.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:12.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:25:12.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:25:12.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:25:12.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:25:12.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:25:12.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:25:12.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:25:12.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:25:12.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.688 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.689 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:12.689 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:12.689 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 78.572730132000004, 2020-11-12T17:25:12.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:25:12.689 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.689 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.690 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.690 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:12.690 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:12.690 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:25:12.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.690 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:12.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:12.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:12.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:25:12.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:25:12.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:25:12.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:25:12.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:25:12.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:25:12.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:25:12.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:25:12.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:25:12.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:25:12.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:25:12.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:25:12.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:12.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:25:12.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:25:12.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:12.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:25:12.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:25:12.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:25:12.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:25:12.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:25:12.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:25:12.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:25:12.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:25:12.699 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.699 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.699 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.699 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:25:12.700 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:12.700 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 78.565071322999998, 2020-11-12T17:25:12.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:25:12.700 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.700 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:12.700 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:12.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:12.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:25:12.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:25:12.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:25:12.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:25:12.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:25:12.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:25:12.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:25:12.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:25:12.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:25:12.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:25:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:25:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:25:12.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:25:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:25:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:25:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.706 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:50240 3.1 e55/20 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head v 55'3224, mlcod=55'3218)", 2020-11-12T17:25:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:25:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 60.198421777999997, 2020-11-12T17:25:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149, 2020-11-12T17:25:12.707 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:25:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:25:12.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:12.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367024+0000", 2020-11-12T17:25:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9963000000000002e-05 2020-11-12T17:25:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367084+0000", 2020-11-12T17:25:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23018651500000001 2020-11-12T17:25:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597271+0000", 2020-11-12T17:25:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2030000000000003e-06 2020-11-12T17:25:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597278+0000", 2020-11-12T17:25:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3430000000000002e-05 2020-11-12T17:25:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597331+0000", 2020-11-12T17:25:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2829000000000001e-05 2020-11-12T17:25:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597354+0000", 2020-11-12T17:25:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064125579999999996 2020-11-12T17:25:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603767+0000", 2020-11-12T17:25:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2398999999999997e-05 2020-11-12T17:25:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603829+0000", 2020-11-12T17:25:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149 2020-11-12T17:25:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.714 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(osd.4.0:8091 3.9 e56/35 ondisk, result = 0)", 2020-11-12T17:25:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:25:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.185642291999997, 2020-11-12T17:25:12.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999, 2020-11-12T17:25:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:25:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:25:12.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:12.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379795+0000", 2020-11-12T17:25:12.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8462999999999998e-05 2020-11-12T17:25:12.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379864+0000", 2020-11-12T17:25:12.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23719935 2020-11-12T17:25:12.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617063+0000", 2020-11-12T17:25:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5229999999999998e-06 2020-11-12T17:25:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617071+0000", 2020-11-12T17:25:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0618999999999995e-05 2020-11-12T17:25:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617151+0000", 2020-11-12T17:25:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4123e-05 2020-11-12T17:25:12.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617165+0000", 2020-11-12T17:25:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4392e-05 2020-11-12T17:25:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617260+0000", 2020-11-12T17:25:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999 2020-11-12T17:25:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.722 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.679816217999999, 2020-11-12T17:25:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:25:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:12.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:25:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:25:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:25:12.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:25:12.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:25:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:25:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:25:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:25:12.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:25:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:25:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:25:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:25:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:25:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:25:12.729 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:304 4.b e71/69 4:d3839b57:::benchmark_data_smithi036_18856_object37:head v 71'32, mlcod=71'28)", 2020-11-12T17:25:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:12.730 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.421160175000001, 2020-11-12T17:25:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998, 2020-11-12T17:25:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:12.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9998965 2020-11-12T17:25:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144200+0000", 2020-11-12T17:25:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166613 2020-11-12T17:25:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144366+0000", 2020-11-12T17:25:12.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.282020573 2020-11-12T17:25:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426387+0000", 2020-11-12T17:25:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1779999999999996e-06 2020-11-12T17:25:12.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426391+0000", 2020-11-12T17:25:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7170999999999999e-05 2020-11-12T17:25:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426448+0000", 2020-11-12T17:25:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9868e-05 2020-11-12T17:25:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426468+0000", 2020-11-12T17:25:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036033319999999999 2020-11-12T17:25:12.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430072+0000", 2020-11-12T17:25:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6007000000000001e-05 2020-11-12T17:25:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430128+0000", 2020-11-12T17:25:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998 2020-11-12T17:25:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.738 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:12912 4.9 4:91c4a289:::benchmark_data_smithi036_18856_object1613:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.896117+0000", 2020-11-12T17:25:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 9.6693467579999997, 2020-11-12T17:25:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25992880699999998, 2020-11-12T17:25:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:12.739 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12912 2020-11-12T17:25:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896117+0000", 2020-11-12T17:25:12.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896117+0000", 2020-11-12T17:25:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896083+0000", 2020-11-12T17:25:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5064999999999999e-05 2020-11-12T17:25:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896178+0000", 2020-11-12T17:25:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0964e-05 2020-11-12T17:25:12.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896189+0000", 2020-11-12T17:25:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.699e-06 2020-11-12T17:25:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896195+0000", 2020-11-12T17:25:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036739390000000002 2020-11-12T17:25:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.899869+0000", 2020-11-12T17:25:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5804999999999997e-05 2020-11-12T17:25:12.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.899944+0000", 2020-11-12T17:25:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110425 2020-11-12T17:25:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:12.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.900055+0000", 2020-11-12T17:25:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050734650000000001 2020-11-12T17:25:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.905128+0000", 2020-11-12T17:25:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25056899199999999 2020-11-12T17:25:12.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:03.155697+0000", 2020-11-12T17:25:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000207414 2020-11-12T17:25:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:03.155905+0000", 2020-11-12T17:25:12.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014098 2020-11-12T17:25:12.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:03.156046+0000", 2020-11-12T17:25:12.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25992880699999998 2020-11-12T17:25:12.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.749 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:25:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.65454695100000004, 2020-11-12T17:25:12.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:25:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:12.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:25:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:25:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:25:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:25:12.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:25:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:25:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:25:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:25:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:25:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:25:12.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:25:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:25:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:25:12.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:25:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:25:12.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:25:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:25:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.759 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.759 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.759 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:12.760 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:12.758+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:12.761 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:12.862 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:12.856+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:12.929 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 21 16 22425 22409 8.33583 7.10156 0.0157351 0.014985 2020-11-12T17:25:12.935 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:12.935 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:12.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.935 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:22418 4.2 4:452dbd8b:::benchmark_data_smithi036_18856_object2802:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e79)", 2020-11-12T17:25:12.935 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:12.925892+0000", 2020-11-12T17:25:12.936 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0082111059999999993, 2020-11-12T17:25:12.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082417010000000006, 2020-11-12T17:25:12.936 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.936 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 22418 2020-11-12T17:25:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.925892+0000", 2020-11-12T17:25:12.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.925892+0000", 2020-11-12T17:25:12.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:25:12.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.925864+0000", 2020-11-12T17:25:12.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6798999999999993e-05 2020-11-12T17:25:12.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.925951+0000", 2020-11-12T17:25:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2486e-05 2020-11-12T17:25:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.925964+0000", 2020-11-12T17:25:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4559999999999997e-06 2020-11-12T17:25:12.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.925970+0000", 2020-11-12T17:25:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011860849999999999 2020-11-12T17:25:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.927156+0000", 2020-11-12T17:25:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3530999999999999e-05 2020-11-12T17:25:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.927220+0000", 2020-11-12T17:25:12.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000177095 2020-11-12T17:25:12.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.927397+0000", 2020-11-12T17:25:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015049569999999999 2020-11-12T17:25:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.948 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:22419 4.2 4:452dbd8b:::benchmark_data_smithi036_18856_object2802:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e79)", 2020-11-12T17:25:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:12.926066+0000", 2020-11-12T17:25:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0080369840000000005, 2020-11-12T17:25:12.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081993499999999993, 2020-11-12T17:25:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 22419 2020-11-12T17:25:12.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.926066+0000", 2020-11-12T17:25:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.926066+0000", 2020-11-12T17:25:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:25:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.926036+0000", 2020-11-12T17:25:12.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7523999999999998e-05 2020-11-12T17:25:12.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.926124+0000", 2020-11-12T17:25:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2164000000000001e-05 2020-11-12T17:25:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.926136+0000", 2020-11-12T17:25:12.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.596e-06 2020-11-12T17:25:12.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.926142+0000", 2020-11-12T17:25:12.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041626839999999998 2020-11-12T17:25:12.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.930305+0000", 2020-11-12T17:25:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5608999999999999e-05 2020-11-12T17:25:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.930401+0000", 2020-11-12T17:25:12.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016394900000000001 2020-11-12T17:25:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.930565+0000", 2020-11-12T17:25:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044987079999999997 2020-11-12T17:25:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.969 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.970 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:22420 4.2 4:452dbd8b:::benchmark_data_smithi036_18856_object2802:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e79)", 2020-11-12T17:25:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:12.928030+0000", 2020-11-12T17:25:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0060724120000000001, 2020-11-12T17:25:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063279019999999998, 2020-11-12T17:25:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.972 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:12.973 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 22420 2020-11-12T17:25:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.979 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928030+0000", 2020-11-12T17:25:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928030+0000", 2020-11-12T17:25:12.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:12.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928014+0000", 2020-11-12T17:25:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1171999999999997e-05 2020-11-12T17:25:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928065+0000", 2020-11-12T17:25:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7730000000000005e-06 2020-11-12T17:25:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928073+0000", 2020-11-12T17:25:12.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9620000000000001e-06 2020-11-12T17:25:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928078+0000", 2020-11-12T17:25:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047394580000000002 2020-11-12T17:25:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.932818+0000", 2020-11-12T17:25:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4424000000000003e-05 2020-11-12T17:25:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:12.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.932912+0000", 2020-11-12T17:25:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016066600000000001 2020-11-12T17:25:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.933073+0000", 2020-11-12T17:25:12.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005042497 2020-11-12T17:25:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:22421 4.2 4.d1bdb4a2 (undecoded) ondisk+write+known_if_redirected e79)", 2020-11-12T17:25:12.987 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:12.928161+0000", 2020-11-12T17:25:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0059416030000000002, 2020-11-12T17:25:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062814129999999996, 2020-11-12T17:25:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:12.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 22421 2020-11-12T17:25:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928161+0000", 2020-11-12T17:25:12.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928161+0000", 2020-11-12T17:25:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:25:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928132+0000", 2020-11-12T17:25:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3312000000000005e-05 2020-11-12T17:25:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928215+0000", 2020-11-12T17:25:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1525000000000001e-05 2020-11-12T17:25:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928227+0000", 2020-11-12T17:25:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7649999999999999e-06 2020-11-12T17:25:12.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.928233+0000", 2020-11-12T17:25:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1246000000000002e-05 2020-11-12T17:25:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:12.993 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:22422 4.2 4.d1bdb4a2 (undecoded) ondisk+write+known_if_redirected e79)", 2020-11-12T17:25:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:12.929286+0000", 2020-11-12T17:25:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0048167110000000004, 2020-11-12T17:25:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052228429999999996, 2020-11-12T17:25:12.994 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 22422 2020-11-12T17:25:12.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929286+0000", 2020-11-12T17:25:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929286+0000", 2020-11-12T17:25:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:12.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929269+0000", 2020-11-12T17:25:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8733000000000002e-05 2020-11-12T17:25:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929318+0000", 2020-11-12T17:25:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.038e-06 2020-11-12T17:25:12.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929326+0000", 2020-11-12T17:25:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8029999999999996e-06 2020-11-12T17:25:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:12.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929331+0000", 2020-11-12T17:25:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4558999999999998e-05 2020-11-12T17:25:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:13.000 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:22423 4.2 4.d1bdb4a2 (undecoded) ondisk+write+known_if_redirected e79)", 2020-11-12T17:25:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:12.929544+0000", 2020-11-12T17:25:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0045590989999999996, 2020-11-12T17:25:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050276219999999998, 2020-11-12T17:25:13.001 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 22423 2020-11-12T17:25:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.002 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929544+0000", 2020-11-12T17:25:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929544+0000", 2020-11-12T17:25:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:25:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:13.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929529+0000", 2020-11-12T17:25:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4239000000000001e-05 2020-11-12T17:25:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929573+0000", 2020-11-12T17:25:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1680000000000001e-06 2020-11-12T17:25:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929579+0000", 2020-11-12T17:25:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.506e-06 2020-11-12T17:25:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.929583+0000", 2020-11-12T17:25:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8887000000000002e-05 2020-11-12T17:25:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:22424 4.2 4.d1bdb4a2 (undecoded) ondisk+write+known_if_redirected e79)", 2020-11-12T17:25:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:12.930201+0000", 2020-11-12T17:25:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.003901505, 2020-11-12T17:25:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044362680000000002, 2020-11-12T17:25:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:13.008 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 22424 2020-11-12T17:25:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:13.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.930201+0000", 2020-11-12T17:25:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:13.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.930201+0000", 2020-11-12T17:25:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:25:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.930173+0000", 2020-11-12T17:25:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4173999999999997e-05 2020-11-12T17:25:13.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.930257+0000", 2020-11-12T17:25:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1429e-05 2020-11-12T17:25:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:13.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.930269+0000", 2020-11-12T17:25:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8019999999999997e-06 2020-11-12T17:25:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.930275+0000", 2020-11-12T17:25:13.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3304000000000002e-05 2020-11-12T17:25:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:22418 4.2 e79/69 ondisk, result = 0)", 2020-11-12T17:25:13.014 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:12.933048+0000", 2020-11-12T17:25:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0010549139999999999, 2020-11-12T17:25:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001640538, 2020-11-12T17:25:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:13.015 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.933048+0000", 2020-11-12T17:25:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.933048+0000", 2020-11-12T17:25:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.933024+0000", 2020-11-12T17:25:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2460999999999997e-05 2020-11-12T17:25:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.933086+0000", 2020-11-12T17:25:13.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0096999999999997e-05 2020-11-12T17:25:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.933147+0000", 2020-11-12T17:25:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3219999999999998e-06 2020-11-12T17:25:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:13.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.933153+0000", 2020-11-12T17:25:13.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010398359999999999 2020-11-12T17:25:13.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:13.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.934193+0000", 2020-11-12T17:25:13.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:25:13.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:13.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.934201+0000", 2020-11-12T17:25:13.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048793300000000002 2020-11-12T17:25:13.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:13.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.934689+0000", 2020-11-12T17:25:13.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001640538 2020-11-12T17:25:13.023 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.023 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:13.023 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.023 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:22419 4.2 e79/69)", 2020-11-12T17:25:13.023 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:12.934450+0000", 2020-11-12T17:25:13.023 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4294967295.9996529, 2020-11-12T17:25:13.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000331157, 2020-11-12T17:25:13.024 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:13.024 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:13.024 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:13.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:13.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.934450+0000", 2020-11-12T17:25:13.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:13.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:13.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.934450+0000", 2020-11-12T17:25:13.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:13.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:13.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.934415+0000", 2020-11-12T17:25:13.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8017999999999997e-05 2020-11-12T17:25:13.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:13.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.934493+0000", 2020-11-12T17:25:13.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2247999999999998e-05 2020-11-12T17:25:13.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:13.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.934546+0000", 2020-11-12T17:25:13.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5180000000000001e-06 2020-11-12T17:25:13.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:13.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:13.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:13.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.934552+0000", 2020-11-12T17:25:13.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101895 2020-11-12T17:25:13.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.029 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:13.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.030 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:13.030 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:13.030 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 9 2020-11-12T17:25:13.031 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:13.031 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:13.033 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:13.034 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:13.030+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:13.133 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:13.128+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:13.197 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:13.203 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:13.205 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:13.216 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:13.229 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:13.257 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:13.260 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:13.258+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:13.288 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:13.320 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:13.335 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:13.328+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:13.346 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:13.347 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:13.353 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:13.359 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:13.371 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:13.364+0000 7f658835a700 -1 osd.0 79 handle_osd_map injecting map crc failure 2020-11-12T17:25:13.381 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:25:13.392 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:13.392 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:13.392 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:13.392 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:13.392 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:25:13.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:13.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:13.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:13.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:13.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:13.394 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:13.395 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:13.440 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:13.436+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:13.532 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:13.533 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:13.538 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:13.532+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:13.543 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:13.639 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:13.634+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:13.678 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:13.678 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:13.689 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:13.777 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:13.774+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:13.840 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:13.836+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:13.863 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:13.863 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:13.875 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:13.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 22 16 23603 23587 8.37522 9.20312 0.124573 0.0148958 2020-11-12T17:25:13.942 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:13.936+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:14.041 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:14.041 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:14.044 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:14.040+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:14.052 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:14.145 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:14.142+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:14.187 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:14.188 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:14.201 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:14.246 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:14.240+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:14.348 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:14.340+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:14.372 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:14.373 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:14.385 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:14.448 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:14.446+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:14.502 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:14.502 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:14.513 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:14.549 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:14.546+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:14.634 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:14.635 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:14.647 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:14.650 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:14.646+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:14.751 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:14.744+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:14.760 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:14.761 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:14.771 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:14.854 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:14.846+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:14.929 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 23 16 24811 24795 8.42137 9.4375 0.0363558 0.0148301 2020-11-12T17:25:14.934 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:14.935 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:14.947 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:25:14.953 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:14.950+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:15.054 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:15.050+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:15.070 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:15.071 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:15.080 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:25:15.154 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:15.148+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:15.210 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:15.211 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:15.221 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:15.256 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:15.250+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:15.357 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:15.354+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:15.378 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:15.379 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:15.389 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:15.396 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:25:15.398 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:15.458 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:15.454+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:15.537 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:15.537 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:15.552 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:15.558 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:15.554+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:15.627 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:15.659 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:15.652+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:15.662 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:15.677 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:15.678 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:15.689 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:15.690 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:15.716 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:15.747 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:15.761 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:15.756+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:15.777 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:15.804 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:15.804 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:15.804 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:15.805 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:15.805 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:25:15.805 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:15.805 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:15.805 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:15.805 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:15.805 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:15.806 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:15.807 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:15.826 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:15.826 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:15.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.827 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:25712 4.d 4:bc8494f5:::benchmark_data_smithi036_18856_object3213:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e80)", 2020-11-12T17:25:15.827 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:15.796422+0000", 2020-11-12T17:25:15.827 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.029389829999999999, 2020-11-12T17:25:15.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.029421441, 2020-11-12T17:25:15.827 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:15.827 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:15.827 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:15.828 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:15.828 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:15.828 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25712 2020-11-12T17:25:15.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.828 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:15.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:15.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.796422+0000", 2020-11-12T17:25:15.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:15.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:15.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.796422+0000", 2020-11-12T17:25:15.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:15.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:15.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.796403+0000", 2020-11-12T17:25:15.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9793000000000002e-05 2020-11-12T17:25:15.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:15.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.796463+0000", 2020-11-12T17:25:15.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7469999999999999e-06 2020-11-12T17:25:15.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:15.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.796469+0000", 2020-11-12T17:25:15.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0123999999999999e-05 2020-11-12T17:25:15.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:15.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.796489+0000", 2020-11-12T17:25:15.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032148789999999999 2020-11-12T17:25:15.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:15.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.799704+0000", 2020-11-12T17:25:15.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011222000000000001 2020-11-12T17:25:15.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:15.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.799817+0000", 2020-11-12T17:25:15.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018427499999999999 2020-11-12T17:25:15.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:15.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.800001+0000", 2020-11-12T17:25:15.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005136219 2020-11-12T17:25:15.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:15.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.805137+0000", 2020-11-12T17:25:15.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0087149259999999996 2020-11-12T17:25:15.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:15.839 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:15.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:15.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.840 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:25737 4.5 e80/69 4:ae3e1f72:::benchmark_data_smithi036_18856_object3217:head v 80'1793, mlcod=80'1791)", 2020-11-12T17:25:15.841 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:15.824035+0000", 2020-11-12T17:25:15.841 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0017772720000000001, 2020-11-12T17:25:15.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001911266, 2020-11-12T17:25:15.841 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:15.842 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:15.842 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:15.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:15.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.824035+0000", 2020-11-12T17:25:15.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:15.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:15.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.824035+0000", 2020-11-12T17:25:15.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:15.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:15.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.824008+0000", 2020-11-12T17:25:15.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7968999999999998e-05 2020-11-12T17:25:15.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:15.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.824096+0000", 2020-11-12T17:25:15.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5267999999999998e-05 2020-11-12T17:25:15.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:15.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.824171+0000", 2020-11-12T17:25:15.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5159999999999997e-06 2020-11-12T17:25:15.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:15.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.824179+0000", 2020-11-12T17:25:15.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7849000000000001e-05 2020-11-12T17:25:15.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:15.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.824237+0000", 2020-11-12T17:25:15.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4961e-05 2020-11-12T17:25:15.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:15.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:15.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:15.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:15.824261+0000", 2020-11-12T17:25:15.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000226772 2020-11-12T17:25:15.847 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:15.848 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:15.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:15.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:15.848 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:15.848 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:25:15.848 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:15.849 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:15.896 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:15.894+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:15.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 24 16 25847 25831 8.40769 8.09375 0.00745758 0.0148457 2020-11-12T17:25:15.964 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:15.960+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:15.979 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:15.979 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:15.979 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:15.980 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:15.980 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:15.991 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:16.008 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:25:16.064 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:16.060+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:16.156 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:16.152+0000 7f42fe1ab700 -1 osd.2 80 handle_osd_map injecting map crc failure 2020-11-12T17:25:16.161 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:16.161 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:16.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:16.162 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:16.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.163 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:16.163 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:16.163 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.400536071, 2020-11-12T17:25:16.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:25:16.163 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.163 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.163 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.164 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.164 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.164 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:25:16.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.164 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:16.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:16.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:25:16.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:25:16.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:25:16.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:25:16.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:25:16.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:25:16.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:25:16.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:25:16.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:25:16.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:25:16.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:25:16.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:25:16.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:25:16.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:16.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:25:16.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:25:16.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:25:16.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:25:16.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:25:16.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:25:16.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:25:16.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:25:16.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:25:16.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:25:16.176 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.176 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.176 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.177 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:25:16.177 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:16.177 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.39373721999999, 2020-11-12T17:25:16.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:25:16.177 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.177 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:16.177 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:16.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:16.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:16.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:25:16.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:25:16.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:25:16.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:25:16.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:25:16.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:25:16.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:25:16.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:25:16.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:25:16.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:25:16.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:25:16.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:25:16.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:25:16.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:25:16.184 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.184 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.184 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.184 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:1576 3.9 3:9ddd6d46:::benchmark_data_smithi036_14212_object196:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e23)", 2020-11-12T17:25:16.185 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:25:16.186 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 130.15047844399999, 2020-11-12T17:25:16.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137, 2020-11-12T17:25:16.187 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.187 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.187 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.187 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.187 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.187 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 1576 2020-11-12T17:25:16.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.188 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:25:16.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008888+0000", 2020-11-12T17:25:16.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:16.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008838+0000", 2020-11-12T17:25:16.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014991700000000001 2020-11-12T17:25:16.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.008988+0000", 2020-11-12T17:25:16.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.876e-05 2020-11-12T17:25:16.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009007+0000", 2020-11-12T17:25:16.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6260000000000003e-06 2020-11-12T17:25:16.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.009015+0000", 2020-11-12T17:25:16.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004284309 2020-11-12T17:25:16.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013299+0000", 2020-11-12T17:25:16.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000188827 2020-11-12T17:25:16.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013488+0000", 2020-11-12T17:25:16.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029998500000000001 2020-11-12T17:25:16.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:16.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.013788+0000", 2020-11-12T17:25:16.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013092290000000001 2020-11-12T17:25:16.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.015097+0000", 2020-11-12T17:25:16.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23966480900000001 2020-11-12T17:25:16.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254762+0000", 2020-11-12T17:25:16.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8551000000000001e-05 2020-11-12T17:25:16.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254840+0000", 2020-11-12T17:25:16.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8664000000000004e-05 2020-11-12T17:25:16.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254919+0000", 2020-11-12T17:25:16.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.24603137 2020-11-12T17:25:16.197 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.197 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.197 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.197 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:1576 3.9 e23/20 ondisk, result = 0)", 2020-11-12T17:25:16.197 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:25:16.197 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 130.14326326299999, 2020-11-12T17:25:16.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001, 2020-11-12T17:25:16.198 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.198 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:16.198 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:25:16.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016103+0000", 2020-11-12T17:25:16.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:25:16.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016090+0000", 2020-11-12T17:25:16.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5323e-05 2020-11-12T17:25:16.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.016135+0000", 2020-11-12T17:25:16.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23802548200000001 2020-11-12T17:25:16.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254160+0000", 2020-11-12T17:25:16.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4588e-05 2020-11-12T17:25:16.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254175+0000", 2020-11-12T17:25:16.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00056229700000000001 2020-11-12T17:25:16.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254737+0000", 2020-11-12T17:25:16.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2806000000000001e-05 2020-11-12T17:25:16.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254750+0000", 2020-11-12T17:25:16.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183217 2020-11-12T17:25:16.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:06.254933+0000", 2020-11-12T17:25:16.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23883033400000001 2020-11-12T17:25:16.204 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.204 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.204 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.205 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:16.205 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:16.205 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.47281837200001, 2020-11-12T17:25:16.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:25:16.205 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.205 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.205 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.205 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.206 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.206 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:25:16.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.206 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:16.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:16.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:16.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:25:16.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:25:16.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:25:16.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:25:16.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:25:16.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:25:16.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:25:16.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:25:16.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:25:16.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:25:16.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:25:16.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:25:16.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:16.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:25:16.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:25:16.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:25:16.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:25:16.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:25:16.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:25:16.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:25:16.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:25:16.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:25:16.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:25:16.215 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.215 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.215 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.216 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:16.216 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:16.216 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.47265346899999, 2020-11-12T17:25:16.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:25:16.216 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.216 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.216 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.216 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.217 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.217 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:25:16.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.217 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:16.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:16.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:16.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:25:16.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:25:16.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:25:16.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:25:16.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:25:16.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:25:16.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:25:16.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:25:16.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:25:16.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:25:16.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:25:16.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:25:16.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:16.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:25:16.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:25:16.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:25:16.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:25:16.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:25:16.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:25:16.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:25:16.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:25:16.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:25:16.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:25:16.226 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.226 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.226 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.226 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:16.226 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:16.226 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.468490235, 2020-11-12T17:25:16.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:25:16.227 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.227 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:16.227 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:16.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:16.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:25:16.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:25:16.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:25:16.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:25:16.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:25:16.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:25:16.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:25:16.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:25:16.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:25:16.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:25:16.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:25:16.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:25:16.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:25:16.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:25:16.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:25:16.233 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.233 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.233 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.233 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:16.234 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:16.234 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.46717339999999, 2020-11-12T17:25:16.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:25:16.234 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.234 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:16.234 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:16.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:16.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:16.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:25:16.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:25:16.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:25:16.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:25:16.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:25:16.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:25:16.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:25:16.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:25:16.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:25:16.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:25:16.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:25:16.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:25:16.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:25:16.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:25:16.240 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.240 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.240 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.241 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:10000 3.1 e26/20 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head v 26'672, mlcod=26'663)", 2020-11-12T17:25:16.241 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:25:16.241 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.604853768, 2020-11-12T17:25:16.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997, 2020-11-12T17:25:16.241 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.241 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.242 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:25:16.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554512+0000", 2020-11-12T17:25:16.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:25:16.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554479+0000", 2020-11-12T17:25:16.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114431 2020-11-12T17:25:16.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.554593+0000", 2020-11-12T17:25:16.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25291531699999997 2020-11-12T17:25:16.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807509+0000", 2020-11-12T17:25:16.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3295999999999999e-05 2020-11-12T17:25:16.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807522+0000", 2020-11-12T17:25:16.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022022099999999999 2020-11-12T17:25:16.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807742+0000", 2020-11-12T17:25:16.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2039999999999995e-05 2020-11-12T17:25:16.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.807814+0000", 2020-11-12T17:25:16.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020987089999999998 2020-11-12T17:25:16.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.809913+0000", 2020-11-12T17:25:16.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8536999999999995e-05 2020-11-12T17:25:16.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.810011+0000", 2020-11-12T17:25:16.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25549895099999997 2020-11-12T17:25:16.248 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.248 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.248 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.249 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:25:16.249 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:16.249 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.2770518, 2020-11-12T17:25:16.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:25:16.249 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.249 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.250 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.250 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.250 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.250 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:25:16.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.250 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:16.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:16.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:25:16.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:25:16.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:25:16.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:25:16.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:25:16.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:25:16.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:25:16.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:25:16.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:25:16.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:25:16.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:25:16.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:25:16.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:25:16.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:16.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:25:16.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:25:16.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:25:16.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:25:16.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:25:16.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:25:16.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:25:16.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:25:16.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:25:16.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:25:16.259 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.259 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.259 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.259 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:25:16.260 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:16.260 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.269808091, 2020-11-12T17:25:16.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:25:16.260 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.260 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:16.260 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:16.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:16.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:16.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:25:16.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:25:16.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:25:16.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:25:16.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:25:16.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:25:16.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:25:16.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:25:16.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:25:16.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:25:16.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:25:16.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:25:16.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:25:16.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:25:16.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.267 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.267 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:20352 3.3 3:c533bd5c:::benchmark_data_smithi036_14212_object2543:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e42)", 2020-11-12T17:25:16.267 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:25:16.267 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.107460388000007, 2020-11-12T17:25:16.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999, 2020-11-12T17:25:16.268 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.268 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.268 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.268 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.268 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.268 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 20352 2020-11-12T17:25:16.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.269 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:25:16.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051906+0000", 2020-11-12T17:25:16.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:16.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051885+0000", 2020-11-12T17:25:16.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6161999999999994e-05 2020-11-12T17:25:16.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051952+0000", 2020-11-12T17:25:16.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4639999999999995e-06 2020-11-12T17:25:16.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051961+0000", 2020-11-12T17:25:16.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7290000000000002e-06 2020-11-12T17:25:16.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.051965+0000", 2020-11-12T17:25:16.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016930039999999999 2020-11-12T17:25:16.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053658+0000", 2020-11-12T17:25:16.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4564000000000001e-05 2020-11-12T17:25:16.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053722+0000", 2020-11-12T17:25:16.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011075599999999999 2020-11-12T17:25:16.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:16.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.053833+0000", 2020-11-12T17:25:16.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043395689999999997 2020-11-12T17:25:16.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.058173+0000", 2020-11-12T17:25:16.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23177740399999999 2020-11-12T17:25:16.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.289950+0000", 2020-11-12T17:25:16.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0587000000000006e-05 2020-11-12T17:25:16.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290031+0000", 2020-11-12T17:25:16.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5424999999999999e-05 2020-11-12T17:25:16.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.290086+0000", 2020-11-12T17:25:16.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23818034799999999 2020-11-12T17:25:16.277 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.277 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.277 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.278 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:16.278 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:16.278 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 82.166632630999999, 2020-11-12T17:25:16.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:25:16.278 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.279 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.279 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.279 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.279 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.279 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:25:16.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.279 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:16.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:16.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:16.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:25:16.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:25:16.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:25:16.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:25:16.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:25:16.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:25:16.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:25:16.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:25:16.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:25:16.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:25:16.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:25:16.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:25:16.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:16.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:25:16.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:25:16.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:25:16.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:25:16.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:25:16.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:25:16.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:25:16.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:25:16.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:25:16.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:25:16.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.288 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.288 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:25:16.289 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:16.289 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 82.158973821999993, 2020-11-12T17:25:16.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:25:16.289 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.289 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:16.289 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:16.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:16.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:25:16.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:25:16.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:25:16.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:25:16.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:25:16.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:25:16.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:25:16.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:25:16.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:25:16.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:25:16.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:25:16.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:25:16.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:25:16.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:25:16.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:25:16.295 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.296 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.296 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.296 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:50240 3.1 e55/20 3:8d46c60c:::benchmark_data_smithi036_14212_object6279:head v 55'3224, mlcod=55'3218)", 2020-11-12T17:25:16.296 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:25:16.296 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.792324276999999, 2020-11-12T17:25:16.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149, 2020-11-12T17:25:16.297 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.297 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.297 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:25:16.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367042+0000", 2020-11-12T17:25:16.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:16.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367024+0000", 2020-11-12T17:25:16.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9963000000000002e-05 2020-11-12T17:25:16.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.367084+0000", 2020-11-12T17:25:16.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23018651500000001 2020-11-12T17:25:16.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597271+0000", 2020-11-12T17:25:16.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2030000000000003e-06 2020-11-12T17:25:16.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597278+0000", 2020-11-12T17:25:16.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3430000000000002e-05 2020-11-12T17:25:16.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597331+0000", 2020-11-12T17:25:16.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2829000000000001e-05 2020-11-12T17:25:16.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.597354+0000", 2020-11-12T17:25:16.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064125579999999996 2020-11-12T17:25:16.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603767+0000", 2020-11-12T17:25:16.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2398999999999997e-05 2020-11-12T17:25:16.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:12.603829+0000", 2020-11-12T17:25:16.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.236787149 2020-11-12T17:25:16.303 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.304 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.304 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.304 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(osd.4.0:8091 3.9 e56/35 ondisk, result = 0)", 2020-11-12T17:25:16.304 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:25:16.304 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 53.779544790999999, 2020-11-12T17:25:16.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999, 2020-11-12T17:25:16.305 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.305 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:16.305 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:25:16.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379821+0000", 2020-11-12T17:25:16.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:16.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379795+0000", 2020-11-12T17:25:16.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8462999999999998e-05 2020-11-12T17:25:16.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.379864+0000", 2020-11-12T17:25:16.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23719935 2020-11-12T17:25:16.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617063+0000", 2020-11-12T17:25:16.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5229999999999998e-06 2020-11-12T17:25:16.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617071+0000", 2020-11-12T17:25:16.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0618999999999995e-05 2020-11-12T17:25:16.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617151+0000", 2020-11-12T17:25:16.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4123e-05 2020-11-12T17:25:16.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617165+0000", 2020-11-12T17:25:16.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4392e-05 2020-11-12T17:25:16.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.617260+0000", 2020-11-12T17:25:16.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.23743824899999999 2020-11-12T17:25:16.311 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.311 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.311 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.311 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:16.312 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:16.312 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.273718717000001, 2020-11-12T17:25:16.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:25:16.312 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.312 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:16.312 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:16.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:16.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:16.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:25:16.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:25:16.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:25:16.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:25:16.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:25:16.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:25:16.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:25:16.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:25:16.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:25:16.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:25:16.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:25:16.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:25:16.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:25:16.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:25:16.318 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.318 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.318 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.319 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:304 4.b e71/69 4:d3839b57:::benchmark_data_smithi036_18856_object37:head v 71'32, mlcod=71'28)", 2020-11-12T17:25:16.319 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:16.319 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 24.015062673999999, 2020-11-12T17:25:16.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998, 2020-11-12T17:25:16.319 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.319 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.320 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:16.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:16.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9998965 2020-11-12T17:25:16.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144200+0000", 2020-11-12T17:25:16.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166613 2020-11-12T17:25:16.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144366+0000", 2020-11-12T17:25:16.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.282020573 2020-11-12T17:25:16.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426387+0000", 2020-11-12T17:25:16.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1779999999999996e-06 2020-11-12T17:25:16.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426391+0000", 2020-11-12T17:25:16.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7170999999999999e-05 2020-11-12T17:25:16.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426448+0000", 2020-11-12T17:25:16.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9868e-05 2020-11-12T17:25:16.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426468+0000", 2020-11-12T17:25:16.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036033319999999999 2020-11-12T17:25:16.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430072+0000", 2020-11-12T17:25:16.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6007000000000001e-05 2020-11-12T17:25:16.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430128+0000", 2020-11-12T17:25:16.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998 2020-11-12T17:25:16.327 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.327 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.327 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.327 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:12912 4.9 4:91c4a289:::benchmark_data_smithi036_18856_object1613:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:16.327 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.896117+0000", 2020-11-12T17:25:16.327 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.263249257, 2020-11-12T17:25:16.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25992880699999998, 2020-11-12T17:25:16.328 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.328 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.328 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.328 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:16.328 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:16.328 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12912 2020-11-12T17:25:16.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.329 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896117+0000", 2020-11-12T17:25:16.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896117+0000", 2020-11-12T17:25:16.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:16.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896083+0000", 2020-11-12T17:25:16.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5064999999999999e-05 2020-11-12T17:25:16.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896178+0000", 2020-11-12T17:25:16.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0964e-05 2020-11-12T17:25:16.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896189+0000", 2020-11-12T17:25:16.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.699e-06 2020-11-12T17:25:16.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.896195+0000", 2020-11-12T17:25:16.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036739390000000002 2020-11-12T17:25:16.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.899869+0000", 2020-11-12T17:25:16.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5804999999999997e-05 2020-11-12T17:25:16.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.899944+0000", 2020-11-12T17:25:16.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110425 2020-11-12T17:25:16.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:16.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.900055+0000", 2020-11-12T17:25:16.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050734650000000001 2020-11-12T17:25:16.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.905128+0000", 2020-11-12T17:25:16.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25056899199999999 2020-11-12T17:25:16.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:03.155697+0000", 2020-11-12T17:25:16.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000207414 2020-11-12T17:25:16.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:03.155905+0000", 2020-11-12T17:25:16.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014098 2020-11-12T17:25:16.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:03.156046+0000", 2020-11-12T17:25:16.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25992880699999998 2020-11-12T17:25:16.350 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.350 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.350 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.351 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:25:16.351 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:16.352 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.2484494499999998, 2020-11-12T17:25:16.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:25:16.352 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.353 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.353 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:16.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:16.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:25:16.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:25:16.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:25:16.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:25:16.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:25:16.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:25:16.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:25:16.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:25:16.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:25:16.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:25:16.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:25:16.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:25:16.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:25:16.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:25:16.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:25:16.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:25:16.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:25:16.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.368 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.369 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.369 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:16.371 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:16.372 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:16.366+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:16.472 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:16.466+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:16.544 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:16.545 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:16.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.545 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:26538 4.8 4:154256a4:::benchmark_data_smithi036_18856_object3317:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e81)", 2020-11-12T17:25:16.545 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:16.538562+0000", 2020-11-12T17:25:16.545 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0060563520000000001, 2020-11-12T17:25:16.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0060812519999999997, 2020-11-12T17:25:16.546 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.546 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:16.546 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.546 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:16.546 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:16.546 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 26538 2020-11-12T17:25:16.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.547 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.538562+0000", 2020-11-12T17:25:16.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.538562+0000", 2020-11-12T17:25:16.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:25:16.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.538546+0000", 2020-11-12T17:25:16.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5445000000000003e-05 2020-11-12T17:25:16.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.538591+0000", 2020-11-12T17:25:16.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2670000000000003e-06 2020-11-12T17:25:16.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.538598+0000", 2020-11-12T17:25:16.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.971e-06 2020-11-12T17:25:16.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.538601+0000", 2020-11-12T17:25:16.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001267333 2020-11-12T17:25:16.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.539868+0000", 2020-11-12T17:25:16.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4219000000000002e-05 2020-11-12T17:25:16.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.539942+0000", 2020-11-12T17:25:16.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165229 2020-11-12T17:25:16.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:16.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.540107+0000", 2020-11-12T17:25:16.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021377840000000002 2020-11-12T17:25:16.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542245+0000", 2020-11-12T17:25:16.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003683576 2020-11-12T17:25:16.558 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.558 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.558 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.558 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:26539 4.8 4:154256a4:::benchmark_data_smithi036_18856_object3317:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e81)", 2020-11-12T17:25:16.559 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:16.540383+0000", 2020-11-12T17:25:16.559 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0042353340000000003, 2020-11-12T17:25:16.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043880860000000002, 2020-11-12T17:25:16.560 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.560 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:16.560 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.560 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:16.560 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:16.560 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 26539 2020-11-12T17:25:16.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.561 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.540383+0000", 2020-11-12T17:25:16.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.540383+0000", 2020-11-12T17:25:16.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:16.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.540350+0000", 2020-11-12T17:25:16.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7862999999999995e-05 2020-11-12T17:25:16.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.540448+0000", 2020-11-12T17:25:16.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4545000000000001e-05 2020-11-12T17:25:16.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.540462+0000", 2020-11-12T17:25:16.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.165e-06 2020-11-12T17:25:16.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.540470+0000", 2020-11-12T17:25:16.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052299900000000001 2020-11-12T17:25:16.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.540993+0000", 2020-11-12T17:25:16.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9851000000000003e-05 2020-11-12T17:25:16.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.541092+0000", 2020-11-12T17:25:16.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000174341 2020-11-12T17:25:16.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:16.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.541267+0000", 2020-11-12T17:25:16.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00088400800000000004 2020-11-12T17:25:16.576 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.576 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.576 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.576 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:26540 4.8 4:154256a4:::benchmark_data_smithi036_18856_object3317:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e81)", 2020-11-12T17:25:16.576 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:16.542889+0000", 2020-11-12T17:25:16.577 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.001729232, 2020-11-12T17:25:16.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001988386, 2020-11-12T17:25:16.577 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.577 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:16.577 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.577 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:16.577 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:16.577 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 26540 2020-11-12T17:25:16.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.578 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542889+0000", 2020-11-12T17:25:16.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542889+0000", 2020-11-12T17:25:16.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:16.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542869+0000", 2020-11-12T17:25:16.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4682000000000002e-05 2020-11-12T17:25:16.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542934+0000", 2020-11-12T17:25:16.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3249999999999997e-06 2020-11-12T17:25:16.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542943+0000", 2020-11-12T17:25:16.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3839999999999996e-06 2020-11-12T17:25:16.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542949+0000", 2020-11-12T17:25:16.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5658999999999999e-05 2020-11-12T17:25:16.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542984+0000", 2020-11-12T17:25:16.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3632000000000002e-05 2020-11-12T17:25:16.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.543068+0000", 2020-11-12T17:25:16.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000104151 2020-11-12T17:25:16.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:16.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.543172+0000", 2020-11-12T17:25:16.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000283372 2020-11-12T17:25:16.584 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.584 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.584 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.585 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:26541 4.8 4:154256a4:::benchmark_data_smithi036_18856_object3317:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e81)", 2020-11-12T17:25:16.585 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:16.542984+0000", 2020-11-12T17:25:16.585 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0016341579999999999, 2020-11-12T17:25:16.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019952770000000002, 2020-11-12T17:25:16.586 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.586 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:16.586 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.586 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:16.586 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:16.586 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 26541 2020-11-12T17:25:16.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.587 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542984+0000", 2020-11-12T17:25:16.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542984+0000", 2020-11-12T17:25:16.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:16.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.542966+0000", 2020-11-12T17:25:16.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3327e-05 2020-11-12T17:25:16.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.543019+0000", 2020-11-12T17:25:16.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7909999999999999e-06 2020-11-12T17:25:16.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.543026+0000", 2020-11-12T17:25:16.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2770000000000001e-06 2020-11-12T17:25:16.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.543029+0000", 2020-11-12T17:25:16.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001209543 2020-11-12T17:25:16.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.544239+0000", 2020-11-12T17:25:16.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010689899999999999 2020-11-12T17:25:16.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.544345+0000", 2020-11-12T17:25:16.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000210125 2020-11-12T17:25:16.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:16.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.544556+0000", 2020-11-12T17:25:16.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001571713 2020-11-12T17:25:16.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.593 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.593 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:26538 4.8 e81/69)", 2020-11-12T17:25:16.593 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:16.544440+0000", 2020-11-12T17:25:16.593 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00017788799999999999, 2020-11-12T17:25:16.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00063137299999999996, 2020-11-12T17:25:16.594 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.594 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:16.594 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.544440+0000", 2020-11-12T17:25:16.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.544440+0000", 2020-11-12T17:25:16.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:16.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.544426+0000", 2020-11-12T17:25:16.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3137999999999999e-05 2020-11-12T17:25:16.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.544469+0000", 2020-11-12T17:25:16.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4116999999999999e-05 2020-11-12T17:25:16.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.544503+0000", 2020-11-12T17:25:16.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6489999999999999e-06 2020-11-12T17:25:16.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:16.544508+0000", 2020-11-12T17:25:16.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7815e-05 2020-11-12T17:25:16.598 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.599 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.600 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:16.600 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 5 2020-11-12T17:25:16.600 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:16.602 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:16.603 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:16.596+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:16.703 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:16.696+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:16.773 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:16.774 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:16.774 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:16.774 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:16.774 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:16.785 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:16.832 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:16.830+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:16.905 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:16.902+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:16.909 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:16.909 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:16.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:16.910 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:16.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.910 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:25:16.910 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:16.910 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 126.40363073499999, 2020-11-12T17:25:16.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:25:16.911 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.911 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.911 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:16.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:16.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:16.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:25:16.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:25:16.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:25:16.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:25:16.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:25:16.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:25:16.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:25:16.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:25:16.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:25:16.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:25:16.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:25:16.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:25:16.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:25:16.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:25:16.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:25:16.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:25:16.919 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.920 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.920 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.920 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:16.920 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:16.920 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.38162117, 2020-11-12T17:25:16.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:25:16.921 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.921 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.921 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.921 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.921 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.921 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:25:16.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.923 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:16.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:16.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:16.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:25:16.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:25:16.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:25:16.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:25:16.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:25:16.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:25:16.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:25:16.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:25:16.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:25:16.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:25:16.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:25:16.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:25:16.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:16.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:25:16.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:25:16.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:25:16.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:25:16.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:25:16.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:25:16.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:25:16.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:25:16.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:25:16.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:25:16.932 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.932 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.932 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.932 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:25:16.933 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:16.933 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.378221236, 2020-11-12T17:25:16.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:25:16.933 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.933 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:16.933 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:16.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:16.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:16.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:25:16.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:25:16.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:25:16.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:25:16.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:25:16.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:25:16.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:25:16.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:25:16.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:25:16.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:25:16.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:25:16.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:25:16.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:25:16.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:25:16.939 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.940 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.940 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.940 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29991 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1679, mlcod=48'1673)", 2020-11-12T17:25:16.940 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:25:16.940 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 86.903695541999994, 2020-11-12T17:25:16.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001, 2020-11-12T17:25:16.941 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.941 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.941 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:25:16.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:25:16.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:25:16.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004127+0000", 2020-11-12T17:25:16.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012464900000000001 2020-11-12T17:25:16.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004251+0000", 2020-11-12T17:25:16.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28639012600000002 2020-11-12T17:25:16.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290641+0000", 2020-11-12T17:25:16.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:25:16.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290646+0000", 2020-11-12T17:25:16.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2363000000000002e-05 2020-11-12T17:25:16.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290679+0000", 2020-11-12T17:25:16.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3289999999999999e-05 2020-11-12T17:25:16.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290702+0000", 2020-11-12T17:25:16.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014675440000000001 2020-11-12T17:25:16.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292170+0000", 2020-11-12T17:25:16.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6585000000000001e-05 2020-11-12T17:25:16.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292226+0000", 2020-11-12T17:25:16.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001 2020-11-12T17:25:16.948 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.948 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.948 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.948 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:25:16.949 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:16.949 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 86.902331789000002, 2020-11-12T17:25:16.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:25:16.949 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.949 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.949 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:16.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:16.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:16.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:25:16.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:25:16.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:25:16.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:25:16.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:25:16.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:25:16.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:25:16.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:25:16.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:25:16.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:25:16.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:25:16.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:25:16.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:25:16.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:25:16.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:25:16.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:25:16.956 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.956 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.956 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.957 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:33768 3.d e49/20 3:bed94f4a:::benchmark_data_smithi036_14212_object4220:head v 49'1880, mlcod=49'1874)", 2020-11-12T17:25:16.957 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:25:16.957 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 82.993288741000001, 2020-11-12T17:25:16.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001, 2020-11-12T17:25:16.957 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.957 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.958 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:25:16.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:25:16.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:25:16.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914530+0000", 2020-11-12T17:25:16.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013119499999999999 2020-11-12T17:25:16.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914662+0000", 2020-11-12T17:25:16.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26915680600000003 2020-11-12T17:25:16.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183818+0000", 2020-11-12T17:25:16.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.61e-06 2020-11-12T17:25:16.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183826+0000", 2020-11-12T17:25:16.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2031999999999999e-05 2020-11-12T17:25:16.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183878+0000", 2020-11-12T17:25:16.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1192999999999998e-05 2020-11-12T17:25:16.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183909+0000", 2020-11-12T17:25:16.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055133250000000003 2020-11-12T17:25:16.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189422+0000", 2020-11-12T17:25:16.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4030999999999997e-05 2020-11-12T17:25:16.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189486+0000", 2020-11-12T17:25:16.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001 2020-11-12T17:25:16.964 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.965 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.965 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.965 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:25:16.965 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:16.965 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.069637822999994, 2020-11-12T17:25:16.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:25:16.966 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.966 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.966 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:16.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:16.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:16.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:25:16.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:25:16.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:25:16.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:25:16.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:25:16.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:25:16.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:25:16.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:25:16.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:25:16.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:25:16.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:25:16.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:25:16.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:25:16.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:25:16.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:25:16.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:25:16.973 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.973 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.973 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.973 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:16.974 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:16.974 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.962346445999998, 2020-11-12T17:25:16.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:25:16.974 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.974 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.974 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.975 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.975 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.975 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:25:16.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.975 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:16.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:16.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:25:16.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:25:16.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:25:16.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:25:16.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:25:16.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:25:16.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:25:16.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:25:16.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:25:16.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:25:16.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:25:16.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:25:16.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:25:16.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:16.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:25:16.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:25:16.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:25:16.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:25:16.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:25:16.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:25:16.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:25:16.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:25:16.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:25:16.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:25:16.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.984 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.985 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:59416 3.c 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:16.985 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:16.985 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.379951030999997, 2020-11-12T17:25:16.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998, 2020-11-12T17:25:16.985 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.985 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:16.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:16.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:16.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:16.986 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59416 2020-11-12T17:25:16.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.986 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:16.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:16.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:16.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527883+0000", 2020-11-12T17:25:16.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2643000000000002e-05 2020-11-12T17:25:16.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:16.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527956+0000", 2020-11-12T17:25:16.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:25:16.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:16.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527969+0000", 2020-11-12T17:25:16.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2689999999999996e-06 2020-11-12T17:25:16.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:16.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527976+0000", 2020-11-12T17:25:16.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043768990000000001 2020-11-12T17:25:16.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:16.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532353+0000", 2020-11-12T17:25:16.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011210299999999999 2020-11-12T17:25:16.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:16.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532465+0000", 2020-11-12T17:25:16.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017931699999999999 2020-11-12T17:25:16.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:16.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532644+0000", 2020-11-12T17:25:16.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002342341 2020-11-12T17:25:16.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:16.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.534986+0000", 2020-11-12T17:25:16.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30120883700000001 2020-11-12T17:25:16.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:16.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836195+0000", 2020-11-12T17:25:16.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0408999999999995e-05 2020-11-12T17:25:16.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:16.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836276+0000", 2020-11-12T17:25:16.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1774999999999997e-05 2020-11-12T17:25:16.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:16.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836337+0000", 2020-11-12T17:25:16.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998 2020-11-12T17:25:16.996 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.996 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:16.996 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:16.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.996 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:25:16.997 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:16.997 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 43.485245372000001, 2020-11-12T17:25:16.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:25:16.997 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:16.997 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:16.997 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:16.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:16.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:16.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:16.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:16.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:16.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:25:16.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:16.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:16.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:16.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:25:16.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:25:16.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:25:17.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:25:17.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:25:17.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:25:17.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:25:17.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:25:17.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:25:17.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:25:17.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:25:17.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:25:17.003 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.003 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.003 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.003 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:64408 3.d e61/20 3:b728e6a9:::benchmark_data_smithi036_14212_object8050:head v 61'3888, mlcod=61'3882)", 2020-11-12T17:25:17.003 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:25:17.004 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 43.038760891000003, 2020-11-12T17:25:17.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25887154299999998, 2020-11-12T17:25:17.004 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.004 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.004 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:25:17.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869098+0000", 2020-11-12T17:25:17.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:25:17.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869075+0000", 2020-11-12T17:25:17.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5099999999999994e-05 2020-11-12T17:25:17.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.869170+0000", 2020-11-12T17:25:17.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25377307599999999 2020-11-12T17:25:17.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122943+0000", 2020-11-12T17:25:17.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0360000000000001e-06 2020-11-12T17:25:17.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122950+0000", 2020-11-12T17:25:17.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4113999999999998e-05 2020-11-12T17:25:17.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.122994+0000", 2020-11-12T17:25:17.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5396999999999998e-05 2020-11-12T17:25:17.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.123010+0000", 2020-11-12T17:25:17.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049051490000000001 2020-11-12T17:25:17.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.127915+0000", 2020-11-12T17:25:17.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5053999999999998e-05 2020-11-12T17:25:17.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.127970+0000", 2020-11-12T17:25:17.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.25887154299999998 2020-11-12T17:25:17.011 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.011 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.011 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.012 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:25:17.012 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:17.012 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 42.366234984999998, 2020-11-12T17:25:17.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:25:17.012 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.012 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.013 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:17.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.013 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:17.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:17.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:17.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:25:17.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:25:17.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:25:17.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:25:17.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:25:17.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:25:17.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:25:17.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:25:17.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:25:17.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:25:17.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:25:17.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:25:17.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:17.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:25:17.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:25:17.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:25:17.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:25:17.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:25:17.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:25:17.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:25:17.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:25:17.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:25:17.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:25:17.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.022 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.023 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:25:17.023 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:17.023 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 42.350096981, 2020-11-12T17:25:17.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:25:17.023 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.023 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:17.024 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:17.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:17.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:17.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:25:17.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:25:17.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:25:17.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:25:17.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:25:17.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:25:17.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:25:17.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:25:17.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:25:17.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:25:17.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:25:17.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:25:17.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:25:17.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:25:17.030 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.030 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.030 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.030 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:25:17.030 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:17.031 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 42.345369302000002, 2020-11-12T17:25:17.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:25:17.031 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.031 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:25:17.031 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.031 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.031 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.032 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:17.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.032 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:17.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:17.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:17.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:25:17.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:25:17.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:25:17.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:25:17.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:25:17.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:25:17.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:25:17.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:25:17.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:25:17.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:25:17.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:17.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:25:17.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:25:17.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:25:17.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:25:17.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.038 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.038 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:424 4.8 4:15a22128:::benchmark_data_smithi036_18856_object52:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:17.039 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:17.039 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 24.687339564999998, 2020-11-12T17:25:17.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002, 2020-11-12T17:25:17.039 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.039 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:17.040 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:17.040 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 424 2020-11-12T17:25:17.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.040 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:17.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:17.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:17.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220491+0000", 2020-11-12T17:25:17.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7780000000000003e-05 2020-11-12T17:25:17.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220579+0000", 2020-11-12T17:25:17.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1511e-05 2020-11-12T17:25:17.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220590+0000", 2020-11-12T17:25:17.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9410000000000004e-06 2020-11-12T17:25:17.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220596+0000", 2020-11-12T17:25:17.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027076259999999999 2020-11-12T17:25:17.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223304+0000", 2020-11-12T17:25:17.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102644 2020-11-12T17:25:17.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223406+0000", 2020-11-12T17:25:17.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017898600000000001 2020-11-12T17:25:17.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:17.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223585+0000", 2020-11-12T17:25:17.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000774389 2020-11-12T17:25:17.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224360+0000", 2020-11-12T17:25:17.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30234014999999997 2020-11-12T17:25:17.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526700+0000", 2020-11-12T17:25:17.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5360999999999999e-05 2020-11-12T17:25:17.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526775+0000", 2020-11-12T17:25:17.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6470000000000001e-05 2020-11-12T17:25:17.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526812+0000", 2020-11-12T17:25:17.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002 2020-11-12T17:25:17.049 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.049 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.049 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.049 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:424 4.8 e71/69 ondisk, result = 0)", 2020-11-12T17:25:17.049 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:17.049 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 24.682888026000001, 2020-11-12T17:25:17.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474, 2020-11-12T17:25:17.050 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.050 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:17.050 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:17.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:17.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:17.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224949+0000", 2020-11-12T17:25:17.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8579000000000003e-05 2020-11-12T17:25:17.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.225008+0000", 2020-11-12T17:25:17.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30161437000000002 2020-11-12T17:25:17.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526622+0000", 2020-11-12T17:25:17.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1900000000000003e-06 2020-11-12T17:25:17.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526628+0000", 2020-11-12T17:25:17.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8828000000000001e-05 2020-11-12T17:25:17.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526676+0000", 2020-11-12T17:25:17.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1576000000000001e-05 2020-11-12T17:25:17.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526688+0000", 2020-11-12T17:25:17.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012879999999999999 2020-11-12T17:25:17.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526817+0000", 2020-11-12T17:25:17.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474 2020-11-12T17:25:17.056 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.056 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.056 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.057 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11951 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:17.057 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:17.057 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 14.816869713000001, 2020-11-12T17:25:17.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998, 2020-11-12T17:25:17.057 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.057 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.057 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.058 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:17.058 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:17.058 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11951 2020-11-12T17:25:17.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.058 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:17.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:17.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:25:17.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090956+0000", 2020-11-12T17:25:17.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110012 2020-11-12T17:25:17.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091066+0000", 2020-11-12T17:25:17.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2517000000000001e-05 2020-11-12T17:25:17.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091078+0000", 2020-11-12T17:25:17.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.421e-06 2020-11-12T17:25:17.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091085+0000", 2020-11-12T17:25:17.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052388110000000003 2020-11-12T17:25:17.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096323+0000", 2020-11-12T17:25:17.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010759 2020-11-12T17:25:17.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096431+0000", 2020-11-12T17:25:17.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018636600000000001 2020-11-12T17:25:17.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:17.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096617+0000", 2020-11-12T17:25:17.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018824309999999999 2020-11-12T17:25:17.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098500+0000", 2020-11-12T17:25:17.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29523157 2020-11-12T17:25:17.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393731+0000", 2020-11-12T17:25:17.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7910999999999994e-05 2020-11-12T17:25:17.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393799+0000", 2020-11-12T17:25:17.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101962 2020-11-12T17:25:17.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393901+0000", 2020-11-12T17:25:17.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998 2020-11-12T17:25:17.067 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.067 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.067 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.068 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11952 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:17.068 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:17.068 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 14.816718892000001, 2020-11-12T17:25:17.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002, 2020-11-12T17:25:17.068 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.068 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.068 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.069 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:17.069 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:17.069 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11952 2020-11-12T17:25:17.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.069 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:17.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:17.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:17.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091107+0000", 2020-11-12T17:25:17.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011024200000000001 2020-11-12T17:25:17.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091218+0000", 2020-11-12T17:25:17.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2203e-05 2020-11-12T17:25:17.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091230+0000", 2020-11-12T17:25:17.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.694e-06 2020-11-12T17:25:17.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091236+0000", 2020-11-12T17:25:17.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076783260000000001 2020-11-12T17:25:17.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098914+0000", 2020-11-12T17:25:17.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3187000000000001e-05 2020-11-12T17:25:17.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099007+0000", 2020-11-12T17:25:17.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016888299999999999 2020-11-12T17:25:17.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:17.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099176+0000", 2020-11-12T17:25:17.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012571570000000001 2020-11-12T17:25:17.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100433+0000", 2020-11-12T17:25:17.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29596956499999999 2020-11-12T17:25:17.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396403+0000", 2020-11-12T17:25:17.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0348999999999999e-05 2020-11-12T17:25:17.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396483+0000", 2020-11-12T17:25:17.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8981000000000003e-05 2020-11-12T17:25:17.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396542+0000", 2020-11-12T17:25:17.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002 2020-11-12T17:25:17.078 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.078 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.078 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.078 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11951 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:17.079 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:17.079 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 14.809191468, 2020-11-12T17:25:17.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998, 2020-11-12T17:25:17.079 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.079 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:17.079 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:17.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:17.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:17.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098644+0000", 2020-11-12T17:25:17.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2123000000000001e-05 2020-11-12T17:25:17.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098706+0000", 2020-11-12T17:25:17.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.294880011 2020-11-12T17:25:17.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393586+0000", 2020-11-12T17:25:17.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:17.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393595+0000", 2020-11-12T17:25:17.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115302 2020-11-12T17:25:17.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393710+0000", 2020-11-12T17:25:17.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2968e-05 2020-11-12T17:25:17.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393723+0000", 2020-11-12T17:25:17.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018932500000000001 2020-11-12T17:25:17.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393913+0000", 2020-11-12T17:25:17.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998 2020-11-12T17:25:17.086 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.086 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.086 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.086 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11952 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:17.086 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:17.087 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 14.807091692, 2020-11-12T17:25:17.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999, 2020-11-12T17:25:17.087 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.087 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:17.087 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:17.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:17.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:17.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100743+0000", 2020-11-12T17:25:17.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2359000000000004e-05 2020-11-12T17:25:17.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100805+0000", 2020-11-12T17:25:17.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29550863300000002 2020-11-12T17:25:17.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396314+0000", 2020-11-12T17:25:17.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6940000000000003e-06 2020-11-12T17:25:17.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396318+0000", 2020-11-12T17:25:17.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8325999999999997e-05 2020-11-12T17:25:17.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396377+0000", 2020-11-12T17:25:17.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4015999999999999e-05 2020-11-12T17:25:17.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396391+0000", 2020-11-12T17:25:17.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015908 2020-11-12T17:25:17.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396550+0000", 2020-11-12T17:25:17.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999 2020-11-12T17:25:17.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.093 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.094 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.094 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:17.095 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 25 16 26927 26911 8.40885 8.4375 0.0060908 0.0148406 2020-11-12T17:25:17.095 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:17.096 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:17.088+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:17.196 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:17.194+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:17.264 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:17.265 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:17.265 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:25:17.265 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:17.278 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:17.297 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:17.292+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:17.398 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:17.394+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:17.448 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:17.448 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:17.448 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:17.448 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:17.448 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:17.459 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:17.499 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:17.492+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:17.601 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:17.598+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:17.632 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:17.633 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:17.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:17.633 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:17.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.633 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:25:17.634 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:17.634 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.95969302100001, 2020-11-12T17:25:17.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:25:17.634 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.634 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:17.634 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.634 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.635 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.635 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:25:17.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.635 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:17.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:17.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:25:17.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:25:17.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:25:17.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:25:17.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:25:17.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:25:17.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:25:17.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:25:17.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:25:17.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:25:17.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:25:17.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:25:17.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:25:17.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:25:17.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:25:17.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:25:17.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:25:17.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:25:17.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:25:17.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:25:17.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:25:17.643 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.644 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.644 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.644 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.644 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:17.644 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.95929065999999, 2020-11-12T17:25:17.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:25:17.646 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.646 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.647 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.647 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.647 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.647 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:25:17.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.647 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:17.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:17.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:25:17.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:25:17.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:25:17.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:25:17.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:25:17.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:25:17.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:25:17.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:25:17.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:25:17.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:25:17.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:25:17.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:25:17.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:25:17.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:25:17.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:25:17.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:25:17.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:25:17.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:25:17.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:25:17.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:25:17.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:25:17.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:25:17.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:25:17.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:25:17.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:25:17.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:25:17.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:25:17.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:25:17.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:25:17.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:25:17.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:25:17.662 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.662 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.662 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.662 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.662 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:17.663 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.958966667, 2020-11-12T17:25:17.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:25:17.663 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.663 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.663 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.663 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.664 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.664 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:25:17.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.664 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:17.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:17.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:25:17.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:25:17.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:25:17.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:25:17.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:25:17.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:25:17.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:25:17.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:25:17.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:25:17.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:25:17.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:25:17.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:25:17.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:25:17.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:25:17.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:25:17.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:25:17.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:25:17.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:25:17.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:25:17.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:25:17.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:25:17.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:25:17.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:25:17.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:25:17.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:25:17.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:25:17.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:25:17.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:25:17.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:25:17.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:25:17.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:25:17.676 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.676 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.676 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.677 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.677 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:17.677 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.958722956, 2020-11-12T17:25:17.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:25:17.677 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.677 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.678 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:25:17.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.678 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:17.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:17.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:17.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:25:17.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:25:17.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:25:17.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:25:17.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:25:17.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:25:17.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:25:17.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:25:17.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:25:17.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:25:17.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:25:17.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:25:17.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:25:17.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:25:17.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:25:17.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:25:17.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:25:17.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:25:17.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:25:17.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:25:17.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:25:17.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:25:17.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:25:17.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:25:17.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:25:17.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:25:17.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:25:17.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:25:17.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:25:17.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:25:17.690 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.690 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.690 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.691 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.691 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:17.691 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.958484809, 2020-11-12T17:25:17.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:25:17.691 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.691 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.691 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.692 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.692 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.692 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:25:17.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.692 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:17.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:17.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:25:17.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:25:17.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:25:17.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:25:17.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:25:17.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:25:17.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:25:17.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:25:17.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:25:17.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:25:17.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:25:17.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:25:17.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:25:17.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:25:17.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:25:17.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:25:17.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:25:17.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:25:17.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:25:17.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:25:17.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:25:17.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:25:17.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:25:17.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:25:17.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:25:17.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:25:17.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:25:17.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:25:17.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:25:17.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:25:17.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:25:17.705 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.705 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.705 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.705 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.705 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:17.706 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.95828276899999, 2020-11-12T17:25:17.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:25:17.706 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.706 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.706 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:25:17.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.707 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:17.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:17.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:17.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:25:17.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:25:17.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:25:17.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:25:17.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:25:17.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:25:17.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:25:17.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:25:17.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:25:17.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:25:17.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:25:17.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:25:17.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:25:17.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:25:17.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:25:17.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:25:17.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:25:17.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:25:17.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:25:17.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:25:17.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:25:17.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:25:17.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:25:17.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:25:17.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:25:17.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:25:17.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:25:17.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:25:17.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:25:17.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:25:17.718 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.719 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.719 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.719 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.719 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:17.719 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.958077399, 2020-11-12T17:25:17.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:25:17.720 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.720 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.720 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.720 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.720 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.720 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:25:17.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.721 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:17.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:17.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:17.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:25:17.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:25:17.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:25:17.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:25:17.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:25:17.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:25:17.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:25:17.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:25:17.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:25:17.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:25:17.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:25:17.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:25:17.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:25:17.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:25:17.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:25:17.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:25:17.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:25:17.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:25:17.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:25:17.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:25:17.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:25:17.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:25:17.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:25:17.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:25:17.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:25:17.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:25:17.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:25:17.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:25:17.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:25:17.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:25:17.735 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.736 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.736 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.736 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.736 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:17.736 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.95789157199999, 2020-11-12T17:25:17.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:25:17.737 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.737 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.737 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.737 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.737 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.737 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:25:17.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.738 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:17.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:17.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:17.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:25:17.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:25:17.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:25:17.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:25:17.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:25:17.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:25:17.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:25:17.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:25:17.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:25:17.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:25:17.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:25:17.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:25:17.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:25:17.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:25:17.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:25:17.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:25:17.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:25:17.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:25:17.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:25:17.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:25:17.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:25:17.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:25:17.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:25:17.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:25:17.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:25:17.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:25:17.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:25:17.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:25:17.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:25:17.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:25:17.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.755 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.755 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.756 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:17.756 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.957694608, 2020-11-12T17:25:17.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:25:17.756 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.756 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.757 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:25:17.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.757 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:17.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:17.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:25:17.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:25:17.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:25:17.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:25:17.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:25:17.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:25:17.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:25:17.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:25:17.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:25:17.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:25:17.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:25:17.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:25:17.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:25:17.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:25:17.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:25:17.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:25:17.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:25:17.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:25:17.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:25:17.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:25:17.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:25:17.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:25:17.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:25:17.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:25:17.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:25:17.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:25:17.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:25:17.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:25:17.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:25:17.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:25:17.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:25:17.769 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.770 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.770 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.770 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.770 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:17.770 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.957498578, 2020-11-12T17:25:17.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:25:17.771 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.771 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.771 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.771 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.771 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.771 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:25:17.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.772 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:17.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:17.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:17.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:25:17.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:25:17.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:25:17.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:25:17.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:25:17.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:25:17.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:25:17.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:25:17.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:25:17.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:25:17.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:25:17.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:25:17.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:25:17.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:25:17.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:25:17.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:25:17.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:25:17.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:25:17.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:25:17.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:25:17.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:25:17.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:25:17.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:25:17.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:25:17.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:25:17.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:25:17.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:25:17.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:25:17.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:25:17.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:25:17.786 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.786 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.786 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.786 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.786 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:17.787 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.957317778, 2020-11-12T17:25:17.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:25:17.787 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.787 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.787 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:25:17.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.788 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:17.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:17.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:17.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:25:17.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:25:17.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:25:17.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:25:17.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:25:17.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:25:17.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:25:17.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:25:17.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:25:17.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:25:17.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:25:17.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:25:17.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:25:17.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:25:17.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:25:17.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:25:17.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:25:17.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:25:17.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:25:17.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:25:17.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:25:17.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:25:17.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:25:17.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:25:17.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:25:17.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:25:17.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:25:17.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:25:17.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:25:17.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:25:17.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.799 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.800 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.800 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:17.800 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.957121825, 2020-11-12T17:25:17.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:25:17.800 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.800 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.801 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:25:17.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.801 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:17.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:17.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:17.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:25:17.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:25:17.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:25:17.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:25:17.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:25:17.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:17.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:25:17.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:25:17.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:25:17.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:25:17.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:25:17.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:25:17.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:25:17.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:25:17.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:25:17.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:25:17.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:25:17.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:25:17.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:25:17.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:25:17.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:25:17.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:25:17.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:25:17.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:25:17.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:25:17.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:25:17.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:25:17.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:25:17.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:25:17.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:25:17.823 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.823 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.823 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.824 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.824 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:17.824 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.956928217, 2020-11-12T17:25:17.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:25:17.824 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.824 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.824 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.824 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.825 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.825 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:25:17.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.825 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:17.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:17.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:25:17.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:25:17.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:25:17.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:25:17.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:25:17.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:25:17.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:25:17.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:25:17.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:25:17.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:25:17.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:25:17.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:25:17.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:25:17.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:25:17.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:25:17.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:25:17.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:25:17.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:25:17.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:25:17.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:25:17.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:25:17.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:25:17.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:25:17.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:25:17.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:25:17.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:25:17.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:25:17.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:25:17.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:25:17.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:25:17.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:25:17.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.840 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.840 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.840 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.840 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:17.841 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.956616354, 2020-11-12T17:25:17.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:25:17.841 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.841 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.841 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.842 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.842 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.842 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:25:17.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.842 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:17.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:17.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:25:17.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:25:17.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:25:17.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:25:17.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:25:17.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:25:17.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:25:17.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:25:17.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:25:17.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:25:17.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:25:17.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:25:17.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:25:17.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:25:17.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:25:17.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:25:17.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:25:17.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:25:17.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:25:17.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:25:17.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:25:17.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:25:17.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:25:17.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:25:17.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:25:17.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:25:17.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:25:17.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:25:17.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:25:17.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:25:17.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:25:17.856 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.856 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.856 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.857 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.857 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:17.857 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.956328857, 2020-11-12T17:25:17.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:25:17.857 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.858 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.858 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.858 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.858 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.858 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:25:17.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.858 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:17.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:17.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:25:17.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:25:17.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:25:17.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:25:17.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:25:17.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:25:17.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:25:17.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:25:17.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:25:17.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:25:17.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:25:17.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:25:17.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:25:17.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:25:17.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:25:17.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:25:17.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:25:17.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:25:17.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:25:17.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:25:17.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:25:17.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:25:17.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:25:17.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:25:17.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:25:17.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:25:17.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:25:17.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:25:17.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:25:17.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:25:17.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:25:17.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.870 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.870 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:17.871 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:17.871 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.95610848600001, 2020-11-12T17:25:17.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:25:17.871 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.871 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.871 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.871 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.871 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.872 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:25:17.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.872 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:17.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:17.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:25:17.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:25:17.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:25:17.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:25:17.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:25:17.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:25:17.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:25:17.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:25:17.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:25:17.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:25:17.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:25:17.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:17.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:25:17.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:25:17.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:25:17.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:25:17.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:17.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:25:17.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:25:17.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:25:17.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:25:17.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:25:17.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:25:17.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:25:17.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:25:17.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:25:17.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:25:17.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:25:17.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:25:17.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:25:17.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:25:17.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:25:17.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:25:17.884 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.884 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.884 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.885 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:20904 3.0 e42/35 3:07649b2f:::benchmark_data_smithi036_14212_object2612:head v 42'1120, mlcod=42'1114)", 2020-11-12T17:25:17.885 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:25:17.885 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 97.015456181000005, 2020-11-12T17:25:17.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999, 2020-11-12T17:25:17.885 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.885 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.885 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:25:17.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:25:17.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:17.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613848+0000", 2020-11-12T17:25:17.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3206000000000004e-05 2020-11-12T17:25:17.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613911+0000", 2020-11-12T17:25:17.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38330512799999999 2020-11-12T17:25:17.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997216+0000", 2020-11-12T17:25:17.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8860000000000004e-06 2020-11-12T17:25:17.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997224+0000", 2020-11-12T17:25:17.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000129011 2020-11-12T17:25:17.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997353+0000", 2020-11-12T17:25:17.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9062999999999999e-05 2020-11-12T17:25:17.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997382+0000", 2020-11-12T17:25:17.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018580370000000001 2020-11-12T17:25:17.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999240+0000", 2020-11-12T17:25:17.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6116999999999998e-05 2020-11-12T17:25:17.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999296+0000", 2020-11-12T17:25:17.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999 2020-11-12T17:25:17.892 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.892 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.892 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.893 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:17.893 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:17.893 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.184654640000005, 2020-11-12T17:25:17.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:25:17.893 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.894 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:17.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:17.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:17.894 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:25:17.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.894 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:17.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:17.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:17.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:25:17.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:25:17.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:25:17.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:25:17.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:25:17.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:25:17.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:25:17.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:25:17.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:25:17.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:25:17.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:25:17.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:25:17.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:17.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:25:17.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:25:17.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:17.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:25:17.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:25:17.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:17.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:25:17.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:25:17.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:25:17.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:25:17.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:25:17.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:25:17.906 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.907 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.907 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.907 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:25496 3.a e46/31 ondisk, result = 0)", 2020-11-12T17:25:17.908 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:25:17.908 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.178727128000006, 2020-11-12T17:25:17.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999, 2020-11-12T17:25:17.908 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.909 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:17.909 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:25:17.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:25:17.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:17.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450588+0000", 2020-11-12T17:25:17.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5475000000000002e-05 2020-11-12T17:25:17.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450623+0000", 2020-11-12T17:25:17.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46380360799999998 2020-11-12T17:25:17.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914427+0000", 2020-11-12T17:25:17.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7369999999999995e-06 2020-11-12T17:25:17.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914436+0000", 2020-11-12T17:25:17.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001408212 2020-11-12T17:25:17.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915844+0000", 2020-11-12T17:25:17.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0029e-05 2020-11-12T17:25:17.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915854+0000", 2020-11-12T17:25:17.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014011899999999999 2020-11-12T17:25:17.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915994+0000", 2020-11-12T17:25:17.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999 2020-11-12T17:25:17.917 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.917 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.917 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.918 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:25:17.918 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:17.918 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 72.864365738999993, 2020-11-12T17:25:17.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:25:17.918 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:17.918 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:17.918 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:17.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:17.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:17.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:17.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:17.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:17.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:17.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:17.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:25:17.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:25:17.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:17.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:25:17.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:25:17.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:17.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:25:17.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:25:17.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:17.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:25:17.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:25:17.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:17.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:25:17.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:25:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:25:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:25:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:25:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:25:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:25:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:25:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:17.926 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:17.927 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:17.929 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:17.929 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:17.924+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:17.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 26 16 27852 27836 8.36335 7.22656 0.0116724 0.0149207 2020-11-12T17:25:18.022 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:25:18.068 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:18.064+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:18.090 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:18.100 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:28005 4.0 e82/69 4:0dbc8e0c:::benchmark_data_smithi036_18856_object3500:head v 82'1733, mlcod=82'1728)", 2020-11-12T17:25:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:18.092195+0000", 2020-11-12T17:25:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0071988019999999998, 2020-11-12T17:25:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0072175549999999996, 2020-11-12T17:25:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.092195+0000", 2020-11-12T17:25:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.092195+0000", 2020-11-12T17:25:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.092178+0000", 2020-11-12T17:25:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0362000000000002e-05 2020-11-12T17:25:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.092248+0000", 2020-11-12T17:25:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9373000000000002e-05 2020-11-12T17:25:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.092308+0000", 2020-11-12T17:25:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0840000000000003e-06 2020-11-12T17:25:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.092315+0000", 2020-11-12T17:25:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5915999999999999e-05 2020-11-12T17:25:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.092361+0000", 2020-11-12T17:25:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7258e-05 2020-11-12T17:25:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.092378+0000", 2020-11-12T17:25:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018245499999999999 2020-11-12T17:25:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:28006 4.0 e82/69 4:0dbc8e0c:::benchmark_data_smithi036_18856_object3500:head v 82'1734, mlcod=82'1728)", 2020-11-12T17:25:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:18.095820+0000", 2020-11-12T17:25:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.003574523, 2020-11-12T17:25:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036351769999999999, 2020-11-12T17:25:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.095820+0000", 2020-11-12T17:25:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.095820+0000", 2020-11-12T17:25:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.095793+0000", 2020-11-12T17:25:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8385000000000002e-05 2020-11-12T17:25:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.095882+0000", 2020-11-12T17:25:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012822699999999999 2020-11-12T17:25:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096010+0000", 2020-11-12T17:25:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8769999999999993e-06 2020-11-12T17:25:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096018+0000", 2020-11-12T17:25:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3702999999999998e-05 2020-11-12T17:25:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096062+0000", 2020-11-12T17:25:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0085000000000002e-05 2020-11-12T17:25:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096082+0000", 2020-11-12T17:25:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026212499999999999 2020-11-12T17:25:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:28007 4.0 e82/69 4:0dbc8e0c:::benchmark_data_smithi036_18856_object3500:head v 82'1735, mlcod=82'1728)", 2020-11-12T17:25:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:18.095912+0000", 2020-11-12T17:25:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0034817099999999998, 2020-11-12T17:25:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035784810000000001, 2020-11-12T17:25:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.095912+0000", 2020-11-12T17:25:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.095912+0000", 2020-11-12T17:25:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.095897+0000", 2020-11-12T17:25:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:25:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.095949+0000", 2020-11-12T17:25:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5291999999999996e-05 2020-11-12T17:25:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096034+0000", 2020-11-12T17:25:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3380000000000001e-06 2020-11-12T17:25:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096038+0000", 2020-11-12T17:25:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00073948199999999996 2020-11-12T17:25:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096777+0000", 2020-11-12T17:25:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6829e-05 2020-11-12T17:25:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096804+0000", 2020-11-12T17:25:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00089149800000000001 2020-11-12T17:25:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:28008 4.0 e82/69 4:0dbc8e0c:::benchmark_data_smithi036_18856_object3500:head v 82'1736, mlcod=82'1728)", 2020-11-12T17:25:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:18.096907+0000", 2020-11-12T17:25:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0024871229999999999, 2020-11-12T17:25:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002618741, 2020-11-12T17:25:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096907+0000", 2020-11-12T17:25:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096907+0000", 2020-11-12T17:25:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096890+0000", 2020-11-12T17:25:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8570999999999999e-05 2020-11-12T17:25:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096949+0000", 2020-11-12T17:25:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2824000000000003e-05 2020-11-12T17:25:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096981+0000", 2020-11-12T17:25:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8189999999999999e-06 2020-11-12T17:25:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.096986+0000", 2020-11-12T17:25:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00059566399999999998 2020-11-12T17:25:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.097582+0000", 2020-11-12T17:25:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1164000000000002e-05 2020-11-12T17:25:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:18.097613+0000", 2020-11-12T17:25:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00070593800000000003 2020-11-12T17:25:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 4 2020-11-12T17:25:18.135 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:18.136 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:18.137 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:18.137 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:18.134+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:18.157 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:18.191 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:18.224 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:18.238 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:18.234+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:18.255 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:18.285 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:18.285 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:18.285 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:18.285 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:18.286 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:25:18.286 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:18.286 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:18.286 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:18.286 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:18.286 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:18.287 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:18.288 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:18.306 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:18.307 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:18.319 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:18.361 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:18.358+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:18.397 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:25:18.441 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:18.436+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:18.495 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:18.495 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:18.506 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:18.541 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:18.538+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:18.624 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:18.624 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:18.639 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:18.684 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:18.680+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:18.744 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:18.740+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:18.752 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:18.752 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:18.762 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:18.854 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:18.848+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:18.925 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:18.926 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:18.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 27 16 28867 28851 8.34726 7.92969 0.0245344 0.0149653 2020-11-12T17:25:18.941 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:18.947 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:18.942+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:19.048 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:19.044+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:19.108 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:19.108 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:19.121 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:25:19.168 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:19.164+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:19.249 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:19.244+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:19.276 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:19.276 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:19.285 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:25:19.351 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:19.346+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:19.452 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:19.448+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:19.460 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:19.461 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:19.474 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:19.564 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:19.560+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:19.625 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:19.626 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:19.635 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:19.755 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:19.748+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:19.786 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:19.787 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:19.796 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:19.884 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:19.880+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:19.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 28 16 29436 29420 8.20789 4.44531 0.0100758 0.014999 2020-11-12T17:25:19.949 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:19.950 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:19.956 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:19.952+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:19.959 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:20.035 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:19.650+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:20.057 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:20.052+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:20.098 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:20.099 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:20.111 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:20.159 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:20.154+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:20.242 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:20.243 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:20.254 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:20.266 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:20.252+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:20.288 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:20.360 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:20.358+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:20.410 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:25:20.439 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:20.439 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:20.451 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:20.463 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:20.464 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:20.456+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:20.491 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:20.522 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:20.554 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:20.564 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:20.560+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:20.584 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:20.615 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:20.621 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:20.621 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:20.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.622 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:30115 4.1 e83/69 4:86fade22:::benchmark_data_smithi036_18856_object3764:head v 83'1939, mlcod=83'1935)", 2020-11-12T17:25:20.622 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:20.620111+0000", 2020-11-12T17:25:20.622 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0019131440000000001, 2020-11-12T17:25:20.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001940034, 2020-11-12T17:25:20.622 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.623 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:20.623 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.620111+0000", 2020-11-12T17:25:20.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.620111+0000", 2020-11-12T17:25:20.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:20.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.620084+0000", 2020-11-12T17:25:20.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9828999999999997e-05 2020-11-12T17:25:20.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.620174+0000", 2020-11-12T17:25:20.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7945999999999998e-05 2020-11-12T17:25:20.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.620222+0000", 2020-11-12T17:25:20.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7219999999999996e-06 2020-11-12T17:25:20.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.620228+0000", 2020-11-12T17:25:20.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9249000000000003e-05 2020-11-12T17:25:20.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.620267+0000", 2020-11-12T17:25:20.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2942000000000002e-05 2020-11-12T17:25:20.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.620290+0000", 2020-11-12T17:25:20.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000179266 2020-11-12T17:25:20.628 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.628 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:20.628 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.629 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:30116 4.1 e83/69 4:86fade22:::benchmark_data_smithi036_18856_object3764:head v 83'1940, mlcod=83'1935)", 2020-11-12T17:25:20.629 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:20.621466+0000", 2020-11-12T17:25:20.629 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00055790199999999999, 2020-11-12T17:25:20.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00066452999999999998, 2020-11-12T17:25:20.629 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.629 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:20.629 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.621466+0000", 2020-11-12T17:25:20.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.621466+0000", 2020-11-12T17:25:20.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:20.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.621444+0000", 2020-11-12T17:25:20.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4110000000000006e-05 2020-11-12T17:25:20.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.621528+0000", 2020-11-12T17:25:20.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6375000000000002e-05 2020-11-12T17:25:20.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.621574+0000", 2020-11-12T17:25:20.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2469999999999997e-06 2020-11-12T17:25:20.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.621580+0000", 2020-11-12T17:25:20.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8535999999999998e-05 2020-11-12T17:25:20.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.621619+0000", 2020-11-12T17:25:20.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0123e-05 2020-11-12T17:25:20.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:20.621639+0000", 2020-11-12T17:25:20.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017317100000000001 2020-11-12T17:25:20.635 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.635 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:20.635 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.635 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.635 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:20.635 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:25:20.636 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:20.637 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:20.646 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:20.646 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:20.646 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:25:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:20.648 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:20.648 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:20.692 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:20.688+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:20.758 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:20.758 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:20.758 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:20.759 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:20.759 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:20.767 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:20.762+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:20.767 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:20.867 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:20.862+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:20.920 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:20.920 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:20.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:20.920 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:20.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.921 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:25:20.921 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:20.921 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 130.41296625999999, 2020-11-12T17:25:20.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:25:20.921 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.921 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:20.921 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:20.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:20.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:20.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:25:20.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:25:20.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:25:20.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:25:20.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:25:20.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:25:20.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:25:20.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:25:20.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:25:20.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:25:20.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:25:20.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:25:20.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:20.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:25:20.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:25:20.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:20.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:25:20.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:25:20.931 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.931 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:20.931 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.932 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:20.932 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:20.932 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 126.390956695, 2020-11-12T17:25:20.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:25:20.932 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.932 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:20.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:20.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:20.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:20.933 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:25:20.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.934 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:20.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:20.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:20.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:25:20.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:25:20.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:25:20.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:25:20.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:25:20.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:25:20.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:25:20.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:25:20.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:25:20.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:25:20.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:25:20.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:25:20.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:20.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:25:20.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:25:20.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:20.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:25:20.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:25:20.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:20.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:25:20.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:25:20.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:20.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:25:20.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:25:20.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:20.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:25:20.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:25:20.943 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.943 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:20.943 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.944 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:25:20.944 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:20.944 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 126.387556761, 2020-11-12T17:25:20.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:25:20.944 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.945 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:20.945 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:20.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:20.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:20.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:25:20.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:25:20.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:25:20.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:25:20.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:25:20.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:25:20.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:25:20.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:25:20.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:25:20.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:25:20.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:25:20.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:25:20.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:20.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:25:20.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:25:20.951 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.951 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:20.951 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.951 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29991 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1679, mlcod=48'1673)", 2020-11-12T17:25:20.952 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:25:20.952 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 90.913031067000006, 2020-11-12T17:25:20.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001, 2020-11-12T17:25:20.952 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.952 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:20.952 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:25:20.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004164+0000", 2020-11-12T17:25:20.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:25:20.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004127+0000", 2020-11-12T17:25:20.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012464900000000001 2020-11-12T17:25:20.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.004251+0000", 2020-11-12T17:25:20.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28639012600000002 2020-11-12T17:25:20.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290641+0000", 2020-11-12T17:25:20.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:25:20.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290646+0000", 2020-11-12T17:25:20.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2363000000000002e-05 2020-11-12T17:25:20.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290679+0000", 2020-11-12T17:25:20.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3289999999999999e-05 2020-11-12T17:25:20.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.290702+0000", 2020-11-12T17:25:20.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014675440000000001 2020-11-12T17:25:20.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:20.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292170+0000", 2020-11-12T17:25:20.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6585000000000001e-05 2020-11-12T17:25:20.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:20.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.292226+0000", 2020-11-12T17:25:20.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28806227400000001 2020-11-12T17:25:20.961 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.961 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:20.961 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.962 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:25:20.962 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:20.962 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 90.911667313999999, 2020-11-12T17:25:20.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:25:20.962 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.962 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:20.962 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:20.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:20.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:20.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:25:20.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:25:20.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:25:20.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:25:20.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:25:20.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:25:20.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:25:20.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:25:20.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:25:20.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:25:20.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:25:20.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:25:20.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:20.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:25:20.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:25:20.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:20.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:25:20.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:25:20.970 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.970 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:20.971 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.971 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:33768 3.d e49/20 3:bed94f4a:::benchmark_data_smithi036_14212_object4220:head v 49'1880, mlcod=49'1874)", 2020-11-12T17:25:20.972 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:25:20.972 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 87.002624265999998, 2020-11-12T17:25:20.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001, 2020-11-12T17:25:20.972 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.972 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:20.972 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:25:20.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914571+0000", 2020-11-12T17:25:20.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:25:20.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914530+0000", 2020-11-12T17:25:20.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013119499999999999 2020-11-12T17:25:20.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.914662+0000", 2020-11-12T17:25:20.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26915680600000003 2020-11-12T17:25:20.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183818+0000", 2020-11-12T17:25:20.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.61e-06 2020-11-12T17:25:20.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183826+0000", 2020-11-12T17:25:20.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2031999999999999e-05 2020-11-12T17:25:20.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183878+0000", 2020-11-12T17:25:20.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1192999999999998e-05 2020-11-12T17:25:20.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.183909+0000", 2020-11-12T17:25:20.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055133250000000003 2020-11-12T17:25:20.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:20.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189422+0000", 2020-11-12T17:25:20.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4030999999999997e-05 2020-11-12T17:25:20.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:20.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.189486+0000", 2020-11-12T17:25:20.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27491586400000001 2020-11-12T17:25:20.981 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.981 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:20.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.982 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:25:20.982 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:20.983 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 81.078973348000005, 2020-11-12T17:25:20.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:25:20.983 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.984 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:20.984 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:20.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:20.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:20.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:25:20.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:25:20.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:25:20.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:25:20.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:25:20.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:25:20.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:25:20.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:25:20.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:25:20.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:25:20.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:25:20.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:25:20.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:20.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:25:20.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:25:20.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:20.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:25:20.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:25:20.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.991 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:20.991 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:20.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.991 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:20.991 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:20.991 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.971681971000002, 2020-11-12T17:25:20.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:25:20.992 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:20.992 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:20.992 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:20.992 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:20.992 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:20.992 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:25:20.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.993 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:20.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:20.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:20.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:20.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:20.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:20.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:25:20.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:20.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:25:20.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:25:20.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:20.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:25:20.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:25:20.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:20.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:25:20.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:25:20.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:20.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:25:20.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:25:20.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:20.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:25:20.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:25:20.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:20.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:25:20.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:25:20.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:20.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:25:20.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:25:20.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:20.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:25:20.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:25:20.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:20.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:20.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:25:21.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:25:21.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:25:21.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:25:21.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:25:21.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:25:21.001 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.001 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.001 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.002 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:59416 3.c 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:21.002 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:21.002 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.389286556000002, 2020-11-12T17:25:21.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998, 2020-11-12T17:25:21.002 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.002 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.003 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59416 2020-11-12T17:25:21.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.003 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:21.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:21.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:21.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527883+0000", 2020-11-12T17:25:21.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2643000000000002e-05 2020-11-12T17:25:21.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527956+0000", 2020-11-12T17:25:21.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:25:21.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527969+0000", 2020-11-12T17:25:21.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2689999999999996e-06 2020-11-12T17:25:21.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527976+0000", 2020-11-12T17:25:21.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043768990000000001 2020-11-12T17:25:21.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532353+0000", 2020-11-12T17:25:21.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011210299999999999 2020-11-12T17:25:21.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532465+0000", 2020-11-12T17:25:21.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017931699999999999 2020-11-12T17:25:21.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:21.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532644+0000", 2020-11-12T17:25:21.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002342341 2020-11-12T17:25:21.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.534986+0000", 2020-11-12T17:25:21.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30120883700000001 2020-11-12T17:25:21.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836195+0000", 2020-11-12T17:25:21.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0408999999999995e-05 2020-11-12T17:25:21.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836276+0000", 2020-11-12T17:25:21.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1774999999999997e-05 2020-11-12T17:25:21.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836337+0000", 2020-11-12T17:25:21.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998 2020-11-12T17:25:21.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.014 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.015 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:25:21.015 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:21.015 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 47.494580896999999, 2020-11-12T17:25:21.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:25:21.015 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.015 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:21.016 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:21.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:21.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:25:21.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:25:21.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:25:21.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:25:21.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:25:21.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:25:21.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:25:21.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:25:21.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:25:21.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:25:21.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:25:21.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:25:21.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:25:21.021 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.021 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.021 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.022 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:25:21.022 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:21.023 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.375570510000003, 2020-11-12T17:25:21.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:25:21.023 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.023 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.023 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.023 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.024 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.024 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:21.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.024 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:21.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:21.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:21.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:25:21.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:25:21.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:25:21.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:25:21.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:25:21.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:25:21.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:25:21.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:25:21.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:25:21.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:25:21.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:25:21.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:25:21.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:21.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:25:21.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:25:21.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:25:21.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:25:21.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:25:21.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:25:21.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:25:21.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:25:21.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:25:21.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:25:21.033 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.033 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.034 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.034 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:25:21.034 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:21.034 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.359432505999997, 2020-11-12T17:25:21.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:25:21.035 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.035 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.035 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:21.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:21.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:21.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:25:21.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:25:21.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:25:21.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:25:21.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:25:21.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:25:21.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:25:21.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:25:21.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:25:21.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:25:21.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:25:21.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:25:21.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:25:21.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:25:21.041 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.041 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.041 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.042 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:25:21.042 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:21.042 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.354704826999999, 2020-11-12T17:25:21.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:25:21.042 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.042 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:25:21.043 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.043 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.043 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.043 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:21.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.043 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:21.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:21.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:21.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:25:21.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:25:21.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:25:21.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:25:21.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:25:21.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:25:21.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:25:21.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:25:21.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:25:21.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:25:21.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:21.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:25:21.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:25:21.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:25:21.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:25:21.050 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.050 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.050 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.050 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:424 4.8 4:15a22128:::benchmark_data_smithi036_18856_object52:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:21.050 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:21.051 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.696675089999999, 2020-11-12T17:25:21.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002, 2020-11-12T17:25:21.051 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.051 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.051 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.051 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:21.051 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:21.051 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 424 2020-11-12T17:25:21.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.052 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:21.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:21.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:21.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220491+0000", 2020-11-12T17:25:21.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7780000000000003e-05 2020-11-12T17:25:21.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220579+0000", 2020-11-12T17:25:21.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1511e-05 2020-11-12T17:25:21.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220590+0000", 2020-11-12T17:25:21.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9410000000000004e-06 2020-11-12T17:25:21.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220596+0000", 2020-11-12T17:25:21.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027076259999999999 2020-11-12T17:25:21.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223304+0000", 2020-11-12T17:25:21.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102644 2020-11-12T17:25:21.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223406+0000", 2020-11-12T17:25:21.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017898600000000001 2020-11-12T17:25:21.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:21.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223585+0000", 2020-11-12T17:25:21.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000774389 2020-11-12T17:25:21.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224360+0000", 2020-11-12T17:25:21.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30234014999999997 2020-11-12T17:25:21.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526700+0000", 2020-11-12T17:25:21.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5360999999999999e-05 2020-11-12T17:25:21.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526775+0000", 2020-11-12T17:25:21.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6470000000000001e-05 2020-11-12T17:25:21.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526812+0000", 2020-11-12T17:25:21.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002 2020-11-12T17:25:21.061 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.061 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.061 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.062 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:424 4.8 e71/69 ondisk, result = 0)", 2020-11-12T17:25:21.062 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:21.062 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.692223551000001, 2020-11-12T17:25:21.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474, 2020-11-12T17:25:21.062 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.062 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.063 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:21.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:21.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:21.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224949+0000", 2020-11-12T17:25:21.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8579000000000003e-05 2020-11-12T17:25:21.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.225008+0000", 2020-11-12T17:25:21.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30161437000000002 2020-11-12T17:25:21.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526622+0000", 2020-11-12T17:25:21.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1900000000000003e-06 2020-11-12T17:25:21.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526628+0000", 2020-11-12T17:25:21.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8828000000000001e-05 2020-11-12T17:25:21.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526676+0000", 2020-11-12T17:25:21.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1576000000000001e-05 2020-11-12T17:25:21.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526688+0000", 2020-11-12T17:25:21.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012879999999999999 2020-11-12T17:25:21.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526817+0000", 2020-11-12T17:25:21.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474 2020-11-12T17:25:21.070 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.070 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.070 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.070 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11951 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:21.071 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:21.072 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.826205238, 2020-11-12T17:25:21.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998, 2020-11-12T17:25:21.072 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.072 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:21.073 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:21.073 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11951 2020-11-12T17:25:21.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.073 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:21.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:21.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:25:21.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090956+0000", 2020-11-12T17:25:21.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110012 2020-11-12T17:25:21.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091066+0000", 2020-11-12T17:25:21.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2517000000000001e-05 2020-11-12T17:25:21.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091078+0000", 2020-11-12T17:25:21.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.421e-06 2020-11-12T17:25:21.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091085+0000", 2020-11-12T17:25:21.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052388110000000003 2020-11-12T17:25:21.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096323+0000", 2020-11-12T17:25:21.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010759 2020-11-12T17:25:21.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096431+0000", 2020-11-12T17:25:21.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018636600000000001 2020-11-12T17:25:21.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:21.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096617+0000", 2020-11-12T17:25:21.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018824309999999999 2020-11-12T17:25:21.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098500+0000", 2020-11-12T17:25:21.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29523157 2020-11-12T17:25:21.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393731+0000", 2020-11-12T17:25:21.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7910999999999994e-05 2020-11-12T17:25:21.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393799+0000", 2020-11-12T17:25:21.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101962 2020-11-12T17:25:21.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393901+0000", 2020-11-12T17:25:21.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998 2020-11-12T17:25:21.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.085 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.086 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11952 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:21.086 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:21.086 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.826054417000002, 2020-11-12T17:25:21.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002, 2020-11-12T17:25:21.086 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.087 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.087 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.087 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:21.087 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:21.087 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11952 2020-11-12T17:25:21.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.087 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:21.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:21.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:21.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091107+0000", 2020-11-12T17:25:21.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011024200000000001 2020-11-12T17:25:21.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091218+0000", 2020-11-12T17:25:21.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2203e-05 2020-11-12T17:25:21.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091230+0000", 2020-11-12T17:25:21.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.694e-06 2020-11-12T17:25:21.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091236+0000", 2020-11-12T17:25:21.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076783260000000001 2020-11-12T17:25:21.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098914+0000", 2020-11-12T17:25:21.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3187000000000001e-05 2020-11-12T17:25:21.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099007+0000", 2020-11-12T17:25:21.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016888299999999999 2020-11-12T17:25:21.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:21.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099176+0000", 2020-11-12T17:25:21.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012571570000000001 2020-11-12T17:25:21.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100433+0000", 2020-11-12T17:25:21.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29596956499999999 2020-11-12T17:25:21.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396403+0000", 2020-11-12T17:25:21.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0348999999999999e-05 2020-11-12T17:25:21.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396483+0000", 2020-11-12T17:25:21.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8981000000000003e-05 2020-11-12T17:25:21.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396542+0000", 2020-11-12T17:25:21.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002 2020-11-12T17:25:21.102 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.102 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.102 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.103 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11951 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:21.104 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:21.104 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.818526992999999, 2020-11-12T17:25:21.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998, 2020-11-12T17:25:21.104 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.104 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.105 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:21.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:21.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:21.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098644+0000", 2020-11-12T17:25:21.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2123000000000001e-05 2020-11-12T17:25:21.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098706+0000", 2020-11-12T17:25:21.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.294880011 2020-11-12T17:25:21.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393586+0000", 2020-11-12T17:25:21.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:21.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393595+0000", 2020-11-12T17:25:21.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115302 2020-11-12T17:25:21.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393710+0000", 2020-11-12T17:25:21.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2968e-05 2020-11-12T17:25:21.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393723+0000", 2020-11-12T17:25:21.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018932500000000001 2020-11-12T17:25:21.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393913+0000", 2020-11-12T17:25:21.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998 2020-11-12T17:25:21.113 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.113 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.113 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.114 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11952 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:21.114 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:21.114 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.816427217000001, 2020-11-12T17:25:21.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999, 2020-11-12T17:25:21.115 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.115 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.115 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:21.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:21.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:21.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100743+0000", 2020-11-12T17:25:21.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2359000000000004e-05 2020-11-12T17:25:21.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100805+0000", 2020-11-12T17:25:21.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29550863300000002 2020-11-12T17:25:21.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396314+0000", 2020-11-12T17:25:21.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6940000000000003e-06 2020-11-12T17:25:21.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396318+0000", 2020-11-12T17:25:21.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8325999999999997e-05 2020-11-12T17:25:21.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396377+0000", 2020-11-12T17:25:21.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4015999999999999e-05 2020-11-12T17:25:21.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396391+0000", 2020-11-12T17:25:21.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015908 2020-11-12T17:25:21.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396550+0000", 2020-11-12T17:25:21.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999 2020-11-12T17:25:21.123 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.123 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.123 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.123 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:27264 4.1 e81/69 4:8cfa79b8:::benchmark_data_smithi036_18856_object3407:head v 81'1736, mlcod=81'1730)", 2020-11-12T17:25:21.123 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:21.124 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.6128774259999998, 2020-11-12T17:25:21.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999, 2020-11-12T17:25:21.124 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.124 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.124 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:21.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:21.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:21.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304300+0000", 2020-11-12T17:25:21.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0590000000000001e-05 2020-11-12T17:25:21.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304360+0000", 2020-11-12T17:25:21.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29159615 2020-11-12T17:25:21.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595957+0000", 2020-11-12T17:25:21.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9299999999999997e-06 2020-11-12T17:25:21.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595963+0000", 2020-11-12T17:25:21.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8519000000000001e-05 2020-11-12T17:25:21.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596012+0000", 2020-11-12T17:25:21.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3053000000000001e-05 2020-11-12T17:25:21.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596035+0000", 2020-11-12T17:25:21.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001402122 2020-11-12T17:25:21.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597437+0000", 2020-11-12T17:25:21.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0948999999999997e-05 2020-11-12T17:25:21.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597478+0000", 2020-11-12T17:25:21.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999 2020-11-12T17:25:21.131 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.131 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.131 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.132 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.132 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.132 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:21.133 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 29 16 30239 30223 8.14115 6.27344 0.123211 0.0152417 2020-11-12T17:25:21.134 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:21.134 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:21.130+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:21.234 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:21.228+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:21.304 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:21.304 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:21.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.304 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:30589 4.d e83/69 4:b5673588:::benchmark_data_smithi036_18856_object3823:head v 83'2093, mlcod=83'2087)", 2020-11-12T17:25:21.305 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:21.301718+0000", 2020-11-12T17:25:21.305 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0018164749999999999, 2020-11-12T17:25:21.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001833817, 2020-11-12T17:25:21.305 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.305 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.306 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.301718+0000", 2020-11-12T17:25:21.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.301718+0000", 2020-11-12T17:25:21.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:25:21.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.301679+0000", 2020-11-12T17:25:21.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120928 2020-11-12T17:25:21.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.301800+0000", 2020-11-12T17:25:21.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1248999999999994e-05 2020-11-12T17:25:21.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.301881+0000", 2020-11-12T17:25:21.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7309999999999999e-06 2020-11-12T17:25:21.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.301890+0000", 2020-11-12T17:25:21.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532999999999999 2020-11-12T17:25:21.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.302055+0000", 2020-11-12T17:25:21.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8818e-05 2020-11-12T17:25:21.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.302094+0000", 2020-11-12T17:25:21.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037638199999999998 2020-11-12T17:25:21.312 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.312 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.312 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.313 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:30586 4.d e83/69 4:b5673588:::benchmark_data_smithi036_18856_object3823:head v 83'2090, mlcod=83'2087)", 2020-11-12T17:25:21.313 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:21.296308+0000", 2020-11-12T17:25:21.313 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0072266639999999998, 2020-11-12T17:25:21.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0072906760000000003, 2020-11-12T17:25:21.313 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.314 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.314 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.296308+0000", 2020-11-12T17:25:21.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.296308+0000", 2020-11-12T17:25:21.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:21.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.296279+0000", 2020-11-12T17:25:21.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5888000000000001e-05 2020-11-12T17:25:21.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.296375+0000", 2020-11-12T17:25:21.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8454999999999994e-05 2020-11-12T17:25:21.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.296443+0000", 2020-11-12T17:25:21.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1180000000000003e-06 2020-11-12T17:25:21.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.296450+0000", 2020-11-12T17:25:21.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00066617300000000005 2020-11-12T17:25:21.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.297117+0000", 2020-11-12T17:25:21.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2983e-05 2020-11-12T17:25:21.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.297139+0000", 2020-11-12T17:25:21.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000831969 2020-11-12T17:25:21.320 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.320 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.321 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.321 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:30583 4.4 e83/69 4:2666ba26:::benchmark_data_smithi036_18856_object3822:head v 83'1695, mlcod=83'1689)", 2020-11-12T17:25:21.321 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:21.295630+0000", 2020-11-12T17:25:21.321 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0079042739999999993, 2020-11-12T17:25:21.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00800646, 2020-11-12T17:25:21.322 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.322 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.322 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.295630+0000", 2020-11-12T17:25:21.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.295630+0000", 2020-11-12T17:25:21.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999958 2020-11-12T17:25:21.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.295588+0000", 2020-11-12T17:25:21.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013957600000000001 2020-11-12T17:25:21.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.295728+0000", 2020-11-12T17:25:21.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001106311 2020-11-12T17:25:21.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.296834+0000", 2020-11-12T17:25:21.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9070000000000004e-06 2020-11-12T17:25:21.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.296840+0000", 2020-11-12T17:25:21.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000201392 2020-11-12T17:25:21.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.297041+0000", 2020-11-12T17:25:21.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8e-05 2020-11-12T17:25:21.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.297069+0000", 2020-11-12T17:25:21.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014393260000000001 2020-11-12T17:25:21.329 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.329 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.329 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.329 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:30587 4.d e83/69 4:b5673588:::benchmark_data_smithi036_18856_object3823:head v 83'2091, mlcod=83'2087)", 2020-11-12T17:25:21.330 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:21.298060+0000", 2020-11-12T17:25:21.330 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0054737370000000002, 2020-11-12T17:25:21.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056124800000000004, 2020-11-12T17:25:21.330 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.330 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.330 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.298060+0000", 2020-11-12T17:25:21.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.298060+0000", 2020-11-12T17:25:21.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:25:21.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.298014+0000", 2020-11-12T17:25:21.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014806199999999999 2020-11-12T17:25:21.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.298162+0000", 2020-11-12T17:25:21.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0672000000000003e-05 2020-11-12T17:25:21.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.298243+0000", 2020-11-12T17:25:21.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6059999999999992e-06 2020-11-12T17:25:21.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.298253+0000", 2020-11-12T17:25:21.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020121399999999999 2020-11-12T17:25:21.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.298454+0000", 2020-11-12T17:25:21.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6191000000000001e-05 2020-11-12T17:25:21.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.298470+0000", 2020-11-12T17:25:21.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00040963499999999999 2020-11-12T17:25:21.337 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.337 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.337 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.338 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:30588 4.d e83/69 4:b5673588:::benchmark_data_smithi036_18856_object3823:head v 83'2092, mlcod=83'2087)", 2020-11-12T17:25:21.338 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:21.300297+0000", 2020-11-12T17:25:21.338 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.003237429, 2020-11-12T17:25:21.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034187499999999999, 2020-11-12T17:25:21.339 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.339 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.339 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.300297+0000", 2020-11-12T17:25:21.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.300297+0000", 2020-11-12T17:25:21.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:21.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.300253+0000", 2020-11-12T17:25:21.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014597899999999999 2020-11-12T17:25:21.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.300399+0000", 2020-11-12T17:25:21.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8968000000000006e-05 2020-11-12T17:25:21.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.300488+0000", 2020-11-12T17:25:21.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0044000000000001e-05 2020-11-12T17:25:21.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.300498+0000", 2020-11-12T17:25:21.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035559300000000002 2020-11-12T17:25:21.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.300853+0000", 2020-11-12T17:25:21.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2264999999999997e-05 2020-11-12T17:25:21.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.300886+0000", 2020-11-12T17:25:21.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00058881299999999999 2020-11-12T17:25:21.346 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.347 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.347 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.347 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.347 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:21.347 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 5 2020-11-12T17:25:21.347 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:21.349 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:21.350 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:21.344+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:21.428 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:25:21.476 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:21.472+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:21.477 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:21.477 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:21.478 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:21.478 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:21.478 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:21.492 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:21.552 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:21.546+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:21.618 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:21.618 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:21.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:21.619 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:21.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.619 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:25:21.619 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:21.619 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.945552693, 2020-11-12T17:25:21.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:25:21.620 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.620 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:21.620 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.620 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.620 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.620 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:25:21.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.621 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:21.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:21.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:25:21.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:25:21.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:25:21.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:25:21.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:25:21.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:25:21.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:25:21.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:25:21.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:25:21.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:25:21.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:25:21.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:25:21.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:25:21.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:25:21.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:25:21.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:25:21.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:25:21.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:25:21.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:25:21.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:25:21.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:25:21.629 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.630 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.630 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.630 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.630 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:21.630 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.945150332, 2020-11-12T17:25:21.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:25:21.631 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.631 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.631 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.631 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.631 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.632 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:25:21.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.632 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:21.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:21.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:25:21.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:25:21.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:25:21.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:25:21.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:25:21.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:25:21.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:25:21.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:25:21.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:25:21.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:25:21.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:25:21.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:25:21.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:25:21.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:25:21.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:25:21.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:25:21.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:25:21.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:25:21.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:25:21.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:25:21.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:25:21.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:25:21.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:25:21.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:25:21.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:25:21.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:25:21.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:25:21.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:25:21.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:25:21.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:25:21.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:25:21.644 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.644 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.645 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.645 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.645 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:21.645 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.944826339, 2020-11-12T17:25:21.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:25:21.646 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.646 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.646 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.646 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.646 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.646 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:25:21.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.647 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:21.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:21.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:25:21.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:25:21.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:25:21.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:25:21.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:25:21.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:25:21.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:25:21.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:25:21.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:25:21.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:25:21.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:25:21.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:25:21.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:25:21.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:25:21.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:25:21.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:25:21.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:25:21.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:25:21.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:25:21.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:25:21.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:25:21.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:25:21.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:25:21.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:25:21.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:25:21.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:25:21.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:25:21.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:25:21.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:25:21.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:25:21.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:25:21.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.658 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.659 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.659 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:21.659 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.94458262800001, 2020-11-12T17:25:21.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:25:21.659 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.659 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.659 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.660 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:25:21.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.660 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:21.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:21.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:21.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:25:21.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:25:21.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:25:21.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:25:21.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:25:21.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:25:21.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:25:21.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:25:21.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:25:21.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:25:21.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:25:21.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:25:21.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:25:21.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:25:21.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:25:21.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:25:21.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:25:21.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:25:21.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:25:21.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:25:21.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:25:21.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:25:21.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:25:21.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:25:21.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:25:21.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:25:21.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:25:21.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:25:21.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:25:21.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:25:21.671 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.672 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.672 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.672 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.672 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:21.672 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.944344481, 2020-11-12T17:25:21.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:25:21.673 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.673 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.673 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.673 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.673 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.673 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:25:21.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.674 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:21.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:21.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:25:21.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:25:21.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:25:21.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:25:21.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:25:21.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:25:21.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:25:21.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:25:21.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:25:21.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:25:21.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:25:21.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:25:21.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:25:21.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:25:21.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:25:21.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:25:21.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:25:21.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:25:21.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:25:21.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:25:21.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:25:21.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:25:21.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:25:21.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:25:21.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:25:21.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:25:21.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:25:21.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:25:21.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:25:21.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:25:21.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:25:21.689 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.689 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.689 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.690 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.690 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:21.690 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.944142441, 2020-11-12T17:25:21.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:25:21.690 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.691 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.691 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.691 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.691 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.691 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:25:21.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.691 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:21.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:21.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:21.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:25:21.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:25:21.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:25:21.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:25:21.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:25:21.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:25:21.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:25:21.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:25:21.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:25:21.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:25:21.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:25:21.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:25:21.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:25:21.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:25:21.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:25:21.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:25:21.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:25:21.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:25:21.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:25:21.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:25:21.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:25:21.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:25:21.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:25:21.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:25:21.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:25:21.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:25:21.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:25:21.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:25:21.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:25:21.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:25:21.703 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.703 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.704 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.704 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:21.704 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.94393707099999, 2020-11-12T17:25:21.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:25:21.705 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.705 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.705 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.705 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.705 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.705 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:25:21.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.706 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:21.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:21.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:21.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:25:21.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:25:21.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:25:21.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:25:21.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:25:21.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:25:21.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:25:21.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:25:21.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:25:21.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:25:21.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:25:21.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:25:21.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:25:21.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:25:21.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:25:21.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:25:21.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:25:21.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:25:21.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:25:21.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:25:21.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:25:21.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:25:21.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:25:21.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:25:21.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:25:21.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:25:21.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:25:21.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:25:21.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:25:21.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:25:21.717 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.717 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.717 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.718 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.718 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:21.718 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.943751244, 2020-11-12T17:25:21.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:25:21.718 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.718 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.719 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.719 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.719 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.719 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:25:21.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.719 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:21.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:21.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:21.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:25:21.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:25:21.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:25:21.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:25:21.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:25:21.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:25:21.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:25:21.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:25:21.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:25:21.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:25:21.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:25:21.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:25:21.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:25:21.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:25:21.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:25:21.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:25:21.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:25:21.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:25:21.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:25:21.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:25:21.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:25:21.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:25:21.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:25:21.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:25:21.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:25:21.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:25:21.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:25:21.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:25:21.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:25:21.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:25:21.731 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.731 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.731 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.731 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.731 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:21.732 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.94355428, 2020-11-12T17:25:21.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:25:21.732 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.732 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.733 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:25:21.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.733 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:21.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:21.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:25:21.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:25:21.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:25:21.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:25:21.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:25:21.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:25:21.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:25:21.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:25:21.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:25:21.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:25:21.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:25:21.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:25:21.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:25:21.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:25:21.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:25:21.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:25:21.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:25:21.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:25:21.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:25:21.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:25:21.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:25:21.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:25:21.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:25:21.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:25:21.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:25:21.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:25:21.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:25:21.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:25:21.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:25:21.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:25:21.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:25:21.744 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.745 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.745 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.745 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.745 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:21.745 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.94335825, 2020-11-12T17:25:21.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:25:21.746 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.746 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.746 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.746 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.746 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.746 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:25:21.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.747 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:21.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:21.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:21.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:25:21.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:25:21.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:25:21.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:25:21.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:25:21.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:25:21.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:25:21.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:25:21.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:25:21.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:25:21.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:25:21.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:25:21.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:25:21.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:25:21.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:25:21.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:25:21.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:25:21.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:25:21.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:25:21.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:25:21.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:25:21.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:25:21.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:25:21.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:25:21.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:25:21.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:25:21.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:25:21.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:25:21.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:25:21.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:25:21.759 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.759 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.759 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.759 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.759 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:21.759 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.94317744999999, 2020-11-12T17:25:21.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:25:21.760 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.760 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.760 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.760 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.760 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.760 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:25:21.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.761 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:21.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:21.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:21.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:25:21.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:25:21.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:25:21.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:25:21.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:25:21.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:25:21.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:25:21.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:25:21.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:25:21.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:25:21.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:25:21.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:25:21.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:25:21.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:25:21.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:25:21.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:25:21.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:25:21.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:25:21.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:25:21.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:25:21.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:25:21.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:25:21.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:25:21.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:25:21.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:25:21.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:25:21.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:25:21.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:25:21.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:25:21.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:25:21.772 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.772 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.772 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.772 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.773 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:21.773 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.94298149700001, 2020-11-12T17:25:21.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:25:21.773 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.773 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.773 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.773 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.773 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.774 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:25:21.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.774 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:21.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:21.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:21.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:25:21.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:25:21.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:25:21.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:25:21.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:25:21.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:21.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:25:21.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:25:21.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:25:21.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:25:21.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:25:21.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:25:21.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:25:21.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:25:21.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:25:21.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:25:21.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:25:21.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:25:21.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:25:21.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:25:21.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:25:21.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:25:21.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:25:21.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:25:21.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:25:21.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:25:21.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:25:21.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:25:21.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:25:21.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:25:21.786 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.786 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.786 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.787 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.787 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:21.787 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.942787889, 2020-11-12T17:25:21.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:25:21.787 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.787 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.788 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.788 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:25:21.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.788 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:21.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:21.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:25:21.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:25:21.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:25:21.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:25:21.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:25:21.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:25:21.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:25:21.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:25:21.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:25:21.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:25:21.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:25:21.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:25:21.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:25:21.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:25:21.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:25:21.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:25:21.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:25:21.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:25:21.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:25:21.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:25:21.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:25:21.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:25:21.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:25:21.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:25:21.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:25:21.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:25:21.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:25:21.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:25:21.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:25:21.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:25:21.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:25:21.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.800 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.800 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.800 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.800 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:21.800 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.94247602599999, 2020-11-12T17:25:21.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:25:21.801 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.801 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.801 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:25:21.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.802 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:21.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:21.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:25:21.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:25:21.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:25:21.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:25:21.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:25:21.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:25:21.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:25:21.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:25:21.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:25:21.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:25:21.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:25:21.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:25:21.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:25:21.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:25:21.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:25:21.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:25:21.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:25:21.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:25:21.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:25:21.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:25:21.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:25:21.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:25:21.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:25:21.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:25:21.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:25:21.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:25:21.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:25:21.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:25:21.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:25:21.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:25:21.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:25:21.814 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.814 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.814 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.814 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.814 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:21.814 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.94218852900001, 2020-11-12T17:25:21.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:25:21.815 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.815 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.815 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.815 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.815 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.815 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:25:21.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.816 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:21.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:21.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:25:21.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:25:21.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:25:21.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:25:21.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:25:21.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:25:21.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:25:21.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:25:21.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:25:21.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:25:21.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:25:21.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:25:21.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:25:21.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:25:21.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:25:21.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:25:21.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:25:21.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:25:21.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:25:21.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:25:21.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:25:21.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:25:21.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:25:21.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:25:21.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:25:21.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:25:21.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:25:21.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:25:21.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:25:21.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:25:21.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:25:21.828 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.828 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.829 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.829 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:21.829 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:21.829 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 121.94196815799999, 2020-11-12T17:25:21.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:25:21.829 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.830 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.830 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.830 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.830 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.830 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:25:21.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.830 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:21.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:21.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:25:21.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:25:21.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:25:21.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:25:21.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:25:21.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:25:21.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:25:21.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:25:21.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:25:21.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:25:21.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:25:21.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:21.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:25:21.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:25:21.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:25:21.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:25:21.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:21.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:25:21.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:25:21.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:25:21.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:25:21.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:25:21.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:25:21.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:25:21.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:25:21.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:25:21.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:25:21.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:25:21.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:25:21.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:25:21.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:25:21.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:25:21.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:25:21.842 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.843 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.843 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.843 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:20904 3.0 e42/35 3:07649b2f:::benchmark_data_smithi036_14212_object2612:head v 42'1120, mlcod=42'1114)", 2020-11-12T17:25:21.843 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:25:21.843 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.00131585299999, 2020-11-12T17:25:21.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999, 2020-11-12T17:25:21.844 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.844 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.844 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:25:21.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613873+0000", 2020-11-12T17:25:21.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:21.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613848+0000", 2020-11-12T17:25:21.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3206000000000004e-05 2020-11-12T17:25:21.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.613911+0000", 2020-11-12T17:25:21.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38330512799999999 2020-11-12T17:25:21.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997216+0000", 2020-11-12T17:25:21.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8860000000000004e-06 2020-11-12T17:25:21.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997224+0000", 2020-11-12T17:25:21.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000129011 2020-11-12T17:25:21.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997353+0000", 2020-11-12T17:25:21.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9062999999999999e-05 2020-11-12T17:25:21.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.997382+0000", 2020-11-12T17:25:21.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018580370000000001 2020-11-12T17:25:21.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999240+0000", 2020-11-12T17:25:21.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6116999999999998e-05 2020-11-12T17:25:21.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:40.999296+0000", 2020-11-12T17:25:21.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38542300099999999 2020-11-12T17:25:21.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.851 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.851 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:21.851 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:21.851 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.170514311999995, 2020-11-12T17:25:21.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:25:21.852 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.852 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:21.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:21.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:21.852 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:25:21.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.853 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:21.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:21.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:21.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:25:21.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:25:21.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:25:21.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:25:21.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:25:21.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:25:21.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:25:21.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:25:21.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:25:21.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:25:21.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:25:21.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:25:21.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:21.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:25:21.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:25:21.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:21.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:25:21.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:25:21.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:21.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:25:21.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:25:21.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:25:21.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:25:21.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:25:21.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:25:21.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.861 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.862 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:25496 3.a e46/31 ondisk, result = 0)", 2020-11-12T17:25:21.862 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:25:21.862 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.164586799999995, 2020-11-12T17:25:21.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999, 2020-11-12T17:25:21.862 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.862 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:21.863 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:25:21.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:25:21.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:21.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450588+0000", 2020-11-12T17:25:21.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5475000000000002e-05 2020-11-12T17:25:21.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450623+0000", 2020-11-12T17:25:21.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46380360799999998 2020-11-12T17:25:21.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914427+0000", 2020-11-12T17:25:21.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7369999999999995e-06 2020-11-12T17:25:21.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914436+0000", 2020-11-12T17:25:21.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001408212 2020-11-12T17:25:21.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915844+0000", 2020-11-12T17:25:21.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0029e-05 2020-11-12T17:25:21.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915854+0000", 2020-11-12T17:25:21.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014011899999999999 2020-11-12T17:25:21.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915994+0000", 2020-11-12T17:25:21.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999 2020-11-12T17:25:21.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.871 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.871 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:25:21.871 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:21.871 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.850225410999997, 2020-11-12T17:25:21.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:25:21.872 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:21.872 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:21.872 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:21.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:21.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:21.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:21.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:21.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:21.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:21.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:21.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:25:21.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:25:21.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:21.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:25:21.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:25:21.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:21.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:25:21.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:25:21.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:21.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:25:21.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:25:21.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:21.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:25:21.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:25:21.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:21.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:25:21.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:25:21.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:21.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:25:21.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:25:21.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:21.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:21.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:21.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:25:21.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:25:21.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.879 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.880 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.880 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:21.880 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:21.880 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:21.881 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:21.878+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:21.882 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:21.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 30 16 31203 31187 8.1208 7.53125 0.00833525 0.0153699 2020-11-12T17:25:21.983 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:21.978+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:22.045 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:22.046 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:22.046 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:25:22.046 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:22.058 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:22.100 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:22.098+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:22.184 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:22.182+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:22.217 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:22.218 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:22.218 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:22.218 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:22.218 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:22.227 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:22.312 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:22.310+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:22.386 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:22.380+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:22.392 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:22.392 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:22.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:22.393 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:22.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.393 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:25:22.393 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:22.393 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 133.54796938600001, 2020-11-12T17:25:22.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:25:22.394 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:22.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:25:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:25:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:25:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:25:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:25:22.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:25:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:25:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:25:22.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:25:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:25:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:25:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:25:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:25:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:25:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.88931884300001, 2020-11-12T17:25:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:25:22.407 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:25:22.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:25:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:25:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:25:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:25:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:25:22.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:25:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:25:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:25:22.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:25:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:25:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:25:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:25:22.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:25:22.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:25:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:25:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:25:22.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:22.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:25:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:25:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:25:22.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:25:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:25:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:25:22.423 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:22.425 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.88771378300001, 2020-11-12T17:25:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:25:22.426 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:22.427 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:22.428 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:25:22.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.428 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:22.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:22.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:22.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:25:22.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:25:22.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:25:22.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:25:22.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:25:22.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:25:22.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:25:22.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:25:22.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:25:22.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:25:22.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:25:22.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:25:22.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:22.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:25:22.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:25:22.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:22.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:25:22.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:25:22.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:22.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:25:22.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:25:22.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:25:22.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:25:22.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:25:22.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:25:22.445 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.445 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.445 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.445 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:22.446 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:22.446 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.990218779, 2020-11-12T17:25:22.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:25:22.446 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.446 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.446 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:22.447 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:22.447 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:22.447 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:25:22.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.447 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:22.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:22.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:22.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:25:22.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:25:22.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:25:22.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:25:22.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:25:22.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:25:22.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:25:22.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:25:22.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:25:22.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:25:22.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:25:22.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:25:22.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:22.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:25:22.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:25:22.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:22.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:25:22.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:25:22.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:22.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:25:22.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:25:22.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:25:22.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:25:22.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:25:22.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:25:22.457 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.458 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.458 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:22.458 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:22.458 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.98777216400001, 2020-11-12T17:25:22.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:25:22.459 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.459 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.459 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:22.459 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:22.459 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:22.460 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:25:22.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.460 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:22.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:22.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:22.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:25:22.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:25:22.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:25:22.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:25:22.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:25:22.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:25:22.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:25:22.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:25:22.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:25:22.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:25:22.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:25:22.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:25:22.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:22.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:25:22.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:25:22.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:22.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:25:22.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:25:22.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:22.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:25:22.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:25:22.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:25:22.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:25:22.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:25:22.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:25:22.470 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.470 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.470 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.471 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:22.471 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:22.471 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.981947717, 2020-11-12T17:25:22.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:25:22.471 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.472 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:22.472 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:22.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:22.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:22.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:25:22.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:25:22.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:25:22.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:25:22.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:25:22.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:25:22.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:25:22.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:25:22.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:25:22.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:25:22.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:25:22.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:25:22.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:25:22.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:25:22.479 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.479 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.479 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.480 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:22.480 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:22.480 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.98187984099999, 2020-11-12T17:25:22.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:25:22.480 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.480 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:22.480 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:22.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:22.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:22.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:25:22.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:25:22.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:25:22.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:25:22.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:25:22.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:25:22.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:25:22.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:25:22.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:25:22.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:25:22.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:25:22.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:25:22.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:25:22.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:25:22.487 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.487 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.488 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:25:22.488 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:22.488 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 97.855889572999999, 2020-11-12T17:25:22.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:25:22.489 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.489 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.489 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:22.489 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:22.489 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:22.489 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:25:22.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.490 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:22.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:22.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:25:22.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:25:22.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:25:22.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:25:22.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:25:22.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:25:22.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:25:22.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:25:22.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:25:22.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:25:22.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:25:22.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:25:22.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:25:22.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:22.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:25:22.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:25:22.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:22.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:25:22.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:25:22.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:22.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:25:22.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:25:22.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:25:22.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:25:22.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:25:22.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:25:22.500 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.500 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.500 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.501 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:25:22.501 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:22.501 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 97.848585854000007, 2020-11-12T17:25:22.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:25:22.502 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.502 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:22.502 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:22.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:22.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:25:22.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:25:22.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:25:22.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:25:22.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:25:22.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:25:22.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:25:22.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:25:22.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:25:22.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:25:22.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:22.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:25:22.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:25:22.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:25:22.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:25:22.509 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.509 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.509 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.510 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:22.510 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:22.510 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 97.475007360999996, 2020-11-12T17:25:22.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:25:22.510 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.510 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:22.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:22.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:22.511 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:25:22.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.511 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:22.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:22.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:22.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:25:22.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:25:22.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:25:22.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:25:22.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:25:22.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:25:22.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:25:22.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:25:22.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:25:22.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:25:22.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:25:22.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:25:22.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:22.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:25:22.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:25:22.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:22.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:25:22.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:25:22.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:22.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:25:22.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:25:22.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:25:22.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:25:22.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:25:22.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:25:22.521 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.522 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.522 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:25:22.522 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:22.523 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 97.463454240999994, 2020-11-12T17:25:22.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:25:22.523 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.523 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:22.523 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:22.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:22.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:22.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:25:22.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:25:22.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:25:22.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:25:22.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:25:22.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:25:22.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:25:22.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:25:22.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:25:22.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:25:22.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:25:22.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:25:22.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:25:22.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:25:22.530 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.530 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.530 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.531 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:22.531 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:22.531 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.390334060000001, 2020-11-12T17:25:22.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:25:22.532 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.532 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.532 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:22.532 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:22.532 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:22.532 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:25:22.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.533 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:22.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:22.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:22.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:25:22.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:25:22.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:25:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:25:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:25:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:25:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:25:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:25:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:25:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:25:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:25:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:25:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:25:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:25:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:25:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:25:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:25:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:25:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:25:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:25:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:25:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:25:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 83.103034347000005, 2020-11-12T17:25:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:25:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:25:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:25:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:25:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:25:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:25:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:25:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:25:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:25:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:25:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:25:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:25:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:25:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:25:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:25:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:25:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:25:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:25:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:25:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:25:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:25:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:25:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:25:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:25:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 82.557641356999994, 2020-11-12T17:25:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:25:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:25:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:25:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:25:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:25:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:25:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:25:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:25:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:25:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:25:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:25:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:25:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:25:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:25:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:25:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:25:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:25:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:25:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:25:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:25:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:25:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:25:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:25:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:25:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:25:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 60.565091097, 2020-11-12T17:25:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:25:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:25:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:25:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:25:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:25:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:25:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:25:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:25:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:25:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:25:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:25:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:25:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:25:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:25:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:25:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:25:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:25:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57960 3.7 e57/20 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head v 57'3648, mlcod=57'3642)", 2020-11-12T17:25:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.661358329000002, 2020-11-12T17:25:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998, 2020-11-12T17:25:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729033+0000", 2020-11-12T17:25:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001002 2020-11-12T17:25:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729133+0000", 2020-11-12T17:25:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30451762900000001 2020-11-12T17:25:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033650+0000", 2020-11-12T17:25:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2909999999999998e-06 2020-11-12T17:25:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033656+0000", 2020-11-12T17:25:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1718000000000003e-05 2020-11-12T17:25:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033697+0000", 2020-11-12T17:25:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2977999999999999e-05 2020-11-12T17:25:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033720+0000", 2020-11-12T17:25:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058524529999999996 2020-11-12T17:25:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039573+0000", 2020-11-12T17:25:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2095999999999997e-05 2020-11-12T17:25:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039625+0000", 2020-11-12T17:25:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998 2020-11-12T17:25:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:25:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.729254924999999, 2020-11-12T17:25:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:25:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:25:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:25:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:25:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:25:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:25:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:25:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:25:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:25:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:25:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:25:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:25:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:25:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:25:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:25:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:25:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:25:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:1240 4.a e71/69 4:5ae32822:::benchmark_data_smithi036_18856_object154:head v 71'104, mlcod=71'98)", 2020-11-12T17:25:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.413040384999999, 2020-11-12T17:25:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295, 2020-11-12T17:25:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977341+0000", 2020-11-12T17:25:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013138399999999999 2020-11-12T17:25:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977473+0000", 2020-11-12T17:25:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011075199999998 2020-11-12T17:25:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337584+0000", 2020-11-12T17:25:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2939999999999994e-06 2020-11-12T17:25:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337593+0000", 2020-11-12T17:25:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0656999999999996e-05 2020-11-12T17:25:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337684+0000", 2020-11-12T17:25:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819999999999997e-05 2020-11-12T17:25:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337715+0000", 2020-11-12T17:25:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031310180000000002 2020-11-12T17:25:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340846+0000", 2020-11-12T17:25:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2611000000000002e-05 2020-11-12T17:25:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340889+0000", 2020-11-12T17:25:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295 2020-11-12T17:25:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:7176 4.0 e73/69 4:0798add9:::benchmark_data_smithi036_18856_object896:head v 73'408, mlcod=73'401)", 2020-11-12T17:25:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 24.429629853000002, 2020-11-12T17:25:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002, 2020-11-12T17:25:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:25:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960758+0000", 2020-11-12T17:25:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6748000000000003e-05 2020-11-12T17:25:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960855+0000", 2020-11-12T17:25:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31998174899999998 2020-11-12T17:25:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280837+0000", 2020-11-12T17:25:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8499999999999996e-06 2020-11-12T17:25:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280844+0000", 2020-11-12T17:25:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7806000000000002e-05 2020-11-12T17:25:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280902+0000", 2020-11-12T17:25:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5435e-05 2020-11-12T17:25:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280927+0000", 2020-11-12T17:25:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003038785 2020-11-12T17:25:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.283966+0000", 2020-11-12T17:25:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:25:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.284022+0000", 2020-11-12T17:25:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002 2020-11-12T17:25:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:18168 4.a e77/69 4:5a8774b4:::benchmark_data_smithi036_18856_object2270:head v 77'1272, mlcod=77'1264)", 2020-11-12T17:25:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 14.190882218, 2020-11-12T17:25:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998, 2020-11-12T17:25:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199509+0000", 2020-11-12T17:25:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4102000000000002e-05 2020-11-12T17:25:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199593+0000", 2020-11-12T17:25:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34680651499999998 2020-11-12T17:25:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546399+0000", 2020-11-12T17:25:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2539e-05 2020-11-12T17:25:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546412+0000", 2020-11-12T17:25:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000133242 2020-11-12T17:25:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546545+0000", 2020-11-12T17:25:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5343999999999999e-05 2020-11-12T17:25:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546581+0000", 2020-11-12T17:25:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047227149999999997 2020-11-12T17:25:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551303+0000", 2020-11-12T17:25:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112599 2020-11-12T17:25:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551416+0000", 2020-11-12T17:25:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998 2020-11-12T17:25:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:22.624 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:22.626 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:22.622+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:22.627 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:22.650 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:22.729 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:22.726+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:22.764 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:22.765 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:22.765 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:22.765 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:22.776 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:22.829 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:22.830 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:22.824+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:22.863 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:22.892 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:22.895 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:22.895 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:22.910 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:22.925 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:22.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 31 16 32061 32045 8.07504 6.70312 0.0144534 0.0154684 2020-11-12T17:25:22.931 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:22.924+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:22.954 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:22.984 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:23.025 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:23.025 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:23.025 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:23.026 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:23.026 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:25:23.026 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:23.026 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:23.026 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:23.026 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:23.027 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:23.027 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:23.028 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:23.042 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:23.043 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:23.043 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:23.036+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:23.051 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:23.132 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:23.130+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:23.210 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:23.211 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:23.221 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:25:23.233 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:23.230+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:23.334 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:23.330+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:23.347 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:23.347 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:23.358 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:25:23.434 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:25:23.436 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:23.434+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:23.485 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:23.486 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:23.496 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:23.540 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:23.536+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:23.628 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:23.628 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:23.639 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:23.632+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:23.640 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:23.740 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:23.734+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:23.804 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:23.805 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:23.817 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:23.840 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:23.838+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:23.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 32 16 33146 33130 8.08757 8.47656 0.0122588 0.0154467 2020-11-12T17:25:23.934 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:23.935 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:23.942 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:23.936+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:23.946 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:24.042 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:24.038+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:24.077 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:24.077 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:24.090 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:24.176 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:24.174+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:24.245 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:24.242+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:24.266 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:24.266 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:24.277 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:24.364 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:24.362+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:24.437 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:24.437 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:24.447 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:24.442+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:24.448 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:24.440+0000 7fc24d2e3700 -1 osd.3 84 handle_osd_map injecting map crc failure 2020-11-12T17:25:24.449 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:24.453 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:25:24.547 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:24.542+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:24.615 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:24.615 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:24.631 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:24.649 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:24.644+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:24.750 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:24.746+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:24.797 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:24.797 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:24.809 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:24.852 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:24.850+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:24.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 33 16 34046 34030 8.05554 7.03125 0.0116705 0.0155067 2020-11-12T17:25:24.952 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:24.950+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:24.981 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:24.982 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:24.994 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:25.029 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:25.081 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:25.078+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:25.155 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:25.150+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:25.158 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:25.159 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:25.172 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:25.194 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:25.229 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:25.256 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:25.252+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:25.267 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:25.299 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:25.333 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:25.354 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:25.354 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:25.357 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:25.354+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:25.363 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:25.364 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:25.392 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:25.392 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:25.393 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:25.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:25.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:25:25.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:25.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:25.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:25.393 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:25.394 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:25.395 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:25.395 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:25.457 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:25.454+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:25.546 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:25.546 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:25.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:25.547 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:25.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.547 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:25:25.547 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:25.547 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.87421580500001, 2020-11-12T17:25:25.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:25:25.548 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.548 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:25.548 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.548 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.548 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.548 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:25:25.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.549 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:25.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:25.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:25:25.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:25:25.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:25:25.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:25:25.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:25:25.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:25:25.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:25:25.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:25:25.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:25:25.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:25:25.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:25:25.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:25:25.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:25:25.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:25:25.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:25:25.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:25:25.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:25:25.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:25:25.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:25:25.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:25:25.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:25:25.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.557 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.558 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.558 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:25.558 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.87381344400001, 2020-11-12T17:25:25.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:25:25.558 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.559 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.559 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.559 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.559 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.559 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:25:25.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.559 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:25.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:25.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:25:25.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:25:25.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:25:25.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:25:25.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:25:25.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:25:25.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:25:25.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:25:25.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:25:25.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:25:25.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:25:25.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:25:25.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:25:25.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:25:25.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:25:25.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:25:25.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:25:25.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:25:25.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:25:25.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:25:25.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:25:25.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:25:25.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:25:25.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:25:25.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:25:25.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:25:25.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:25:25.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:25:25.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:25:25.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:25:25.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:25:25.573 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.573 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.573 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.573 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.573 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:25.573 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.873489451, 2020-11-12T17:25:25.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:25:25.574 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.574 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.574 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.577 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.578 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.578 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:25:25.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.578 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:25.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:25.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:25:25.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:25:25.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:25:25.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:25:25.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:25:25.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:25:25.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:25:25.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:25:25.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:25:25.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:25:25.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:25:25.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:25:25.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:25:25.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:25:25.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:25:25.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:25:25.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:25:25.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:25:25.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:25:25.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:25:25.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:25:25.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:25:25.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:25:25.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:25:25.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:25:25.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:25:25.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:25:25.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:25:25.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:25:25.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:25:25.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:25:25.590 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.590 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.590 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.590 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.591 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:25.591 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.87324574, 2020-11-12T17:25:25.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:25:25.591 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.591 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.591 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.591 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.591 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.592 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:25:25.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.592 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:25.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:25.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:25.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:25:25.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:25:25.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:25:25.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:25:25.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:25:25.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:25:25.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:25:25.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:25:25.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:25:25.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:25:25.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:25:25.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:25:25.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:25:25.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:25:25.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:25:25.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:25:25.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:25:25.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:25:25.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:25:25.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:25:25.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:25:25.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:25:25.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:25:25.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:25:25.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:25:25.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:25:25.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:25:25.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:25:25.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:25:25.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:25:25.603 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.603 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.604 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.604 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.604 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:25.604 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.873007593, 2020-11-12T17:25:25.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:25:25.604 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.605 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.605 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.605 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.605 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.605 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:25:25.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.605 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:25.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:25.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:25:25.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:25:25.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:25:25.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:25:25.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:25:25.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:25:25.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:25:25.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:25:25.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:25:25.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:25:25.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:25:25.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:25:25.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:25:25.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:25:25.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:25:25.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:25:25.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:25:25.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:25:25.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:25:25.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:25:25.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:25:25.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:25:25.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:25:25.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:25:25.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:25:25.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:25:25.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:25:25.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:25:25.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:25:25.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:25:25.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:25:25.617 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.617 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.617 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.617 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.617 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:25.618 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.87280555300001, 2020-11-12T17:25:25.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:25:25.618 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.618 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.618 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.618 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.618 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.619 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:25:25.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.619 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:25.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:25.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:25.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:25:25.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:25:25.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:25:25.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:25:25.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:25:25.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:25:25.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:25:25.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:25:25.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:25:25.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:25:25.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:25:25.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:25:25.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:25:25.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:25:25.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:25:25.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:25:25.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:25:25.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:25:25.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:25:25.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:25:25.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:25:25.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:25:25.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:25:25.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:25:25.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:25:25.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:25:25.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:25:25.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:25:25.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:25:25.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:25:25.630 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.630 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.630 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.631 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.631 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:25.631 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.872600183, 2020-11-12T17:25:25.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:25:25.631 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.631 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.632 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.632 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.632 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.632 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:25:25.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.632 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:25.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:25.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:25.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:25:25.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:25:25.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:25:25.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:25:25.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:25:25.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:25:25.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:25:25.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:25:25.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:25:25.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:25:25.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:25:25.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:25:25.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:25:25.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:25:25.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:25:25.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:25:25.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:25:25.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:25:25.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:25:25.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:25:25.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:25:25.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:25:25.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:25:25.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:25:25.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:25:25.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:25:25.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:25:25.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:25:25.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:25:25.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:25:25.643 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.643 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.644 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.644 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.644 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:25.644 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.87241435599999, 2020-11-12T17:25:25.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:25:25.644 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.645 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.645 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.645 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.645 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.645 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:25:25.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.645 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:25.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:25.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:25.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:25:25.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:25:25.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:25:25.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:25:25.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:25:25.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:25:25.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:25:25.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:25:25.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:25:25.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:25:25.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:25:25.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:25:25.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:25:25.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:25:25.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:25:25.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:25:25.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:25:25.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:25:25.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:25:25.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:25:25.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:25:25.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:25:25.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:25:25.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:25:25.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:25:25.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:25:25.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:25:25.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:25:25.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:25:25.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:25:25.659 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.659 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.660 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.660 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.660 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:25.660 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.872217392, 2020-11-12T17:25:25.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:25:25.660 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.661 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.661 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:25:25.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.661 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:25.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:25.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:25:25.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:25:25.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:25:25.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:25:25.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:25:25.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:25:25.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:25:25.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:25:25.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:25:25.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:25:25.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:25:25.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:25:25.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:25:25.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:25:25.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:25:25.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:25:25.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:25:25.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:25:25.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:25:25.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:25:25.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:25:25.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:25:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:25:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:25:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:25:25.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:25:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:25:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:25:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:25:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:25:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:25:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.672 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.872021362, 2020-11-12T17:25:25.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:25:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:25:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.674 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:25:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:25:25.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:25:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:25:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:25:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:25:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:25:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:25:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:25:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:25:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:25:25.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:25:25.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:25:25.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:25:25.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:25:25.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:25:25.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:25:25.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:25:25.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:25:25.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:25:25.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:25:25.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:25:25.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:25:25.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:25:25.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:25:25.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:25:25.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:25:25.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:25:25.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:25:25.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:25:25.686 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.686 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.686 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.686 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.687 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:25.687 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.871840562, 2020-11-12T17:25:25.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:25:25.687 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.687 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.687 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.687 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.687 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.688 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:25:25.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.688 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:25.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:25.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:25.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:25:25.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:25:25.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:25:25.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:25:25.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:25:25.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:25:25.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:25:25.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:25:25.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:25:25.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:25:25.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:25:25.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:25:25.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:25:25.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:25:25.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:25:25.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:25:25.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:25:25.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:25:25.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:25:25.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:25:25.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:25:25.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:25:25.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:25:25.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:25:25.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:25:25.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:25:25.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:25:25.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:25:25.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:25:25.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:25:25.699 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.699 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.699 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.700 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.700 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:25.700 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.871644609, 2020-11-12T17:25:25.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:25:25.700 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.700 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.700 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.700 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.701 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.701 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:25:25.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.701 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:25.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:25.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:25.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:25:25.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:25:25.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:25:25.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:25:25.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:25:25.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:25.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:25:25.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:25:25.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:25:25.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:25:25.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:25:25.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:25:25.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:25:25.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:25:25.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:25:25.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:25:25.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:25:25.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:25:25.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:25:25.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:25:25.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:25:25.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:25:25.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:25:25.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:25:25.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:25:25.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:25:25.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:25:25.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:25:25.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:25:25.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:25:25.712 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.712 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.713 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.713 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.713 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:25.713 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.871451001, 2020-11-12T17:25:25.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:25:25.713 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.714 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.714 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.714 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.714 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.714 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:25:25.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.714 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:25.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:25.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:25:25.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:25:25.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:25:25.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:25:25.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:25:25.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:25:25.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:25:25.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:25:25.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:25:25.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:25:25.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:25:25.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:25:25.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:25:25.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:25:25.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:25:25.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:25:25.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:25:25.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:25:25.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:25:25.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:25:25.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:25:25.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:25:25.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:25:25.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:25:25.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:25:25.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:25:25.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:25:25.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:25:25.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:25:25.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:25:25.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:25:25.726 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.726 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.726 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.727 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.727 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:25.727 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.871139138, 2020-11-12T17:25:25.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:25:25.728 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.728 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.728 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.728 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.728 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.728 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:25:25.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.728 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:25.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:25.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:25:25.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:25:25.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:25:25.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:25:25.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:25:25.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:25:25.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:25:25.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:25:25.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:25:25.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:25:25.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:25:25.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:25:25.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:25:25.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:25:25.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:25:25.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:25:25.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:25:25.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:25:25.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:25:25.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:25:25.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:25:25.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:25:25.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:25:25.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:25:25.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:25:25.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:25:25.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:25:25.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:25:25.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:25:25.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:25:25.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:25:25.740 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.740 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.740 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.740 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.741 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:25.741 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.870851641, 2020-11-12T17:25:25.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:25:25.741 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.741 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.741 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.741 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.742 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:25:25.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.742 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:25.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:25.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:25:25.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:25:25.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:25:25.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:25:25.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:25:25.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:25:25.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:25:25.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:25:25.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:25:25.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:25:25.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:25:25.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:25:25.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:25:25.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:25:25.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:25:25.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:25:25.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:25:25.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:25:25.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:25:25.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:25:25.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:25:25.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:25:25.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:25:25.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:25:25.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:25:25.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:25:25.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:25:25.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:25:25.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:25:25.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:25:25.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:25:25.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.755 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.755 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:25.756 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:25.756 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.87063127, 2020-11-12T17:25:25.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:25:25.756 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.756 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.757 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.757 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.757 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:25:25.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.757 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:25.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:25.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:25:25.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:25:25.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:25:25.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:25:25.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:25:25.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:25:25.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:25:25.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:25:25.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:25:25.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:25:25.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:25:25.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:25.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:25:25.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:25:25.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:25:25.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:25:25.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:25.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:25:25.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:25:25.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:25:25.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:25:25.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:25:25.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:25:25.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:25:25.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:25:25.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:25:25.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:25:25.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:25:25.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:25:25.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:25:25.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:25:25.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:25:25.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:25:25.769 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.769 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.769 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.770 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:25.770 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:25.770 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.099177424, 2020-11-12T17:25:25.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:25:25.770 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.770 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.771 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.771 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:25.771 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:25.771 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:25:25.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.771 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:25.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:25.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:25.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:25:25.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:25:25.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:25:25.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:25:25.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:25:25.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:25:25.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:25:25.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:25:25.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:25:25.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:25:25.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:25:25.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:25:25.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:25.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:25:25.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:25:25.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:25:25.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:25:25.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:25:25.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:25:25.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:25:25.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:25:25.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:25:25.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:25:25.780 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.780 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.780 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.780 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:25496 3.a e46/31 ondisk, result = 0)", 2020-11-12T17:25:25.781 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:25:25.781 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.093249912, 2020-11-12T17:25:25.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999, 2020-11-12T17:25:25.781 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.781 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:25.781 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:25:25.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450602+0000", 2020-11-12T17:25:25.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:25.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450588+0000", 2020-11-12T17:25:25.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5475000000000002e-05 2020-11-12T17:25:25.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450623+0000", 2020-11-12T17:25:25.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46380360799999998 2020-11-12T17:25:25.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914427+0000", 2020-11-12T17:25:25.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7369999999999995e-06 2020-11-12T17:25:25.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.914436+0000", 2020-11-12T17:25:25.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001408212 2020-11-12T17:25:25.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915844+0000", 2020-11-12T17:25:25.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0029e-05 2020-11-12T17:25:25.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915854+0000", 2020-11-12T17:25:25.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014011899999999999 2020-11-12T17:25:25.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915994+0000", 2020-11-12T17:25:25.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46539185999999999 2020-11-12T17:25:25.788 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.788 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.788 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.788 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:25:25.789 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:25.789 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 80.778888523000006, 2020-11-12T17:25:25.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:25:25.789 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.789 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.789 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:25.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:25.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:25.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:25:25.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:25:25.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:25:25.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:25:25.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:25:25.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:25:25.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:25:25.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:25:25.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:25:25.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:25:25.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:25:25.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:25:25.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:25:25.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:25:25.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:25:25.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:25:25.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.797 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.797 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:31096 4.a 4:57446b19:::benchmark_data_smithi036_18856_object3886:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e84)", 2020-11-12T17:25:25.798 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:21.817062+0000", 2020-11-12T17:25:25.798 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.726789873, 2020-11-12T17:25:25.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46509228800000002, 2020-11-12T17:25:25.798 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:25.798 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:25.798 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:25.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:25.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:25.799 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31096 2020-11-12T17:25:25.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.799 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:25.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:25.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.817062+0000", 2020-11-12T17:25:25.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:25.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:25.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.817062+0000", 2020-11-12T17:25:25.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:25:25.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:25.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.817028+0000", 2020-11-12T17:25:25.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010029100000000001 2020-11-12T17:25:25.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:25.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.817129+0000", 2020-11-12T17:25:25.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4192000000000001e-05 2020-11-12T17:25:25.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:25.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.817143+0000", 2020-11-12T17:25:25.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3590000000000002e-06 2020-11-12T17:25:25.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:25.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.817150+0000", 2020-11-12T17:25:25.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071645529999999997 2020-11-12T17:25:25.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:25.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.824315+0000", 2020-11-12T17:25:25.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012452700000000001 2020-11-12T17:25:25.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:25.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.824439+0000", 2020-11-12T17:25:25.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166651 2020-11-12T17:25:25.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:25.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.824606+0000", 2020-11-12T17:25:25.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028314109999999998 2020-11-12T17:25:25.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:25.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:21.827437+0000", 2020-11-12T17:25:25.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.454526188 2020-11-12T17:25:25.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:25.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:22.281963+0000", 2020-11-12T17:25:25.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109487 2020-11-12T17:25:25.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:25.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:22.282073+0000", 2020-11-12T17:25:25.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1779000000000004e-05 2020-11-12T17:25:25.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:25.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:25.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:25.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:22.282155+0000", 2020-11-12T17:25:25.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46509228800000002 2020-11-12T17:25:25.808 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.808 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.808 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.808 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:25.808 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:25.808 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:25.810 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:25.810 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:25.806+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:25.911 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:25.906+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:25.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 34 16 34983 34967 8.03389 7.32031 0.0069188 0.015541 2020-11-12T17:25:25.977 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:25.978 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:25.978 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:25:25.978 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:25.988 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:26.032 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:26.030+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:26.114 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:26.110+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:26.159 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:26.160 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:26.160 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:26.160 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:26.160 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:26.170 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:26.215 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:26.208+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:26.316 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:26.312+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:26.339 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:26.340 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:26.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:26.340 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:26.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.341 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:25:26.341 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:26.341 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.49522095, 2020-11-12T17:25:26.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:25:26.341 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.341 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:26.341 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:26.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:26.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:26.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:25:26.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:25:26.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:25:26.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:25:26.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:25:26.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:25:26.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:25:26.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:25:26.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:25:26.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:25:26.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:25:26.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:25:26.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:25:26.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:25:26.347 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.348 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.348 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.348 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:26.348 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:26.348 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 135.83657040700001, 2020-11-12T17:25:26.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:25:26.349 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.349 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.349 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:26.349 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:26.349 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:26.349 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:25:26.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.350 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:26.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:26.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:26.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:25:26.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:25:26.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:25:26.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:25:26.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:25:26.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:25:26.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:25:26.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:25:26.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:25:26.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:25:26.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:25:26.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:25:26.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:26.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:25:26.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:25:26.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:26.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:25:26.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:25:26.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:26.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:25:26.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:25:26.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:25:26.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:25:26.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:25:26.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:25:26.359 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.359 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.359 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.359 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:26.359 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:26.360 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 135.83496534700001, 2020-11-12T17:25:26.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:25:26.360 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.360 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.360 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:26.360 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:26.360 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:26.360 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:25:26.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.361 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:26.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:26.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:26.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:25:26.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:25:26.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:25:26.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:25:26.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:25:26.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:25:26.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:25:26.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:25:26.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:25:26.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:25:26.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:25:26.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:25:26.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:26.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:25:26.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:25:26.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:26.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:25:26.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:25:26.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:26.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:25:26.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:25:26.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:25:26.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:25:26.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:25:26.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:25:26.370 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.370 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.370 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.370 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:26.370 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:26.370 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.937470343, 2020-11-12T17:25:26.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:25:26.371 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.371 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.371 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:26.371 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:26.371 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:26.371 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:25:26.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.372 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:26.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:26.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:26.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:25:26.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:25:26.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:25:26.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:25:26.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:25:26.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:25:26.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:25:26.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:25:26.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:25:26.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:25:26.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:25:26.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:25:26.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:26.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:25:26.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:25:26.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:26.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:25:26.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:25:26.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:26.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:25:26.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:25:26.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:25:26.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:25:26.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:25:26.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:25:26.380 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.380 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.380 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.381 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:26.381 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:26.381 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.935023728, 2020-11-12T17:25:26.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:25:26.381 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.381 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.382 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:26.382 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:26.382 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:26.382 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:25:26.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.382 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:26.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:26.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:26.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:25:26.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:25:26.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:25:26.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:25:26.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:25:26.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:25:26.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:25:26.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:25:26.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:25:26.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:25:26.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:25:26.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:25:26.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:26.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:25:26.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:25:26.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:26.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:25:26.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:25:26.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:26.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:25:26.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:25:26.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:25:26.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:25:26.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:25:26.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:25:26.391 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.391 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.391 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.391 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:26.392 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:26.392 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.929199281, 2020-11-12T17:25:26.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:25:26.392 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.392 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:26.392 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:26.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:26.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:26.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:25:26.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:25:26.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:25:26.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:25:26.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:25:26.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:25:26.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:25:26.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:25:26.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:25:26.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:25:26.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:25:26.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:25:26.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:25:26.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:25:26.398 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.398 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.398 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.399 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:26.399 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:26.399 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.92913140499999, 2020-11-12T17:25:26.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:25:26.399 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.399 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:26.400 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:26.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:26.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:26.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:25:26.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:25:26.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:25:26.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:25:26.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:25:26.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:25:26.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:25:26.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:25:26.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:25:26.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:25:26.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:25:26.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:25:26.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:25:26.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:25:26.405 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.406 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.406 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:25:26.406 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:26.406 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.803141137, 2020-11-12T17:25:26.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:25:26.407 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.407 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:26.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:26.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:26.407 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:25:26.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.408 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:26.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:26.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:25:26.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:25:26.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:25:26.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:25:26.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:25:26.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:25:26.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:25:26.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:25:26.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:25:26.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:25:26.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:25:26.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:25:26.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:25:26.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:26.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:25:26.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:25:26.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:26.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:25:26.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:25:26.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:26.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:25:26.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:25:26.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:25:26.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:25:26.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:25:26.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:25:26.418 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.418 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.418 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.419 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:25:26.419 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:26.419 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.795837418, 2020-11-12T17:25:26.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:25:26.419 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.420 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:26.420 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:26.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:26.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:25:26.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:25:26.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:25:26.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:25:26.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:25:26.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:25:26.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:25:26.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:25:26.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:25:26.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:25:26.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:26.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:25:26.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:25:26.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:25:26.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:25:26.426 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.426 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.426 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.426 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:26.427 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:26.427 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.42225892499999, 2020-11-12T17:25:26.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:25:26.427 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.427 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.427 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:26.427 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:26.428 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:26.428 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:25:26.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.428 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:26.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:26.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:26.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:25:26.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:25:26.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:25:26.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:25:26.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:25:26.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:25:26.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:25:26.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:25:26.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:25:26.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:25:26.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:25:26.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:25:26.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:26.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:25:26.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:25:26.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:26.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:25:26.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:25:26.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:26.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:25:26.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:25:26.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:25:26.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:25:26.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:25:26.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:25:26.437 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.437 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.437 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.438 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:25:26.438 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:26.438 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.41070580500001, 2020-11-12T17:25:26.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:25:26.438 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.438 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:26.438 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:26.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:26.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:26.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:25:26.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:25:26.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:25:26.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:25:26.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:25:26.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:25:26.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:25:26.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:25:26.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:25:26.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:25:26.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:25:26.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:25:26.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:25:26.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:25:26.444 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.445 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.445 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.445 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:26.445 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:26.445 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.337585623999999, 2020-11-12T17:25:26.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:25:26.446 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.446 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.446 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:26.446 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:26.446 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:26.447 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:25:26.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.447 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:26.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:26.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:26.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:25:26.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:25:26.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:25:26.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:25:26.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:25:26.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:25:26.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:25:26.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:25:26.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:25:26.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:25:26.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:25:26.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:25:26.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:26.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:25:26.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:25:26.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:26.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:25:26.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:25:26.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:26.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:25:26.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:25:26.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:25:26.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:25:26.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:25:26.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:25:26.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.456 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.456 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.456 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:26.456 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:26.456 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 87.050285911000003, 2020-11-12T17:25:26.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:25:26.457 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.457 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.457 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:26.457 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:26.457 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:26.457 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:25:26.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.457 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:26.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:26.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:26.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:25:26.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:25:26.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:25:26.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:25:26.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:25:26.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:25:26.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:25:26.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:25:26.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:25:26.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:25:26.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:25:26.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:25:26.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:26.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:25:26.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:25:26.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:26.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:25:26.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:25:26.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:26.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:25:26.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:25:26.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:25:26.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:25:26.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:25:26.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:25:26.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.466 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.467 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:26.467 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:26.467 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 86.504892921000007, 2020-11-12T17:25:26.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:25:26.467 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.468 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:26.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:26.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:26.468 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:25:26.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.468 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:26.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:26.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:26.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:25:26.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:25:26.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:25:26.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:25:26.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:25:26.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:25:26.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:25:26.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:25:26.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:25:26.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:25:26.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:25:26.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:25:26.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:26.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:25:26.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:25:26.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:26.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:25:26.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:25:26.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:26.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:25:26.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:25:26.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:25:26.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:25:26.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:25:26.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:25:26.477 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.478 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.478 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:25:26.478 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:26.478 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.512342661000005, 2020-11-12T17:25:26.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:25:26.479 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.479 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.479 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:26.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:26.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:26.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:25:26.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:25:26.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:25:26.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:25:26.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:25:26.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:25:26.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:25:26.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:25:26.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:25:26.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:25:26.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:25:26.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:25:26.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:25:26.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:25:26.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:25:26.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:25:26.485 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.486 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.486 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.486 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57960 3.7 e57/20 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head v 57'3648, mlcod=57'3642)", 2020-11-12T17:25:26.486 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:26.486 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.608609893000001, 2020-11-12T17:25:26.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998, 2020-11-12T17:25:26.487 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.487 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.487 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:26.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:26.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:26.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729033+0000", 2020-11-12T17:25:26.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001002 2020-11-12T17:25:26.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729133+0000", 2020-11-12T17:25:26.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30451762900000001 2020-11-12T17:25:26.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033650+0000", 2020-11-12T17:25:26.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2909999999999998e-06 2020-11-12T17:25:26.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033656+0000", 2020-11-12T17:25:26.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1718000000000003e-05 2020-11-12T17:25:26.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033697+0000", 2020-11-12T17:25:26.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2977999999999999e-05 2020-11-12T17:25:26.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033720+0000", 2020-11-12T17:25:26.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058524529999999996 2020-11-12T17:25:26.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039573+0000", 2020-11-12T17:25:26.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2095999999999997e-05 2020-11-12T17:25:26.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039625+0000", 2020-11-12T17:25:26.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998 2020-11-12T17:25:26.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.494 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.494 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:25:26.494 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:26.494 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 62.676506488999998, 2020-11-12T17:25:26.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:25:26.495 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.495 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.495 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:26.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:26.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:26.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:25:26.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:25:26.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:25:26.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:25:26.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:25:26.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:25:26.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:25:26.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:25:26.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:25:26.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:25:26.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:25:26.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:25:26.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:25:26.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:25:26.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:25:26.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:25:26.502 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.502 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.502 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.502 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:1240 4.a e71/69 4:5ae32822:::benchmark_data_smithi036_18856_object154:head v 71'104, mlcod=71'98)", 2020-11-12T17:25:26.502 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:26.503 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.360291949, 2020-11-12T17:25:26.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295, 2020-11-12T17:25:26.503 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.503 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.503 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:26.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:26.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:26.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977341+0000", 2020-11-12T17:25:26.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013138399999999999 2020-11-12T17:25:26.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977473+0000", 2020-11-12T17:25:26.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011075199999998 2020-11-12T17:25:26.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337584+0000", 2020-11-12T17:25:26.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2939999999999994e-06 2020-11-12T17:25:26.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337593+0000", 2020-11-12T17:25:26.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0656999999999996e-05 2020-11-12T17:25:26.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337684+0000", 2020-11-12T17:25:26.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819999999999997e-05 2020-11-12T17:25:26.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337715+0000", 2020-11-12T17:25:26.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031310180000000002 2020-11-12T17:25:26.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340846+0000", 2020-11-12T17:25:26.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2611000000000002e-05 2020-11-12T17:25:26.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340889+0000", 2020-11-12T17:25:26.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295 2020-11-12T17:25:26.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.510 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.510 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:7176 4.0 e73/69 4:0798add9:::benchmark_data_smithi036_18856_object896:head v 73'408, mlcod=73'401)", 2020-11-12T17:25:26.510 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:26.511 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.376881417, 2020-11-12T17:25:26.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002, 2020-11-12T17:25:26.511 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.511 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.511 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:26.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:26.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:25:26.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960758+0000", 2020-11-12T17:25:26.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6748000000000003e-05 2020-11-12T17:25:26.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960855+0000", 2020-11-12T17:25:26.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31998174899999998 2020-11-12T17:25:26.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280837+0000", 2020-11-12T17:25:26.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8499999999999996e-06 2020-11-12T17:25:26.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280844+0000", 2020-11-12T17:25:26.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7806000000000002e-05 2020-11-12T17:25:26.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280902+0000", 2020-11-12T17:25:26.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5435e-05 2020-11-12T17:25:26.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280927+0000", 2020-11-12T17:25:26.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003038785 2020-11-12T17:25:26.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.283966+0000", 2020-11-12T17:25:26.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:25:26.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.284022+0000", 2020-11-12T17:25:26.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002 2020-11-12T17:25:26.518 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.518 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.518 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.518 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:18168 4.a e77/69 4:5a8774b4:::benchmark_data_smithi036_18856_object2270:head v 77'1272, mlcod=77'1264)", 2020-11-12T17:25:26.518 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:26.518 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.138133782000001, 2020-11-12T17:25:26.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998, 2020-11-12T17:25:26.519 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:26.519 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:26.519 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:26.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:26.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:26.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:26.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:26.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:26.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:26.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:26.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199509+0000", 2020-11-12T17:25:26.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4102000000000002e-05 2020-11-12T17:25:26.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:26.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199593+0000", 2020-11-12T17:25:26.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34680651499999998 2020-11-12T17:25:26.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:26.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546399+0000", 2020-11-12T17:25:26.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2539e-05 2020-11-12T17:25:26.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546412+0000", 2020-11-12T17:25:26.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000133242 2020-11-12T17:25:26.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:26.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546545+0000", 2020-11-12T17:25:26.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5343999999999999e-05 2020-11-12T17:25:26.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:26.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546581+0000", 2020-11-12T17:25:26.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047227149999999997 2020-11-12T17:25:26.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:26.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551303+0000", 2020-11-12T17:25:26.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112599 2020-11-12T17:25:26.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:26.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:26.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:26.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551416+0000", 2020-11-12T17:25:26.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998 2020-11-12T17:25:26.526 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.526 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.526 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.526 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:26.526 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:26.526 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:26.527 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:25:26.528 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:26.522+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:26.529 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:26.628 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:26.626+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:26.687 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:35612 4.b 4:da209af5:::benchmark_data_smithi036_18856_object4451:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.678965+0000", 2020-11-12T17:25:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0067483059999999999, 2020-11-12T17:25:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006775423, 2020-11-12T17:25:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35612 2020-11-12T17:25:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.678965+0000", 2020-11-12T17:25:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.678965+0000", 2020-11-12T17:25:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999418 2020-11-12T17:25:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.678907+0000", 2020-11-12T17:25:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100667 2020-11-12T17:25:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679008+0000", 2020-11-12T17:25:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3129000000000001e-05 2020-11-12T17:25:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679021+0000", 2020-11-12T17:25:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0294e-05 2020-11-12T17:25:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679031+0000", 2020-11-12T17:25:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00075394600000000002 2020-11-12T17:25:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679785+0000", 2020-11-12T17:25:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111916 2020-11-12T17:25:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679897+0000", 2020-11-12T17:25:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022539700000000001 2020-11-12T17:25:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.680123+0000", 2020-11-12T17:25:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056016929999999996 2020-11-12T17:25:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.685724+0000", 2020-11-12T17:25:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0067590890000000002 2020-11-12T17:25:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:35613 4.b 4:da209af5:::benchmark_data_smithi036_18856_object4451:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.679084+0000", 2020-11-12T17:25:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0066297320000000002, 2020-11-12T17:25:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0067396849999999996, 2020-11-12T17:25:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35613 2020-11-12T17:25:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679084+0000", 2020-11-12T17:25:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679084+0000", 2020-11-12T17:25:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679063+0000", 2020-11-12T17:25:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0202999999999999e-05 2020-11-12T17:25:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679124+0000", 2020-11-12T17:25:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6600000000000007e-06 2020-11-12T17:25:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679133+0000", 2020-11-12T17:25:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1630000000000001e-06 2020-11-12T17:25:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679140+0000", 2020-11-12T17:25:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030380770000000001 2020-11-12T17:25:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.682178+0000", 2020-11-12T17:25:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4394999999999996e-05 2020-11-12T17:25:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.682242+0000", 2020-11-12T17:25:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015616499999999999 2020-11-12T17:25:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.682398+0000", 2020-11-12T17:25:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033142200000000001 2020-11-12T17:25:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:35614 4.b 4:da209af5:::benchmark_data_smithi036_18856_object4451:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.679337+0000", 2020-11-12T17:25:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.006376802, 2020-11-12T17:25:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0065621170000000001, 2020-11-12T17:25:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35614 2020-11-12T17:25:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679337+0000", 2020-11-12T17:25:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679337+0000", 2020-11-12T17:25:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679317+0000", 2020-11-12T17:25:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0606999999999998e-05 2020-11-12T17:25:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679378+0000", 2020-11-12T17:25:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4290000000000001e-06 2020-11-12T17:25:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679386+0000", 2020-11-12T17:25:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6499999999999999e-06 2020-11-12T17:25:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679393+0000", 2020-11-12T17:25:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0039213980000000004 2020-11-12T17:25:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.683314+0000", 2020-11-12T17:25:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111597 2020-11-12T17:25:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.683426+0000", 2020-11-12T17:25:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195832 2020-11-12T17:25:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.683622+0000", 2020-11-12T17:25:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.004284759 2020-11-12T17:25:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:35615 4.b 4:da209af5:::benchmark_data_smithi036_18856_object4451:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.679896+0000", 2020-11-12T17:25:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0058174780000000001, 2020-11-12T17:25:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060725409999999999, 2020-11-12T17:25:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35615 2020-11-12T17:25:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679896+0000", 2020-11-12T17:25:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679896+0000", 2020-11-12T17:25:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:25:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679863+0000", 2020-11-12T17:25:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0381000000000001e-05 2020-11-12T17:25:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679953+0000", 2020-11-12T17:25:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4267000000000001e-05 2020-11-12T17:25:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679968+0000", 2020-11-12T17:25:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8249999999999999e-06 2020-11-12T17:25:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.679975+0000", 2020-11-12T17:25:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045546229999999998 2020-11-12T17:25:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.684529+0000", 2020-11-12T17:25:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6346000000000004e-05 2020-11-12T17:25:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.684605+0000", 2020-11-12T17:25:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011803699999999999 2020-11-12T17:25:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.684724+0000", 2020-11-12T17:25:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048273320000000002 2020-11-12T17:25:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:35616 4.b 4:da209af5:::benchmark_data_smithi036_18856_object4451:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.680040+0000", 2020-11-12T17:25:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0056739080000000001, 2020-11-12T17:25:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005992697, 2020-11-12T17:25:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35616 2020-11-12T17:25:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.680040+0000", 2020-11-12T17:25:26.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:26.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.680040+0000", 2020-11-12T17:25:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:26.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.680022+0000", 2020-11-12T17:25:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4957000000000003e-05 2020-11-12T17:25:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.680077+0000", 2020-11-12T17:25:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4959999999999999e-06 2020-11-12T17:25:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.680085+0000", 2020-11-12T17:25:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7829999999999998e-06 2020-11-12T17:25:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.680090+0000", 2020-11-12T17:25:26.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056841030000000002 2020-11-12T17:25:26.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.685774+0000", 2020-11-12T17:25:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110678 2020-11-12T17:25:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:26.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.685884+0000", 2020-11-12T17:25:26.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0058446369999999997 2020-11-12T17:25:26.740 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.741 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:26.741 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:35612 4.b e85/69)", 2020-11-12T17:25:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.685248+0000", 2020-11-12T17:25:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00046533300000000001, 2020-11-12T17:25:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00083738900000000002, 2020-11-12T17:25:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.685248+0000", 2020-11-12T17:25:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.685248+0000", 2020-11-12T17:25:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999958 2020-11-12T17:25:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:26.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.685206+0000", 2020-11-12T17:25:26.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010309700000000001 2020-11-12T17:25:26.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:26.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.685309+0000", 2020-11-12T17:25:26.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012244099999999999 2020-11-12T17:25:26.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:26.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.685432+0000", 2020-11-12T17:25:26.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7529999999999996e-06 2020-11-12T17:25:26.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:26.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:26.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.685442+0000", 2020-11-12T17:25:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019324000000000001 2020-11-12T17:25:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.758 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:26.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:26.759 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:25:26.759 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 6 2020-11-12T17:25:26.760 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:26.762 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:26.756+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:26.763 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:26.862 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:26.858+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:26.927 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:26.928 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:26.928 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:26.928 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:26.928 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:26.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 35 16 35837 35821 7.99496 6.67188 0.00823579 0.0156183 2020-11-12T17:25:26.937 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:26.984 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:26.980+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:27.053 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:27.053 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:27.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:27.054 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:27.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.054 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:27.054 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:27.054 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 141.94183912599999, 2020-11-12T17:25:27.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:25:27.054 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.055 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.055 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.055 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:27.055 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:27.055 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:25:27.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.055 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:27.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:27.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:27.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:25:27.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:25:27.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:25:27.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:25:27.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:25:27.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:25:27.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:25:27.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:25:27.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:25:27.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:25:27.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:25:27.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:25:27.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:27.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:25:27.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:25:27.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:25:27.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:25:27.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:25:27.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:25:27.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:25:27.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:25:27.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:25:27.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:25:27.064 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.064 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.065 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:25:27.065 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:27.065 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 141.93474732999999, 2020-11-12T17:25:27.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:25:27.065 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.066 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:27.066 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:27.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:27.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:27.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:25:27.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:25:27.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:25:27.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:25:27.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:25:27.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:25:27.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:25:27.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:25:27.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:25:27.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:25:27.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:25:27.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:25:27.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:25:27.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:25:27.072 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.073 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.073 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.073 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:27.073 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:27.073 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.50218783299999, 2020-11-12T17:25:27.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:25:27.074 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.074 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.074 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.074 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:27.074 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:27.074 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:25:27.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.075 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:27.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:27.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:27.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:25:27.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:25:27.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:25:27.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:25:27.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:25:27.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:25:27.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:25:27.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:25:27.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:25:27.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:25:27.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:25:27.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:25:27.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:27.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:25:27.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:25:27.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:25:27.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:25:27.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:25:27.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:25:27.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:25:27.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:25:27.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:25:27.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:25:27.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.084 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.084 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:25:27.085 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:27.085 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.552067738999995, 2020-11-12T17:25:27.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:25:27.085 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.086 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:27.086 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:27.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:27.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:27.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:25:27.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:25:27.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:25:27.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:25:27.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:25:27.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:25:27.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:25:27.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:25:27.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:25:27.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:25:27.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:25:27.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:25:27.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:25:27.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:25:27.092 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.092 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.093 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.093 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:28424 3.b e47/20 3:d6b3d883:::benchmark_data_smithi036_14212_object3552:head v 47'1832, mlcod=47'1825)", 2020-11-12T17:25:27.093 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:27.094 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.526896378000004, 2020-11-12T17:25:27.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002, 2020-11-12T17:25:27.094 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.094 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.095 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:27.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:27.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:27.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523784+0000", 2020-11-12T17:25:27.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100963 2020-11-12T17:25:27.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523885+0000", 2020-11-12T17:25:27.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29458836900000002 2020-11-12T17:25:27.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818473+0000", 2020-11-12T17:25:27.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1482e-05 2020-11-12T17:25:27.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818485+0000", 2020-11-12T17:25:27.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4080999999999998e-05 2020-11-12T17:25:27.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818559+0000", 2020-11-12T17:25:27.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9269e-05 2020-11-12T17:25:27.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818598+0000", 2020-11-12T17:25:27.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044328520000000001 2020-11-12T17:25:27.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823031+0000", 2020-11-12T17:25:27.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2584999999999998e-05 2020-11-12T17:25:27.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823094+0000", 2020-11-12T17:25:27.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002 2020-11-12T17:25:27.103 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.103 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.104 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:25:27.104 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:27.104 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 96.446465846999999, 2020-11-12T17:25:27.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:25:27.105 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.105 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.105 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:27.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:27.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:27.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:25:27.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:25:27.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:25:27.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:25:27.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:25:27.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:27.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:25:27.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:25:27.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:25:27.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:25:27.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:25:27.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:25:27.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:25:27.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:25:27.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:25:27.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:25:27.113 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.113 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.113 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.113 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43535 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:27.114 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:27.114 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 82.341496046000003, 2020-11-12T17:25:27.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003, 2020-11-12T17:25:27.114 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.114 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.114 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.114 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:27.115 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:27.115 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43535 2020-11-12T17:25:27.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.115 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:27.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:27.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:27.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709201+0000", 2020-11-12T17:25:27.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4987000000000001e-05 2020-11-12T17:25:27.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709256+0000", 2020-11-12T17:25:27.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9799999999999998e-06 2020-11-12T17:25:27.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709264+0000", 2020-11-12T17:25:27.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:25:27.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709268+0000", 2020-11-12T17:25:27.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01033796 2020-11-12T17:25:27.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719606+0000", 2020-11-12T17:25:27.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014753499999999999 2020-11-12T17:25:27.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719754+0000", 2020-11-12T17:25:27.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023477900000000001 2020-11-12T17:25:27.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:27.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719989+0000", 2020-11-12T17:25:27.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002308844 2020-11-12T17:25:27.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722298+0000", 2020-11-12T17:25:27.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27981983300000002 2020-11-12T17:25:27.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002117+0000", 2020-11-12T17:25:27.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4757000000000001e-05 2020-11-12T17:25:27.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002212+0000", 2020-11-12T17:25:27.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116928 2020-11-12T17:25:27.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002329+0000", 2020-11-12T17:25:27.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003 2020-11-12T17:25:27.125 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.125 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.125 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.126 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43536 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:27.126 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:27.126 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 82.341396515, 2020-11-12T17:25:27.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001, 2020-11-12T17:25:27.126 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.127 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.127 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.127 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:27.128 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:27.128 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43536 2020-11-12T17:25:27.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.128 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:27.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:27.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:27.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709302+0000", 2020-11-12T17:25:27.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3248999999999998e-05 2020-11-12T17:25:27.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709355+0000", 2020-11-12T17:25:27.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.34e-06 2020-11-12T17:25:27.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709363+0000", 2020-11-12T17:25:27.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.664e-06 2020-11-12T17:25:27.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709366+0000", 2020-11-12T17:25:27.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013071532 2020-11-12T17:25:27.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722438+0000", 2020-11-12T17:25:27.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141901 2020-11-12T17:25:27.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722580+0000", 2020-11-12T17:25:27.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118355 2020-11-12T17:25:27.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:27.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722698+0000", 2020-11-12T17:25:27.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014561839999999999 2020-11-12T17:25:27.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.724154+0000", 2020-11-12T17:25:27.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27825006499999999 2020-11-12T17:25:27.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002404+0000", 2020-11-12T17:25:27.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2908000000000001e-05 2020-11-12T17:25:27.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002477+0000", 2020-11-12T17:25:27.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020370300000000001 2020-11-12T17:25:27.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002681+0000", 2020-11-12T17:25:27.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001 2020-11-12T17:25:27.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.138 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.139 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:27.139 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:27.139 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.099982513, 2020-11-12T17:25:27.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:25:27.139 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.139 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.139 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:27.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:27.140 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:25:27.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.140 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:27.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:27.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:25:27.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:25:27.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:25:27.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:25:27.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:25:27.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:25:27.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:25:27.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:25:27.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:25:27.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:25:27.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:25:27.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:25:27.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:25:27.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:27.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:25:27.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:25:27.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:25:27.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:25:27.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:25:27.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:25:27.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:25:27.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:25:27.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:25:27.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:25:27.151 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.151 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.151 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.151 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:27.151 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:27.152 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 56.104140710999999, 2020-11-12T17:25:27.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:25:27.152 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.152 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:27.152 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:27.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:27.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:27.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:25:27.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:25:27.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:25:27.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:25:27.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:25:27.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:25:27.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:25:27.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:25:27.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:25:27.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:25:27.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:25:27.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:25:27.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:25:27.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:25:27.158 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.158 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.159 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:25:27.159 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:27.159 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 52.169037312, 2020-11-12T17:25:27.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:25:27.160 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.160 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:25:27.160 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:27.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:27.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:27.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:25:27.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:25:27.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:25:27.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:25:27.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:25:27.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:25:27.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:25:27.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:25:27.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:25:27.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:25:27.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:25:27.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:25:27.165 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.165 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.165 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.166 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:304 4.b 4:d3839b57:::benchmark_data_smithi036_18856_object37:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:27.166 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:27.166 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.912871754999998, 2020-11-12T17:25:27.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999, 2020-11-12T17:25:27.166 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.167 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.167 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.167 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:27.167 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:27.167 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 304 2020-11-12T17:25:27.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.168 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:27.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:27.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:27.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137813+0000", 2020-11-12T17:25:27.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9074999999999998e-05 2020-11-12T17:25:27.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137892+0000", 2020-11-12T17:25:27.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8020000000000003e-06 2020-11-12T17:25:27.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137902+0000", 2020-11-12T17:25:27.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7619999999999995e-06 2020-11-12T17:25:27.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137909+0000", 2020-11-12T17:25:27.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040533879999999998 2020-11-12T17:25:27.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.141963+0000", 2020-11-12T17:25:27.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162048 2020-11-12T17:25:27.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142125+0000", 2020-11-12T17:25:27.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00039201500000000001 2020-11-12T17:25:27.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:27.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142517+0000", 2020-11-12T17:25:27.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010951820000000001 2020-11-12T17:25:27.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.143612+0000", 2020-11-12T17:25:27.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.286564975 2020-11-12T17:25:27.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430177+0000", 2020-11-12T17:25:27.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8254000000000002e-05 2020-11-12T17:25:27.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430235+0000", 2020-11-12T17:25:27.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9767000000000001e-05 2020-11-12T17:25:27.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430275+0000", 2020-11-12T17:25:27.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999 2020-11-12T17:25:27.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.177 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.178 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:936 4.6 4:6403dfdf:::benchmark_data_smithi036_18856_object116:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:27.178 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:27.178 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.358427532, 2020-11-12T17:25:27.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001, 2020-11-12T17:25:27.178 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.178 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.179 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.179 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:27.179 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:27.179 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 936 2020-11-12T17:25:27.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.179 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:27.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:27.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:27.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692257+0000", 2020-11-12T17:25:27.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8807999999999994e-05 2020-11-12T17:25:27.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692346+0000", 2020-11-12T17:25:27.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1438e-05 2020-11-12T17:25:27.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692357+0000", 2020-11-12T17:25:27.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0989999999999998e-06 2020-11-12T17:25:27.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692362+0000", 2020-11-12T17:25:27.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036699900000000001 2020-11-12T17:25:27.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696032+0000", 2020-11-12T17:25:27.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021269999999999999 2020-11-12T17:25:27.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696245+0000", 2020-11-12T17:25:27.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00032215999999999999 2020-11-12T17:25:27.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:27.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696567+0000", 2020-11-12T17:25:27.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001477368 2020-11-12T17:25:27.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.698044+0000", 2020-11-12T17:25:27.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29849877600000002 2020-11-12T17:25:27.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996543+0000", 2020-11-12T17:25:27.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4288000000000004e-05 2020-11-12T17:25:27.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996617+0000", 2020-11-12T17:25:27.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1554999999999997e-05 2020-11-12T17:25:27.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996669+0000", 2020-11-12T17:25:27.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001 2020-11-12T17:25:27.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.188 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.189 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:25:27.189 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:25:27.189 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 21.404396820999999, 2020-11-12T17:25:27.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:25:27.189 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.190 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:27.190 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:25:27.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:25:27.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:27.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:25:27.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:25:27.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:25:27.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:25:27.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:25:27.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:25:27.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:25:27.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:25:27.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:25:27.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:25:27.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:25:27.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:25:27.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:25:27.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:25:27.196 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.196 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.197 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.197 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:25:27.197 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:25:27.197 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.147888137000001, 2020-11-12T17:25:27.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:25:27.198 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.198 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.198 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.198 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:27.198 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:27.198 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:25:27.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.199 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:25:27.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:25:27.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:27.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:25:27.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:25:27.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:25:27.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:25:27.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:25:27.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:25:27.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:25:27.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:25:27.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:25:27.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:25:27.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:25:27.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:25:27.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:27.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:25:27.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:25:27.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:25:27.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:25:27.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:25:27.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:25:27.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:25:27.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:25:27.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:25:27.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:25:27.208 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.208 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.208 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.208 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:25:27.209 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:25:27.209 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.147725767000001, 2020-11-12T17:25:27.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:25:27.209 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.209 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.209 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.209 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:27.210 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:27.210 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:25:27.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.210 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:25:27.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:25:27.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:25:27.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:25:27.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:25:27.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:25:27.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:25:27.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:25:27.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:25:27.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:25:27.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:25:27.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:25:27.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:25:27.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:25:27.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:25:27.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:27.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:25:27.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:25:27.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:25:27.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:25:27.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:25:27.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:25:27.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:25:27.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:25:27.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:25:27.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:25:27.219 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.219 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.219 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.220 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:25:27.220 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:25:27.220 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.13915678, 2020-11-12T17:25:27.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:25:27.220 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.221 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:27.221 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:25:27.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:25:27.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:27.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:25:27.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:25:27.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:25:27.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:25:27.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:25:27.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:25:27.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:25:27.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:25:27.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:25:27.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:25:27.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:25:27.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:25:27.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:25:27.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:25:27.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.227 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.227 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:31016 4.3 4:c401a391:::benchmark_data_smithi036_18856_object3876:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e84)", 2020-11-12T17:25:27.228 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.719718+0000", 2020-11-12T17:25:27.228 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3309978500000001, 2020-11-12T17:25:27.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.295163962, 2020-11-12T17:25:27.228 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.228 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.228 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.229 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:27.229 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:27.229 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 31016 2020-11-12T17:25:27.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.229 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719718+0000", 2020-11-12T17:25:27.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719718+0000", 2020-11-12T17:25:27.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:27.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719683+0000", 2020-11-12T17:25:27.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119109 2020-11-12T17:25:27.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719803+0000", 2020-11-12T17:25:27.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4235e-05 2020-11-12T17:25:27.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719817+0000", 2020-11-12T17:25:27.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.619e-06 2020-11-12T17:25:27.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719825+0000", 2020-11-12T17:25:27.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003385599 2020-11-12T17:25:27.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.723211+0000", 2020-11-12T17:25:27.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016867 2020-11-12T17:25:27.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.723380+0000", 2020-11-12T17:25:27.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028993600000000002 2020-11-12T17:25:27.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:27.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.723670+0000", 2020-11-12T17:25:27.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046715749999999999 2020-11-12T17:25:27.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.728341+0000", 2020-11-12T17:25:27.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28638648799999999 2020-11-12T17:25:27.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.014728+0000", 2020-11-12T17:25:27.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2670999999999994e-05 2020-11-12T17:25:27.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.014820+0000", 2020-11-12T17:25:27.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2055000000000001e-05 2020-11-12T17:25:27.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.014882+0000", 2020-11-12T17:25:27.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.295163962 2020-11-12T17:25:27.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.238 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.239 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:31304 4.b 4:d34ad4b4:::benchmark_data_smithi036_18856_object3912:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e84)", 2020-11-12T17:25:27.239 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:22.033159+0000", 2020-11-12T17:25:27.239 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0175568119999996, 2020-11-12T17:25:27.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.301776131, 2020-11-12T17:25:27.239 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.240 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:27.240 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:27.240 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:27.240 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:27.240 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 31304 2020-11-12T17:25:27.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.240 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033159+0000", 2020-11-12T17:25:27.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033159+0000", 2020-11-12T17:25:27.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:25:27.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033136+0000", 2020-11-12T17:25:27.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010585 2020-11-12T17:25:27.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033242+0000", 2020-11-12T17:25:27.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3686999999999999e-05 2020-11-12T17:25:27.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033266+0000", 2020-11-12T17:25:27.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8850000000000001e-06 2020-11-12T17:25:27.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033273+0000", 2020-11-12T17:25:27.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00274186 2020-11-12T17:25:27.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.036015+0000", 2020-11-12T17:25:27.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013071900000000001 2020-11-12T17:25:27.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.036145+0000", 2020-11-12T17:25:27.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019973300000000001 2020-11-12T17:25:27.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:27.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.036345+0000", 2020-11-12T17:25:27.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020334289999999998 2020-11-12T17:25:27.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:27.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.038378+0000", 2020-11-12T17:25:27.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.296228932 2020-11-12T17:25:27.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:27.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334607+0000", 2020-11-12T17:25:27.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016707399999999999 2020-11-12T17:25:27.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:27.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334774+0000", 2020-11-12T17:25:27.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016120899999999999 2020-11-12T17:25:27.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334936+0000", 2020-11-12T17:25:27.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.301776131 2020-11-12T17:25:27.250 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.250 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.250 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.250 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:31304 4.b e84/69 ondisk, result = 0)", 2020-11-12T17:25:27.250 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:22.044264+0000", 2020-11-12T17:25:27.251 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0064523169999999, 2020-11-12T17:25:27.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29069468999999998, 2020-11-12T17:25:27.251 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:27.251 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:27.251 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:27.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:27.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044264+0000", 2020-11-12T17:25:27.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:27.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:27.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044264+0000", 2020-11-12T17:25:27.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:27.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:27.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044236+0000", 2020-11-12T17:25:27.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3578000000000001e-05 2020-11-12T17:25:27.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:27.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044289+0000", 2020-11-12T17:25:27.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28865362300000003 2020-11-12T17:25:27.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:27.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.332943+0000", 2020-11-12T17:25:27.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.345e-06 2020-11-12T17:25:27.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:27.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.332950+0000", 2020-11-12T17:25:27.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015810780000000001 2020-11-12T17:25:27.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:27.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334531+0000", 2020-11-12T17:25:27.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6631999999999998e-05 2020-11-12T17:25:27.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:27.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334558+0000", 2020-11-12T17:25:27.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00040088800000000001 2020-11-12T17:25:27.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:27.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:27.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:27.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334959+0000", 2020-11-12T17:25:27.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29069468999999998 2020-11-12T17:25:27.257 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.257 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.257 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.257 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:27.258 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:27.258 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:27.259 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:27.254+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:27.260 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:27.360 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:27.358+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:27.377 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:25:27.396 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:27.432 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:27.432 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:27.432 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:27.433 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:27.444 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:25:27.461 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:27.458+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:27.557 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:27.563 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:27.558+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:27.587 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:27.613 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:27.613 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:27.625 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:25:27.625 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:27.653 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:27.662 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:27.658+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:27.696 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:27.737 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:27.755 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:27.755 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:27.763 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:27.756+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:27.766 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:27.770 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:27.771 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:27.771 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:27.771 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:27.771 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:25:27.772 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:27.772 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:27.772 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:27.772 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:27.772 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:27.773 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:27.774 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:27.864 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:27.860+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:27.883 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:27.883 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:27.897 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:27.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 36 16 36700 36684 7.96015 6.74219 0.0101602 0.0156863 2020-11-12T17:25:27.964 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:27.962+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:28.058 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:28.059 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:28.065 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:28.062+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:28.069 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:28.166 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:28.162+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:28.181 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:28.182 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:28.195 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:28.268 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:28.266+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:28.327 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:28.327 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:28.340 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:28.384 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:28.382+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:28.471 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:28.466+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:28.506 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:28.507 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:28.520 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:28.608 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:28.606+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:28.675 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:28.670+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:28.679 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2020-11-12T17:25:28.679 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-12T17:25:28.679 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-12T17:25:28.682 INFO:tasks.ceph.osd.1:Started 2020-11-12T17:25:28.682 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:25:28.693 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:28.694 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:28.707 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:28.792 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:28.790+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:28.799 INFO:teuthology.orchestra.run.smithi036.stderr:no valid command found; 10 closest matches: 2020-11-12T17:25:28.800 INFO:teuthology.orchestra.run.smithi036.stderr:0 2020-11-12T17:25:28.800 INFO:teuthology.orchestra.run.smithi036.stderr:1 2020-11-12T17:25:28.800 INFO:teuthology.orchestra.run.smithi036.stderr:2 2020-11-12T17:25:28.800 INFO:teuthology.orchestra.run.smithi036.stderr:abort 2020-11-12T17:25:28.800 INFO:teuthology.orchestra.run.smithi036.stderr:assert 2020-11-12T17:25:28.800 INFO:teuthology.orchestra.run.smithi036.stderr:config diff 2020-11-12T17:25:28.801 INFO:teuthology.orchestra.run.smithi036.stderr:config diff get 2020-11-12T17:25:28.801 INFO:teuthology.orchestra.run.smithi036.stderr:config get 2020-11-12T17:25:28.801 INFO:teuthology.orchestra.run.smithi036.stderr:config help [] 2020-11-12T17:25:28.801 INFO:teuthology.orchestra.run.smithi036.stderr:config set ... 2020-11-12T17:25:28.801 INFO:teuthology.orchestra.run.smithi036.stderr:admin_socket: invalid command 2020-11-12T17:25:28.802 DEBUG:teuthology.orchestra.run:got remote process result: 22 2020-11-12T17:25:28.802 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2020-11-12T17:25:28.876 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:28.876 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:28.880 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:28.876+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:28.886 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:28.930 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 37 16 37667 37651 7.94917 7.55469 0.0114565 0.0156934 2020-11-12T17:25:28.981 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:28.978+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:29.051 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:29.052 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:29.063 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:29.083 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:29.076+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:29.184 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:29.178+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:29.224 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:29.225 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:29.237 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:29.285 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:29.280+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:29.333 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:29.328+0000 7f4dfd935d80 -1 Falling back to public interface 2020-11-12T17:25:29.385 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:29.382+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:29.391 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:25:29.407 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:29.408 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:29.421 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:29.508 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:29.506+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:29.587 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:29.580+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:29.599 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:29.600 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:29.612 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:29.688 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:29.684+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:29.775 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:29.789 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:29.789 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:29.789 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:29.786+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:29.800 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:29.891 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:29.884+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:29.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 38 16 38505 38489 7.91225 6.54688 0.0100731 0.0157812 2020-11-12T17:25:29.959 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:29.969 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:29.970 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:29.983 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:29.985 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:30.015 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:30.032 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:30.030+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:30.043 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:30.075 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:30.092 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:30.090+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:30.103 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:30.112 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:30.112 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:30.125 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:30.460 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:30.461 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:30.461 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.1 2020-11-12T17:25:30.461 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: problem getting command descriptions from osd.1 2020-11-12T17:25:30.461 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:25:30.462 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:30.462 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:30.462 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:30.463 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:30.463 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:30.463 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:30.464 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:30.464 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:30.452+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:30.560 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:30.556+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:30.605 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:25:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 141.761230614, 2020-11-12T17:25:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:25:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:30.609 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:30.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:30.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:30.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:25:30.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:25:30.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:25:30.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:25:30.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:25:30.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:25:30.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:25:30.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:25:30.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:25:30.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:25:30.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:25:30.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:25:30.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:25:30.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:25:30.622 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.623 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.624 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5735 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:30.624 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:30.624 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 140.10258007100001, 2020-11-12T17:25:30.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001, 2020-11-12T17:25:30.625 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.625 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.626 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:30.626 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:30.626 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:30.626 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5735 2020-11-12T17:25:30.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.626 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:30.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501098+0000", 2020-11-12T17:25:30.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:30.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501048+0000", 2020-11-12T17:25:30.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112571 2020-11-12T17:25:30.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501161+0000", 2020-11-12T17:25:30.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3784999999999999e-05 2020-11-12T17:25:30.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501175+0000", 2020-11-12T17:25:30.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5439999999999999e-06 2020-11-12T17:25:30.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.501183+0000", 2020-11-12T17:25:30.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020394060000000001 2020-11-12T17:25:30.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503223+0000", 2020-11-12T17:25:30.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2310000000000004e-05 2020-11-12T17:25:30.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503295+0000", 2020-11-12T17:25:30.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111241 2020-11-12T17:25:30.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:30.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503406+0000", 2020-11-12T17:25:30.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044731959999999996 2020-11-12T17:25:30.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:30.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507879+0000", 2020-11-12T17:25:30.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.305275148 2020-11-12T17:25:30.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:30.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813155+0000", 2020-11-12T17:25:30.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145554 2020-11-12T17:25:30.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813300+0000", 2020-11-12T17:25:30.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000147 2020-11-12T17:25:30.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.813447+0000", 2020-11-12T17:25:30.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31234949200000001 2020-11-12T17:25:30.640 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.640 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.640 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.640 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5736 3.d 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:30.641 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:30.641 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 140.100975011, 2020-11-12T17:25:30.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002, 2020-11-12T17:25:30.642 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.642 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.642 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:30.642 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:30.643 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:30.643 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5736 2020-11-12T17:25:30.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.643 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:30.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502703+0000", 2020-11-12T17:25:30.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:30.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502683+0000", 2020-11-12T17:25:30.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0462000000000004e-05 2020-11-12T17:25:30.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502754+0000", 2020-11-12T17:25:30.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0352e-05 2020-11-12T17:25:30.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502764+0000", 2020-11-12T17:25:30.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6930000000000001e-06 2020-11-12T17:25:30.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.502771+0000", 2020-11-12T17:25:30.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010862300000000001 2020-11-12T17:25:30.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503857+0000", 2020-11-12T17:25:30.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0469000000000005e-05 2020-11-12T17:25:30.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.503937+0000", 2020-11-12T17:25:30.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012522999999999999 2020-11-12T17:25:30.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:30.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504063+0000", 2020-11-12T17:25:30.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00382132 2020-11-12T17:25:30.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:30.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.507884+0000", 2020-11-12T17:25:30.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308883197 2020-11-12T17:25:30.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:30.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816767+0000", 2020-11-12T17:25:30.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010744899999999999 2020-11-12T17:25:30.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816875+0000", 2020-11-12T17:25:30.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011744900000000001 2020-11-12T17:25:30.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.816992+0000", 2020-11-12T17:25:30.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31428951100000002 2020-11-12T17:25:30.657 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.657 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.657 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.658 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:30.658 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:30.658 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 136.203480007, 2020-11-12T17:25:30.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:25:30.658 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.659 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.659 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:30.659 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:30.659 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:30.659 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:25:30.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.660 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:30.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:30.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:30.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:25:30.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:25:30.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:25:30.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:25:30.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:25:30.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:25:30.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:25:30.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:25:30.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:25:30.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:25:30.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:25:30.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:25:30.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:30.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:25:30.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:25:30.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:30.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:25:30.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:25:30.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:30.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:25:30.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:25:30.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:25:30.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:25:30.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:25:30.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:25:30.673 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.673 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.674 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.674 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:30.674 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:30.674 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 136.201033392, 2020-11-12T17:25:30.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:25:30.675 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.675 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.675 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:30.675 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:30.675 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:30.675 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:25:30.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.676 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:30.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:30.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:30.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:25:30.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:25:30.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:25:30.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:25:30.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:25:30.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:25:30.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:25:30.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:25:30.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:25:30.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:25:30.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:25:30.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:25:30.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:30.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:25:30.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:25:30.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:30.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:25:30.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:25:30.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:30.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:25:30.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:25:30.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:25:30.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:25:30.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:25:30.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:25:30.687 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.688 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.688 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:30.688 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:30.689 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 136.19520894499999, 2020-11-12T17:25:30.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:25:30.689 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.689 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:30.689 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:30.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:30.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:30.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:25:30.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:25:30.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:25:30.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:25:30.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:25:30.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:25:30.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:25:30.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:25:30.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:25:30.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:25:30.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:25:30.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:25:30.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:25:30.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:25:30.696 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.696 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.696 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.696 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:30.697 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:30.697 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 136.19514106899999, 2020-11-12T17:25:30.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:25:30.697 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.697 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:30.697 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:30.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:30.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:30.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:25:30.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:25:30.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:25:30.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:25:30.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:25:30.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:25:30.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:25:30.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:25:30.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:25:30.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:25:30.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:25:30.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:25:30.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:25:30.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:25:30.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.704 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.705 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:25:30.705 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:30.705 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.06915080100001, 2020-11-12T17:25:30.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:25:30.705 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.705 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.705 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:30.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:30.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:30.706 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:25:30.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.706 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:30.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:30.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:25:30.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:25:30.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:25:30.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:25:30.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:25:30.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:25:30.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:25:30.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:25:30.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:25:30.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:25:30.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:25:30.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:25:30.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:25:30.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:30.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:25:30.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:25:30.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:30.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:25:30.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:25:30.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:30.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:25:30.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:25:30.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:25:30.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:25:30.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:25:30.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:25:30.715 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.715 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.716 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.716 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:25:30.716 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:30.716 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.061847082, 2020-11-12T17:25:30.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:25:30.717 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.717 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:30.717 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:30.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:30.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:25:30.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:25:30.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:25:30.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:25:30.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:25:30.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:25:30.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:25:30.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:25:30.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:25:30.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:25:30.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:30.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:25:30.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:25:30.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:25:30.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:25:30.723 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.724 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.724 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.724 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:30.724 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:30.724 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 105.688268589, 2020-11-12T17:25:30.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:25:30.725 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.725 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.725 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:30.725 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:30.725 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:30.725 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:25:30.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.726 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:30.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:30.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:30.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:25:30.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:25:30.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:25:30.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:25:30.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:25:30.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:25:30.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:25:30.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:25:30.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:25:30.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:25:30.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:25:30.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:25:30.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:30.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:25:30.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:25:30.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:30.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:25:30.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:25:30.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:30.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:25:30.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:25:30.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:25:30.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:25:30.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:25:30.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:25:30.735 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.735 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.735 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.735 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:25:30.736 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:30.736 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 105.676715469, 2020-11-12T17:25:30.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:25:30.736 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.736 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:30.736 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:30.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:30.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:30.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:25:30.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:25:30.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:25:30.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:25:30.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:25:30.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:25:30.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:25:30.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:25:30.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:25:30.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:25:30.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:25:30.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:25:30.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:25:30.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:25:30.743 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.743 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.743 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.743 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:30.743 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:30.744 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.60359528799999, 2020-11-12T17:25:30.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:25:30.744 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.744 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.744 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:30.744 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:30.744 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:30.745 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:25:30.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.745 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:30.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:30.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:30.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:25:30.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:25:30.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:25:30.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:25:30.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:25:30.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:25:30.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:25:30.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:25:30.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:25:30.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:25:30.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:25:30.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:25:30.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:30.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:25:30.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:25:30.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:30.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:25:30.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:25:30.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:30.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:25:30.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:25:30.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:25:30.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:25:30.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:25:30.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:25:30.754 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.754 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.754 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.755 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:30.755 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:30.755 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 91.316295574999998, 2020-11-12T17:25:30.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:25:30.755 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.755 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:30.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:30.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:30.756 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:25:30.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.756 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:30.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:30.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:30.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:25:30.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:25:30.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:25:30.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:25:30.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:25:30.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:25:30.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:25:30.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:25:30.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:25:30.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:25:30.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:25:30.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:25:30.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:30.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:25:30.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:25:30.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:30.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:25:30.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:25:30.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:30.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:25:30.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:25:30.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:25:30.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:25:30.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:25:30.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:25:30.765 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.765 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.766 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:30.766 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:30.766 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 90.770902585000002, 2020-11-12T17:25:30.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:25:30.767 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.767 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.767 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:30.767 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:30.767 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:30.767 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:25:30.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.768 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:30.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:30.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:30.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:25:30.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:25:30.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:25:30.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:25:30.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:25:30.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:25:30.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:25:30.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:25:30.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:25:30.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:25:30.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:25:30.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:25:30.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:30.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:25:30.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:25:30.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:30.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:25:30.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:25:30.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:30.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:25:30.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:25:30.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:25:30.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:25:30.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:25:30.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:25:30.777 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.777 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.777 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.777 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:25:30.778 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:30.778 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.778352325, 2020-11-12T17:25:30.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:25:30.778 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.778 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.778 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:30.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:30.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:30.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:25:30.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:25:30.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:25:30.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:25:30.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:25:30.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:25:30.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:25:30.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:25:30.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:25:30.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:25:30.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:25:30.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:25:30.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:25:30.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:25:30.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:25:30.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:25:30.785 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.785 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.785 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.786 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57960 3.7 e57/20 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head v 57'3648, mlcod=57'3642)", 2020-11-12T17:25:30.786 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:30.786 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.874619557000003, 2020-11-12T17:25:30.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998, 2020-11-12T17:25:30.790 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.790 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.790 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:30.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729058+0000", 2020-11-12T17:25:30.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:30.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729033+0000", 2020-11-12T17:25:30.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001002 2020-11-12T17:25:30.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.729133+0000", 2020-11-12T17:25:30.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30451762900000001 2020-11-12T17:25:30.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033650+0000", 2020-11-12T17:25:30.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2909999999999998e-06 2020-11-12T17:25:30.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033656+0000", 2020-11-12T17:25:30.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1718000000000003e-05 2020-11-12T17:25:30.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033697+0000", 2020-11-12T17:25:30.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2977999999999999e-05 2020-11-12T17:25:30.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.033720+0000", 2020-11-12T17:25:30.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058524529999999996 2020-11-12T17:25:30.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039573+0000", 2020-11-12T17:25:30.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2095999999999997e-05 2020-11-12T17:25:30.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.039625+0000", 2020-11-12T17:25:30.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31056690599999998 2020-11-12T17:25:30.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.798 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.798 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.798 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:25:30.798 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:30.798 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 66.942516153, 2020-11-12T17:25:30.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:25:30.799 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.799 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.799 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:30.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:30.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:30.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:25:30.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:25:30.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:25:30.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:25:30.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:25:30.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:25:30.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:25:30.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:25:30.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:25:30.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:25:30.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:25:30.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:25:30.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:25:30.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:25:30.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:25:30.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:25:30.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.806 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.807 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:1240 4.a e71/69 4:5ae32822:::benchmark_data_smithi036_18856_object154:head v 71'104, mlcod=71'98)", 2020-11-12T17:25:30.807 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:30.807 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.626301613000003, 2020-11-12T17:25:30.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295, 2020-11-12T17:25:30.807 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.807 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.808 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:30.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:30.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:30.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977341+0000", 2020-11-12T17:25:30.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013138399999999999 2020-11-12T17:25:30.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977473+0000", 2020-11-12T17:25:30.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011075199999998 2020-11-12T17:25:30.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337584+0000", 2020-11-12T17:25:30.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2939999999999994e-06 2020-11-12T17:25:30.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337593+0000", 2020-11-12T17:25:30.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0656999999999996e-05 2020-11-12T17:25:30.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337684+0000", 2020-11-12T17:25:30.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819999999999997e-05 2020-11-12T17:25:30.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337715+0000", 2020-11-12T17:25:30.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031310180000000002 2020-11-12T17:25:30.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340846+0000", 2020-11-12T17:25:30.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2611000000000002e-05 2020-11-12T17:25:30.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340889+0000", 2020-11-12T17:25:30.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295 2020-11-12T17:25:30.815 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.815 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.815 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.816 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:7176 4.0 e73/69 4:0798add9:::benchmark_data_smithi036_18856_object896:head v 73'408, mlcod=73'401)", 2020-11-12T17:25:30.816 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:30.816 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.642891081000002, 2020-11-12T17:25:30.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002, 2020-11-12T17:25:30.816 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.816 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.816 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:30.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:30.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:25:30.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960758+0000", 2020-11-12T17:25:30.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6748000000000003e-05 2020-11-12T17:25:30.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960855+0000", 2020-11-12T17:25:30.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31998174899999998 2020-11-12T17:25:30.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280837+0000", 2020-11-12T17:25:30.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8499999999999996e-06 2020-11-12T17:25:30.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280844+0000", 2020-11-12T17:25:30.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7806000000000002e-05 2020-11-12T17:25:30.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280902+0000", 2020-11-12T17:25:30.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5435e-05 2020-11-12T17:25:30.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280927+0000", 2020-11-12T17:25:30.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003038785 2020-11-12T17:25:30.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.283966+0000", 2020-11-12T17:25:30.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:25:30.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.284022+0000", 2020-11-12T17:25:30.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002 2020-11-12T17:25:30.823 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.824 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.824 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.824 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:18168 4.a e77/69 4:5a8774b4:::benchmark_data_smithi036_18856_object2270:head v 77'1272, mlcod=77'1264)", 2020-11-12T17:25:30.824 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:30.824 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.404143445999999, 2020-11-12T17:25:30.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998, 2020-11-12T17:25:30.825 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:30.825 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:30.825 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:30.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:30.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:30.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:30.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:30.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:30.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:30.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:30.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199509+0000", 2020-11-12T17:25:30.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4102000000000002e-05 2020-11-12T17:25:30.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:30.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199593+0000", 2020-11-12T17:25:30.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34680651499999998 2020-11-12T17:25:30.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:30.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546399+0000", 2020-11-12T17:25:30.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2539e-05 2020-11-12T17:25:30.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:30.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546412+0000", 2020-11-12T17:25:30.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000133242 2020-11-12T17:25:30.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:30.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546545+0000", 2020-11-12T17:25:30.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5343999999999999e-05 2020-11-12T17:25:30.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:30.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546581+0000", 2020-11-12T17:25:30.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047227149999999997 2020-11-12T17:25:30.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:30.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551303+0000", 2020-11-12T17:25:30.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112599 2020-11-12T17:25:30.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:30.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:30.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:30.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551416+0000", 2020-11-12T17:25:30.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998 2020-11-12T17:25:30.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.832 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:30.833 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:30.833 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:30.834 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:25:30.835 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:30.828+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:30.835 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:30.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 39 16 39340 39324 7.87663 6.52344 0.0138249 0.0158512 2020-11-12T17:25:30.935 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:30.932+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:31.012 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:31.013 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:31.022 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:31.064 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:31.060+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:31.137 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:31.132+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:31.187 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:31.187 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:31.187 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:31.188 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:31.188 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:31.199 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:31.239 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:31.234+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:31.340 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:31.336+0000 7f4dfd935d80 -1 osd.1 57 log_to_monitors {default=true} 2020-11-12T17:25:31.340 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:31.338+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:31.367 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:31.367 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:31.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:31.368 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:31.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.368 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:31.368 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:31.369 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 146.254770329, 2020-11-12T17:25:31.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:25:31.369 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.369 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.369 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.370 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:31.370 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:31.370 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:25:31.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.370 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:31.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:31.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:31.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:25:31.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:25:31.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:25:31.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:25:31.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:25:31.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:25:31.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:25:31.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:25:31.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:25:31.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:25:31.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:25:31.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:25:31.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:31.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:25:31.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:25:31.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:25:31.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:25:31.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:25:31.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:25:31.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:25:31.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:25:31.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:25:31.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:25:31.388 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.388 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.388 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.389 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:25:31.389 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:31.390 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 146.247678533, 2020-11-12T17:25:31.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:25:31.390 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.391 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:31.391 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:31.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:31.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:31.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:25:31.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:25:31.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:25:31.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:25:31.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:25:31.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:25:31.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:25:31.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:25:31.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:25:31.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:25:31.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:25:31.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:25:31.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:25:31.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:25:31.404 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.404 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.404 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.405 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:31.406 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:31.406 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 136.815119036, 2020-11-12T17:25:31.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:25:31.406 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.407 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.407 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.407 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:31.408 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:31.408 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:25:31.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.409 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:31.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:31.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:31.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:25:31.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:25:31.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:25:31.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:25:31.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:25:31.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:25:31.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:25:31.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:25:31.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:25:31.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:25:31.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:25:31.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:25:31.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:31.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:25:31.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:25:31.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:25:31.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:25:31.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:25:31.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:25:31.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:25:31.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:25:31.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:25:31.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:25:31.424 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.425 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.425 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.426 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:25:31.426 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:31.426 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.864998942, 2020-11-12T17:25:31.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:25:31.427 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.427 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:31.428 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:31.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:31.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:31.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:25:31.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:25:31.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:25:31.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:25:31.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:25:31.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:25:31.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:25:31.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:25:31.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:25:31.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:25:31.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:25:31.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:25:31.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:25:31.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:25:31.435 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.435 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.435 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.436 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:28424 3.b e47/20 3:d6b3d883:::benchmark_data_smithi036_14212_object3552:head v 47'1832, mlcod=47'1825)", 2020-11-12T17:25:31.436 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:31.436 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.83982758099999, 2020-11-12T17:25:31.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002, 2020-11-12T17:25:31.436 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.436 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.437 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:31.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:31.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:31.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523784+0000", 2020-11-12T17:25:31.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100963 2020-11-12T17:25:31.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523885+0000", 2020-11-12T17:25:31.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29458836900000002 2020-11-12T17:25:31.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818473+0000", 2020-11-12T17:25:31.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1482e-05 2020-11-12T17:25:31.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818485+0000", 2020-11-12T17:25:31.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4080999999999998e-05 2020-11-12T17:25:31.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818559+0000", 2020-11-12T17:25:31.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9269e-05 2020-11-12T17:25:31.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818598+0000", 2020-11-12T17:25:31.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044328520000000001 2020-11-12T17:25:31.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823031+0000", 2020-11-12T17:25:31.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2584999999999998e-05 2020-11-12T17:25:31.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823094+0000", 2020-11-12T17:25:31.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002 2020-11-12T17:25:31.444 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.444 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.444 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.444 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:25:31.444 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:31.445 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 100.75939705, 2020-11-12T17:25:31.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:25:31.446 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.446 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.447 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:31.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:31.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:31.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:25:31.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:25:31.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:25:31.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:25:31.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:25:31.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:31.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:25:31.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:25:31.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:25:31.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:25:31.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:25:31.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:25:31.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:25:31.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:25:31.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:25:31.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:25:31.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.454 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.454 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43535 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:31.454 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:31.454 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.654427248999994, 2020-11-12T17:25:31.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003, 2020-11-12T17:25:31.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.455 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:31.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:31.455 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43535 2020-11-12T17:25:31.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.456 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:31.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:31.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:31.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709201+0000", 2020-11-12T17:25:31.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4987000000000001e-05 2020-11-12T17:25:31.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709256+0000", 2020-11-12T17:25:31.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9799999999999998e-06 2020-11-12T17:25:31.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709264+0000", 2020-11-12T17:25:31.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:25:31.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709268+0000", 2020-11-12T17:25:31.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01033796 2020-11-12T17:25:31.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719606+0000", 2020-11-12T17:25:31.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014753499999999999 2020-11-12T17:25:31.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719754+0000", 2020-11-12T17:25:31.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023477900000000001 2020-11-12T17:25:31.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:31.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719989+0000", 2020-11-12T17:25:31.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002308844 2020-11-12T17:25:31.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722298+0000", 2020-11-12T17:25:31.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27981983300000002 2020-11-12T17:25:31.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002117+0000", 2020-11-12T17:25:31.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4757000000000001e-05 2020-11-12T17:25:31.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002212+0000", 2020-11-12T17:25:31.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116928 2020-11-12T17:25:31.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002329+0000", 2020-11-12T17:25:31.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003 2020-11-12T17:25:31.464 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.464 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.464 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.465 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43536 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:31.465 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:31.465 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.654327718000005, 2020-11-12T17:25:31.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001, 2020-11-12T17:25:31.465 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.466 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:31.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:31.466 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43536 2020-11-12T17:25:31.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.466 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:31.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:31.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:31.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709302+0000", 2020-11-12T17:25:31.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3248999999999998e-05 2020-11-12T17:25:31.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709355+0000", 2020-11-12T17:25:31.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.34e-06 2020-11-12T17:25:31.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709363+0000", 2020-11-12T17:25:31.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.664e-06 2020-11-12T17:25:31.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709366+0000", 2020-11-12T17:25:31.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013071532 2020-11-12T17:25:31.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722438+0000", 2020-11-12T17:25:31.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141901 2020-11-12T17:25:31.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722580+0000", 2020-11-12T17:25:31.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118355 2020-11-12T17:25:31.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:31.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722698+0000", 2020-11-12T17:25:31.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014561839999999999 2020-11-12T17:25:31.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.724154+0000", 2020-11-12T17:25:31.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27825006499999999 2020-11-12T17:25:31.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002404+0000", 2020-11-12T17:25:31.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2908000000000001e-05 2020-11-12T17:25:31.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002477+0000", 2020-11-12T17:25:31.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020370300000000001 2020-11-12T17:25:31.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002681+0000", 2020-11-12T17:25:31.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001 2020-11-12T17:25:31.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.475 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.475 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:31.476 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:31.476 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.412913716000006, 2020-11-12T17:25:31.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:25:31.476 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.476 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.476 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.476 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:31.476 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:31.477 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:25:31.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.477 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:31.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:31.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:25:31.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:25:31.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:25:31.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:25:31.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:25:31.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:25:31.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:25:31.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:25:31.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:25:31.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:25:31.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:25:31.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:25:31.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:25:31.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:31.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:25:31.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:25:31.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:25:31.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:25:31.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:25:31.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:25:31.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:25:31.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:25:31.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:25:31.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:25:31.485 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.486 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.486 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:31.486 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:31.486 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.417071913999997, 2020-11-12T17:25:31.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:25:31.487 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.487 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:31.487 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:31.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:31.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:31.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:25:31.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:25:31.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:25:31.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:25:31.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:25:31.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:25:31.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:25:31.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:25:31.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:25:31.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:25:31.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:25:31.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:25:31.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:25:31.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:25:31.493 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.493 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.493 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.493 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:25:31.493 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:31.494 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 56.481968514999998, 2020-11-12T17:25:31.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:25:31.494 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.494 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:25:31.494 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:31.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:31.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:31.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:25:31.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:25:31.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:25:31.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:25:31.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:25:31.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:25:31.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.499 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:304 4.b 4:d3839b57:::benchmark_data_smithi036_18856_object37:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.225802958000003, 2020-11-12T17:25:31.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999, 2020-11-12T17:25:31.501 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.501 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.501 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.501 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:31.501 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:31.501 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 304 2020-11-12T17:25:31.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.501 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:31.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:31.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:31.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137813+0000", 2020-11-12T17:25:31.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9074999999999998e-05 2020-11-12T17:25:31.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137892+0000", 2020-11-12T17:25:31.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8020000000000003e-06 2020-11-12T17:25:31.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137902+0000", 2020-11-12T17:25:31.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7619999999999995e-06 2020-11-12T17:25:31.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137909+0000", 2020-11-12T17:25:31.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040533879999999998 2020-11-12T17:25:31.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.141963+0000", 2020-11-12T17:25:31.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162048 2020-11-12T17:25:31.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142125+0000", 2020-11-12T17:25:31.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00039201500000000001 2020-11-12T17:25:31.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:31.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142517+0000", 2020-11-12T17:25:31.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010951820000000001 2020-11-12T17:25:31.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.143612+0000", 2020-11-12T17:25:31.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.286564975 2020-11-12T17:25:31.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430177+0000", 2020-11-12T17:25:31.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8254000000000002e-05 2020-11-12T17:25:31.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430235+0000", 2020-11-12T17:25:31.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9767000000000001e-05 2020-11-12T17:25:31.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430275+0000", 2020-11-12T17:25:31.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999 2020-11-12T17:25:31.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.510 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.511 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:936 4.6 4:6403dfdf:::benchmark_data_smithi036_18856_object116:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:31.511 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:31.511 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 38.671358734999998, 2020-11-12T17:25:31.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001, 2020-11-12T17:25:31.511 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.511 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:31.512 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:31.512 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 936 2020-11-12T17:25:31.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.512 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:31.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:31.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:31.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692257+0000", 2020-11-12T17:25:31.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8807999999999994e-05 2020-11-12T17:25:31.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692346+0000", 2020-11-12T17:25:31.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1438e-05 2020-11-12T17:25:31.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692357+0000", 2020-11-12T17:25:31.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0989999999999998e-06 2020-11-12T17:25:31.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692362+0000", 2020-11-12T17:25:31.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036699900000000001 2020-11-12T17:25:31.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696032+0000", 2020-11-12T17:25:31.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021269999999999999 2020-11-12T17:25:31.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696245+0000", 2020-11-12T17:25:31.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00032215999999999999 2020-11-12T17:25:31.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:31.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696567+0000", 2020-11-12T17:25:31.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001477368 2020-11-12T17:25:31.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.698044+0000", 2020-11-12T17:25:31.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29849877600000002 2020-11-12T17:25:31.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996543+0000", 2020-11-12T17:25:31.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4288000000000004e-05 2020-11-12T17:25:31.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996617+0000", 2020-11-12T17:25:31.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1554999999999997e-05 2020-11-12T17:25:31.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996669+0000", 2020-11-12T17:25:31.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001 2020-11-12T17:25:31.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.521 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.521 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:25:31.521 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:25:31.521 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.717328024, 2020-11-12T17:25:31.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:25:31.522 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:31.522 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:25:31.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:25:31.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:31.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:25:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:25:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:25:31.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:25:31.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:25:31.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:25:31.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:25:31.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:25:31.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:25:31.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:25:31.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:25:31.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:25:31.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:25:31.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:25:31.528 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.528 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.528 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.529 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:25:31.529 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:25:31.529 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.46081934, 2020-11-12T17:25:31.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:25:31.529 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.529 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.530 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.530 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:31.530 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:31.530 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:25:31.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.530 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:25:31.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:25:31.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:31.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:25:31.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:25:31.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:25:31.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:25:31.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:25:31.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:25:31.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:25:31.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:25:31.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:25:31.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:25:31.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:25:31.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:25:31.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:31.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:25:31.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:25:31.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:25:31.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:25:31.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:25:31.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:25:31.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:25:31.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:25:31.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:25:31.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:25:31.539 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.539 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.539 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.539 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:25:31.540 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:25:31.540 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.460656969999999, 2020-11-12T17:25:31.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:25:31.540 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.540 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.540 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.540 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:31.541 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:31.541 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:25:31.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.541 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:25:31.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:25:31.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:25:31.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:25:31.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:25:31.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:25:31.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:25:31.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:25:31.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:25:31.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:25:31.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:25:31.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:25:31.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:25:31.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:25:31.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:25:31.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:31.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:25:31.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:25:31.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:25:31.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:25:31.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:25:31.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:25:31.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:25:31.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:25:31.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:25:31.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:25:31.549 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.549 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.550 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:25:31.550 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:25:31.550 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.452087982999998, 2020-11-12T17:25:31.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:25:31.551 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.551 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:31.551 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:25:31.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:25:31.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:31.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:25:31.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:25:31.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:25:31.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:25:31.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:25:31.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:25:31.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:25:31.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:25:31.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:25:31.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:25:31.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:25:31.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:25:31.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:25:31.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:25:31.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.557 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.557 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:31016 4.3 4:c401a391:::benchmark_data_smithi036_18856_object3876:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e84)", 2020-11-12T17:25:31.558 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.719718+0000", 2020-11-12T17:25:31.558 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.6439290530000008, 2020-11-12T17:25:31.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.295163962, 2020-11-12T17:25:31.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.558 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:31.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:31.559 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 31016 2020-11-12T17:25:31.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.559 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719718+0000", 2020-11-12T17:25:31.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719718+0000", 2020-11-12T17:25:31.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:31.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719683+0000", 2020-11-12T17:25:31.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119109 2020-11-12T17:25:31.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719803+0000", 2020-11-12T17:25:31.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4235e-05 2020-11-12T17:25:31.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719817+0000", 2020-11-12T17:25:31.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.619e-06 2020-11-12T17:25:31.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719825+0000", 2020-11-12T17:25:31.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003385599 2020-11-12T17:25:31.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.723211+0000", 2020-11-12T17:25:31.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016867 2020-11-12T17:25:31.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.723380+0000", 2020-11-12T17:25:31.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028993600000000002 2020-11-12T17:25:31.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:31.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.723670+0000", 2020-11-12T17:25:31.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046715749999999999 2020-11-12T17:25:31.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.728341+0000", 2020-11-12T17:25:31.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28638648799999999 2020-11-12T17:25:31.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.014728+0000", 2020-11-12T17:25:31.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2670999999999994e-05 2020-11-12T17:25:31.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.014820+0000", 2020-11-12T17:25:31.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2055000000000001e-05 2020-11-12T17:25:31.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.014882+0000", 2020-11-12T17:25:31.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.295163962 2020-11-12T17:25:31.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.570 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.571 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:31304 4.b 4:d34ad4b4:::benchmark_data_smithi036_18856_object3912:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e84)", 2020-11-12T17:25:31.571 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:22.033159+0000", 2020-11-12T17:25:31.571 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3304880150000002, 2020-11-12T17:25:31.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.301776131, 2020-11-12T17:25:31.571 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.571 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:31.571 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:31.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:31.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:31.572 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 31304 2020-11-12T17:25:31.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.572 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033159+0000", 2020-11-12T17:25:31.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033159+0000", 2020-11-12T17:25:31.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:25:31.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033136+0000", 2020-11-12T17:25:31.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010585 2020-11-12T17:25:31.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033242+0000", 2020-11-12T17:25:31.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3686999999999999e-05 2020-11-12T17:25:31.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033266+0000", 2020-11-12T17:25:31.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8850000000000001e-06 2020-11-12T17:25:31.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033273+0000", 2020-11-12T17:25:31.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00274186 2020-11-12T17:25:31.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.036015+0000", 2020-11-12T17:25:31.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013071900000000001 2020-11-12T17:25:31.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.036145+0000", 2020-11-12T17:25:31.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019973300000000001 2020-11-12T17:25:31.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:31.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.036345+0000", 2020-11-12T17:25:31.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020334289999999998 2020-11-12T17:25:31.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:31.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.038378+0000", 2020-11-12T17:25:31.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.296228932 2020-11-12T17:25:31.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:31.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334607+0000", 2020-11-12T17:25:31.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016707399999999999 2020-11-12T17:25:31.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334774+0000", 2020-11-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016120899999999999 2020-11-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334936+0000", 2020-11-12T17:25:31.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.301776131 2020-11-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:31304 4.b e84/69 ondisk, result = 0)", 2020-11-12T17:25:31.581 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:22.044264+0000", 2020-11-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3193835200000006, 2020-11-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29069468999999998, 2020-11-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:31.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044264+0000", 2020-11-12T17:25:31.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:31.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:31.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044264+0000", 2020-11-12T17:25:31.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:31.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:31.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044236+0000", 2020-11-12T17:25:31.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3578000000000001e-05 2020-11-12T17:25:31.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:31.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044289+0000", 2020-11-12T17:25:31.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28865362300000003 2020-11-12T17:25:31.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:31.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.332943+0000", 2020-11-12T17:25:31.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.345e-06 2020-11-12T17:25:31.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:31.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.332950+0000", 2020-11-12T17:25:31.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015810780000000001 2020-11-12T17:25:31.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:31.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334531+0000", 2020-11-12T17:25:31.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6631999999999998e-05 2020-11-12T17:25:31.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:31.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334558+0000", 2020-11-12T17:25:31.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00040088800000000001 2020-11-12T17:25:31.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:31.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:31.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:31.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334959+0000", 2020-11-12T17:25:31.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29069468999999998 2020-11-12T17:25:31.588 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.588 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.588 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.588 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:31.588 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:31.589 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:31.590 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:31.586+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:31.590 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:31.647 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:31.640+0000 7f4dea6fe700 -1 osd.1 57 handle_osd_map injecting map crc failure 2020-11-12T17:25:31.648 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:31.646+0000 7f928515c700 -1 osd.7 87 handle_osd_map injecting map crc failure 2020-11-12T17:25:31.692 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:31.686+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:31.741 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:31.741 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:31.741 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:31.741 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:31.754 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:25:31.794 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:31.790+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:31.885 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:31.885 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:31.886 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:31.886 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:31.886 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:31.900 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:31.892+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:31.901 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:25:31.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:25:31.930892+0000 min lat: 0.00228632 max lat: 0.869783 avg lat: 0.0159296 2020-11-12T17:25:31.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:25:31.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 40 16 40122 40106 7.83243 6.10938 0.00566883 0.0159296 2020-11-12T17:25:32.039 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:25:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.37683003199999, 2020-11-12T17:25:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:25:32.042 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.042 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.042 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:32.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:32.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:25:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:25:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:25:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:25:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:25:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:25:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:25:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:25:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:25:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:25:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:25:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:25:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:25:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:25:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:25:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:25:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.053 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.053 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.053 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:25:32.053 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:32.053 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.37592323699999, 2020-11-12T17:25:32.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:25:32.054 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.054 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.054 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:32.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:32.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:32.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:25:32.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:25:32.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:25:32.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:25:32.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:25:32.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:32.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:25:32.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:25:32.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:25:32.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:25:32.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:25:32.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:25:32.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:25:32.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:25:32.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:25:32.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:25:32.061 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.061 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.062 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.062 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:25:32.062 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:32.062 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.375221014, 2020-11-12T17:25:32.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:25:32.063 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.063 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.063 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:32.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:32.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:32.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:25:32.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:25:32.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:25:32.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:25:32.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:25:32.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:25:32.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:25:32.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:25:32.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:25:32.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:25:32.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:25:32.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:25:32.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:25:32.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:25:32.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:25:32.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:25:32.070 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.070 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.070 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.070 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:25:32.071 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:32.071 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.37071481800001, 2020-11-12T17:25:32.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:25:32.071 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.071 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.071 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:32.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:32.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:32.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:25:32.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:25:32.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:25:32.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:25:32.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:25:32.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:25:32.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:25:32.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:25:32.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:25:32.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:25:32.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:25:32.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:25:32.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:25:32.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:25:32.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:25:32.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:25:32.079 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.079 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.079 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.080 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:25:32.080 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:32.080 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 145.867173837, 2020-11-12T17:25:32.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:25:32.080 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.081 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.081 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:32.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:32.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:32.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:25:32.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:25:32.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:25:32.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:25:32.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:25:32.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:25:32.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:25:32.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:25:32.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:25:32.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:25:32.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:25:32.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:25:32.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:25:32.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:25:32.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:25:32.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:25:32.087 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.088 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.088 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.088 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:25:32.088 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:32.088 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 145.86624759599999, 2020-11-12T17:25:32.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:25:32.089 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.089 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.089 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:32.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:32.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:25:32.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:25:32.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:25:32.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:25:32.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:25:32.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:25:32.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:25:32.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:25:32.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:25:32.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:25:32.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:25:32.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:25:32.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:25:32.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:25:32.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:25:32.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:25:32.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:25:32.096 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.096 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.096 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.096 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:25:32.096 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:32.096 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 145.863900086, 2020-11-12T17:25:32.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:25:32.097 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.097 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.097 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:32.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:32.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:25:32.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:25:32.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:25:32.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:25:32.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:25:32.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:25:32.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:25:32.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:25:32.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:25:32.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:25:32.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:25:32.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:25:32.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:25:32.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:25:32.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:25:32.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:25:32.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:25:32.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.104 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.105 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:25:32.105 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:32.105 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 145.86313529399999, 2020-11-12T17:25:32.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:25:32.105 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.105 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.106 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:32.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:32.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:32.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:25:32.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:25:32.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:25:32.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:25:32.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:25:32.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:25:32.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:25:32.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:25:32.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:25:32.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:25:32.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:25:32.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:25:32.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:25:32.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:25:32.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:25:32.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:25:32.113 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.113 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.113 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.114 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:25:32.114 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:32.114 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 145.78090881599999, 2020-11-12T17:25:32.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:25:32.114 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.114 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.114 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:32.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:32.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:32.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:25:32.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:25:32.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:25:32.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:25:32.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:25:32.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:25:32.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:25:32.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:25:32.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:25:32.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:25:32.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:25:32.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:25:32.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:25:32.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:25:32.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:25:32.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:25:32.122 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.122 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.122 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.123 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:25:32.123 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:32.123 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.18879538300001, 2020-11-12T17:25:32.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:25:32.123 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.123 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.123 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:32.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:32.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:25:32.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:25:32.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:25:32.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:25:32.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:25:32.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:25:32.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:25:32.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:25:32.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:25:32.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:25:32.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:25:32.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:25:32.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:25:32.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:25:32.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:25:32.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:25:32.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:25:32.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.130 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.131 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:25:32.131 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:32.131 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.160135086, 2020-11-12T17:25:32.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:25:32.131 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.131 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.132 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:32.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:32.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:32.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:25:32.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:25:32.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:25:32.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:25:32.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:25:32.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:25:32.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:25:32.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:25:32.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:25:32.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:25:32.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:25:32.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:25:32.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:25:32.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:25:32.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:25:32.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:25:32.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.138 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.139 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:25:32.139 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:32.139 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.247538375, 2020-11-12T17:25:32.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:25:32.139 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.140 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.140 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:32.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:32.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:32.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:25:32.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:25:32.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:25:32.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:25:32.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:25:32.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:25:32.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:25:32.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:25:32.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:25:32.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:25:32.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:25:32.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:25:32.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:25:32.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:25:32.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:25:32.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:25:32.146 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.146 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.147 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.147 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:25:32.147 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:32.147 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.17639873100001, 2020-11-12T17:25:32.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:25:32.147 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.148 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.148 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:32.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:32.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:32.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:25:32.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:25:32.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:25:32.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:25:32.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:25:32.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:25:32.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:25:32.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:25:32.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:25:32.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:25:32.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:25:32.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:25:32.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:25:32.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:25:32.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:25:32.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:25:32.156 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.156 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.156 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.157 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:25:32.157 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:32.157 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.06701143999999, 2020-11-12T17:25:32.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:25:32.157 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.157 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.157 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:32.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:32.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:32.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:25:32.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:25:32.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:25:32.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:25:32.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:25:32.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:25:32.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:25:32.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:25:32.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:25:32.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:25:32.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:25:32.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:25:32.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:25:32.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:25:32.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:25:32.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:25:32.164 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.164 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.164 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.165 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:25:32.165 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:32.165 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.99647560099999, 2020-11-12T17:25:32.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:25:32.165 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.165 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.166 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:32.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:32.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:32.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:25:32.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:25:32.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:25:32.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:25:32.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:25:32.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:25:32.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:25:32.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:25:32.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:25:32.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:25:32.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:25:32.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:25:32.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:25:32.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:25:32.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:25:32.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:25:32.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.172 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.173 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:25:32.173 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:32.173 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.82710966299999, 2020-11-12T17:25:32.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:25:32.173 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.173 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.173 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:32.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:32.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:25:32.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:25:32.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:25:32.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:25:32.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:25:32.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:25:32.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:25:32.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:25:32.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:25:32.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:25:32.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:25:32.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:25:32.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:25:32.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:25:32.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:25:32.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:25:32.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:25:32.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.181 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:25:32.181 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:32.181 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.49848379100001, 2020-11-12T17:25:32.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:25:32.181 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.181 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.181 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:32.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:32.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:25:32.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:25:32.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:25:32.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:25:32.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:25:32.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:25:32.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:25:32.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:25:32.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:25:32.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:25:32.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:25:32.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:25:32.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:25:32.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:25:32.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:25:32.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:25:32.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:25:32.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.188 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.189 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:25:32.189 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:32.189 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 136.842020429, 2020-11-12T17:25:32.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:25:32.189 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.189 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.189 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:32.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:32.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:32.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:25:32.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:25:32.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:25:32.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:25:32.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:25:32.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:25:32.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:25:32.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:25:32.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:25:32.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:25:32.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:25:32.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:25:32.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:25:32.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:25:32.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:25:32.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:25:32.196 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.196 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.196 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.197 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:25:32.197 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:32.197 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 136.83937970599999, 2020-11-12T17:25:32.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:25:32.197 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.197 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.197 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:32.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:32.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:32.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:25:32.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:25:32.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:25:32.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:25:32.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:25:32.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:25:32.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:25:32.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:25:32.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:25:32.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:25:32.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:25:32.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:25:32.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:25:32.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:25:32.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:25:32.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:25:32.204 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.204 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.204 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.205 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:25:32.205 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:32.205 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 133.35513366699999, 2020-11-12T17:25:32.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:25:32.205 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.205 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.205 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:32.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:32.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:25:32.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:25:32.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:25:32.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:25:32.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:25:32.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:25:32.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:25:32.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:25:32.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:25:32.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:25:32.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:25:32.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:25:32.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:25:32.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:25:32.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:25:32.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:25:32.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:25:32.212 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.212 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.212 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.212 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.212 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.213 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:32.214 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:31.992+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:32.214 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:32.210+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:32.215 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:32.315 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:32.310+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:32.349 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:32.350 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:32.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.350 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:25:32.350 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:32.351 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.44284768699999999, 2020-11-12T17:25:32.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44288285199999999, 2020-11-12T17:25:32.351 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.351 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:32.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.352 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:32.352 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:32.352 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:25:32.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.352 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:32.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:32.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:25:32.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:25:32.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:25:32.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:25:32.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:25:32.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:25:32.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:25:32.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:25:32.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:25:32.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:25:32.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:25:32.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:25:32.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:25:32.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:32.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:25:32.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:25:32.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:25:32.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001755111 2020-11-12T17:25:32.360 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.360 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.361 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.361 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40376 4.0 4:0898c9e5:::benchmark_data_smithi036_18856_object5046:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:25:32.361 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:32.297702+0000", 2020-11-12T17:25:32.361 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.051050747, 2020-11-12T17:25:32.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.051194970999999999, 2020-11-12T17:25:32.362 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.362 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:32.362 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.362 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:32.363 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:32.363 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40376 2020-11-12T17:25:32.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.363 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.297702+0000", 2020-11-12T17:25:32.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.297702+0000", 2020-11-12T17:25:32.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:32.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.297661+0000", 2020-11-12T17:25:32.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013632999999999999 2020-11-12T17:25:32.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.297797+0000", 2020-11-12T17:25:32.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7651000000000001e-05 2020-11-12T17:25:32.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.297815+0000", 2020-11-12T17:25:32.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9189999999999999e-06 2020-11-12T17:25:32.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.297823+0000", 2020-11-12T17:25:32.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080357369999999994 2020-11-12T17:25:32.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.305859+0000", 2020-11-12T17:25:32.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148951 2020-11-12T17:25:32.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.306008+0000", 2020-11-12T17:25:32.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017094699999999999 2020-11-12T17:25:32.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:32.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.306178+0000", 2020-11-12T17:25:32.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001409502 2020-11-12T17:25:32.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.307588+0000", 2020-11-12T17:25:32.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098856800000000009 2020-11-12T17:25:32.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.372 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.372 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.372 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40425 4.0 4:0051237f:::benchmark_data_smithi036_18856_object5053:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:25:32.372 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:32.348591+0000", 2020-11-12T17:25:32.373 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00016175299999999999, 2020-11-12T17:25:32.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00040478299999999998, 2020-11-12T17:25:32.373 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.373 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:25:32.373 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.373 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:32.374 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:32.374 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40425 2020-11-12T17:25:32.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.374 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.348591+0000", 2020-11-12T17:25:32.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.348591+0000", 2020-11-12T17:25:32.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999433 2020-11-12T17:25:32.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.348535+0000", 2020-11-12T17:25:32.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015378899999999999 2020-11-12T17:25:32.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.348688+0000", 2020-11-12T17:25:32.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1860000000000001e-05 2020-11-12T17:25:32.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.348710+0000", 2020-11-12T17:25:32.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6330000000000002e-06 2020-11-12T17:25:32.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.348719+0000", 2020-11-12T17:25:32.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9456000000000001e-05 2020-11-12T17:25:32.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.348778+0000", 2020-11-12T17:25:32.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018700800000000001 2020-11-12T17:25:32.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.380 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.380 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:25:32.380 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 3 2020-11-12T17:25:32.381 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:32.382 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:32.432 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:32.428+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:32.534 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:32.536 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:32.536 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:32.536 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:32.537 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:32.537 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:32.537 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:32.538 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:32.532+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:32.637 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:32.634+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:32.716 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:32.716 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:32.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:32.717 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:32.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.717 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:32.717 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:32.717 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.293708737, 2020-11-12T17:25:32.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:25:32.718 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.718 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.718 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.718 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:32.718 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:32.718 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:25:32.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.719 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:32.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:32.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:25:32.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:25:32.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:25:32.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:25:32.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:25:32.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:25:32.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:25:32.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:25:32.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:25:32.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:25:32.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:25:32.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:25:32.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:25:32.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:32.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:25:32.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:25:32.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:25:32.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:25:32.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:25:32.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:25:32.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:25:32.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:25:32.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:25:32.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:25:32.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.730 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.731 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:25:32.731 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:32.731 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.286764675, 2020-11-12T17:25:32.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:25:32.731 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.731 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:32.732 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:32.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:32.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:32.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:25:32.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:25:32.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:25:32.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:25:32.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:25:32.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:25:32.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:25:32.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:25:32.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:25:32.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:25:32.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:25:32.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:25:32.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:25:32.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:25:32.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.739 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.740 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:32.740 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:32.740 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.11292688899999, 2020-11-12T17:25:32.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:25:32.740 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.741 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.741 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.741 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:32.741 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:32.741 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:25:32.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.741 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:32.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:32.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:32.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:25:32.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:25:32.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:25:32.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:25:32.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:25:32.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:25:32.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:25:32.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:25:32.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:25:32.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:25:32.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:25:32.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:25:32.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:32.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:25:32.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:25:32.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:25:32.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:25:32.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:25:32.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:25:32.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:25:32.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:25:32.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:25:32.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:25:32.753 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.753 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.753 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.754 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34328 3.8 3:12eb1396:::benchmark_data_smithi036_14212_object4290:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:32.754 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:32.754 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.155737492, 2020-11-12T17:25:32.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999, 2020-11-12T17:25:32.754 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.755 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:32.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:32.755 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34328 2020-11-12T17:25:32.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.755 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:32.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556460+0000", 2020-11-12T17:25:32.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999542 2020-11-12T17:25:32.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556414+0000", 2020-11-12T17:25:32.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133592 2020-11-12T17:25:32.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556547+0000", 2020-11-12T17:25:32.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8813000000000001e-05 2020-11-12T17:25:32.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556566+0000", 2020-11-12T17:25:32.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7660000000000004e-06 2020-11-12T17:25:32.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.556575+0000", 2020-11-12T17:25:32.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011688914999999999 2020-11-12T17:25:32.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568264+0000", 2020-11-12T17:25:32.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108214 2020-11-12T17:25:32.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568372+0000", 2020-11-12T17:25:32.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189846 2020-11-12T17:25:32.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:32.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.568562+0000", 2020-11-12T17:25:32.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016740710000000001 2020-11-12T17:25:32.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.570236+0000", 2020-11-12T17:25:32.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29321335900000001 2020-11-12T17:25:32.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863449+0000", 2020-11-12T17:25:32.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7244999999999998e-05 2020-11-12T17:25:32.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863507+0000", 2020-11-12T17:25:32.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0704999999999994e-05 2020-11-12T17:25:32.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:54.863587+0000", 2020-11-12T17:25:32.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30712787899999999 2020-11-12T17:25:32.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.766 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.767 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:32.767 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:32.767 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 97.641392980000006, 2020-11-12T17:25:32.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:25:32.767 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.768 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:32.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:32.768 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:25:32.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.769 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:32.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:32.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:25:32.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:25:32.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:25:32.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:25:32.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:25:32.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:25:32.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:25:32.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:25:32.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:25:32.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:25:32.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:25:32.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:25:32.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:25:32.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:32.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:25:32.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:25:32.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:25:32.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:25:32.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:25:32.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:25:32.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:25:32.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:25:32.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:25:32.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:25:32.779 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.779 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.779 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.780 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:32.780 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:32.780 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 97.626071757999995, 2020-11-12T17:25:32.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:25:32.780 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.780 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:32.780 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:32.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:32.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:32.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:25:32.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:25:32.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:25:32.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:25:32.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:25:32.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:25:32.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:25:32.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:25:32.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:25:32.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:32.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:25:32.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:25:32.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:25:32.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:25:32.788 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.788 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.788 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.788 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:32.789 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:32.789 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.849221795999995, 2020-11-12T17:25:32.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:25:32.789 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.789 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.789 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.790 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:32.790 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:32.790 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:25:32.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.790 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:32.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:32.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:32.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:25:32.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:25:32.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:25:32.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:25:32.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:25:32.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:25:32.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:25:32.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:25:32.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:25:32.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:25:32.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:25:32.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:25:32.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:32.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:25:32.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:25:32.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:25:32.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:25:32.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:25:32.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:25:32.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:25:32.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:25:32.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:25:32.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:25:32.800 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.800 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.801 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.801 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:32.801 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:32.801 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 70.892774954000004, 2020-11-12T17:25:32.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:25:32.802 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.802 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.802 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.803 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:32.803 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:32.803 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:25:32.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.803 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:32.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:32.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:32.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:25:32.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:25:32.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:25:32.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:25:32.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:25:32.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:25:32.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:25:32.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:25:32.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:25:32.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:25:32.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:25:32.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:25:32.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:32.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:25:32.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:25:32.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:25:32.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:25:32.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:25:32.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:25:32.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:25:32.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:25:32.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:25:32.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:25:32.818 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.818 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.819 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.819 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:25:32.819 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:32.819 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 70.763841470000003, 2020-11-12T17:25:32.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:25:32.820 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.820 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.820 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:32.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:32.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:25:32.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:25:32.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:25:32.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:25:32.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:25:32.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:25:32.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:25:32.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:25:32.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:25:32.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:25:32.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:25:32.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:25:32.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:25:32.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:25:32.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:25:32.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:25:32.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:25:32.828 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.828 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.828 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.829 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:32.829 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:32.829 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.991823183999998, 2020-11-12T17:25:32.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:25:32.829 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.829 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:32.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:32.830 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:25:32.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.830 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:32.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:32.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:32.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:25:32.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:25:32.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:25:32.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:25:32.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:25:32.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:25:32.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:25:32.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:25:32.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:25:32.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:25:32.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:25:32.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:25:32.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:32.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:25:32.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:25:32.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:25:32.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:25:32.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:25:32.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:25:32.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:25:32.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:25:32.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:25:32.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:25:32.840 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.841 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.841 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.841 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:32.841 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:32.842 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.069703196000006, 2020-11-12T17:25:32.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:25:32.842 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.842 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.842 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.842 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:32.843 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:32.843 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:25:32.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.843 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:32.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:32.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:25:32.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:25:32.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:25:32.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:25:32.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:25:32.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:25:32.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:25:32.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:25:32.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:25:32.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:25:32.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:25:32.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:25:32.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:25:32.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:32.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:25:32.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:25:32.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:25:32.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:25:32.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:25:32.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:25:32.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:25:32.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:25:32.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:25:32.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:25:32.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.853 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.854 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:59416 3.c e57/20 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head v 57'3976, mlcod=57'3970)", 2020-11-12T17:25:32.854 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:32.854 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.179363631000001, 2020-11-12T17:25:32.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998, 2020-11-12T17:25:32.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.855 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.855 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:32.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532833+0000", 2020-11-12T17:25:32.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:32.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532795+0000", 2020-11-12T17:25:32.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014490099999999999 2020-11-12T17:25:32.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.532940+0000", 2020-11-12T17:25:32.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29738320899999998 2020-11-12T17:25:32.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830323+0000", 2020-11-12T17:25:32.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3199999999999996e-06 2020-11-12T17:25:32.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830330+0000", 2020-11-12T17:25:32.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9622999999999994e-05 2020-11-12T17:25:32.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830399+0000", 2020-11-12T17:25:32.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4766999999999999e-05 2020-11-12T17:25:32.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.830424+0000", 2020-11-12T17:25:32.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038976610000000002 2020-11-12T17:25:32.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834322+0000", 2020-11-12T17:25:32.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7682999999999994e-05 2020-11-12T17:25:32.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.834410+0000", 2020-11-12T17:25:32.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30157616399999998 2020-11-12T17:25:32.863 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.863 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.863 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.863 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:25:32.863 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:32.864 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.755149549999999, 2020-11-12T17:25:32.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:25:32.864 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.864 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:32.865 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:32.865 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:25:32.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.865 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:32.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:32.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:32.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:25:32.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:25:32.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:25:32.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:25:32.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:25:32.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:25:32.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:25:32.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:25:32.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:25:32.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:25:32.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:25:32.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:25:32.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:32.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:25:32.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:25:32.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:25:32.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:25:32.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:25:32.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:25:32.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:25:32.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:25:32.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:25:32.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:25:32.875 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.875 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.876 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:25:32.876 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:25:32.876 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.400464474, 2020-11-12T17:25:32.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:25:32.877 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.877 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:32.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:32.877 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:25:32.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.878 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:25:32.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:25:32.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:25:32.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:25:32.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:25:32.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:25:32.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:25:32.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:25:32.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:25:32.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:25:32.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:25:32.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:25:32.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:25:32.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:25:32.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:25:32.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:32.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:25:32.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:25:32.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:25:32.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:25:32.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:25:32.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:25:32.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:25:32.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:25:32.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:25:32.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:25:32.888 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.888 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.888 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.889 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:25:32.889 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:25:32.889 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.387287714999999, 2020-11-12T17:25:32.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:25:32.889 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.889 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:32.890 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:25:32.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:25:32.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:25:32.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:25:32.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:25:32.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:25:32.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:25:32.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:25:32.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:25:32.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:25:32.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:25:32.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:25:32.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:25:32.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:25:32.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:25:32.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:25:32.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:25:32.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.897 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.897 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:32.897 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:25:32.898 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.8332062660000004, 2020-11-12T17:25:32.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:25:32.898 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.898 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.898 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.898 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:32.899 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:32.899 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:25:32.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.899 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:25:32.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:25:32.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:25:32.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:25:32.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:25:32.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:25:32.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:25:32.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:25:32.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:25:32.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:25:32.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:25:32.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:25:32.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:25:32.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:25:32.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:25:32.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:32.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:25:32.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:25:32.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:25:32.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:25:32.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:25:32.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:25:32.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:25:32.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:25:32.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:25:32.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:25:32.909 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.909 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.909 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.910 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:25:32.910 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:25:32.910 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.8242189599999996, 2020-11-12T17:25:32.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:25:32.911 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.911 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:32.911 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:25:32.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:25:32.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:25:32.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:25:32.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:25:32.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:25:32.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:25:32.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:25:32.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:25:32.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:25:32.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:25:32.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:25:32.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:25:32.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:25:32.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:25:32.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:25:32.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:25:32.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.918 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.919 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:35728 4.0 4:0ba2c915:::benchmark_data_smithi036_18856_object4465:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:32.919 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.813819+0000", 2020-11-12T17:25:32.919 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.8983782939999996, 2020-11-12T17:25:32.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31853714300000002, 2020-11-12T17:25:32.919 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.919 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:32.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:32.920 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35728 2020-11-12T17:25:32.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.920 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813819+0000", 2020-11-12T17:25:32.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813819+0000", 2020-11-12T17:25:32.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:25:32.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813780+0000", 2020-11-12T17:25:32.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102786 2020-11-12T17:25:32.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813882+0000", 2020-11-12T17:25:32.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2130000000000001e-05 2020-11-12T17:25:32.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813895+0000", 2020-11-12T17:25:32.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0839999999999997e-06 2020-11-12T17:25:32.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813901+0000", 2020-11-12T17:25:32.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0059487150000000003 2020-11-12T17:25:32.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.819849+0000", 2020-11-12T17:25:32.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011679 2020-11-12T17:25:32.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.819966+0000", 2020-11-12T17:25:32.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019489600000000001 2020-11-12T17:25:32.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:32.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.820161+0000", 2020-11-12T17:25:32.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017291679999999999 2020-11-12T17:25:32.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.821890+0000", 2020-11-12T17:25:32.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31039288100000001 2020-11-12T17:25:32.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132283+0000", 2020-11-12T17:25:32.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5061000000000002e-05 2020-11-12T17:25:32.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132318+0000", 2020-11-12T17:25:32.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7722000000000002e-05 2020-11-12T17:25:32.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132356+0000", 2020-11-12T17:25:32.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31853714300000002 2020-11-12T17:25:32.930 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.930 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.931 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.931 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:35728 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:25:32.931 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.822286+0000", 2020-11-12T17:25:32.931 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.8899114020000001, 2020-11-12T17:25:32.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31007312799999998, 2020-11-12T17:25:32.932 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.932 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:32.932 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.822286+0000", 2020-11-12T17:25:32.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.822286+0000", 2020-11-12T17:25:32.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:32.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.822249+0000", 2020-11-12T17:25:32.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6236999999999994e-05 2020-11-12T17:25:32.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.822345+0000", 2020-11-12T17:25:32.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30988090400000001 2020-11-12T17:25:32.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132226+0000", 2020-11-12T17:25:32.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3029999999999999e-06 2020-11-12T17:25:32.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132231+0000", 2020-11-12T17:25:32.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6786000000000003e-05 2020-11-12T17:25:32.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132268+0000", 2020-11-12T17:25:32.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0270000000000001e-06 2020-11-12T17:25:32.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132274+0000", 2020-11-12T17:25:32.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4476999999999998e-05 2020-11-12T17:25:32.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132359+0000", 2020-11-12T17:25:32.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31007312799999998 2020-11-12T17:25:32.939 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.939 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.939 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.939 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:25:32.940 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:32.940 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.80629164600000003, 2020-11-12T17:25:32.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:25:32.940 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:32.940 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:32.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:32.941 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:32.941 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:32.941 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:25:32.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.941 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:32.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:32.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:32.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:32.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:32.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:32.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:25:32.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:32.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:25:32.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:25:32.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:32.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:25:32.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:25:32.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:32.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:25:32.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:25:32.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:32.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:25:32.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:25:32.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:32.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:25:32.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:25:32.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:32.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:25:32.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:25:32.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:32.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:25:32.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:25:32.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:32.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:25:32.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:25:32.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:32.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:25:32.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:25:32.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:32.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:25:32.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:25:32.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:32.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:32.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:32.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:25:32.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:25:32.951 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.952 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:32.952 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:32.952 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:32.953 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:25:32.955 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:32.955 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:32.956 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:32.956 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:32.956 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:32.956 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:32.956 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 41 16 41039 41023 7.81611 7.16406 0.0116587 0.0159814 2020-11-12T17:25:32.957 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:32.950+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:32.957 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:33.057 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:33.052+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:33.086 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:33.086 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:33.097 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:33.157 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:33.154+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:33.225 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:33.225 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:33.240 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:33.257 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:33.252+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:33.357 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:33.352+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:33.401 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:33.401 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:33.416 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:33.459 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:33.452+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:33.550 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:33.550 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:33.560 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:33.558+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:33.561 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:33.661 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:33.658+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:33.672 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:33.668+0000 7f4302dbd700 -1 osd.2 89 handle_osd_map injecting map crc failure 2020-11-12T17:25:33.674 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:33.670+0000 7f9a06aa2700 -1 osd.5 89 handle_osd_map injecting map crc failure 2020-11-12T17:25:33.675 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:25:33.739 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:33.744 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:33.744 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:33.759 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:33.769 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:33.772 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:33.772 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:25:33.772 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:25:33.773 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:33.773 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:33.773 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:33.773 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:33.773 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:33.801 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:33.798+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:33.804 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:25:33.863 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:33.858+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:33.917 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:33.917 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:33.918 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:33.918 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:33.927 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:25:33.927 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-11-12T17:25:33.928 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:33.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 42 16 41895 41879 7.78923 6.6875 0.00696329 0.0160108 2020-11-12T17:25:33.964 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:33.960+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:34.066 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:34.062+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:34.157 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:34.158 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:34.159 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:34.200 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:34.198+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:34.237 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:25:34.237 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 90, 2020-11-12T17:25:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:25:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2020-11-12T17:22:37.581394+0000", 2020-11-12T17:25:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2020-11-12T17:25:33.658064+0000", 2020-11-12T17:25:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2020-11-12T17:25:31.632418+0000", 2020-11-12T17:25:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2020-11-12T17:24:29.625503+0000", 2020-11-12T17:25:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-12T17:25:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5804032, 2020-11-12T17:25:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2020-11-12T17:25:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: "nodeep-scrub", 2020-11-12T17:25:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2020-11-12T17:25:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2020-11-12T17:25:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2020-11-12T17:25:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2020-11-12T17:25:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:25:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 4, 2020-11-12T17:25:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2020-11-12T17:25:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-12T17:25:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-12T17:25:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2020-11-12T17:25:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 4, 2020-11-12T17:25:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2020-11-12T17:25:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2020-11-12T17:25:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2020-11-12T17:25:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2020-11-12T17:25:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2020-11-12T17:25:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2020-11-12T17:25:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2020-11-12T17:25:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:41.596657+0000", 2020-11-12T17:25:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:25:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:25:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:25:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:25:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:25:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:25:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:25:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:25:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2020-11-12T17:25:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2020-11-12T17:25:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2020-11-12T17:25:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2020-11-12T17:25:34.245 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2020-11-12T17:25:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:25:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:25:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:25:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:25:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:25:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:25:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:25:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "16", 2020-11-12T17:25:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:25:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:25:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:25:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:25:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:25:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:25:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:25:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:25:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:25:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:25:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:25:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:25:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:25:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:25:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:25:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:25:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:25:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:25:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:25:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:25:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:25:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:25:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:25:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:25:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:25:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:25:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:25:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:25:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:25:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:25:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:25:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:25:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:25:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:25:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:25:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:25:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:25:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2020-11-12T17:25:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2020-11-12T17:25:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:25:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2020-11-12T17:25:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.256 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2020-11-12T17:25:34.256 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2020-11-12T17:25:34.256 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:49.905816+0000", 2020-11-12T17:25:34.256 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:25:34.257 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:25:34.257 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:25:34.257 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:25:34.257 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:25:34.257 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:25:34.257 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:25:34.257 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:25:34.258 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2020-11-12T17:25:34.258 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2020-11-12T17:25:34.258 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2020-11-12T17:25:34.258 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2020-11-12T17:25:34.258 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2020-11-12T17:25:34.259 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:25:34.259 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:25:34.259 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:25:34.259 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:25:34.259 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:25:34.259 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:25:34.259 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:25:34.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.260 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "19", 2020-11-12T17:25:34.260 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:25:34.260 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:25:34.260 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:25:34.260 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:25:34.260 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:25:34.261 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:25:34.261 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:25:34.261 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:25:34.261 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:25:34.261 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:25:34.261 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:25:34.261 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:25:34.262 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:25:34.262 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:25:34.262 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:25:34.262 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:25:34.262 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:25:34.262 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:25:34.263 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:25:34.263 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:25:34.263 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:25:34.263 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:25:34.263 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:25:34.263 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:25:34.263 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:25:34.263 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:25:34.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.264 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:25:34.264 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:25:34.264 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:25:34.264 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:25:34.264 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:25:34.264 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:25:34.265 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:25:34.265 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:25:34.265 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:25:34.265 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:25:34.265 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:25:34.265 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:25:34.265 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:25:34.266 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2020-11-12T17:25:34.266 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.266 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 4, 2020-11-12T17:25:34.266 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "unique_pool_1", 2020-11-12T17:25:34.266 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:24:49.045109+0000", 2020-11-12T17:25:34.267 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:25:34.267 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:25:34.267 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:25:34.267 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:25:34.267 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:25:34.267 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:25:34.267 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:25:34.268 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:25:34.268 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 16, 2020-11-12T17:25:34.268 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 16, 2020-11-12T17:25:34.268 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 16, 2020-11-12T17:25:34.268 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 16, 2020-11-12T17:25:34.268 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 16, 2020-11-12T17:25:34.268 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:25:34.268 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:25:34.269 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:25:34.269 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:25:34.269 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:25:34.269 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:25:34.269 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:25:34.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.270 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "71", 2020-11-12T17:25:34.270 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:25:34.270 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:25:34.270 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:25:34.270 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:25:34.270 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:25:34.270 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:25:34.271 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:25:34.271 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:25:34.271 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:25:34.271 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:25:34.271 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:25:34.271 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:25:34.271 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:25:34.272 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:25:34.272 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:25:34.272 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:25:34.272 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:25:34.272 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:25:34.272 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:25:34.272 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:25:34.273 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:25:34.273 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:25:34.273 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:25:34.273 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:25:34.273 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:25:34.273 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:25:34.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.273 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:25:34.274 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:25:34.274 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:25:34.274 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:25:34.274 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:25:34.274 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:25:34.274 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:25:34.275 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:25:34.275 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:25:34.275 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:25:34.275 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:25:34.275 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:25:34.275 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:25:34.275 INFO:teuthology.orchestra.run.smithi036.stdout: "rados": {} 2020-11-12T17:25:34.275 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.276 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.276 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:25:34.276 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2020-11-12T17:25:34.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.276 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:25:34.276 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "bd1d5457-5d54-4074-b378-9da417f42976", 2020-11-12T17:25:34.276 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:25:34.277 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:25:34.277 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:25:34.277 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:25:34.277 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:25:34.277 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:25:34.277 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:25:34.278 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:25:34.278 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:25:34.278 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:25:34.278 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:25:34.278 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.279 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.279 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6801", 2020-11-12T17:25:34.279 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:25:34.279 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.279 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.279 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:25:34.280 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.280 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.280 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2020-11-12T17:25:34.280 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:25:34.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.280 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.281 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:25:34.281 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.281 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.281 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2020-11-12T17:25:34.282 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:25:34.282 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.282 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.282 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:25:34.282 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.283 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.283 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2020-11-12T17:25:34.283 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:25:34.283 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.283 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.283 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6801/12304", 2020-11-12T17:25:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6802/12304", 2020-11-12T17:25:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6806/12304", 2020-11-12T17:25:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6804/12304", 2020-11-12T17:25:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:25:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:25:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:25:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:25:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "37152eee-a8d8-40f1-8e27-2899e7b94c98", 2020-11-12T17:25:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:25:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 0, 2020-11-12T17:25:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 0, 2020-11-12T17:25:34.286 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:25:34.286 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:25:34.286 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 57, 2020-11-12T17:25:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 88, 2020-11-12T17:25:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 35, 2020-11-12T17:25:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 58, 2020-11-12T17:25:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:25:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:25:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.288 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.288 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2020-11-12T17:25:34.288 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:25:34.288 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.289 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.289 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:25:34.289 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.289 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.290 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2020-11-12T17:25:34.290 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:25:34.290 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.290 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.291 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:25:34.291 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.292 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.292 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2020-11-12T17:25:34.292 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:25:34.292 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.293 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.293 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:25:34.293 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.294 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.294 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2020-11-12T17:25:34.295 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:25:34.295 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.295 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.295 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/20274", 2020-11-12T17:25:34.296 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6814/20274", 2020-11-12T17:25:34.296 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6816/20274", 2020-11-12T17:25:34.296 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6815/20274", 2020-11-12T17:25:34.296 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:25:34.297 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:25:34.297 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:25:34.297 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.298 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:25:34.298 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "d8ec2abb-38bf-4863-969a-482c4fa44f41", 2020-11-12T17:25:34.298 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:25:34.298 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 0, 2020-11-12T17:25:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 0, 2020-11-12T17:25:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:25:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:25:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:25:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:25:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 17, 2020-11-12T17:25:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:25:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:25:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:25:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2020-11-12T17:25:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12306 2020-11-12T17:25:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:25:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2020-11-12T17:25:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12306 2020-11-12T17:25:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:25:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2020-11-12T17:25:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12306 2020-11-12T17:25:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:25:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2020-11-12T17:25:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12306 2020-11-12T17:25:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/12306", 2020-11-12T17:25:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/12306", 2020-11-12T17:25:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6808/12306", 2020-11-12T17:25:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/12306", 2020-11-12T17:25:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:25:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:25:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:25:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:25:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "799d3499-577c-4510-a00c-9b2e126fc449", 2020-11-12T17:25:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:25:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:25:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:25:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:25:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:25:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:25:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:25:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:25:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:25:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:25:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:25:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2020-11-12T17:25:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:25:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:25:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2020-11-12T17:25:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:25:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.311 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:25:34.311 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.311 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.311 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2020-11-12T17:25:34.311 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:25:34.312 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.312 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.312 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:25:34.312 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.313 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.313 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2020-11-12T17:25:34.313 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:25:34.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.313 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.314 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6809/12305", 2020-11-12T17:25:34.314 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6810/12305", 2020-11-12T17:25:34.314 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6813/12305", 2020-11-12T17:25:34.314 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6811/12305", 2020-11-12T17:25:34.315 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:25:34.315 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:25:34.315 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:25:34.315 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.316 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:25:34.317 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "c36e3100-aadc-4117-b495-24fb08a34148", 2020-11-12T17:25:34.317 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:25:34.317 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:25:34.317 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:25:34.318 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:25:34.318 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:25:34.318 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:25:34.318 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:25:34.319 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:25:34.319 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:25:34.319 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:25:34.319 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:25:34.320 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.320 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.320 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6804", 2020-11-12T17:25:34.321 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:25:34.321 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.321 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.321 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:25:34.322 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.322 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.322 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6805", 2020-11-12T17:25:34.322 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:25:34.323 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.323 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.323 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:25:34.323 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.323 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.324 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6807", 2020-11-12T17:25:34.324 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:25:34.324 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.324 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.324 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:25:34.325 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.325 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.325 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6806", 2020-11-12T17:25:34.325 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:25:34.326 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.326 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.326 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6804/12499", 2020-11-12T17:25:34.326 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6805/12499", 2020-11-12T17:25:34.326 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6807/12499", 2020-11-12T17:25:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6806/12499", 2020-11-12T17:25:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:25:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:25:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:25:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:25:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "b152141f-b530-448e-8dff-fe200559eff0", 2020-11-12T17:25:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:25:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:25:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:25:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:25:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:25:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:25:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:25:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:25:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:25:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:25:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:25:34.330 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.330 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.331 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6808", 2020-11-12T17:25:34.331 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:25:34.331 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.331 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.332 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:25:34.332 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.333 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.333 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6810", 2020-11-12T17:25:34.333 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:25:34.334 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.334 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.335 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:25:34.335 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.336 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.336 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6814", 2020-11-12T17:25:34.336 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:25:34.336 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.337 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.337 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:25:34.337 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.338 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.338 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6812", 2020-11-12T17:25:34.339 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:25:34.339 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.339 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.340 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6808/12525", 2020-11-12T17:25:34.340 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6810/12525", 2020-11-12T17:25:34.341 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6814/12525", 2020-11-12T17:25:34.341 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6812/12525", 2020-11-12T17:25:34.341 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:25:34.342 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:25:34.342 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:25:34.342 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.343 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:25:34.343 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "62a140ba-7f94-4bb6-8a62-fda077f81354", 2020-11-12T17:25:34.344 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:25:34.344 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:25:34.344 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:25:34.344 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:25:34.345 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:25:34.345 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:25:34.345 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:25:34.346 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:25:34.346 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:25:34.346 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:25:34.346 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:25:34.347 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.347 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.348 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6809", 2020-11-12T17:25:34.348 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:25:34.348 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.348 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.349 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:25:34.349 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.350 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.350 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6811", 2020-11-12T17:25:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:25:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:25:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6815", 2020-11-12T17:25:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:25:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:25:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6813", 2020-11-12T17:25:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:25:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.354 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.354 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6809/12524", 2020-11-12T17:25:34.354 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6811/12524", 2020-11-12T17:25:34.354 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6815/12524", 2020-11-12T17:25:34.354 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6813/12524", 2020-11-12T17:25:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:25:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:25:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:25:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:25:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "32879bd7-780c-4da6-9838-5850b6277902", 2020-11-12T17:25:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:25:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:25:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:25:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:25:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:25:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:25:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:25:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 59, 2020-11-12T17:25:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:25:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:25:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:25:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6800", 2020-11-12T17:25:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:25:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:25:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6801", 2020-11-12T17:25:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:25:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:25:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6803", 2020-11-12T17:25:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:25:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:25:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:25:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:25:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6802", 2020-11-12T17:25:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:25:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6800/12522", 2020-11-12T17:25:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6801/12522", 2020-11-12T17:25:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6803/12522", 2020-11-12T17:25:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6802/12522", 2020-11-12T17:25:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:25:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:25:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:25:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:25:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2020-11-12T17:25:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:25:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:25:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:25:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:25:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:25:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:25:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:24:44.245240+0000", 2020-11-12T17:25:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:25:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:25:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:25:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:25:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:25:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:25:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 65536, 2020-11-12T17:25:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:32.332836+0000", 2020-11-12T17:25:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 58 2020-11-12T17:25:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:25:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:25:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:25:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:25:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:25:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 65536, 2020-11-12T17:25:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:24:45.483747+0000", 2020-11-12T17:25:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:25:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:25:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:25:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:25:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:25:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:25:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:25:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:24:45.398602+0000", 2020-11-12T17:25:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:25:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:25:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:25:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:25:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:25:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:25:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:25:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:24:44.145528+0000", 2020-11-12T17:25:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:25:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:25:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:25:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:25:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:25:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:25:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:25:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:24:45.534493+0000", 2020-11-12T17:25:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:25:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:25:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:25:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:25:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:25:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:25:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:25:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:24:44.299086+0000", 2020-11-12T17:25:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:25:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:25:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:25:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:25:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:25:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:25:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:25:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:24:44.263385+0000", 2020-11-12T17:25:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:25:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:25:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2020-11-12T17:25:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2020-11-12T17:25:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2020-11-12T17:25:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2020-11-12T17:25:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2020-11-12T17:25:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2020-11-12T17:25:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2020-11-12T17:25:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2020-11-12T17:25:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2020-11-12T17:25:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2020-11-12T17:25:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2020-11-12T17:25:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2020-11-12T17:25:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2020-11-12T17:25:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2020-11-12T17:25:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2020-11-12T17:25:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2020-11-12T17:25:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2020-11-12T17:25:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2020-11-12T17:25:34.380 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:34.382 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:34.382 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:34.383 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:34.383 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:34.376+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:34.384 INFO:tasks.thrashosds.thrasher:j is {'epoch': 90, 'fsid': '8c8a6bcc-49d4-47d1-904f-e20798ef8e1f', 'created': '2020-11-12T17:22:37.581394+0000', 'modified': '2020-11-12T17:25:33.658064+0000', 'last_up_change': '2020-11-12T17:25:31.632418+0000', 'last_in_change': '2020-11-12T17:24:29.625503+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'unique_pool_1', 'create_time': '2020-11-12T17:24:49.045109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'bd1d5457-5d54-4074-b378-9da417f42976', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6801', 'nonce': 12304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6802', 'nonce': 12304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6806', 'nonce': 12304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6804', 'nonce': 12304}]}, 'public_addr': '172.21.15.36:6801/12304', 'cluster_addr': '172.21.15.36:6802/12304', 'heartbeat_back_addr': '172.21.15.36:6806/12304', 'heartbeat_front_addr': '172.21.15.36:6804/12304', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '37152eee-a8d8-40f1-8e27-2899e7b94c98', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 57, 'up_from': 88, 'up_thru': 35, 'down_at': 58, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6812', 'nonce': 20274}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6814', 'nonce': 20274}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6816', 'nonce': 20274}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6815', 'nonce': 20274}]}, 'public_addr': '172.21.15.36:6812/20274', 'cluster_addr': '172.21.15.36:6814/20274', 'heartbeat_back_addr': '172.21.15.36:6816/20274', 'heartbeat_front_addr': '172.21.15.36:6815/20274', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd8ec2abb-38bf-4863-969a-482c4fa44f41', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6803', 'nonce': 12306}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6805', 'nonce': 12306}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6808', 'nonce': 12306}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6807', 'nonce': 12306}]}, 'public_addr': '172.21.15.36:6803/12306', 'cluster_addr': '172.21.15.36:6805/12306', 'heartbeat_back_addr': '172.21.15.36:6808/12306', 'heartbeat_front_addr': '172.21.15.36:6807/12306', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '799d3499-577c-4510-a00c-9b2e126fc449', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6809', 'nonce': 12305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6810', 'nonce': 12305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6813', 'nonce': 12305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6811', 'nonce': 12305}]}, 'public_addr': '172.21.15.36:6809/12305', 'cluster_addr': '172.21.15.36:6810/12305', 'heartbeat_back_addr': '172.21.15.36:6813/12305', 'heartbeat_front_addr': '172.21.15.36:6811/12305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c36e3100-aadc-4117-b495-24fb08a34148', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6804', 'nonce': 12499}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6805', 'nonce': 12499}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6807', 'nonce': 12499}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6806', 'nonce': 12499}]}, 'public_addr': '172.21.15.205:6804/12499', 'cluster_addr': '172.21.15.205:6805/12499', 'heartbeat_back_addr': '172.21.15.205:6807/12499', 'heartbeat_front_addr': '172.21.15.205:6806/12499', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b152141f-b530-448e-8dff-fe200559eff0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6808', 'nonce': 12525}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6810', 'nonce': 12525}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6814', 'nonce': 12525}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6812', 'nonce': 12525}]}, 'public_addr': '172.21.15.205:6808/12525', 'cluster_addr': '172.21.15.205:6810/12525', 'heartbeat_back_addr': '172.21.15.205:6814/12525', 'heartbeat_front_addr': '172.21.15.205:6812/12525', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '62a140ba-7f94-4bb6-8a62-fda077f81354', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6809', 'nonce': 12524}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6811', 'nonce': 12524}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6815', 'nonce': 12524}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6813', 'nonce': 12524}]}, 'public_addr': '172.21.15.205:6809/12524', 'cluster_addr': '172.21.15.205:6811/12524', 'heartbeat_back_addr': '172.21.15.205:6815/12524', 'heartbeat_front_addr': '172.21.15.205:6813/12524', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '32879bd7-780c-4da6-9838-5850b6277902', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 59, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6800', 'nonce': 12522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6801', 'nonce': 12522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6803', 'nonce': 12522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6802', 'nonce': 12522}]}, 'public_addr': '172.21.15.205:6800/12522', 'cluster_addr': '172.21.15.205:6801/12522', 'heartbeat_back_addr': '172.21.15.205:6803/12522', 'heartbeat_front_addr': '172.21.15.205:6802/12522', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:24:44.245240+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-12T17:25:32.332836+0000', 'dead_epoch': 58}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-12T17:24:45.483747+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:24:45.398602+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:24:44.145528+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:24:45.534493+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:24:44.299086+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:24:44.263385+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-11-12T17:25:34.385 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:25:34.482 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:34.476+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:34.530 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:34.531 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:34.542 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:34.613 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:34.610+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:34.685 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:34.680+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:34.687 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:34.687 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:34.699 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:34.731 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:25:34.737 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:25:34.751 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2020-11-12T17:25:33.666572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":323862528,"num_objects":4944,"num_object_clones":0,"num_object_copies":9888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4944,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39536,"num_write_kb":316274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39536,"ondisk_log_size":39536,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":6609988,"kb_used_data":318484,"kb_used_omap":0,"kb_used_meta":6291456,"kb_avail":559621052,"statfs":{"total":579820584960,"available":573051957248,"internally_reserved":6442450944,"allocated":326127616,"data_stored":643924966,"data_compressed":4286590,"data_compressed_allocated":320888832,"data_compressed_original":641777664,"omap_allocated":0,"internal_metadata":6442450944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35618816,"num_objects":543,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":543,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4348,"num_write_kb":34784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.094645"},"pg_stats":[{"pgid":"4.f","version":"87'2528","reported_seq":"2553","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-12T17:25:31.389106+0000","last_change":"2020-11-12T17:24:50.857680+0000","last_active":"2020-11-12T17:25:31.389106+0000","last_peered":"2020-11-12T17:25:31.389106+0000","last_clean":"2020-11-12T17:25:31.389106+0000","last_became_active":"2020-11-12T17:24:50.856245+0000","last_became_peered":"2020-11-12T17:24:50.856245+0000","last_unstale":"2020-11-12T17:25:31.389106+0000","last_undegraded":"2020-11-12T17:25:31.389106+0000","last_fullsized":"2020-11-12T17:25:31.389106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2528,"ondisk_log_size":2528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2528,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"86'2488","reported_seq":"2512","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:30.247623+0000","last_change":"2020-11-12T17:24:50.864218+0000","last_active":"2020-11-12T17:25:30.247623+0000","last_peered":"2020-11-12T17:25:30.247623+0000","last_clean":"2020-11-12T17:25:30.247623+0000","last_became_active":"2020-11-12T17:24:50.863828+0000","last_became_peered":"2020-11-12T17:24:50.863828+0000","last_unstale":"2020-11-12T17:25:30.247623+0000","last_undegraded":"2020-11-12T17:25:30.247623+0000","last_fullsized":"2020-11-12T17:25:30.247623+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2488,"ondisk_log_size":2488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2488,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"86'2648","reported_seq":"2672","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:30.337892+0000","last_change":"2020-11-12T17:24:50.863794+0000","last_active":"2020-11-12T17:25:30.337892+0000","last_peered":"2020-11-12T17:25:30.337892+0000","last_clean":"2020-11-12T17:25:30.337892+0000","last_became_active":"2020-11-12T17:24:50.863357+0000","last_became_peered":"2020-11-12T17:24:50.863357+0000","last_unstale":"2020-11-12T17:25:30.337892+0000","last_undegraded":"2020-11-12T17:25:30.337892+0000","last_fullsized":"2020-11-12T17:25:30.337892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2648,"ondisk_log_size":2648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2648,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.c","version":"86'2336","reported_seq":"2360","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:30.600157+0000","last_change":"2020-11-12T17:24:50.858690+0000","last_active":"2020-11-12T17:25:30.600157+0000","last_peered":"2020-11-12T17:25:30.600157+0000","last_clean":"2020-11-12T17:25:30.600157+0000","last_became_active":"2020-11-12T17:24:50.858126+0000","last_became_peered":"2020-11-12T17:24:50.858126+0000","last_unstale":"2020-11-12T17:25:30.600157+0000","last_undegraded":"2020-11-12T17:25:30.600157+0000","last_fullsized":"2020-11-12T17:25:30.600157+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2336,"ondisk_log_size":2336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":292,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2336,"num_write_kb":18688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"87'2384","reported_seq":"2408","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-12T17:25:31.609998+0000","last_change":"2020-11-12T17:24:50.864382+0000","last_active":"2020-11-12T17:25:31.609998+0000","last_peered":"2020-11-12T17:25:31.609998+0000","last_clean":"2020-11-12T17:25:31.609998+0000","last_became_active":"2020-11-12T17:24:50.864001+0000","last_became_peered":"2020-11-12T17:24:50.864001+0000","last_unstale":"2020-11-12T17:25:31.609998+0000","last_undegraded":"2020-11-12T17:25:31.609998+0000","last_fullsized":"2020-11-12T17:25:31.609998+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2384,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":298,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2384,"num_write_kb":19072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"86'2440","reported_seq":"2464","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:30.546945+0000","last_change":"2020-11-12T17:24:51.721640+0000","last_active":"2020-11-12T17:25:30.546945+0000","last_peered":"2020-11-12T17:25:30.546945+0000","last_clean":"2020-11-12T17:25:30.546945+0000","last_became_active":"2020-11-12T17:24:51.720614+0000","last_became_peered":"2020-11-12T17:24:51.720614+0000","last_unstale":"2020-11-12T17:25:30.546945+0000","last_undegraded":"2020-11-12T17:25:30.546945+0000","last_fullsized":"2020-11-12T17:25:30.546945+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2440,"ondisk_log_size":2440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19988480,"num_objects":305,"num_object_clones":0,"num_object_copies":610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":305,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2440,"num_write_kb":19520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"86'2424","reported_seq":"2445","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:30.618031+0000","last_change":"2020-11-12T17:24:50.871207+0000","last_active":"2020-11-12T17:25:30.618031+0000","last_peered":"2020-11-12T17:25:30.618031+0000","last_clean":"2020-11-12T17:25:30.618031+0000","last_became_active":"2020-11-12T17:24:50.870852+0000","last_became_peered":"2020-11-12T17:24:50.870852+0000","last_unstale":"2020-11-12T17:25:30.618031+0000","last_undegraded":"2020-11-12T17:25:30.618031+0000","last_fullsized":"2020-11-12T17:25:30.618031+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2424,"ondisk_log_size":2424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2424,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"87'2584","reported_seq":"2609","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-12T17:25:31.525220+0000","last_change":"2020-11-12T17:24:51.722005+0000","last_active":"2020-11-12T17:25:31.525220+0000","last_peered":"2020-11-12T17:25:31.525220+0000","last_clean":"2020-11-12T17:25:31.525220+0000","last_became_active":"2020-11-12T17:24:51.721107+0000","last_became_peered":"2020-11-12T17:24:51.721107+0000","last_unstale":"2020-11-12T17:25:31.525220+0000","last_undegraded":"2020-11-12T17:25:31.525220+0000","last_fullsized":"2020-11-12T17:25:31.525220+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2584,"ondisk_log_size":2584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2584,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"87'2408","reported_seq":"2433","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-12T17:25:31.561399+0000","last_change":"2020-11-12T17:24:50.866031+0000","last_active":"2020-11-12T17:25:31.561399+0000","last_peered":"2020-11-12T17:25:31.561399+0000","last_clean":"2020-11-12T17:25:31.561399+0000","last_became_active":"2020-11-12T17:24:50.865574+0000","last_became_peered":"2020-11-12T17:24:50.865574+0000","last_unstale":"2020-11-12T17:25:31.561399+0000","last_undegraded":"2020-11-12T17:25:31.561399+0000","last_fullsized":"2020-11-12T17:25:31.561399+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2408,"ondisk_log_size":2408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19726336,"num_objects":301,"num_object_clones":0,"num_object_copies":602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2408,"num_write_kb":19264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"40","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:27.374011+0000","last_change":"2020-11-12T17:24:30.646835+0000","last_active":"2020-11-12T17:25:27.374011+0000","last_peered":"2020-11-12T17:25:27.374011+0000","last_clean":"2020-11-12T17:25:27.374011+0000","last_became_active":"2020-11-12T17:24:30.646312+0000","last_became_peered":"2020-11-12T17:24:30.646312+0000","last_unstale":"2020-11-12T17:25:27.374011+0000","last_undegraded":"2020-11-12T17:25:27.374011+0000","last_fullsized":"2020-11-12T17:25:27.374011+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:18.299871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:18.299871+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"87'2312","reported_seq":"2337","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-12T17:25:31.485884+0000","last_change":"2020-11-12T17:24:50.862887+0000","last_active":"2020-11-12T17:25:31.485884+0000","last_peered":"2020-11-12T17:25:31.485884+0000","last_clean":"2020-11-12T17:25:31.485884+0000","last_became_active":"2020-11-12T17:24:50.862235+0000","last_became_peered":"2020-11-12T17:24:50.862235+0000","last_unstale":"2020-11-12T17:25:31.485884+0000","last_undegraded":"2020-11-12T17:25:31.485884+0000","last_fullsized":"2020-11-12T17:25:31.485884+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2312,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18939904,"num_objects":289,"num_object_clones":0,"num_object_copies":578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":289,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2312,"num_write_kb":18496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"92","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:27.372139+0000","last_change":"2020-11-12T17:25:23.254945+0000","last_active":"2020-11-12T17:25:27.372139+0000","last_peered":"2020-11-12T17:25:27.372139+0000","last_clean":"2020-11-12T17:25:27.372139+0000","last_became_active":"2020-11-12T17:24:30.653733+0000","last_became_peered":"2020-11-12T17:24:30.653733+0000","last_unstale":"2020-11-12T17:25:27.372139+0000","last_undegraded":"2020-11-12T17:25:27.372139+0000","last_fullsized":"2020-11-12T17:25:27.372139+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:23.254853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:23.254853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"87'2432","reported_seq":"2457","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-12T17:25:31.228994+0000","last_change":"2020-11-12T17:24:50.864289+0000","last_active":"2020-11-12T17:25:31.228994+0000","last_peered":"2020-11-12T17:25:31.228994+0000","last_clean":"2020-11-12T17:25:31.228994+0000","last_became_active":"2020-11-12T17:24:50.863771+0000","last_became_peered":"2020-11-12T17:24:50.863771+0000","last_unstale":"2020-11-12T17:25:31.228994+0000","last_undegraded":"2020-11-12T17:25:31.228994+0000","last_fullsized":"2020-11-12T17:25:31.228994+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2432,"ondisk_log_size":2432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2432,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"65","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:27.368848+0000","last_change":"2020-11-12T17:24:45.040539+0000","last_active":"2020-11-12T17:25:27.368848+0000","last_peered":"2020-11-12T17:25:27.368848+0000","last_clean":"2020-11-12T17:25:27.368848+0000","last_became_active":"2020-11-12T17:23:27.983997+0000","last_became_peered":"2020-11-12T17:23:27.983997+0000","last_unstale":"2020-11-12T17:25:27.368848+0000","last_undegraded":"2020-11-12T17:25:27.368848+0000","last_fullsized":"2020-11-12T17:25:27.368848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:45.040397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:45.040397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"86'2622","reported_seq":"2642","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:30.640153+0000","last_change":"2020-11-12T17:24:50.867446+0000","last_active":"2020-11-12T17:25:30.640153+0000","last_peered":"2020-11-12T17:25:30.640153+0000","last_clean":"2020-11-12T17:25:30.640153+0000","last_became_active":"2020-11-12T17:24:50.867064+0000","last_became_peered":"2020-11-12T17:24:50.867064+0000","last_unstale":"2020-11-12T17:25:30.640153+0000","last_undegraded":"2020-11-12T17:25:30.640153+0000","last_fullsized":"2020-11-12T17:25:30.640153+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2622,"ondisk_log_size":2622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21479424,"num_objects":328,"num_object_clones":0,"num_object_copies":656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2622,"num_write_kb":20976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"88","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:27.372147+0000","last_change":"2020-11-12T17:24:15.328590+0000","last_active":"2020-11-12T17:25:27.372147+0000","last_peered":"2020-11-12T17:25:27.372147+0000","last_clean":"2020-11-12T17:25:27.372147+0000","last_became_active":"2020-11-12T17:23:27.787364+0000","last_became_peered":"2020-11-12T17:23:27.787364+0000","last_unstale":"2020-11-12T17:25:27.372147+0000","last_undegraded":"2020-11-12T17:25:27.372147+0000","last_fullsized":"2020-11-12T17:25:27.372147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:15.328459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:15.328459+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"88","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:27.369586+0000","last_change":"2020-11-12T17:25:22.846800+0000","last_active":"2020-11-12T17:25:27.369586+0000","last_peered":"2020-11-12T17:25:27.369586+0000","last_clean":"2020-11-12T17:25:27.369586+0000","last_became_active":"2020-11-12T17:22:47.069110+0000","last_became_peered":"2020-11-12T17:22:47.069110+0000","last_unstale":"2020-11-12T17:25:27.369586+0000","last_undegraded":"2020-11-12T17:25:27.369586+0000","last_fullsized":"2020-11-12T17:25:27.369586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:25:22.846686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:25:22.846686+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"87'2328","reported_seq":"2353","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-12T17:25:31.394025+0000","last_change":"2020-11-12T17:24:51.720773+0000","last_active":"2020-11-12T17:25:31.394025+0000","last_peered":"2020-11-12T17:25:31.394025+0000","last_clean":"2020-11-12T17:25:31.394025+0000","last_became_active":"2020-11-12T17:24:51.719716+0000","last_became_peered":"2020-11-12T17:24:51.719716+0000","last_unstale":"2020-11-12T17:25:31.394025+0000","last_undegraded":"2020-11-12T17:25:31.394025+0000","last_fullsized":"2020-11-12T17:25:31.394025+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2328,"ondisk_log_size":2328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19070976,"num_objects":291,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2328,"num_write_kb":18624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"89","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:27.369681+0000","last_change":"2020-11-12T17:24:30.649974+0000","last_active":"2020-11-12T17:25:27.369681+0000","last_peered":"2020-11-12T17:25:27.369681+0000","last_clean":"2020-11-12T17:25:27.369681+0000","last_became_active":"2020-11-12T17:24:30.649571+0000","last_became_peered":"2020-11-12T17:24:30.649571+0000","last_unstale":"2020-11-12T17:25:27.369681+0000","last_undegraded":"2020-11-12T17:25:27.369681+0000","last_fullsized":"2020-11-12T17:25:27.369681+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:11.795281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:11.795281+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"87'2504","reported_seq":"2529","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-12T17:25:31.440875+0000","last_change":"2020-11-12T17:24:50.864632+0000","last_active":"2020-11-12T17:25:31.440875+0000","last_peered":"2020-11-12T17:25:31.440875+0000","last_clean":"2020-11-12T17:25:31.440875+0000","last_became_active":"2020-11-12T17:24:50.863500+0000","last_became_peered":"2020-11-12T17:24:50.863500+0000","last_unstale":"2020-11-12T17:25:31.440875+0000","last_undegraded":"2020-11-12T17:25:31.440875+0000","last_fullsized":"2020-11-12T17:25:31.440875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2504,"ondisk_log_size":2504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2504,"num_write_kb":20032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"80","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:27.369623+0000","last_change":"2020-11-12T17:24:14.829837+0000","last_active":"2020-11-12T17:25:27.369623+0000","last_peered":"2020-11-12T17:25:27.369623+0000","last_clean":"2020-11-12T17:25:27.369623+0000","last_became_active":"2020-11-12T17:22:51.723115+0000","last_became_peered":"2020-11-12T17:22:51.723115+0000","last_unstale":"2020-11-12T17:25:27.369623+0000","last_undegraded":"2020-11-12T17:25:27.369623+0000","last_fullsized":"2020-11-12T17:25:27.369623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:24:14.829737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"87'2504","reported_seq":"2529","reported_epoch":"87","state":"active+clean","last_fresh":"2020-11-12T17:25:31.604587+0000","last_change":"2020-11-12T17:24:51.720640+0000","last_active":"2020-11-12T17:25:31.604587+0000","last_peered":"2020-11-12T17:25:31.604587+0000","last_clean":"2020-11-12T17:25:31.604587+0000","last_became_active":"2020-11-12T17:24:51.719333+0000","last_became_peered":"2020-11-12T17:24:51.719333+0000","last_unstale":"2020-11-12T17:25:31.604587+0000","last_undegraded":"2020-11-12T17:25:31.604587+0000","last_fullsized":"2020-11-12T17:25:31.604587+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2504,"ondisk_log_size":2504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2504,"num_write_kb":20032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"66","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:27.396001+0000","last_change":"2020-11-12T17:24:30.652630+0000","last_active":"2020-11-12T17:25:27.396001+0000","last_peered":"2020-11-12T17:25:27.396001+0000","last_clean":"2020-11-12T17:25:27.396001+0000","last_became_active":"2020-11-12T17:24:30.652206+0000","last_became_peered":"2020-11-12T17:24:30.652206+0000","last_unstale":"2020-11-12T17:25:27.396001+0000","last_undegraded":"2020-11-12T17:25:27.396001+0000","last_fullsized":"2020-11-12T17:25:27.396001+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:16.370222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:16.370222+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"86'2592","reported_seq":"2616","reported_epoch":"86","state":"active+clean","last_fresh":"2020-11-12T17:25:30.583931+0000","last_change":"2020-11-12T17:24:50.865566+0000","last_active":"2020-11-12T17:25:30.583931+0000","last_peered":"2020-11-12T17:25:30.583931+0000","last_clean":"2020-11-12T17:25:30.583931+0000","last_became_active":"2020-11-12T17:24:50.865159+0000","last_became_peered":"2020-11-12T17:24:50.865159+0000","last_unstale":"2020-11-12T17:25:30.583931+0000","last_undegraded":"2020-11-12T17:25:30.583931+0000","last_fullsized":"2020-11-12T17:25:30.583931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":2592,"ondisk_log_size":2592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":324,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2592,"num_write_kb":20736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"70","reported_epoch":"85","state":"active+clean","last_fresh":"2020-11-12T17:25:24.449092+0000","last_change":"2020-11-12T17:24:18.165744+0000","last_active":"2020-11-12T17:25:24.449092+0000","last_peered":"2020-11-12T17:25:24.449092+0000","last_clean":"2020-11-12T17:25:24.449092+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:25:24.449092+0000","last_undegraded":"2020-11-12T17:25:24.449092+0000","last_fullsized":"2020-11-12T17:25:24.449092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:24:18.165582+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":323862528,"num_objects":4942,"num_object_clones":0,"num_object_copies":9884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4942,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39534,"num_write_kb":316272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323796992,"data_stored":647593984,"data_compressed":4325640,"data_compressed_allocated":323796992,"data_compressed_original":647593984,"omap_allocated":0,"internal_metadata":0},"log_size":39534,"ondisk_log_size":39534,"up":32,"acting":32,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1088348,"kb_used_data":39764,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283492,"statfs":{"total":96636764160,"available":95522295808,"internally_reserved":1073741824,"allocated":40718336,"data_stored":80052227,"data_compressed":532180,"data_compressed_allocated":39845888,"data_compressed_original":79691776,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:24:54 2020","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.552,"15min":1.5629999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.998,"15min":2.0960000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.8919999999999999,"5min":7.4349999999999996,"15min":7.4349999999999996},"last":1.403}]},{"osd":1,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.27,"5min":2.27,"15min":2.27},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":7.585,"5min":7.585,"15min":7.585},"last":1.452},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":0.94599999999999995}]},{"osd":2,"last update":"Thu Nov 12 17:24:54 2020","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.6120000000000001,"15min":1.6339999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":796.97000000000003},{"interface":"front","average":{"1min":1.645,"5min":2.0830000000000002,"15min":2.1560000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.9769999999999999,"5min":7.6310000000000002,"15min":7.6310000000000002},"last":1.119}]},{"osd":3,"last update":"Thu Nov 12 17:24:54 2020","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":2.0510000000000002,"15min":2.1579999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.3119999999999998,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":33.890000000000001,"5min":8.7850000000000001,"15min":4.601},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":871.76700000000005,"5min":871.76700000000005,"15min":871.76700000000005},"last":1.2430000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:24:54 2020","interfaces":[{"interface":"back","average":{"1min":6.798,"5min":44.366,"15min":50.627000000000002},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":148.19800000000001,"5min":503.50200000000001,"15min":503.50200000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.883,"5min":1.98,"15min":1.996},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":4.415,"5min":4.415,"15min":4.415},"last":1.4299999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:24:54 2020","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":2.577,"15min":2.6869999999999998},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":3.137,"5min":7.7169999999999996,"15min":7.7169999999999996},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.9850000000000001,"5min":2.6909999999999998,"15min":2.8090000000000002},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":3.2149999999999999,"5min":7.7480000000000002,"15min":7.7480000000000002},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:24:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":2.5880000000000001,"15min":2.7360000000000002},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.5579999999999998,"5min":7.6630000000000003,"15min":7.6630000000000003},"last":1.4870000000000001},{"interface":"front","average":{"1min":33.698999999999998,"5min":49.491999999999997,"15min":52.124000000000002},"min":{"1min":0.86799999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":864.70899999999995,"5min":975.20899999999995,"15min":975.20899999999995},"last":0.76400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1099324,"kb_used_data":50740,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93272516,"statfs":{"total":96636764160,"available":95511056384,"internally_reserved":1073741824,"allocated":51957760,"data_stored":102528772,"data_compressed":682526,"data_compressed_allocated":51085312,"data_compressed_original":102170624,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:24:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.728,"15min":1.792},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.738,"5min":3.339,"15min":3.339},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.9990000000000001,"15min":2.0870000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.6629999999999998,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":1.867}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.042}]},{"osd":2,"last update":"Thu Nov 12 17:24:48 2020","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":2.0800000000000001,"15min":2.1789999999999998},"min":{"1min":0.79400000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6099999999999999,"5min":5.4329999999999998,"15min":5.4329999999999998},"last":1.8169999999999999},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.1819999999999999,"15min":2.27},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3130000000000002,"5min":8.0969999999999995,"15min":8.0969999999999995},"last":416.31900000000002}]},{"osd":3,"last update":"Thu Nov 12 17:24:48 2020","interfaces":[{"interface":"back","average":{"1min":4.3680000000000003,"5min":3.0670000000000002,"15min":2.8500000000000001},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":49.442999999999998,"5min":49.442999999999998,"15min":49.442999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.8240000000000001,"5min":2.3530000000000002,"15min":2.4409999999999998},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.3570000000000002,"5min":8.202,"15min":8.202},"last":2.0209999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:24:48 2020","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":2.121,"15min":2.1909999999999998},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":3.3980000000000001,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.74,"5min":2.7879999999999998,"15min":2.9630000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.9140000000000001,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":1.7470000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:24:48 2020","interfaces":[{"interface":"back","average":{"1min":1.784,"5min":2.23,"15min":2.3039999999999998},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.0350000000000001,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":1.7909999999999999,"5min":2.2570000000000001,"15min":2.335},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.5939999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Nov 12 17:24:48 2020","interfaces":[{"interface":"back","average":{"1min":3.9279999999999999,"5min":3.2679999999999998,"15min":3.1579999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":40.268000000000001,"5min":40.268000000000001,"15min":40.268000000000001},"last":1.786},{"interface":"front","average":{"1min":1.859,"5min":2.6949999999999998,"15min":2.835},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.2130000000000001,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":1.3520000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137488,"kb_used_data":88904,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93234352,"statfs":{"total":96636764160,"available":95471976448,"internally_reserved":1073741824,"allocated":91037696,"data_stored":180756478,"data_compressed":1204992,"data_compressed_allocated":90202112,"data_compressed_original":180404224,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:24:49 2020","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.5489999999999999,"15min":1.5720000000000001},"min":{"1min":0.63200000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.835,"5min":37.991999999999997,"15min":44.018000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":8.6920000000000002,"5min":948.30899999999997,"15min":948.30899999999997},"last":0.748}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":9.7530000000000001,"5min":9.7530000000000001,"15min":9.7530000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":162.126,"5min":162.126,"15min":162.126},"last":1.5289999999999999},{"interface":"front","average":{"1min":9.4280000000000008,"5min":9.4280000000000008,"15min":9.4280000000000008},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":163.59899999999999,"5min":163.59899999999999,"15min":163.59899999999999},"last":2.3929999999999998}]},{"osd":2,"last update":"Thu Nov 12 17:24:49 2020","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.7230000000000001,"15min":1.7549999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.038},{"interface":"front","average":{"1min":1.7370000000000001,"5min":1.8400000000000001,"15min":1.857},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.82499999999999996}]},{"osd":3,"last update":"Thu Nov 12 17:24:49 2020","interfaces":[{"interface":"back","average":{"1min":1.9410000000000001,"5min":2.0190000000000001,"15min":2.032},"min":{"1min":1.089,"5min":1.034,"15min":1.034},"max":{"1min":4.0179999999999998,"5min":4.0179999999999998,"15min":4.0179999999999998},"last":1.149},{"interface":"front","average":{"1min":1.925,"5min":2.117,"15min":2.149},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":5.2130000000000001,"5min":5.2130000000000001,"15min":5.2130000000000001},"last":1.127}]},{"osd":5,"last update":"Thu Nov 12 17:24:49 2020","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.968,"15min":2.024},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.623},{"interface":"front","average":{"1min":1.9590000000000001,"5min":2.2000000000000002,"15min":2.2400000000000002},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":4.7510000000000003,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Nov 12 17:24:49 2020","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":27.282,"15min":31.524999999999999},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":3.7050000000000001,"5min":665.13999999999999,"15min":665.13999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.8200000000000001,"5min":2.157,"15min":2.2130000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Nov 12 17:24:49 2020","interfaces":[{"interface":"back","average":{"1min":31.189,"5min":8.1519999999999992,"15min":4.3120000000000003},"min":{"1min":1.1459999999999999,"5min":1.097,"15min":1.097},"max":{"1min":584.00300000000004,"5min":584.00300000000004,"15min":584.00300000000004},"last":0.91100000000000003},{"interface":"front","average":{"1min":2.2730000000000001,"5min":2.2050000000000001,"15min":2.194},"min":{"1min":1,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":8.2739999999999991,"5min":8.2739999999999991,"15min":8.2739999999999991},"last":1.1040000000000001}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1099132,"kb_used_data":50548,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93272708,"statfs":{"total":96636764160,"available":95511252992,"internally_reserved":1073741824,"allocated":51761152,"data_stored":102131853,"data_compressed":679560,"data_compressed_allocated":50888704,"data_compressed_original":101777408,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:24:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.706,"15min":1.7470000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.4649999999999999,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.9370000000000001,"15min":2.0190000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.234,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.02}]},{"osd":1,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":2.254,"5min":2.254,"15min":2.254},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.343}]},{"osd":2,"last update":"Thu Nov 12 17:24:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.954,"15min":2.0329999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.4390000000000001,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":4.7469999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.9470000000000001,"15min":2.0219999999999998},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.2989999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Nov 12 17:24:46 2020","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":2.0129999999999999,"15min":2.077},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.363,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.74,"5min":2.3159999999999998,"15min":2.4119999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.492,"5min":9.2550000000000008,"15min":9.2550000000000008},"last":0.873}]},{"osd":4,"last update":"Thu Nov 12 17:24:46 2020","interfaces":[{"interface":"back","average":{"1min":1.738,"5min":2.1320000000000001,"15min":2.198},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":6.3049999999999997,"5min":6.3049999999999997,"15min":6.3049999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.552,"5min":2.448,"15min":2.597},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.1739999999999999,"5min":8.7189999999999994,"15min":8.7189999999999994},"last":1.627}]},{"osd":5,"last update":"Thu Nov 12 17:24:46 2020","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":2.1819999999999999,"15min":2.2469999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":3.0230000000000001,"5min":9.7710000000000008,"15min":9.7710000000000008},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.7250000000000001,"5min":18.538,"15min":21.34},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.9380000000000002,"5min":445.34699999999998,"15min":445.34699999999998},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Nov 12 17:24:46 2020","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":2.597,"15min":2.7189999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":7.0469999999999997,"5min":8.8339999999999996,"15min":8.8339999999999996},"last":1.6699999999999999},{"interface":"front","average":{"1min":2.5800000000000001,"5min":2.5350000000000001,"15min":2.5270000000000001},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":10.271000000000001,"5min":10.271000000000001,"15min":10.271000000000001},"last":1.573}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1087888,"kb_used_data":39304,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93283952,"statfs":{"total":96636764160,"available":95522766848,"internally_reserved":1073741824,"allocated":40247296,"data_stored":79070709,"data_compressed":525776,"data_compressed_allocated":39354368,"data_compressed_original":78708736,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":5.1399999999999997,"5min":5.1399999999999997,"15min":5.1399999999999997},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":66.608000000000004,"5min":66.608000000000004,"15min":66.608000000000004},"last":1.3480000000000001},{"interface":"front","average":{"1min":5.3899999999999997,"5min":5.3899999999999997,"15min":5.3899999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":67.099999999999994,"5min":67.099999999999994,"15min":67.099999999999994},"last":1.4430000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:24:47 2020","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":43.450000000000003,"15min":50.500999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.452,"5min":995.93899999999996,"15min":995.93899999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.387,"5min":1.6579999999999999,"15min":1.7030000000000001},"min":{"1min":0.68300000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.198,"5min":3.198,"15min":3.198},"last":0.77600000000000002}]},{"osd":3,"last update":"Thu Nov 12 17:24:47 2020","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":12.880000000000001,"15min":14.743},"min":{"1min":0.68700000000000006,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9729999999999999,"5min":269.27100000000002,"15min":269.27100000000002},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.724,"5min":1.9930000000000001,"15min":2.0379999999999998},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":4.9649999999999999,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Thu Nov 12 17:24:47 2020","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":2.1309999999999998,"15min":2.1699999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.7869999999999999,"5min":1.9119999999999999,"15min":1.9330000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:24:47 2020","interfaces":[{"interface":"back","average":{"1min":2.056,"5min":2.1280000000000001,"15min":2.1400000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":4.298,"5min":4.298,"15min":4.298},"last":2.347},{"interface":"front","average":{"1min":1.5609999999999999,"5min":40.844000000000001,"15min":47.390999999999998},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.5430000000000001,"5min":920.76900000000001,"15min":920.76900000000001},"last":1.5149999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:24:47 2020","interfaces":[{"interface":"back","average":{"1min":1.792,"5min":2.2559999999999998,"15min":2.3330000000000002},"min":{"1min":1.1259999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":3.5329999999999999,"5min":3.5329999999999999,"15min":3.5329999999999999},"last":1.464},{"interface":"front","average":{"1min":69.096000000000004,"5min":15.823,"15min":6.944},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":931.65200000000004,"5min":931.65200000000004,"15min":931.65200000000004},"last":1.145}]},{"osd":7,"last update":"Thu Nov 12 17:24:47 2020","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":23.704000000000001,"15min":27.323},"min":{"1min":1.091,"5min":1.091,"15min":1.091},"max":{"1min":3.3340000000000001,"5min":502.12900000000002,"15min":502.12900000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":2.222,"5min":39.726999999999997,"15min":45.978000000000002},"min":{"1min":1.0489999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.8460000000000001,"5min":502.42099999999999,"15min":502.42099999999999},"last":1.2709999999999999}]}]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1097808,"kb_used_data":49224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93274032,"statfs":{"total":96636764160,"available":95512608768,"internally_reserved":1073741824,"allocated":50405376,"data_stored":99384927,"data_compressed":661556,"data_compressed_allocated":49512448,"data_compressed_original":99024896,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:24:50 2020","interfaces":[{"interface":"back","average":{"1min":12.154,"5min":3.8690000000000002,"15min":2.488},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":178.36699999999999,"5min":178.36699999999999,"15min":178.36699999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":2.3719999999999999,"5min":2.04,"15min":1.984},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":16.902000000000001,"5min":16.902000000000001,"15min":16.902000000000001},"last":2.6509999999999998}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":22.77,"5min":22.77,"15min":22.77},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":440.65899999999999,"5min":440.65899999999999,"15min":440.65899999999999},"last":2.085},{"interface":"front","average":{"1min":1.839,"5min":1.839,"15min":1.839},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":2.1349999999999998}]},{"osd":2,"last update":"Thu Nov 12 17:24:50 2020","interfaces":[{"interface":"back","average":{"1min":6.5069999999999997,"5min":3.1789999999999998,"15min":2.6240000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":86.161000000000001,"5min":86.161000000000001,"15min":86.161000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.8819999999999999,"15min":1.956},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4300000000000002,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":1.429}]},{"osd":4,"last update":"Thu Nov 12 17:24:50 2020","interfaces":[{"interface":"back","average":{"1min":2.012,"5min":2.4350000000000001,"15min":2.5049999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":4.407,"5min":10.318,"15min":10.318},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.766,"5min":2.3500000000000001,"15min":2.448},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":3.2309999999999999,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":1.4419999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:24:50 2020","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":26.207999999999998,"15min":30.209},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":3.6059999999999999,"5min":622.07799999999997,"15min":622.07799999999997},"last":2.8530000000000002},{"interface":"front","average":{"1min":2.145,"5min":2.7149999999999999,"15min":2.8100000000000001},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":4.4649999999999999,"5min":10.436,"15min":10.436},"last":2.423}]},{"osd":6,"last update":"Thu Nov 12 17:24:50 2020","interfaces":[{"interface":"back","average":{"1min":1.958,"5min":2.4910000000000001,"15min":2.5800000000000001},"min":{"1min":1.079,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.379,"5min":5.0419999999999998,"15min":5.0419999999999998},"last":1.603},{"interface":"front","average":{"1min":1.887,"5min":2.5760000000000001,"15min":2.6909999999999998},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.9660000000000002,"5min":11.497999999999999,"15min":11.497999999999999},"last":2.7450000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:24:50 2020","interfaces":[{"interface":"back","average":{"1min":2.0819999999999999,"5min":2.7599999999999998,"15min":2.8730000000000002},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.5110000000000001,"5min":10.513999999999999,"15min":10.513999999999999},"last":2.073},{"interface":"front","average":{"1min":2.056,"5min":24.562999999999999,"15min":28.314},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":3.024,"5min":577.35900000000004,"15min":577.35900000000004},"last":1.8879999999999999}]}]}]}} 2020-11-12T17:25:34.756 INFO:tasks.thrashosds.thrasher:Setting 4.8 to [4, 6, 2, 0] 2020-11-12T17:25:34.756 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.8', '4', '6', '2', '0'] 2020-11-12T17:25:34.757 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap-items 4.8 4 6 2 0 2020-11-12T17:25:34.825 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:34.810+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:34.889 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:34.889 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:34.890 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:34.886+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:34.901 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:34.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 43 16 42725 42709 7.75887 6.48438 0.0139449 0.0160969 2020-11-12T17:25:34.992 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:34.988+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:35.078 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:35.079 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:35.090 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:25:35.097 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:35.094+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:35.154 INFO:teuthology.orchestra.run.smithi036.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-11-12T17:25:35.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:25:35.158 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2020-11-12T17:25:35.198 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:35.192+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:35.220 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:35.221 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:35.230 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:25:35.336 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:35.332+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:35.400 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:35.394+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:35.401 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:35.402 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:35.411 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:25:35.508 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:35.504+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:35.574 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:35.575 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:35.586 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:35.628 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:35.624+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:35.689 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:25:35.703 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:35.698+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:35.752 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:35.753 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:35.763 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:35.791 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:35.803 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:35.798+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:35.902 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:35.896+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:35.916 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:35.917 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:35.931 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:35.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 44 16 43605 43589 7.73877 6.875 0.0141828 0.0161398 2020-11-12T17:25:36.005 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:36.000+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:36.007 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:36.038 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:36.064 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:36.067 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:36.068 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:36.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:36.068 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:36.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.068 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:36.068 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:36.069 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 150.95620638400001, 2020-11-12T17:25:36.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:25:36.069 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.069 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:36.070 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:36.070 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:25:36.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.070 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:36.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:25:36.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:36.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:25:36.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:25:36.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:25:36.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:25:36.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:25:36.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:25:36.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:25:36.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:25:36.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:25:36.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:25:36.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:25:36.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:25:36.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:36.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:25:36.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:25:36.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:25:36.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:25:36.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:25:36.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:25:36.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:25:36.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:25:36.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:25:36.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:25:36.081 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.081 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.081 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.081 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:25:36.081 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:36.081 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 150.94911458799999, 2020-11-12T17:25:36.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:25:36.082 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.082 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:36.082 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:36.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:25:36.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:36.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:25:36.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:25:36.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:25:36.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:25:36.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:25:36.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:25:36.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:25:36.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:25:36.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:25:36.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:25:36.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:25:36.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:25:36.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:25:36.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:25:36.088 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.088 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.088 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.089 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:36.089 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:36.089 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 141.51655509099999, 2020-11-12T17:25:36.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:25:36.089 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.089 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:36.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:36.090 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:25:36.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.090 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:36.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:25:36.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:36.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:25:36.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:25:36.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:25:36.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:25:36.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:25:36.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:25:36.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:25:36.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:25:36.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:25:36.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:25:36.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:25:36.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:25:36.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:36.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:25:36.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:25:36.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:25:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:25:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:25:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:25:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:25:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:25:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:25:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:25:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:25:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.566434997, 2020-11-12T17:25:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:25:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:25:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:25:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:25:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:25:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:25:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:25:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:25:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:25:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:25:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:25:36.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:25:36.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:25:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:25:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:25:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:25:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.112 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.112 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:28424 3.b e47/20 3:d6b3d883:::benchmark_data_smithi036_14212_object3552:head v 47'1832, mlcod=47'1825)", 2020-11-12T17:25:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.541263636, 2020-11-12T17:25:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002, 2020-11-12T17:25:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523820+0000", 2020-11-12T17:25:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523784+0000", 2020-11-12T17:25:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100963 2020-11-12T17:25:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.523885+0000", 2020-11-12T17:25:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29458836900000002 2020-11-12T17:25:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818473+0000", 2020-11-12T17:25:36.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1482e-05 2020-11-12T17:25:36.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818485+0000", 2020-11-12T17:25:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4080999999999998e-05 2020-11-12T17:25:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818559+0000", 2020-11-12T17:25:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9269e-05 2020-11-12T17:25:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.818598+0000", 2020-11-12T17:25:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044328520000000001 2020-11-12T17:25:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823031+0000", 2020-11-12T17:25:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2584999999999998e-05 2020-11-12T17:25:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.823094+0000", 2020-11-12T17:25:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29927361400000002 2020-11-12T17:25:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:25:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.46083310500001, 2020-11-12T17:25:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:25:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:25:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:25:36.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:25:36.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:25:36.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:25:36.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:25:36.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:36.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:25:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:25:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:25:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:25:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:25:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:25:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:25:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:25:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:25:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:25:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43535 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 91.355863303999996, 2020-11-12T17:25:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003, 2020-11-12T17:25:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43535 2020-11-12T17:25:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:36.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709220+0000", 2020-11-12T17:25:36.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:36.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709201+0000", 2020-11-12T17:25:36.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4987000000000001e-05 2020-11-12T17:25:36.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709256+0000", 2020-11-12T17:25:36.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9799999999999998e-06 2020-11-12T17:25:36.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709264+0000", 2020-11-12T17:25:36.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8600000000000001e-06 2020-11-12T17:25:36.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709268+0000", 2020-11-12T17:25:36.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01033796 2020-11-12T17:25:36.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719606+0000", 2020-11-12T17:25:36.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014753499999999999 2020-11-12T17:25:36.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719754+0000", 2020-11-12T17:25:36.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023477900000000001 2020-11-12T17:25:36.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:36.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.719989+0000", 2020-11-12T17:25:36.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002308844 2020-11-12T17:25:36.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722298+0000", 2020-11-12T17:25:36.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27981983300000002 2020-11-12T17:25:36.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002117+0000", 2020-11-12T17:25:36.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4757000000000001e-05 2020-11-12T17:25:36.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002212+0000", 2020-11-12T17:25:36.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116928 2020-11-12T17:25:36.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002329+0000", 2020-11-12T17:25:36.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29310885800000003 2020-11-12T17:25:36.144 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.144 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.144 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.145 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:43536 3.6 3:6bf5b56b:::benchmark_data_smithi036_14212_object5441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:36.145 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:36.145 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 91.355763773000007, 2020-11-12T17:25:36.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001, 2020-11-12T17:25:36.145 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.145 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.145 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.146 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:36.146 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:36.146 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43536 2020-11-12T17:25:36.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.146 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:36.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709320+0000", 2020-11-12T17:25:36.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:36.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709302+0000", 2020-11-12T17:25:36.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3248999999999998e-05 2020-11-12T17:25:36.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709355+0000", 2020-11-12T17:25:36.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.34e-06 2020-11-12T17:25:36.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709363+0000", 2020-11-12T17:25:36.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.664e-06 2020-11-12T17:25:36.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.709366+0000", 2020-11-12T17:25:36.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013071532 2020-11-12T17:25:36.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722438+0000", 2020-11-12T17:25:36.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141901 2020-11-12T17:25:36.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722580+0000", 2020-11-12T17:25:36.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118355 2020-11-12T17:25:36.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:36.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.722698+0000", 2020-11-12T17:25:36.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014561839999999999 2020-11-12T17:25:36.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:04.724154+0000", 2020-11-12T17:25:36.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27825006499999999 2020-11-12T17:25:36.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002404+0000", 2020-11-12T17:25:36.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2908000000000001e-05 2020-11-12T17:25:36.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002477+0000", 2020-11-12T17:25:36.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020370300000000001 2020-11-12T17:25:36.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:05.002681+0000", 2020-11-12T17:25:36.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29336106000000001 2020-11-12T17:25:36.156 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.157 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.157 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.157 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:36.157 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:36.157 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.114349770999993, 2020-11-12T17:25:36.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:25:36.158 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.158 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.158 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.158 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:36.158 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:36.158 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:25:36.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.159 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:36.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:25:36.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:25:36.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:25:36.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:25:36.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:25:36.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:25:36.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:25:36.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:25:36.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:25:36.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:25:36.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:25:36.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:25:36.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:25:36.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:25:36.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:36.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:25:36.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:25:36.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:25:36.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:25:36.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:25:36.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:25:36.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:25:36.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:25:36.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:25:36.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:25:36.167 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.167 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.168 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:36.168 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:36.168 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.118507969000007, 2020-11-12T17:25:36.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:25:36.168 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.169 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:36.169 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:36.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:25:36.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:36.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:25:36.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:25:36.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:25:36.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:25:36.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:25:36.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:25:36.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:25:36.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:25:36.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:25:36.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:25:36.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:25:36.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:25:36.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:25:36.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:25:36.175 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.176 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.176 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.176 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:25:36.176 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:36.176 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 61.18340457, 2020-11-12T17:25:36.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:25:36.177 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.177 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:25:36.177 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:36.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:25:36.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:36.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:25:36.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:25:36.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:25:36.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:25:36.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:25:36.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:25:36.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:25:36.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:25:36.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:25:36.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:25:36.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:25:36.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:25:36.182 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.182 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.182 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.183 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:304 4.b 4:d3839b57:::benchmark_data_smithi036_18856_object37:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:36.183 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:36.183 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.927239012999998, 2020-11-12T17:25:36.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999, 2020-11-12T17:25:36.183 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.183 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:36.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:36.184 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 304 2020-11-12T17:25:36.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.184 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:36.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137845+0000", 2020-11-12T17:25:36.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:36.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137813+0000", 2020-11-12T17:25:36.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9074999999999998e-05 2020-11-12T17:25:36.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137892+0000", 2020-11-12T17:25:36.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8020000000000003e-06 2020-11-12T17:25:36.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137902+0000", 2020-11-12T17:25:36.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7619999999999995e-06 2020-11-12T17:25:36.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.137909+0000", 2020-11-12T17:25:36.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040533879999999998 2020-11-12T17:25:36.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.141963+0000", 2020-11-12T17:25:36.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162048 2020-11-12T17:25:36.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142125+0000", 2020-11-12T17:25:36.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00039201500000000001 2020-11-12T17:25:36.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:36.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.142517+0000", 2020-11-12T17:25:36.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010951820000000001 2020-11-12T17:25:36.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.143612+0000", 2020-11-12T17:25:36.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.286564975 2020-11-12T17:25:36.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430177+0000", 2020-11-12T17:25:36.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8254000000000002e-05 2020-11-12T17:25:36.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430235+0000", 2020-11-12T17:25:36.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9767000000000001e-05 2020-11-12T17:25:36.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.430275+0000", 2020-11-12T17:25:36.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29243042699999999 2020-11-12T17:25:36.193 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.193 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.193 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.193 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:936 4.6 4:6403dfdf:::benchmark_data_smithi036_18856_object116:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:36.194 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:36.194 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.37279479, 2020-11-12T17:25:36.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001, 2020-11-12T17:25:36.194 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.194 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.194 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.194 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:36.195 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:36.195 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 936 2020-11-12T17:25:36.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.195 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:36.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692289+0000", 2020-11-12T17:25:36.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:36.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692257+0000", 2020-11-12T17:25:36.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8807999999999994e-05 2020-11-12T17:25:36.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692346+0000", 2020-11-12T17:25:36.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1438e-05 2020-11-12T17:25:36.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692357+0000", 2020-11-12T17:25:36.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0989999999999998e-06 2020-11-12T17:25:36.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.692362+0000", 2020-11-12T17:25:36.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036699900000000001 2020-11-12T17:25:36.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696032+0000", 2020-11-12T17:25:36.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021269999999999999 2020-11-12T17:25:36.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696245+0000", 2020-11-12T17:25:36.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00032215999999999999 2020-11-12T17:25:36.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:36.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.696567+0000", 2020-11-12T17:25:36.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001477368 2020-11-12T17:25:36.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.698044+0000", 2020-11-12T17:25:36.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29849877600000002 2020-11-12T17:25:36.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996543+0000", 2020-11-12T17:25:36.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4288000000000004e-05 2020-11-12T17:25:36.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996617+0000", 2020-11-12T17:25:36.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1554999999999997e-05 2020-11-12T17:25:36.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:52.996669+0000", 2020-11-12T17:25:36.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.30438016400000001 2020-11-12T17:25:36.204 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.204 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.204 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.205 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:25:36.205 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:25:36.205 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.418764078999999, 2020-11-12T17:25:36.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:25:36.206 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.206 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:36.206 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:25:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:25:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:25:36.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:25:36.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:25:36.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:25:36.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:25:36.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:25:36.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:25:36.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:25:36.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:25:36.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:25:36.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:25:36.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:25:36.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:25:36.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:25:36.212 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.212 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.212 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.213 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:25:36.213 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:25:36.213 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.162255394999999, 2020-11-12T17:25:36.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:25:36.213 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.213 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.213 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.213 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:36.214 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:36.214 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:25:36.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.214 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:25:36.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:25:36.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:36.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:25:36.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:25:36.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:25:36.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:25:36.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:25:36.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:25:36.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:25:36.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:25:36.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:25:36.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:25:36.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:25:36.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:25:36.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:36.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:25:36.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:25:36.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:25:36.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:25:36.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:25:36.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:25:36.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:25:36.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:25:36.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:25:36.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:25:36.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.223 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.223 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.223 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:25:36.223 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:25:36.223 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.162093025000001, 2020-11-12T17:25:36.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:25:36.224 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.224 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:36.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:36.224 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:25:36.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.225 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:25:36.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:25:36.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:25:36.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:25:36.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:25:36.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:25:36.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:25:36.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:25:36.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:25:36.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:25:36.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:25:36.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:25:36.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:25:36.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:25:36.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:25:36.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:36.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:25:36.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:25:36.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:25:36.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:25:36.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:25:36.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:25:36.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:25:36.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:25:36.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:25:36.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:25:36.233 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.233 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.233 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.234 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:25:36.234 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:25:36.234 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.153524038, 2020-11-12T17:25:36.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:25:36.234 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.234 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:36.234 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:25:36.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:25:36.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:36.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:25:36.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:25:36.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:25:36.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:25:36.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:25:36.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:25:36.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:25:36.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:25:36.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:25:36.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:25:36.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:25:36.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:25:36.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:25:36.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:25:36.240 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.240 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.241 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.241 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:31016 4.3 4:c401a391:::benchmark_data_smithi036_18856_object3876:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e84)", 2020-11-12T17:25:36.241 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.719718+0000", 2020-11-12T17:25:36.241 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.345365107999999, 2020-11-12T17:25:36.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.295163962, 2020-11-12T17:25:36.242 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.242 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:36.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:36.242 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 31016 2020-11-12T17:25:36.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.243 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719718+0000", 2020-11-12T17:25:36.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719718+0000", 2020-11-12T17:25:36.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:36.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719683+0000", 2020-11-12T17:25:36.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119109 2020-11-12T17:25:36.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719803+0000", 2020-11-12T17:25:36.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4235e-05 2020-11-12T17:25:36.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719817+0000", 2020-11-12T17:25:36.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.619e-06 2020-11-12T17:25:36.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.719825+0000", 2020-11-12T17:25:36.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003385599 2020-11-12T17:25:36.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.723211+0000", 2020-11-12T17:25:36.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016867 2020-11-12T17:25:36.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.723380+0000", 2020-11-12T17:25:36.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028993600000000002 2020-11-12T17:25:36.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:36.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.723670+0000", 2020-11-12T17:25:36.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046715749999999999 2020-11-12T17:25:36.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.728341+0000", 2020-11-12T17:25:36.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28638648799999999 2020-11-12T17:25:36.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.014728+0000", 2020-11-12T17:25:36.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2670999999999994e-05 2020-11-12T17:25:36.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.014820+0000", 2020-11-12T17:25:36.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2055000000000001e-05 2020-11-12T17:25:36.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.014882+0000", 2020-11-12T17:25:36.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.295163962 2020-11-12T17:25:36.251 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.251 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.251 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.252 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:31304 4.b 4:d34ad4b4:::benchmark_data_smithi036_18856_object3912:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e84)", 2020-11-12T17:25:36.252 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:22.033159+0000", 2020-11-12T17:25:36.252 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.031924070000001, 2020-11-12T17:25:36.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.301776131, 2020-11-12T17:25:36.252 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.252 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.252 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:36.253 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:36.253 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:36.253 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 31304 2020-11-12T17:25:36.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.253 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033159+0000", 2020-11-12T17:25:36.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033159+0000", 2020-11-12T17:25:36.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:25:36.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033136+0000", 2020-11-12T17:25:36.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010585 2020-11-12T17:25:36.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033242+0000", 2020-11-12T17:25:36.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3686999999999999e-05 2020-11-12T17:25:36.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033266+0000", 2020-11-12T17:25:36.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8850000000000001e-06 2020-11-12T17:25:36.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.033273+0000", 2020-11-12T17:25:36.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00274186 2020-11-12T17:25:36.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.036015+0000", 2020-11-12T17:25:36.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013071900000000001 2020-11-12T17:25:36.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.036145+0000", 2020-11-12T17:25:36.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019973300000000001 2020-11-12T17:25:36.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:36.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.036345+0000", 2020-11-12T17:25:36.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020334289999999998 2020-11-12T17:25:36.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:36.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.038378+0000", 2020-11-12T17:25:36.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.296228932 2020-11-12T17:25:36.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:36.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334607+0000", 2020-11-12T17:25:36.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016707399999999999 2020-11-12T17:25:36.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334774+0000", 2020-11-12T17:25:36.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016120899999999999 2020-11-12T17:25:36.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334936+0000", 2020-11-12T17:25:36.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.301776131 2020-11-12T17:25:36.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.262 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.262 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:31304 4.b e84/69 ondisk, result = 0)", 2020-11-12T17:25:36.262 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:22.044264+0000", 2020-11-12T17:25:36.263 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.020819575000001, 2020-11-12T17:25:36.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29069468999999998, 2020-11-12T17:25:36.263 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.263 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:36.263 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044264+0000", 2020-11-12T17:25:36.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044264+0000", 2020-11-12T17:25:36.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:36.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044236+0000", 2020-11-12T17:25:36.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3578000000000001e-05 2020-11-12T17:25:36.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.044289+0000", 2020-11-12T17:25:36.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28865362300000003 2020-11-12T17:25:36.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.332943+0000", 2020-11-12T17:25:36.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.345e-06 2020-11-12T17:25:36.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.332950+0000", 2020-11-12T17:25:36.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015810780000000001 2020-11-12T17:25:36.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334531+0000", 2020-11-12T17:25:36.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6631999999999998e-05 2020-11-12T17:25:36.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334558+0000", 2020-11-12T17:25:36.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00040088800000000001 2020-11-12T17:25:36.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:22.334959+0000", 2020-11-12T17:25:36.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29069468999999998 2020-11-12T17:25:36.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.269 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.269 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.270 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:36.271 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:36.272 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:36.272 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:36.272 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:36.272 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:36.272 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:36.273 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:25:36.273 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:25:36.273 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:36.273 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:36.273 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:36.273 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:36.274 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:36.274 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:36.266+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:36.275 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:36.373 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:36.370+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:36.443 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:36.444 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:36.459 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:25:36.508 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:36.504+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:36.569 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:36.570 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:36.574 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:36.570+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:36.579 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:25:36.675 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:36.670+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:36.682 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:36.678+0000 7f9a0b6b4700 -1 osd.5 90 handle_osd_map injecting map crc failure 2020-11-12T17:25:36.689 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:36.686+0000 7f7b4b297700 -1 osd.4 90 handle_osd_map injecting map crc failure 2020-11-12T17:25:36.690 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:25:36.742 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:36.742 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:36.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:36.742 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:36.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.743 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:132 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'4, mlcod=0'0)", 2020-11-12T17:25:36.743 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:36.743 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 152.08033226699999, 2020-11-12T17:25:36.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003, 2020-11-12T17:25:36.743 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.743 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.743 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:36.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659504+0000", 2020-11-12T17:25:36.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:36.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659479+0000", 2020-11-12T17:25:36.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106088 2020-11-12T17:25:36.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659585+0000", 2020-11-12T17:25:36.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8701000000000005e-05 2020-11-12T17:25:36.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659654+0000", 2020-11-12T17:25:36.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3280000000000002e-06 2020-11-12T17:25:36.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659660+0000", 2020-11-12T17:25:36.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6808000000000003e-05 2020-11-12T17:25:36.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659707+0000", 2020-11-12T17:25:36.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6177999999999999e-05 2020-11-12T17:25:36.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.659733+0000", 2020-11-12T17:25:36.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089711989999999991 2020-11-12T17:25:36.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668704+0000", 2020-11-12T17:25:36.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5686999999999994e-05 2020-11-12T17:25:36.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668800+0000", 2020-11-12T17:25:36.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092961420000000003 2020-11-12T17:25:36.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.750 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.751 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.751 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:133 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'5, mlcod=0'0)", 2020-11-12T17:25:36.751 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:36.751 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 152.079425472, 2020-11-12T17:25:36.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001, 2020-11-12T17:25:36.752 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.752 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.752 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:36.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660410+0000", 2020-11-12T17:25:36.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:36.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660385+0000", 2020-11-12T17:25:36.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6765e-05 2020-11-12T17:25:36.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660472+0000", 2020-11-12T17:25:36.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0564999999999998e-05 2020-11-12T17:25:36.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660562+0000", 2020-11-12T17:25:36.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:36.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660569+0000", 2020-11-12T17:25:36.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3807999999999998e-05 2020-11-12T17:25:36.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660613+0000", 2020-11-12T17:25:36.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5299999999999998e-05 2020-11-12T17:25:36.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.660639+0000", 2020-11-12T17:25:36.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084653160000000005 2020-11-12T17:25:36.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669104+0000", 2020-11-12T17:25:36.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7162000000000001e-05 2020-11-12T17:25:36.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669141+0000", 2020-11-12T17:25:36.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087305170000000001 2020-11-12T17:25:36.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.759 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.759 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:134 3.4 e22/20 3:2f8991eb:::benchmark_data_smithi036_14212_object16:head v 22'6, mlcod=0'0)", 2020-11-12T17:25:36.759 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:36.759 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 152.07872324900001, 2020-11-12T17:25:36.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005, 2020-11-12T17:25:36.760 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.760 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.760 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:36.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661113+0000", 2020-11-12T17:25:36.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:36.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661088+0000", 2020-11-12T17:25:36.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6825999999999998e-05 2020-11-12T17:25:36.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661175+0000", 2020-11-12T17:25:36.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1464000000000006e-05 2020-11-12T17:25:36.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661236+0000", 2020-11-12T17:25:36.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0560000000000001e-06 2020-11-12T17:25:36.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.661242+0000", 2020-11-12T17:25:36.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001772842 2020-11-12T17:25:36.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663015+0000", 2020-11-12T17:25:36.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4703e-05 2020-11-12T17:25:36.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.663040+0000", 2020-11-12T17:25:36.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061262729999999998 2020-11-12T17:25:36.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669166+0000", 2020-11-12T17:25:36.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1947999999999999e-05 2020-11-12T17:25:36.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.669208+0000", 2020-11-12T17:25:36.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080954830000000005 2020-11-12T17:25:36.767 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.767 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.767 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.767 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:147 3.4 e22/20 3:2a1f0b35:::benchmark_data_smithi036_14212_object18:head v 22'11, mlcod=22'2)", 2020-11-12T17:25:36.767 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:36.767 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 152.07421705300001, 2020-11-12T17:25:36.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002, 2020-11-12T17:25:36.768 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.768 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.768 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:36.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665619+0000", 2020-11-12T17:25:36.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:36.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665595+0000", 2020-11-12T17:25:36.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120876 2020-11-12T17:25:36.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665716+0000", 2020-11-12T17:25:36.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6929999999999999e-05 2020-11-12T17:25:36.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665773+0000", 2020-11-12T17:25:36.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:25:36.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.665780+0000", 2020-11-12T17:25:36.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026318729999999999 2020-11-12T17:25:36.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668412+0000", 2020-11-12T17:25:36.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9828000000000001e-05 2020-11-12T17:25:36.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.668432+0000", 2020-11-12T17:25:36.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052635609999999999 2020-11-12T17:25:36.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673696+0000", 2020-11-12T17:25:36.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8526999999999998e-05 2020-11-12T17:25:36.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:04.673744+0000", 2020-11-12T17:25:36.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081251550000000002 2020-11-12T17:25:36.775 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.775 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.775 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.776 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1767 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'87, mlcod=23'80)", 2020-11-12T17:25:36.776 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:36.776 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 150.570676072, 2020-11-12T17:25:36.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097, 2020-11-12T17:25:36.776 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.777 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.777 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:36.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169160+0000", 2020-11-12T17:25:36.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:36.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169133+0000", 2020-11-12T17:25:36.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102364 2020-11-12T17:25:36.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169236+0000", 2020-11-12T17:25:36.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107971 2020-11-12T17:25:36.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169344+0000", 2020-11-12T17:25:36.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.525e-06 2020-11-12T17:25:36.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.169351+0000", 2020-11-12T17:25:36.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018991850000000001 2020-11-12T17:25:36.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171250+0000", 2020-11-12T17:25:36.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5503000000000002e-05 2020-11-12T17:25:36.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.171286+0000", 2020-11-12T17:25:36.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0098520180000000006 2020-11-12T17:25:36.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181138+0000", 2020-11-12T17:25:36.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0168999999999998e-05 2020-11-12T17:25:36.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181218+0000", 2020-11-12T17:25:36.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012058097 2020-11-12T17:25:36.784 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.785 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.785 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.785 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1768 3.4 e23/20 3:21778d9b:::benchmark_data_smithi036_14212_object220:head v 23'88, mlcod=23'80)", 2020-11-12T17:25:36.785 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:36.786 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 150.569749831, 2020-11-12T17:25:36.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311, 2020-11-12T17:25:36.786 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.786 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.787 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:36.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170086+0000", 2020-11-12T17:25:36.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:25:36.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170070+0000", 2020-11-12T17:25:36.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8257999999999997e-05 2020-11-12T17:25:36.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170128+0000", 2020-11-12T17:25:36.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0139999999999998e-05 2020-11-12T17:25:36.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170178+0000", 2020-11-12T17:25:36.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6189999999999999e-06 2020-11-12T17:25:36.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.170184+0000", 2020-11-12T17:25:36.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030062579999999999 2020-11-12T17:25:36.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173190+0000", 2020-11-12T17:25:36.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5352999999999999e-05 2020-11-12T17:25:36.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173215+0000", 2020-11-12T17:25:36.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080080599999999991 2020-11-12T17:25:36.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181223+0000", 2020-11-12T17:25:36.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3237000000000003e-05 2020-11-12T17:25:36.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181306+0000", 2020-11-12T17:25:36.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011220311 2020-11-12T17:25:36.794 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.794 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.794 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.795 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1770 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'106, mlcod=23'103)", 2020-11-12T17:25:36.795 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:36.795 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 150.567402321, 2020-11-12T17:25:36.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991, 2020-11-12T17:25:36.795 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.795 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.795 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:36.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172434+0000", 2020-11-12T17:25:36.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:25:36.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172402+0000", 2020-11-12T17:25:36.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118745 2020-11-12T17:25:36.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172521+0000", 2020-11-12T17:25:36.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9580999999999997e-05 2020-11-12T17:25:36.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172591+0000", 2020-11-12T17:25:36.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0175e-05 2020-11-12T17:25:36.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172601+0000", 2020-11-12T17:25:36.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4148999999999999e-05 2020-11-12T17:25:36.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172665+0000", 2020-11-12T17:25:36.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1019999999999999e-05 2020-11-12T17:25:36.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.172686+0000", 2020-11-12T17:25:36.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084683129999999999 2020-11-12T17:25:36.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181154+0000", 2020-11-12T17:25:36.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3254e-05 2020-11-12T17:25:36.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181228+0000", 2020-11-12T17:25:36.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087940109999999991 2020-11-12T17:25:36.804 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.804 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.804 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.804 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1771 3.0 e23/20 3:00c7b625:::benchmark_data_smithi036_14212_object221:head v 23'107, mlcod=23'103)", 2020-11-12T17:25:36.804 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:36.804 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 150.56663752899999, 2020-11-12T17:25:36.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007, 2020-11-12T17:25:36.805 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.805 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.805 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:36.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173198+0000", 2020-11-12T17:25:36.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:36.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173174+0000", 2020-11-12T17:25:36.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0946999999999996e-05 2020-11-12T17:25:36.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173255+0000", 2020-11-12T17:25:36.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000143225 2020-11-12T17:25:36.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173398+0000", 2020-11-12T17:25:36.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.149e-05 2020-11-12T17:25:36.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173410+0000", 2020-11-12T17:25:36.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5201000000000001e-05 2020-11-12T17:25:36.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173475+0000", 2020-11-12T17:25:36.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2320999999999998e-05 2020-11-12T17:25:36.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.173507+0000", 2020-11-12T17:25:36.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077242459999999997 2020-11-12T17:25:36.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181232+0000", 2020-11-12T17:25:36.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2563000000000004e-05 2020-11-12T17:25:36.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.181294+0000", 2020-11-12T17:25:36.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080957990000000007 2020-11-12T17:25:36.813 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.813 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.814 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.814 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:1846 3.9 e23/20 3:91e4f55d:::benchmark_data_smithi036_14212_object230:head v 23'118, mlcod=23'111)", 2020-11-12T17:25:36.814 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:36.815 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 150.484411051, 2020-11-12T17:25:36.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993, 2020-11-12T17:25:36.815 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.815 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.816 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:36.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255425+0000", 2020-11-12T17:25:36.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:36.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255404+0000", 2020-11-12T17:25:36.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0986000000000001e-05 2020-11-12T17:25:36.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255475+0000", 2020-11-12T17:25:36.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0112999999999999e-05 2020-11-12T17:25:36.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255525+0000", 2020-11-12T17:25:36.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2314999999999999e-05 2020-11-12T17:25:36.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.255548+0000", 2020-11-12T17:25:36.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018442129999999999 2020-11-12T17:25:36.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257392+0000", 2020-11-12T17:25:36.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8216000000000001e-05 2020-11-12T17:25:36.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.257430+0000", 2020-11-12T17:25:36.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007071478 2020-11-12T17:25:36.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264502+0000", 2020-11-12T17:25:36.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5906000000000003e-05 2020-11-12T17:25:36.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:06.264558+0000", 2020-11-12T17:25:36.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091326199999999993 2020-11-12T17:25:36.822 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.823 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.823 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.823 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4456 3.4 e24/20 3:2687f8a1:::benchmark_data_smithi036_14212_object556:head v 24'240, mlcod=24'235)", 2020-11-12T17:25:36.823 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:36.823 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.89229761799999, 2020-11-12T17:25:36.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001, 2020-11-12T17:25:36.824 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.824 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.824 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:36.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847538+0000", 2020-11-12T17:25:36.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:25:36.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847499+0000", 2020-11-12T17:25:36.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000110498 2020-11-12T17:25:36.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:08.847610+0000", 2020-11-12T17:25:36.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28062427099999998 2020-11-12T17:25:36.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128234+0000", 2020-11-12T17:25:36.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4157e-05 2020-11-12T17:25:36.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128248+0000", 2020-11-12T17:25:36.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000163833 2020-11-12T17:25:36.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128412+0000", 2020-11-12T17:25:36.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8687000000000002e-05 2020-11-12T17:25:36.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.128470+0000", 2020-11-12T17:25:36.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001925394 2020-11-12T17:25:36.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130396+0000", 2020-11-12T17:25:36.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114404 2020-11-12T17:25:36.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.130510+0000", 2020-11-12T17:25:36.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28297193700000001 2020-11-12T17:25:36.831 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.831 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.831 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.831 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:4973 3.4 e25/20 3:2c6689bf:::benchmark_data_smithi036_14212_object621:head v 25'277, mlcod=25'271)", 2020-11-12T17:25:36.839 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:36.840 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 146.863637321, 2020-11-12T17:25:36.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005, 2020-11-12T17:25:36.840 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.840 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.841 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:36.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876199+0000", 2020-11-12T17:25:36.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:36.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876175+0000", 2020-11-12T17:25:36.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1934000000000004e-05 2020-11-12T17:25:36.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876267+0000", 2020-11-12T17:25:36.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114885 2020-11-12T17:25:36.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876382+0000", 2020-11-12T17:25:36.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3196e-05 2020-11-12T17:25:36.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.876395+0000", 2020-11-12T17:25:36.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031080999999999999 2020-11-12T17:25:36.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879503+0000", 2020-11-12T17:25:36.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6483000000000003e-05 2020-11-12T17:25:36.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.879539+0000", 2020-11-12T17:25:36.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051216760000000004 2020-11-12T17:25:36.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884661+0000", 2020-11-12T17:25:36.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7345e-05 2020-11-12T17:25:36.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:09.884728+0000", 2020-11-12T17:25:36.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085296750000000005 2020-11-12T17:25:36.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.847 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.848 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.848 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9200 3.0 e26/20 3:09fed960:::benchmark_data_smithi036_14212_object1149:head v 26'496, mlcod=26'491)", 2020-11-12T17:25:36.848 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:36.848 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.95104061000001, 2020-11-12T17:25:36.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995, 2020-11-12T17:25:36.848 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.849 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.849 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:36.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788795+0000", 2020-11-12T17:25:36.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:25:36.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788770+0000", 2020-11-12T17:25:36.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7348000000000005e-05 2020-11-12T17:25:36.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.788857+0000", 2020-11-12T17:25:36.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061760865999999998 2020-11-12T17:25:36.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850618+0000", 2020-11-12T17:25:36.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2779999999999999e-06 2020-11-12T17:25:36.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850624+0000", 2020-11-12T17:25:36.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026604800000000001 2020-11-12T17:25:36.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850890+0000", 2020-11-12T17:25:36.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3411e-05 2020-11-12T17:25:36.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.850914+0000", 2020-11-12T17:25:36.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001534101 2020-11-12T17:25:36.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852448+0000", 2020-11-12T17:25:36.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5482999999999998e-05 2020-11-12T17:25:36.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.852493+0000", 2020-11-12T17:25:36.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063697991999999995 2020-11-12T17:25:36.855 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.856 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.856 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.856 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9296 3.0 e26/20 3:0b6df96a:::benchmark_data_smithi036_14212_object1161:head v 26'504, mlcod=26'497)", 2020-11-12T17:25:36.856 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:36.856 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.87990096600001, 2020-11-12T17:25:36.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067, 2020-11-12T17:25:36.857 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.857 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.857 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:36.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859935+0000", 2020-11-12T17:25:36.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:36.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859911+0000", 2020-11-12T17:25:36.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3479000000000005e-05 2020-11-12T17:25:36.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.859995+0000", 2020-11-12T17:25:36.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.098764670999999998 2020-11-12T17:25:36.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958759+0000", 2020-11-12T17:25:36.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0621999999999999e-05 2020-11-12T17:25:36.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958770+0000", 2020-11-12T17:25:36.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6164999999999999e-05 2020-11-12T17:25:36.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958856+0000", 2020-11-12T17:25:36.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8405999999999997e-05 2020-11-12T17:25:36.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.958905+0000", 2020-11-12T17:25:36.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012413770000000001 2020-11-12T17:25:36.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960146+0000", 2020-11-12T17:25:36.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1122000000000001e-05 2020-11-12T17:25:36.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.960217+0000", 2020-11-12T17:25:36.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.100282067 2020-11-12T17:25:36.864 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.864 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.864 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.864 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9384 3.4 e26/20 3:2291be56:::benchmark_data_smithi036_14212_object1172:head v 26'520, mlcod=26'514)", 2020-11-12T17:25:36.864 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:36.864 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.77051367499999, 2020-11-12T17:25:36.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994, 2020-11-12T17:25:36.865 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.865 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.865 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:36.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969322+0000", 2020-11-12T17:25:36.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:36.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969308+0000", 2020-11-12T17:25:36.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0612000000000003e-05 2020-11-12T17:25:36.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:13.969358+0000", 2020-11-12T17:25:36.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.061378808999999999 2020-11-12T17:25:36.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030737+0000", 2020-11-12T17:25:36.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2894999999999999e-05 2020-11-12T17:25:36.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030750+0000", 2020-11-12T17:25:36.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103908 2020-11-12T17:25:36.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030854+0000", 2020-11-12T17:25:36.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2722999999999997e-05 2020-11-12T17:25:36.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.030897+0000", 2020-11-12T17:25:36.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001762174 2020-11-12T17:25:36.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032659+0000", 2020-11-12T17:25:36.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9755999999999998e-05 2020-11-12T17:25:36.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.032759+0000", 2020-11-12T17:25:36.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063436260999999994 2020-11-12T17:25:36.872 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.872 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.872 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.873 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9480 3.4 e26/20 3:265c8f5d:::benchmark_data_smithi036_14212_object1184:head v 26'528, mlcod=26'523)", 2020-11-12T17:25:36.873 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:36.873 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.69997783599999, 2020-11-12T17:25:36.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001, 2020-11-12T17:25:36.873 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.873 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.873 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:36.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039858+0000", 2020-11-12T17:25:36.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:36.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039820+0000", 2020-11-12T17:25:36.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000128372 2020-11-12T17:25:36.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.039948+0000", 2020-11-12T17:25:36.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.1585821 2020-11-12T17:25:36.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198530+0000", 2020-11-12T17:25:36.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4455e-05 2020-11-12T17:25:36.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198545+0000", 2020-11-12T17:25:36.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5377999999999995e-05 2020-11-12T17:25:36.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198630+0000", 2020-11-12T17:25:36.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5126999999999998e-05 2020-11-12T17:25:36.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.198665+0000", 2020-11-12T17:25:36.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021252049999999998 2020-11-12T17:25:36.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200791+0000", 2020-11-12T17:25:36.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3455000000000006e-05 2020-11-12T17:25:36.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.200874+0000", 2020-11-12T17:25:36.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.16101596400000001 2020-11-12T17:25:36.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.881 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.881 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.881 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9680 3.0 e26/20 3:0dd1be81:::benchmark_data_smithi036_14212_object1209:head v 26'512, mlcod=26'508)", 2020-11-12T17:25:36.881 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:36.881 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.53061189799999, 2020-11-12T17:25:36.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002, 2020-11-12T17:25:36.882 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.882 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.882 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:36.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209224+0000", 2020-11-12T17:25:36.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:25:36.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209203+0000", 2020-11-12T17:25:36.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3950999999999997e-05 2020-11-12T17:25:36.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.209277+0000", 2020-11-12T17:25:36.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063097652000000004 2020-11-12T17:25:36.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272375+0000", 2020-11-12T17:25:36.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1910000000000006e-06 2020-11-12T17:25:36.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272384+0000", 2020-11-12T17:25:36.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109095 2020-11-12T17:25:36.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272493+0000", 2020-11-12T17:25:36.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8387000000000001e-05 2020-11-12T17:25:36.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.272521+0000", 2020-11-12T17:25:36.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022515059999999999 2020-11-12T17:25:36.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.274773+0000", 2020-11-12T17:25:36.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044021199999999999 2020-11-12T17:25:36.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.275213+0000", 2020-11-12T17:25:36.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.065988928000000002 2020-11-12T17:25:36.889 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.889 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.889 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.890 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:9989 3.4 e26/20 3:2b39e6c1:::benchmark_data_smithi036_14212_object1248:head v 26'549, mlcod=26'544)", 2020-11-12T17:25:36.890 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:36.890 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.20198602599999, 2020-11-12T17:25:36.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008, 2020-11-12T17:25:36.890 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.890 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.891 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:36.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537850+0000", 2020-11-12T17:25:36.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:25:36.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537836+0000", 2020-11-12T17:25:36.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8739000000000002e-05 2020-11-12T17:25:36.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537885+0000", 2020-11-12T17:25:36.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0043000000000003e-05 2020-11-12T17:25:36.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537925+0000", 2020-11-12T17:25:36.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5689999999999998e-06 2020-11-12T17:25:36.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.537929+0000", 2020-11-12T17:25:36.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033164230000000002 2020-11-12T17:25:36.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541246+0000", 2020-11-12T17:25:36.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0898e-05 2020-11-12T17:25:36.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.541287+0000", 2020-11-12T17:25:36.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0051416070000000003 2020-11-12T17:25:36.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546428+0000", 2020-11-12T17:25:36.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3261999999999999e-05 2020-11-12T17:25:36.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.546481+0000", 2020-11-12T17:25:36.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086315320000000008 2020-11-12T17:25:36.898 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.898 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.898 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.898 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10142 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'566, mlcod=27'562)", 2020-11-12T17:25:36.898 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:36.899 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 141.545522664, 2020-11-12T17:25:36.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994, 2020-11-12T17:25:36.899 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.899 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.899 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:36.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194313+0000", 2020-11-12T17:25:36.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:36.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194291+0000", 2020-11-12T17:25:36.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6120999999999998e-05 2020-11-12T17:25:36.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194367+0000", 2020-11-12T17:25:36.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0123e-05 2020-11-12T17:25:36.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194427+0000", 2020-11-12T17:25:36.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0076e-05 2020-11-12T17:25:36.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194437+0000", 2020-11-12T17:25:36.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0734000000000003e-05 2020-11-12T17:25:36.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194518+0000", 2020-11-12T17:25:36.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7044e-05 2020-11-12T17:25:36.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.194555+0000", 2020-11-12T17:25:36.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081578880000000003 2020-11-12T17:25:36.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202713+0000", 2020-11-12T17:25:36.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:25:36.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.202799+0000", 2020-11-12T17:25:36.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084861469999999994 2020-11-12T17:25:36.906 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.906 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.906 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.907 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:10143 3.4 e27/20 3:2269b2fa:::benchmark_data_smithi036_14212_object1267:head v 27'567, mlcod=27'563)", 2020-11-12T17:25:36.907 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:36.907 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 141.54288194099999, 2020-11-12T17:25:36.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996, 2020-11-12T17:25:36.907 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.907 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.907 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:36.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196954+0000", 2020-11-12T17:25:36.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:36.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.196918+0000", 2020-11-12T17:25:36.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133652 2020-11-12T17:25:36.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197052+0000", 2020-11-12T17:25:36.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5613999999999996e-05 2020-11-12T17:25:36.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197148+0000", 2020-11-12T17:25:36.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0468e-05 2020-11-12T17:25:36.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197158+0000", 2020-11-12T17:25:36.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4934999999999999e-05 2020-11-12T17:25:36.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197243+0000", 2020-11-12T17:25:36.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2072e-05 2020-11-12T17:25:36.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.197285+0000", 2020-11-12T17:25:36.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081433689999999993 2020-11-12T17:25:36.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205428+0000", 2020-11-12T17:25:36.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6565999999999999e-05 2020-11-12T17:25:36.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:15.205495+0000", 2020-11-12T17:25:36.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0085410269999999996 2020-11-12T17:25:36.915 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.915 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.916 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.916 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:12320 3.9 e31/20 3:981ec540:::benchmark_data_smithi036_14212_object1539:head v 31'888, mlcod=30'879)", 2020-11-12T17:25:36.916 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:36.916 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.05863590199999, 2020-11-12T17:25:36.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995, 2020-11-12T17:25:36.917 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:36.917 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:36.917 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:36.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:36.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:36.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:36.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:36.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681200+0000", 2020-11-12T17:25:36.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:25:36.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:36.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681187+0000", 2020-11-12T17:25:36.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5859000000000003e-05 2020-11-12T17:25:36.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:36.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681233+0000", 2020-11-12T17:25:36.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013427600000000001 2020-11-12T17:25:36.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:36.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681367+0000", 2020-11-12T17:25:36.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0640000000000001e-06 2020-11-12T17:25:36.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:36.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.681369+0000", 2020-11-12T17:25:36.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003921239 2020-11-12T17:25:36.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:36.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685291+0000", 2020-11-12T17:25:36.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0961999999999999e-05 2020-11-12T17:25:36.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:36.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.685322+0000", 2020-11-12T17:25:36.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055640250000000002 2020-11-12T17:25:36.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:36.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690886+0000", 2020-11-12T17:25:36.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8990000000000002e-05 2020-11-12T17:25:36.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:36.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:36.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:36.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:18.690955+0000", 2020-11-12T17:25:36.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097544699999999995 2020-11-12T17:25:36.923 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.923 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.924 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.924 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:36.924 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:36.924 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:36.925 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:36.926 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:36.920+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:36.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 45 16 44420 44404 7.70828 6.36719 0.0189044 0.0161947 2020-11-12T17:25:37.027 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:37.020+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:37.058 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:37.058 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:37.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.059 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:25:37.059 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:25:37.059 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.34742014500000001, 2020-11-12T17:25:37.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34745602199999998, 2020-11-12T17:25:37.059 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.059 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:37.060 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.060 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.060 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.060 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:25:37.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.061 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:25:37.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:25:37.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:37.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:25:37.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:25:37.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:25:37.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:25:37.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:25:37.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:25:37.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:25:37.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:25:37.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:25:37.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:25:37.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:25:37.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:25:37.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:25:37.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:25:37.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:25:37.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046003240000000003 2020-11-12T17:25:37.068 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.068 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.068 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.069 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:44506 4.9 e91/69 4:9544fab5:::benchmark_data_smithi036_18856_object5563:head v 91'2778, mlcod=91'2775)", 2020-11-12T17:25:37.069 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.050585+0000", 2020-11-12T17:25:37.069 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0051796389999999998, 2020-11-12T17:25:37.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005303393, 2020-11-12T17:25:37.070 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.070 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:37.070 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050585+0000", 2020-11-12T17:25:37.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050585+0000", 2020-11-12T17:25:37.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:37.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050558+0000", 2020-11-12T17:25:37.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010796 2020-11-12T17:25:37.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050666+0000", 2020-11-12T17:25:37.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443918 2020-11-12T17:25:37.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052110+0000", 2020-11-12T17:25:37.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1764e-05 2020-11-12T17:25:37.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052122+0000", 2020-11-12T17:25:37.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7552999999999993e-05 2020-11-12T17:25:37.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052209+0000", 2020-11-12T17:25:37.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8062000000000003e-05 2020-11-12T17:25:37.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052247+0000", 2020-11-12T17:25:37.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001662485 2020-11-12T17:25:37.077 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.077 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.077 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.078 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:44507 4.9 e91/69 4:9544fab5:::benchmark_data_smithi036_18856_object5563:head v 91'2779, mlcod=91'2775)", 2020-11-12T17:25:37.078 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.050758+0000", 2020-11-12T17:25:37.078 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0050062850000000001, 2020-11-12T17:25:37.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052690569999999997, 2020-11-12T17:25:37.078 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.078 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:37.078 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050758+0000", 2020-11-12T17:25:37.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050758+0000", 2020-11-12T17:25:37.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999552 2020-11-12T17:25:37.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050713+0000", 2020-11-12T17:25:37.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015782900000000001 2020-11-12T17:25:37.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050871+0000", 2020-11-12T17:25:37.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012856269999999999 2020-11-12T17:25:37.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052157+0000", 2020-11-12T17:25:37.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.96e-06 2020-11-12T17:25:37.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052165+0000", 2020-11-12T17:25:37.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002117879 2020-11-12T17:25:37.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.054283+0000", 2020-11-12T17:25:37.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1745e-05 2020-11-12T17:25:37.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.054334+0000", 2020-11-12T17:25:37.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035763679999999999 2020-11-12T17:25:37.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.085 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.085 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.085 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:44508 4.9 e91/69 4:9544fab5:::benchmark_data_smithi036_18856_object5563:head v 91'2780, mlcod=91'2775)", 2020-11-12T17:25:37.085 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.050959+0000", 2020-11-12T17:25:37.085 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0048053219999999999, 2020-11-12T17:25:37.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052192239999999997, 2020-11-12T17:25:37.086 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.086 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:37.086 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050959+0000", 2020-11-12T17:25:37.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050959+0000", 2020-11-12T17:25:37.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:37.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.050910+0000", 2020-11-12T17:25:37.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000156334 2020-11-12T17:25:37.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051066+0000", 2020-11-12T17:25:37.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011566409999999999 2020-11-12T17:25:37.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052223+0000", 2020-11-12T17:25:37.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.72e-06 2020-11-12T17:25:37.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052229+0000", 2020-11-12T17:25:37.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036921060000000001 2020-11-12T17:25:37.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.055921+0000", 2020-11-12T17:25:37.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3921000000000002e-05 2020-11-12T17:25:37.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.055965+0000", 2020-11-12T17:25:37.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050061999999999997 2020-11-12T17:25:37.092 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.092 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.092 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.093 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:44509 4.9 e91/69)", 2020-11-12T17:25:37.093 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.051265+0000", 2020-11-12T17:25:37.093 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0044998460000000001, 2020-11-12T17:25:37.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050348420000000003, 2020-11-12T17:25:37.093 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.094 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:37.094 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051265+0000", 2020-11-12T17:25:37.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051265+0000", 2020-11-12T17:25:37.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9998345 2020-11-12T17:25:37.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051099+0000", 2020-11-12T17:25:37.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027616199999999999 2020-11-12T17:25:37.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051375+0000", 2020-11-12T17:25:37.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00087320300000000002 2020-11-12T17:25:37.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052248+0000", 2020-11-12T17:25:37.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9599999999999997e-06 2020-11-12T17:25:37.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052254+0000", 2020-11-12T17:25:37.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00098985299999999996 2020-11-12T17:25:37.098 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.098 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.098 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.099 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:44510 4.9 e91/69)", 2020-11-12T17:25:37.099 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.051455+0000", 2020-11-12T17:25:37.099 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0043094240000000001, 2020-11-12T17:25:37.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.004948516, 2020-11-12T17:25:37.099 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.100 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:37.100 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051455+0000", 2020-11-12T17:25:37.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051455+0000", 2020-11-12T17:25:37.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:37.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051412+0000", 2020-11-12T17:25:37.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019803400000000001 2020-11-12T17:25:37.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051610+0000", 2020-11-12T17:25:37.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00066208499999999997 2020-11-12T17:25:37.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052272+0000", 2020-11-12T17:25:37.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6340000000000003e-06 2020-11-12T17:25:37.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052279+0000", 2020-11-12T17:25:37.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00082386099999999995 2020-11-12T17:25:37.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.104 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.105 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.105 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:44511 4.9 e91/69)", 2020-11-12T17:25:37.105 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.051692+0000", 2020-11-12T17:25:37.105 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0040724180000000004, 2020-11-12T17:25:37.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048355819999999997, 2020-11-12T17:25:37.106 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.106 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:37.106 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051692+0000", 2020-11-12T17:25:37.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051692+0000", 2020-11-12T17:25:37.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999552 2020-11-12T17:25:37.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051647+0000", 2020-11-12T17:25:37.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145544 2020-11-12T17:25:37.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051793+0000", 2020-11-12T17:25:37.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00050298300000000003 2020-11-12T17:25:37.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052296+0000", 2020-11-12T17:25:37.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8440000000000003e-06 2020-11-12T17:25:37.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052301+0000", 2020-11-12T17:25:37.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00060939700000000002 2020-11-12T17:25:37.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.112 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.112 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.112 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:44512 4.9 e91/69)", 2020-11-12T17:25:37.112 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.051917+0000", 2020-11-12T17:25:37.112 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0038470739999999998, 2020-11-12T17:25:37.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047133660000000001, 2020-11-12T17:25:37.113 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.113 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:37.113 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051917+0000", 2020-11-12T17:25:37.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051917+0000", 2020-11-12T17:25:37.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999958 2020-11-12T17:25:37.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.051875+0000", 2020-11-12T17:25:37.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014412600000000001 2020-11-12T17:25:37.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052019+0000", 2020-11-12T17:25:37.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000302801 2020-11-12T17:25:37.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052322+0000", 2020-11-12T17:25:37.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8080000000000001e-06 2020-11-12T17:25:37.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.052328+0000", 2020-11-12T17:25:37.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041060100000000002 2020-11-12T17:25:37.117 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.117 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.118 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.118 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:25:37.118 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:25:37.118 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.26829782800000002, 2020-11-12T17:25:37.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26928821400000003, 2020-11-12T17:25:37.119 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.119 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:37.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.120 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:25:37.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.120 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:25:37.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:25:37.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:37.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:25:37.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:25:37.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:25:37.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:25:37.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:25:37.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:25:37.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:25:37.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:25:37.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:25:37.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:25:37.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:25:37.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:25:37.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:37.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:25:37.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:25:37.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:25:37.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080941120000000005 2020-11-12T17:25:37.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.127 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.127 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:25:37.127 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 9 2020-11-12T17:25:37.127 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:37.129 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:37.130 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:37.126+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:37.229 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:37.226+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:37.301 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:37.302 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:37.302 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:37.302 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:37.302 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:37.313 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:37.333 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:37.326+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:37.432 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:37.426+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:37.441 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:37.441 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:37.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:37.442 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:37.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.442 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:37.442 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:37.443 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.01809993000001, 2020-11-12T17:25:37.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:25:37.443 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.443 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.444 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.444 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:37.444 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:37.444 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:25:37.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.444 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:37.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:37.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:25:37.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:25:37.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:25:37.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:25:37.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:25:37.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:25:37.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:25:37.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:25:37.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:25:37.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:25:37.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:25:37.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:25:37.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:25:37.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:25:37.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:25:37.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:25:37.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:25:37.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:25:37.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:25:37.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:25:37.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:25:37.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:25:37.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:25:37.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.454 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.455 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:25:37.455 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:37.455 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.011155868, 2020-11-12T17:25:37.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:25:37.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.455 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:37.456 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:37.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:37.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:37.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:25:37.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:25:37.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:25:37.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:25:37.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:25:37.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:25:37.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:25:37.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:25:37.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:25:37.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:25:37.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:25:37.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:25:37.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:25:37.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:25:37.464 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.464 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.464 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.465 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:37.465 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:37.465 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 106.837318082, 2020-11-12T17:25:37.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:25:37.465 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.465 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:37.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:37.466 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:25:37.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.466 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:37.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:37.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:37.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:25:37.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:25:37.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:25:37.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:25:37.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:25:37.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:25:37.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:25:37.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:25:37.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:25:37.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:25:37.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:25:37.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:25:37.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:37.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:25:37.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:25:37.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:25:37.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:25:37.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:25:37.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:25:37.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:25:37.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:25:37.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:25:37.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:25:37.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.476 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.476 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:37.476 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:37.477 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.36578417299999, 2020-11-12T17:25:37.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:25:37.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.477 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:37.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:37.477 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:25:37.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.478 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:37.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:37.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:25:37.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:25:37.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:25:37.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:25:37.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:25:37.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:25:37.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:25:37.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:25:37.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:25:37.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:25:37.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:25:37.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:25:37.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:25:37.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:37.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:25:37.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:25:37.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:25:37.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:25:37.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:25:37.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:25:37.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:25:37.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:25:37.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:25:37.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:25:37.489 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.489 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.489 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.490 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:37.490 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:37.490 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.350462951, 2020-11-12T17:25:37.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:25:37.491 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.491 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:37.491 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:37.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:37.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:37.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:25:37.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:25:37.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:25:37.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:25:37.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:25:37.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:25:37.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:25:37.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:25:37.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:25:37.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:37.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:25:37.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:25:37.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:25:37.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:25:37.500 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.501 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.501 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:37.501 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:37.502 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.573612988999997, 2020-11-12T17:25:37.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:25:37.502 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.502 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.502 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.502 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:37.502 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:37.503 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:25:37.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.503 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:37.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:37.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:37.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:25:37.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:25:37.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:25:37.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:25:37.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:25:37.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:25:37.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:25:37.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:25:37.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:25:37.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:25:37.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:25:37.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:25:37.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:37.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:25:37.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:25:37.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:25:37.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:25:37.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:25:37.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:25:37.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:25:37.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:25:37.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:25:37.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:25:37.515 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.515 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.516 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.517 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:37.517 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:37.517 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 75.617166147000006, 2020-11-12T17:25:37.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:25:37.517 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.518 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.518 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.518 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:37.518 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:37.518 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:25:37.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.518 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:37.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:37.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:37.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:25:37.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:25:37.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:25:37.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:25:37.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:25:37.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:25:37.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:25:37.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:25:37.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:25:37.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:25:37.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:25:37.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:25:37.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:25:37.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:25:37.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:25:37.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:25:37.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:25:37.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:25:37.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:25:37.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:25:37.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:25:37.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:25:37.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.528 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.528 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.528 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:25:37.528 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:37.528 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 75.488232663000005, 2020-11-12T17:25:37.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:25:37.530 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.531 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.531 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:37.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:37.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:25:37.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:25:37.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:25:37.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:25:37.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:25:37.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:25:37.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:25:37.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:25:37.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:25:37.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:25:37.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:25:37.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:25:37.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:25:37.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:25:37.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:25:37.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:25:37.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:25:37.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.543 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:37.543 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:37.543 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.716214377, 2020-11-12T17:25:37.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:25:37.544 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.544 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.544 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.544 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:37.544 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:37.545 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:25:37.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.545 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:37.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:37.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:37.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:25:37.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:25:37.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:25:37.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:25:37.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:25:37.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:25:37.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:25:37.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:25:37.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:25:37.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:25:37.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:25:37.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:25:37.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:25:37.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:25:37.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:25:37.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:25:37.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:25:37.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:25:37.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:25:37.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:25:37.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:25:37.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:25:37.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.558 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.558 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:37.559 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:37.559 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.794094388999994, 2020-11-12T17:25:37.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:25:37.559 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.559 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.559 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.560 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:37.560 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:37.560 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:25:37.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.560 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:37.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:37.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:25:37.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:25:37.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:25:37.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:25:37.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:25:37.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:25:37.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:25:37.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:25:37.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:25:37.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:25:37.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:25:37.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:25:37.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:25:37.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:25:37.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:25:37.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:25:37.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:25:37.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:25:37.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:25:37.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:25:37.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:25:37.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:25:37.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:25:37.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.570 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.571 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:25:37.571 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:37.571 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.479540743000001, 2020-11-12T17:25:37.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:25:37.571 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.571 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.571 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.572 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:25:37.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.572 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:37.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:37.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:37.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:25:37.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:25:37.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:25:37.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:25:37.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:25:37.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:25:37.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:25:37.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:25:37.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:25:37.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:25:37.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:25:37.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:25:37.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:25:37.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:25:37.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:25:37.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:25:37.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:25:37.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:25:37.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:25:37.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:25:37.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:25:37.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:25:37.581 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.581 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.581 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.582 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:25:37.582 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:25:37.582 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.124855666999999, 2020-11-12T17:25:37.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:25:37.582 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.582 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.582 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.583 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.583 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.583 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:25:37.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.583 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:25:37.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:25:37.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:25:37.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:25:37.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:25:37.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:25:37.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:25:37.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:25:37.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:25:37.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:25:37.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:25:37.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:25:37.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:25:37.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:25:37.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:25:37.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:25:37.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:25:37.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:25:37.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:25:37.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:25:37.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:25:37.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:25:37.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:25:37.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:25:37.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:25:37.592 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.592 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.592 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.592 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:25:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:25:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.111678907999998, 2020-11-12T17:25:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:25:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:25:37.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:25:37.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:25:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:25:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:25:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:25:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:25:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:25:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:25:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:25:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:25:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:25:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:25:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:25:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:25:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:25:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:25:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:25:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.557597459, 2020-11-12T17:25:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:25:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:25:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:25:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:25:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:25:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:25:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:25:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:25:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:25:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:25:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:25:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:25:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:25:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:25:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:25:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:25:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:25:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:25:37.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:25:37.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:25:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:25:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:25:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:25:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:25:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:25:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:25:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:25:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:25:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:25:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.548610153, 2020-11-12T17:25:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:25:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:25:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:25:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:25:37.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:25:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:25:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:25:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:25:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:25:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:25:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:25:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:25:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:25:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:25:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:25:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:25:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:25:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:25:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:35728 4.0 4:0ba2c915:::benchmark_data_smithi036_18856_object4465:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.813819+0000", 2020-11-12T17:25:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.622769486999999, 2020-11-12T17:25:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31853714300000002, 2020-11-12T17:25:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35728 2020-11-12T17:25:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813819+0000", 2020-11-12T17:25:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813819+0000", 2020-11-12T17:25:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:25:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813780+0000", 2020-11-12T17:25:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102786 2020-11-12T17:25:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813882+0000", 2020-11-12T17:25:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2130000000000001e-05 2020-11-12T17:25:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813895+0000", 2020-11-12T17:25:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0839999999999997e-06 2020-11-12T17:25:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813901+0000", 2020-11-12T17:25:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0059487150000000003 2020-11-12T17:25:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.819849+0000", 2020-11-12T17:25:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011679 2020-11-12T17:25:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.819966+0000", 2020-11-12T17:25:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019489600000000001 2020-11-12T17:25:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.820161+0000", 2020-11-12T17:25:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017291679999999999 2020-11-12T17:25:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.821890+0000", 2020-11-12T17:25:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31039288100000001 2020-11-12T17:25:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132283+0000", 2020-11-12T17:25:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5061000000000002e-05 2020-11-12T17:25:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132318+0000", 2020-11-12T17:25:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7722000000000002e-05 2020-11-12T17:25:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132356+0000", 2020-11-12T17:25:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31853714300000002 2020-11-12T17:25:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:25:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.5306828389999998, 2020-11-12T17:25:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:25:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:25:37.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.632 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:37.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:37.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:25:37.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:25:37.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:25:37.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:25:37.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:25:37.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:25:37.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:25:37.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:25:37.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:25:37.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:25:37.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:25:37.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:25:37.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:25:37.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:37.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:25:37.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:25:37.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:25:37.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:25:37.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:25:37.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:25:37.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:25:37.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:25:37.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:25:37.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:25:37.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.641 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.641 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:37.642 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:25:37.642 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.979639441, 2020-11-12T17:25:37.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:25:37.643 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.643 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.643 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:25:37.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.644 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:25:37.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:25:37.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:37.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:25:37.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:25:37.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:25:37.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:25:37.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:25:37.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:25:37.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:25:37.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:25:37.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:25:37.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:25:37.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:25:37.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:25:37.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:37.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:25:37.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:25:37.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:25:37.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:25:37.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:25:37.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:25:37.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:25:37.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:25:37.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:25:37.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:25:37.653 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.653 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.653 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.653 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:25:37.653 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:25:37.654 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.72824394100000001, 2020-11-12T17:25:37.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:25:37.654 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.654 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.654 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.654 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.654 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.655 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:25:37.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.655 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:25:37.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:25:37.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:37.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:25:37.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:25:37.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:25:37.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:25:37.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:25:37.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:25:37.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:25:37.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:25:37.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:25:37.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:25:37.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:25:37.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:25:37.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:37.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:25:37.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:25:37.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:25:37.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:25:37.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:25:37.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:25:37.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:25:37.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:25:37.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:25:37.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:25:37.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.664 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.664 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.664 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:25:37.664 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:25:37.664 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.64912162399999995, 2020-11-12T17:25:37.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:25:37.665 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:37.665 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:37.665 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:37.665 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:37.665 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.665 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:25:37.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.666 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:37.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:37.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:25:37.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:37.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:37.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:25:37.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:37.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:37.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:25:37.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:25:37.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:37.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:25:37.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:25:37.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:37.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:25:37.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:25:37.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:25:37.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:25:37.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:37.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:25:37.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:25:37.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:37.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:25:37.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:25:37.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:37.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:25:37.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:25:37.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:37.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:25:37.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:25:37.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:37.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:25:37.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:25:37.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:37.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:25:37.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:25:37.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:37.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:37.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:37.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:25:37.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:25:37.674 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.674 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.674 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.675 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:37.675 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:37.675 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:37.676 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:37.674+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:37.677 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:37.777 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:37.774+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:37.811 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:45165 4.5 e92/69 4:a96944f5:::benchmark_data_smithi036_18856_object5645:head v 92'2957, mlcod=92'2951)", 2020-11-12T17:25:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.804408+0000", 2020-11-12T17:25:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0069465610000000004, 2020-11-12T17:25:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0069759560000000002, 2020-11-12T17:25:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804408+0000", 2020-11-12T17:25:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804408+0000", 2020-11-12T17:25:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999989 2020-11-12T17:25:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804397+0000", 2020-11-12T17:25:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8055000000000001e-05 2020-11-12T17:25:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804435+0000", 2020-11-12T17:25:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019414599999999999 2020-11-12T17:25:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804629+0000", 2020-11-12T17:25:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1259999999999998e-06 2020-11-12T17:25:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804632+0000", 2020-11-12T17:25:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003767711 2020-11-12T17:25:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.808400+0000", 2020-11-12T17:25:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9805000000000001e-05 2020-11-12T17:25:37.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:37.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.808420+0000", 2020-11-12T17:25:37.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040118979999999999 2020-11-12T17:25:37.818 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.818 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.819 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.819 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:45166 4.5 e92/69 4:a96944f5:::benchmark_data_smithi036_18856_object5645:head v 92'2958, mlcod=92'2951)", 2020-11-12T17:25:37.819 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.804455+0000", 2020-11-12T17:25:37.819 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.006899067, 2020-11-12T17:25:37.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0070024290000000001, 2020-11-12T17:25:37.819 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804455+0000", 2020-11-12T17:25:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804455+0000", 2020-11-12T17:25:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999886 2020-11-12T17:25:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804444+0000", 2020-11-12T17:25:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8911000000000001e-05 2020-11-12T17:25:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804483+0000", 2020-11-12T17:25:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000155883 2020-11-12T17:25:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804639+0000", 2020-11-12T17:25:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9860000000000001e-06 2020-11-12T17:25:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804641+0000", 2020-11-12T17:25:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004930584 2020-11-12T17:25:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809571+0000", 2020-11-12T17:25:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.156e-05 2020-11-12T17:25:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809593+0000", 2020-11-12T17:25:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0051375250000000004 2020-11-12T17:25:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.826 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:45167 4.5 e92/69 4:a96944f5:::benchmark_data_smithi036_18856_object5645:head v 92'2959, mlcod=92'2951)", 2020-11-12T17:25:37.826 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.804503+0000", 2020-11-12T17:25:37.826 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0068512499999999997, 2020-11-12T17:25:37.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0070297379999999998, 2020-11-12T17:25:37.826 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.826 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:37.826 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804503+0000", 2020-11-12T17:25:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804503+0000", 2020-11-12T17:25:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804491+0000", 2020-11-12T17:25:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1513e-05 2020-11-12T17:25:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804533+0000", 2020-11-12T17:25:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112891 2020-11-12T17:25:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804646+0000", 2020-11-12T17:25:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6470000000000001e-06 2020-11-12T17:25:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.804647+0000", 2020-11-12T17:25:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0060026020000000001 2020-11-12T17:25:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:37.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.810650+0000", 2020-11-12T17:25:37.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1929e-05 2020-11-12T17:25:37.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:37.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.810672+0000", 2020-11-12T17:25:37.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0061686359999999999 2020-11-12T17:25:37.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.832 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.832 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:45168 4.5 e92/69)", 2020-11-12T17:25:37.833 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.805442+0000", 2020-11-12T17:25:37.833 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0059124269999999996, 2020-11-12T17:25:37.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0061244489999999997, 2020-11-12T17:25:37.833 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.833 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:37.833 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.805442+0000", 2020-11-12T17:25:37.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.805442+0000", 2020-11-12T17:25:37.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:25:37.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.805426+0000", 2020-11-12T17:25:37.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6260999999999995e-05 2020-11-12T17:25:37.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.805492+0000", 2020-11-12T17:25:37.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.066e-05 2020-11-12T17:25:37.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.805533+0000", 2020-11-12T17:25:37.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4119999999999998e-06 2020-11-12T17:25:37.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.805539+0000", 2020-11-12T17:25:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7081000000000001e-05 2020-11-12T17:25:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.838 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:45172 4.9 4:990d5424:::benchmark_data_smithi036_18856_object5646:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:25:37.838 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.805981+0000", 2020-11-12T17:25:37.838 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0053737539999999997, 2020-11-12T17:25:37.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056193320000000003, 2020-11-12T17:25:37.838 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.839 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:37.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:37.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:37.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.839 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 45172 2020-11-12T17:25:37.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.839 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.805981+0000", 2020-11-12T17:25:37.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.805981+0000", 2020-11-12T17:25:37.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:25:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.805947+0000", 2020-11-12T17:25:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001013 2020-11-12T17:25:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806049+0000", 2020-11-12T17:25:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2965999999999999e-05 2020-11-12T17:25:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806062+0000", 2020-11-12T17:25:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:25:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806068+0000", 2020-11-12T17:25:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1396999999999997e-05 2020-11-12T17:25:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806110+0000", 2020-11-12T17:25:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3598999999999997e-05 2020-11-12T17:25:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806193+0000", 2020-11-12T17:25:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013691300000000001 2020-11-12T17:25:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806330+0000", 2020-11-12T17:25:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045332920000000004 2020-11-12T17:25:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.810863+0000", 2020-11-12T17:25:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048827510000000003 2020-11-12T17:25:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:45173 4.9 4:990d5424:::benchmark_data_smithi036_18856_object5646:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:25:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.806125+0000", 2020-11-12T17:25:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0052293440000000004, 2020-11-12T17:25:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055584650000000003, 2020-11-12T17:25:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 45173 2020-11-12T17:25:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806125+0000", 2020-11-12T17:25:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806125+0000", 2020-11-12T17:25:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806093+0000", 2020-11-12T17:25:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0305999999999999e-05 2020-11-12T17:25:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806183+0000", 2020-11-12T17:25:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2235000000000001e-05 2020-11-12T17:25:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806196+0000", 2020-11-12T17:25:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6960000000000002e-06 2020-11-12T17:25:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806201+0000", 2020-11-12T17:25:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001476857 2020-11-12T17:25:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.807678+0000", 2020-11-12T17:25:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5871000000000004e-05 2020-11-12T17:25:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.807774+0000", 2020-11-12T17:25:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016755900000000001 2020-11-12T17:25:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.807942+0000", 2020-11-12T17:25:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001816458 2020-11-12T17:25:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:45174 4.9 4:990d5424:::benchmark_data_smithi036_18856_object5646:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:25:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.806900+0000", 2020-11-12T17:25:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.004454698, 2020-11-12T17:25:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048541640000000002, 2020-11-12T17:25:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 45174 2020-11-12T17:25:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806900+0000", 2020-11-12T17:25:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806900+0000", 2020-11-12T17:25:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806878+0000", 2020-11-12T17:25:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6378999999999997e-05 2020-11-12T17:25:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806934+0000", 2020-11-12T17:25:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2560000000000002e-06 2020-11-12T17:25:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806942+0000", 2020-11-12T17:25:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4959999999999998e-06 2020-11-12T17:25:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.806947+0000", 2020-11-12T17:25:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022507019999999998 2020-11-12T17:25:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809198+0000", 2020-11-12T17:25:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2862999999999995e-05 2020-11-12T17:25:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809291+0000", 2020-11-12T17:25:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000182358 2020-11-12T17:25:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809473+0000", 2020-11-12T17:25:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025731489999999998 2020-11-12T17:25:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:45175 4.9 4:990d5424:::benchmark_data_smithi036_18856_object5646:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:25:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.809159+0000", 2020-11-12T17:25:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0021959029999999999, 2020-11-12T17:25:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026816679999999999, 2020-11-12T17:25:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 45175 2020-11-12T17:25:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809159+0000", 2020-11-12T17:25:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809159+0000", 2020-11-12T17:25:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809132+0000", 2020-11-12T17:25:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0863000000000002e-05 2020-11-12T17:25:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809213+0000", 2020-11-12T17:25:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3067999999999999e-05 2020-11-12T17:25:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809226+0000", 2020-11-12T17:25:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3219999999999998e-06 2020-11-12T17:25:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.809232+0000", 2020-11-12T17:25:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018875210000000001 2020-11-12T17:25:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.811120+0000", 2020-11-12T17:25:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010114499999999999 2020-11-12T17:25:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.811221+0000", 2020-11-12T17:25:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014239400000000001 2020-11-12T17:25:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.811364+0000", 2020-11-12T17:25:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00220498 2020-11-12T17:25:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:45176 4.9 4.242ab099 (undecoded) ondisk+write+known_if_redirected e92)", 2020-11-12T17:25:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.810235+0000", 2020-11-12T17:25:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0011191249999999999, 2020-11-12T17:25:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001681409, 2020-11-12T17:25:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 45176 2020-11-12T17:25:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.810235+0000", 2020-11-12T17:25:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.810235+0000", 2020-11-12T17:25:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:25:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.810203+0000", 2020-11-12T17:25:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9981000000000005e-05 2020-11-12T17:25:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.810293+0000", 2020-11-12T17:25:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2598e-05 2020-11-12T17:25:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.810306+0000", 2020-11-12T17:25:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4069999999999998e-06 2020-11-12T17:25:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.810312+0000", 2020-11-12T17:25:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6790000000000002e-05 2020-11-12T17:25:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:45160 4.1 4:85e373fe:::benchmark_data_smithi036_18856_object5644:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:25:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.792192+0000", 2020-11-12T17:25:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.019162284000000002, 2020-11-12T17:25:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.019759848, 2020-11-12T17:25:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 45160 2020-11-12T17:25:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.792192+0000", 2020-11-12T17:25:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.792192+0000", 2020-11-12T17:25:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.792161+0000", 2020-11-12T17:25:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4278999999999996e-05 2020-11-12T17:25:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.792256+0000", 2020-11-12T17:25:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2921e-05 2020-11-12T17:25:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.792269+0000", 2020-11-12T17:25:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8859999999999998e-06 2020-11-12T17:25:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.792275+0000", 2020-11-12T17:25:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029397199999999998 2020-11-12T17:25:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.795215+0000", 2020-11-12T17:25:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0492e-05 2020-11-12T17:25:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.795306+0000", 2020-11-12T17:25:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166281 2020-11-12T17:25:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.795472+0000", 2020-11-12T17:25:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019283810000000001 2020-11-12T17:25:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.797400+0000", 2020-11-12T17:25:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052081200000000001 2020-11-12T17:25:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 10 2020-11-12T17:25:37.887 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:37.889 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:37.886+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:37.889 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:37.931 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 46 16 45292 45276 7.68879 6.8125 0.0117436 0.0162414 2020-11-12T17:25:37.990 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:37.986+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:38.055 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:38.055 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:38.056 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:38.056 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:38.056 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:38.067 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:38.108 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:38.106+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:38.192 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:38.186+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:38.227 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:38.228 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:38.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:38.228 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:38.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.228 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:38.228 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:38.228 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.46738652799999, 2020-11-12T17:25:38.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:25:38.229 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.229 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.229 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.229 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:38.229 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:38.229 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:25:38.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.230 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:38.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:38.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:25:38.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:25:38.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:25:38.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:25:38.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:25:38.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:25:38.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:25:38.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:25:38.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:25:38.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:25:38.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:25:38.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:25:38.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:25:38.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:38.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:25:38.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:25:38.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:25:38.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:25:38.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:25:38.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:25:38.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:25:38.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:25:38.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:25:38.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:25:38.242 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.242 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.243 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.243 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:25:38.243 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:38.243 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.46058767700001, 2020-11-12T17:25:38.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:25:38.244 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.244 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.244 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:38.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:38.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:38.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:25:38.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:25:38.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:25:38.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:25:38.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:25:38.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:25:38.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:25:38.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:25:38.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:25:38.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:25:38.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:25:38.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:25:38.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:25:38.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:25:38.250 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.250 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.250 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.251 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:38.251 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:38.251 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 147.53966882899999, 2020-11-12T17:25:38.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:25:38.251 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.252 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.252 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.252 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:38.252 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:38.252 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:25:38.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.253 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:38.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:38.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:38.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:25:38.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:25:38.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:25:38.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:25:38.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:25:38.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:25:38.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:25:38.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:25:38.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:25:38.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:25:38.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:25:38.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:25:38.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:38.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:25:38.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:25:38.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:25:38.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:25:38.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:25:38.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:25:38.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:25:38.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:25:38.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:25:38.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:25:38.264 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.264 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.264 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.264 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:38.264 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:38.264 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 147.53950392600001, 2020-11-12T17:25:38.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:25:38.265 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.265 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.265 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.265 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:38.265 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:38.265 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:25:38.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.266 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:38.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:38.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:38.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:25:38.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:25:38.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:25:38.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:25:38.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:25:38.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:25:38.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:25:38.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:25:38.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:25:38.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:25:38.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:25:38.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:25:38.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:38.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:25:38.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:25:38.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:25:38.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:25:38.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:25:38.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:25:38.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:25:38.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:25:38.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:25:38.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:25:38.274 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.274 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.275 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.275 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5879 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:38.275 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:38.275 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 147.53534069200001, 2020-11-12T17:25:38.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001, 2020-11-12T17:25:38.275 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.276 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.276 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:38.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690876+0000", 2020-11-12T17:25:38.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999623 2020-11-12T17:25:38.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690838+0000", 2020-11-12T17:25:38.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7706000000000004e-05 2020-11-12T17:25:38.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690926+0000", 2020-11-12T17:25:38.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26752739599999997 2020-11-12T17:25:38.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958453+0000", 2020-11-12T17:25:38.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.097e-06 2020-11-12T17:25:38.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958460+0000", 2020-11-12T17:25:38.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7271000000000001e-05 2020-11-12T17:25:38.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958518+0000", 2020-11-12T17:25:38.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0334e-05 2020-11-12T17:25:38.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958528+0000", 2020-11-12T17:25:38.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001562 2020-11-12T17:25:38.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958684+0000", 2020-11-12T17:25:38.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26780823100000001 2020-11-12T17:25:38.282 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.282 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.282 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.282 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:38.282 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:38.283 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 147.53402385699999, 2020-11-12T17:25:38.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:25:38.283 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.283 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.283 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:38.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:38.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:38.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:25:38.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:25:38.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:25:38.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:25:38.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:25:38.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:25:38.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:25:38.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:25:38.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:25:38.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:25:38.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:25:38.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:25:38.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:25:38.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:25:38.289 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.289 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.289 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.290 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:25:38.290 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:38.290 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 139.343902257, 2020-11-12T17:25:38.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:25:38.290 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.290 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.291 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.291 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:38.291 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:38.291 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:25:38.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.291 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:38.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:38.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:25:38.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:25:38.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:25:38.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:25:38.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:25:38.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:25:38.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:25:38.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:25:38.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:25:38.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:25:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:25:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:25:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:25:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:25:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:25:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:25:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:25:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:25:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:25:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:25:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:25:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:25:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:25:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:25:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 139.336658548, 2020-11-12T17:25:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:25:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:25:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:25:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:25:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:25:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:25:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:25:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:25:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:25:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:25:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:25:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:25:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:25:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:25:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:25:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 104.233483088, 2020-11-12T17:25:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:25:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:25:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:25:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:25:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:25:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:25:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:25:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:25:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:25:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:25:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:25:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:25:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:25:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:25:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:25:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:25:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:25:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:25:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:25:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:25:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:25:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:25:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:25:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:25:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:25:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 104.22582427899999, 2020-11-12T17:25:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:25:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:25:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:25:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:25:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:25:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:25:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:25:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:25:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:25:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:25:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:25:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:25:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:25:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:25:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:25:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:25:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.340569174000002, 2020-11-12T17:25:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:25:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:25:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:25:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:25:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:25:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:25:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:25:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:25:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:25:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:25:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:25:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:25:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:25:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:25:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:25:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:304 4.b e71/69 4:d3839b57:::benchmark_data_smithi036_18856_object37:head v 71'32, mlcod=71'28)", 2020-11-12T17:25:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.081913131, 2020-11-12T17:25:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998, 2020-11-12T17:25:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9998965 2020-11-12T17:25:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144200+0000", 2020-11-12T17:25:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166613 2020-11-12T17:25:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144366+0000", 2020-11-12T17:25:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.282020573 2020-11-12T17:25:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426387+0000", 2020-11-12T17:25:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1779999999999996e-06 2020-11-12T17:25:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426391+0000", 2020-11-12T17:25:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7170999999999999e-05 2020-11-12T17:25:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426448+0000", 2020-11-12T17:25:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9868e-05 2020-11-12T17:25:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426468+0000", 2020-11-12T17:25:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036033319999999999 2020-11-12T17:25:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430072+0000", 2020-11-12T17:25:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6007000000000001e-05 2020-11-12T17:25:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430128+0000", 2020-11-12T17:25:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998 2020-11-12T17:25:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:25:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.315299907, 2020-11-12T17:25:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:25:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:25:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:25:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:25:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:25:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:25:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:25:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:25:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:25:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:25:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:25:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:25:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:25:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:25:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:25:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:25:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:25:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:25:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:27264 4.1 4:8cfa79b8:::benchmark_data_smithi036_18856_object3407:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e81)", 2020-11-12T17:25:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:17.300229+0000", 2020-11-12T17:25:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.925987863, 2020-11-12T17:25:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29760083700000001, 2020-11-12T17:25:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 27264 2020-11-12T17:25:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300229+0000", 2020-11-12T17:25:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300229+0000", 2020-11-12T17:25:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999958 2020-11-12T17:25:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300187+0000", 2020-11-12T17:25:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101628 2020-11-12T17:25:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300289+0000", 2020-11-12T17:25:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4150000000000005e-06 2020-11-12T17:25:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300298+0000", 2020-11-12T17:25:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.998e-06 2020-11-12T17:25:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300304+0000", 2020-11-12T17:25:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015043999999999999 2020-11-12T17:25:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.301808+0000", 2020-11-12T17:25:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013547 2020-11-12T17:25:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.301944+0000", 2020-11-12T17:25:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00092783000000000004 2020-11-12T17:25:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.302872+0000", 2020-11-12T17:25:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001891895 2020-11-12T17:25:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304764+0000", 2020-11-12T17:25:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29299214000000001 2020-11-12T17:25:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597756+0000", 2020-11-12T17:25:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3123e-05 2020-11-12T17:25:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597799+0000", 2020-11-12T17:25:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0700000000000001e-05 2020-11-12T17:25:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597830+0000", 2020-11-12T17:25:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29760083700000001 2020-11-12T17:25:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44206 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.6496174240000001, 2020-11-12T17:25:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002, 2020-11-12T17:25:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44206 2020-11-12T17:25:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:25:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576576+0000", 2020-11-12T17:25:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1733e-05 2020-11-12T17:25:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576637+0000", 2020-11-12T17:25:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3419e-05 2020-11-12T17:25:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576651+0000", 2020-11-12T17:25:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0509999999999996e-06 2020-11-12T17:25:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576656+0000", 2020-11-12T17:25:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9773e-05 2020-11-12T17:25:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576696+0000", 2020-11-12T17:25:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2999999999999997e-05 2020-11-12T17:25:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576789+0000", 2020-11-12T17:25:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137916 2020-11-12T17:25:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576927+0000", 2020-11-12T17:25:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027075860000000001 2020-11-12T17:25:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579634+0000", 2020-11-12T17:25:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.333427529 2020-11-12T17:25:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913062+0000", 2020-11-12T17:25:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2707000000000002e-05 2020-11-12T17:25:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913114+0000", 2020-11-12T17:25:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8039e-05 2020-11-12T17:25:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913152+0000", 2020-11-12T17:25:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002 2020-11-12T17:25:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.649458892, 2020-11-12T17:25:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:25:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:25:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:25:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:25:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:25:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:25:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:25:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:25:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:25:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:25:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:25:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:25:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:25:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:25:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:25:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:25:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:25:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:25:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:25:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:25:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:25:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:25:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:25:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:25:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:25:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.646217563, 2020-11-12T17:25:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:25:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:25:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:25:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:25:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:25:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:25:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:25:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:25:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:25:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:25:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:25:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:25:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:25:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:25:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:25:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:25:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:25:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:25:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:25:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:25:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:25:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:25:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:25:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:25:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44206 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.581565+0000", 2020-11-12T17:25:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.6446513629999999, 2020-11-12T17:25:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33159236600000003, 2020-11-12T17:25:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581565+0000", 2020-11-12T17:25:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581565+0000", 2020-11-12T17:25:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581541+0000", 2020-11-12T17:25:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0001999999999999e-05 2020-11-12T17:25:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581601+0000", 2020-11-12T17:25:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33139100900000001 2020-11-12T17:25:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.912992+0000", 2020-11-12T17:25:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.391e-06 2020-11-12T17:25:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.912997+0000", 2020-11-12T17:25:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6869999999999997e-05 2020-11-12T17:25:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913044+0000", 2020-11-12T17:25:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1580000000000005e-06 2020-11-12T17:25:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913052+0000", 2020-11-12T17:25:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105784 2020-11-12T17:25:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913158+0000", 2020-11-12T17:25:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33159236600000003 2020-11-12T17:25:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44207 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.582601+0000", 2020-11-12T17:25:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.643615284, 2020-11-12T17:25:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33232504899999998, 2020-11-12T17:25:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582601+0000", 2020-11-12T17:25:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582601+0000", 2020-11-12T17:25:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:25:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582580+0000", 2020-11-12T17:25:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3579999999999999e-05 2020-11-12T17:25:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582634+0000", 2020-11-12T17:25:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33216079100000001 2020-11-12T17:25:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914795+0000", 2020-11-12T17:25:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1170000000000003e-06 2020-11-12T17:25:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914800+0000", 2020-11-12T17:25:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6638999999999999e-05 2020-11-12T17:25:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914836+0000", 2020-11-12T17:25:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2330000000000003e-06 2020-11-12T17:25:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914843+0000", 2020-11-12T17:25:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3751000000000005e-05 2020-11-12T17:25:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914926+0000", 2020-11-12T17:25:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33232504899999998 2020-11-12T17:25:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44208 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.643032973, 2020-11-12T17:25:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003, 2020-11-12T17:25:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583142+0000", 2020-11-12T17:25:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9876000000000004e-05 2020-11-12T17:25:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583242+0000", 2020-11-12T17:25:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33634110099999998 2020-11-12T17:25:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919583+0000", 2020-11-12T17:25:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3000000000000001e-06 2020-11-12T17:25:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919588+0000", 2020-11-12T17:25:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:25:38.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919642+0000", 2020-11-12T17:25:38.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3859999999999996e-06 2020-11-12T17:25:38.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919652+0000", 2020-11-12T17:25:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013921800000000001 2020-11-12T17:25:38.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919791+0000", 2020-11-12T17:25:38.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003 2020-11-12T17:25:38.418 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.418 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.419 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.419 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.419 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.419 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:38.420 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:38.423 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:38.423 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:38.416+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:38.523 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:38.516+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:38.594 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:38.595 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:38.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.595 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:45798 4.1 e92/69 4:85fcd2dc:::benchmark_data_smithi036_18856_object5724:head v 92'3094, mlcod=92'3090)", 2020-11-12T17:25:38.595 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:38.592512+0000", 2020-11-12T17:25:38.595 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0025122199999999999, 2020-11-12T17:25:38.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002536642, 2020-11-12T17:25:38.596 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.596 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.597 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.592512+0000", 2020-11-12T17:25:38.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.592512+0000", 2020-11-12T17:25:38.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:38.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.592489+0000", 2020-11-12T17:25:38.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3720999999999993e-05 2020-11-12T17:25:38.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.592573+0000", 2020-11-12T17:25:38.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000118886 2020-11-12T17:25:38.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.592692+0000", 2020-11-12T17:25:38.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1680000000000001e-06 2020-11-12T17:25:38.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.592698+0000", 2020-11-12T17:25:38.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0343999999999999e-05 2020-11-12T17:25:38.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.592738+0000", 2020-11-12T17:25:38.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4664e-05 2020-11-12T17:25:38.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.592763+0000", 2020-11-12T17:25:38.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025097200000000002 2020-11-12T17:25:38.602 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.602 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.602 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.603 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:45799 4.1 e92/69 4:85fcd2dc:::benchmark_data_smithi036_18856_object5724:head v 92'3095, mlcod=92'3090)", 2020-11-12T17:25:38.603 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:38.593949+0000", 2020-11-12T17:25:38.603 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00107569, 2020-11-12T17:25:38.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011781630000000001, 2020-11-12T17:25:38.603 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.604 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.604 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.593949+0000", 2020-11-12T17:25:38.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.593949+0000", 2020-11-12T17:25:38.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:25:38.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.593936+0000", 2020-11-12T17:25:38.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4826000000000001e-05 2020-11-12T17:25:38.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.593980+0000", 2020-11-12T17:25:38.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5930000000000003e-05 2020-11-12T17:25:38.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.594016+0000", 2020-11-12T17:25:38.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4870000000000004e-06 2020-11-12T17:25:38.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.594021+0000", 2020-11-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8105000000000002e-05 2020-11-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.594059+0000", 2020-11-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.732e-05 2020-11-12T17:25:38.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.594076+0000", 2020-11-12T17:25:38.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753600000000001 2020-11-12T17:25:38.609 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.609 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.609 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.610 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:45648 4.8 4:10cae61a:::benchmark_data_smithi036_18856_object5705:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:25:38.610 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:38.406614+0000", 2020-11-12T17:25:38.610 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.18841055700000001, 2020-11-12T17:25:38.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18857559099999999, 2020-11-12T17:25:38.610 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.610 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:38.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:38.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:38.611 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 45648 2020-11-12T17:25:38.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.611 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.406614+0000", 2020-11-12T17:25:38.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.406614+0000", 2020-11-12T17:25:38.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:25:38.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.406584+0000", 2020-11-12T17:25:38.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9294000000000003e-05 2020-11-12T17:25:38.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.406673+0000", 2020-11-12T17:25:38.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7561e-05 2020-11-12T17:25:38.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.406691+0000", 2020-11-12T17:25:38.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0750999999999999e-05 2020-11-12T17:25:38.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.406701+0000", 2020-11-12T17:25:38.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045792849999999998 2020-11-12T17:25:38.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.411281+0000", 2020-11-12T17:25:38.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2738000000000002e-05 2020-11-12T17:25:38.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.411333+0000", 2020-11-12T17:25:38.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011158900000000001 2020-11-12T17:25:38.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:38.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.411445+0000", 2020-11-12T17:25:38.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016413860000000001 2020-11-12T17:25:38.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.413086+0000", 2020-11-12T17:25:38.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064724819999999999 2020-11-12T17:25:38.618 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.618 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.618 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.619 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.619 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:38.619 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 3 2020-11-12T17:25:38.619 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:38.620 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:38.624 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:38.622+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:38.706 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:25:38.756 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:38.752+0000 7f430e4c0700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 12302) UID: 0 2020-11-12T17:25:38.759 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:38.760 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:38.761 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:38.761 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:38.761 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:38.773 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:38.798 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:38.826 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:38.820+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:38.835 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:38.874 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:38.903 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:25:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.39801287500001, 2020-11-12T17:25:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:25:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:25:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:25:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:25:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:25:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:25:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:25:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:25:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:25:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:25:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:25:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:25:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:25:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:25:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:25:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.37600330999999, 2020-11-12T17:25:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:25:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:25:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:25:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:25:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:25:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:25:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:25:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:25:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:25:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:25:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:25:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:25:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:25:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:25:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:25:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:25:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:25:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:25:38.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:25:38.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:25:38.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:25:38.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:25:38.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:25:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:25:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:25:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.372603376, 2020-11-12T17:25:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:25:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:25:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:25:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:25:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:25:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:25:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:25:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:25:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:25:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:25:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:25:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:25:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:25:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:25:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:25:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:25:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 108.896713929, 2020-11-12T17:25:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:25:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:25:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:25:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:25:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:25:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:25:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:25:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:25:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:25:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:25:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:25:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:25:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:25:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:25:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:25:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:25:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:25:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:25:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 99.064019963000007, 2020-11-12T17:25:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:25:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:25:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:25:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:25:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:25:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:25:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:25:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:25:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:25:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:25:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:25:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:25:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:25:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:25:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:25:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:25:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:25:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.956728585999997, 2020-11-12T17:25:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:25:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:25:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:25:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:25:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:25:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:25:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:25:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:25:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:25:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:25:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:25:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:25:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:25:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:25:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:25:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:25:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:25:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:25:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:25:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:25:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:25:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:25:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:25:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:25:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:25:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:59416 3.c 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 74.374333171000004, 2020-11-12T17:25:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998, 2020-11-12T17:25:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59416 2020-11-12T17:25:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527883+0000", 2020-11-12T17:25:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2643000000000002e-05 2020-11-12T17:25:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527956+0000", 2020-11-12T17:25:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:25:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527969+0000", 2020-11-12T17:25:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2689999999999996e-06 2020-11-12T17:25:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527976+0000", 2020-11-12T17:25:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043768990000000001 2020-11-12T17:25:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532353+0000", 2020-11-12T17:25:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011210299999999999 2020-11-12T17:25:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532465+0000", 2020-11-12T17:25:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017931699999999999 2020-11-12T17:25:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532644+0000", 2020-11-12T17:25:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002342341 2020-11-12T17:25:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.534986+0000", 2020-11-12T17:25:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30120883700000001 2020-11-12T17:25:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836195+0000", 2020-11-12T17:25:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0408999999999995e-05 2020-11-12T17:25:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836276+0000", 2020-11-12T17:25:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1774999999999997e-05 2020-11-12T17:25:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836337+0000", 2020-11-12T17:25:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998 2020-11-12T17:25:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:25:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 65.479627511999993, 2020-11-12T17:25:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:25:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:25:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:25:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:25:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:25:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:25:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:25:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:25:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:25:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:25:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:25:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:25:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:25:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:25:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:25:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.360617125000005, 2020-11-12T17:25:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:25:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:25:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:25:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:25:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:25:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:25:38.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:25:38.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:38.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:25:38.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:25:38.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:38.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:25:38.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:25:38.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:38.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:25:38.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:25:38.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:38.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:25:38.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:25:38.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:38.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:25:38.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:25:38.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:38.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:25:38.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:25:38.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:38.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:25:38.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:25:38.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:38.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:38.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:38.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:25:39.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:25:39.000 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.000 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.000 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.001 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:25:39.001 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:39.001 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.344479121000006, 2020-11-12T17:25:39.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:25:39.001 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.001 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:39.002 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:39.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:39.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:39.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:25:39.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:25:39.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:25:39.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:25:39.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:25:39.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:25:39.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:25:39.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:25:39.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:25:39.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:25:39.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:25:39.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:25:39.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:25:39.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:25:39.011 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.011 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.011 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.012 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:25:39.012 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:39.012 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.339751441999994, 2020-11-12T17:25:39.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:25:39.013 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.013 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:25:39.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:39.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:39.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:39.013 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:39.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.014 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:39.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:39.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:39.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:25:39.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:25:39.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:25:39.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:25:39.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:25:39.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:25:39.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:25:39.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:25:39.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:25:39.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:25:39.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:39.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:25:39.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:25:39.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:25:39.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:25:39.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.022 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.023 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:424 4.8 4:15a22128:::benchmark_data_smithi036_18856_object52:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:39.023 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:39.023 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.681721705000001, 2020-11-12T17:25:39.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002, 2020-11-12T17:25:39.023 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.023 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:39.024 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:39.024 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:39.024 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:39.024 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 424 2020-11-12T17:25:39.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.025 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:39.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:39.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:39.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220491+0000", 2020-11-12T17:25:39.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7780000000000003e-05 2020-11-12T17:25:39.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220579+0000", 2020-11-12T17:25:39.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1511e-05 2020-11-12T17:25:39.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220590+0000", 2020-11-12T17:25:39.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9410000000000004e-06 2020-11-12T17:25:39.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220596+0000", 2020-11-12T17:25:39.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027076259999999999 2020-11-12T17:25:39.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223304+0000", 2020-11-12T17:25:39.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102644 2020-11-12T17:25:39.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223406+0000", 2020-11-12T17:25:39.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017898600000000001 2020-11-12T17:25:39.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:39.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223585+0000", 2020-11-12T17:25:39.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000774389 2020-11-12T17:25:39.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:39.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224360+0000", 2020-11-12T17:25:39.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30234014999999997 2020-11-12T17:25:39.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:39.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526700+0000", 2020-11-12T17:25:39.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5360999999999999e-05 2020-11-12T17:25:39.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:39.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526775+0000", 2020-11-12T17:25:39.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6470000000000001e-05 2020-11-12T17:25:39.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526812+0000", 2020-11-12T17:25:39.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002 2020-11-12T17:25:39.036 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.036 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.036 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.036 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:424 4.8 e71/69 ondisk, result = 0)", 2020-11-12T17:25:39.037 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:39.037 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.677270166, 2020-11-12T17:25:39.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474, 2020-11-12T17:25:39.037 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.037 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:39.037 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:39.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:39.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:39.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224949+0000", 2020-11-12T17:25:39.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8579000000000003e-05 2020-11-12T17:25:39.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.225008+0000", 2020-11-12T17:25:39.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30161437000000002 2020-11-12T17:25:39.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526622+0000", 2020-11-12T17:25:39.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1900000000000003e-06 2020-11-12T17:25:39.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526628+0000", 2020-11-12T17:25:39.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8828000000000001e-05 2020-11-12T17:25:39.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526676+0000", 2020-11-12T17:25:39.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1576000000000001e-05 2020-11-12T17:25:39.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526688+0000", 2020-11-12T17:25:39.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012879999999999999 2020-11-12T17:25:39.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526817+0000", 2020-11-12T17:25:39.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474 2020-11-12T17:25:39.045 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.046 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.046 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.046 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11951 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:39.046 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:39.047 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.811251853000002, 2020-11-12T17:25:39.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998, 2020-11-12T17:25:39.047 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.047 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:39.047 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:39.048 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:39.048 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:39.048 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11951 2020-11-12T17:25:39.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.048 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:39.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:39.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:25:39.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090956+0000", 2020-11-12T17:25:39.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110012 2020-11-12T17:25:39.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091066+0000", 2020-11-12T17:25:39.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2517000000000001e-05 2020-11-12T17:25:39.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091078+0000", 2020-11-12T17:25:39.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.421e-06 2020-11-12T17:25:39.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091085+0000", 2020-11-12T17:25:39.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052388110000000003 2020-11-12T17:25:39.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096323+0000", 2020-11-12T17:25:39.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010759 2020-11-12T17:25:39.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096431+0000", 2020-11-12T17:25:39.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018636600000000001 2020-11-12T17:25:39.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:39.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096617+0000", 2020-11-12T17:25:39.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018824309999999999 2020-11-12T17:25:39.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:39.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098500+0000", 2020-11-12T17:25:39.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29523157 2020-11-12T17:25:39.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:39.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393731+0000", 2020-11-12T17:25:39.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7910999999999994e-05 2020-11-12T17:25:39.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:39.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393799+0000", 2020-11-12T17:25:39.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101962 2020-11-12T17:25:39.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393901+0000", 2020-11-12T17:25:39.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998 2020-11-12T17:25:39.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.059 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.060 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11952 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:39.061 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:39.061 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.811101032000003, 2020-11-12T17:25:39.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002, 2020-11-12T17:25:39.061 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.061 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:39.062 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:39.064 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:39.064 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:39.064 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11952 2020-11-12T17:25:39.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.064 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:39.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:39.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:39.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091107+0000", 2020-11-12T17:25:39.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011024200000000001 2020-11-12T17:25:39.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091218+0000", 2020-11-12T17:25:39.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2203e-05 2020-11-12T17:25:39.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091230+0000", 2020-11-12T17:25:39.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.694e-06 2020-11-12T17:25:39.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091236+0000", 2020-11-12T17:25:39.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076783260000000001 2020-11-12T17:25:39.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098914+0000", 2020-11-12T17:25:39.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3187000000000001e-05 2020-11-12T17:25:39.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099007+0000", 2020-11-12T17:25:39.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016888299999999999 2020-11-12T17:25:39.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:39.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099176+0000", 2020-11-12T17:25:39.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012571570000000001 2020-11-12T17:25:39.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:39.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100433+0000", 2020-11-12T17:25:39.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29596956499999999 2020-11-12T17:25:39.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:39.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396403+0000", 2020-11-12T17:25:39.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0348999999999999e-05 2020-11-12T17:25:39.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:39.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396483+0000", 2020-11-12T17:25:39.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8981000000000003e-05 2020-11-12T17:25:39.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396542+0000", 2020-11-12T17:25:39.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002 2020-11-12T17:25:39.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.075 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.076 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11951 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:39.076 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:39.076 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.803573608000001, 2020-11-12T17:25:39.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998, 2020-11-12T17:25:39.077 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.077 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:39.077 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:39.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:39.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:39.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098644+0000", 2020-11-12T17:25:39.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2123000000000001e-05 2020-11-12T17:25:39.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098706+0000", 2020-11-12T17:25:39.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.294880011 2020-11-12T17:25:39.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393586+0000", 2020-11-12T17:25:39.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:39.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393595+0000", 2020-11-12T17:25:39.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115302 2020-11-12T17:25:39.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393710+0000", 2020-11-12T17:25:39.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2968e-05 2020-11-12T17:25:39.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393723+0000", 2020-11-12T17:25:39.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018932500000000001 2020-11-12T17:25:39.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393913+0000", 2020-11-12T17:25:39.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998 2020-11-12T17:25:39.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.085 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.085 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11952 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:39.086 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:39.086 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.801473831999999, 2020-11-12T17:25:39.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999, 2020-11-12T17:25:39.086 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.086 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:39.086 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:39.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:39.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:39.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100743+0000", 2020-11-12T17:25:39.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2359000000000004e-05 2020-11-12T17:25:39.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100805+0000", 2020-11-12T17:25:39.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29550863300000002 2020-11-12T17:25:39.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396314+0000", 2020-11-12T17:25:39.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6940000000000003e-06 2020-11-12T17:25:39.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396318+0000", 2020-11-12T17:25:39.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8325999999999997e-05 2020-11-12T17:25:39.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396377+0000", 2020-11-12T17:25:39.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4015999999999999e-05 2020-11-12T17:25:39.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396391+0000", 2020-11-12T17:25:39.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015908 2020-11-12T17:25:39.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396550+0000", 2020-11-12T17:25:39.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999 2020-11-12T17:25:39.094 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.094 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.095 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.095 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:27264 4.1 e81/69 4:8cfa79b8:::benchmark_data_smithi036_18856_object3407:head v 81'1736, mlcod=81'1730)", 2020-11-12T17:25:39.095 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:39.095 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.597924040999999, 2020-11-12T17:25:39.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999, 2020-11-12T17:25:39.096 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.096 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:39.096 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:39.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:39.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:39.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304300+0000", 2020-11-12T17:25:39.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0590000000000001e-05 2020-11-12T17:25:39.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304360+0000", 2020-11-12T17:25:39.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29159615 2020-11-12T17:25:39.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595957+0000", 2020-11-12T17:25:39.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9299999999999997e-06 2020-11-12T17:25:39.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595963+0000", 2020-11-12T17:25:39.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8519000000000001e-05 2020-11-12T17:25:39.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596012+0000", 2020-11-12T17:25:39.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3053000000000001e-05 2020-11-12T17:25:39.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596035+0000", 2020-11-12T17:25:39.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001402122 2020-11-12T17:25:39.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:39.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597437+0000", 2020-11-12T17:25:39.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0948999999999997e-05 2020-11-12T17:25:39.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597478+0000", 2020-11-12T17:25:39.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999 2020-11-12T17:25:39.105 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.105 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.105 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.106 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:25:39.106 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:39.106 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.9581923750000003, 2020-11-12T17:25:39.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:25:39.106 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.107 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:39.107 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:39.107 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:39.107 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:39.107 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:25:39.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.108 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:39.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:39.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:39.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:25:39.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:25:39.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:25:39.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:25:39.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:25:39.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:25:39.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:25:39.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:25:39.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:25:39.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:25:39.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:25:39.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:25:39.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:39.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:25:39.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:25:39.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:39.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:25:39.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:25:39.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:39.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:25:39.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:25:39.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:39.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:25:39.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:25:39.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:25:39.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:25:39.126 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.127 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.127 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.128 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:25:39.128 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:39.129 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.952638554, 2020-11-12T17:25:39.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:25:39.129 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:39.129 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:39.130 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:39.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:39.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:39.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:39.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:39.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:39.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:39.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:39.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:25:39.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:25:39.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:39.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:25:39.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:25:39.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:25:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:25:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:25:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:25:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:25:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:25:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:39.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:25:39.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:25:39.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:39.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:39.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:39.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:25:39.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:25:39.138 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.138 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.138 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.138 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:39.139 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:39.139 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:39.141 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:39.141 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:39.141 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:39.142 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:39.142 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:39.142 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 47 16 46135 46119 7.66531 6.58594 0.0120959 0.0162952 2020-11-12T17:25:39.142 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:39.143 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:25:39.143 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:39.143 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:39.143 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:39.143 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:39.143 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:39.144 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:39.145 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:39.138+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:39.241 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:39.238+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:39.271 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:39.271 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:39.281 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:39.342 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:39.336+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:39.443 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:39.438+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:39.447 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:39.448 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:39.460 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:39.544 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:39.540+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:39.638 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:39.639 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:39.645 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:39.640+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:39.648 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:39.746 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:39.740+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:39.776 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:39.776 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:39.788 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:39.828 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:25:39.847 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:39.842+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:39.920 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:39.921 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:39.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 48 16 46963 46947 7.64037 6.46875 0.0173362 0.0163466 2020-11-12T17:25:39.934 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:39.948 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:39.944+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:40.049 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:40.046+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:40.060 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:40.056+0000 7f42fe1ab700 -1 osd.2 92 handle_osd_map injecting map crc failure 2020-11-12T17:25:40.103 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:40.103 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:40.116 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:25:40.159 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 7, 6] out_osds: [2, 1] dead_osds: [] live_osds: [0, 2, 3, 4, 5, 6, 7, 1] 2020-11-12T17:25:40.159 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:25:40.159 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 2, 3, 4, 5, 6, 7, 1] 2020-11-12T17:25:40.160 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-11-12T17:25:40.160 INFO:teuthology.orchestra.run:waiting for 300 2020-11-12T17:25:40.161 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:40.158+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:40.251 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:40.246+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:40.260 INFO:tasks.ceph.osd.2:Stopped 2020-11-12T17:25:40.260 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.2 2020-11-12T17:25:40.261 INFO:tasks.thrashosds.thrasher:remote for osd 2 is ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:25:40.261 INFO:teuthology.orchestra.run.smithi036:> type ceph-objectstore-tool 2020-11-12T17:25:40.262 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:40.262 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:40.266 INFO:teuthology.orchestra.run.smithi036.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2020-11-12T17:25:40.267 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op list-pgs 2020-11-12T17:25:40.272 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:25:40.352 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:40.350+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:40.451 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:40.452 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:40.454 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:40.448+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:40.463 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:25:40.555 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:40.550+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:40.618 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:40.618 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:40.629 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:40.676 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:40.672+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:40.739 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:40.740 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:40.750 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:40.757 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:40.754+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:40.839 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:40.834+0000 7f9a0b6b4700 -1 osd.5 93 handle_osd_map injecting map crc failure 2020-11-12T17:25:40.858 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:40.854+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:40.918 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:40.918 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:40.930 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:40.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 49 16 47782 47766 7.61501 6.39844 0.0287086 0.0164041 2020-11-12T17:25:40.959 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:40.954+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:41.049 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:41.049 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:41.060 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:41.056+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:41.061 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:41.145 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:41.193 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:41.188+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:41.234 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:41.234 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:41.245 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:41.288 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:41.284+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:41.323 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:41.355 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:41.363 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:41.358+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:41.393 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:41.419 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:41.419 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:41.420 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:41.420 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:41.420 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:41.431 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:41.434 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:41.469 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:41.470 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:41.464+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:41.500 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:41.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:41.537 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:41.537 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:25:41.538 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:25:41.538 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:25:41.538 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:41.539 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:41.539 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:41.539 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:41.540 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:41.541 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:41.541 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:41.564 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:41.564 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:41.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:41.565 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:41.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.565 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:41.565 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:41.565 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.141903732, 2020-11-12T17:25:41.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:25:41.566 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.566 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.566 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.566 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:41.566 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:41.566 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:25:41.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.567 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:41.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:25:41.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:25:41.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:25:41.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:25:41.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:25:41.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:25:41.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:25:41.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:25:41.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:25:41.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:25:41.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:25:41.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:25:41.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:25:41.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:25:41.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:41.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:25:41.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:25:41.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:25:41.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:25:41.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:25:41.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:25:41.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:25:41.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:25:41.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:25:41.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:25:41.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.576 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.577 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:25:41.577 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:41.577 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.13495967, 2020-11-12T17:25:41.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:25:41.577 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.577 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:41.578 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:41.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:25:41.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:41.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:25:41.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:25:41.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:25:41.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:25:41.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:25:41.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:25:41.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:25:41.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:25:41.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:25:41.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:25:41.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:25:41.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:25:41.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:25:41.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:25:41.584 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.584 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.585 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:41.585 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:41.585 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.96112188399999, 2020-11-12T17:25:41.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:25:41.586 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.586 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.586 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.586 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:41.586 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:41.586 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:25:41.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.587 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:41.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:25:41.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:41.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:25:41.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:25:41.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:25:41.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:25:41.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:25:41.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:25:41.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:25:41.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:25:41.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:25:41.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:25:41.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:25:41.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:25:41.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:41.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:25:41.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:25:41.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:25:41.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:25:41.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:25:41.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:25:41.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:25:41.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:25:41.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:25:41.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:25:41.598 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.598 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.598 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.598 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:41.599 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:41.599 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 106.48958797500001, 2020-11-12T17:25:41.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:25:41.599 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.600 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.601 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.601 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:41.601 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:41.602 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:25:41.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.602 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:41.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:25:41.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:25:41.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:25:41.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:25:41.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:25:41.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:25:41.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:25:41.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:25:41.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:25:41.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:25:41.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:25:41.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:25:41.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:25:41.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:25:41.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:41.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:25:41.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:25:41.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:25:41.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:25:41.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:25:41.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:25:41.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:25:41.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:25:41.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:25:41.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:25:41.623 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.623 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.623 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.624 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:25:41.624 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:41.624 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 106.47426675299999, 2020-11-12T17:25:41.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:25:41.624 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.624 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:41.624 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:41.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:25:41.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:41.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:25:41.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:25:41.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:25:41.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:25:41.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:25:41.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:25:41.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:25:41.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:25:41.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:25:41.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:41.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:25:41.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:25:41.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:25:41.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:25:41.633 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.633 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.633 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.633 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:25:41.633 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:41.634 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.697416790999995, 2020-11-12T17:25:41.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:25:41.634 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.634 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.634 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.634 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:41.634 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:41.635 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:25:41.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.635 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:41.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:25:41.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:41.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:25:41.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:25:41.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:25:41.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:25:41.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:25:41.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:25:41.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:25:41.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:25:41.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:25:41.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:25:41.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:25:41.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:25:41.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:25:41.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:25:41.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:25:41.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:25:41.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:25:41.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:25:41.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:25:41.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:25:41.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:25:41.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:25:41.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:25:41.645 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.645 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.645 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.645 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:41.645 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:41.645 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.740969949000004, 2020-11-12T17:25:41.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:25:41.646 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.646 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.646 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.646 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:41.646 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:41.646 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:25:41.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.647 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:41.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:25:41.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:41.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:25:41.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:25:41.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:25:41.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:25:41.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:25:41.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:25:41.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:25:41.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:25:41.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:25:41.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:25:41.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:25:41.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:25:41.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:41.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:25:41.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:25:41.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:25:41.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:25:41.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:25:41.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:25:41.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:25:41.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:25:41.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:25:41.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:25:41.656 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.656 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.656 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.656 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:25:41.656 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:41.657 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.612036465000003, 2020-11-12T17:25:41.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:25:41.657 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.657 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.657 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:41.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:25:41.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:25:41.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:25:41.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:25:41.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:25:41.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:25:41.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:25:41.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:25:41.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:25:41.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:25:41.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:25:41.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:25:41.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:25:41.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:25:41.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:25:41.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:25:41.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:25:41.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:25:41.665 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.665 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.665 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.665 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:41.666 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:41.666 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 78.840018178999998, 2020-11-12T17:25:41.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:25:41.666 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.666 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.666 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.666 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:41.667 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:41.667 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:25:41.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.667 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:41.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:25:41.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:41.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:25:41.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:25:41.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:25:41.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:25:41.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:25:41.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:25:41.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:25:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:25:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:25:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:25:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:25:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:25:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:25:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:25:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:25:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:25:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:25:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:25:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:25:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:25:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:25:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:25:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:41.677 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.917898191000006, 2020-11-12T17:25:41.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:25:41.677 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.677 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.677 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.677 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:25:41.677 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:41.677 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:25:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:25:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:25:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:25:41.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:25:41.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:25:41.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:25:41.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:25:41.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:25:41.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:25:41.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:25:41.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:25:41.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:25:41.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:25:41.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:25:41.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:41.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:25:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:25:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:25:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:25:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:25:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:25:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:25:41.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:25:41.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:25:41.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:25:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:25:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.603344544999999, 2020-11-12T17:25:41.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:25:41.689 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.689 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:41.690 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.690 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:25:41.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.690 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:25:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:25:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:25:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:25:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:25:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:25:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:25:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:25:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:25:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:25:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:25:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:25:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:25:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:25:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:25:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:25:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:25:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:25:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:25:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:25:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:25:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:25:41.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:25:41.699 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.699 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.699 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:25:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:25:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.248659469, 2020-11-12T17:25:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:25:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:41.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.701 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:25:41.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.701 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:25:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:25:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:25:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:25:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:25:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:25:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:25:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:25:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:25:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:25:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:25:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:25:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:25:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:25:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:25:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:25:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:25:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:25:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:25:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:25:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:25:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:25:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:25:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:25:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:25:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:25:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:25:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.235482709999999, 2020-11-12T17:25:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:25:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:25:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:25:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:25:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:25:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:25:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:25:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:25:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:25:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:25:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:25:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:25:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:25:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:25:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:25:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:25:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:25:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:25:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:25:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.681401261, 2020-11-12T17:25:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:25:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:25:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:25:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:25:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:25:41.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:25:41.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:25:41.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:25:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:25:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:25:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:25:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:25:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:25:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:25:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:25:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:25:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:25:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:25:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:25:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:25:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:25:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:25:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:25:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:25:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:25:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:25:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:25:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:25:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:25:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.672413955, 2020-11-12T17:25:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:25:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:25:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:25:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:25:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:25:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:25:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:25:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:25:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:25:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:25:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:25:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:25:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:25:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:25:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:25:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:25:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:25:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:25:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:25:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:35728 4.0 4:0ba2c915:::benchmark_data_smithi036_18856_object4465:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:25:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:26.813819+0000", 2020-11-12T17:25:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.746573289000001, 2020-11-12T17:25:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31853714300000002, 2020-11-12T17:25:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35728 2020-11-12T17:25:41.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.740 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813819+0000", 2020-11-12T17:25:41.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813819+0000", 2020-11-12T17:25:41.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:25:41.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813780+0000", 2020-11-12T17:25:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102786 2020-11-12T17:25:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813882+0000", 2020-11-12T17:25:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2130000000000001e-05 2020-11-12T17:25:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813895+0000", 2020-11-12T17:25:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0839999999999997e-06 2020-11-12T17:25:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.813901+0000", 2020-11-12T17:25:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0059487150000000003 2020-11-12T17:25:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.819849+0000", 2020-11-12T17:25:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011679 2020-11-12T17:25:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.819966+0000", 2020-11-12T17:25:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019489600000000001 2020-11-12T17:25:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.820161+0000", 2020-11-12T17:25:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017291679999999999 2020-11-12T17:25:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.821890+0000", 2020-11-12T17:25:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31039288100000001 2020-11-12T17:25:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132283+0000", 2020-11-12T17:25:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5061000000000002e-05 2020-11-12T17:25:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132318+0000", 2020-11-12T17:25:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7722000000000002e-05 2020-11-12T17:25:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:27.132356+0000", 2020-11-12T17:25:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31853714300000002 2020-11-12T17:25:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:25:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.6544866410000001, 2020-11-12T17:25:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:25:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:25:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:25:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:25:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:25:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:25:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:25:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:25:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:25:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:25:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:25:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:25:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:25:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:25:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:25:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:25:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:25:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:25:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:25:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:25:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:25:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:25:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:25:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:25:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:25:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:25:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:25:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.1034432430000001, 2020-11-12T17:25:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:25:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:25:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:25:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:25:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:25:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:25:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:25:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:25:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:25:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:25:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:25:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:25:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:25:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:25:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:25:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:25:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:25:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:25:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:25:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:25:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:25:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:25:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:25:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:25:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:25:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:25:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:25:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:25:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.852047743, 2020-11-12T17:25:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:25:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:25:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:25:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:25:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:25:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:25:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:25:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:25:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:25:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:25:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:25:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:25:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:25:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:25:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:25:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:25:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:25:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:25:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:25:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:25:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:25:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:25:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:25:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:25:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:25:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:25:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:25:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:25:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.7729254259999996, 2020-11-12T17:25:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:25:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:25:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:25:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:25:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:25:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:25:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:25:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:25:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:25:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:25:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:25:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:25:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:25:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:25:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:25:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:25:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:25:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:25:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:25:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:25:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:25:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:25:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:25:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:25:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:25:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:25:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:25:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:25:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:41.796 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:41.797 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:41.798 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:41.794+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:41.841 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:25:41.899 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:41.894+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:41.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 50 16 48642 48626 7.59707 6.71875 0.012492 0.0164375 2020-11-12T17:25:41.939 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:41.940 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:41.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.940 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:48646 4.1 4.3607a0e1 (undecoded) ondisk+write+known_if_redirected e94)", 2020-11-12T17:25:41.941 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.934527+0000", 2020-11-12T17:25:41.941 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.004614061, 2020-11-12T17:25:41.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046306079999999996, 2020-11-12T17:25:41.942 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:41.942 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:41.942 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:41.943 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:41.943 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.943 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 48646 2020-11-12T17:25:41.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.944 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:41.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:41.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934527+0000", 2020-11-12T17:25:41.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:41.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:41.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934527+0000", 2020-11-12T17:25:41.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:25:41.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:41.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934497+0000", 2020-11-12T17:25:41.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6013999999999993e-05 2020-11-12T17:25:41.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:41.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934583+0000", 2020-11-12T17:25:41.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1154e-05 2020-11-12T17:25:41.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:41.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934594+0000", 2020-11-12T17:25:41.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6749999999999999e-06 2020-11-12T17:25:41.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934600+0000", 2020-11-12T17:25:41.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2960999999999995e-05 2020-11-12T17:25:41.949 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.950 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:41.950 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.950 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:48647 4.1 4.3607a0e1 (undecoded) ondisk+write+known_if_redirected e94)", 2020-11-12T17:25:41.950 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.934644+0000", 2020-11-12T17:25:41.950 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00449673, 2020-11-12T17:25:41.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045702729999999997, 2020-11-12T17:25:41.951 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:41.951 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:41.951 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:41.951 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:41.951 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.952 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 48647 2020-11-12T17:25:41.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.952 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:41.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:41.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934644+0000", 2020-11-12T17:25:41.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:41.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:41.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934644+0000", 2020-11-12T17:25:41.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:41.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:41.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934618+0000", 2020-11-12T17:25:41.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6519000000000004e-05 2020-11-12T17:25:41.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:41.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934694+0000", 2020-11-12T17:25:41.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7259999999999997e-06 2020-11-12T17:25:41.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:41.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934704+0000", 2020-11-12T17:25:41.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4440000000000001e-06 2020-11-12T17:25:41.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934709+0000", 2020-11-12T17:25:41.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4225000000000003e-05 2020-11-12T17:25:41.957 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.957 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:41.957 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.957 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:48648 4.1 4.3607a0e1 (undecoded) ondisk+write+known_if_redirected e94)", 2020-11-12T17:25:41.958 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.936193+0000", 2020-11-12T17:25:41.958 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0029482169999999999, 2020-11-12T17:25:41.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030659369999999999, 2020-11-12T17:25:41.958 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:41.958 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:25:41.958 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:41.959 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:41.959 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.959 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 48648 2020-11-12T17:25:41.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.960 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:41.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:41.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.936193+0000", 2020-11-12T17:25:41.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:41.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:41.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.936193+0000", 2020-11-12T17:25:41.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:25:41.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:41.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.936163+0000", 2020-11-12T17:25:41.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2608000000000006e-05 2020-11-12T17:25:41.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:41.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.936246+0000", 2020-11-12T17:25:41.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1394e-05 2020-11-12T17:25:41.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:41.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.936257+0000", 2020-11-12T17:25:41.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8100000000000003e-06 2020-11-12T17:25:41.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.936263+0000", 2020-11-12T17:25:41.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9913000000000006e-05 2020-11-12T17:25:41.965 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.965 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:41.966 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.966 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:48639 4.d 4:bbf697d5:::benchmark_data_smithi036_18856_object6079:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:25:41.966 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.927329+0000", 2020-11-12T17:25:41.967 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.011811571999999999, 2020-11-12T17:25:41.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011967317, 2020-11-12T17:25:41.967 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:41.967 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:41.968 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:41.968 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:41.968 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.968 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 48639 2020-11-12T17:25:41.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.969 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:41.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:41.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.927329+0000", 2020-11-12T17:25:41.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:41.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:41.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.927329+0000", 2020-11-12T17:25:41.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:25:41.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:41.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.927302+0000", 2020-11-12T17:25:41.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5208000000000002e-05 2020-11-12T17:25:41.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:41.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.927377+0000", 2020-11-12T17:25:41.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3449999999999995e-06 2020-11-12T17:25:41.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:41.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.927386+0000", 2020-11-12T17:25:41.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0080000000000004e-06 2020-11-12T17:25:41.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.927390+0000", 2020-11-12T17:25:41.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066953280000000004 2020-11-12T17:25:41.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:41.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934086+0000", 2020-11-12T17:25:41.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2281000000000006e-05 2020-11-12T17:25:41.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:41.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934178+0000", 2020-11-12T17:25:41.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000157789 2020-11-12T17:25:41.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:41.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.934336+0000", 2020-11-12T17:25:41.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030710049999999999 2020-11-12T17:25:41.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:41.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.937407+0000", 2020-11-12T17:25:41.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010077322 2020-11-12T17:25:41.981 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.981 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:41.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.982 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:48624 4.c 4:3159770f:::benchmark_data_smithi036_18856_object6077:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:25:41.983 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.911280+0000", 2020-11-12T17:25:41.983 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.027860976999999999, 2020-11-12T17:25:41.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.028067536000000001, 2020-11-12T17:25:41.983 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:41.984 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:41.984 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:41.984 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:41.984 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:41.985 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 48624 2020-11-12T17:25:41.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.985 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:41.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:41.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.911280+0000", 2020-11-12T17:25:41.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:41.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:41.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.911280+0000", 2020-11-12T17:25:41.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:41.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:41.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.911244+0000", 2020-11-12T17:25:41.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010631100000000001 2020-11-12T17:25:41.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:41.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.911350+0000", 2020-11-12T17:25:41.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4623999999999999e-05 2020-11-12T17:25:41.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:41.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.911365+0000", 2020-11-12T17:25:41.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3669999999999999e-06 2020-11-12T17:25:41.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:41.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.911372+0000", 2020-11-12T17:25:41.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0092805249999999995 2020-11-12T17:25:41.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:41.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.920652+0000", 2020-11-12T17:25:41.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3384999999999998e-05 2020-11-12T17:25:41.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:41.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.920706+0000", 2020-11-12T17:25:41.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5246000000000003e-05 2020-11-12T17:25:41.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:41.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.920801+0000", 2020-11-12T17:25:41.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077907250000000001 2020-11-12T17:25:41.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:41.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.928592+0000", 2020-11-12T17:25:41.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.017311777 2020-11-12T17:25:41.998 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.999 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:41.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:41.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:41.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:41.999 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:48640 4.d 4:bbf697d5:::benchmark_data_smithi036_18856_object6079:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:25:42.000 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.928732+0000", 2020-11-12T17:25:42.000 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.010409414000000001, 2020-11-12T17:25:42.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010664144, 2020-11-12T17:25:42.000 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.000 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:42.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:42.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:42.001 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 48640 2020-11-12T17:25:42.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.001 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.928732+0000", 2020-11-12T17:25:42.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.928732+0000", 2020-11-12T17:25:42.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999609 2020-11-12T17:25:42.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.928693+0000", 2020-11-12T17:25:42.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011468699999999999 2020-11-12T17:25:42.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.928807+0000", 2020-11-12T17:25:42.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1489e-05 2020-11-12T17:25:42.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.928819+0000", 2020-11-12T17:25:42.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7150000000000003e-06 2020-11-12T17:25:42.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.928825+0000", 2020-11-12T17:25:42.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068638429999999997 2020-11-12T17:25:42.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.935688+0000", 2020-11-12T17:25:42.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2584999999999999e-05 2020-11-12T17:25:42.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.935741+0000", 2020-11-12T17:25:42.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010904399999999999 2020-11-12T17:25:42.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:25:42.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.935850+0000", 2020-11-12T17:25:42.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021720189999999999 2020-11-12T17:25:42.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.938022+0000", 2020-11-12T17:25:42.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0092903729999999993 2020-11-12T17:25:42.013 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.013 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.013 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.014 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:48644 4.1 4:8705e06c:::benchmark_data_smithi036_18856_object6080:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:25:42.014 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.933766+0000", 2020-11-12T17:25:42.014 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.005375019, 2020-11-12T17:25:42.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056830329999999997, 2020-11-12T17:25:42.015 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.015 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:42.015 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.015 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:42.015 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:42.015 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 48644 2020-11-12T17:25:42.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.015 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933766+0000", 2020-11-12T17:25:42.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933766+0000", 2020-11-12T17:25:42.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:42.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933737+0000", 2020-11-12T17:25:42.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4432999999999995e-05 2020-11-12T17:25:42.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933832+0000", 2020-11-12T17:25:42.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1555e-05 2020-11-12T17:25:42.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933843+0000", 2020-11-12T17:25:42.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2020000000000003e-06 2020-11-12T17:25:42.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933848+0000", 2020-11-12T17:25:42.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002147754 2020-11-12T17:25:42.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.935996+0000", 2020-11-12T17:25:42.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2097999999999998e-05 2020-11-12T17:25:42.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.936088+0000", 2020-11-12T17:25:42.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022919699999999999 2020-11-12T17:25:42.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:42.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.936317+0000", 2020-11-12T17:25:42.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002551331 2020-11-12T17:25:42.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.022 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.023 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:48645 4.1 4:8705e06c:::benchmark_data_smithi036_18856_object6080:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:25:42.023 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.933904+0000", 2020-11-12T17:25:42.024 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0052373960000000001, 2020-11-12T17:25:42.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055952170000000004, 2020-11-12T17:25:42.024 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.025 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:42.025 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.025 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:42.025 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:42.026 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 48645 2020-11-12T17:25:42.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.026 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933904+0000", 2020-11-12T17:25:42.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933904+0000", 2020-11-12T17:25:42.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:25:42.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933874+0000", 2020-11-12T17:25:42.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6669000000000007e-05 2020-11-12T17:25:42.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933961+0000", 2020-11-12T17:25:42.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1087000000000001e-05 2020-11-12T17:25:42.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933972+0000", 2020-11-12T17:25:42.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.921e-06 2020-11-12T17:25:42.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.933977+0000", 2020-11-12T17:25:42.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041500790000000001 2020-11-12T17:25:42.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.938127+0000", 2020-11-12T17:25:42.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5532999999999995e-05 2020-11-12T17:25:42.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.938222+0000", 2020-11-12T17:25:42.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166744 2020-11-12T17:25:42.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:42.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.938389+0000", 2020-11-12T17:25:42.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044853489999999996 2020-11-12T17:25:42.039 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.040 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.040 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:42.041 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 8 2020-11-12T17:25:42.041 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:42.045 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:42.046 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:42.040+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:42.146 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:42.140+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:42.221 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:42.222 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:42.222 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:42.222 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:42.223 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:42.232 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:42.240 INFO:tasks.thrashosds.thrasher:No PGs found for osd.2 2020-11-12T17:25:42.284 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:42.280+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:42.347 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:42.342+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:42.352 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:42.352 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:42.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:42.353 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:42.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.354 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:42.354 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:42.354 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.59158858500001, 2020-11-12T17:25:42.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:25:42.354 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.354 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.355 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.355 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:42.355 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:42.355 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:25:42.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.355 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:42.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:42.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:25:42.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:25:42.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:25:42.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:25:42.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:25:42.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:25:42.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:25:42.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:25:42.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:25:42.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:25:42.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:25:42.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:25:42.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:25:42.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:42.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:25:42.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:25:42.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:25:42.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:25:42.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:42.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:25:42.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:25:42.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:25:42.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:25:42.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:25:42.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:25:42.370 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.370 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.371 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.371 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:272 3.9 e22/20 ondisk, result = 0)", 2020-11-12T17:25:42.371 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:42.372 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.584789734, 2020-11-12T17:25:42.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999, 2020-11-12T17:25:42.372 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.372 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:42.372 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:42.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765629+0000", 2020-11-12T17:25:42.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:42.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765617+0000", 2020-11-12T17:25:42.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9439999999999999e-05 2020-11-12T17:25:42.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.765647+0000", 2020-11-12T17:25:42.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26852880400000001 2020-11-12T17:25:42.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034175+0000", 2020-11-12T17:25:42.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9009999999999994e-06 2020-11-12T17:25:42.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034183+0000", 2020-11-12T17:25:42.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5900000000000003e-05 2020-11-12T17:25:42.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034249+0000", 2020-11-12T17:25:42.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1831000000000002e-05 2020-11-12T17:25:42.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034271+0000", 2020-11-12T17:25:42.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015410399999999999 2020-11-12T17:25:42.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034425+0000", 2020-11-12T17:25:42.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26879614299999999 2020-11-12T17:25:42.381 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.381 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.381 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.382 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:42.382 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:42.382 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 151.66387088600001, 2020-11-12T17:25:42.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:25:42.383 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.383 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.383 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.383 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:42.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:42.384 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:25:42.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.384 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:42.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:42.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:42.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:25:42.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:25:42.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:25:42.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:25:42.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:25:42.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:25:42.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:25:42.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:25:42.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:25:42.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:25:42.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:25:42.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:25:42.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:42.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:25:42.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:25:42.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:25:42.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:25:42.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:42.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:25:42.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:25:42.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:25:42.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:25:42.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:25:42.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:25:42.396 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.396 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.396 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.397 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:42.397 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:42.397 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 151.663705983, 2020-11-12T17:25:42.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:25:42.398 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.398 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:42.399 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:42.399 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:25:42.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.399 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:42.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:42.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:42.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:25:42.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:25:42.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:25:42.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:25:42.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:25:42.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:25:42.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:25:42.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:25:42.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:25:42.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:25:42.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:25:42.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:25:42.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:42.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:25:42.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:25:42.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:25:42.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:25:42.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:42.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:25:42.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:25:42.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:25:42.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:25:42.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:25:42.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:25:42.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.408 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.409 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:42.409 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:42.409 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 151.65822591400001, 2020-11-12T17:25:42.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:25:42.409 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.410 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:42.410 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:42.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:42.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:42.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:25:42.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:25:42.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:25:42.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:25:42.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:25:42.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:25:42.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:25:42.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:25:42.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:25:42.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:25:42.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:25:42.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:25:42.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:25:42.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:25:42.416 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.416 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.416 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.417 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:25:42.417 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:42.417 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.46810431399999, 2020-11-12T17:25:42.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:25:42.417 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.417 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.418 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.418 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:42.418 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:42.418 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:25:42.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.418 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:42.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:42.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:25:42.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:25:42.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:25:42.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:25:42.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:25:42.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:25:42.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:25:42.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:25:42.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:25:42.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:25:42.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:25:42.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:25:42.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:25:42.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:42.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:25:42.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:25:42.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:25:42.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:25:42.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:42.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:25:42.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:25:42.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:25:42.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:25:42.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:25:42.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:25:42.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.428 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.428 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:25:42.429 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:42.429 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.46086060499999, 2020-11-12T17:25:42.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:25:42.429 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.429 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:42.429 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:42.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:42.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:42.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:25:42.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:25:42.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:25:42.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:25:42.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:25:42.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:25:42.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:25:42.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:25:42.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:25:42.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:25:42.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:25:42.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:25:42.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:25:42.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:25:42.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.436 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.436 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:42.436 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:42.437 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 108.357685145, 2020-11-12T17:25:42.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:25:42.437 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.437 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:42.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:42.438 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:25:42.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.438 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:42.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:42.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:42.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:25:42.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:25:42.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:25:42.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:25:42.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:25:42.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:25:42.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:25:42.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:25:42.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:25:42.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:25:42.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:25:42.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:25:42.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:42.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:25:42.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:25:42.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:25:42.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:25:42.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:42.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:25:42.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:25:42.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:25:42.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:25:42.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:25:42.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:25:42.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.447 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.448 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:25:42.448 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:42.448 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 108.350026336, 2020-11-12T17:25:42.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:25:42.448 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.448 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:42.449 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:42.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:42.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:25:42.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:25:42.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:25:42.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:25:42.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:25:42.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:25:42.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:25:42.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:25:42.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:25:42.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:25:42.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:25:42.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:25:42.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:25:42.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:25:42.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:25:42.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.455 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.456 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:42.456 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:42.456 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.464771231, 2020-11-12T17:25:42.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:25:42.456 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.456 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:42.456 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:42.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:42.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:42.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:25:42.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:25:42.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:25:42.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:25:42.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:25:42.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:25:42.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:25:42.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:25:42.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:25:42.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:25:42.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:25:42.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:25:42.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:25:42.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:25:42.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.465 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.466 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:304 4.b e71/69 4:d3839b57:::benchmark_data_smithi036_18856_object37:head v 71'32, mlcod=71'28)", 2020-11-12T17:25:42.466 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:42.466 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.206115187999998, 2020-11-12T17:25:42.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998, 2020-11-12T17:25:42.466 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.466 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.466 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:42.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:42.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9998965 2020-11-12T17:25:42.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144200+0000", 2020-11-12T17:25:42.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166613 2020-11-12T17:25:42.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144366+0000", 2020-11-12T17:25:42.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.282020573 2020-11-12T17:25:42.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426387+0000", 2020-11-12T17:25:42.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1779999999999996e-06 2020-11-12T17:25:42.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426391+0000", 2020-11-12T17:25:42.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7170999999999999e-05 2020-11-12T17:25:42.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426448+0000", 2020-11-12T17:25:42.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9868e-05 2020-11-12T17:25:42.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426468+0000", 2020-11-12T17:25:42.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036033319999999999 2020-11-12T17:25:42.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430072+0000", 2020-11-12T17:25:42.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6007000000000001e-05 2020-11-12T17:25:42.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430128+0000", 2020-11-12T17:25:42.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998 2020-11-12T17:25:42.474 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.474 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.474 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.474 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:25:42.474 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:42.475 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.439501964000002, 2020-11-12T17:25:42.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:25:42.475 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.475 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.475 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:42.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:42.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:25:42.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:25:42.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:25:42.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:25:42.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:25:42.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:25:42.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:25:42.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:25:42.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:25:42.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:25:42.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:25:42.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:25:42.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:25:42.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:25:42.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:25:42.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:25:42.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:25:42.482 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.482 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.482 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.483 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:27264 4.1 4:8cfa79b8:::benchmark_data_smithi036_18856_object3407:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e81)", 2020-11-12T17:25:42.483 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:17.300229+0000", 2020-11-12T17:25:42.483 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.050189920000001, 2020-11-12T17:25:42.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29760083700000001, 2020-11-12T17:25:42.483 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.484 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.484 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.484 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:42.484 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:42.484 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 27264 2020-11-12T17:25:42.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.484 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300229+0000", 2020-11-12T17:25:42.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300229+0000", 2020-11-12T17:25:42.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999958 2020-11-12T17:25:42.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300187+0000", 2020-11-12T17:25:42.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101628 2020-11-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300289+0000", 2020-11-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4150000000000005e-06 2020-11-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300298+0000", 2020-11-12T17:25:42.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.998e-06 2020-11-12T17:25:42.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300304+0000", 2020-11-12T17:25:42.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015043999999999999 2020-11-12T17:25:42.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.301808+0000", 2020-11-12T17:25:42.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013547 2020-11-12T17:25:42.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.301944+0000", 2020-11-12T17:25:42.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00092783000000000004 2020-11-12T17:25:42.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:42.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.302872+0000", 2020-11-12T17:25:42.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001891895 2020-11-12T17:25:42.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304764+0000", 2020-11-12T17:25:42.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29299214000000001 2020-11-12T17:25:42.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:42.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597756+0000", 2020-11-12T17:25:42.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3123e-05 2020-11-12T17:25:42.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597799+0000", 2020-11-12T17:25:42.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0700000000000001e-05 2020-11-12T17:25:42.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597830+0000", 2020-11-12T17:25:42.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29760083700000001 2020-11-12T17:25:42.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.494 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.494 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44206 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:42.494 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:42.495 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.7738194810000003, 2020-11-12T17:25:42.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002, 2020-11-12T17:25:42.495 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.495 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:42.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:42.495 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44206 2020-11-12T17:25:42.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.496 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:42.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:42.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:25:42.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576576+0000", 2020-11-12T17:25:42.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1733e-05 2020-11-12T17:25:42.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576637+0000", 2020-11-12T17:25:42.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3419e-05 2020-11-12T17:25:42.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576651+0000", 2020-11-12T17:25:42.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0509999999999996e-06 2020-11-12T17:25:42.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576656+0000", 2020-11-12T17:25:42.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9773e-05 2020-11-12T17:25:42.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576696+0000", 2020-11-12T17:25:42.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2999999999999997e-05 2020-11-12T17:25:42.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576789+0000", 2020-11-12T17:25:42.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137916 2020-11-12T17:25:42.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:42.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576927+0000", 2020-11-12T17:25:42.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027075860000000001 2020-11-12T17:25:42.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579634+0000", 2020-11-12T17:25:42.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.333427529 2020-11-12T17:25:42.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:42.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913062+0000", 2020-11-12T17:25:42.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2707000000000002e-05 2020-11-12T17:25:42.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913114+0000", 2020-11-12T17:25:42.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8039e-05 2020-11-12T17:25:42.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913152+0000", 2020-11-12T17:25:42.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002 2020-11-12T17:25:42.505 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.505 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.505 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.506 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:42.506 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:42.506 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.7736609489999999, 2020-11-12T17:25:42.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:25:42.506 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.506 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.507 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.507 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:42.507 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:42.507 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:25:42.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.507 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:42.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:42.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:25:42.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:25:42.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:25:42.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:25:42.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:25:42.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:25:42.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:25:42.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:25:42.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:25:42.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:25:42.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:25:42.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:25:42.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:25:42.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:42.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:25:42.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:25:42.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:25:42.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:25:42.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:42.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:25:42.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:25:42.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:25:42.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:25:42.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:25:42.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:25:42.516 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.516 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.516 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.517 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:42.517 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:42.517 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.7704196200000002, 2020-11-12T17:25:42.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:25:42.517 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.518 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:42.518 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:42.518 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:42.518 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:42.518 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:25:42.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.518 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:42.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:42.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:42.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:25:42.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:25:42.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:25:42.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:25:42.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:25:42.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:25:42.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:25:42.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:25:42.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:25:42.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:25:42.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:25:42.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:25:42.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:42.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:25:42.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:25:42.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:42.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:25:42.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:25:42.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:42.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:25:42.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:25:42.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:42.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:25:42.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:25:42.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:25:42.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:25:42.527 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.527 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.527 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.528 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44206 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:42.528 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.581565+0000", 2020-11-12T17:25:42.528 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.7688534200000001, 2020-11-12T17:25:42.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33159236600000003, 2020-11-12T17:25:42.528 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.528 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:42.529 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581565+0000", 2020-11-12T17:25:42.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581565+0000", 2020-11-12T17:25:42.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:42.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581541+0000", 2020-11-12T17:25:42.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0001999999999999e-05 2020-11-12T17:25:42.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581601+0000", 2020-11-12T17:25:42.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33139100900000001 2020-11-12T17:25:42.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.912992+0000", 2020-11-12T17:25:42.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.391e-06 2020-11-12T17:25:42.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.912997+0000", 2020-11-12T17:25:42.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6869999999999997e-05 2020-11-12T17:25:42.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913044+0000", 2020-11-12T17:25:42.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1580000000000005e-06 2020-11-12T17:25:42.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913052+0000", 2020-11-12T17:25:42.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105784 2020-11-12T17:25:42.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913158+0000", 2020-11-12T17:25:42.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33159236600000003 2020-11-12T17:25:42.535 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.535 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.535 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.535 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44207 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:42.535 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.582601+0000", 2020-11-12T17:25:42.535 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.7678173409999998, 2020-11-12T17:25:42.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33232504899999998, 2020-11-12T17:25:42.536 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.536 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:42.536 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582601+0000", 2020-11-12T17:25:42.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582601+0000", 2020-11-12T17:25:42.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:25:42.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582580+0000", 2020-11-12T17:25:42.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3579999999999999e-05 2020-11-12T17:25:42.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582634+0000", 2020-11-12T17:25:42.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33216079100000001 2020-11-12T17:25:42.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914795+0000", 2020-11-12T17:25:42.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1170000000000003e-06 2020-11-12T17:25:42.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914800+0000", 2020-11-12T17:25:42.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6638999999999999e-05 2020-11-12T17:25:42.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914836+0000", 2020-11-12T17:25:42.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2330000000000003e-06 2020-11-12T17:25:42.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914843+0000", 2020-11-12T17:25:42.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3751000000000005e-05 2020-11-12T17:25:42.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914926+0000", 2020-11-12T17:25:42.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33232504899999998 2020-11-12T17:25:42.542 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.542 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.542 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.542 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44208 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:42.543 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:42.543 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.7672350300000002, 2020-11-12T17:25:42.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003, 2020-11-12T17:25:42.543 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.543 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:42.543 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:42.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:42.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:42.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583142+0000", 2020-11-12T17:25:42.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9876000000000004e-05 2020-11-12T17:25:42.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583242+0000", 2020-11-12T17:25:42.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33634110099999998 2020-11-12T17:25:42.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919583+0000", 2020-11-12T17:25:42.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3000000000000001e-06 2020-11-12T17:25:42.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919588+0000", 2020-11-12T17:25:42.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:25:42.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919642+0000", 2020-11-12T17:25:42.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3859999999999996e-06 2020-11-12T17:25:42.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919652+0000", 2020-11-12T17:25:42.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013921800000000001 2020-11-12T17:25:42.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919791+0000", 2020-11-12T17:25:42.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003 2020-11-12T17:25:42.549 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.549 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.549 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.550 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:25:42.550 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:25:42.550 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.337248719, 2020-11-12T17:25:42.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:25:42.550 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:42.550 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:42.551 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:42.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:42.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:25:42.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:42.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:42.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:25:42.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:42.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:42.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:25:42.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:25:42.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:42.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:25:42.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:25:42.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:42.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:25:42.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:25:42.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:42.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:25:42.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:25:42.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:42.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:25:42.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:25:42.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:42.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:25:42.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:25:42.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:42.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:42.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:42.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:25:42.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:25:42.556 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.557 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:42.557 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:42.557 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:42.559 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:42.559 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:42.554+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:42.662 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:42.658+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:42.733 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:42.734 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:42.734 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:25:42.734 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:42.745 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:42.791 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:42.786+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:42.862 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:42.856+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:42.866 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:42.862+0000 7f280e6c1700 -1 osd.6 94 handle_osd_map injecting map crc failure 2020-11-12T17:25:42.871 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:25:42.929 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:42.929 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:42.929 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:42.929 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:42.929 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:42.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 51 16 49511 49495 7.58121 6.78906 0.0112715 0.0164814 2020-11-12T17:25:42.943 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:42.988 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:42.986+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:43.066 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:43.060+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:43.080 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:43.080 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:43.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:43.081 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:43.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.081 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:25:43.081 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:43.081 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 152.57508741199999, 2020-11-12T17:25:43.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:25:43.082 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.082 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.082 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:43.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:43.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:43.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:25:43.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:25:43.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:25:43.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:25:43.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:25:43.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:25:43.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:25:43.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:25:43.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:25:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:25:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:25:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:25:43.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:25:43.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:25:43.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:25:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:25:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.553077847, 2020-11-12T17:25:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:25:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:25:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:25:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:25:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:25:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:25:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:25:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:25:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:25:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:25:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:25:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:25:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:25:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:25:43.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:43.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:25:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:25:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:25:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:25:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:25:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:25:43.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:25:43.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:25:43.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:25:43.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:25:43.104 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.104 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.104 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.104 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:25:43.104 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:43.105 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.54967791300001, 2020-11-12T17:25:43.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:25:43.105 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.105 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:43.105 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:43.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:43.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:43.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:25:43.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:25:43.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:25:43.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:25:43.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:25:43.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:25:43.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:25:43.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:25:43.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:25:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:25:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:25:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:25:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:25:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:25:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:25:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 113.073788466, 2020-11-12T17:25:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:25:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:25:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:25:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:25:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:25:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:25:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:25:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:25:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:25:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:25:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:25:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:25:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:25:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:25:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:25:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:25:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:25:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:25:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 103.2410945, 2020-11-12T17:25:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:25:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:25:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:25:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:25:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:25:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:25:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:25:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:25:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:25:43.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:25:43.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:25:43.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:25:43.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:25:43.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:25:43.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:25:43.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:25:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:25:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 81.133803123000007, 2020-11-12T17:25:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:25:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:25:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:25:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:25:43.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:25:43.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:25:43.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:25:43.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:25:43.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:25:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:25:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:25:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:25:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:25:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:25:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:25:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:25:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:25:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:25:43.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:25:43.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:25:43.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:25:43.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:25:43.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:25:43.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:25:43.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:25:43.149 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.149 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.150 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.151 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:59416 3.c 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:43.151 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:43.151 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 78.551407707999999, 2020-11-12T17:25:43.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998, 2020-11-12T17:25:43.152 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.152 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.152 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.152 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59416 2020-11-12T17:25:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527883+0000", 2020-11-12T17:25:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2643000000000002e-05 2020-11-12T17:25:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527956+0000", 2020-11-12T17:25:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:25:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527969+0000", 2020-11-12T17:25:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2689999999999996e-06 2020-11-12T17:25:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527976+0000", 2020-11-12T17:25:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043768990000000001 2020-11-12T17:25:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532353+0000", 2020-11-12T17:25:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011210299999999999 2020-11-12T17:25:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532465+0000", 2020-11-12T17:25:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017931699999999999 2020-11-12T17:25:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532644+0000", 2020-11-12T17:25:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002342341 2020-11-12T17:25:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.534986+0000", 2020-11-12T17:25:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30120883700000001 2020-11-12T17:25:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836195+0000", 2020-11-12T17:25:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0408999999999995e-05 2020-11-12T17:25:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836276+0000", 2020-11-12T17:25:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1774999999999997e-05 2020-11-12T17:25:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836337+0000", 2020-11-12T17:25:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998 2020-11-12T17:25:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:25:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.656702049000003, 2020-11-12T17:25:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:25:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:25:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:25:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:25:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:25:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:25:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:25:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:25:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:25:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:25:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:25:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:25:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:25:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:25:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:25:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.537691662, 2020-11-12T17:25:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:25:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:25:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:25:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:25:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:25:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:25:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:25:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:25:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:25:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:25:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:25:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:25:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:25:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:43.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:25:43.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:25:43.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:25:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:25:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:25:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:25:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:25:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:25:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:25:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:25:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:25:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.521553658000002, 2020-11-12T17:25:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:25:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:25:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:25:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:25:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:25:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:25:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:25:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:25:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:25:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:25:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:25:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:25:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:25:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:25:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:25:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:25:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.516825979000004, 2020-11-12T17:25:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:25:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:25:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:25:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:25:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:25:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:25:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:25:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:25:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:25:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:25:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:25:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:25:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:25:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:25:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:25:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:25:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:424 4.8 4:15a22128:::benchmark_data_smithi036_18856_object52:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.858796241999997, 2020-11-12T17:25:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002, 2020-11-12T17:25:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 424 2020-11-12T17:25:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220491+0000", 2020-11-12T17:25:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7780000000000003e-05 2020-11-12T17:25:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220579+0000", 2020-11-12T17:25:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1511e-05 2020-11-12T17:25:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220590+0000", 2020-11-12T17:25:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9410000000000004e-06 2020-11-12T17:25:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220596+0000", 2020-11-12T17:25:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027076259999999999 2020-11-12T17:25:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223304+0000", 2020-11-12T17:25:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102644 2020-11-12T17:25:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223406+0000", 2020-11-12T17:25:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017898600000000001 2020-11-12T17:25:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223585+0000", 2020-11-12T17:25:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000774389 2020-11-12T17:25:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224360+0000", 2020-11-12T17:25:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30234014999999997 2020-11-12T17:25:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526700+0000", 2020-11-12T17:25:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5360999999999999e-05 2020-11-12T17:25:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526775+0000", 2020-11-12T17:25:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6470000000000001e-05 2020-11-12T17:25:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526812+0000", 2020-11-12T17:25:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002 2020-11-12T17:25:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:424 4.8 e71/69 ondisk, result = 0)", 2020-11-12T17:25:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.854344703000002, 2020-11-12T17:25:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474, 2020-11-12T17:25:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224949+0000", 2020-11-12T17:25:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8579000000000003e-05 2020-11-12T17:25:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.225008+0000", 2020-11-12T17:25:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30161437000000002 2020-11-12T17:25:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526622+0000", 2020-11-12T17:25:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1900000000000003e-06 2020-11-12T17:25:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526628+0000", 2020-11-12T17:25:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8828000000000001e-05 2020-11-12T17:25:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526676+0000", 2020-11-12T17:25:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1576000000000001e-05 2020-11-12T17:25:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526688+0000", 2020-11-12T17:25:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012879999999999999 2020-11-12T17:25:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526817+0000", 2020-11-12T17:25:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474 2020-11-12T17:25:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11951 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.988326389999997, 2020-11-12T17:25:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998, 2020-11-12T17:25:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11951 2020-11-12T17:25:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:25:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090956+0000", 2020-11-12T17:25:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110012 2020-11-12T17:25:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091066+0000", 2020-11-12T17:25:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2517000000000001e-05 2020-11-12T17:25:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091078+0000", 2020-11-12T17:25:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.421e-06 2020-11-12T17:25:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091085+0000", 2020-11-12T17:25:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052388110000000003 2020-11-12T17:25:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096323+0000", 2020-11-12T17:25:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010759 2020-11-12T17:25:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096431+0000", 2020-11-12T17:25:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018636600000000001 2020-11-12T17:25:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096617+0000", 2020-11-12T17:25:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018824309999999999 2020-11-12T17:25:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098500+0000", 2020-11-12T17:25:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29523157 2020-11-12T17:25:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393731+0000", 2020-11-12T17:25:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7910999999999994e-05 2020-11-12T17:25:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393799+0000", 2020-11-12T17:25:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101962 2020-11-12T17:25:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393901+0000", 2020-11-12T17:25:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998 2020-11-12T17:25:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11952 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.988175568999999, 2020-11-12T17:25:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002, 2020-11-12T17:25:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11952 2020-11-12T17:25:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091107+0000", 2020-11-12T17:25:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011024200000000001 2020-11-12T17:25:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091218+0000", 2020-11-12T17:25:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2203e-05 2020-11-12T17:25:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091230+0000", 2020-11-12T17:25:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.694e-06 2020-11-12T17:25:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091236+0000", 2020-11-12T17:25:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076783260000000001 2020-11-12T17:25:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098914+0000", 2020-11-12T17:25:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3187000000000001e-05 2020-11-12T17:25:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099007+0000", 2020-11-12T17:25:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016888299999999999 2020-11-12T17:25:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099176+0000", 2020-11-12T17:25:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012571570000000001 2020-11-12T17:25:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100433+0000", 2020-11-12T17:25:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29596956499999999 2020-11-12T17:25:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396403+0000", 2020-11-12T17:25:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0348999999999999e-05 2020-11-12T17:25:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396483+0000", 2020-11-12T17:25:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8981000000000003e-05 2020-11-12T17:25:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396542+0000", 2020-11-12T17:25:43.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002 2020-11-12T17:25:43.235 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.235 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.235 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.235 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11951 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:43.236 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:43.236 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.980648145000004, 2020-11-12T17:25:43.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998, 2020-11-12T17:25:43.236 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.236 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:43.236 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:43.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:43.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:43.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098644+0000", 2020-11-12T17:25:43.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2123000000000001e-05 2020-11-12T17:25:43.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098706+0000", 2020-11-12T17:25:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.294880011 2020-11-12T17:25:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393586+0000", 2020-11-12T17:25:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393595+0000", 2020-11-12T17:25:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115302 2020-11-12T17:25:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393710+0000", 2020-11-12T17:25:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2968e-05 2020-11-12T17:25:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393723+0000", 2020-11-12T17:25:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018932500000000001 2020-11-12T17:25:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393913+0000", 2020-11-12T17:25:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998 2020-11-12T17:25:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11952 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.978548369000002, 2020-11-12T17:25:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999, 2020-11-12T17:25:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100743+0000", 2020-11-12T17:25:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2359000000000004e-05 2020-11-12T17:25:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100805+0000", 2020-11-12T17:25:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29550863300000002 2020-11-12T17:25:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396314+0000", 2020-11-12T17:25:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6940000000000003e-06 2020-11-12T17:25:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396318+0000", 2020-11-12T17:25:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8325999999999997e-05 2020-11-12T17:25:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396377+0000", 2020-11-12T17:25:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4015999999999999e-05 2020-11-12T17:25:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396391+0000", 2020-11-12T17:25:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015908 2020-11-12T17:25:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396550+0000", 2020-11-12T17:25:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999 2020-11-12T17:25:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:27264 4.1 e81/69 4:8cfa79b8:::benchmark_data_smithi036_18856_object3407:head v 81'1736, mlcod=81'1730)", 2020-11-12T17:25:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.774998578000002, 2020-11-12T17:25:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999, 2020-11-12T17:25:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304300+0000", 2020-11-12T17:25:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0590000000000001e-05 2020-11-12T17:25:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304360+0000", 2020-11-12T17:25:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29159615 2020-11-12T17:25:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595957+0000", 2020-11-12T17:25:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9299999999999997e-06 2020-11-12T17:25:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595963+0000", 2020-11-12T17:25:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8519000000000001e-05 2020-11-12T17:25:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596012+0000", 2020-11-12T17:25:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3053000000000001e-05 2020-11-12T17:25:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596035+0000", 2020-11-12T17:25:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001402122 2020-11-12T17:25:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597437+0000", 2020-11-12T17:25:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0948999999999997e-05 2020-11-12T17:25:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597478+0000", 2020-11-12T17:25:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999 2020-11-12T17:25:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:25:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.135266912000001, 2020-11-12T17:25:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:25:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:25:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:25:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:25:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:25:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:25:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:25:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:25:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:25:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:25:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:25:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:25:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:25:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:25:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:25:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:25:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:25:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:25:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:25:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:25:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:25:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:25:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:25:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:25:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:25:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.129713090999999, 2020-11-12T17:25:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:25:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:25:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:25:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:25:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:25:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:25:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:25:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:25:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:25:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:25:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:25:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:25:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:25:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:25:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:25:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.276 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:43.278 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:43.274+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:43.278 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:43.379 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:43.372+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:43.448 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:43.449 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:43.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.449 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:49959 4.5 4:ad2be9b2:::benchmark_data_smithi036_18856_object6244:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e95)", 2020-11-12T17:25:43.449 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:43.426674+0000", 2020-11-12T17:25:43.449 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.022582113000000001, 2020-11-12T17:25:43.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.022612613, 2020-11-12T17:25:43.450 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.450 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:43.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:43.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:43.451 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 49959 2020-11-12T17:25:43.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.451 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.426674+0000", 2020-11-12T17:25:43.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.426674+0000", 2020-11-12T17:25:43.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:43.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.426642+0000", 2020-11-12T17:25:43.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2575e-05 2020-11-12T17:25:43.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.426735+0000", 2020-11-12T17:25:43.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.503e-05 2020-11-12T17:25:43.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.426750+0000", 2020-11-12T17:25:43.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1761e-05 2020-11-12T17:25:43.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.426761+0000", 2020-11-12T17:25:43.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037000999999999999 2020-11-12T17:25:43.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.427131+0000", 2020-11-12T17:25:43.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5188e-05 2020-11-12T17:25:43.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.427197+0000", 2020-11-12T17:25:43.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010136699999999999 2020-11-12T17:25:43.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.427298+0000", 2020-11-12T17:25:43.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042503760000000002 2020-11-12T17:25:43.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.431548+0000", 2020-11-12T17:25:43.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048742619999999999 2020-11-12T17:25:43.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.458 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.459 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:49960 4.5 4:ad2be9b2:::benchmark_data_smithi036_18856_object6244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e95)", 2020-11-12T17:25:43.459 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:43.427482+0000", 2020-11-12T17:25:43.459 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.021774519999999999, 2020-11-12T17:25:43.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.021877883000000001, 2020-11-12T17:25:43.459 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.460 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:43.460 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.460 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:43.460 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:43.460 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 49960 2020-11-12T17:25:43.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.460 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.427482+0000", 2020-11-12T17:25:43.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.427482+0000", 2020-11-12T17:25:43.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:43.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.427452+0000", 2020-11-12T17:25:43.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2482000000000001e-05 2020-11-12T17:25:43.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.427535+0000", 2020-11-12T17:25:43.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4256999999999999e-05 2020-11-12T17:25:43.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.427549+0000", 2020-11-12T17:25:43.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.336e-06 2020-11-12T17:25:43.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.427555+0000", 2020-11-12T17:25:43.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000761877 2020-11-12T17:25:43.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.428317+0000", 2020-11-12T17:25:43.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6715999999999997e-05 2020-11-12T17:25:43.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.428374+0000", 2020-11-12T17:25:43.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9281e-05 2020-11-12T17:25:43.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.428473+0000", 2020-11-12T17:25:43.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030849639999999999 2020-11-12T17:25:43.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:43.431558+0000", 2020-11-12T17:25:43.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040766020000000004 2020-11-12T17:25:43.468 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.468 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.468 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.468 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.468 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:43.468 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:25:43.469 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:43.470 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:43.517 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:43.514+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:43.543 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:43.582 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:43.578+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:43.603 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:43.603 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:43.603 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:43.603 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:43.604 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:43.619 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:43.701 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:43.708 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:43.706+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:43.733 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:43.763 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:43.784 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:43.780+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:43.792 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:43.798 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:43.798 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:43.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:25:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.12562803899999, 2020-11-12T17:25:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:25:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:25:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:25:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:25:43.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:25:43.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:25:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:25:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:25:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:25:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:25:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:25:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:25:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:25:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:25:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:25:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:25:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:25:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:25:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:25:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:25:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:25:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:25:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:25:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.12522567799999, 2020-11-12T17:25:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:25:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:25:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:25:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:25:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:25:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:25:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:25:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:25:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:25:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:25:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:25:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:25:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:25:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:25:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:25:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:25:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:25:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:25:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:25:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:25:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:25:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:25:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:25:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:25:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:25:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:25:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:25:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:25:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:25:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:25:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:25:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:25:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:25:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.124901685, 2020-11-12T17:25:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:25:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:25:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:25:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:25:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:25:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:25:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:25:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:25:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:25:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:25:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:25:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:25:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:25:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:25:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:25:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:25:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:25:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:25:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:25:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:25:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:25:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:25:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:25:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:25:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:25:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:25:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:25:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:25:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:25:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:25:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:25:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:25:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:25:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.124657974, 2020-11-12T17:25:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:25:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:25:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:25:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:25:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:25:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:25:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:25:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:25:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:25:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:25:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:25:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:25:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:25:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:25:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:25:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:25:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:25:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:25:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:25:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:25:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:25:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:25:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:25:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:25:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:25:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:25:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:25:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:25:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:25:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:25:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:25:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:25:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.124419827, 2020-11-12T17:25:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:25:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:25:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:25:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:25:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:25:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:25:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:25:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:25:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:25:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:25:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:25:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:25:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:25:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:25:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:25:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:25:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:25:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:25:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:25:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:25:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:25:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:25:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:25:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:25:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:25:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:25:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:25:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:25:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:25:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:25:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:25:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:25:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:25:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.12421778699999, 2020-11-12T17:25:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:25:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:25:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:25:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:25:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:25:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:25:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:25:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:25:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:25:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:25:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:25:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:25:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:25:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:25:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:25:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:25:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:25:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:25:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:25:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:25:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:25:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:25:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:25:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:25:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:25:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:25:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:25:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:25:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:25:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:25:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:25:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:25:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.12401241699999, 2020-11-12T17:25:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:25:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:25:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:25:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:25:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:25:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:25:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:25:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:25:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:25:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:25:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:25:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:25:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:25:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:25:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:25:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:25:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:25:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:25:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:25:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:25:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:25:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:25:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:25:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:25:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:25:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:25:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:25:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:25:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:25:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:25:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:25:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:25:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.12382658999999, 2020-11-12T17:25:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:25:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:25:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:25:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:25:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:25:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:25:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:25:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:25:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:25:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:25:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:25:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:25:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:25:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:25:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:25:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:25:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:25:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:25:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:25:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:25:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:25:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:25:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:25:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:25:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:25:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:25:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:25:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:25:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:25:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:25:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:25:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:25:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.123629626, 2020-11-12T17:25:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:25:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:25:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:25:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:25:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:25:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:25:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:25:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:25:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:25:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:25:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:25:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:25:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:25:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:25:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:25:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:25:43.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:25:43.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:25:43.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:25:43.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:25:43.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:25:43.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:25:43.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:25:43.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:25:43.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:25:43.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:25:43.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:25:43.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:25:43.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:25:43.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:25:43.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:25:43.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:25:43.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:25:43.919 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.919 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.920 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.920 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.920 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:43.920 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.12343359600001, 2020-11-12T17:25:43.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:25:43.921 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.921 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.921 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.921 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.921 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.921 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:25:43.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.921 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:43.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:43.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:43.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:25:43.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:25:43.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:25:43.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:25:43.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:25:43.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:25:43.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:25:43.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:25:43.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:25:43.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:25:43.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:25:43.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:25:43.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:25:43.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:25:43.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:25:43.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:25:43.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:25:43.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:25:43.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:25:43.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:25:43.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:25:43.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:25:43.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:25:43.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:25:43.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:25:43.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:25:43.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:25:43.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:25:43.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:25:43.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:25:43.933 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.933 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.933 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.933 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.933 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:43.933 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.123252796, 2020-11-12T17:25:43.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:25:43.934 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.934 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.934 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.934 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.934 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.934 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:25:43.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.935 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:43.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:43.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:43.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:25:43.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:25:43.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:25:43.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:25:43.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:25:43.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:25:43.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:25:43.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:25:43.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:25:43.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:25:43.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:25:43.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:25:43.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:25:43.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:25:43.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:25:43.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:25:43.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:25:43.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:25:43.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:25:43.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:25:43.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:25:43.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:25:43.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:25:43.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:25:43.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:25:43.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:25:43.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:25:43.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:25:43.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:25:43.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:25:43.946 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.946 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.946 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.946 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.947 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:43.947 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.123056843, 2020-11-12T17:25:43.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:25:43.947 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.947 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.947 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.947 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.947 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.948 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:25:43.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.948 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:43.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:43.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:43.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:25:43.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:25:43.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:25:43.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:25:43.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:25:43.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:43.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:25:43.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:25:43.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:25:43.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:25:43.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:25:43.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:25:43.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:25:43.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:25:43.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:25:43.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:25:43.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:25:43.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:25:43.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:25:43.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:25:43.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:25:43.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:25:43.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:25:43.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:25:43.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:25:43.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:25:43.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:25:43.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:25:43.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:25:43.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:25:43.959 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.959 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.959 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.960 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.960 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:43.960 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.12286323500001, 2020-11-12T17:25:43.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:25:43.960 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.960 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.960 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.961 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.961 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.961 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:25:43.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.961 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:43.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:43.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:25:43.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:25:43.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:25:43.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:25:43.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:25:43.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:25:43.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:25:43.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:25:43.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:25:43.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:25:43.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:25:43.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:25:43.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:25:43.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:25:43.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:25:43.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:25:43.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:25:43.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:25:43.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:25:43.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:25:43.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:25:43.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:25:43.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:25:43.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:25:43.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:25:43.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:25:43.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:25:43.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:25:43.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:25:43.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:25:43.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:25:43.972 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.972 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.972 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.973 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.973 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:43.973 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.122551372, 2020-11-12T17:25:43.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:25:43.973 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.973 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.974 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.974 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.974 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.974 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:25:43.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.974 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:43.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:43.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:25:43.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:25:43.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:25:43.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:25:43.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:25:43.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:25:43.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:25:43.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:25:43.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:25:43.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:25:43.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:25:43.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:25:43.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:25:43.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:25:43.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:25:43.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:25:43.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:25:43.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:25:43.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:25:43.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:25:43.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:25:43.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:25:43.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:25:43.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:25:43.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:25:43.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:25:43.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:25:43.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:25:43.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:25:43.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:25:43.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:25:43.985 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.985 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.986 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.986 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.986 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:43.986 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.12226387499999, 2020-11-12T17:25:43.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:25:43.987 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:43.987 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:43.987 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:43.987 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:43.987 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:43.987 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:25:43.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.987 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:43.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:43.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:43.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:43.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:43.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:43.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:25:43.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:43.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:25:43.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:25:43.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:43.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:25:43.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:25:43.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:43.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:25:43.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:25:43.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:43.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:25:43.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:25:43.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:25:43.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:25:43.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:43.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:25:43.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:25:43.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:25:43.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:25:43.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:43.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:25:43.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:25:43.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:43.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:25:43.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:25:43.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:43.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:25:43.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:25:43.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:43.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:25:43.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:25:43.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:43.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:25:43.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:25:43.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:43.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:25:43.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:25:43.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:43.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:25:43.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:25:43.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:43.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:25:43.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:25:43.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.999 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:43.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:43.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:43.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:43.999 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:43.999 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:44.000 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.122043504, 2020-11-12T17:25:44.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:25:44.000 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:44.000 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:44.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:44.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:44.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:44.001 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:25:44.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.001 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:44.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:44.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:44.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:44.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:44.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:44.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:25:44.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:44.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:25:44.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:25:44.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:44.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:25:44.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:25:44.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:44.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:25:44.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:25:44.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:44.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:25:44.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:25:44.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:44.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:25:44.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:25:44.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:44.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:25:44.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:25:44.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:44.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:25:44.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:25:44.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:44.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:25:44.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:25:44.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:44.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:25:44.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:25:44.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:44.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:25:44.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:25:44.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:44.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:25:44.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:25:44.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:44.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:25:44.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:25:44.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:44.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:25:44.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:25:44.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:44.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:25:44.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:25:44.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:44.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:25:44.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:25:44.012 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.012 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:44.012 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.013 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:44.013 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:44.013 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 118.350589658, 2020-11-12T17:25:44.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:25:44.013 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:44.013 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:44.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:44.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:44.014 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:44.014 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:25:44.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.014 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:44.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:44.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:44.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:44.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:44.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:44.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:44.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:44.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:25:44.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:25:44.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:44.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:25:44.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:25:44.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:44.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:25:44.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:25:44.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:44.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:25:44.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:25:44.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:44.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:25:44.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:25:44.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:44.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:25:44.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:25:44.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:44.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:25:44.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:25:44.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:44.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:25:44.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:25:44.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:44.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:25:44.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:25:44.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:44.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:25:44.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:25:44.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:44.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:25:44.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:25:44.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.023 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:44.023 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.023 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:25:44.023 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:44.023 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 99.030300757000006, 2020-11-12T17:25:44.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:25:44.024 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:44.024 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:44.024 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:44.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:44.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:44.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:44.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:44.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:44.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:44.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:44.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:25:44.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:25:44.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:44.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:25:44.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:25:44.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:44.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:25:44.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:25:44.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:44.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:25:44.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:25:44.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:44.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:25:44.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:25:44.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:44.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:25:44.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:25:44.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:44.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:25:44.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:25:44.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:44.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:25:44.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:25:44.031 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.031 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:44.031 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.031 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:40120 4.4 e88/69 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head v 88'2336, mlcod=88'2333)", 2020-11-12T17:25:44.031 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:44.031 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.887354555, 2020-11-12T17:25:44.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001, 2020-11-12T17:25:44.032 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:44.032 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:44.032 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:44.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:44.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:44.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:44.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:44.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:44.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:25:44.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:44.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907891+0000", 2020-11-12T17:25:44.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1538000000000006e-05 2020-11-12T17:25:44.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:44.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907953+0000", 2020-11-12T17:25:44.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56353955600000005 2020-11-12T17:25:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471493+0000", 2020-11-12T17:25:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1980000000000007e-06 2020-11-12T17:25:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:44.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471502+0000", 2020-11-12T17:25:44.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5057999999999997e-05 2020-11-12T17:25:44.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:44.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471597+0000", 2020-11-12T17:25:44.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4514999999999997e-05 2020-11-12T17:25:44.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:44.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471631+0000", 2020-11-12T17:25:44.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026000350000000001 2020-11-12T17:25:44.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:44.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474231+0000", 2020-11-12T17:25:44.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7666999999999997e-05 2020-11-12T17:25:44.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:44.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474269+0000", 2020-11-12T17:25:44.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001 2020-11-12T17:25:44.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.039 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:44.039 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.039 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44328 4.4 e91/69 4:28df349f:::benchmark_data_smithi036_18856_object5540:head v 91'2624, mlcod=90'2615)", 2020-11-12T17:25:44.039 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:44.039 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.000805282, 2020-11-12T17:25:44.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002, 2020-11-12T17:25:44.040 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:44.040 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:44.040 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:44.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:44.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:44.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:44.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:44.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:44.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:44.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:44.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794441+0000", 2020-11-12T17:25:44.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6031000000000005e-05 2020-11-12T17:25:44.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:44.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794507+0000", 2020-11-12T17:25:44.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48298932700000002 2020-11-12T17:25:44.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:44.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277496+0000", 2020-11-12T17:25:44.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3239999999999999e-06 2020-11-12T17:25:44.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:44.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277503+0000", 2020-11-12T17:25:44.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9152000000000001e-05 2020-11-12T17:25:44.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:44.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277542+0000", 2020-11-12T17:25:44.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0945999999999999e-05 2020-11-12T17:25:44.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:44.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277563+0000", 2020-11-12T17:25:44.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040876100000000002 2020-11-12T17:25:44.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:44.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281650+0000", 2020-11-12T17:25:44.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4248e-05 2020-11-12T17:25:44.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:44.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:44.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:44.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281705+0000", 2020-11-12T17:25:44.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002 2020-11-12T17:25:44.046 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.047 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:44.047 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.047 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:44.047 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:44.047 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:44.049 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:44.049 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:44.049 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:44.049 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:44.050 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:25:44.050 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:25:44.050 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:25:44.050 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:44.050 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:44.050 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:44.051 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:44.051 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:44.051 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:44.051 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:44.051 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 52 16 50398 50382 7.56867 6.92969 0.0101185 0.0165042 2020-11-12T17:25:44.052 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:44.052 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:44.046+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:44.152 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:44.146+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:44.233 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:44.233 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:44.245 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:44.289 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:44.286+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:44.351 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:44.344+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:44.423 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:44.423 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:44.436 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:44.452 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:44.448+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:44.553 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:44.550+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:44.562 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:44.562 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:44.572 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:25:44.654 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:44.650+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:44.697 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:44.697 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:44.709 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:25:44.756 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:44.752+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:44.827 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:44.828 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:44.837 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:25:44.857 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:44.854+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:44.890 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:25:44.917 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:44.912+0000 7f6583748700 -1 osd.0 95 handle_osd_map injecting map crc failure 2020-11-12T17:25:44.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 53 16 51330 51314 7.56324 7.28125 0.0146967 0.0165196 2020-11-12T17:25:44.957 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:44.954+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:45.005 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:45.005 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:45.017 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:45.163 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:45.164 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:45.173 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:45.281 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:45.282 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:45.291 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:45.402 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:45.403 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:45.412 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:45.463 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:45.456+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:45.521 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:45.054+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:45.521 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:45.510+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:45.522 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:45.258+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:45.522 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:45.358+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:45.529 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:45.529 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:45.540 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:45.589 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:45.584+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:45.665 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:45.660+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:45.712 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:45.713 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:45.723 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:45.766 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:45.762+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:45.868 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:45.860+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:45.895 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:25:45.896 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:45.896 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:45.907 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:45.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 54 16 51822 51806 7.49435 3.84375 0.00947482 0.0166693 2020-11-12T17:25:45.967 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:45.962+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:46.039 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:46.040 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:46.052 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:46.054 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:46.097 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:46.094+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:46.169 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:46.166+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:46.224 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:46.236 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:46.237 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:46.247 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:46.260 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:46.270 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:46.264+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:46.293 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:46.332 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:46.366 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:46.371 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:46.364+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:46.401 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:46.424 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:272 3.9 3:9ef42d07:::benchmark_data_smithi036_14212_object33:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:25:46.425 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 161.66349757099999, 2020-11-12T17:25:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001, 2020-11-12T17:25:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:46.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 272 2020-11-12T17:25:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758830+0000", 2020-11-12T17:25:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999676 2020-11-12T17:25:46.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758798+0000", 2020-11-12T17:25:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010153999999999999 2020-11-12T17:25:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758899+0000", 2020-11-12T17:25:46.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2150999999999999e-05 2020-11-12T17:25:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758911+0000", 2020-11-12T17:25:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8439999999999998e-06 2020-11-12T17:25:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.758919+0000", 2020-11-12T17:25:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019534800000000001 2020-11-12T17:25:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760873+0000", 2020-11-12T17:25:46.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6598000000000001e-05 2020-11-12T17:25:46.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.760949+0000", 2020-11-12T17:25:46.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012636900000000001 2020-11-12T17:25:46.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:46.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.761076+0000", 2020-11-12T17:25:46.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015771719999999999 2020-11-12T17:25:46.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:46.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:04.762653+0000", 2020-11-12T17:25:46.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27162882700000002 2020-11-12T17:25:46.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:46.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034282+0000", 2020-11-12T17:25:46.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7477000000000004e-05 2020-11-12T17:25:46.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034359+0000", 2020-11-12T17:25:46.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9021000000000003e-05 2020-11-12T17:25:46.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:05.034418+0000", 2020-11-12T17:25:46.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27558813300000001 2020-11-12T17:25:46.438 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.438 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.438 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.439 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5879 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:46.439 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:46.439 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 155.73577987199999, 2020-11-12T17:25:46.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999, 2020-11-12T17:25:46.439 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.439 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:46.440 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:46.440 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:46.440 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5879 2020-11-12T17:25:46.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.440 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:46.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686548+0000", 2020-11-12T17:25:46.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:25:46.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686510+0000", 2020-11-12T17:25:46.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011615799999999999 2020-11-12T17:25:46.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686626+0000", 2020-11-12T17:25:46.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6390999999999999e-05 2020-11-12T17:25:46.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686642+0000", 2020-11-12T17:25:46.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4919999999999993e-06 2020-11-12T17:25:46.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686651+0000", 2020-11-12T17:25:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021737319999999998 2020-11-12T17:25:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688825+0000", 2020-11-12T17:25:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012862299999999999 2020-11-12T17:25:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.688953+0000", 2020-11-12T17:25:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019954799999999999 2020-11-12T17:25:46.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.689153+0000", 2020-11-12T17:25:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002931987 2020-11-12T17:25:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692085+0000", 2020-11-12T17:25:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.26646165199999999 2020-11-12T17:25:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958546+0000", 2020-11-12T17:25:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0947999999999998e-05 2020-11-12T17:25:46.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958627+0000", 2020-11-12T17:25:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0217999999999999e-05 2020-11-12T17:25:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.958678+0000", 2020-11-12T17:25:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.27212977999999999 2020-11-12T17:25:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.449 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 155.73561496900001, 2020-11-12T17:25:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:25:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:46.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:25:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:46.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:25:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:25:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:25:46.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:25:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:25:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:25:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:25:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:25:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:25:46.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:25:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:25:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:25:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:25:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:25:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:25:46.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:25:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:25:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:25:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:25:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:25:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:25:46.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:25:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:46.460 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 155.7301349, 2020-11-12T17:25:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:25:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:46.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:25:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:25:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:25:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:25:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:25:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:25:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:25:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:25:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:25:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:25:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:25:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:25:46.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:25:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:25:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.467 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:25:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 147.5400133, 2020-11-12T17:25:46.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:25:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:46.469 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:25:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:25:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:25:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:25:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:25:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:25:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:25:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:25:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:25:46.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:25:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:25:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:25:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:25:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:25:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:25:46.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:25:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:25:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:25:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:25:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:25:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:25:46.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:25:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:25:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:25:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:25:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 147.532769591, 2020-11-12T17:25:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:25:46.479 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:25:46.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:25:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:25:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:25:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:25:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:25:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:25:46.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:25:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:25:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:25:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:25:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:25:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:25:46.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:25:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:33840 3.3 3:c6a571a6:::benchmark_data_smithi036_14212_object4229:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:25:46.486 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 112.429594131, 2020-11-12T17:25:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001, 2020-11-12T17:25:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:46.487 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 33840 2020-11-12T17:25:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992734+0000", 2020-11-12T17:25:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992700+0000", 2020-11-12T17:25:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013144299999999999 2020-11-12T17:25:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992832+0000", 2020-11-12T17:25:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7258000000000001e-05 2020-11-12T17:25:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992869+0000", 2020-11-12T17:25:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1294e-05 2020-11-12T17:25:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.992890+0000", 2020-11-12T17:25:46.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039534990000000001 2020-11-12T17:25:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996844+0000", 2020-11-12T17:25:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9883999999999995e-05 2020-11-12T17:25:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.996934+0000", 2020-11-12T17:25:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015021699999999999 2020-11-12T17:25:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:53.997084+0000", 2020-11-12T17:25:46.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063519960000000004 2020-11-12T17:25:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.003436+0000", 2020-11-12T17:25:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29877047099999998 2020-11-12T17:25:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302206+0000", 2020-11-12T17:25:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9221999999999997e-05 2020-11-12T17:25:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302256+0000", 2020-11-12T17:25:46.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3410000000000004e-05 2020-11-12T17:25:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302329+0000", 2020-11-12T17:25:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30959556900000001 2020-11-12T17:25:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.496 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.497 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:33840 3.3 e49/20 ondisk, result = 0)", 2020-11-12T17:25:46.497 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:46.497 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 112.421935322, 2020-11-12T17:25:46.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998, 2020-11-12T17:25:46.497 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.498 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:46.498 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:46.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000392+0000", 2020-11-12T17:25:46.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999537 2020-11-12T17:25:46.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000346+0000", 2020-11-12T17:25:46.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121014 2020-11-12T17:25:46.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.000467+0000", 2020-11-12T17:25:46.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29976937999999997 2020-11-12T17:25:46.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300236+0000", 2020-11-12T17:25:46.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5519999999999998e-06 2020-11-12T17:25:46.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.300241+0000", 2020-11-12T17:25:46.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019510510000000001 2020-11-12T17:25:46.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302192+0000", 2020-11-12T17:25:46.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:25:46.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302200+0000", 2020-11-12T17:25:46.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001428 2020-11-12T17:25:46.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:54.302343+0000", 2020-11-12T17:25:46.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30195072499999998 2020-11-12T17:25:46.504 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.504 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.504 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.504 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:46.504 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:46.505 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.536680216999997, 2020-11-12T17:25:46.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:25:46.505 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.505 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:46.505 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:46.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:46.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:46.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:25:46.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:25:46.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:25:46.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:25:46.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:25:46.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:25:46.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:25:46.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:25:46.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:25:46.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:25:46.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:25:46.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:25:46.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:25:46.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:25:46.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.511 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.512 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:304 4.b e71/69 4:d3839b57:::benchmark_data_smithi036_18856_object37:head v 71'32, mlcod=71'28)", 2020-11-12T17:25:46.512 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:46.512 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.278024174000002, 2020-11-12T17:25:46.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998, 2020-11-12T17:25:46.512 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.512 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.512 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:46.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144304+0000", 2020-11-12T17:25:46.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9998965 2020-11-12T17:25:46.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144200+0000", 2020-11-12T17:25:46.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166613 2020-11-12T17:25:46.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.144366+0000", 2020-11-12T17:25:46.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.282020573 2020-11-12T17:25:46.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426387+0000", 2020-11-12T17:25:46.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1779999999999996e-06 2020-11-12T17:25:46.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426391+0000", 2020-11-12T17:25:46.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7170999999999999e-05 2020-11-12T17:25:46.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426448+0000", 2020-11-12T17:25:46.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9868e-05 2020-11-12T17:25:46.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.426468+0000", 2020-11-12T17:25:46.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036033319999999999 2020-11-12T17:25:46.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430072+0000", 2020-11-12T17:25:46.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6007000000000001e-05 2020-11-12T17:25:46.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.430128+0000", 2020-11-12T17:25:46.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28582403299999998 2020-11-12T17:25:46.519 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.519 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.519 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.520 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:25:46.520 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:46.520 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.511410949999998, 2020-11-12T17:25:46.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:25:46.520 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.520 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.520 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:46.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:46.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:25:46.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:25:46.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:25:46.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:25:46.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:25:46.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:25:46.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:25:46.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:25:46.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:25:46.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:25:46.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:25:46.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:25:46.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:25:46.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:25:46.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:25:46.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:25:46.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:25:46.527 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.527 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.527 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.528 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:27264 4.1 4:8cfa79b8:::benchmark_data_smithi036_18856_object3407:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e81)", 2020-11-12T17:25:46.528 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:17.300229+0000", 2020-11-12T17:25:46.528 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.122098906000002, 2020-11-12T17:25:46.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29760083700000001, 2020-11-12T17:25:46.528 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.528 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.528 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:46.528 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:46.529 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:46.529 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 27264 2020-11-12T17:25:46.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.529 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300229+0000", 2020-11-12T17:25:46.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300229+0000", 2020-11-12T17:25:46.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999958 2020-11-12T17:25:46.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300187+0000", 2020-11-12T17:25:46.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101628 2020-11-12T17:25:46.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300289+0000", 2020-11-12T17:25:46.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4150000000000005e-06 2020-11-12T17:25:46.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300298+0000", 2020-11-12T17:25:46.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.998e-06 2020-11-12T17:25:46.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.300304+0000", 2020-11-12T17:25:46.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015043999999999999 2020-11-12T17:25:46.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.301808+0000", 2020-11-12T17:25:46.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013547 2020-11-12T17:25:46.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.301944+0000", 2020-11-12T17:25:46.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00092783000000000004 2020-11-12T17:25:46.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:46.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.302872+0000", 2020-11-12T17:25:46.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001891895 2020-11-12T17:25:46.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:46.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304764+0000", 2020-11-12T17:25:46.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29299214000000001 2020-11-12T17:25:46.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:46.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597756+0000", 2020-11-12T17:25:46.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3123e-05 2020-11-12T17:25:46.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597799+0000", 2020-11-12T17:25:46.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0700000000000001e-05 2020-11-12T17:25:46.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597830+0000", 2020-11-12T17:25:46.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29760083700000001 2020-11-12T17:25:46.537 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.538 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.538 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.538 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44206 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:46.538 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:46.538 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 9.8457284670000007, 2020-11-12T17:25:46.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002, 2020-11-12T17:25:46.539 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.539 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.539 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:46.539 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:46.539 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:46.539 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44206 2020-11-12T17:25:46.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.540 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:46.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:46.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:25:46.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576576+0000", 2020-11-12T17:25:46.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1733e-05 2020-11-12T17:25:46.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576637+0000", 2020-11-12T17:25:46.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3419e-05 2020-11-12T17:25:46.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576651+0000", 2020-11-12T17:25:46.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0509999999999996e-06 2020-11-12T17:25:46.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576656+0000", 2020-11-12T17:25:46.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9773e-05 2020-11-12T17:25:46.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576696+0000", 2020-11-12T17:25:46.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2999999999999997e-05 2020-11-12T17:25:46.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576789+0000", 2020-11-12T17:25:46.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137916 2020-11-12T17:25:46.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:46.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576927+0000", 2020-11-12T17:25:46.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027075860000000001 2020-11-12T17:25:46.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:46.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579634+0000", 2020-11-12T17:25:46.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.333427529 2020-11-12T17:25:46.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:46.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913062+0000", 2020-11-12T17:25:46.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2707000000000002e-05 2020-11-12T17:25:46.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913114+0000", 2020-11-12T17:25:46.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8039e-05 2020-11-12T17:25:46.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913152+0000", 2020-11-12T17:25:46.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002 2020-11-12T17:25:46.548 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.548 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.548 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.549 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:46.549 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:46.549 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 9.8455699350000003, 2020-11-12T17:25:46.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:25:46.549 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.549 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.549 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:46.550 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:46.550 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:46.550 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:25:46.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.550 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:46.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:46.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:25:46.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:25:46.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:25:46.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:25:46.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:25:46.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:25:46.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:25:46.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:25:46.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:25:46.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:25:46.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:25:46.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:25:46.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:25:46.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:46.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:25:46.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:25:46.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:46.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:25:46.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:25:46.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:46.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:25:46.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:25:46.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:25:46.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:25:46.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:25:46.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:25:46.559 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.559 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.559 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.559 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:46.559 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:46.560 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 9.8423286060000006, 2020-11-12T17:25:46.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:25:46.560 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.560 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.560 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:46.560 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:46.560 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:46.560 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:25:46.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.561 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:46.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:46.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:46.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:25:46.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:25:46.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:25:46.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:25:46.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:25:46.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:25:46.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:25:46.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:25:46.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:25:46.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:25:46.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:25:46.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:25:46.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:46.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:25:46.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:25:46.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:46.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:25:46.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:25:46.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:46.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:25:46.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:25:46.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:25:46.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:25:46.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:25:46.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:25:46.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.569 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.570 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44206 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:46.570 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.581565+0000", 2020-11-12T17:25:46.570 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 9.8407624059999996, 2020-11-12T17:25:46.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33159236600000003, 2020-11-12T17:25:46.570 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.571 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:46.571 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581565+0000", 2020-11-12T17:25:46.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581565+0000", 2020-11-12T17:25:46.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999762 2020-11-12T17:25:46.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581541+0000", 2020-11-12T17:25:46.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0001999999999999e-05 2020-11-12T17:25:46.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581601+0000", 2020-11-12T17:25:46.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33139100900000001 2020-11-12T17:25:46.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.912992+0000", 2020-11-12T17:25:46.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.391e-06 2020-11-12T17:25:46.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.912997+0000", 2020-11-12T17:25:46.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6869999999999997e-05 2020-11-12T17:25:46.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913044+0000", 2020-11-12T17:25:46.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1580000000000005e-06 2020-11-12T17:25:46.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913052+0000", 2020-11-12T17:25:46.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105784 2020-11-12T17:25:46.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913158+0000", 2020-11-12T17:25:46.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33159236600000003 2020-11-12T17:25:46.577 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.577 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.577 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.577 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44207 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:46.577 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.582601+0000", 2020-11-12T17:25:46.578 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 9.8397263269999993, 2020-11-12T17:25:46.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33232504899999998, 2020-11-12T17:25:46.578 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.578 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:46.578 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582601+0000", 2020-11-12T17:25:46.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582601+0000", 2020-11-12T17:25:46.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:25:46.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582580+0000", 2020-11-12T17:25:46.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3579999999999999e-05 2020-11-12T17:25:46.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582634+0000", 2020-11-12T17:25:46.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33216079100000001 2020-11-12T17:25:46.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914795+0000", 2020-11-12T17:25:46.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1170000000000003e-06 2020-11-12T17:25:46.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914800+0000", 2020-11-12T17:25:46.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6638999999999999e-05 2020-11-12T17:25:46.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914836+0000", 2020-11-12T17:25:46.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2330000000000003e-06 2020-11-12T17:25:46.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914843+0000", 2020-11-12T17:25:46.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3751000000000005e-05 2020-11-12T17:25:46.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914926+0000", 2020-11-12T17:25:46.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33232504899999998 2020-11-12T17:25:46.584 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.584 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.584 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.585 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44208 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:46.585 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:46.585 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 9.8391440160000005, 2020-11-12T17:25:46.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003, 2020-11-12T17:25:46.585 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.585 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:46.585 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:46.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:46.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:46.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583142+0000", 2020-11-12T17:25:46.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9876000000000004e-05 2020-11-12T17:25:46.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583242+0000", 2020-11-12T17:25:46.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33634110099999998 2020-11-12T17:25:46.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919583+0000", 2020-11-12T17:25:46.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3000000000000001e-06 2020-11-12T17:25:46.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919588+0000", 2020-11-12T17:25:46.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:25:46.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919642+0000", 2020-11-12T17:25:46.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3859999999999996e-06 2020-11-12T17:25:46.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919652+0000", 2020-11-12T17:25:46.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013921800000000001 2020-11-12T17:25:46.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919791+0000", 2020-11-12T17:25:46.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003 2020-11-12T17:25:46.591 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.591 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.592 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.592 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:25:46.592 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:25:46.592 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.4091577050000001, 2020-11-12T17:25:46.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:25:46.592 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.593 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:46.593 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:25:46.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:25:46.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:46.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:25:46.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:25:46.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:25:46.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:25:46.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:25:46.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:25:46.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:25:46.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:25:46.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:25:46.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:25:46.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:25:46.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:25:46.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:25:46.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:25:46.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.599 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.599 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:49064 4.b e94/69 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head v 94'3048, mlcod=94'3040)", 2020-11-12T17:25:46.599 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.430506+0000", 2020-11-12T17:25:46.600 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.9918219339999998, 2020-11-12T17:25:46.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33348710300000001, 2020-11-12T17:25:46.600 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:46.600 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:46.600 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:46.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:46.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430506+0000", 2020-11-12T17:25:46.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:46.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:46.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430506+0000", 2020-11-12T17:25:46.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:46.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:46.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430479+0000", 2020-11-12T17:25:46.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7113999999999995e-05 2020-11-12T17:25:46.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:46.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430546+0000", 2020-11-12T17:25:46.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32724931299999999 2020-11-12T17:25:46.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:46.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757796+0000", 2020-11-12T17:25:46.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8050000000000001e-06 2020-11-12T17:25:46.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:46.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757803+0000", 2020-11-12T17:25:46.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6453000000000003e-05 2020-11-12T17:25:46.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:46.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757859+0000", 2020-11-12T17:25:46.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7866000000000001e-05 2020-11-12T17:25:46.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:46.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757887+0000", 2020-11-12T17:25:46.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0060471960000000003 2020-11-12T17:25:46.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:46.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.763934+0000", 2020-11-12T17:25:46.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8743000000000003e-05 2020-11-12T17:25:46.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:46.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:46.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:46.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.763993+0000", 2020-11-12T17:25:46.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33348710300000001 2020-11-12T17:25:46.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.607 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:46.607 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:46.607 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:46.609 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:46.609 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:46.609 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:25:46.610 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:25:46.610 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:25:46.610 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:46.610 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:46.610 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:46.610 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:46.610 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:46.611 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:46.611 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:46.611 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:46.604+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:46.612 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:46.710 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:46.704+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:46.750 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:46.750 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:46.750 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:25:46.750 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:46.760 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:46.811 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:46.806+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:46.890 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:46.890 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:46.891 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:46.891 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:46.891 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:46.904 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:46.919 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:46.906+0000 7f2809aaf700 -1 osd.6 97 handle_osd_map injecting map crc failure 2020-11-12T17:25:46.920 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:46.906+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:46.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 55 16 52720 52704 7.48564 7.01562 0.0204554 0.0166899 2020-11-12T17:25:47.017 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:47.010+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:47.055 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:47.056 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:47.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:47.057 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:47.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.057 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:25:47.058 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:47.058 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.54087385, 2020-11-12T17:25:47.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:25:47.059 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.059 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.061 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:47.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:47.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:47.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:25:47.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:25:47.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:25:47.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:25:47.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:25:47.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:25:47.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:25:47.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:25:47.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:25:47.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:25:47.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:25:47.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:25:47.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:25:47.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:25:47.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:25:47.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:25:47.070 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.070 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.070 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.070 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:47.071 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:47.071 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 152.51886428500001, 2020-11-12T17:25:47.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:25:47.071 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.071 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.071 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.072 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:25:47.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.073 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:47.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:47.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:47.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:25:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:25:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:25:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:25:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:25:47.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:25:47.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:25:47.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:25:47.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:25:47.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:25:47.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:25:47.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:25:47.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:47.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:25:47.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:25:47.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:25:47.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:25:47.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:25:47.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:25:47.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:25:47.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:25:47.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:25:47.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:25:47.082 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.082 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.082 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.082 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:25:47.083 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:47.083 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 152.51546435099999, 2020-11-12T17:25:47.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:25:47.083 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.083 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:47.083 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:47.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:47.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:47.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:25:47.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:25:47.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:25:47.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:25:47.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:25:47.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:25:47.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:25:47.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:25:47.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:25:47.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:25:47.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:25:47.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:25:47.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:25:47.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:25:47.099 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.099 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.099 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.099 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:25:47.100 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:47.100 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.03957490400001, 2020-11-12T17:25:47.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:25:47.100 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.100 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.100 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:47.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:47.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:47.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:25:47.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:25:47.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:25:47.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:25:47.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:25:47.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:25:47.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:25:47.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:25:47.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:25:47.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:25:47.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:25:47.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:25:47.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:25:47.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:25:47.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:25:47.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:25:47.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.108 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.109 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:25:47.109 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:47.109 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 107.206880938, 2020-11-12T17:25:47.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:25:47.109 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.109 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.110 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:47.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:47.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:47.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:25:47.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:25:47.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:25:47.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:25:47.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:25:47.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:25:47.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:25:47.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:25:47.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:25:47.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:25:47.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:25:47.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:25:47.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:25:47.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:25:47.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:25:47.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:25:47.118 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.118 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.118 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.119 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:47.119 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:47.119 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.099589561000002, 2020-11-12T17:25:47.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:25:47.119 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.119 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.120 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:25:47.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.120 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:47.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:47.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:25:47.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:25:47.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:25:47.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:25:47.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:25:47.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:25:47.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:25:47.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:25:47.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:25:47.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:25:47.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:25:47.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:25:47.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:25:47.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:47.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:25:47.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:25:47.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:25:47.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:25:47.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:25:47.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:25:47.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:25:47.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:25:47.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:25:47.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:25:47.129 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.129 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.129 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.130 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:59416 3.c 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:47.131 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:47.131 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 82.517194145999994, 2020-11-12T17:25:47.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998, 2020-11-12T17:25:47.131 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.132 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.132 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.133 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.133 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.133 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59416 2020-11-12T17:25:47.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.134 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:47.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:47.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:47.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527883+0000", 2020-11-12T17:25:47.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2643000000000002e-05 2020-11-12T17:25:47.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527956+0000", 2020-11-12T17:25:47.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:25:47.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527969+0000", 2020-11-12T17:25:47.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2689999999999996e-06 2020-11-12T17:25:47.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527976+0000", 2020-11-12T17:25:47.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043768990000000001 2020-11-12T17:25:47.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532353+0000", 2020-11-12T17:25:47.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011210299999999999 2020-11-12T17:25:47.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532465+0000", 2020-11-12T17:25:47.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017931699999999999 2020-11-12T17:25:47.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:47.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532644+0000", 2020-11-12T17:25:47.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002342341 2020-11-12T17:25:47.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.534986+0000", 2020-11-12T17:25:47.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30120883700000001 2020-11-12T17:25:47.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836195+0000", 2020-11-12T17:25:47.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0408999999999995e-05 2020-11-12T17:25:47.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836276+0000", 2020-11-12T17:25:47.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1774999999999997e-05 2020-11-12T17:25:47.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836337+0000", 2020-11-12T17:25:47.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998 2020-11-12T17:25:47.158 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.158 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.158 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.159 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:25:47.160 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:47.160 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 73.622488486999998, 2020-11-12T17:25:47.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:25:47.161 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.161 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:47.161 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:47.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:47.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:25:47.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:25:47.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:25:47.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:25:47.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:25:47.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:25:47.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:25:47.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:25:47.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:25:47.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:25:47.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:25:47.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:25:47.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:25:47.175 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.175 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.176 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.177 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:25:47.177 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:47.177 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 72.503478099999995, 2020-11-12T17:25:47.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:25:47.178 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.178 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.178 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.179 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:47.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.180 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:47.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:47.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:47.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:25:47.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:25:47.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:25:47.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:25:47.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:25:47.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:25:47.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:25:47.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:25:47.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:25:47.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:25:47.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:25:47.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:25:47.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:47.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:25:47.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:25:47.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:25:47.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:25:47.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:25:47.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:25:47.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:25:47.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:25:47.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:25:47.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:25:47.199 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.199 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.199 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.199 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:25:47.199 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:47.200 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 72.487340095999997, 2020-11-12T17:25:47.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:25:47.200 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.200 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:47.200 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:47.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:47.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:47.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:25:47.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:25:47.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:25:47.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:25:47.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:25:47.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:25:47.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:25:47.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:25:47.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:25:47.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:25:47.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:25:47.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:25:47.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:25:47.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:25:47.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.210 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.210 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:25:47.211 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:47.211 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 72.482612416999999, 2020-11-12T17:25:47.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:25:47.211 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.212 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:25:47.212 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.212 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.212 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.212 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:47.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.212 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:47.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:47.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:47.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:25:47.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:25:47.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:25:47.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:25:47.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:25:47.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:25:47.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:25:47.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:25:47.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:25:47.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:25:47.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:47.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:25:47.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:25:47.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:25:47.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:25:47.218 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.219 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.219 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.219 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:424 4.8 4:15a22128:::benchmark_data_smithi036_18856_object52:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:47.219 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:47.219 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.824582679999999, 2020-11-12T17:25:47.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002, 2020-11-12T17:25:47.220 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.220 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.220 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.220 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:47.220 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:47.220 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 424 2020-11-12T17:25:47.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.221 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:47.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:47.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:47.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220491+0000", 2020-11-12T17:25:47.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7780000000000003e-05 2020-11-12T17:25:47.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220579+0000", 2020-11-12T17:25:47.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1511e-05 2020-11-12T17:25:47.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220590+0000", 2020-11-12T17:25:47.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9410000000000004e-06 2020-11-12T17:25:47.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220596+0000", 2020-11-12T17:25:47.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027076259999999999 2020-11-12T17:25:47.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223304+0000", 2020-11-12T17:25:47.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102644 2020-11-12T17:25:47.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223406+0000", 2020-11-12T17:25:47.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017898600000000001 2020-11-12T17:25:47.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:47.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223585+0000", 2020-11-12T17:25:47.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000774389 2020-11-12T17:25:47.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224360+0000", 2020-11-12T17:25:47.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30234014999999997 2020-11-12T17:25:47.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526700+0000", 2020-11-12T17:25:47.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5360999999999999e-05 2020-11-12T17:25:47.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526775+0000", 2020-11-12T17:25:47.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6470000000000001e-05 2020-11-12T17:25:47.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526812+0000", 2020-11-12T17:25:47.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002 2020-11-12T17:25:47.230 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.230 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.230 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.230 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:424 4.8 e71/69 ondisk, result = 0)", 2020-11-12T17:25:47.231 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:47.231 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.820131140999997, 2020-11-12T17:25:47.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474, 2020-11-12T17:25:47.231 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.231 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:47.231 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:47.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:47.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:47.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224949+0000", 2020-11-12T17:25:47.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8579000000000003e-05 2020-11-12T17:25:47.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.225008+0000", 2020-11-12T17:25:47.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30161437000000002 2020-11-12T17:25:47.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526622+0000", 2020-11-12T17:25:47.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1900000000000003e-06 2020-11-12T17:25:47.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526628+0000", 2020-11-12T17:25:47.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8828000000000001e-05 2020-11-12T17:25:47.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526676+0000", 2020-11-12T17:25:47.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1576000000000001e-05 2020-11-12T17:25:47.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526688+0000", 2020-11-12T17:25:47.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012879999999999999 2020-11-12T17:25:47.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526817+0000", 2020-11-12T17:25:47.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474 2020-11-12T17:25:47.237 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11951 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:47.238 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:47.239 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.954112828, 2020-11-12T17:25:47.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998, 2020-11-12T17:25:47.239 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.239 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.239 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:47.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:47.240 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11951 2020-11-12T17:25:47.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.240 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:47.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:47.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:25:47.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090956+0000", 2020-11-12T17:25:47.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110012 2020-11-12T17:25:47.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091066+0000", 2020-11-12T17:25:47.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2517000000000001e-05 2020-11-12T17:25:47.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091078+0000", 2020-11-12T17:25:47.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.421e-06 2020-11-12T17:25:47.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091085+0000", 2020-11-12T17:25:47.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052388110000000003 2020-11-12T17:25:47.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096323+0000", 2020-11-12T17:25:47.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010759 2020-11-12T17:25:47.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096431+0000", 2020-11-12T17:25:47.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018636600000000001 2020-11-12T17:25:47.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:47.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096617+0000", 2020-11-12T17:25:47.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018824309999999999 2020-11-12T17:25:47.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098500+0000", 2020-11-12T17:25:47.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29523157 2020-11-12T17:25:47.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393731+0000", 2020-11-12T17:25:47.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7910999999999994e-05 2020-11-12T17:25:47.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393799+0000", 2020-11-12T17:25:47.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101962 2020-11-12T17:25:47.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393901+0000", 2020-11-12T17:25:47.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998 2020-11-12T17:25:47.249 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.249 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.249 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.250 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11952 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:47.250 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:47.250 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.953962007000001, 2020-11-12T17:25:47.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002, 2020-11-12T17:25:47.250 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.251 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.251 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.251 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:47.251 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:47.251 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11952 2020-11-12T17:25:47.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.252 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:47.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:47.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:47.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091107+0000", 2020-11-12T17:25:47.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011024200000000001 2020-11-12T17:25:47.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091218+0000", 2020-11-12T17:25:47.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2203e-05 2020-11-12T17:25:47.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091230+0000", 2020-11-12T17:25:47.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.694e-06 2020-11-12T17:25:47.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091236+0000", 2020-11-12T17:25:47.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076783260000000001 2020-11-12T17:25:47.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098914+0000", 2020-11-12T17:25:47.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3187000000000001e-05 2020-11-12T17:25:47.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099007+0000", 2020-11-12T17:25:47.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016888299999999999 2020-11-12T17:25:47.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:47.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099176+0000", 2020-11-12T17:25:47.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012571570000000001 2020-11-12T17:25:47.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100433+0000", 2020-11-12T17:25:47.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29596956499999999 2020-11-12T17:25:47.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396403+0000", 2020-11-12T17:25:47.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0348999999999999e-05 2020-11-12T17:25:47.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396483+0000", 2020-11-12T17:25:47.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8981000000000003e-05 2020-11-12T17:25:47.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396542+0000", 2020-11-12T17:25:47.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002 2020-11-12T17:25:47.265 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.265 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.265 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.265 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11951 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:47.265 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:47.266 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.946434582999998, 2020-11-12T17:25:47.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998, 2020-11-12T17:25:47.266 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.266 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:47.266 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:47.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:47.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:47.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098644+0000", 2020-11-12T17:25:47.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2123000000000001e-05 2020-11-12T17:25:47.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098706+0000", 2020-11-12T17:25:47.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.294880011 2020-11-12T17:25:47.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393586+0000", 2020-11-12T17:25:47.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:47.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393595+0000", 2020-11-12T17:25:47.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115302 2020-11-12T17:25:47.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393710+0000", 2020-11-12T17:25:47.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2968e-05 2020-11-12T17:25:47.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393723+0000", 2020-11-12T17:25:47.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018932500000000001 2020-11-12T17:25:47.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393913+0000", 2020-11-12T17:25:47.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998 2020-11-12T17:25:47.275 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.276 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.276 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.277 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11952 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:47.277 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:47.277 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.944334806999997, 2020-11-12T17:25:47.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999, 2020-11-12T17:25:47.278 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.278 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:47.278 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:47.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:47.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:47.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100743+0000", 2020-11-12T17:25:47.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2359000000000004e-05 2020-11-12T17:25:47.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100805+0000", 2020-11-12T17:25:47.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29550863300000002 2020-11-12T17:25:47.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396314+0000", 2020-11-12T17:25:47.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6940000000000003e-06 2020-11-12T17:25:47.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396318+0000", 2020-11-12T17:25:47.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8325999999999997e-05 2020-11-12T17:25:47.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396377+0000", 2020-11-12T17:25:47.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4015999999999999e-05 2020-11-12T17:25:47.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396391+0000", 2020-11-12T17:25:47.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015908 2020-11-12T17:25:47.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396550+0000", 2020-11-12T17:25:47.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999 2020-11-12T17:25:47.291 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.291 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.292 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.293 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:27264 4.1 e81/69 4:8cfa79b8:::benchmark_data_smithi036_18856_object3407:head v 81'1736, mlcod=81'1730)", 2020-11-12T17:25:47.293 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:47.293 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.740785016, 2020-11-12T17:25:47.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999, 2020-11-12T17:25:47.294 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.294 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.295 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 7, 6] out_osds: [2, 1] dead_osds: [2] live_osds: [0, 3, 4, 5, 6, 7, 1] 2020-11-12T17:25:47.295 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:25:47.295 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 1.000000 2020-11-12T17:25:47.295 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd primary-affinity 5 1 2020-11-12T17:25:47.297 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:47.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:47.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:47.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304300+0000", 2020-11-12T17:25:47.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0590000000000001e-05 2020-11-12T17:25:47.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304360+0000", 2020-11-12T17:25:47.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29159615 2020-11-12T17:25:47.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595957+0000", 2020-11-12T17:25:47.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9299999999999997e-06 2020-11-12T17:25:47.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595963+0000", 2020-11-12T17:25:47.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8519000000000001e-05 2020-11-12T17:25:47.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596012+0000", 2020-11-12T17:25:47.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3053000000000001e-05 2020-11-12T17:25:47.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596035+0000", 2020-11-12T17:25:47.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001402122 2020-11-12T17:25:47.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597437+0000", 2020-11-12T17:25:47.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0948999999999997e-05 2020-11-12T17:25:47.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597478+0000", 2020-11-12T17:25:47.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999 2020-11-12T17:25:47.304 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.304 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.304 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.304 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:25:47.305 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:47.305 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.101053350000001, 2020-11-12T17:25:47.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:25:47.305 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.305 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.305 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.306 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:47.306 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:47.306 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:25:47.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.306 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:47.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:47.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:47.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:25:47.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:25:47.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:25:47.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:25:47.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:25:47.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:25:47.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:25:47.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:25:47.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:25:47.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:25:47.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:25:47.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:25:47.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:47.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:25:47.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:25:47.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:25:47.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:25:47.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:25:47.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:25:47.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:25:47.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:25:47.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:25:47.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:25:47.316 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.316 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.316 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.316 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:25:47.316 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:47.317 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.095499529000001, 2020-11-12T17:25:47.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:25:47.317 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.317 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:47.317 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:47.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:47.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:47.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:25:47.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:25:47.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:25:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:25:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:25:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:25:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:25:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:25:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:25:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:25:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:25:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:25:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:25:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:25:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.324 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.324 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:47.324 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:47.325 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:47.290+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:47.398 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:47.394+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:47.476 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:47.476 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:47.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53184 4.5 4:a2711735:::benchmark_data_smithi036_18856_object6647:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:25:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:47.468007+0000", 2020-11-12T17:25:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0088287360000000002, 2020-11-12T17:25:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0088579109999999996, 2020-11-12T17:25:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53184 2020-11-12T17:25:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.468007+0000", 2020-11-12T17:25:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.468007+0000", 2020-11-12T17:25:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:25:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.467977+0000", 2020-11-12T17:25:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7627999999999995e-05 2020-11-12T17:25:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.468065+0000", 2020-11-12T17:25:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0947e-05 2020-11-12T17:25:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.468076+0000", 2020-11-12T17:25:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5029999999999997e-06 2020-11-12T17:25:47.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.468081+0000", 2020-11-12T17:25:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003055987 2020-11-12T17:25:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.471137+0000", 2020-11-12T17:25:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012699900000000001 2020-11-12T17:25:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.471264+0000", 2020-11-12T17:25:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000209915 2020-11-12T17:25:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.471474+0000", 2020-11-12T17:25:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022077619999999998 2020-11-12T17:25:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.473682+0000", 2020-11-12T17:25:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056750560000000004 2020-11-12T17:25:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:53193 4.e e98/69 4:79156bdf:::benchmark_data_smithi036_18856_object6649:head v 98'3249, mlcod=98'3247)", 2020-11-12T17:25:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:47.471442+0000", 2020-11-12T17:25:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.005393966, 2020-11-12T17:25:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055224380000000002, 2020-11-12T17:25:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.471442+0000", 2020-11-12T17:25:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.471442+0000", 2020-11-12T17:25:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.471420+0000", 2020-11-12T17:25:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4112999999999999e-05 2020-11-12T17:25:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.471504+0000", 2020-11-12T17:25:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025262399999999999 2020-11-12T17:25:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.474030+0000", 2020-11-12T17:25:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.494e-06 2020-11-12T17:25:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.474036+0000", 2020-11-12T17:25:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3810000000000002e-05 2020-11-12T17:25:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.474080+0000", 2020-11-12T17:25:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0657999999999997e-05 2020-11-12T17:25:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.474111+0000", 2020-11-12T17:25:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002669435 2020-11-12T17:25:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:53194 4.e e98/69 4:79156bdf:::benchmark_data_smithi036_18856_object6649:head v 98'3250, mlcod=98'3247)", 2020-11-12T17:25:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:47.474233+0000", 2020-11-12T17:25:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0026026589999999998, 2020-11-12T17:25:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027997679999999998, 2020-11-12T17:25:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.474233+0000", 2020-11-12T17:25:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.474233+0000", 2020-11-12T17:25:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.474211+0000", 2020-11-12T17:25:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7366000000000004e-05 2020-11-12T17:25:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.474288+0000", 2020-11-12T17:25:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00150147 2020-11-12T17:25:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.475789+0000", 2020-11-12T17:25:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1399999999999999e-05 2020-11-12T17:25:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.475801+0000", 2020-11-12T17:25:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0066999999999999e-05 2020-11-12T17:25:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.475861+0000", 2020-11-12T17:25:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3383999999999998e-05 2020-11-12T17:25:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:47.475884+0000", 2020-11-12T17:25:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001651401 2020-11-12T17:25:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 3 2020-11-12T17:25:47.510 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:47.512 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:47.510+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:47.512 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:47.621 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:47.616+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:47.699 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:47.699 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:47.700 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:47.700 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:47.700 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:47.711 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:47.765 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:47.762+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:47.826 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:47.822+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:47.851 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:47.855 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:47.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:47.855 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:47.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.856 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:25:47.856 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:47.856 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17859110500001, 2020-11-12T17:25:47.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:25:47.856 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.856 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:47.857 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.857 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.857 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.857 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:25:47.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.857 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:47.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:47.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:25:47.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:25:47.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:25:47.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:25:47.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:25:47.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:25:47.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:25:47.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:25:47.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:25:47.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:25:47.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:25:47.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:47.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:25:47.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:25:47.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:25:47.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:25:47.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:47.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:25:47.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:25:47.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:25:47.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:25:47.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:25:47.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:25:47.880 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.880 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.880 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.881 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:47.881 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:47.882 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17818874400001, 2020-11-12T17:25:47.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:25:47.882 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.882 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.883 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.883 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.883 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.884 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:25:47.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.884 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:47.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:47.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:25:47.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:25:47.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:25:47.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:25:47.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:25:47.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:25:47.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:25:47.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:25:47.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:25:47.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:25:47.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:25:47.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:47.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:25:47.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:25:47.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:25:47.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:25:47.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:47.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:25:47.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:25:47.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:25:47.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:25:47.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:25:47.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:25:47.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:47.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:25:47.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:25:47.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:25:47.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:25:47.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:25:47.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:25:47.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:25:47.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:25:47.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:25:47.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:25:47.899 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.899 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.900 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.900 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:47.900 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:47.900 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17786475099999, 2020-11-12T17:25:47.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:25:47.901 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.901 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.901 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.901 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.901 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.901 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:25:47.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.902 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:47.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:47.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:25:47.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:25:47.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:25:47.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:25:47.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:25:47.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:25:47.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:25:47.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:25:47.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:25:47.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:25:47.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:25:47.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:47.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:25:47.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:25:47.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:25:47.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:25:47.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:47.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:25:47.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:25:47.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:25:47.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:25:47.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:25:47.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:25:47.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:47.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:25:47.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:25:47.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:25:47.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:25:47.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:25:47.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:25:47.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:25:47.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:25:47.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:25:47.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:25:47.936 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.936 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.936 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.937 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:47.938 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:47.962 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17762103999999, 2020-11-12T17:25:47.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:25:47.963 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.963 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.963 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.964 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.964 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.964 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:25:47.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.965 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:47.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:47.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:47.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:25:47.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:25:47.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:25:47.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:25:47.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:25:47.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:25:47.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:25:47.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:25:47.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:25:47.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:25:47.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:47.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:25:47.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:25:47.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:25:47.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:25:47.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:47.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:25:47.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:25:47.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:25:47.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:25:47.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:47.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:25:47.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:25:47.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:47.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:25:47.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:25:47.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:47.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:25:47.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:25:47.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:47.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:25:47.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:25:47.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:47.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:25:47.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:25:47.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:47.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:25:47.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:25:47.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.991 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:47.991 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:47.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.991 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:47.991 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:47.991 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17738289299999, 2020-11-12T17:25:47.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:25:47.992 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:47.992 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:47.992 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:47.992 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:47.992 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:47.992 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:25:47.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.993 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:47.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:47.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:47.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:47.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:47.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:47.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:25:47.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:47.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:25:47.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:25:47.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:47.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:25:47.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:25:47.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:47.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:25:47.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:25:47.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:47.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:25:47.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:25:47.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:25:47.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:25:47.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:47.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:25:47.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:25:47.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:47.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:25:47.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:25:47.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:47.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:47.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:47.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:25:47.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:25:47.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:25:48.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:25:48.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:25:48.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:25:48.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:25:48.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:25:48.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:25:48.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:25:48.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:25:48.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:25:48.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:25:48.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:25:48.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:25:48.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:48.005 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17718085300001, 2020-11-12T17:25:48.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:25:48.006 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.006 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.006 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:25:48.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.007 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:48.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:48.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:48.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:25:48.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:25:48.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:25:48.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:25:48.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:25:48.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:25:48.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:25:48.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:25:48.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:25:48.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:25:48.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:25:48.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:25:48.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:25:48.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:25:48.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:25:48.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:25:48.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:25:48.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:25:48.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:25:48.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:25:48.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:25:48.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:25:48.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:25:48.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:25:48.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:25:48.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:25:48.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:25:48.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:25:48.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:25:48.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:25:48.019 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.019 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.019 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.020 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.020 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:48.020 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17697548300001, 2020-11-12T17:25:48.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:25:48.020 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.021 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.021 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.021 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.021 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.022 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:25:48.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.022 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:48.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:48.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:48.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:25:48.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:25:48.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:25:48.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:25:48.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:25:48.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:25:48.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:25:48.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:25:48.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:25:48.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:25:48.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:25:48.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:25:48.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:25:48.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:25:48.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:25:48.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:25:48.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:25:48.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:25:48.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:25:48.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:25:48.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:25:48.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:25:48.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:25:48.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:25:48.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:25:48.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:25:48.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:25:48.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:25:48.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:25:48.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:25:48.035 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.035 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.036 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.036 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.036 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:48.036 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17678965600001, 2020-11-12T17:25:48.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:25:48.037 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.037 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.037 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.037 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.037 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.037 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:25:48.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.037 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:48.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:48.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:48.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:25:48.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:25:48.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:25:48.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:25:48.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:25:48.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:25:48.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:25:48.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:25:48.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:25:48.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:25:48.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:25:48.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:25:48.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:25:48.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:25:48.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:25:48.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:25:48.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:25:48.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:25:48.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:25:48.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:25:48.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:25:48.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:25:48.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:25:48.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:25:48.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:25:48.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:25:48.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:25:48.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:25:48.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:25:48.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:25:48.057 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.057 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.057 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.058 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.058 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:48.058 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17659269200001, 2020-11-12T17:25:48.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:25:48.058 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.059 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.059 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.059 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.059 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.059 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:25:48.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.060 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:48.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:48.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:25:48.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:25:48.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:25:48.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:25:48.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:25:48.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:25:48.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:25:48.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:25:48.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:25:48.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:25:48.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:25:48.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:25:48.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:25:48.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:25:48.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:25:48.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:25:48.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:25:48.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:25:48.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:25:48.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:25:48.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:25:48.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:25:48.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:25:48.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:25:48.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:25:48.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:25:48.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:25:48.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:25:48.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:25:48.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:25:48.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:25:48.074 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.075 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.075 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.075 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:48.075 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.176396662, 2020-11-12T17:25:48.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:25:48.076 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.076 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.076 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:25:48.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.077 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:48.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:48.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:48.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:25:48.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:25:48.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:25:48.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:25:48.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:25:48.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:25:48.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:25:48.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:25:48.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:25:48.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:25:48.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:25:48.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:25:48.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:25:48.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:25:48.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:25:48.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:25:48.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:25:48.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:25:48.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:25:48.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:25:48.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:25:48.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:25:48.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:25:48.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:25:48.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:25:48.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:25:48.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:25:48.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:25:48.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:25:48.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:25:48.090 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.090 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.090 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.091 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.091 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:48.091 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17621586199999, 2020-11-12T17:25:48.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:25:48.092 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.092 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.092 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.092 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.092 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.092 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:25:48.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.093 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:48.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:48.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:48.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:25:48.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:25:48.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:25:48.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:25:48.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:25:48.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:25:48.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:25:48.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:25:48.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:25:48.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:25:48.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:25:48.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:25:48.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:25:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:25:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:25:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:25:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:25:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:25:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:25:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:25:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:25:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:25:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:25:48.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:25:48.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:25:48.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:25:48.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:25:48.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:25:48.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:25:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:25:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17601990899999, 2020-11-12T17:25:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:25:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:25:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:25:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:25:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:25:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:25:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:25:48.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:48.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:25:48.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:25:48.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:25:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:25:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:25:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:25:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:25:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:25:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:25:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:25:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:25:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:25:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:25:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:25:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:25:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:25:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:25:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:25:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:25:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:25:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:25:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:25:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:25:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:25:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.175826301, 2020-11-12T17:25:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:25:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:25:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:25:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:25:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:25:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:25:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:25:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:25:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:25:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:25:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:25:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:25:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:25:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:25:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:25:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:25:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:25:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:25:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:25:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:25:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:25:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:25:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:25:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:25:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:25:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:25:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:25:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:25:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:25:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:25:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:25:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:25:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:25:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17551443799999, 2020-11-12T17:25:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:25:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:25:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:25:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:25:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:25:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:25:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:25:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:25:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:25:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:25:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:25:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:25:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:25:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:25:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:25:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:25:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:25:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:25:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:25:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:25:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:25:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:25:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:25:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:25:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:25:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:25:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:25:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:25:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:25:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:25:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:25:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:25:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:25:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17522694100001, 2020-11-12T17:25:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:25:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:25:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:48.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:25:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:25:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:25:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:25:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:25:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:25:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:25:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:25:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:25:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:25:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:25:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:25:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:25:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:25:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:25:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:25:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:25:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:25:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:25:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:25:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:25:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:25:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:25:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:25:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:25:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:25:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:25:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:25:48.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:25:48.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:25:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:25:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.17500656999999, 2020-11-12T17:25:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:25:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:25:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:25:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:25:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:25:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:25:48.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:25:48.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:25:48.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:25:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:25:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:25:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:25:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:25:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:25:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:25:48.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:25:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:25:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:25:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:25:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:25:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:25:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:25:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:25:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:25:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:25:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:25:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:25:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:25:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:25:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:25:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:25:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:25:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:25:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.40355272399999, 2020-11-12T17:25:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:25:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:25:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:25:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:25:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:25:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:25:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:25:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:25:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:25:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:25:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:25:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:25:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:25:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:25:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:25:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:25:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:25:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:25:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:25:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:25:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:25:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:25:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:25:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:25:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:25:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 103.083263823, 2020-11-12T17:25:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:25:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.206 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.209 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:25:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:25:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:25:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:25:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:25:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:25:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:25:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:25:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:25:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:25:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:25:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:25:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:25:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:25:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:25:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:25:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:40120 4.4 e88/69 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head v 88'2336, mlcod=88'2333)", 2020-11-12T17:25:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 15.940317621, 2020-11-12T17:25:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001, 2020-11-12T17:25:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.221 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.221 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:48.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:25:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907891+0000", 2020-11-12T17:25:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1538000000000006e-05 2020-11-12T17:25:48.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907953+0000", 2020-11-12T17:25:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56353955600000005 2020-11-12T17:25:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471493+0000", 2020-11-12T17:25:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1980000000000007e-06 2020-11-12T17:25:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471502+0000", 2020-11-12T17:25:48.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5057999999999997e-05 2020-11-12T17:25:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471597+0000", 2020-11-12T17:25:48.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4514999999999997e-05 2020-11-12T17:25:48.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471631+0000", 2020-11-12T17:25:48.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026000350000000001 2020-11-12T17:25:48.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474231+0000", 2020-11-12T17:25:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7666999999999997e-05 2020-11-12T17:25:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474269+0000", 2020-11-12T17:25:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001 2020-11-12T17:25:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44328 4.4 e91/69 4:28df349f:::benchmark_data_smithi036_18856_object5540:head v 91'2624, mlcod=90'2615)", 2020-11-12T17:25:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.053768348, 2020-11-12T17:25:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002, 2020-11-12T17:25:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794441+0000", 2020-11-12T17:25:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6031000000000005e-05 2020-11-12T17:25:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794507+0000", 2020-11-12T17:25:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48298932700000002 2020-11-12T17:25:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277496+0000", 2020-11-12T17:25:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3239999999999999e-06 2020-11-12T17:25:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277503+0000", 2020-11-12T17:25:48.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9152000000000001e-05 2020-11-12T17:25:48.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277542+0000", 2020-11-12T17:25:48.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0945999999999999e-05 2020-11-12T17:25:48.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277563+0000", 2020-11-12T17:25:48.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040876100000000002 2020-11-12T17:25:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281650+0000", 2020-11-12T17:25:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4248e-05 2020-11-12T17:25:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281705+0000", 2020-11-12T17:25:48.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002 2020-11-12T17:25:48.256 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.257 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.257 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.258 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.258 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.259 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:48.259 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:25:48.262 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 56 16 53615 53599 7.47681 6.99219 0.0100809 0.0167119 2020-11-12T17:25:48.263 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:48.258+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:48.263 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:48.362 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:48.358+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:48.395 INFO:teuthology.orchestra.run.smithi036.stderr:set osd.5 primary-affinity to 1 (8655362) 2020-11-12T17:25:48.438 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:48.438 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:48.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.439 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:54011 4.a e99/69 4:5014edb0:::benchmark_data_smithi036_18856_object6751:head v 99'3451, mlcod=99'3447)", 2020-11-12T17:25:48.439 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.434677+0000", 2020-11-12T17:25:48.439 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0043149490000000002, 2020-11-12T17:25:48.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043423890000000003, 2020-11-12T17:25:48.440 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.440 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:48.440 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.434677+0000", 2020-11-12T17:25:48.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.434677+0000", 2020-11-12T17:25:48.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:48.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.434650+0000", 2020-11-12T17:25:48.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115862 2020-11-12T17:25:48.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.434766+0000", 2020-11-12T17:25:48.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020641919999999998 2020-11-12T17:25:48.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.436830+0000", 2020-11-12T17:25:48.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4930000000000001e-06 2020-11-12T17:25:48.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.436837+0000", 2020-11-12T17:25:48.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6834000000000002e-05 2020-11-12T17:25:48.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.436924+0000", 2020-11-12T17:25:48.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9904e-05 2020-11-12T17:25:48.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.436954+0000", 2020-11-12T17:25:48.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022768829999999999 2020-11-12T17:25:48.462 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.462 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.462 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.463 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:54012 4.a e99/69 4:5014edb0:::benchmark_data_smithi036_18856_object6751:head v 99'3452, mlcod=99'3447)", 2020-11-12T17:25:48.463 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.436733+0000", 2020-11-12T17:25:48.463 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0022596600000000001, 2020-11-12T17:25:48.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023628270000000001, 2020-11-12T17:25:48.463 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.463 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:48.463 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.436733+0000", 2020-11-12T17:25:48.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.436733+0000", 2020-11-12T17:25:48.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:48.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.436704+0000", 2020-11-12T17:25:48.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010063 2020-11-12T17:25:48.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.436804+0000", 2020-11-12T17:25:48.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001752087 2020-11-12T17:25:48.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.438556+0000", 2020-11-12T17:25:48.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2869999999999998e-06 2020-11-12T17:25:48.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.438561+0000", 2020-11-12T17:25:48.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024806699999999998 2020-11-12T17:25:48.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.438809+0000", 2020-11-12T17:25:48.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5925999999999999e-05 2020-11-12T17:25:48.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.438835+0000", 2020-11-12T17:25:48.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021019260000000001 2020-11-12T17:25:48.469 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.469 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.470 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.471 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.472 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:48.472 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:25:48.472 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:48.474 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:48.476 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:48.468+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:48.575 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:48.568+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:48.612 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:48.654 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:48.654 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:48.655 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:48.655 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:48.655 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:48.663 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:48.708 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:48.706+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:48.772 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:48.776 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:48.774+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:48.797 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:48.798 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:48.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:48.798 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:48.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.798 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:25:48.799 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:48.799 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 159.95428908299999, 2020-11-12T17:25:48.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:25:48.799 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.799 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:48.799 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:48.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:48.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:48.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:25:48.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:25:48.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:25:48.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:25:48.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:25:48.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:25:48.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:25:48.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:25:48.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:25:48.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:25:48.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:25:48.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:25:48.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:25:48.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:25:48.807 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.807 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.807 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.808 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:48.808 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:48.808 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 154.39653847599999, 2020-11-12T17:25:48.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:25:48.808 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.809 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.809 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:25:48.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.809 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:48.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:48.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:48.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:25:48.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:25:48.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:25:48.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:25:48.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:25:48.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:25:48.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:25:48.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:25:48.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:25:48.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:25:48.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:25:48.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:25:48.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:48.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:25:48.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:25:48.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:25:48.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:25:48.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:25:48.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:25:48.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:25:48.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:25:48.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:25:48.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:25:48.819 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.819 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.819 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.820 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:48.820 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:48.820 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 154.39409186099999, 2020-11-12T17:25:48.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:25:48.820 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.820 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.821 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.821 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.821 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:25:48.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.821 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:48.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:48.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:48.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:25:48.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:25:48.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:25:48.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:25:48.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:25:48.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:25:48.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:25:48.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:25:48.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:25:48.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:25:48.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:25:48.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:25:48.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:48.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:25:48.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:25:48.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:25:48.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:25:48.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:25:48.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:25:48.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:25:48.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:25:48.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:25:48.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:25:48.831 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.831 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.832 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:48.832 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:48.832 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 154.38826741400001, 2020-11-12T17:25:48.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:25:48.832 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.833 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:48.833 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:48.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:48.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:48.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:25:48.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:25:48.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:25:48.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:25:48.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:25:48.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:25:48.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:25:48.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:25:48.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:25:48.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:25:48.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:25:48.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:25:48.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:25:48.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:25:48.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.839 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.840 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:48.840 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:48.840 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 154.38819953800001, 2020-11-12T17:25:48.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:25:48.840 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.840 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:48.841 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:48.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:48.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:48.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:25:48.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:25:48.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:25:48.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:25:48.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:25:48.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:25:48.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:25:48.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:25:48.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:25:48.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:25:48.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:25:48.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:25:48.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:25:48.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:25:48.847 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.847 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.847 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.847 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:25:48.847 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:48.847 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 124.26220927, 2020-11-12T17:25:48.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:25:48.848 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.848 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.848 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.848 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.848 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.848 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:25:48.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.849 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:48.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:48.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:25:48.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:25:48.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:25:48.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:25:48.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:25:48.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:25:48.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:25:48.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:25:48.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:25:48.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:25:48.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:25:48.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:25:48.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:25:48.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:48.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:25:48.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:25:48.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:25:48.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:25:48.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:25:48.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:25:48.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:25:48.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:25:48.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:25:48.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:25:48.857 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.857 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.857 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.858 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:25:48.858 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:48.858 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 124.25490555099999, 2020-11-12T17:25:48.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:25:48.858 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.859 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:48.859 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:48.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:48.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:25:48.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:25:48.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:25:48.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:25:48.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:25:48.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:25:48.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:25:48.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:25:48.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:25:48.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:25:48.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:48.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:25:48.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:25:48.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:25:48.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:25:48.865 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.865 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.865 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.865 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:48.866 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:48.866 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 123.881327058, 2020-11-12T17:25:48.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:25:48.866 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.866 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.866 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.866 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.866 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.867 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:25:48.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.867 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:48.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:48.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:48.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:25:48.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:25:48.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:25:48.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:25:48.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:25:48.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:25:48.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:25:48.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:25:48.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:25:48.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:25:48.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:25:48.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:25:48.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:48.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:25:48.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:25:48.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:25:48.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:25:48.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:25:48.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:25:48.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:25:48.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:25:48.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:25:48.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:25:48.876 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.876 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.876 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.876 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:25:48.876 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:48.877 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 123.86977393799999, 2020-11-12T17:25:48.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:25:48.877 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.877 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:48.877 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:48.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:48.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:48.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:25:48.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:25:48.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:25:48.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:25:48.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:25:48.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:25:48.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:25:48.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:25:48.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:25:48.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:25:48.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:25:48.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:25:48.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:25:48.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:25:48.884 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.884 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.884 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.884 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:48.884 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:48.884 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 118.796653757, 2020-11-12T17:25:48.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:25:48.885 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.885 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.885 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.885 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.885 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.885 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:25:48.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.886 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:48.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:48.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:48.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:25:48.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:25:48.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:25:48.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:25:48.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:25:48.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:25:48.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:25:48.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:25:48.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:25:48.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:25:48.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:25:48.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:25:48.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:48.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:25:48.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:25:48.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:25:48.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:25:48.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:25:48.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:25:48.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:25:48.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:25:48.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:25:48.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:25:48.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.894 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.895 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.895 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:48.895 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:48.895 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 109.50935404400001, 2020-11-12T17:25:48.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:25:48.896 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.896 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.896 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.896 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.896 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.896 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:25:48.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.896 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:48.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:48.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:48.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:25:48.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:25:48.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:25:48.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:25:48.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:25:48.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:25:48.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:25:48.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:25:48.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:25:48.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:25:48.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:25:48.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:25:48.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:48.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:25:48.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:25:48.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:25:48.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:25:48.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:25:48.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:25:48.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:25:48.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:25:48.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:25:48.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:25:48.905 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.905 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.905 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.906 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:48.906 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:48.906 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 108.96396105399999, 2020-11-12T17:25:48.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:25:48.906 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.906 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.907 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:48.907 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:48.907 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:48.907 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:25:48.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.907 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:48.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:48.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:48.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:25:48.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:25:48.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:25:48.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:25:48.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:25:48.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:25:48.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:25:48.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:25:48.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:25:48.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:25:48.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:25:48.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:25:48.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:48.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:25:48.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:25:48.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:48.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:25:48.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:25:48.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:48.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:25:48.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:25:48.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:25:48.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:25:48.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:25:48.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:25:48.916 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.916 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.916 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.917 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:25:48.917 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:48.917 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 86.971410793999993, 2020-11-12T17:25:48.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:25:48.917 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.917 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.917 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:48.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:48.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:48.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:25:48.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:25:48.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:25:48.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:25:48.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:25:48.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:25:48.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:25:48.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:25:48.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:25:48.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:25:48.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:25:48.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:25:48.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:25:48.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:25:48.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:25:48.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:25:48.924 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.924 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.924 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.925 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:25:48.925 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:48.925 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.135574621999993, 2020-11-12T17:25:48.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:25:48.925 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.925 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.925 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:48.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:48.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:48.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:25:48.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:25:48.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:25:48.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:25:48.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:25:48.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:25:48.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:25:48.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:25:48.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:25:48.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:25:48.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:25:48.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:25:48.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:25:48.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:25:48.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:25:48.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:25:48.939 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.939 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.939 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.940 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:1240 4.a e71/69 4:5ae32822:::benchmark_data_smithi036_18856_object154:head v 71'104, mlcod=71'98)", 2020-11-12T17:25:48.940 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:48.940 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.819360082000003, 2020-11-12T17:25:48.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295, 2020-11-12T17:25:48.940 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.940 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.941 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:48.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:48.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:48.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977341+0000", 2020-11-12T17:25:48.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013138399999999999 2020-11-12T17:25:48.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977473+0000", 2020-11-12T17:25:48.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011075199999998 2020-11-12T17:25:48.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337584+0000", 2020-11-12T17:25:48.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2939999999999994e-06 2020-11-12T17:25:48.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337593+0000", 2020-11-12T17:25:48.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0656999999999996e-05 2020-11-12T17:25:48.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337684+0000", 2020-11-12T17:25:48.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819999999999997e-05 2020-11-12T17:25:48.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337715+0000", 2020-11-12T17:25:48.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031310180000000002 2020-11-12T17:25:48.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340846+0000", 2020-11-12T17:25:48.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2611000000000002e-05 2020-11-12T17:25:48.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340889+0000", 2020-11-12T17:25:48.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295 2020-11-12T17:25:48.948 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.948 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.948 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.948 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:7176 4.0 e73/69 4:0798add9:::benchmark_data_smithi036_18856_object896:head v 73'408, mlcod=73'401)", 2020-11-12T17:25:48.949 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:48.949 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.835949550000002, 2020-11-12T17:25:48.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002, 2020-11-12T17:25:48.949 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.949 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.949 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:48.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:48.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:25:48.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960758+0000", 2020-11-12T17:25:48.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6748000000000003e-05 2020-11-12T17:25:48.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960855+0000", 2020-11-12T17:25:48.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31998174899999998 2020-11-12T17:25:48.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280837+0000", 2020-11-12T17:25:48.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8499999999999996e-06 2020-11-12T17:25:48.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280844+0000", 2020-11-12T17:25:48.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7806000000000002e-05 2020-11-12T17:25:48.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280902+0000", 2020-11-12T17:25:48.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5435e-05 2020-11-12T17:25:48.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280927+0000", 2020-11-12T17:25:48.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003038785 2020-11-12T17:25:48.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.283966+0000", 2020-11-12T17:25:48.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:25:48.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.284022+0000", 2020-11-12T17:25:48.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002 2020-11-12T17:25:48.957 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.957 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.957 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.957 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:18168 4.a e77/69 4:5a8774b4:::benchmark_data_smithi036_18856_object2270:head v 77'1272, mlcod=77'1264)", 2020-11-12T17:25:48.957 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:48.958 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.597201914999999, 2020-11-12T17:25:48.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998, 2020-11-12T17:25:48.958 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.958 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.958 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:48.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:48.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:48.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199509+0000", 2020-11-12T17:25:48.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4102000000000002e-05 2020-11-12T17:25:48.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199593+0000", 2020-11-12T17:25:48.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34680651499999998 2020-11-12T17:25:48.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546399+0000", 2020-11-12T17:25:48.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2539e-05 2020-11-12T17:25:48.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546412+0000", 2020-11-12T17:25:48.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000133242 2020-11-12T17:25:48.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546545+0000", 2020-11-12T17:25:48.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5343999999999999e-05 2020-11-12T17:25:48.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546581+0000", 2020-11-12T17:25:48.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047227149999999997 2020-11-12T17:25:48.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551303+0000", 2020-11-12T17:25:48.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112599 2020-11-12T17:25:48.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551416+0000", 2020-11-12T17:25:48.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998 2020-11-12T17:25:48.965 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.965 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.966 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.966 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:25:48.966 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:25:48.966 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.085829364, 2020-11-12T17:25:48.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:25:48.967 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.967 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.967 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:25:48.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:25:48.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:48.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:25:48.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:25:48.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:25:48.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:25:48.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:25:48.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:25:48.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:25:48.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:25:48.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:25:48.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:25:48.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:25:48.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:25:48.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:25:48.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:25:48.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:25:48.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:25:48.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.974 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.974 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:45264 4.6 e92/69 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head v 92'2672, mlcod=92'2667)", 2020-11-12T17:25:48.974 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.906823+0000", 2020-11-12T17:25:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.889912948999999, 2020-11-12T17:25:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.365396253, 2020-11-12T17:25:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906823+0000", 2020-11-12T17:25:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906823+0000", 2020-11-12T17:25:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906792+0000", 2020-11-12T17:25:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105272 2020-11-12T17:25:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906898+0000", 2020-11-12T17:25:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011942299999999 2020-11-12T17:25:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267017+0000", 2020-11-12T17:25:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1388e-05 2020-11-12T17:25:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267028+0000", 2020-11-12T17:25:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0346000000000005e-05 2020-11-12T17:25:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267119+0000", 2020-11-12T17:25:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4870000000000001e-05 2020-11-12T17:25:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267144+0000", 2020-11-12T17:25:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050235710000000001 2020-11-12T17:25:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.272167+0000", 2020-11-12T17:25:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2215000000000001e-05 2020-11-12T17:25:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.272219+0000", 2020-11-12T17:25:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.365396253 2020-11-12T17:25:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:25:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:25:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.7568868389999999, 2020-11-12T17:25:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:25:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:25:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:25:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:25:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:25:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:25:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:25:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:25:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:25:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:25:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:25:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:25:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:25:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:25:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:25:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:25:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:25:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:25:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:25:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:48.991 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:48.993 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:48.993 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:48.993 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:48.993 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:48.993 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:48.994 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:48.994 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 57 16 54437 54421 7.4583 6.42188 0.0236519 0.0167455 2020-11-12T17:25:48.994 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:48.994 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:25:48.994 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:25:48.994 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:25:48.995 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:48.995 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:48.995 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:48.995 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:48.995 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:48.995 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:48.996 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:48.996 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:48.990+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:48.997 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:25:49.094 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:49.090+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:49.116 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:49.116 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:49.126 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:25:49.196 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:49.190+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:49.242 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:49.819 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:49.821 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:49.406+0000 7f928515c700 -1 osd.7 99 handle_osd_map injecting map crc failure 2020-11-12T17:25:49.821 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:25:49.822 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:49.400+0000 7f6583748700 -1 osd.0 99 handle_osd_map injecting map crc failure 2020-11-12T17:25:49.822 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:49.816+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:49.822 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:25:49.921 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:49.916+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:49.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 58 16 55211 55195 7.43395 6.04688 0.0202007 0.0167953 2020-11-12T17:25:49.996 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:49.996 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:50.007 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:50.166 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:50.160+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:50.267 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:50.262+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:50.294 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:50.295 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:50.307 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:50.369 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:50.366+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:50.410 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:50.410 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:50.420 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:50.471 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:50.466+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:50.540 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:50.540 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:50.551 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:50.571 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:50.566+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:50.652 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:50.653 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:50.669 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:50.678 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:50.674+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:50.776 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:50.770+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:50.803 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:50.803 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:50.811 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:50.878 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:50.872+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:50.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 59 15 55938 55923 7.40434 5.6875 0.304154 0.0168574 2020-11-12T17:25:50.952 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:50.952 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:50.958 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:50.997 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:51.001 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:50.996+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:51.078 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:51.074+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:51.097 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:51.098 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:51.110 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:51.155 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:51.180 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:51.176+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:51.187 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:51.215 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:51.249 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:51.281 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:51.283 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:51.278+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:51.287 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:51.288 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:51.288 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:51.300 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:51.315 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:51.348 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:51.349 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:51.349 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:25:51.350 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:25:51.350 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:25:51.350 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:51.351 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:51.351 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:51.351 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:51.352 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:51.353 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:51.354 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:51.397 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:51.392+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:51.485 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:51.482+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:51.491 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:51.491 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:51.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:51.492 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:51.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.492 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:25:51.493 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:51.493 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 160.80036332099999, 2020-11-12T17:25:51.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:25:51.493 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.494 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.494 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.494 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:51.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:51.495 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:25:51.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.495 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:51.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:25:51.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:51.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:25:51.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:25:51.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:25:51.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:25:51.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:25:51.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:25:51.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:25:51.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:25:51.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:25:51.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:25:51.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:25:51.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:25:51.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:51.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:25:51.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:25:51.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:51.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:25:51.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:25:51.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:51.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:25:51.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:25:51.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:25:51.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:25:51.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:25:51.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:25:51.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.510 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.511 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:25:51.511 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:51.511 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 160.79488325200001, 2020-11-12T17:25:51.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:25:51.511 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.512 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:51.512 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:51.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:25:51.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:51.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:25:51.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:25:51.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:25:51.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:25:51.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:25:51.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:25:51.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:25:51.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:25:51.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:25:51.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:25:51.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:25:51.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:25:51.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:25:51.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:25:51.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.522 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.523 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:25:51.523 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:51.523 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 152.60476165200001, 2020-11-12T17:25:51.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:25:51.523 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:25:51.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:25:51.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:25:51.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:25:51.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:25:51.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:25:51.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:25:51.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:25:51.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:25:51.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:25:51.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:25:51.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:25:51.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:51.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:25:51.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:25:51.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:51.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:25:51.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:25:51.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:25:51.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:25:51.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:25:51.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:25:51.534 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.534 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.534 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.535 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:25:51.535 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:51.535 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 152.59751794300001, 2020-11-12T17:25:51.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:25:51.535 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.535 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:51.536 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:51.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:25:51.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:51.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:25:51.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:25:51.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:25:51.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:25:51.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:25:51.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:25:51.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:25:51.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:25:51.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:25:51.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:25:51.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:25:51.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:25:51.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:25:51.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:25:51.547 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.547 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.547 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.548 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:25:51.548 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:51.549 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.601428569000007, 2020-11-12T17:25:51.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:25:51.549 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.549 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:51.550 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:51.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:25:51.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:51.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:25:51.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:25:51.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:25:51.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:25:51.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:25:51.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:25:51.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:25:51.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:25:51.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:25:51.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:25:51.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:25:51.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:25:51.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:25:51.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:25:51.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.557 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.558 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:25:51.558 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:51.558 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.576159302000001, 2020-11-12T17:25:51.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:25:51.559 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.559 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.559 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:51.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:25:51.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:25:51.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:25:51.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:25:51.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:25:51.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:25:51.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:25:51.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:25:51.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:25:51.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:25:51.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:25:51.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:25:51.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:25:51.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:25:51.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:25:51.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:25:51.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:25:51.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:25:51.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.569 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.570 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44206 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:51.570 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:51.570 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 14.910476818999999, 2020-11-12T17:25:51.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002, 2020-11-12T17:25:51.570 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.571 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.571 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.571 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:51.571 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:51.571 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44206 2020-11-12T17:25:51.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.571 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:51.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:25:51.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:25:51.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576576+0000", 2020-11-12T17:25:51.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1733e-05 2020-11-12T17:25:51.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576637+0000", 2020-11-12T17:25:51.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3419e-05 2020-11-12T17:25:51.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576651+0000", 2020-11-12T17:25:51.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0509999999999996e-06 2020-11-12T17:25:51.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576656+0000", 2020-11-12T17:25:51.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9773e-05 2020-11-12T17:25:51.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576696+0000", 2020-11-12T17:25:51.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2999999999999997e-05 2020-11-12T17:25:51.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576789+0000", 2020-11-12T17:25:51.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137916 2020-11-12T17:25:51.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:51.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576927+0000", 2020-11-12T17:25:51.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027075860000000001 2020-11-12T17:25:51.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:51.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579634+0000", 2020-11-12T17:25:51.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.333427529 2020-11-12T17:25:51.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:51.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913062+0000", 2020-11-12T17:25:51.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2707000000000002e-05 2020-11-12T17:25:51.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913114+0000", 2020-11-12T17:25:51.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8039e-05 2020-11-12T17:25:51.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913152+0000", 2020-11-12T17:25:51.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002 2020-11-12T17:25:51.586 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.586 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.587 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.587 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:51.587 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:51.587 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 14.910318287000001, 2020-11-12T17:25:51.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:25:51.587 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.588 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.588 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.588 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:51.588 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:51.588 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:25:51.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.588 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:51.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:25:51.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:25:51.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:25:51.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:25:51.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:25:51.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:25:51.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:25:51.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:25:51.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:25:51.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:25:51.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:25:51.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:25:51.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:25:51.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:25:51.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:51.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:25:51.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:25:51.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:51.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:25:51.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:25:51.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:51.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:25:51.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:25:51.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:25:51.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:25:51.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:25:51.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:25:51.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.599 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.600 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:25:51.600 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:51.600 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 14.907076957999999, 2020-11-12T17:25:51.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:25:51.600 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.601 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.601 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.601 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:51.601 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:51.601 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:25:51.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.601 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:51.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:25:51.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:51.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:25:51.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:25:51.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:25:51.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:25:51.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:25:51.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:25:51.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:25:51.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:25:51.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:25:51.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:25:51.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:25:51.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:25:51.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:51.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:25:51.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:25:51.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:51.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:25:51.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:25:51.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:51.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:25:51.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:25:51.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:25:51.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:25:51.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:25:51.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:25:51.611 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.611 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.611 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.612 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44208 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:25:51.612 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:51.612 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 14.903892367999999, 2020-11-12T17:25:51.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003, 2020-11-12T17:25:51.612 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.612 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:51.613 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:51.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:25:51.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:51.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583142+0000", 2020-11-12T17:25:51.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9876000000000004e-05 2020-11-12T17:25:51.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583242+0000", 2020-11-12T17:25:51.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33634110099999998 2020-11-12T17:25:51.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919583+0000", 2020-11-12T17:25:51.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3000000000000001e-06 2020-11-12T17:25:51.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919588+0000", 2020-11-12T17:25:51.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:25:51.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919642+0000", 2020-11-12T17:25:51.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3859999999999996e-06 2020-11-12T17:25:51.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919652+0000", 2020-11-12T17:25:51.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013921800000000001 2020-11-12T17:25:51.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919791+0000", 2020-11-12T17:25:51.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003 2020-11-12T17:25:51.619 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.619 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.619 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.620 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:25:51.620 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:25:51.620 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.473906057000001, 2020-11-12T17:25:51.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:25:51.620 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.620 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:51.621 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:25:51.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:25:51.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:25:51.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:25:51.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:25:51.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:25:51.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:25:51.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:25:51.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:25:51.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:25:51.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:25:51.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:25:51.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:25:51.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:25:51.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:25:51.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:25:51.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:25:51.627 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.627 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.627 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.627 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:49064 4.b e94/69 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head v 94'3048, mlcod=94'3040)", 2020-11-12T17:25:51.628 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.430506+0000", 2020-11-12T17:25:51.628 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 9.0565702859999995, 2020-11-12T17:25:51.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33348710300000001, 2020-11-12T17:25:51.628 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.629 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.630 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430506+0000", 2020-11-12T17:25:51.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430506+0000", 2020-11-12T17:25:51.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:51.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430479+0000", 2020-11-12T17:25:51.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7113999999999995e-05 2020-11-12T17:25:51.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430546+0000", 2020-11-12T17:25:51.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32724931299999999 2020-11-12T17:25:51.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757796+0000", 2020-11-12T17:25:51.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8050000000000001e-06 2020-11-12T17:25:51.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757803+0000", 2020-11-12T17:25:51.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6453000000000003e-05 2020-11-12T17:25:51.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757859+0000", 2020-11-12T17:25:51.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7866000000000001e-05 2020-11-12T17:25:51.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757887+0000", 2020-11-12T17:25:51.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0060471960000000003 2020-11-12T17:25:51.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.763934+0000", 2020-11-12T17:25:51.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8743000000000003e-05 2020-11-12T17:25:51.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.763993+0000", 2020-11-12T17:25:51.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33348710300000001 2020-11-12T17:25:51.638 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.638 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.638 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.639 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:25:51.639 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:25:51.639 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.4248393959999999, 2020-11-12T17:25:51.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:25:51.639 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.639 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.640 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.640 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:51.640 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:51.640 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:25:51.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.640 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:25:51.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:25:51.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:25:51.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:25:51.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:25:51.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:25:51.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:25:51.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:25:51.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:25:51.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:25:51.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:25:51.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:25:51.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:25:51.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:25:51.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:25:51.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:51.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:25:51.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:25:51.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:51.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:25:51.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:25:51.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:51.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:25:51.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:25:51.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:25:51.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:25:51.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:25:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:25:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.649 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:25:51.650 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:25:51.650 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.4231586159999998, 2020-11-12T17:25:51.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:25:51.650 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.650 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.650 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.650 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:51.651 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:51.651 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:25:51.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.651 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:25:51.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:25:51.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:25:51.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:25:51.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:25:51.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:25:51.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:25:51.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:25:51.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:25:51.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:25:51.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:25:51.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:25:51.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:25:51.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:25:51.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:25:51.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:51.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:25:51.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:25:51.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:51.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:25:51.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:25:51.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:51.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:25:51.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:25:51.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:25:51.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:25:51.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:25:51.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:25:51.660 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.660 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.660 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.661 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:25:51.661 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:25:51.661 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.4230704209999998, 2020-11-12T17:25:51.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:25:51.661 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.661 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:51.662 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.662 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:51.662 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:51.662 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:25:51.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.662 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:25:51.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:25:51.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:51.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:25:51.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:25:51.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:25:51.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:25:51.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:25:51.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:25:51.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:25:51.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:25:51.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:25:51.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:25:51.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:25:51.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:25:51.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:51.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:25:51.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:25:51.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:51.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:25:51.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:25:51.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:51.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:25:51.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:25:51.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:51.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:25:51.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:25:51.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:25:51.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:25:51.671 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.672 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.672 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.672 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:25:51.672 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:25:51.672 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.4045751059999998, 2020-11-12T17:25:51.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:25:51.673 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.673 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:51.673 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:25:51.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:25:51.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:51.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:25:51.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:25:51.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:25:51.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:25:51.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:25:51.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:25:51.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:25:51.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:25:51.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:25:51.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:25:51.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:25:51.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:25:51.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:25:51.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:25:51.680 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.681 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.681 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.681 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:25:51.681 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:25:51.681 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.4044421159999998, 2020-11-12T17:25:51.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:25:51.682 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.682 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:51.682 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:25:51.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:25:51.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:51.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:25:51.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:25:51.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:25:51.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:25:51.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:25:51.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:25:51.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:25:51.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:25:51.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:25:51.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:25:51.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:25:51.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:25:51.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:25:51.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:25:51.689 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.689 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.689 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.690 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:25:51.690 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:25:51.690 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.4043573880000002, 2020-11-12T17:25:51.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:25:51.690 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.690 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:51.690 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:25:51.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:25:51.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:25:51.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:25:51.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:25:51.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:25:51.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:25:51.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:25:51.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:25:51.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:25:51.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:25:51.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:25:51.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:25:51.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:25:51.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:25:51.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:25:51.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:25:51.697 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.697 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.697 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.697 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:25:51.697 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:25:51.697 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.3527448579999999, 2020-11-12T17:25:51.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:25:51.698 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.698 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:25:51.698 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.698 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:51.698 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:51.698 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:25:51.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.699 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:25:51.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:25:51.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:25:51.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:25:51.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:25:51.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:25:51.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:25:51.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:25:51.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:25:51.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:25:51.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:25:51.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:25:51.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:25:51.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:51.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:25:51.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:25:51.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:25:51.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:25:51.705 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.705 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.705 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.706 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:25:51.707 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:25:51.707 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.3525878420000002, 2020-11-12T17:25:51.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:25:51.708 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.708 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:25:51.708 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.708 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:51.709 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:51.709 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:25:51.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.709 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:25:51.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:25:51.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:51.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:25:51.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:25:51.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:25:51.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:25:51.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:25:51.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:25:51.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:25:51.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:25:51.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:25:51.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:25:51.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:51.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:25:51.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:25:51.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:51.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:25:51.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:25:51.721 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.721 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.721 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.721 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.722 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.722 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:51.722 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:51.624+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:51.723 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:51.730 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:51.724+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:51.824 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:25:51.858 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:51.859 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:51.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.860 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:56664 4.7 4:e2c64fab:::benchmark_data_smithi036_18856_object7082:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e100)", 2020-11-12T17:25:51.860 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:51.795519+0000", 2020-11-12T17:25:51.860 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.061748741000000003, 2020-11-12T17:25:51.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.061773756999999999, 2020-11-12T17:25:51.862 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:51.862 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:51.862 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:51.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:51.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:51.863 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 56664 2020-11-12T17:25:51.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.863 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:51.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:51.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.795519+0000", 2020-11-12T17:25:51.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:51.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:51.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.795519+0000", 2020-11-12T17:25:51.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999852 2020-11-12T17:25:51.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:51.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.795504+0000", 2020-11-12T17:25:51.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3914e-05 2020-11-12T17:25:51.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:51.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.795548+0000", 2020-11-12T17:25:51.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.383e-06 2020-11-12T17:25:51.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:51.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.795554+0000", 2020-11-12T17:25:51.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.666e-06 2020-11-12T17:25:51.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:51.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.795556+0000", 2020-11-12T17:25:51.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010097948000000001 2020-11-12T17:25:51.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:51.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.805654+0000", 2020-11-12T17:25:51.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5550999999999994e-05 2020-11-12T17:25:51.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:51.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.805750+0000", 2020-11-12T17:25:51.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018761799999999999 2020-11-12T17:25:51.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 0", 2020-11-12T17:25:51.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.805937+0000", 2020-11-12T17:25:51.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004115133 2020-11-12T17:25:51.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:51.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:51.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:51.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:51.810053+0000", 2020-11-12T17:25:51.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014533661999999999 2020-11-12T17:25:51.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.870 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:51.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:51.870 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:51.871 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:25:51.871 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:51.872 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:51.873 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:51.868+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:51.932 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:25:51.932732+0000 min lat: 0.00228632 max lat: 0.869783 avg lat: 0.0169029 2020-11-12T17:25:51.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:25:51.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 60 16 56778 56762 7.39017 6.55469 0.0131385 0.0169029 2020-11-12T17:25:51.933 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:51.928+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:52.009 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:52.010 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:52.011 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:52.020 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:52.066 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:52.062+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:52.135 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:52.128+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:52.159 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:52.159 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:52.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:52.159 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:52.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.160 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:5736 3.d e25/20 3:bcdc320f:::benchmark_data_smithi036_14212_object716:head v 25'336, mlcod=25'327)", 2020-11-12T17:25:52.160 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:52.160 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 161.653552768, 2020-11-12T17:25:52.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837, 2020-11-12T17:25:52.160 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.161 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.161 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:52.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504229+0000", 2020-11-12T17:25:52.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:52.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504192+0000", 2020-11-12T17:25:52.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011728200000000001 2020-11-12T17:25:52.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.504309+0000", 2020-11-12T17:25:52.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30427027600000001 2020-11-12T17:25:52.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808579+0000", 2020-11-12T17:25:52.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4046000000000001e-05 2020-11-12T17:25:52.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808593+0000", 2020-11-12T17:25:52.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000126341 2020-11-12T17:25:52.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808720+0000", 2020-11-12T17:25:52.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2632e-05 2020-11-12T17:25:52.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.808772+0000", 2020-11-12T17:25:52.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014984569999999999 2020-11-12T17:25:52.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810271+0000", 2020-11-12T17:25:52.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000156186 2020-11-12T17:25:52.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.810427+0000", 2020-11-12T17:25:52.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30619837 2020-11-12T17:25:52.171 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.172 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.172 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.172 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:52.173 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:52.173 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.63154320300001, 2020-11-12T17:25:52.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:25:52.173 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.173 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.174 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.174 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.174 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.174 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:25:52.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.175 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:52.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:25:52.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:52.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:25:52.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:25:52.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:25:52.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:25:52.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:25:52.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:25:52.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:25:52.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:25:52.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:25:52.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:25:52.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:25:52.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:25:52.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:52.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:25:52.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:25:52.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:25:52.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:25:52.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:25:52.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:25:52.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:25:52.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:25:52.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:25:52.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:25:52.185 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.185 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.186 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.186 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:25:52.186 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:52.187 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.62814326899999, 2020-11-12T17:25:52.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:25:52.187 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.187 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:52.187 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:52.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:25:52.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:52.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:25:52.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:25:52.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:25:52.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:25:52.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:25:52.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:25:52.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:25:52.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:25:52.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:25:52.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:25:52.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:25:52.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:25:52.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:25:52.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:25:52.195 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.195 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.195 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.196 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:25:52.196 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:52.196 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.15225382200001, 2020-11-12T17:25:52.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:25:52.197 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.197 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.198 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:52.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:25:52.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:25:52.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:25:52.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:25:52.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:25:52.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:25:52.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:25:52.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:25:52.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:25:52.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:25:52.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:25:52.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:25:52.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:25:52.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:25:52.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:25:52.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:25:52.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:25:52.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:25:52.209 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.209 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.209 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.210 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:39368 3.d e51/20 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head v 51'2248, mlcod=51'2244)", 2020-11-12T17:25:52.210 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:52.210 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 112.319559856, 2020-11-12T17:25:52.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002, 2020-11-12T17:25:52.211 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.211 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.211 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:52.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838222+0000", 2020-11-12T17:25:52.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999857 2020-11-12T17:25:52.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838207+0000", 2020-11-12T17:25:52.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4833999999999997e-05 2020-11-12T17:25:52.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838262+0000", 2020-11-12T17:25:52.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.308151489 2020-11-12T17:25:52.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146414+0000", 2020-11-12T17:25:52.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4097000000000001e-05 2020-11-12T17:25:52.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146428+0000", 2020-11-12T17:25:52.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015923399999999999 2020-11-12T17:25:52.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146587+0000", 2020-11-12T17:25:52.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6860000000000002e-05 2020-11-12T17:25:52.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.146634+0000", 2020-11-12T17:25:52.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024672930000000002 2020-11-12T17:25:52.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149101+0000", 2020-11-12T17:25:52.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5122000000000003e-05 2020-11-12T17:25:52.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149176+0000", 2020-11-12T17:25:52.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31095460400000002 2020-11-12T17:25:52.218 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.219 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.219 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.219 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:25:52.219 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:52.219 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 90.212268479000002, 2020-11-12T17:25:52.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:25:52.220 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.220 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.220 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.220 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.220 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.220 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:25:52.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.221 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:52.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:25:52.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:25:52.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:25:52.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:25:52.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:25:52.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:25:52.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:25:52.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:25:52.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:25:52.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:25:52.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:25:52.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:25:52.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:25:52.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:25:52.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:52.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:25:52.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:25:52.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:25:52.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:25:52.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:25:52.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:25:52.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:25:52.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:25:52.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:25:52.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:25:52.230 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.230 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.230 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.231 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:59416 3.c 3:3723ca1c:::benchmark_data_smithi036_14212_object7426:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:25:52.231 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:52.231 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 87.629873063999995, 2020-11-12T17:25:52.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998, 2020-11-12T17:25:52.231 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.231 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.231 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.232 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.232 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.232 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59416 2020-11-12T17:25:52.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.232 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:52.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527908+0000", 2020-11-12T17:25:52.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:52.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527883+0000", 2020-11-12T17:25:52.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2643000000000002e-05 2020-11-12T17:25:52.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527956+0000", 2020-11-12T17:25:52.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3878e-05 2020-11-12T17:25:52.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527969+0000", 2020-11-12T17:25:52.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2689999999999996e-06 2020-11-12T17:25:52.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.527976+0000", 2020-11-12T17:25:52.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043768990000000001 2020-11-12T17:25:52.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532353+0000", 2020-11-12T17:25:52.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011210299999999999 2020-11-12T17:25:52.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532465+0000", 2020-11-12T17:25:52.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017931699999999999 2020-11-12T17:25:52.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:52.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.532644+0000", 2020-11-12T17:25:52.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002342341 2020-11-12T17:25:52.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.534986+0000", 2020-11-12T17:25:52.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30120883700000001 2020-11-12T17:25:52.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836195+0000", 2020-11-12T17:25:52.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0408999999999995e-05 2020-11-12T17:25:52.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836276+0000", 2020-11-12T17:25:52.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1774999999999997e-05 2020-11-12T17:25:52.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.836337+0000", 2020-11-12T17:25:52.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30842900299999998 2020-11-12T17:25:52.241 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.241 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.241 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.241 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:25:52.242 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:52.242 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 78.735167404999999, 2020-11-12T17:25:52.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:25:52.242 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.242 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:52.242 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:52.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:25:52.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:25:52.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:25:52.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:25:52.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:25:52.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:25:52.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:25:52.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:25:52.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:25:52.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:25:52.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:25:52.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:25:52.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:25:52.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:25:52.248 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.248 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.248 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.249 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:25:52.249 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:52.249 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.616157017999996, 2020-11-12T17:25:52.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:25:52.249 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.249 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.250 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.250 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.250 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.250 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:52.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.250 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:52.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:25:52.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:52.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:25:52.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:25:52.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:25:52.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:25:52.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:25:52.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:25:52.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:25:52.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:25:52.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:25:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:25:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:25:52.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:25:52.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:25:52.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:25:52.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:25:52.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:25:52.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:25:52.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:25:52.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:25:52.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:25:52.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:25:52.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:25:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:25:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.259 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.260 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:25:52.260 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:52.260 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.600019013999997, 2020-11-12T17:25:52.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:25:52.260 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.260 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:52.261 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:52.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:25:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:25:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:25:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:25:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:25:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:25:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:25:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:25:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:25:52.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:25:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:25:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:25:52.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:25:52.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:25:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:25:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:25:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:25:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.595291334999999, 2020-11-12T17:25:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:25:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:25:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.269 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:25:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:25:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:25:52.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:25:52.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:25:52.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:25:52.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:25:52.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:25:52.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:25:52.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:25:52.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:25:52.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:25:52.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:25:52.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:25:52.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:25:52.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:25:52.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:25:52.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:25:52.276 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.276 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.277 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.277 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:424 4.8 4:15a22128:::benchmark_data_smithi036_18856_object52:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e71)", 2020-11-12T17:25:52.277 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:52.277 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.937261597999999, 2020-11-12T17:25:52.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002, 2020-11-12T17:25:52.278 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.278 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.278 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.278 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:52.278 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:52.278 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 424 2020-11-12T17:25:52.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.278 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:52.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220520+0000", 2020-11-12T17:25:52.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:52.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220491+0000", 2020-11-12T17:25:52.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7780000000000003e-05 2020-11-12T17:25:52.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220579+0000", 2020-11-12T17:25:52.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1511e-05 2020-11-12T17:25:52.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220590+0000", 2020-11-12T17:25:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9410000000000004e-06 2020-11-12T17:25:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.220596+0000", 2020-11-12T17:25:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027076259999999999 2020-11-12T17:25:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223304+0000", 2020-11-12T17:25:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102644 2020-11-12T17:25:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223406+0000", 2020-11-12T17:25:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017898600000000001 2020-11-12T17:25:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.223585+0000", 2020-11-12T17:25:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000774389 2020-11-12T17:25:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224360+0000", 2020-11-12T17:25:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30234014999999997 2020-11-12T17:25:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526700+0000", 2020-11-12T17:25:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5360999999999999e-05 2020-11-12T17:25:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526775+0000", 2020-11-12T17:25:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6470000000000001e-05 2020-11-12T17:25:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526812+0000", 2020-11-12T17:25:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30629192700000002 2020-11-12T17:25:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:424 4.8 e71/69 ondisk, result = 0)", 2020-11-12T17:25:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.932810058999998, 2020-11-12T17:25:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474, 2020-11-12T17:25:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224971+0000", 2020-11-12T17:25:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.224949+0000", 2020-11-12T17:25:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8579000000000003e-05 2020-11-12T17:25:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.225008+0000", 2020-11-12T17:25:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30161437000000002 2020-11-12T17:25:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526622+0000", 2020-11-12T17:25:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1900000000000003e-06 2020-11-12T17:25:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526628+0000", 2020-11-12T17:25:52.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8828000000000001e-05 2020-11-12T17:25:52.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526676+0000", 2020-11-12T17:25:52.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1576000000000001e-05 2020-11-12T17:25:52.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526688+0000", 2020-11-12T17:25:52.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012879999999999999 2020-11-12T17:25:52.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.526817+0000", 2020-11-12T17:25:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.301845474 2020-11-12T17:25:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11951 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.066791746, 2020-11-12T17:25:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998, 2020-11-12T17:25:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11951 2020-11-12T17:25:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090990+0000", 2020-11-12T17:25:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:25:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.090956+0000", 2020-11-12T17:25:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110012 2020-11-12T17:25:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091066+0000", 2020-11-12T17:25:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2517000000000001e-05 2020-11-12T17:25:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091078+0000", 2020-11-12T17:25:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.421e-06 2020-11-12T17:25:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091085+0000", 2020-11-12T17:25:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052388110000000003 2020-11-12T17:25:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096323+0000", 2020-11-12T17:25:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010759 2020-11-12T17:25:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096431+0000", 2020-11-12T17:25:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018636600000000001 2020-11-12T17:25:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.096617+0000", 2020-11-12T17:25:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018824309999999999 2020-11-12T17:25:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098500+0000", 2020-11-12T17:25:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29523157 2020-11-12T17:25:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393731+0000", 2020-11-12T17:25:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7910999999999994e-05 2020-11-12T17:25:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393799+0000", 2020-11-12T17:25:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101962 2020-11-12T17:25:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393901+0000", 2020-11-12T17:25:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30291147899999998 2020-11-12T17:25:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.307 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:11952 4.8 4:1e82e17e:::benchmark_data_smithi036_18856_object1493:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e74)", 2020-11-12T17:25:52.307 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:52.307 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.066640925000002, 2020-11-12T17:25:52.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002, 2020-11-12T17:25:52.307 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.307 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.307 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11952 2020-11-12T17:25:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091140+0000", 2020-11-12T17:25:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:25:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091107+0000", 2020-11-12T17:25:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011024200000000001 2020-11-12T17:25:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091218+0000", 2020-11-12T17:25:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2203e-05 2020-11-12T17:25:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091230+0000", 2020-11-12T17:25:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.694e-06 2020-11-12T17:25:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.091236+0000", 2020-11-12T17:25:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076783260000000001 2020-11-12T17:25:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098914+0000", 2020-11-12T17:25:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3187000000000001e-05 2020-11-12T17:25:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099007+0000", 2020-11-12T17:25:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016888299999999999 2020-11-12T17:25:52.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:52.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.099176+0000", 2020-11-12T17:25:52.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012571570000000001 2020-11-12T17:25:52.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100433+0000", 2020-11-12T17:25:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29596956499999999 2020-11-12T17:25:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396403+0000", 2020-11-12T17:25:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0348999999999999e-05 2020-11-12T17:25:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396483+0000", 2020-11-12T17:25:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8981000000000003e-05 2020-11-12T17:25:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396542+0000", 2020-11-12T17:25:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30540150100000002 2020-11-12T17:25:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.318 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11951 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:52.318 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:52.318 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.059113500999999, 2020-11-12T17:25:52.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998, 2020-11-12T17:25:52.318 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.318 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:52.318 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098668+0000", 2020-11-12T17:25:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:25:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098644+0000", 2020-11-12T17:25:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2123000000000001e-05 2020-11-12T17:25:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.098706+0000", 2020-11-12T17:25:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.294880011 2020-11-12T17:25:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393586+0000", 2020-11-12T17:25:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:25:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393595+0000", 2020-11-12T17:25:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115302 2020-11-12T17:25:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393710+0000", 2020-11-12T17:25:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2968e-05 2020-11-12T17:25:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393723+0000", 2020-11-12T17:25:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018932500000000001 2020-11-12T17:25:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.393913+0000", 2020-11-12T17:25:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29524479199999998 2020-11-12T17:25:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:11952 4.8 e74/69 ondisk, result = 0)", 2020-11-12T17:25:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.057013724999997, 2020-11-12T17:25:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999, 2020-11-12T17:25:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100768+0000", 2020-11-12T17:25:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:25:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100743+0000", 2020-11-12T17:25:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2359000000000004e-05 2020-11-12T17:25:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.100805+0000", 2020-11-12T17:25:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29550863300000002 2020-11-12T17:25:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396314+0000", 2020-11-12T17:25:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6940000000000003e-06 2020-11-12T17:25:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396318+0000", 2020-11-12T17:25:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8325999999999997e-05 2020-11-12T17:25:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396377+0000", 2020-11-12T17:25:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4015999999999999e-05 2020-11-12T17:25:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396391+0000", 2020-11-12T17:25:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015908 2020-11-12T17:25:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:02.396550+0000", 2020-11-12T17:25:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29578220399999999 2020-11-12T17:25:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:27264 4.1 e81/69 4:8cfa79b8:::benchmark_data_smithi036_18856_object3407:head v 81'1736, mlcod=81'1730)", 2020-11-12T17:25:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.853463933999997, 2020-11-12T17:25:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999, 2020-11-12T17:25:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304317+0000", 2020-11-12T17:25:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:25:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304300+0000", 2020-11-12T17:25:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0590000000000001e-05 2020-11-12T17:25:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.304360+0000", 2020-11-12T17:25:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29159615 2020-11-12T17:25:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595957+0000", 2020-11-12T17:25:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9299999999999997e-06 2020-11-12T17:25:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.595963+0000", 2020-11-12T17:25:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8519000000000001e-05 2020-11-12T17:25:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596012+0000", 2020-11-12T17:25:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3053000000000001e-05 2020-11-12T17:25:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.596035+0000", 2020-11-12T17:25:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001402122 2020-11-12T17:25:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597437+0000", 2020-11-12T17:25:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0948999999999997e-05 2020-11-12T17:25:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:17.597478+0000", 2020-11-12T17:25:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.29316066299999999 2020-11-12T17:25:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:25:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.213732268000001, 2020-11-12T17:25:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:25:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:25:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:25:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:25:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:25:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:25:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:25:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:25:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:25:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:25:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:25:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:25:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:25:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:25:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:25:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:25:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:25:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:25:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:25:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:25:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:25:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:25:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:25:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:25:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:25:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:25:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:25:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:25:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.208178447000002, 2020-11-12T17:25:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:25:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:25:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:25:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:25:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:25:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:25:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:25:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:25:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:25:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:25:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:25:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:25:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:25:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:25:52.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:25:52.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:25:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:25:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.361 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:52.363 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:52.363 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:52.358+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:52.465 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:52.458+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:52.537 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:52.537 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:52.537 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:25:52.538 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:52.548 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:52.592 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:52.590+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:52.666 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:52.660+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:52.730 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:52.731 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:52.732 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:52.732 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:52.743 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:52.788 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:52.786+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:52.867 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:52.860+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:52.872 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:52.872 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:25:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.200361843, 2020-11-12T17:25:52.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:25:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.874 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:25:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:25:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:25:52.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:25:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:25:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:25:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:25:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:25:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:25:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:25:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:25:52.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:25:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:25:52.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:25:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:25:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:25:52.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:25:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:25:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:25:52.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:25:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:25:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:25:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.889 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.892 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.199959482, 2020-11-12T17:25:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:25:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.893 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.894 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:25:52.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.894 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:52.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:52.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:25:52.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:25:52.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:25:52.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:25:52.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:25:52.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:25:52.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:25:52.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:25:52.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:25:52.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:25:52.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:25:52.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:52.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:25:52.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:25:52.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:25:52.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:25:52.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:52.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:25:52.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:25:52.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:25:52.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:25:52.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:25:52.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:25:52.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:52.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:25:52.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:25:52.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:25:52.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:25:52.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:25:52.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:25:52.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:25:52.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:25:52.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:25:52.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:25:52.908 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.908 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.908 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.909 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:52.909 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:52.909 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.199635489, 2020-11-12T17:25:52.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:25:52.909 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.909 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.909 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.910 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.910 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.910 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:25:52.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.910 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:52.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:52.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:25:52.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:25:52.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:25:52.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:25:52.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:25:52.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:25:52.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:25:52.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:25:52.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:25:52.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:25:52.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:25:52.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:52.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:25:52.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:25:52.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:25:52.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:25:52.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:52.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:25:52.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:25:52.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:25:52.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:25:52.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:25:52.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:25:52.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:52.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:25:52.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:25:52.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:25:52.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:25:52.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:25:52.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:25:52.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:25:52.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:25:52.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:25:52.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:25:52.922 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.930 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.931 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.931 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:52.931 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:52.931 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19939177800001, 2020-11-12T17:25:52.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:25:52.932 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.932 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.932 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.933 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:25:52.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.933 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:52.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:52.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:52.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:25:52.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:25:52.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:25:52.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:25:52.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:25:52.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:25:52.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:25:52.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:25:52.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:25:52.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:25:52.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:52.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:25:52.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:25:52.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:25:52.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:25:52.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:52.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:25:52.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:25:52.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:25:52.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:25:52.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:25:52.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:25:52.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:52.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:25:52.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:25:52.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:25:52.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:25:52.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:25:52.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:25:52.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:25:52.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:25:52.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:25:52.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:25:52.945 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.945 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.945 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.946 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:52.946 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:52.946 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.199153631, 2020-11-12T17:25:52.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:25:52.946 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.946 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.947 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.947 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.947 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.947 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:25:52.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.947 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:52.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:52.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:25:52.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:25:52.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:25:52.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:25:52.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:25:52.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:25:52.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:25:52.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:25:52.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:25:52.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:25:52.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:25:52.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:52.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:25:52.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:25:52.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:25:52.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:25:52.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:52.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:25:52.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:25:52.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:25:52.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:25:52.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:25:52.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:25:52.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:52.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:25:52.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:25:52.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:25:52.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:25:52.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:25:52.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:25:52.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:25:52.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:25:52.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:25:52.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:25:52.959 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.959 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.959 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.959 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:52.960 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:52.960 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.198951591, 2020-11-12T17:25:52.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:25:52.960 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.960 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.960 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.961 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.961 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.961 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:25:52.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.961 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:52.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:52.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:52.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:25:52.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:25:52.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:25:52.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:25:52.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:25:52.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:25:52.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:25:52.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:25:52.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:25:52.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:25:52.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:52.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:25:52.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:25:52.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:25:52.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:25:52.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:52.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:25:52.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:25:52.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:25:52.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:25:52.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:25:52.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:25:52.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:52.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:25:52.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:25:52.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:25:52.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:25:52.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:25:52.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:25:52.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:25:52.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:25:52.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:25:52.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:25:52.972 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.973 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.973 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.973 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:52.973 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:52.973 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19874622099999, 2020-11-12T17:25:52.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:25:52.974 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.974 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.974 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.974 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.974 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.974 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:25:52.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.975 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:52.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:52.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:52.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:25:52.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:25:52.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:25:52.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:25:52.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:25:52.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:25:52.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:25:52.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:25:52.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:25:52.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:25:52.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:52.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:25:52.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:25:52.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:25:52.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:25:52.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:52.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:25:52.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:25:52.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:25:52.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:25:52.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:25:52.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:25:52.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:52.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:25:52.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:25:52.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:25:52.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:25:52.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:25:52.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:25:52.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:52.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:25:52.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:25:52.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:52.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:25:52.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:25:52.987 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.987 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:52.987 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:52.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.987 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:52.987 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:52.988 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.198560394, 2020-11-12T17:25:52.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:25:52.988 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:52.988 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:52.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:52.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:52.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:52.989 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:25:52.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.989 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:52.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:52.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:52.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:52.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:52.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:52.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:52.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:52.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:25:52.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:25:52.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:52.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:25:52.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:25:52.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:52.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:25:52.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:25:52.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:52.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:25:52.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:25:52.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:25:52.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:25:52.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:52.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:25:52.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:25:52.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:25:52.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:25:52.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:52.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:25:52.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:25:52.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:52.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:25:52.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:25:52.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:52.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:25:52.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:25:52.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:52.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:25:52.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:25:52.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:52.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:25:52.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:25:52.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:52.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:52.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:52.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:25:52.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:25:53.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:25:53.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:25:53.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:25:53.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:25:53.001 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.001 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.001 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.002 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:53.002 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:53.002 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19836343, 2020-11-12T17:25:53.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:25:53.002 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.002 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.002 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.003 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.003 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:25:53.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.003 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:53.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:53.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:25:53.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:25:53.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:25:53.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:25:53.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:25:53.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:25:53.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:25:53.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:25:53.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:25:53.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:25:53.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:25:53.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:53.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:25:53.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:25:53.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:25:53.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:25:53.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:53.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:25:53.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:25:53.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:25:53.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:25:53.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:25:53.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:25:53.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:53.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:25:53.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:25:53.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:25:53.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:25:53.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:25:53.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:25:53.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:25:53.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:25:53.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:25:53.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:25:53.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.014 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.015 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.015 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:53.015 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:53.015 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19816739999999, 2020-11-12T17:25:53.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:25:53.015 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.016 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.016 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.016 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.016 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.016 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:25:53.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.016 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:53.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:53.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:53.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:25:53.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:25:53.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:25:53.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:25:53.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:25:53.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:25:53.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:25:53.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:25:53.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:25:53.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:25:53.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:53.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:25:53.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:25:53.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:25:53.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:25:53.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:53.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:25:53.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:25:53.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:25:53.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:25:53.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:25:53.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:25:53.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:53.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:25:53.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:25:53.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:25:53.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:25:53.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:25:53.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:25:53.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:25:53.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:25:53.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:25:53.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:25:53.028 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.028 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.028 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.028 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:53.029 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:53.029 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19798660000001, 2020-11-12T17:25:53.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:25:53.029 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.029 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.029 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.029 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.029 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.030 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:25:53.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.030 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:53.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:53.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:53.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:25:53.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:25:53.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:25:53.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:25:53.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:25:53.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:25:53.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:25:53.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:25:53.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:25:53.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:25:53.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:53.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:25:53.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:25:53.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:25:53.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:25:53.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:53.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:25:53.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:25:53.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:25:53.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:25:53.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:25:53.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:25:53.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:53.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:25:53.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:25:53.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:25:53.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:25:53.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:25:53.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:25:53.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:25:53.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:25:53.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:25:53.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:25:53.043 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.044 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.044 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.044 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:53.044 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:53.044 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19779064700001, 2020-11-12T17:25:53.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:25:53.045 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.045 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.045 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.045 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.045 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.045 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:25:53.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.046 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:53.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:53.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:53.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:25:53.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:25:53.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:25:53.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:25:53.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:25:53.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:53.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:25:53.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:25:53.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:25:53.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:25:53.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:53.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:25:53.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:25:53.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:25:53.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:25:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:25:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:25:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:25:53.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:25:53.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:25:53.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:25:53.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:53.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:25:53.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:25:53.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:25:53.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:25:53.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:25:53.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:25:53.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:25:53.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:25:53.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:25:53.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:25:53.057 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.057 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.057 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.057 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:53.058 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:53.058 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19759703899999, 2020-11-12T17:25:53.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:25:53.058 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.058 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.058 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.058 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.059 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.059 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:25:53.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.059 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:53.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:53.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:25:53.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:25:53.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:25:53.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:25:53.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:25:53.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:25:53.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:25:53.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:25:53.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:25:53.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:25:53.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:25:53.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:53.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:25:53.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:25:53.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:25:53.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:25:53.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:53.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:25:53.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:25:53.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:25:53.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:25:53.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:25:53.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:25:53.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:53.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:25:53.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:25:53.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:25:53.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:25:53.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:25:53.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:25:53.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:25:53.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:25:53.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:25:53.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:25:53.070 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.070 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.071 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.071 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:53.071 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:53.071 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19728517600001, 2020-11-12T17:25:53.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:25:53.072 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.072 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.072 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:25:53.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.072 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:53.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:53.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:25:53.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:25:53.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:25:53.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:25:53.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:25:53.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:25:53.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:25:53.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:25:53.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:25:53.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:25:53.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:25:53.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:53.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:25:53.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:25:53.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:25:53.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:25:53.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:53.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:25:53.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:25:53.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:25:53.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:25:53.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:25:53.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:25:53.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:53.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:25:53.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:25:53.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:25:53.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:25:53.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:25:53.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:25:53.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:25:53.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:25:53.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:25:53.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:25:53.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.084 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.084 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:53.085 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:53.085 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19699767899999, 2020-11-12T17:25:53.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:25:53.085 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.085 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.085 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.085 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.086 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:25:53.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.086 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:53.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:53.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:25:53.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:25:53.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:25:53.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:25:53.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:25:53.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:25:53.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:25:53.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:25:53.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:25:53.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:25:53.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:25:53.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:53.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:25:53.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:25:53.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:25:53.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:25:53.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:53.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:25:53.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:25:53.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:25:53.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:25:53.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:25:53.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:25:53.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:53.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:25:53.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:25:53.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:25:53.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:25:53.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:25:53.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:25:53.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:25:53.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:25:53.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:25:53.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:25:53.098 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.098 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.098 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.098 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:53.098 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:53.099 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.19677730800001, 2020-11-12T17:25:53.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:25:53.099 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.099 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.099 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.099 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.099 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.100 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:25:53.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.100 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:53.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:53.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:25:53.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:25:53.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:25:53.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:25:53.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:25:53.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:25:53.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:25:53.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:25:53.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:25:53.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:25:53.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:25:53.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:53.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:25:53.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:25:53.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:25:53.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:25:53.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:53.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:25:53.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:25:53.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:25:53.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:25:53.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:25:53.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:25:53.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:53.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:25:53.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:25:53.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:25:53.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:25:53.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:25:53.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:25:53.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:25:53.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:25:53.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:25:53.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:25:53.111 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.111 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.111 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.112 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:53.112 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:53.112 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.42532346199999, 2020-11-12T17:25:53.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:25:53.112 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.112 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.113 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.113 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.113 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.113 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:25:53.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.113 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:53.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:53.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:53.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:25:53.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:25:53.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:25:53.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:25:53.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:25:53.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:25:53.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:25:53.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:25:53.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:25:53.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:25:53.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:25:53.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:25:53.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:53.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:25:53.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:25:53.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:25:53.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:25:53.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:25:53.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:25:53.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:25:53.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:25:53.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:25:53.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:25:53.122 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.122 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.122 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.122 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:25:53.123 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:53.123 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 108.105034561, 2020-11-12T17:25:53.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:25:53.123 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.123 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.123 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:53.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:53.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:53.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:25:53.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:25:53.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:25:53.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:25:53.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:25:53.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:25:53.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:25:53.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:25:53.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:25:53.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:25:53.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:25:53.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:25:53.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:25:53.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:25:53.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:25:53.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:25:53.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.130 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.131 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:40120 4.4 e88/69 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head v 88'2336, mlcod=88'2333)", 2020-11-12T17:25:53.131 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:53.131 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.962088358999999, 2020-11-12T17:25:53.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001, 2020-11-12T17:25:53.131 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.131 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.131 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:53.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:53.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:25:53.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907891+0000", 2020-11-12T17:25:53.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1538000000000006e-05 2020-11-12T17:25:53.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907953+0000", 2020-11-12T17:25:53.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56353955600000005 2020-11-12T17:25:53.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471493+0000", 2020-11-12T17:25:53.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1980000000000007e-06 2020-11-12T17:25:53.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471502+0000", 2020-11-12T17:25:53.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5057999999999997e-05 2020-11-12T17:25:53.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471597+0000", 2020-11-12T17:25:53.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4514999999999997e-05 2020-11-12T17:25:53.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471631+0000", 2020-11-12T17:25:53.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026000350000000001 2020-11-12T17:25:53.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474231+0000", 2020-11-12T17:25:53.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7666999999999997e-05 2020-11-12T17:25:53.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474269+0000", 2020-11-12T17:25:53.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001 2020-11-12T17:25:53.138 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.138 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.138 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.139 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44328 4.4 e91/69 4:28df349f:::benchmark_data_smithi036_18856_object5540:head v 91'2624, mlcod=90'2615)", 2020-11-12T17:25:53.139 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:53.139 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.075539085999999, 2020-11-12T17:25:53.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002, 2020-11-12T17:25:53.139 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.139 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.139 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:53.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:53.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:53.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794441+0000", 2020-11-12T17:25:53.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6031000000000005e-05 2020-11-12T17:25:53.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794507+0000", 2020-11-12T17:25:53.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48298932700000002 2020-11-12T17:25:53.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277496+0000", 2020-11-12T17:25:53.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3239999999999999e-06 2020-11-12T17:25:53.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277503+0000", 2020-11-12T17:25:53.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9152000000000001e-05 2020-11-12T17:25:53.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277542+0000", 2020-11-12T17:25:53.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0945999999999999e-05 2020-11-12T17:25:53.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277563+0000", 2020-11-12T17:25:53.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040876100000000002 2020-11-12T17:25:53.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281650+0000", 2020-11-12T17:25:53.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4248e-05 2020-11-12T17:25:53.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281705+0000", 2020-11-12T17:25:53.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002 2020-11-12T17:25:53.146 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.146 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.146 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.146 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.146 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.147 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:53.148 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 61 16 57540 57524 7.36661 5.95312 0.0142906 0.0169574 2020-11-12T17:25:53.149 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:25:53.149 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:53.144+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:53.149 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:53.150 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:52.942+0000 7f2809aaf700 -1 osd.6 100 handle_osd_map injecting map crc failure 2020-11-12T17:25:53.248 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:53.244+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:53.317 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:53.318 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:53.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.318 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:57833 4.8 e101/69 4:179ac0d0:::benchmark_data_smithi036_18856_object7229:head v 101'3513, mlcod=101'3511)", 2020-11-12T17:25:53.318 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:53.314728+0000", 2020-11-12T17:25:53.318 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0036120229999999998, 2020-11-12T17:25:53.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036333530000000002, 2020-11-12T17:25:53.319 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.319 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:53.319 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.314728+0000", 2020-11-12T17:25:53.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.314728+0000", 2020-11-12T17:25:53.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:53.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.314694+0000", 2020-11-12T17:25:53.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114109 2020-11-12T17:25:53.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.314808+0000", 2020-11-12T17:25:53.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2682999999999995e-05 2020-11-12T17:25:53.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.314881+0000", 2020-11-12T17:25:53.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1600000000000001e-05 2020-11-12T17:25:53.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.314892+0000", 2020-11-12T17:25:53.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5377000000000002e-05 2020-11-12T17:25:53.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.314948+0000", 2020-11-12T17:25:53.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9113000000000001e-05 2020-11-12T17:25:53.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.314977+0000", 2020-11-12T17:25:53.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024901900000000001 2020-11-12T17:25:53.325 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.325 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.326 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:57830 4.0 e101/69 4:090fc139:::benchmark_data_smithi036_18856_object7228:head v 101'3638, mlcod=101'3635)", 2020-11-12T17:25:53.326 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:53.316247+0000", 2020-11-12T17:25:53.326 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0020924139999999999, 2020-11-12T17:25:53.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021705840000000001, 2020-11-12T17:25:53.327 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.327 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:53.327 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.316247+0000", 2020-11-12T17:25:53.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.316247+0000", 2020-11-12T17:25:53.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:25:53.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.316229+0000", 2020-11-12T17:25:53.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3713999999999993e-05 2020-11-12T17:25:53.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.316293+0000", 2020-11-12T17:25:53.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6919999999999998e-05 2020-11-12T17:25:53.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.316339+0000", 2020-11-12T17:25:53.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6289999999999998e-06 2020-11-12T17:25:53.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.316345+0000", 2020-11-12T17:25:53.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5184e-05 2020-11-12T17:25:53.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.316390+0000", 2020-11-12T17:25:53.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6483e-05 2020-11-12T17:25:53.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.316417+0000", 2020-11-12T17:25:53.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169376 2020-11-12T17:25:53.332 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.332 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.332 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.333 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:57834 4.8 e101/69 4:179ac0d0:::benchmark_data_smithi036_18856_object7229:head v 101'3514, mlcod=101'3511)", 2020-11-12T17:25:53.333 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:53.317547+0000", 2020-11-12T17:25:53.333 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00079325800000000003, 2020-11-12T17:25:53.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00092130100000000002, 2020-11-12T17:25:53.333 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.334 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:53.334 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.317547+0000", 2020-11-12T17:25:53.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.317547+0000", 2020-11-12T17:25:53.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:53.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.317516+0000", 2020-11-12T17:25:53.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103712 2020-11-12T17:25:53.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.317619+0000", 2020-11-12T17:25:53.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5196000000000004e-05 2020-11-12T17:25:53.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.317684+0000", 2020-11-12T17:25:53.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5820000000000002e-06 2020-11-12T17:25:53.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.317693+0000", 2020-11-12T17:25:53.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016250999999999999 2020-11-12T17:25:53.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.317856+0000", 2020-11-12T17:25:53.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1593000000000001e-05 2020-11-12T17:25:53.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:53.317877+0000", 2020-11-12T17:25:53.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033062100000000002 2020-11-12T17:25:53.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.342 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.343 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.343 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.343 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:53.343 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 3 2020-11-12T17:25:53.343 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:53.344 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:53.350 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:53.346+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:53.357 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:53.406 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 7, 6] out_osds: [2, 1] dead_osds: [2] live_osds: [0, 3, 4, 5, 6, 7, 1] 2020-11-12T17:25:53.407 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:25:53.407 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2020-11-12T17:25:53.407 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-12T17:25:53.408 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-12T17:25:53.414 INFO:tasks.ceph.osd.2:Started 2020-11-12T17:25:53.414 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:53.459 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:53.456+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:53.472 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:53.473 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:53.473 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:53.473 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:53.473 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:53.485 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:53.519 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:53.551 INFO:teuthology.orchestra.run.smithi036.stderr:no valid command found; 10 closest matches: 2020-11-12T17:25:53.552 INFO:teuthology.orchestra.run.smithi036.stderr:0 2020-11-12T17:25:53.552 INFO:teuthology.orchestra.run.smithi036.stderr:1 2020-11-12T17:25:53.552 INFO:teuthology.orchestra.run.smithi036.stderr:2 2020-11-12T17:25:53.552 INFO:teuthology.orchestra.run.smithi036.stderr:abort 2020-11-12T17:25:53.553 INFO:teuthology.orchestra.run.smithi036.stderr:assert 2020-11-12T17:25:53.553 INFO:teuthology.orchestra.run.smithi036.stderr:config diff 2020-11-12T17:25:53.553 INFO:teuthology.orchestra.run.smithi036.stderr:config diff get 2020-11-12T17:25:53.553 INFO:teuthology.orchestra.run.smithi036.stderr:config get 2020-11-12T17:25:53.553 INFO:teuthology.orchestra.run.smithi036.stderr:config help [] 2020-11-12T17:25:53.554 INFO:teuthology.orchestra.run.smithi036.stderr:config set ... 2020-11-12T17:25:53.554 INFO:teuthology.orchestra.run.smithi036.stderr:admin_socket: invalid command 2020-11-12T17:25:53.555 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:53.548+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:53.555 DEBUG:teuthology.orchestra.run:got remote process result: 22 2020-11-12T17:25:53.555 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2020-11-12T17:25:53.559 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:53.590 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:53.622 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:25:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 164.773369976, 2020-11-12T17:25:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:25:53.625 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.625 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:53.625 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:53.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:53.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:53.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:25:53.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:25:53.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:25:53.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:25:53.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:25:53.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:25:53.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:25:53.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:25:53.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:25:53.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:25:53.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:25:53.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:25:53.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:25:53.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:25:53.635 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.635 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.635 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.636 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:53.636 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:53.636 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 159.215619369, 2020-11-12T17:25:53.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:25:53.636 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.637 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.637 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.637 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.637 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.637 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:25:53.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.637 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:53.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:53.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:53.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:25:53.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:25:53.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:25:53.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:25:53.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:25:53.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:25:53.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:25:53.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:25:53.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:25:53.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:25:53.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:25:53.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:25:53.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:53.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:25:53.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:25:53.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:25:53.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:25:53.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:25:53.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:25:53.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:25:53.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:25:53.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:25:53.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:25:53.647 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.647 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.648 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.648 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:53.648 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:53.648 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 159.213172754, 2020-11-12T17:25:53.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:25:53.649 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.649 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.649 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:25:53.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.650 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:53.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:53.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:53.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:25:53.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:25:53.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:25:53.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:25:53.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:25:53.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:25:53.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:25:53.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:25:53.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:25:53.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:25:53.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:25:53.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:25:53.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:53.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:25:53.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:25:53.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:25:53.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:25:53.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:25:53.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:25:53.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:25:53.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:25:53.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:25:53.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:25:53.659 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.660 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.660 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.660 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:53.660 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:53.661 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 159.20734830699999, 2020-11-12T17:25:53.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:25:53.661 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.661 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:53.661 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:53.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:53.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:53.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:25:53.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:25:53.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:25:53.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:25:53.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:25:53.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:25:53.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:25:53.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:25:53.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:25:53.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:25:53.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:25:53.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:25:53.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:25:53.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:25:53.668 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.668 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.668 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.668 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:53.669 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:53.669 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 159.20728043099999, 2020-11-12T17:25:53.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:25:53.669 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.669 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:53.669 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:53.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:53.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:53.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:25:53.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:25:53.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:25:53.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:25:53.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:25:53.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:25:53.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:25:53.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:25:53.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:25:53.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:25:53.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:25:53.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:25:53.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:25:53.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:25:53.676 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.676 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.676 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 129.08129016300001, 2020-11-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.677 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.678 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:25:53.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.678 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:53.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:53.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:25:53.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:25:53.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:25:53.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:25:53.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:25:53.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:25:53.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:25:53.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:25:53.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:25:53.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:25:53.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:25:53.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:25:53.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:25:53.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:53.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:25:53.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:25:53.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:25:53.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:25:53.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:25:53.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:25:53.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:25:53.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:25:53.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:25:53.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:25:53.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.688 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.688 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:25:53.688 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:53.689 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 129.07398644400001, 2020-11-12T17:25:53.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:25:53.689 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.689 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:53.689 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:53.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:53.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:25:53.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:25:53.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:25:53.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:25:53.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:25:53.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:25:53.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:25:53.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:25:53.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:25:53.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:25:53.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:53.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:25:53.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:25:53.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:25:53.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:25:53.696 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.696 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.696 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.697 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:53.697 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:53.697 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 128.70040795099999, 2020-11-12T17:25:53.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:25:53.697 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.698 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.698 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.698 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.698 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.698 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:25:53.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.698 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:53.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:53.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:53.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:25:53.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:25:53.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:25:53.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:25:53.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:25:53.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:25:53.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:25:53.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:25:53.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:25:53.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:25:53.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:25:53.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:25:53.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:53.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:25:53.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:25:53.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:25:53.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:25:53.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:25:53.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:25:53.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:25:53.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:25:53.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:25:53.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:25:53.708 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.708 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.708 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.709 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:25:53.709 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:53.709 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 128.68885483099999, 2020-11-12T17:25:53.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:25:53.709 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.710 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:53.710 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:53.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:53.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:53.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:25:53.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:25:53.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:25:53.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:25:53.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:25:53.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:25:53.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:25:53.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:25:53.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:25:53.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:25:53.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:25:53.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:25:53.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:25:53.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:25:53.716 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.716 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.716 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.717 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:53.717 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:53.717 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 123.61573464999999, 2020-11-12T17:25:53.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:25:53.717 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.717 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.718 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.718 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.718 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.718 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:25:53.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.719 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:53.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:53.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:53.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:25:53.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:25:53.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:25:53.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:25:53.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:25:53.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:25:53.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:25:53.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:25:53.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:25:53.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:25:53.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:25:53.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:25:53.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:53.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:25:53.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:25:53.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:25:53.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:25:53.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:25:53.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:25:53.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:25:53.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:25:53.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:25:53.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:25:53.728 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.728 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.728 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.728 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:53.729 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:53.729 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 114.328434937, 2020-11-12T17:25:53.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:25:53.729 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.729 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.729 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.729 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.730 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.730 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:25:53.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.730 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:53.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:53.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:53.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:25:53.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:25:53.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:25:53.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:25:53.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:25:53.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:25:53.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:25:53.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:25:53.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:25:53.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:25:53.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:25:53.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:25:53.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:53.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:25:53.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:25:53.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:25:53.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:25:53.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:25:53.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:25:53.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:25:53.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:25:53.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:25:53.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:25:53.739 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.739 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.740 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.740 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:39368 3.d 3:bf3c18a5:::benchmark_data_smithi036_14212_object4920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:53.740 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:53.740 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 113.783041947, 2020-11-12T17:25:53.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002, 2020-11-12T17:25:53.741 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.741 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.741 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:53.741 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:53.741 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:53.741 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39368 2020-11-12T17:25:53.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.742 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:53.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832775+0000", 2020-11-12T17:25:53.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:53.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832726+0000", 2020-11-12T17:25:53.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108274 2020-11-12T17:25:53.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832834+0000", 2020-11-12T17:25:53.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0851e-05 2020-11-12T17:25:53.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832845+0000", 2020-11-12T17:25:53.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1259999999999997e-06 2020-11-12T17:25:53.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.832850+0000", 2020-11-12T17:25:53.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050500440000000001 2020-11-12T17:25:53.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837900+0000", 2020-11-12T17:25:53.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2028999999999998e-05 2020-11-12T17:25:53.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.837972+0000", 2020-11-12T17:25:53.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011166399999999999 2020-11-12T17:25:53.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:53.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.838084+0000", 2020-11-12T17:25:53.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043007499999999999 2020-11-12T17:25:53.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:53.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.842384+0000", 2020-11-12T17:25:53.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.307173896 2020-11-12T17:25:53.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:53.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149558+0000", 2020-11-12T17:25:53.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:25:53.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149649+0000", 2020-11-12T17:25:53.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4185999999999998e-05 2020-11-12T17:25:53.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:00.149713+0000", 2020-11-12T17:25:53.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31693785000000002 2020-11-12T17:25:53.751 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.751 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.751 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.752 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:25:53.752 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:53.752 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 91.790491686999999, 2020-11-12T17:25:53.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:25:53.752 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.752 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.752 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:53.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:53.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:53.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:25:53.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:25:53.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:25:53.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:25:53.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:25:53.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:25:53.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:25:53.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:25:53.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:25:53.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:25:53.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:25:53.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:25:53.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:25:53.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:25:53.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:25:53.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:25:53.760 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.760 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.761 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.761 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:25:53.761 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:53.762 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 89.954655514999999, 2020-11-12T17:25:53.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:25:53.762 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.762 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.762 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:53.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:53.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:53.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:25:53.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:25:53.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:25:53.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:25:53.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:25:53.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:25:53.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:25:53.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:25:53.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:25:53.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:25:53.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:25:53.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:25:53.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:25:53.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:25:53.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:25:53.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:25:53.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.771 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.772 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:1240 4.a e71/69 4:5ae32822:::benchmark_data_smithi036_18856_object154:head v 71'104, mlcod=71'98)", 2020-11-12T17:25:53.772 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:53.773 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 60.638440975000002, 2020-11-12T17:25:53.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295, 2020-11-12T17:25:53.773 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.773 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.773 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:53.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:53.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:53.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977341+0000", 2020-11-12T17:25:53.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013138399999999999 2020-11-12T17:25:53.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977473+0000", 2020-11-12T17:25:53.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011075199999998 2020-11-12T17:25:53.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337584+0000", 2020-11-12T17:25:53.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2939999999999994e-06 2020-11-12T17:25:53.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337593+0000", 2020-11-12T17:25:53.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0656999999999996e-05 2020-11-12T17:25:53.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337684+0000", 2020-11-12T17:25:53.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819999999999997e-05 2020-11-12T17:25:53.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337715+0000", 2020-11-12T17:25:53.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031310180000000002 2020-11-12T17:25:53.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340846+0000", 2020-11-12T17:25:53.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2611000000000002e-05 2020-11-12T17:25:53.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340889+0000", 2020-11-12T17:25:53.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295 2020-11-12T17:25:53.790 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.790 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.791 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.791 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:7176 4.0 e73/69 4:0798add9:::benchmark_data_smithi036_18856_object896:head v 73'408, mlcod=73'401)", 2020-11-12T17:25:53.791 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:53.791 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.655030443000001, 2020-11-12T17:25:53.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002, 2020-11-12T17:25:53.792 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.792 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.792 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:53.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:53.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:25:53.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960758+0000", 2020-11-12T17:25:53.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6748000000000003e-05 2020-11-12T17:25:53.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960855+0000", 2020-11-12T17:25:53.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31998174899999998 2020-11-12T17:25:53.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280837+0000", 2020-11-12T17:25:53.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8499999999999996e-06 2020-11-12T17:25:53.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280844+0000", 2020-11-12T17:25:53.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7806000000000002e-05 2020-11-12T17:25:53.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280902+0000", 2020-11-12T17:25:53.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5435e-05 2020-11-12T17:25:53.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280927+0000", 2020-11-12T17:25:53.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003038785 2020-11-12T17:25:53.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.283966+0000", 2020-11-12T17:25:53.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:25:53.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.284022+0000", 2020-11-12T17:25:53.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002 2020-11-12T17:25:53.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.799 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.800 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.800 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:18168 4.a e77/69 4:5a8774b4:::benchmark_data_smithi036_18856_object2270:head v 77'1272, mlcod=77'1264)", 2020-11-12T17:25:53.800 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:53.800 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.416282807999998, 2020-11-12T17:25:53.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998, 2020-11-12T17:25:53.801 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.801 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.801 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:53.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:53.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:53.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199509+0000", 2020-11-12T17:25:53.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4102000000000002e-05 2020-11-12T17:25:53.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199593+0000", 2020-11-12T17:25:53.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34680651499999998 2020-11-12T17:25:53.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546399+0000", 2020-11-12T17:25:53.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2539e-05 2020-11-12T17:25:53.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546412+0000", 2020-11-12T17:25:53.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000133242 2020-11-12T17:25:53.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546545+0000", 2020-11-12T17:25:53.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5343999999999999e-05 2020-11-12T17:25:53.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546581+0000", 2020-11-12T17:25:53.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047227149999999997 2020-11-12T17:25:53.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551303+0000", 2020-11-12T17:25:53.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112599 2020-11-12T17:25:53.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551416+0000", 2020-11-12T17:25:53.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998 2020-11-12T17:25:53.812 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.812 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.812 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.813 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:25:53.813 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:25:53.814 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.904910257000001, 2020-11-12T17:25:53.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:25:53.814 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.814 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:25:53.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:25:53.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:53.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:25:53.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:25:53.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:25:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:25:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:25:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:25:53.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:25:53.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:25:53.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:25:53.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:25:53.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:25:53.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:25:53.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:25:53.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:25:53.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:25:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:25:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:45264 4.6 e92/69 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head v 92'2672, mlcod=92'2667)", 2020-11-12T17:25:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.906823+0000", 2020-11-12T17:25:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 15.708993842, 2020-11-12T17:25:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.365396253, 2020-11-12T17:25:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906823+0000", 2020-11-12T17:25:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906823+0000", 2020-11-12T17:25:53.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:53.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906792+0000", 2020-11-12T17:25:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105272 2020-11-12T17:25:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906898+0000", 2020-11-12T17:25:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011942299999999 2020-11-12T17:25:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267017+0000", 2020-11-12T17:25:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1388e-05 2020-11-12T17:25:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267028+0000", 2020-11-12T17:25:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0346000000000005e-05 2020-11-12T17:25:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267119+0000", 2020-11-12T17:25:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4870000000000001e-05 2020-11-12T17:25:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267144+0000", 2020-11-12T17:25:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050235710000000001 2020-11-12T17:25:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.272167+0000", 2020-11-12T17:25:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2215000000000001e-05 2020-11-12T17:25:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.272219+0000", 2020-11-12T17:25:53.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.365396253 2020-11-12T17:25:53.836 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.836 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:25:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:25:53.838 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.575967732000001, 2020-11-12T17:25:53.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:25:53.838 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:53.838 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:25:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:25:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:25:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:25:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:25:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:25:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:25:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:25:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:25:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:25:53.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:53.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:25:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:25:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:53.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:25:53.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:25:53.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:25:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:25:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:25:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:25:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.852 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:53.852 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:53.852 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:53.855 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:53.855 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:53.855 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:53.855 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:53.856 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:53.856 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:25:53.856 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:25:53.856 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:25:53.856 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:53.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:53.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:53.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:53.857 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:53.857 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:25:53.858 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:25:53.858 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:53.832+0000 7f03a1d0dd80 -1 Falling back to public interface 2020-11-12T17:25:53.859 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:53.848+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:53.859 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:25:53.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 62 16 58302 58286 7.3438 5.95312 0.0149638 0.0170081 2020-11-12T17:25:53.955 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:53.948+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:54.029 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:54.030 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:54.043 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:25:54.056 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:54.054+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:54.157 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:54.154+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:54.203 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:54.204 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:54.219 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:25:54.259 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:54.254+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:54.327 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:54.328 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:54.337 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:54.361 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:54.358+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:54.461 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:54.462 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:54.463 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:54.458+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:54.472 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:54.562 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:54.558+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:54.586 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:54.587 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:54.599 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:54.663 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:54.658+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:54.727 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:54.728 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:54.740 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:54.785 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:54.780+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:54.845 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:54.846 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:54.857 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:54.900 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:54.896+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:54.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 63 16 59148 59132 7.33213 6.60938 0.0102658 0.0170404 2020-11-12T17:25:54.965 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:54.962+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:55.028 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:55.029 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:55.038 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:55.068 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:55.062+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:55.071 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:55.068+0000 7f03a1d0dd80 -1 osd.2 93 log_to_monitors {default=true} 2020-11-12T17:25:55.150 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:25:55.168 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:55.162+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:55.203 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:55.204 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:55.217 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:55.268 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:55.264+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:55.349 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:55.350 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:55.363 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:55.368 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:55.364+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:55.469 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:55.466+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:55.492 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:55.492 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:55.504 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:55.571 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:55.568+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:55.659 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:55.660 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:55.669 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:55.773 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:55.770+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:55.774 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:55.774 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:55.783 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:55.816 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:55.670+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:55.860 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:25:55.904 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:55.900+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:55.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 64 16 59730 59714 7.2886 4.54688 0.0208326 0.0171358 2020-11-12T17:25:55.940 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:55.941 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:55.951 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:55.944+0000 7f4dea6fe700 -1 osd.1 101 handle_osd_map injecting map crc failure 2020-11-12T17:25:55.952 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:55.944+0000 7f038ead6700 -1 osd.2 93 handle_osd_map injecting map crc failure 2020-11-12T17:25:55.954 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:55.959 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:25:55.959 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:55.956+0000 7f038ead6700 -1 osd.2 93 handle_osd_map injecting map crc failure 2020-11-12T17:25:56.001 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:55.998+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:56.031 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:56.061 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:56.076 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:56.074+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:56.087 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:56.094 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:56.095 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:56.108 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:25:56.117 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:56.146 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:56.177 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:56.196 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:56.194+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:56.208 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:56.239 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:56.241 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:25:56.242 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:25:56.242 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:25:56.242 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:25:56.242 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:25:56.242 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:25:56.243 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:25:56.243 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:25:56.278 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:56.272+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:56.287 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:56.288 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:56.288 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:25:56.288 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:56.301 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:25:56.379 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:56.372+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:56.472 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:56.472 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:56.472 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:56.472 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:56.473 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:56.480 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:56.478+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:56.485 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:25:56.581 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:56.576+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:56.658 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:56.658 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:56.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:25:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.986689477, 2020-11-12T17:25:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:25:56.659 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:25:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:25:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.660 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:25:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:25:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:25:56.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:25:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:25:56.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:25:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:25:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:25:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:25:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:25:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:25:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:25:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:25:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:25:56.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:25:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:25:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:25:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:25:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:25:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:25:56.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:25:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:25:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.670 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.986287116, 2020-11-12T17:25:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:25:56.671 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:25:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.672 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:25:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:25:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:25:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:25:56.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:25:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:25:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:25:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:25:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:25:56.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:25:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:25:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:25:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:25:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:25:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:25:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:25:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:25:56.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:25:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:25:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:25:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:25:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:25:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:25:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:25:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:25:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:25:56.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:25:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:25:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:25:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:25:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:25:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:25:56.684 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.985963123, 2020-11-12T17:25:56.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:25:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.686 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:25:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:56.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:25:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:25:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:25:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:25:56.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:25:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:25:56.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:25:56.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:25:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:25:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:25:56.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:25:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:25:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:25:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:25:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:25:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:25:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:25:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:25:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:25:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:25:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:25:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:25:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:25:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:25:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:25:56.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:25:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:25:56.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:25:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:25:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:25:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:25:56.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:25:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.704 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.98571941200001, 2020-11-12T17:25:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:25:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.705 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:25:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:25:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:25:56.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:25:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:25:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:25:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:25:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:25:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:25:56.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:25:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:25:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:25:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:25:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:25:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:25:56.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:25:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:25:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:25:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:25:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:25:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:25:56.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:25:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:25:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:25:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:25:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:25:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:25:56.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:25:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:25:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:25:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:25:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:25:56.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:25:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.718 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.985481265, 2020-11-12T17:25:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:25:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.719 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:25:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:25:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:25:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:25:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:25:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:25:56.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:25:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:25:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:25:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:25:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:25:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:25:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:25:56.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:25:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:25:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:25:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:25:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:25:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:25:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:25:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:25:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:25:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:25:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:25:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:25:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:25:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:25:56.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:25:56.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:25:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:25:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:25:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:25:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:25:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.735 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.736 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.985279225, 2020-11-12T17:25:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:25:56.737 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.738 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:25:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:56.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:25:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:25:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:25:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:25:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:25:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:25:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:25:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:25:56.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:25:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:25:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:25:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:25:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:25:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:25:56.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:25:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:25:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:25:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:25:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:25:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:25:56.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:25:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:25:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:25:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:25:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:25:56.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:25:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:25:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:25:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:25:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:25:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:25:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:25:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.751 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.985073855, 2020-11-12T17:25:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:25:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:25:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:56.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:25:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:25:56.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:25:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:25:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:25:56.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:25:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:25:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:25:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:25:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:25:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:25:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:25:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:25:56.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:25:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:25:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:25:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:25:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:25:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:25:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:25:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:25:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:25:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:25:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:25:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:25:56.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:25:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:25:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:25:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:25:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:25:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:25:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.765 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.984888028, 2020-11-12T17:25:56.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:25:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:25:56.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:25:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:25:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:25:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:25:56.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:25:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:25:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:25:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:25:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:25:56.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:25:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:25:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:25:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:25:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:25:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:25:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:25:56.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:25:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:25:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:25:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:25:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:25:56.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:25:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:25:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:25:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:25:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:25:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:25:56.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:25:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:25:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:25:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:25:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:25:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.984691064, 2020-11-12T17:25:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:25:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.780 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:25:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:25:56.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:25:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:25:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:25:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:25:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:25:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:25:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:25:56.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:25:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:25:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:25:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:25:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:25:56.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:25:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:25:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:25:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:25:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:25:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:25:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:25:56.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:25:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:25:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:25:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:25:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:25:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:25:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:25:56.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:25:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:25:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:25:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:25:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:25:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.98449503399999, 2020-11-12T17:25:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:25:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.794 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:25:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:25:56.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:25:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:25:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:25:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:25:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:25:56.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:25:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:25:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:25:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:25:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:25:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:25:56.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:25:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:25:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:25:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:25:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:25:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:25:56.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:25:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:25:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:25:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:25:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:25:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:25:56.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:25:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:25:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:25:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:25:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:25:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:25:56.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:25:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.807 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.98431423400001, 2020-11-12T17:25:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:25:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.808 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:25:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:25:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:25:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:25:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:25:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:25:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:25:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:25:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:25:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:25:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:25:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:25:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:25:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:25:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:25:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:25:56.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:25:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:25:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:25:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:25:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:25:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:25:56.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:25:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:25:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:25:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:25:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:25:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:25:56.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:25:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:25:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:25:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:25:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:25:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.98411828100001, 2020-11-12T17:25:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:25:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.821 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:25:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:56.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:25:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:25:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:25:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:25:56.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:25:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:25:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:25:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:25:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:25:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:25:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:25:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:25:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:25:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:25:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:25:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:25:56.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:25:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:25:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:25:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:25:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:25:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:25:56.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:25:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:25:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:25:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:25:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:25:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:25:56.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:25:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:25:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:25:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.833 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.98392467299999, 2020-11-12T17:25:56.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:25:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:25:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.835 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:25:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:25:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:25:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:25:56.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:25:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:25:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:25:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:25:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:25:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:25:56.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:25:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:25:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:25:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:25:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:25:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:25:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:25:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:25:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:25:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:25:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:25:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:25:56.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:25:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:25:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:25:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:25:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:25:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:25:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:25:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:25:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:25:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:25:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.847 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:56.848 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.98361281000001, 2020-11-12T17:25:56.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:25:56.848 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.848 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.848 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.848 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.848 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.848 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:25:56.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.849 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:56.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:25:56.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:25:56.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:25:56.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:25:56.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:25:56.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:25:56.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:25:56.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:25:56.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:25:56.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:25:56.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:25:56.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:25:56.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:25:56.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:25:56.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:25:56.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:25:56.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:25:56.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:25:56.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:25:56.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:25:56.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:25:56.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:25:56.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:25:56.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:25:56.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:25:56.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:25:56.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:25:56.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:25:56.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:25:56.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:25:56.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:25:56.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:25:56.860 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.860 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.860 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.861 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.861 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:56.861 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.98332531299999, 2020-11-12T17:25:56.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:25:56.861 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.861 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.861 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.862 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.862 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.862 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:25:56.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.862 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:56.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:25:56.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:25:56.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:25:56.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:25:56.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:25:56.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:25:56.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:25:56.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:25:56.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:25:56.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:25:56.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:25:56.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:25:56.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:25:56.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:25:56.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:25:56.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:25:56.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:25:56.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:25:56.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:25:56.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:25:56.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:25:56.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:25:56.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:25:56.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:25:56.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:25:56.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:25:56.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:25:56.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:25:56.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:25:56.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:25:56.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:25:56.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:25:56.873 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.873 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.873 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.874 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:25:56.874 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:56.874 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.98310494200001, 2020-11-12T17:25:56.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:25:56.874 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.875 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.875 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.875 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.875 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.875 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:25:56.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.875 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:56.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:25:56.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:25:56.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:25:56.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:25:56.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:25:56.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:25:56.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:25:56.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:25:56.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:25:56.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:25:56.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:25:56.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:25:56.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:25:56.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:25:56.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:25:56.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:25:56.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:25:56.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:25:56.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:25:56.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:25:56.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:25:56.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:25:56.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:25:56.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:25:56.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:25:56.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:25:56.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:25:56.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:25:56.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:25:56.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:25:56.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:25:56.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:25:56.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:25:56.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:25:56.887 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.887 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.887 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.887 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:25496 3.a 3:5c84d46c:::benchmark_data_smithi036_14212_object3186:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:56.887 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:56.887 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.211651096, 2020-11-12T17:25:56.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002, 2020-11-12T17:25:56.888 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.888 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.888 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:56.888 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:56.888 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:56.888 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25496 2020-11-12T17:25:56.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.889 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:56.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444675+0000", 2020-11-12T17:25:56.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:56.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444644+0000", 2020-11-12T17:25:56.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8268000000000003e-05 2020-11-12T17:25:56.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444732+0000", 2020-11-12T17:25:56.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0447e-05 2020-11-12T17:25:56.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444743+0000", 2020-11-12T17:25:56.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1279999999999999e-06 2020-11-12T17:25:56.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.444748+0000", 2020-11-12T17:25:56.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028512149999999998 2020-11-12T17:25:56.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447599+0000", 2020-11-12T17:25:56.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000119527 2020-11-12T17:25:56.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447718+0000", 2020-11-12T17:25:56.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017821499999999999 2020-11-12T17:25:56.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:56.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.447897+0000", 2020-11-12T17:25:56.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024260879999999999 2020-11-12T17:25:56.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:56.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.450323+0000", 2020-11-12T17:25:56.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46553971999999999 2020-11-12T17:25:56.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:56.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915863+0000", 2020-11-12T17:25:56.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7346000000000002e-05 2020-11-12T17:25:56.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915930+0000", 2020-11-12T17:25:56.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2892000000000001e-05 2020-11-12T17:25:56.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.915983+0000", 2020-11-12T17:25:56.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47130791900000002 2020-11-12T17:25:56.897 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.897 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.897 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.898 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:43576 3.0 e53/35 3:049a1ed9:::benchmark_data_smithi036_14212_object5446:head v 53'2472, mlcod=53'2466)", 2020-11-12T17:25:56.898 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:56.898 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 111.891362195, 2020-11-12T17:25:56.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999, 2020-11-12T17:25:56.898 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.899 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.899 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:56.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764964+0000", 2020-11-12T17:25:56.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:25:56.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.764942+0000", 2020-11-12T17:25:56.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8529000000000007e-05 2020-11-12T17:25:56.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:04.765021+0000", 2020-11-12T17:25:56.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46718295799999998 2020-11-12T17:25:56.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232203+0000", 2020-11-12T17:25:56.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2200000000000003e-06 2020-11-12T17:25:56.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232211+0000", 2020-11-12T17:25:56.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2479999999999996e-05 2020-11-12T17:25:56.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232293+0000", 2020-11-12T17:25:56.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9845999999999999e-05 2020-11-12T17:25:56.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.232323+0000", 2020-11-12T17:25:56.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002034803 2020-11-12T17:25:56.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234358+0000", 2020-11-12T17:25:56.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1783000000000001e-05 2020-11-12T17:25:56.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:05.234420+0000", 2020-11-12T17:25:56.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46945587799999999 2020-11-12T17:25:56.905 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.905 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.905 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.906 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:40120 4.4 e88/69 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head v 88'2336, mlcod=88'2333)", 2020-11-12T17:25:56.906 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:56.906 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 24.748415992999998, 2020-11-12T17:25:56.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001, 2020-11-12T17:25:56.906 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.907 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.907 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:56.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:25:56.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:25:56.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907891+0000", 2020-11-12T17:25:56.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1538000000000006e-05 2020-11-12T17:25:56.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907953+0000", 2020-11-12T17:25:56.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56353955600000005 2020-11-12T17:25:56.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471493+0000", 2020-11-12T17:25:56.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1980000000000007e-06 2020-11-12T17:25:56.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471502+0000", 2020-11-12T17:25:56.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5057999999999997e-05 2020-11-12T17:25:56.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471597+0000", 2020-11-12T17:25:56.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4514999999999997e-05 2020-11-12T17:25:56.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471631+0000", 2020-11-12T17:25:56.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026000350000000001 2020-11-12T17:25:56.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474231+0000", 2020-11-12T17:25:56.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7666999999999997e-05 2020-11-12T17:25:56.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474269+0000", 2020-11-12T17:25:56.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001 2020-11-12T17:25:56.913 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.913 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.913 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.914 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44328 4.4 e91/69 4:28df349f:::benchmark_data_smithi036_18856_object5540:head v 91'2624, mlcod=90'2615)", 2020-11-12T17:25:56.914 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:56.914 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 19.861866719999998, 2020-11-12T17:25:56.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002, 2020-11-12T17:25:56.914 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:56.914 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:56.915 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:56.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:56.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:56.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:56.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:56.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:25:56.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:25:56.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:56.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794441+0000", 2020-11-12T17:25:56.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6031000000000005e-05 2020-11-12T17:25:56.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:56.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794507+0000", 2020-11-12T17:25:56.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48298932700000002 2020-11-12T17:25:56.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:56.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277496+0000", 2020-11-12T17:25:56.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3239999999999999e-06 2020-11-12T17:25:56.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:56.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277503+0000", 2020-11-12T17:25:56.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9152000000000001e-05 2020-11-12T17:25:56.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:56.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277542+0000", 2020-11-12T17:25:56.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0945999999999999e-05 2020-11-12T17:25:56.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:56.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277563+0000", 2020-11-12T17:25:56.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040876100000000002 2020-11-12T17:25:56.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:56.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281650+0000", 2020-11-12T17:25:56.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4248e-05 2020-11-12T17:25:56.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:56.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:56.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:56.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281705+0000", 2020-11-12T17:25:56.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002 2020-11-12T17:25:56.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.921 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.922 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:56.922 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:56.922 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:56.923 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:25:56.924 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:56.920+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:56.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 65 16 60494 60478 7.26829 5.96875 0.0212576 0.0171838 2020-11-12T17:25:56.965 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:56.960+0000 7f4dea6fe700 -1 osd.1 102 handle_osd_map injecting map crc failure 2020-11-12T17:25:57.025 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:57.022+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:57.053 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:57.054 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:57.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.055 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60567 4.0 e103/69 4:0b89b597:::benchmark_data_smithi036_18856_object7570:head v 103'3767, mlcod=103'3763)", 2020-11-12T17:25:57.055 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:57.053725+0000", 2020-11-12T17:25:57.055 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00064031299999999999, 2020-11-12T17:25:57.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00068059900000000005, 2020-11-12T17:25:57.056 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.056 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:57.056 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.053725+0000", 2020-11-12T17:25:57.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.053725+0000", 2020-11-12T17:25:57.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999776 2020-11-12T17:25:57.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.053703+0000", 2020-11-12T17:25:57.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8183999999999995e-05 2020-11-12T17:25:57.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.053781+0000", 2020-11-12T17:25:57.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0858000000000001e-05 2020-11-12T17:25:57.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.053822+0000", 2020-11-12T17:25:57.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5880000000000003e-06 2020-11-12T17:25:57.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.053828+0000", 2020-11-12T17:25:57.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7054000000000001e-05 2020-11-12T17:25:57.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.053865+0000", 2020-11-12T17:25:57.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9224000000000001e-05 2020-11-12T17:25:57.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.053885+0000", 2020-11-12T17:25:57.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951999999999999 2020-11-12T17:25:57.066 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.066 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.067 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.067 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.067 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:25:57.067 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:25:57.067 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:57.069 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:25:57.125 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:57.120+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:57.230 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:57.224+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:57.247 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:57.247 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:25:57.247 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:25:57.248 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:25:57.248 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:57.260 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:25:57.328 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:57.324+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:57.390 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:25:57.391 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:25:57.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:25:57.391 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:25:57.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.392 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:25:57.392 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:57.392 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 168.54618624400001, 2020-11-12T17:25:57.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:25:57.393 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.393 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:57.393 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:25:57.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:25:57.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:25:57.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:25:57.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:25:57.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:25:57.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:25:57.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:25:57.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:25:57.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:25:57.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:25:57.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:25:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:25:57.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:25:57.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:25:57.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:25:57.407 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.407 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.407 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.408 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9879 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:57.408 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:57.409 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.98843563700001, 2020-11-12T17:25:57.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997, 2020-11-12T17:25:57.410 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.410 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.410 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:57.412 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:57.412 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:57.413 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9879 2020-11-12T17:25:57.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.413 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:57.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400198+0000", 2020-11-12T17:25:57.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:25:57.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400161+0000", 2020-11-12T17:25:57.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010919100000000001 2020-11-12T17:25:57.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400270+0000", 2020-11-12T17:25:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6099999999999998e-05 2020-11-12T17:25:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400286+0000", 2020-11-12T17:25:57.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1919999999999994e-06 2020-11-12T17:25:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.400295+0000", 2020-11-12T17:25:57.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026699860000000001 2020-11-12T17:25:57.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402965+0000", 2020-11-12T17:25:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001172 2020-11-12T17:25:57.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403082+0000", 2020-11-12T17:25:57.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018919499999999999 2020-11-12T17:25:57.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403272+0000", 2020-11-12T17:25:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042906009999999998 2020-11-12T17:25:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.407562+0000", 2020-11-12T17:25:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33652416800000001 2020-11-12T17:25:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744086+0000", 2020-11-12T17:25:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018981 2020-11-12T17:25:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744276+0000", 2020-11-12T17:25:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015347399999999999 2020-11-12T17:25:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744430+0000", 2020-11-12T17:25:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34423207099999997 2020-11-12T17:25:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:25:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.98598902200001, 2020-11-12T17:25:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:25:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:25:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:25:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:25:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:25:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:25:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:25:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:25:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:25:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:25:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:25:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:25:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:25:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:25:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:25:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:25:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:25:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:25:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:25:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:25:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:25:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:25:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:25:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:25:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:25:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:25:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9879 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.980164575, 2020-11-12T17:25:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002, 2020-11-12T17:25:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408469+0000", 2020-11-12T17:25:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:25:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408442+0000", 2020-11-12T17:25:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9553999999999999e-05 2020-11-12T17:25:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408502+0000", 2020-11-12T17:25:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33529756300000002 2020-11-12T17:25:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743799+0000", 2020-11-12T17:25:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3020000000000001e-05 2020-11-12T17:25:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.743812+0000", 2020-11-12T17:25:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021717399999999999 2020-11-12T17:25:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744030+0000", 2020-11-12T17:25:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3052999999999997e-05 2020-11-12T17:25:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744063+0000", 2020-11-12T17:25:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037978699999999997 2020-11-12T17:25:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.744442+0000", 2020-11-12T17:25:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33597374200000002 2020-11-12T17:25:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:25:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.980096699, 2020-11-12T17:25:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:25:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:25:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:25:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:25:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:25:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:25:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:25:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:25:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:25:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:25:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:25:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:25:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:25:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:25:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:25:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:25:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:25:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:25:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.85410643099999, 2020-11-12T17:25:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:25:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:25:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:25:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:25:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:25:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:25:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:25:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:25:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:25:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:25:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:25:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:25:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:25:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:25:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:25:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:25:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:25:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:25:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:25:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:25:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:25:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:25:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:25:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:25:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:25:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:25:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:25:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.846802712, 2020-11-12T17:25:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:25:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:25:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:25:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:25:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:25:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:25:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:25:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:25:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:25:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:25:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:25:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:25:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:25:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:25:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:25:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:25:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:25:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:25:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.473224219, 2020-11-12T17:25:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:25:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:25:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:25:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:25:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:25:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:25:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:25:57.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:25:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:25:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:25:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:25:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:25:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:25:57.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:25:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:25:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:25:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:25:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:25:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:25:57.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:25:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:25:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:25:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:25:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:25:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:25:57.485 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:25:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:57.486 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.461671099, 2020-11-12T17:25:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:25:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:25:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:25:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:25:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:25:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:25:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:25:57.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:25:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:25:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:25:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:25:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:25:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:25:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:25:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:25:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:25:57.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:25:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:25:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:25:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.38855091800001, 2020-11-12T17:25:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:25:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.494 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:25:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:25:57.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:25:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:25:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:25:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:25:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:25:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:25:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:25:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:25:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:25:57.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:25:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:25:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:25:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:25:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:25:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:25:57.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:25:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:25:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:57.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:25:57.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:25:57.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:25:57.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:25:57.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:25:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:25:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:38792 3.d 3:b2d6dd36:::benchmark_data_smithi036_14212_object4848:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e51)", 2020-11-12T17:25:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 118.101251205, 2020-11-12T17:25:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001, 2020-11-12T17:25:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:25:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:25:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:25:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 38792 2020-11-12T17:25:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287382+0000", 2020-11-12T17:25:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:25:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287340+0000", 2020-11-12T17:25:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7817000000000002e-05 2020-11-12T17:25:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287438+0000", 2020-11-12T17:25:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1341e-05 2020-11-12T17:25:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287450+0000", 2020-11-12T17:25:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8590000000000001e-06 2020-11-12T17:25:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.287456+0000", 2020-11-12T17:25:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074907180000000004 2020-11-12T17:25:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.294946+0000", 2020-11-12T17:25:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012753999999999999 2020-11-12T17:25:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295074+0000", 2020-11-12T17:25:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021753500000000001 2020-11-12T17:25:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:25:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.295291+0000", 2020-11-12T17:25:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052740490000000003 2020-11-12T17:25:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:25:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.300565+0000", 2020-11-12T17:25:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31519515100000001 2020-11-12T17:25:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:25:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615761+0000", 2020-11-12T17:25:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9402999999999999e-05 2020-11-12T17:25:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615830+0000", 2020-11-12T17:25:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9435999999999999e-05 2020-11-12T17:25:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:59.615879+0000", 2020-11-12T17:25:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32849727400000001 2020-11-12T17:25:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:57704 3.7 e56/20 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head v 56'3640, mlcod=56'3634)", 2020-11-12T17:25:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 95.563307954999999, 2020-11-12T17:25:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999, 2020-11-12T17:25:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825325+0000", 2020-11-12T17:25:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:25:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825305+0000", 2020-11-12T17:25:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0538000000000006e-05 2020-11-12T17:25:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.825395+0000", 2020-11-12T17:25:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32226312200000001 2020-11-12T17:25:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147659+0000", 2020-11-12T17:25:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9459999999999998e-06 2020-11-12T17:25:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147666+0000", 2020-11-12T17:25:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6517000000000001e-05 2020-11-12T17:25:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147723+0000", 2020-11-12T17:25:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9721999999999999e-05 2020-11-12T17:25:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.147743+0000", 2020-11-12T17:25:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022545289999999999 2020-11-12T17:25:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.149997+0000", 2020-11-12T17:25:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3713e-05 2020-11-12T17:25:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.150041+0000", 2020-11-12T17:25:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32471565899999999 2020-11-12T17:25:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:58744 3.7 e57/20 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head v 57'3680, mlcod=57'3675)", 2020-11-12T17:25:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 93.727471782999999, 2020-11-12T17:25:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002, 2020-11-12T17:25:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661161+0000", 2020-11-12T17:25:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:25:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661138+0000", 2020-11-12T17:25:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7111000000000001e-05 2020-11-12T17:25:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:23.661215+0000", 2020-11-12T17:25:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36422102699999997 2020-11-12T17:25:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025437+0000", 2020-11-12T17:25:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4389999999999997e-06 2020-11-12T17:25:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025443+0000", 2020-11-12T17:25:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7877999999999997e-05 2020-11-12T17:25:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025501+0000", 2020-11-12T17:25:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5887999999999999e-05 2020-11-12T17:25:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.025537+0000", 2020-11-12T17:25:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030808290000000002 2020-11-12T17:25:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028618+0000", 2020-11-12T17:25:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9160999999999999e-05 2020-11-12T17:25:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:24.028667+0000", 2020-11-12T17:25:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36750523000000002 2020-11-12T17:25:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:1240 4.a e71/69 4:5ae32822:::benchmark_data_smithi036_18856_object154:head v 71'104, mlcod=71'98)", 2020-11-12T17:25:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.411257242999994, 2020-11-12T17:25:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295, 2020-11-12T17:25:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977376+0000", 2020-11-12T17:25:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999652 2020-11-12T17:25:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977341+0000", 2020-11-12T17:25:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013138399999999999 2020-11-12T17:25:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:52.977473+0000", 2020-11-12T17:25:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011075199999998 2020-11-12T17:25:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337584+0000", 2020-11-12T17:25:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2939999999999994e-06 2020-11-12T17:25:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337593+0000", 2020-11-12T17:25:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0656999999999996e-05 2020-11-12T17:25:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337684+0000", 2020-11-12T17:25:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819999999999997e-05 2020-11-12T17:25:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.337715+0000", 2020-11-12T17:25:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031310180000000002 2020-11-12T17:25:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340846+0000", 2020-11-12T17:25:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2611000000000002e-05 2020-11-12T17:25:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:53.340889+0000", 2020-11-12T17:25:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36351295 2020-11-12T17:25:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:7176 4.0 e73/69 4:0798add9:::benchmark_data_smithi036_18856_object896:head v 73'408, mlcod=73'401)", 2020-11-12T17:25:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.427846711000001, 2020-11-12T17:25:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002, 2020-11-12T17:25:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960787+0000", 2020-11-12T17:25:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:25:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960758+0000", 2020-11-12T17:25:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6748000000000003e-05 2020-11-12T17:25:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:57.960855+0000", 2020-11-12T17:25:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31998174899999998 2020-11-12T17:25:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280837+0000", 2020-11-12T17:25:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8499999999999996e-06 2020-11-12T17:25:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280844+0000", 2020-11-12T17:25:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7806000000000002e-05 2020-11-12T17:25:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280902+0000", 2020-11-12T17:25:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5435e-05 2020-11-12T17:25:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.280927+0000", 2020-11-12T17:25:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003038785 2020-11-12T17:25:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.283966+0000", 2020-11-12T17:25:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:25:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:58.284022+0000", 2020-11-12T17:25:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32323516600000002 2020-11-12T17:25:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:18168 4.a e77/69 4:5a8774b4:::benchmark_data_smithi036_18856_object2270:head v 77'1272, mlcod=77'1264)", 2020-11-12T17:25:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.189099075999998, 2020-11-12T17:25:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998, 2020-11-12T17:25:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199534+0000", 2020-11-12T17:25:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:25:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199509+0000", 2020-11-12T17:25:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4102000000000002e-05 2020-11-12T17:25:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.199593+0000", 2020-11-12T17:25:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34680651499999998 2020-11-12T17:25:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546399+0000", 2020-11-12T17:25:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2539e-05 2020-11-12T17:25:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546412+0000", 2020-11-12T17:25:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000133242 2020-11-12T17:25:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546545+0000", 2020-11-12T17:25:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5343999999999999e-05 2020-11-12T17:25:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.546581+0000", 2020-11-12T17:25:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047227149999999997 2020-11-12T17:25:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551303+0000", 2020-11-12T17:25:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112599 2020-11-12T17:25:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:08.551416+0000", 2020-11-12T17:25:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35188171499999998 2020-11-12T17:25:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:25:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:25:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.677726525000001, 2020-11-12T17:25:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:25:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:25:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:25:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:25:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:25:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:25:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:25:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:25:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:25:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:25:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:25:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:25:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:25:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:25:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:25:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:25:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:25:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:25:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:25:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:25:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:45264 4.6 e92/69 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head v 92'2672, mlcod=92'2667)", 2020-11-12T17:25:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:37.906823+0000", 2020-11-12T17:25:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 19.481810110000001, 2020-11-12T17:25:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.365396253, 2020-11-12T17:25:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906823+0000", 2020-11-12T17:25:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906823+0000", 2020-11-12T17:25:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:25:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906792+0000", 2020-11-12T17:25:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105272 2020-11-12T17:25:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.906898+0000", 2020-11-12T17:25:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36011942299999999 2020-11-12T17:25:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267017+0000", 2020-11-12T17:25:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1388e-05 2020-11-12T17:25:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267028+0000", 2020-11-12T17:25:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0346000000000005e-05 2020-11-12T17:25:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267119+0000", 2020-11-12T17:25:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4870000000000001e-05 2020-11-12T17:25:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.267144+0000", 2020-11-12T17:25:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050235710000000001 2020-11-12T17:25:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.272167+0000", 2020-11-12T17:25:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2215000000000001e-05 2020-11-12T17:25:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:38.272219+0000", 2020-11-12T17:25:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.365396253 2020-11-12T17:25:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:25:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:25:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 15.348784, 2020-11-12T17:25:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:25:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:25:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:25:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:25:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:25:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:25:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:25:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:25:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:25:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:25:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:25:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:25:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:25:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:25:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:25:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:25:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:25:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:25:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:25:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:25:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:25:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:25:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.75427614200000004, 2020-11-12T17:25:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:25:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:25:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:25:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:25:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:25:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:25:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:25:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:25:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:25:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:25:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:25:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:25:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:25:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:25:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:25:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:25:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:25:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:25:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:25:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:25:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:25:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:25:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:25:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:25:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:25:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:25:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:25:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:25:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:25:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:25:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:25:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:25:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:25:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:25:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:25:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:25:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:25:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:25:57.590 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:25:57.591 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:25:57.592 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:57.586+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:57.692 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:25:57.688+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:25:57.716 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:57.716 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:57.716 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:25:57.716 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:57.726 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:25:57.793 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:57.790+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:57.893 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:57.890+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:57.895 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:57.896 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:57.896 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:57.896 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:57.896 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:57.905 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:25:57.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 66 16 61269 61253 7.24989 6.05469 0.0116435 0.0172325 2020-11-12T17:25:57.974 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:25:58.019 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:58.016+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:58.025 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:58.026 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:25:58.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:25:58.026 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:25:58.027 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:58.036 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:25:58.096 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:58.094+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:58.197 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:58.194+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:58.197 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:58.198 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:25:58.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.198 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61352 4.6 4:6b7fcaa0:::benchmark_data_smithi036_18856_object7668:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:25:58.198 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:58.043848+0000", 2020-11-12T17:25:58.198 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.15338432299999999, 2020-11-12T17:25:58.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15341792700000001, 2020-11-12T17:25:58.199 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:58.199 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:58.199 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:58.199 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:58.199 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:58.199 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61352 2020-11-12T17:25:58.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.043848+0000", 2020-11-12T17:25:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.043848+0000", 2020-11-12T17:25:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999843 2020-11-12T17:25:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.043833+0000", 2020-11-12T17:25:58.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6125000000000003e-05 2020-11-12T17:25:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.043879+0000", 2020-11-12T17:25:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9410000000000004e-06 2020-11-12T17:25:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.043885+0000", 2020-11-12T17:25:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.695e-06 2020-11-12T17:25:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:58.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.043887+0000", 2020-11-12T17:25:58.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055200680000000004 2020-11-12T17:25:58.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:58.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.049408+0000", 2020-11-12T17:25:58.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8103999999999997e-05 2020-11-12T17:25:58.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.049476+0000", 2020-11-12T17:25:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:25:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:25:58.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.049582+0000", 2020-11-12T17:25:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015627099999999999 2020-11-12T17:25:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.051144+0000", 2020-11-12T17:25:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00729622 2020-11-12T17:25:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:58.206 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:25:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:25:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.322781971, 2020-11-12T17:25:58.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32291712099999997, 2020-11-12T17:25:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:25:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:25:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:25:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:25:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:25:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:25:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.208 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:25:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:25:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:25:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:25:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:25:58.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:25:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:25:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:25:58.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:25:58.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:25:58.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:25:58.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:25:58.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:25:58.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:25:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:25:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:25:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:25:58.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:25:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:25:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:25:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:25:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:25:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:25:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:25:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:25:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:25:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:25:58.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:25:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:25:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:25:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:25:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:25:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015242428000000001 2020-11-12T17:25:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:58.215 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:25:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:25:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:25:58.216 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 2 2020-11-12T17:25:58.216 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:58.217 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:25:58.256 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:25:58.298 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:58.294+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:58.352 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:25:58.353 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:25:58.353 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:25:58.353 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:25:58.353 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:25:58.366 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:25:58.399 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:58.394+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:58.442 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:25:58.479 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:25:58.500 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:58.501 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:58.501 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:58.496+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:58.510 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:25:58.511 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:25:58.539 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:25:58.557 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:25:58.568 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:25:58.609 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:25:58.610 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:25:58.604+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:25:58.641 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:25:58.670 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:58.671 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:58.674 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:25:58.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:25:58.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:25:58.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:25:58.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:25:58.680 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:25:58.680 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:25:58.680 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:25:58.680 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:25:58.684 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:25:58.702 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:58.703 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:58.703 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:58.698+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:58.804 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:58.802+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:58.811 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:58.812 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:58.822 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:25:58.905 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:25:58.902+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:25:58.929 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:58.929 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:58.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 67 16 61898 61882 7.21502 4.91406 0.00513235 0.0172687 2020-11-12T17:25:58.938 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:25:58.981 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:25:59.006 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:59.002+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:59.079 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:59.080 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:59.090 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:25:59.132 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:59.130+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:59.208 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:59.204+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:25:59.258 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:59.259 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:59.269 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:25:59.316 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:25:59.314+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:25:59.394 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:59.394 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:59.405 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:25:59.410 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:25:59.404+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:25:59.511 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:59.506+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:59.579 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:59.579 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:59.592 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:25:59.636 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:25:59.634+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:25:59.715 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:25:59.710+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:25:59.771 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:59.772 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:59.783 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:25:59.815 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:59.808+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:59.916 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:25:59.912+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:25:59.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 68 16 62654 62638 7.19576 5.90625 0.0201193 0.0173632 2020-11-12T17:25:59.956 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:25:59.956 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:25:59.969 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:00.017 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:00.014+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:00.115 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:00.116 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:00.119 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:00.114+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:00.129 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:00.219 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:00.214+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:00.306 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:00.307 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:00.317 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:00.360 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:00.358+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:00.421 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:00.418+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:00.488 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:00.488 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:00.501 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:00.528 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:00.516+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:00.622 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:00.616+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:00.668 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:00.669 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:00.677 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:00.693 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:00.724 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:00.722+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:00.799 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:00.800 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:00.812 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:00.856 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:00.854+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:00.857 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:00.888 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:00.917 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:00.926 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:00.922+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:00.933 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 69 16 63357 63341 7.17107 5.49219 0.00808713 0.0174185 2020-11-12T17:26:00.947 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:00.977 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:00.979 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:00.979 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:00.992 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:00.997 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:26:01.011 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:01.054 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:01.055 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:01.048+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:01.081 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:01.083 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:01.083 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:01.130 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:01.131 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:01.131 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:01.131 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:01.133 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:01.128+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:01.143 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:01.234 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:01.228+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:01.316 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:01.317 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:01.317 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:01.318 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:01.318 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:01.328 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:01.376 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:01.372+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:01.436 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:01.432+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:01.495 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:01.496 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:26:01.496 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:01.506 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:01.548 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:01.544+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:01.637 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:01.632+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:01.661 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:01.662 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:01.662 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:01.662 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:01.673 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:01.763 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:01.760+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:01.839 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:01.838+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:01.845 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:01.846 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:01.846 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:01.846 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:01.846 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:01.856 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:01.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 70 16 64175 64159 7.15991 6.39062 0.0168072 0.0174431 2020-11-12T17:26:01.941 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:01.938+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:02.006 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:26:02.013 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:26:02.014 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:02.027 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:02.072 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:02.068+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:02.142 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:02.138+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:02.197 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:02.197 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:02.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.197 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:64342 4.6 e105/69)", 2020-11-12T17:26:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.196016+0000", 2020-11-12T17:26:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00048368, 2020-11-12T17:26:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000501239, 2020-11-12T17:26:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.196016+0000", 2020-11-12T17:26:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.196016+0000", 2020-11-12T17:26:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.195985+0000", 2020-11-12T17:26:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3120000000000005e-05 2020-11-12T17:26:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.196058+0000", 2020-11-12T17:26:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9877999999999999e-05 2020-11-12T17:26:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.196108+0000", 2020-11-12T17:26:02.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8700000000000003e-06 2020-11-12T17:26:02.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.196115+0000", 2020-11-12T17:26:02.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9131999999999999e-05 2020-11-12T17:26:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64342 4.6 4:62b367e2:::benchmark_data_smithi036_18856_object8042:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.181818+0000", 2020-11-12T17:26:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.014681649, 2020-11-12T17:26:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014749698, 2020-11-12T17:26:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64342 2020-11-12T17:26:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181818+0000", 2020-11-12T17:26:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181818+0000", 2020-11-12T17:26:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:26:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181796+0000", 2020-11-12T17:26:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1999000000000001e-05 2020-11-12T17:26:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181858+0000", 2020-11-12T17:26:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0679999999999997e-06 2020-11-12T17:26:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181866+0000", 2020-11-12T17:26:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7060000000000002e-06 2020-11-12T17:26:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181870+0000", 2020-11-12T17:26:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097369510000000006 2020-11-12T17:26:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.191607+0000", 2020-11-12T17:26:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120995 2020-11-12T17:26:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.191728+0000", 2020-11-12T17:26:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023454300000000001 2020-11-12T17:26:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.191962+0000", 2020-11-12T17:26:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038550450000000001 2020-11-12T17:26:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.195817+0000", 2020-11-12T17:26:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01399947 2020-11-12T17:26:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64343 4.6 4:62b367e2:::benchmark_data_smithi036_18856_object8042:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.181911+0000", 2020-11-12T17:26:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.014588309000000001, 2020-11-12T17:26:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01472393, 2020-11-12T17:26:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.215 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:02.215 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.215 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.215 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.215 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64343 2020-11-12T17:26:02.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.215 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181911+0000", 2020-11-12T17:26:02.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181911+0000", 2020-11-12T17:26:02.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999723 2020-11-12T17:26:02.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181884+0000", 2020-11-12T17:26:02.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9491000000000003e-05 2020-11-12T17:26:02.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181953+0000", 2020-11-12T17:26:02.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1829999999999997e-06 2020-11-12T17:26:02.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181960+0000", 2020-11-12T17:26:02.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4769999999999999e-06 2020-11-12T17:26:02.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181964+0000", 2020-11-12T17:26:02.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011692718 2020-11-12T17:26:02.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.193656+0000", 2020-11-12T17:26:02.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4496e-05 2020-11-12T17:26:02.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.193731+0000", 2020-11-12T17:26:02.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312600000000001 2020-11-12T17:26:02.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.193894+0000", 2020-11-12T17:26:02.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011982713000000001 2020-11-12T17:26:02.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.222 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.223 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64344 4.6 4:62b367e2:::benchmark_data_smithi036_18856_object8042:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.223 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.181999+0000", 2020-11-12T17:26:02.223 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.014500760999999999, 2020-11-12T17:26:02.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014693915, 2020-11-12T17:26:02.224 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.224 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:02.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.224 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64344 2020-11-12T17:26:02.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.225 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181999+0000", 2020-11-12T17:26:02.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181999+0000", 2020-11-12T17:26:02.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:26:02.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.181977+0000", 2020-11-12T17:26:02.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4252999999999995e-05 2020-11-12T17:26:02.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.182052+0000", 2020-11-12T17:26:02.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8299999999999996e-06 2020-11-12T17:26:02.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.182059+0000", 2020-11-12T17:26:02.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7170000000000002e-06 2020-11-12T17:26:02.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.182063+0000", 2020-11-12T17:26:02.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013815066000000001 2020-11-12T17:26:02.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.195878+0000", 2020-11-12T17:26:02.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3591999999999994e-05 2020-11-12T17:26:02.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.195972+0000", 2020-11-12T17:26:02.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015994699999999999 2020-11-12T17:26:02.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.196132+0000", 2020-11-12T17:26:02.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014132919000000001 2020-11-12T17:26:02.232 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.233 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.233 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.233 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.233 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:02.233 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 4 2020-11-12T17:26:02.233 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:02.235 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:02.245 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:02.242+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:02.344 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:02.340+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:02.361 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:02.361 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:02.362 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:02.362 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:02.362 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:02.372 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:02.446 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:02.442+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:02.544 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:02.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 177.43127022199999, 2020-11-12T17:26:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:02.545 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.546 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:02.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:02.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:02.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:02.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:02.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:02.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:02.557 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 177.424178426, 2020-11-12T17:26:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:02.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.565 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 167.991618929, 2020-11-12T17:26:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:02.566 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:02.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:02.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:02.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:02.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 134.041498835, 2020-11-12T17:26:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.577 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:02.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:02.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 131.93589694299999, 2020-11-12T17:26:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.585 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:02.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 100.589413609, 2020-11-12T17:26:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 91.593571807000004, 2020-11-12T17:26:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:02.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:02.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:02.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:02.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:02.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:02.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:02.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.611 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 87.658468408000005, 2020-11-12T17:26:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:02.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:02.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:02.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:02.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:02.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:02.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:02.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:02.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:02.618 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.618 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.618 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.618 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:02.618 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:02.618 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 56.893827917000003, 2020-11-12T17:26:02.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:02.619 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.619 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:02.619 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:02.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:02.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:02.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:02.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:02.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:02.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:02.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:02.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:02.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:02.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:02.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:02.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:02.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:02.625 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.637319232999999, 2020-11-12T17:26:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:02.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:02.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:02.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:02.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:02.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.637 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.638 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.638 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:02.638 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:02.638 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.637156863000001, 2020-11-12T17:26:02.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:02.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.628587875999997, 2020-11-12T17:26:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.124075426000001, 2020-11-12T17:26:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.666 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.638527140000001, 2020-11-12T17:26:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:02.667 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 21.565208708, 2020-11-12T17:26:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:02.679 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:02.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:02.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.686 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.509563732, 2020-11-12T17:26:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.687 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:02.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:02.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:02.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:02.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:02.696 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.121359361, 2020-11-12T17:26:02.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:02.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:02.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:02.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:02.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:02.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:02.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:02.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:02.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:02.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:02.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:02.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:02.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:02.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:02.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:02.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:02.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:02.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:02.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:02.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:02.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:02.707 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.707 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.707 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.708 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:02.708 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:02.708 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.9149024289999996, 2020-11-12T17:26:02.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:02.708 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.709 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.709 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.709 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.709 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.709 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:02.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.709 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.6656968120000002, 2020-11-12T17:26:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.6487373630000004, 2020-11-12T17:26:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.737 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:02.738 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:02.732+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:02.739 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:02.842 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:02.834+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:02.911 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:02.911 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:02.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.912 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64905 4.0 4:0d04f043:::benchmark_data_smithi036_18856_object8113:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.912 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.903485+0000", 2020-11-12T17:26:02.912 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0068942250000000004, 2020-11-12T17:26:02.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006921539, 2020-11-12T17:26:02.912 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.913 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:02.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.919 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64905 2020-11-12T17:26:02.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.920 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903485+0000", 2020-11-12T17:26:02.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903485+0000", 2020-11-12T17:26:02.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999552 2020-11-12T17:26:02.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903440+0000", 2020-11-12T17:26:02.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000126983 2020-11-12T17:26:02.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903567+0000", 2020-11-12T17:26:02.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.489e-05 2020-11-12T17:26:02.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903582+0000", 2020-11-12T17:26:02.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8840000000000006e-06 2020-11-12T17:26:02.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903592+0000", 2020-11-12T17:26:02.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7064000000000001e-05 2020-11-12T17:26:02.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903649+0000", 2020-11-12T17:26:02.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187305 2020-11-12T17:26:02.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903836+0000", 2020-11-12T17:26:02.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014076 2020-11-12T17:26:02.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903977+0000", 2020-11-12T17:26:02.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00049188300000000003 2020-11-12T17:26:02.930 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.930 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.930 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.930 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64906 4.0 4:0d04f043:::benchmark_data_smithi036_18856_object8113:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.930 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.903653+0000", 2020-11-12T17:26:02.931 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0067262210000000001, 2020-11-12T17:26:02.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068294640000000004, 2020-11-12T17:26:02.931 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.931 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:02.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.932 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64906 2020-11-12T17:26:02.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.932 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903653+0000", 2020-11-12T17:26:02.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903653+0000", 2020-11-12T17:26:02.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:26:02.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903622+0000", 2020-11-12T17:26:02.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2991000000000006e-05 2020-11-12T17:26:02.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903695+0000", 2020-11-12T17:26:02.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2910000000000007e-06 2020-11-12T17:26:02.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903703+0000", 2020-11-12T17:26:02.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4489999999999998e-06 2020-11-12T17:26:02.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.903709+0000", 2020-11-12T17:26:02.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024367630000000002 2020-11-12T17:26:02.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.906145+0000", 2020-11-12T17:26:02.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2937999999999997e-05 2020-11-12T17:26:02.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.906238+0000", 2020-11-12T17:26:02.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013289700000000001 2020-11-12T17:26:02.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.906371+0000", 2020-11-12T17:26:02.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027184179999999998 2020-11-12T17:26:02.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.938 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.939 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64907 4.0 4:0d04f043:::benchmark_data_smithi036_18856_object8113:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.939 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.905031+0000", 2020-11-12T17:26:02.939 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0053484159999999999, 2020-11-12T17:26:02.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055181659999999997, 2020-11-12T17:26:02.939 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.939 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:02.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.941 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.941 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.941 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64907 2020-11-12T17:26:02.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.941 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.905031+0000", 2020-11-12T17:26:02.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.905031+0000", 2020-11-12T17:26:02.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:26:02.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.905009+0000", 2020-11-12T17:26:02.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3756000000000004e-05 2020-11-12T17:26:02.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.905072+0000", 2020-11-12T17:26:02.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1781e-05 2020-11-12T17:26:02.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.905084+0000", 2020-11-12T17:26:02.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1249999999999993e-06 2020-11-12T17:26:02.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.905092+0000", 2020-11-12T17:26:02.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003223236 2020-11-12T17:26:02.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.908316+0000", 2020-11-12T17:26:02.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4040000000000003e-05 2020-11-12T17:26:02.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.908390+0000", 2020-11-12T17:26:02.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013664100000000001 2020-11-12T17:26:02.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.908526+0000", 2020-11-12T17:26:02.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034955450000000001 2020-11-12T17:26:02.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.948 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.949 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64908 4.0 4:0d04f043:::benchmark_data_smithi036_18856_object8113:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.949 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.907158+0000", 2020-11-12T17:26:02.949 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0032208750000000002, 2020-11-12T17:26:02.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034565379999999999, 2020-11-12T17:26:02.949 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.949 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:02.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.950 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.950 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.950 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64908 2020-11-12T17:26:02.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.950 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907158+0000", 2020-11-12T17:26:02.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907158+0000", 2020-11-12T17:26:02.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999537 2020-11-12T17:26:02.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907112+0000", 2020-11-12T17:26:02.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012714200000000001 2020-11-12T17:26:02.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907239+0000", 2020-11-12T17:26:02.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8221999999999998e-05 2020-11-12T17:26:02.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907267+0000", 2020-11-12T17:26:02.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.049e-05 2020-11-12T17:26:02.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907278+0000", 2020-11-12T17:26:02.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025717029999999998 2020-11-12T17:26:02.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:02.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.909849+0000", 2020-11-12T17:26:02.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9244000000000001e-05 2020-11-12T17:26:02.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:02.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.909939+0000", 2020-11-12T17:26:02.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012630000000000001 2020-11-12T17:26:02.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:02.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.910065+0000", 2020-11-12T17:26:02.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029067530000000002 2020-11-12T17:26:02.957 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.957 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.957 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.957 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64909 4.0 4.c20f20b0 (undecoded) ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.957 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.907336+0000", 2020-11-12T17:26:02.957 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0030427480000000001, 2020-11-12T17:26:02.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033384640000000002, 2020-11-12T17:26:02.958 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.958 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:02.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.959 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64909 2020-11-12T17:26:02.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.959 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907336+0000", 2020-11-12T17:26:02.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907336+0000", 2020-11-12T17:26:02.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:02.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907311+0000", 2020-11-12T17:26:02.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0782000000000001e-05 2020-11-12T17:26:02.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907382+0000", 2020-11-12T17:26:02.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2729e-05 2020-11-12T17:26:02.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907395+0000", 2020-11-12T17:26:02.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8280000000000002e-06 2020-11-12T17:26:02.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907399+0000", 2020-11-12T17:26:02.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3116999999999999e-05 2020-11-12T17:26:02.963 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.963 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.963 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.964 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64910 4.0 4.c20f20b0 (undecoded) ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.964 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.907693+0000", 2020-11-12T17:26:02.964 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0026857489999999999, 2020-11-12T17:26:02.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030353509999999999, 2020-11-12T17:26:02.964 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.964 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:02.964 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.964 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.965 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.965 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64910 2020-11-12T17:26:02.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.965 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907693+0000", 2020-11-12T17:26:02.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907693+0000", 2020-11-12T17:26:02.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999609 2020-11-12T17:26:02.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907654+0000", 2020-11-12T17:26:02.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011349999999999999 2020-11-12T17:26:02.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907768+0000", 2020-11-12T17:26:02.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3944e-05 2020-11-12T17:26:02.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907792+0000", 2020-11-12T17:26:02.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0832999999999999e-05 2020-11-12T17:26:02.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.907803+0000", 2020-11-12T17:26:02.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010936400000000001 2020-11-12T17:26:02.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.970 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:64911 4.0 4.c20f20b0 (undecoded) ondisk+write+known_if_redirected e105)", 2020-11-12T17:26:02.970 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:02.908095+0000", 2020-11-12T17:26:02.970 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00228408, 2020-11-12T17:26:02.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026796070000000001, 2020-11-12T17:26:02.970 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:02.970 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:02.971 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:02.972 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:02.972 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:02.973 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 64911 2020-11-12T17:26:02.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.973 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:02.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:02.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.908095+0000", 2020-11-12T17:26:02.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:02.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:02.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.908095+0000", 2020-11-12T17:26:02.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:02.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:02.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.908075+0000", 2020-11-12T17:26:02.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999999e-05 2020-11-12T17:26:02.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:02.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.908140+0000", 2020-11-12T17:26:02.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0336000000000001e-05 2020-11-12T17:26:02.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:02.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.908150+0000", 2020-11-12T17:26:02.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2490000000000001e-06 2020-11-12T17:26:02.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:02.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:02.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:02.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.908155+0000", 2020-11-12T17:26:02.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0257000000000003e-05 2020-11-12T17:26:02.977 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.977 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:02.977 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.977 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:02.977 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:02.978 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 7 2020-11-12T17:26:02.978 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:02.979 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:02.980 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 71 16 64928 64912 7.14192 5.88281 0.0164525 0.0174936 2020-11-12T17:26:02.980 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:02.972+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:03.083 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:03.080+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:03.095 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:03.149 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:03.149 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:03.150 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:03.150 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:03.150 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:03.161 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:03.208 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:03.204+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:03.253 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:03.285 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:03.280+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:03.289 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:03.296 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 168.876406852, 2020-11-12T17:26:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 168.86946279, 2020-11-12T17:26:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.69562500399999, 2020-11-12T17:26:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 128.22409109500001, 2020-11-12T17:26:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:26:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 128.20876987299999, 2020-11-12T17:26:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:26:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:26:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:26:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:26:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:26:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:26:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:26:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:26:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:26:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:26:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:26:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:26:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:26:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:26:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:26:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.43191991099999, 2020-11-12T17:26:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 101.475473069, 2020-11-12T17:26:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 101.346539585, 2020-11-12T17:26:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 100.574521299, 2020-11-12T17:26:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:26:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:26:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:26:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:26:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:26:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:26:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:26:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:26:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:26:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:26:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:26:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:26:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:26:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:26:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:26:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:26:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:26:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:26:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:26:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:26:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:26:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:26:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:26:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:26:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.652401311000006, 2020-11-12T17:26:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.337847664999998, 2020-11-12T17:26:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.983162589000003, 2020-11-12T17:26:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.969985829999999, 2020-11-12T17:26:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 37.415904380999997, 2020-11-12T17:26:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:03.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:03.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:03.468 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:03.468 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 37.406917075000003, 2020-11-12T17:26:03.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 31.388989761000001, 2020-11-12T17:26:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.837946363, 2020-11-12T17:26:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.586550862999999, 2020-11-12T17:26:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.507428546, 2020-11-12T17:26:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 1.7250775789999999, 2020-11-12T17:26:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:03.534 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:03.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:03.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:03.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:03.537 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:03.537 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:03.537 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:03.537 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:03.537 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:03.538 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:03.538 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:03.538 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:03.539 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:03.539 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:03.539 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:03.539 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:03.530+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:03.540 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:03.636 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:03.632+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:03.663 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:03.664 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:03.677 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:03.716 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 7, 6] out_osds: [2, 1] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:03.717 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:03.717 INFO:tasks.thrashosds.thrasher:Removing osd 0, in_osds are: [0, 3, 4, 5, 7, 6] 2020-11-12T17:26:03.717 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 0 2020-11-12T17:26:03.736 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:03.734+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:03.804 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:03.805 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:03.817 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:03.837 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:03.832+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:03.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 72 16 65626 65610 7.11845 5.45312 0.0213779 0.0175495 2020-11-12T17:26:03.938 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:03.932+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:03.985 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:03.986 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:03.997 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:04.024 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:26:04.039 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:26:04.032+0000 7f4952786700 -1 mon.a@0(leader).osd e105 definitely_dead 0 2020-11-12T17:26:04.044 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:04.042+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:04.127 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:04.127 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:04.138 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:04.140 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:04.136+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:04.241 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:04.238+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:04.306 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:04.306 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:04.318 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:04.343 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:04.336+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:04.444 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:04.442+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:04.842 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:04.842 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:04.843 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:04.844 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:04.836+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:04.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 73 15 66330 66315 7.09638 5.50781 0.0133816 0.0176062 2020-11-12T17:26:04.944 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:04.942+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:05.011 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:05.011 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:05.024 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:05.040 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:26:05.041 INFO:teuthology.orchestra.run.smithi036.stderr:marked out osd.0. 2020-11-12T17:26:05.068 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:05.066+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:05.146 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:05.142+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:05.170 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:05.170 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:05.179 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:05.268 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:05.266+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:05.329 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:05.330 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:05.337 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:05.380 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:05.378+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:05.450 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:05.446+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:05.490 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:05.490 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:05.500 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:05.540 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:05.588 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:05.584+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:05.651 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:05.652 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:05.654 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:05.650+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:05.661 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:05.702 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:05.730 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:05.756 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:05.752+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:05.764 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:05.799 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:05.812 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:05.813 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:05.825 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:05.828 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:05.870 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:05.871 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:05.864+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:05.912 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:05.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 74 16 66423 66407 7.0102 0.71875 0.759329 0.0176424 2020-11-12T17:26:05.953 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:05.955 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:05.956 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:05.956 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:05.956 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:05.956 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:05.956 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:05.957 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:05.957 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:05.958 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:05.958 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:05.958 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:05.959 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:05.954+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:05.968 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:06.060 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:06.054+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:06.133 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:06.134 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:06.134 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:06.143 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:06.199 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:06.192+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:06.261 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:06.261 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:06.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:06.261 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:26:06.262 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:06.270 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:06.258+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:06.272 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:06.430 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:06.420+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:06.470 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:06.471 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:06.471 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:06.471 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:06.473 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:06.468+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:06.480 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:06.566 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:06.562+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:06.669 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:06.664+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:06.674 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:06.674 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:06.675 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:06.675 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:06.675 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:06.685 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:06.799 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:06.792+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:06.863 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:06.863 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:06.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:06.864 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:26:06.864 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:06.873 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:06.862+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:06.875 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:06.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 75 16 66884 66868 6.96474 3.60156 0.0162971 0.0179402 2020-11-12T17:26:06.973 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:06.966+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:07.042 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:07.043 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:07.043 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:07.043 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:07.051 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:07.058 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:26:07.099 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:07.092+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:07.176 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:07.170+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:07.211 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:07.212 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:07.224 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:07.280 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:07.274+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:07.356 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:07.357 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:07.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:07.358 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:07.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 182.24278815900001, 2020-11-12T17:26:07.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:07.360 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.361 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.361 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 182.23569636299999, 2020-11-12T17:26:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 172.80313686599999, 2020-11-12T17:26:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.85301677199999, 2020-11-12T17:26:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 136.74741488000001, 2020-11-12T17:26:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.400931546, 2020-11-12T17:26:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 96.405089743999994, 2020-11-12T17:26:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 92.469986344999995, 2020-11-12T17:26:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 61.705345854000001, 2020-11-12T17:26:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.448837169999997, 2020-11-12T17:26:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.448674799999999, 2020-11-12T17:26:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.440105813000002, 2020-11-12T17:26:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.935593362999999, 2020-11-12T17:26:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.450045076999999, 2020-11-12T17:26:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.376726645000002, 2020-11-12T17:26:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.321081669000002, 2020-11-12T17:26:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.932877298000001, 2020-11-12T17:26:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.726420365999999, 2020-11-12T17:26:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.4772147489999998, 2020-11-12T17:26:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.4602553, 2020-11-12T17:26:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:07.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:07.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:07.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:07.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:07.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:07.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.595 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:07.597 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:07.598 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:07.592+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:07.697 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:07.694+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:07.777 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:07.778 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:07.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.778 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:67415 4.9 e107/69 4:9f6fdd04:::benchmark_data_smithi036_18856_object8426:head v 107'4375, mlcod=107'4370)", 2020-11-12T17:26:07.778 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:07.776195+0000", 2020-11-12T17:26:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0011198899999999999, 2020-11-12T17:26:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001147857, 2020-11-12T17:26:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:07.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:07.776195+0000", 2020-11-12T17:26:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:07.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:07.776195+0000", 2020-11-12T17:26:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:07.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:07.776171+0000", 2020-11-12T17:26:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4442000000000001e-05 2020-11-12T17:26:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:07.776265+0000", 2020-11-12T17:26:07.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100089 2020-11-12T17:26:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:07.776365+0000", 2020-11-12T17:26:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2390000000000002e-06 2020-11-12T17:26:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:07.776373+0000", 2020-11-12T17:26:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8767999999999999e-05 2020-11-12T17:26:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:07.776412+0000", 2020-11-12T17:26:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8578999999999999e-05 2020-11-12T17:26:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:07.776431+0000", 2020-11-12T17:26:07.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023533000000000001 2020-11-12T17:26:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:07.786 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 1 2020-11-12T17:26:07.787 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:07.788 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:07.798 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:07.794+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:07.897 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:07.898 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:07.899 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:07.899 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:07.899 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:07.902 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:07.896+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:07.908 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:07.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 76 16 67530 67514 6.9395 5.04688 0.020899 0.0180038 2020-11-12T17:26:07.969 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:08.023 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:08.020+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:08.087 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:08.087 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:08.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:08.088 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:08.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.088 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:08.088 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:08.088 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 173.66575446799999, 2020-11-12T17:26:08.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:08.089 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.089 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.089 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.089 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:08.089 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:08.089 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:08.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.090 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:08.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:08.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:08.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:08.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:08.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:08.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:08.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:08.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:08.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:08.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:08.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:08.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:08.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:08.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:08.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:08.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:08.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:08.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:08.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:08.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:08.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:08.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:08.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:08.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:08.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:08.099 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.099 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.099 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.100 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:08.100 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:08.100 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 173.65881040599999, 2020-11-12T17:26:08.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:08.100 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.100 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:08.101 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:08.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:08.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:08.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:08.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:08.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:08.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:08.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:08.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:08.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:08.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:08.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:08.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:08.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:08.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:08.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:08.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:08.107 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.108 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.108 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:08.108 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:08.108 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.48497262000001, 2020-11-12T17:26:08.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:08.109 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.109 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:08.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:08.109 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:08.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.110 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:08.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:08.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:08.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:08.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:08.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:08.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:08.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:08.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:08.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:08.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:08.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:08.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:08.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:08.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:08.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:08.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:08.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:08.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:08.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:08.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:08.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:08.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:08.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:08.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:08.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:08.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.119 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.120 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:08.120 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:08.120 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 133.01343871099999, 2020-11-12T17:26:08.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:08.120 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.120 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.120 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:08.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:08.121 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:08.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.121 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:08.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:08.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:08.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:08.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:08.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:08.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:08.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:08.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:08.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:08.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:08.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:08.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:08.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:08.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:08.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:08.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:08.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:08.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:08.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:08.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:08.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:08.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:08.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:08.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:08.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:08.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.130 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.130 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:26:08.131 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:08.131 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.99811748900001, 2020-11-12T17:26:08.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:26:08.131 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.131 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:08.131 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:08.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:08.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:08.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:26:08.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:26:08.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:26:08.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:26:08.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:26:08.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:26:08.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:26:08.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:26:08.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:26:08.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:26:08.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:26:08.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:26:08.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:26:08.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:26:08.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.138 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.138 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:08.138 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:08.139 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 121.22126752699999, 2020-11-12T17:26:08.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:08.139 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.139 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.139 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.139 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:08.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:08.140 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:08.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.140 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:08.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:08.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:08.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:08.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:08.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:08.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:08.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:08.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:08.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:08.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:08.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:08.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:08.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:08.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:08.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:08.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:08.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:08.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:08.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:08.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:08.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:08.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:08.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:08.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:08.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:08.150 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.150 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.150 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.151 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:08.151 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:08.151 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 106.264820685, 2020-11-12T17:26:08.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:08.151 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.151 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.152 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.152 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:08.152 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:08.152 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:08.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.152 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:08.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:08.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:08.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:08.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:08.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:08.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:08.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:08.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:08.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:08.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:08.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:08.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:08.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:08.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:08.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:08.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:08.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:08.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:08.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:08.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:08.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:08.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:08.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:08.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:08.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:08.161 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.161 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.162 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.162 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:08.162 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:08.162 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 106.135887201, 2020-11-12T17:26:08.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:08.163 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.163 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.163 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:08.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:08.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:08.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:08.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:08.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:08.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:08.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:08.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:08.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:08.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:08.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:08.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:08.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:08.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:08.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:08.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:08.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:08.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:08.170 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.170 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.170 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.170 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:08.171 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:08.171 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.363868915, 2020-11-12T17:26:08.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:26:08.171 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.171 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.171 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.172 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:08.172 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:08.172 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:26:08.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.172 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:08.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:26:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:26:08.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:26:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:26:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:26:08.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:26:08.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:26:08.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:26:08.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:26:08.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:26:08.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:26:08.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:26:08.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:08.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:26:08.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:26:08.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:26:08.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:26:08.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:26:08.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:26:08.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:26:08.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:26:08.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:26:08.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:26:08.183 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.183 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.183 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.183 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:08.183 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:08.184 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 104.44174892700001, 2020-11-12T17:26:08.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:08.184 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.184 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:08.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:08.185 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:08.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.185 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:08.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:08.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:08.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:08.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:08.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:08.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:08.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:08.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:08.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:08.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:08.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:08.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:08.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:08.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:08.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:08.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:08.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:08.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:08.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:08.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:08.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:08.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:08.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:08.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:08.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:08.194 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.194 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.194 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.195 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:08.195 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:08.195 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 70.127195280999999, 2020-11-12T17:26:08.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:08.195 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.196 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.196 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.196 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:08.196 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:08.196 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:08.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.196 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:08.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:08.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:08.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:08.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:08.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:08.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:08.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:08.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:08.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:08.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:08.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:08.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:08.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:08.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:08.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:08.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:08.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:08.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:08.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:08.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:08.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:08.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:08.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:08.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:08.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:08.205 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.205 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.206 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:08.206 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:08.206 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.772510205000003, 2020-11-12T17:26:08.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:08.207 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.207 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.207 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.207 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:08.207 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:08.207 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:08.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.207 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:08.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:08.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:08.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:08.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:08.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:08.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:08.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:08.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:08.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:08.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:08.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:08.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:08.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:08.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:08.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:08.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:08.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:08.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:08.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:08.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:08.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:08.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:08.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:08.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:08.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:08.216 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.216 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.216 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.217 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:08.217 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:08.217 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.759333445999999, 2020-11-12T17:26:08.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:08.217 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.218 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:08.218 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:08.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:08.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:08.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:08.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:08.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:08.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:08.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:08.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:08.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:08.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:08.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:08.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:08.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:08.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:08.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:08.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:08.224 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.224 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.224 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.224 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:08.225 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:08.225 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 42.205251996999998, 2020-11-12T17:26:08.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:08.225 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.225 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.225 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.225 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:08.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:08.226 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:08.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.226 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:08.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:08.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:08.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:08.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:08.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:08.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:08.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:08.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:08.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:08.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:08.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:08.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:08.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:08.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:08.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:08.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:08.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:08.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:08.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:08.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:08.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:08.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:08.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:08.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:08.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:08.234 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.235 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.235 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:08.235 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:08.235 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 42.196264691000003, 2020-11-12T17:26:08.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:08.236 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.236 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:08.236 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:08.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:08.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:08.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:08.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:08.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:08.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:08.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:08.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:08.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:08.242 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.242 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.242 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.243 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:08.243 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:08.243 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.178337376999998, 2020-11-12T17:26:08.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:08.243 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.243 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.243 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.243 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:08.244 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:08.244 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:08.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.244 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:08.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:08.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:08.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:08.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:08.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:08.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:08.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:08.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:08.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:08.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:08.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:08.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:08.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:08.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:08.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:08.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:08.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:08.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:08.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:08.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:08.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:08.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:08.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:08.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:08.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:08.253 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.253 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.253 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.253 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:08.253 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:08.254 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 31.627293979000001, 2020-11-12T17:26:08.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:08.254 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.254 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.254 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.254 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:08.254 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:08.255 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:08.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.255 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:08.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:08.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:08.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:08.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:08.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:08.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:08.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:08.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:08.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:08.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:08.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:08.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:08.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:08.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:08.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:08.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:08.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:08.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:08.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:08.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:08.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:08.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:08.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:08.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:08.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:08.263 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.263 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.264 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.264 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:08.264 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:08.264 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 31.375898479, 2020-11-12T17:26:08.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:08.264 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.265 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.265 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.265 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:08.265 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:08.265 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:08.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.265 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:08.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:08.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:08.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:08.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:08.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:08.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:08.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:08.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:08.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:08.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:08.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:08.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:08.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:08.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:08.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:08.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:08.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:08.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:08.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:08.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:08.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:08.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:08.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:08.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:08.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:08.275 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.275 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.275 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.275 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:08.276 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:08.276 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 31.296776162, 2020-11-12T17:26:08.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:08.276 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.276 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:08.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:08.277 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:08.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.277 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:08.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:08.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:08.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:08.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:08.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:08.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:08.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:08.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:08.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:08.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:08.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:08.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:08.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:08.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:08.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:08.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:08.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:08.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:08.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:08.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:08.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:08.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:08.285 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.286 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.286 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:08.286 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:08.286 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.5144251950000003, 2020-11-12T17:26:08.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:08.287 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:08.287 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:08.287 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:08.287 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:08.287 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:08.287 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:08.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.288 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:08.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:08.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:08.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:08.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:08.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:08.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:08.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:08.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:08.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:08.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:08.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:08.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:08.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:08.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:08.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:08.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:08.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:08.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:08.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:08.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:08.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:08.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:08.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:08.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:08.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:08.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:08.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:08.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:08.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:08.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:08.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:08.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:08.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:08.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:08.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:08.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:08.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:08.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:08.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:08.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:08.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:08.296 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.296 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.296 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.297 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:08.297 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:08.297 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:08.299 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:08.299 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:08.299 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:08.299 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:08.299 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:08.300 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:08.301 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:08.294+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:08.310 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:08.341 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:08.374 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:08.377 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:08.377 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:08.377 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:08.377 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:08.377 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:08.378 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:08.378 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:08.378 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:08.395 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:26:08.399 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:08.396+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:08.479 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:08.480 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:08.495 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:08.500 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:08.496+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:08.601 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:08.596+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:08.650 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:08.651 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:08.666 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:08.712 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:08.710+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:08.803 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:08.796+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:08.831 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:08.831 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:08.845 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:08.932 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:08.930+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:08.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 77 16 68124 68108 6.90964 4.64062 0.0159442 0.0180838 2020-11-12T17:26:09.005 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:09.000+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:09.072 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:09.072 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:09.086 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:09.106 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:09.100+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:09.206 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:09.202+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:09.279 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:09.280 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:09.298 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:09.307 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:09.304+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:09.408 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:09.404+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:09.505 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:09.505 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:09.509 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:09.504+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:09.518 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:09.611 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:09.604+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:09.697 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:09.698 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:09.713 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:09.708+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:09.716 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:09.814 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:09.810+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:09.864 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:09.865 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:09.877 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:09.922 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:09.918+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:09.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 78 16 68731 68715 6.88185 4.74219 0.0700223 0.0181559 2020-11-12T17:26:10.015 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:10.014+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:10.055 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6] out_osds: [2, 1, 0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:10.055 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:10.056 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-11-12T17:26:10.057 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:10.058 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:10.076 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:10.117 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:10.112+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:10.217 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:10.214+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:10.255 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:10.255 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:10.269 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:10.319 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:10.316+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:10.366 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:26:10.367 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 108, 2020-11-12T17:26:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:26:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2020-11-12T17:22:37.581394+0000", 2020-11-12T17:26:10.367 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2020-11-12T17:26:08.377804+0000", 2020-11-12T17:26:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2020-11-12T17:25:55.942493+0000", 2020-11-12T17:26:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2020-11-12T17:26:05.016890+0000", 2020-11-12T17:26:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-12T17:26:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5806080, 2020-11-12T17:26:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2020-11-12T17:26:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "nodeep-scrub", 2020-11-12T17:26:10.368 INFO:teuthology.orchestra.run.smithi036.stdout: "noscrub", 2020-11-12T17:26:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2020-11-12T17:26:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2020-11-12T17:26:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2020-11-12T17:26:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2020-11-12T17:26:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 4, 2020-11-12T17:26:10.369 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2020-11-12T17:26:10.370 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-12T17:26:10.370 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-12T17:26:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2020-11-12T17:26:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 4, 2020-11-12T17:26:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2020-11-12T17:26:10.371 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2020-11-12T17:26:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2020-11-12T17:26:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2020-11-12T17:26:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2020-11-12T17:26:10.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2020-11-12T17:26:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2020-11-12T17:26:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:41.596657+0000", 2020-11-12T17:26:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:26:10.374 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:26:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:26:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:26:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:26:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:26:10.375 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:26:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:26:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2020-11-12T17:26:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2020-11-12T17:26:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2020-11-12T17:26:10.376 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2020-11-12T17:26:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2020-11-12T17:26:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:26:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:26:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:26:10.377 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:26:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:26:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:26:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:26:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.378 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "16", 2020-11-12T17:26:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:26:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:26:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:26:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:26:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:26:10.379 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:26:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:26:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:26:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:26:10.380 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:26:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:26:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:26:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:26:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:26:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:26:10.382 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:26:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:26:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:26:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:26:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:26:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:26:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:26:10.383 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:26:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:26:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:26:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:26:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:26:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:26:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:26:10.384 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:26:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:26:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:26:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:26:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:26:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:26:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:26:10.385 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:26:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2020-11-12T17:26:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2020-11-12T17:26:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.386 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:26:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2020-11-12T17:26:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.388 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2020-11-12T17:26:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2020-11-12T17:26:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:49.905816+0000", 2020-11-12T17:26:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:26:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:26:10.389 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:26:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:26:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:26:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:26:10.390 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:26:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:26:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2020-11-12T17:26:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2020-11-12T17:26:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2020-11-12T17:26:10.391 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2020-11-12T17:26:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2020-11-12T17:26:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:26:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:26:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:26:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:26:10.392 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:26:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:26:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:26:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "19", 2020-11-12T17:26:10.393 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:26:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:26:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:26:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:26:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:26:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:26:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:26:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:26:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:26:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:26:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:26:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:26:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:26:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:26:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:26:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:26:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:26:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:26:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:26:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:26:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:26:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:26:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:26:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:26:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:26:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:26:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:26:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:26:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:26:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:26:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:26:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:26:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:26:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:26:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:26:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:26:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:26:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:26:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:26:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2020-11-12T17:26:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 4, 2020-11-12T17:26:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "unique_pool_1", 2020-11-12T17:26:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:24:49.045109+0000", 2020-11-12T17:26:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:26:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:26:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:26:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:26:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:26:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:26:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:26:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:26:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 16, 2020-11-12T17:26:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 16, 2020-11-12T17:26:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 16, 2020-11-12T17:26:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 16, 2020-11-12T17:26:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 16, 2020-11-12T17:26:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:26:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:26:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:26:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:26:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:26:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:26:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:26:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "71", 2020-11-12T17:26:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:26:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:26:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:26:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:26:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:26:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:26:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:26:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:26:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:26:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:26:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:26:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:26:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:26:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:26:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:26:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:26:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:26:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:26:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:26:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:26:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:26:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:26:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:26:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:26:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:26:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:26:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:26:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:26:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:26:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:26:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:26:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:26:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:26:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:26:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:26:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:26:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:26:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:26:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:26:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: "rados": {} 2020-11-12T17:26:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2020-11-12T17:26:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:26:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "bd1d5457-5d54-4074-b378-9da417f42976", 2020-11-12T17:26:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 0, 2020-11-12T17:26:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 0, 2020-11-12T17:26:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:26:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6801", 2020-11-12T17:26:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:26:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2020-11-12T17:26:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:26:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2020-11-12T17:26:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:26:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2020-11-12T17:26:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:26:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6801/12304", 2020-11-12T17:26:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6802/12304", 2020-11-12T17:26:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6806/12304", 2020-11-12T17:26:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6804/12304", 2020-11-12T17:26:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:26:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "37152eee-a8d8-40f1-8e27-2899e7b94c98", 2020-11-12T17:26:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 0, 2020-11-12T17:26:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 0, 2020-11-12T17:26:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:26:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 57, 2020-11-12T17:26:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 88, 2020-11-12T17:26:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 35, 2020-11-12T17:26:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 58, 2020-11-12T17:26:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2020-11-12T17:26:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:26:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2020-11-12T17:26:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:26:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2020-11-12T17:26:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:26:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2020-11-12T17:26:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:26:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/20274", 2020-11-12T17:26:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6814/20274", 2020-11-12T17:26:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6816/20274", 2020-11-12T17:26:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6815/20274", 2020-11-12T17:26:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:26:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "d8ec2abb-38bf-4863-969a-482c4fa44f41", 2020-11-12T17:26:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 0, 2020-11-12T17:26:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 0, 2020-11-12T17:26:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:26:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 93, 2020-11-12T17:26:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 102, 2020-11-12T17:26:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 17, 2020-11-12T17:26:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 94, 2020-11-12T17:26:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2020-11-12T17:26:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:26:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2020-11-12T17:26:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:26:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2020-11-12T17:26:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:26:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2020-11-12T17:26:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:26:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/21493", 2020-11-12T17:26:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/21493", 2020-11-12T17:26:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6808/21493", 2020-11-12T17:26:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/21493", 2020-11-12T17:26:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:26:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "799d3499-577c-4510-a00c-9b2e126fc449", 2020-11-12T17:26:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 106, 2020-11-12T17:26:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2020-11-12T17:26:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:26:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2020-11-12T17:26:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:26:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2020-11-12T17:26:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:26:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2020-11-12T17:26:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:26:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6809/12305", 2020-11-12T17:26:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6810/12305", 2020-11-12T17:26:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6813/12305", 2020-11-12T17:26:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6811/12305", 2020-11-12T17:26:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:26:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "c36e3100-aadc-4117-b495-24fb08a34148", 2020-11-12T17:26:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 106, 2020-11-12T17:26:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6804", 2020-11-12T17:26:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:26:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6805", 2020-11-12T17:26:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:26:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6807", 2020-11-12T17:26:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:26:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6806", 2020-11-12T17:26:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:26:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6804/12499", 2020-11-12T17:26:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6805/12499", 2020-11-12T17:26:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6807/12499", 2020-11-12T17:26:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6806/12499", 2020-11-12T17:26:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:26:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "b152141f-b530-448e-8dff-fe200559eff0", 2020-11-12T17:26:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 106, 2020-11-12T17:26:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6808", 2020-11-12T17:26:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:26:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6810", 2020-11-12T17:26:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:26:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6814", 2020-11-12T17:26:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:26:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6812", 2020-11-12T17:26:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:26:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6808/12525", 2020-11-12T17:26:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6810/12525", 2020-11-12T17:26:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6814/12525", 2020-11-12T17:26:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6812/12525", 2020-11-12T17:26:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:26:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "62a140ba-7f94-4bb6-8a62-fda077f81354", 2020-11-12T17:26:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:26:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6809", 2020-11-12T17:26:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:26:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6811", 2020-11-12T17:26:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:26:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6815", 2020-11-12T17:26:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:26:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6813", 2020-11-12T17:26:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:26:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6809/12524", 2020-11-12T17:26:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6811/12524", 2020-11-12T17:26:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6815/12524", 2020-11-12T17:26:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6813/12524", 2020-11-12T17:26:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:26:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "32879bd7-780c-4da6-9838-5850b6277902", 2020-11-12T17:26:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 106, 2020-11-12T17:26:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6800", 2020-11-12T17:26:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:26:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6801", 2020-11-12T17:26:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:26:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6803", 2020-11-12T17:26:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:26:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6802", 2020-11-12T17:26:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:26:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6800/12522", 2020-11-12T17:26:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6801/12522", 2020-11-12T17:26:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6803/12522", 2020-11-12T17:26:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6802/12522", 2020-11-12T17:26:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2020-11-12T17:26:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:26:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 65536, 2020-11-12T17:26:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:44.263353+0000", 2020-11-12T17:26:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:26:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 65536, 2020-11-12T17:26:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:32.332836+0000", 2020-11-12T17:26:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 58 2020-11-12T17:26:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:26:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 65536, 2020-11-12T17:26:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:56.086138+0000", 2020-11-12T17:26:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 94 2020-11-12T17:26:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:26:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:45.759169+0000", 2020-11-12T17:26:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:26:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:45.106269+0000", 2020-11-12T17:26:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:26:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:46.496339+0000", 2020-11-12T17:26:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:26:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:44.404347+0000", 2020-11-12T17:26:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:26:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:45.516908+0000", 2020-11-12T17:26:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2020-11-12T17:26:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2020-11-12T17:26:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2020-11-12T17:26:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2020-11-12T17:26:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2020-11-12T17:26:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2020-11-12T17:26:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2020-11-12T17:26:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2020-11-12T17:26:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2020-11-12T17:26:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2020-11-12T17:26:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2020-11-12T17:26:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2020-11-12T17:26:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2020-11-12T17:26:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2020-11-12T17:26:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2020-11-12T17:26:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2020-11-12T17:26:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2020-11-12T17:26:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2020-11-12T17:26:10.499 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:10.499 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:10.500 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:26:10.502 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:10.502 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:10.503 INFO:tasks.thrashosds.thrasher:j is {'epoch': 108, 'fsid': '8c8a6bcc-49d4-47d1-904f-e20798ef8e1f', 'created': '2020-11-12T17:22:37.581394+0000', 'modified': '2020-11-12T17:26:08.377804+0000', 'last_up_change': '2020-11-12T17:25:55.942493+0000', 'last_in_change': '2020-11-12T17:26:05.016890+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'unique_pool_1', 'create_time': '2020-11-12T17:24:49.045109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'bd1d5457-5d54-4074-b378-9da417f42976', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6801', 'nonce': 12304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6802', 'nonce': 12304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6806', 'nonce': 12304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6804', 'nonce': 12304}]}, 'public_addr': '172.21.15.36:6801/12304', 'cluster_addr': '172.21.15.36:6802/12304', 'heartbeat_back_addr': '172.21.15.36:6806/12304', 'heartbeat_front_addr': '172.21.15.36:6804/12304', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '37152eee-a8d8-40f1-8e27-2899e7b94c98', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 57, 'up_from': 88, 'up_thru': 35, 'down_at': 58, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6812', 'nonce': 20274}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6814', 'nonce': 20274}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6816', 'nonce': 20274}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6815', 'nonce': 20274}]}, 'public_addr': '172.21.15.36:6812/20274', 'cluster_addr': '172.21.15.36:6814/20274', 'heartbeat_back_addr': '172.21.15.36:6816/20274', 'heartbeat_front_addr': '172.21.15.36:6815/20274', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd8ec2abb-38bf-4863-969a-482c4fa44f41', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 93, 'up_from': 102, 'up_thru': 17, 'down_at': 94, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6803', 'nonce': 21493}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6805', 'nonce': 21493}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6808', 'nonce': 21493}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6807', 'nonce': 21493}]}, 'public_addr': '172.21.15.36:6803/21493', 'cluster_addr': '172.21.15.36:6805/21493', 'heartbeat_back_addr': '172.21.15.36:6808/21493', 'heartbeat_front_addr': '172.21.15.36:6807/21493', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '799d3499-577c-4510-a00c-9b2e126fc449', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6809', 'nonce': 12305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6810', 'nonce': 12305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6813', 'nonce': 12305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6811', 'nonce': 12305}]}, 'public_addr': '172.21.15.36:6809/12305', 'cluster_addr': '172.21.15.36:6810/12305', 'heartbeat_back_addr': '172.21.15.36:6813/12305', 'heartbeat_front_addr': '172.21.15.36:6811/12305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c36e3100-aadc-4117-b495-24fb08a34148', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6804', 'nonce': 12499}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6805', 'nonce': 12499}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6807', 'nonce': 12499}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6806', 'nonce': 12499}]}, 'public_addr': '172.21.15.205:6804/12499', 'cluster_addr': '172.21.15.205:6805/12499', 'heartbeat_back_addr': '172.21.15.205:6807/12499', 'heartbeat_front_addr': '172.21.15.205:6806/12499', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b152141f-b530-448e-8dff-fe200559eff0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6808', 'nonce': 12525}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6810', 'nonce': 12525}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6814', 'nonce': 12525}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6812', 'nonce': 12525}]}, 'public_addr': '172.21.15.205:6808/12525', 'cluster_addr': '172.21.15.205:6810/12525', 'heartbeat_back_addr': '172.21.15.205:6814/12525', 'heartbeat_front_addr': '172.21.15.205:6812/12525', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '62a140ba-7f94-4bb6-8a62-fda077f81354', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6809', 'nonce': 12524}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6811', 'nonce': 12524}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6815', 'nonce': 12524}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6813', 'nonce': 12524}]}, 'public_addr': '172.21.15.205:6809/12524', 'cluster_addr': '172.21.15.205:6811/12524', 'heartbeat_back_addr': '172.21.15.205:6815/12524', 'heartbeat_front_addr': '172.21.15.205:6813/12524', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '32879bd7-780c-4da6-9838-5850b6277902', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6800', 'nonce': 12522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6801', 'nonce': 12522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6803', 'nonce': 12522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6802', 'nonce': 12522}]}, 'public_addr': '172.21.15.205:6800/12522', 'cluster_addr': '172.21.15.205:6801/12522', 'heartbeat_back_addr': '172.21.15.205:6803/12522', 'heartbeat_front_addr': '172.21.15.205:6802/12522', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-12T17:25:44.263353+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-12T17:25:32.332836+0000', 'dead_epoch': 58}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-12T17:25:56.086138+0000', 'dead_epoch': 94}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:25:45.759169+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:25:45.106269+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:25:46.496339+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:25:44.404347+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:25:45.516908+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-11-12T17:26:10.503 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:26:10.504 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:10.505 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:10.498+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:10.602 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:10.598+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:10.644 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:10.645 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:10.659 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:10.704 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:10.698+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:10.719 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:10.747 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:10.778 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:10.796 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:10.797 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:10.797 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:10.797 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:10.805 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:10.800+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:10.811 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:10.812 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:10.852 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:10.886 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:10.897 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:26:10.902 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:26:10.904 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:10.900+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:10.919 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2020-11-12T17:26:09.581379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":545390592,"num_objects":8324,"num_object_clones":0,"num_object_copies":16648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1416,"num_objects_unfound":0,"num_objects_dirty":8324,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66578,"num_write_kb":532610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":5668864,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66578,"ondisk_log_size":66578,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":5712556,"kb_used_data":469636,"kb_used_omap":0,"kb_used_meta":5242880,"kb_avail":466146644,"statfs":{"total":483183820800,"available":477334163456,"internally_reserved":5368709120,"allocated":480907264,"data_stored":956153438,"data_compressed":6390529,"data_compressed_allocated":477376512,"data_compressed_original":954753024,"omap_allocated":0,"internal_metadata":5368709120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,0,4,12,1,7],"upper_bound":64},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23953408,"num_objects":365,"num_object_clones":0,"num_object_copies":730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1416,"num_objects_unfound":0,"num_objects_dirty":365,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2924,"num_write_kb":23392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":5668864,"num_keys_recovered":2,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001597"},"pg_stats":[{"pgid":"4.f","version":"107'4176","reported_seq":"4215","reported_epoch":"107","state":"active+clean","last_fresh":"2020-11-12T17:26:06.612078+0000","last_change":"2020-11-12T17:24:50.857680+0000","last_active":"2020-11-12T17:26:06.612078+0000","last_peered":"2020-11-12T17:26:06.612078+0000","last_clean":"2020-11-12T17:26:06.612078+0000","last_became_active":"2020-11-12T17:24:50.856245+0000","last_became_peered":"2020-11-12T17:24:50.856245+0000","last_unstale":"2020-11-12T17:26:06.612078+0000","last_undegraded":"2020-11-12T17:26:06.612078+0000","last_fullsized":"2020-11-12T17:26:06.612078+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4176,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34209792,"num_objects":522,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":522,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4176,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"106'4144","reported_seq":"4187","reported_epoch":"106","state":"active+clean","last_fresh":"2020-11-12T17:26:05.064016+0000","last_change":"2020-11-12T17:24:50.864218+0000","last_active":"2020-11-12T17:26:05.064016+0000","last_peered":"2020-11-12T17:26:05.064016+0000","last_clean":"2020-11-12T17:26:05.064016+0000","last_became_active":"2020-11-12T17:24:50.863828+0000","last_became_peered":"2020-11-12T17:24:50.863828+0000","last_unstale":"2020-11-12T17:26:05.064016+0000","last_undegraded":"2020-11-12T17:26:05.064016+0000","last_fullsized":"2020-11-12T17:26:05.064016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4144,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":518,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4144,"num_write_kb":33152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"105'4296","reported_seq":"4340","reported_epoch":"105","state":"active+clean","last_fresh":"2020-11-12T17:26:04.591874+0000","last_change":"2020-11-12T17:24:50.863794+0000","last_active":"2020-11-12T17:26:04.591874+0000","last_peered":"2020-11-12T17:26:04.591874+0000","last_clean":"2020-11-12T17:26:04.591874+0000","last_became_active":"2020-11-12T17:24:50.863357+0000","last_became_peered":"2020-11-12T17:24:50.863357+0000","last_unstale":"2020-11-12T17:26:04.591874+0000","last_undegraded":"2020-11-12T17:26:04.591874+0000","last_fullsized":"2020-11-12T17:26:04.591874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4296,"ondisk_log_size":4296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35192832,"num_objects":537,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":537,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4296,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.c","version":"105'4160","reported_seq":"4204","reported_epoch":"106","state":"active+clean","last_fresh":"2020-11-12T17:26:05.046179+0000","last_change":"2020-11-12T17:24:50.858690+0000","last_active":"2020-11-12T17:26:05.046179+0000","last_peered":"2020-11-12T17:26:05.046179+0000","last_clean":"2020-11-12T17:26:05.046179+0000","last_became_active":"2020-11-12T17:24:50.858126+0000","last_became_peered":"2020-11-12T17:24:50.858126+0000","last_unstale":"2020-11-12T17:26:05.046179+0000","last_undegraded":"2020-11-12T17:26:05.046179+0000","last_fullsized":"2020-11-12T17:26:05.046179+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4160,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":520,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4160,"num_write_kb":33280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"105'4256","reported_seq":"4297","reported_epoch":"106","state":"peering","last_fresh":"2020-11-12T17:26:05.043336+0000","last_change":"2020-11-12T17:26:05.043587+0000","last_active":"2020-11-12T17:26:05.043336+0000","last_peered":"2020-11-12T17:26:04.914366+0000","last_clean":"2020-11-12T17:26:04.914366+0000","last_became_active":"2020-11-12T17:24:50.864001+0000","last_became_peered":"2020-11-12T17:24:50.864001+0000","last_unstale":"2020-11-12T17:26:05.043336+0000","last_undegraded":"2020-11-12T17:26:05.043336+0000","last_fullsized":"2020-11-12T17:26:05.043336+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4256,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34865152,"num_objects":532,"num_object_clones":0,"num_object_copies":1064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":532,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4256,"num_write_kb":34048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"105'4136","reported_seq":"4180","reported_epoch":"105","state":"active+clean","last_fresh":"2020-11-12T17:26:04.821756+0000","last_change":"2020-11-12T17:24:51.721640+0000","last_active":"2020-11-12T17:26:04.821756+0000","last_peered":"2020-11-12T17:26:04.821756+0000","last_clean":"2020-11-12T17:26:04.821756+0000","last_became_active":"2020-11-12T17:24:51.720614+0000","last_became_peered":"2020-11-12T17:24:51.720614+0000","last_unstale":"2020-11-12T17:26:04.821756+0000","last_undegraded":"2020-11-12T17:26:04.821756+0000","last_fullsized":"2020-11-12T17:26:04.821756+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4136,"ondisk_log_size":4136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":517,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4136,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"105'4312","reported_seq":"4356","reported_epoch":"105","state":"active+clean","last_fresh":"2020-11-12T17:26:05.030748+0000","last_change":"2020-11-12T17:24:50.871207+0000","last_active":"2020-11-12T17:26:05.030748+0000","last_peered":"2020-11-12T17:26:05.030748+0000","last_clean":"2020-11-12T17:26:05.030748+0000","last_became_active":"2020-11-12T17:24:50.870852+0000","last_became_peered":"2020-11-12T17:24:50.870852+0000","last_unstale":"2020-11-12T17:26:05.030748+0000","last_undegraded":"2020-11-12T17:26:05.030748+0000","last_fullsized":"2020-11-12T17:26:05.030748+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4312,"ondisk_log_size":4312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35323904,"num_objects":539,"num_object_clones":0,"num_object_copies":1078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4312,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"107'3976","reported_seq":"4021","reported_epoch":"107","state":"active+clean","last_fresh":"2020-11-12T17:26:06.582737+0000","last_change":"2020-11-12T17:24:51.722005+0000","last_active":"2020-11-12T17:26:06.582737+0000","last_peered":"2020-11-12T17:26:06.582737+0000","last_clean":"2020-11-12T17:26:06.582737+0000","last_became_active":"2020-11-12T17:24:51.721107+0000","last_became_peered":"2020-11-12T17:24:51.721107+0000","last_unstale":"2020-11-12T17:26:06.582737+0000","last_undegraded":"2020-11-12T17:26:06.582737+0000","last_fullsized":"2020-11-12T17:26:06.582737+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":3976,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3976,"num_write_kb":31808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"107'4128","reported_seq":"4176","reported_epoch":"107","state":"active+clean","last_fresh":"2020-11-12T17:26:06.549049+0000","last_change":"2020-11-12T17:26:01.833854+0000","last_active":"2020-11-12T17:26:06.549049+0000","last_peered":"2020-11-12T17:26:06.549049+0000","last_clean":"2020-11-12T17:26:06.549049+0000","last_became_active":"2020-11-12T17:24:50.865574+0000","last_became_peered":"2020-11-12T17:24:50.865574+0000","last_unstale":"2020-11-12T17:26:06.549049+0000","last_undegraded":"2020-11-12T17:26:06.549049+0000","last_fullsized":"2020-11-12T17:26:06.549049+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'3976","last_scrub_stamp":"2020-11-12T17:26:01.833755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:01.833755+0000","log_size":4128,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"107","state":"active+clean","last_fresh":"2020-11-12T17:26:06.055390+0000","last_change":"2020-11-12T17:26:06.055390+0000","last_active":"2020-11-12T17:26:06.055390+0000","last_peered":"2020-11-12T17:26:06.055390+0000","last_clean":"2020-11-12T17:26:06.055390+0000","last_became_active":"2020-11-12T17:26:06.054832+0000","last_became_peered":"2020-11-12T17:26:06.054832+0000","last_unstale":"2020-11-12T17:26:06.055390+0000","last_undegraded":"2020-11-12T17:26:06.055390+0000","last_fullsized":"2020-11-12T17:26:06.055390+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:46.329629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:46.329629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"105'4096","reported_seq":"4144","reported_epoch":"106","state":"active+clean","last_fresh":"2020-11-12T17:26:05.031998+0000","last_change":"2020-11-12T17:26:01.232513+0000","last_active":"2020-11-12T17:26:05.031998+0000","last_peered":"2020-11-12T17:26:05.031998+0000","last_clean":"2020-11-12T17:26:05.031998+0000","last_became_active":"2020-11-12T17:24:50.862235+0000","last_became_peered":"2020-11-12T17:24:50.862235+0000","last_unstale":"2020-11-12T17:26:05.031998+0000","last_undegraded":"2020-11-12T17:26:05.031998+0000","last_fullsized":"2020-11-12T17:26:05.031998+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'3904","last_scrub_stamp":"2020-11-12T17:26:01.232418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:01.232418+0000","log_size":4096,"ondisk_log_size":4096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":512,"num_object_clones":0,"num_object_copies":1024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":512,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4096,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"112","reported_epoch":"106","state":"active+clean","last_fresh":"2020-11-12T17:26:05.041598+0000","last_change":"2020-11-12T17:25:23.254945+0000","last_active":"2020-11-12T17:26:05.041598+0000","last_peered":"2020-11-12T17:26:05.041598+0000","last_clean":"2020-11-12T17:26:05.041598+0000","last_became_active":"2020-11-12T17:24:30.653733+0000","last_became_peered":"2020-11-12T17:24:30.653733+0000","last_unstale":"2020-11-12T17:26:05.041598+0000","last_undegraded":"2020-11-12T17:26:05.041598+0000","last_fullsized":"2020-11-12T17:26:05.041598+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:23.254853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:23.254853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"107'3984","reported_seq":"4084","reported_epoch":"107","state":"active+recovering","last_fresh":"2020-11-12T17:26:06.608820+0000","last_change":"2020-11-12T17:26:06.244521+0000","last_active":"2020-11-12T17:26:06.608820+0000","last_peered":"2020-11-12T17:26:06.608820+0000","last_clean":"2020-11-12T17:26:04.929358+0000","last_became_active":"2020-11-12T17:26:06.226885+0000","last_became_peered":"2020-11-12T17:26:06.226885+0000","last_unstale":"2020-11-12T17:26:06.608820+0000","last_undegraded":"2020-11-12T17:26:06.608820+0000","last_fullsized":"2020-11-12T17:26:06.608820+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":3984,"ondisk_log_size":3984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32636928,"num_objects":498,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":469,"num_objects_unfound":0,"num_objects_dirty":498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3984,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":1638400,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","0"],"object_location_counts":[{"shards":"0,5","objects":469},{"shards":"5,7","objects":29}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"93","reported_epoch":"107","state":"active+clean","last_fresh":"2020-11-12T17:26:06.051659+0000","last_change":"2020-11-12T17:26:06.051659+0000","last_active":"2020-11-12T17:26:06.051659+0000","last_peered":"2020-11-12T17:26:06.051659+0000","last_clean":"2020-11-12T17:26:06.051659+0000","last_became_active":"2020-11-12T17:26:06.050876+0000","last_became_peered":"2020-11-12T17:26:06.050876+0000","last_unstale":"2020-11-12T17:26:06.051659+0000","last_undegraded":"2020-11-12T17:26:06.051659+0000","last_fullsized":"2020-11-12T17:26:06.051659+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:45.040397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:45.040397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"105'4216","reported_seq":"4260","reported_epoch":"105","state":"active+clean","last_fresh":"2020-11-12T17:26:04.904570+0000","last_change":"2020-11-12T17:24:50.867446+0000","last_active":"2020-11-12T17:26:04.904570+0000","last_peered":"2020-11-12T17:26:04.904570+0000","last_clean":"2020-11-12T17:26:04.904570+0000","last_became_active":"2020-11-12T17:24:50.867064+0000","last_became_peered":"2020-11-12T17:24:50.867064+0000","last_unstale":"2020-11-12T17:26:04.904570+0000","last_undegraded":"2020-11-12T17:26:04.904570+0000","last_fullsized":"2020-11-12T17:26:04.904570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4216,"ondisk_log_size":4216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34537472,"num_objects":527,"num_object_clones":0,"num_object_copies":1054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4216,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"111","reported_epoch":"106","state":"active+clean","last_fresh":"2020-11-12T17:26:05.042575+0000","last_change":"2020-11-12T17:25:46.581725+0000","last_active":"2020-11-12T17:26:05.042575+0000","last_peered":"2020-11-12T17:26:05.042575+0000","last_clean":"2020-11-12T17:26:05.042575+0000","last_became_active":"2020-11-12T17:23:27.787364+0000","last_became_peered":"2020-11-12T17:23:27.787364+0000","last_unstale":"2020-11-12T17:26:05.042575+0000","last_undegraded":"2020-11-12T17:26:05.042575+0000","last_fullsized":"2020-11-12T17:26:05.042575+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:46.581637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:46.581637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"122","reported_epoch":"107","state":"active+clean","last_fresh":"2020-11-12T17:26:06.066118+0000","last_change":"2020-11-12T17:26:06.066118+0000","last_active":"2020-11-12T17:26:06.066118+0000","last_peered":"2020-11-12T17:26:06.066118+0000","last_clean":"2020-11-12T17:26:06.066118+0000","last_became_active":"2020-11-12T17:26:06.057282+0000","last_became_peered":"2020-11-12T17:26:06.057282+0000","last_unstale":"2020-11-12T17:26:06.066118+0000","last_undegraded":"2020-11-12T17:26:06.066118+0000","last_fullsized":"2020-11-12T17:26:06.066118+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:25:22.846686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:25:22.846686+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"107'3928","reported_seq":"4047","reported_epoch":"107","state":"active+recovering","last_fresh":"2020-11-12T17:26:06.593633+0000","last_change":"2020-11-12T17:26:06.218843+0000","last_active":"2020-11-12T17:26:06.593633+0000","last_peered":"2020-11-12T17:26:06.593633+0000","last_clean":"2020-11-12T17:26:05.005718+0000","last_became_active":"2020-11-12T17:26:06.201695+0000","last_became_peered":"2020-11-12T17:26:06.201695+0000","last_unstale":"2020-11-12T17:26:06.593633+0000","last_undegraded":"2020-11-12T17:26:06.593633+0000","last_fullsized":"2020-11-12T17:26:06.593633+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'3680","last_scrub_stamp":"2020-11-12T17:26:00.856078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:00.856078+0000","log_size":3928,"ondisk_log_size":3928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":456,"num_objects_unfound":0,"num_objects_dirty":491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3928,"num_write_kb":31424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":2129920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","0"],"object_location_counts":[{"shards":"0,7","objects":456},{"shards":"5,7","objects":35}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"120","reported_epoch":"107","state":"active+clean","last_fresh":"2020-11-12T17:26:06.055827+0000","last_change":"2020-11-12T17:26:06.055827+0000","last_active":"2020-11-12T17:26:06.055827+0000","last_peered":"2020-11-12T17:26:06.055827+0000","last_clean":"2020-11-12T17:26:06.055827+0000","last_became_active":"2020-11-12T17:26:06.055089+0000","last_became_peered":"2020-11-12T17:26:06.055089+0000","last_unstale":"2020-11-12T17:26:06.055827+0000","last_undegraded":"2020-11-12T17:26:06.055827+0000","last_fullsized":"2020-11-12T17:26:06.055827+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:33.820630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:33.820630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"107'4184","reported_seq":"4294","reported_epoch":"107","state":"active+recovering","last_fresh":"2020-11-12T17:26:06.600559+0000","last_change":"2020-11-12T17:26:06.228057+0000","last_active":"2020-11-12T17:26:06.600559+0000","last_peered":"2020-11-12T17:26:06.600559+0000","last_clean":"2020-11-12T17:26:04.993333+0000","last_became_active":"2020-11-12T17:26:06.202691+0000","last_became_peered":"2020-11-12T17:26:06.202691+0000","last_unstale":"2020-11-12T17:26:06.600559+0000","last_undegraded":"2020-11-12T17:26:06.600559+0000","last_fullsized":"2020-11-12T17:26:06.600559+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'4120","last_scrub_stamp":"2020-11-12T17:26:03.373193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:03.373193+0000","log_size":4184,"ondisk_log_size":4184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34275328,"num_objects":523,"num_object_clones":0,"num_object_copies":1046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":491,"num_objects_unfound":0,"num_objects_dirty":523,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4184,"num_write_kb":33472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":1900544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","0"],"object_location_counts":[{"shards":"0,5","objects":491},{"shards":"5,7","objects":32}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"111","reported_epoch":"107","state":"active+clean","last_fresh":"2020-11-12T17:26:06.060044+0000","last_change":"2020-11-12T17:26:06.060044+0000","last_active":"2020-11-12T17:26:06.060044+0000","last_peered":"2020-11-12T17:26:06.060044+0000","last_clean":"2020-11-12T17:26:06.060044+0000","last_became_active":"2020-11-12T17:26:06.058701+0000","last_became_peered":"2020-11-12T17:26:06.058701+0000","last_unstale":"2020-11-12T17:26:06.060044+0000","last_undegraded":"2020-11-12T17:26:06.060044+0000","last_fullsized":"2020-11-12T17:26:06.060044+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:34.809567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:25:34.809567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"107'4200","reported_seq":"4245","reported_epoch":"107","state":"active+clean","last_fresh":"2020-11-12T17:26:06.519135+0000","last_change":"2020-11-12T17:24:51.720640+0000","last_active":"2020-11-12T17:26:06.519135+0000","last_peered":"2020-11-12T17:26:06.519135+0000","last_clean":"2020-11-12T17:26:06.519135+0000","last_became_active":"2020-11-12T17:24:51.719333+0000","last_became_peered":"2020-11-12T17:24:51.719333+0000","last_unstale":"2020-11-12T17:26:06.519135+0000","last_undegraded":"2020-11-12T17:26:06.519135+0000","last_fullsized":"2020-11-12T17:26:06.519135+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4200,"ondisk_log_size":4200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":525,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4200,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"89","reported_epoch":"105","state":"active+clean","last_fresh":"2020-11-12T17:26:02.007589+0000","last_change":"2020-11-12T17:25:38.366805+0000","last_active":"2020-11-12T17:26:02.007589+0000","last_peered":"2020-11-12T17:26:02.007589+0000","last_clean":"2020-11-12T17:26:02.007589+0000","last_became_active":"2020-11-12T17:24:30.652206+0000","last_became_peered":"2020-11-12T17:24:30.652206+0000","last_unstale":"2020-11-12T17:26:02.007589+0000","last_undegraded":"2020-11-12T17:26:02.007589+0000","last_fullsized":"2020-11-12T17:26:02.007589+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:38.366685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:38.366685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"105'4384","reported_seq":"4428","reported_epoch":"105","state":"active+clean","last_fresh":"2020-11-12T17:26:04.629875+0000","last_change":"2020-11-12T17:24:50.865566+0000","last_active":"2020-11-12T17:26:04.629875+0000","last_peered":"2020-11-12T17:26:04.629875+0000","last_clean":"2020-11-12T17:26:04.629875+0000","last_became_active":"2020-11-12T17:24:50.865159+0000","last_became_peered":"2020-11-12T17:24:50.865159+0000","last_unstale":"2020-11-12T17:26:04.629875+0000","last_undegraded":"2020-11-12T17:26:04.629875+0000","last_fullsized":"2020-11-12T17:26:04.629875+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":4384,"ondisk_log_size":4384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":548,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4384,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"93","reported_epoch":"105","state":"active+clean","last_fresh":"2020-11-12T17:26:02.007508+0000","last_change":"2020-11-12T17:25:37.363305+0000","last_active":"2020-11-12T17:26:02.007508+0000","last_peered":"2020-11-12T17:26:02.007508+0000","last_clean":"2020-11-12T17:26:02.007508+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:26:02.007508+0000","last_undegraded":"2020-11-12T17:26:02.007508+0000","last_fullsized":"2020-11-12T17:26:02.007508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:37.363220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:25:37.363220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":545390592,"num_objects":8322,"num_object_clones":0,"num_object_copies":16644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1416,"num_objects_unfound":0,"num_objects_dirty":8322,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66576,"num_write_kb":532608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":5668864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":546033664,"data_stored":1099317248,"data_compressed":7314118,"data_compressed_allocated":546033664,"data_compressed_original":1099317248,"omap_allocated":0,"internal_metadata":0},"log_size":66576,"ondisk_log_size":66576,"up":32,"acting":32,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1113852,"kb_used_data":65268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93257988,"statfs":{"total":96636764160,"available":95496179712,"internally_reserved":1073741824,"allocated":66834432,"data_stored":132555682,"data_compressed":885225,"data_compressed_allocated":66138112,"data_compressed_original":132276224,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.466,"15min":1.534},"min":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.2949999999999999,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.8460000000000001,"15min":2.0459999999999998},"min":{"1min":0.80800000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.2280000000000002,"5min":7.4349999999999996,"15min":7.4349999999999996},"last":1.018}]},{"osd":1,"last update":"Thu Nov 12 17:23:51 2020","interfaces":[{"interface":"back","average":{"1min":2.27,"5min":2.27,"15min":2.27},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":7.585,"5min":7.585,"15min":7.585},"last":1.494},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.8519999999999999,"5min":3.8519999999999999,"15min":3.8519999999999999},"last":1.242}]},{"osd":2,"last update":"Thu Nov 12 17:24:54 2020","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.6120000000000001,"15min":1.6339999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.645,"5min":2.0830000000000002,"15min":2.1560000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.9769999999999999,"5min":7.6310000000000002,"15min":7.6310000000000002},"last":1.7290000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.863,"15min":2.0950000000000002},"min":{"1min":0.79700000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.4630000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.581,"5min":8.5990000000000002,"15min":4.5389999999999997},"min":{"1min":0.871,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5630000000000002,"5min":871.76700000000005,"15min":871.76700000000005},"last":1.337}]},{"osd":4,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":7.9630000000000001,"5min":35.207000000000001,"15min":47.573999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":110.66800000000001,"5min":503.50200000000001,"15min":503.50200000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":7.6310000000000002,"5min":3.105,"15min":2.371},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":108.14,"5min":108.14,"15min":108.14},"last":1.528}]},{"osd":5,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.7390000000000001,"5min":2.3759999999999999,"15min":2.6200000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.5259999999999998,"5min":7.7169999999999996,"15min":7.7169999999999996},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.865,"5min":2.4900000000000002,"15min":2.742},"min":{"1min":1.131,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.597,"5min":7.7480000000000002,"15min":7.7480000000000002},"last":1.367}]},{"osd":6,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":24.794,"5min":6.9850000000000003,"15min":4.202},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":375.04199999999997,"5min":375.04199999999997,"15min":375.04199999999997},"last":1.756},{"interface":"front","average":{"1min":1.2470000000000001,"5min":39.052999999999997,"15min":48.645000000000003},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.8159999999999998,"5min":975.20899999999995,"15min":975.20899999999995},"last":4.5060000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542187,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1131544,"kb_used_data":82960,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93240296,"statfs":{"total":96636764160,"available":95478063104,"internally_reserved":1073741824,"allocated":84951040,"data_stored":168772836,"data_compressed":1127806,"data_compressed_allocated":84246528,"data_compressed_original":168493056,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,1,0,0,7],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.597,"15min":1.7490000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.3180000000000001,"5min":3.339,"15min":3.339},"last":1.232},{"interface":"front","average":{"1min":1.385,"5min":1.849,"15min":2.0369999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6019999999999999,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":1.125}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.748,"5min":1.748,"15min":1.748},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.0680000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:24:48 2020","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":2.0800000000000001,"15min":2.1789999999999998},"min":{"1min":0.79400000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6099999999999999,"5min":5.4329999999999998,"15min":5.4329999999999998},"last":2.5470000000000002},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.1819999999999999,"15min":2.27},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3130000000000002,"5min":8.0969999999999995,"15min":8.0969999999999995},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":2.8900000000000001,"15min":2.7909999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.3360000000000003,"5min":49.442999999999998,"15min":49.442999999999998},"last":2.8370000000000002},{"interface":"front","average":{"1min":1.8660000000000001,"5min":2.2290000000000001,"15min":2.3999999999999999},"min":{"1min":0.93100000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":6.2809999999999997,"5min":8.202,"15min":8.202},"last":1.2989999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":23.341000000000001,"5min":6.3440000000000003,"15min":3.5990000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":459.15499999999997,"5min":459.15499999999997,"15min":459.15499999999997},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.595,"5min":2.4969999999999999,"15min":2.8660000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.6589999999999998,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":1.0329999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":2.1389999999999998,"15min":2.274},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":6.3300000000000001,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":2.8769999999999998},{"interface":"front","average":{"1min":1.7370000000000001,"5min":2.1299999999999999,"15min":2.2919999999999998},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":4.8440000000000003,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.282}]},{"osd":7,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":3.0009999999999999,"15min":3.069},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":4.1070000000000002,"5min":40.268000000000001,"15min":40.268000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":2.0339999999999998,"5min":2.5209999999999999,"15min":2.7770000000000001},"min":{"1min":1.097,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":6.1470000000000002,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.72599999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1201484,"kb_used_data":152900,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93170356,"statfs":{"total":96636764160,"available":95406444544,"internally_reserved":1073741824,"allocated":156569600,"data_stored":312033898,"data_compressed":2086862,"data_compressed_allocated":155877376,"data_compressed_original":311754752,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":21.207000000000001,"5min":5.4740000000000002,"15min":2.8799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":358.101,"5min":358.101,"15min":358.101},"last":1.069},{"interface":"front","average":{"1min":20.922999999999998,"5min":32.770000000000003,"15min":42.277999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":357.41199999999998,"5min":948.30899999999997,"15min":948.30899999999997},"last":1.3169999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":9.7530000000000001,"5min":9.7530000000000001,"15min":9.7530000000000001},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":162.126,"5min":162.126,"15min":162.126},"last":1.147},{"interface":"front","average":{"1min":9.4280000000000008,"5min":9.4280000000000008,"15min":9.4280000000000008},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":163.59899999999999,"5min":163.59899999999999,"15min":163.59899999999999},"last":1.175}]},{"osd":2,"last update":"Thu Nov 12 17:24:49 2020","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.7230000000000001,"15min":1.7549999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":1.7370000000000001,"5min":1.8400000000000001,"15min":1.857},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":1.2749999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":21.018000000000001,"5min":5.8150000000000004,"15min":3.2970000000000002},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":356.02300000000002,"5min":356.02300000000002,"15min":356.02300000000002},"last":1.6579999999999999},{"interface":"front","average":{"1min":21.254999999999999,"5min":5.9349999999999996,"15min":3.4220000000000002},"min":{"1min":0.751,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":357.79000000000002,"5min":357.79000000000002,"15min":357.79000000000002},"last":1.575}]},{"osd":5,"last update":"Thu Nov 12 17:25:50 2020","interfaces":[{"interface":"back","average":{"1min":53.131999999999998,"5min":12.183999999999999,"15min":5.4299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":575.16800000000001,"5min":575.16800000000001,"15min":575.16800000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":71.412999999999997,"5min":16.030999999999999,"15min":6.851},"min":{"1min":0.78000000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":908.52700000000004,"5min":908.52700000000004,"15min":908.52700000000004},"last":1.234}]},{"osd":6,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":21.048999999999999,"5min":24.763000000000002,"15min":30.684999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":356.57900000000001,"5min":665.13999999999999,"15min":665.13999999999999},"last":1.208},{"interface":"front","average":{"1min":21.399999999999999,"5min":5.9889999999999999,"15min":3.4910000000000001},"min":{"1min":0.92500000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":359.05200000000002,"5min":359.05200000000002,"15min":359.05200000000002},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":33.764000000000003,"5min":14.426,"15min":6.4039999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":358.29199999999997,"5min":584.00300000000004,"15min":584.00300000000004},"last":1.534},{"interface":"front","average":{"1min":21.434999999999999,"5min":6.0549999999999997,"15min":3.4769999999999999},"min":{"1min":1.0880000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":358.06,"5min":358.06,"15min":358.06},"last":1.0960000000000001}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":14,"seq":60129542186,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1132832,"kb_used_data":84248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93239008,"statfs":{"total":96636764160,"available":95476744192,"internally_reserved":1073741824,"allocated":86269952,"data_stored":171395136,"data_compressed":1145080,"data_compressed_allocated":85557248,"data_compressed_original":171114496,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,2,7,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.649,"15min":1.728},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4260000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.8,"15min":1.974},"min":{"1min":0.85899999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1930000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.137}]},{"osd":1,"last update":"Thu Nov 12 17:23:45 2020","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":3.6000000000000001,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":2.254,"5min":2.254,"15min":2.254},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.0620000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:24:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.954,"15min":2.0329999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.4390000000000001,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":1.353},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.9470000000000001,"15min":2.0219999999999998},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.2989999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.196}]},{"osd":3,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.9390000000000001,"15min":2.0529999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.6720000000000002,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.486},{"interface":"front","average":{"1min":1.5429999999999999,"5min":2.1320000000000001,"15min":2.3500000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3490000000000002,"5min":9.2550000000000008,"15min":9.2550000000000008},"last":1.464}]},{"osd":4,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.9810000000000001,"15min":2.1469999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.7559999999999998,"5min":6.3049999999999997,"15min":6.3049999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":10.989000000000001,"5min":4.1109999999999998,"15min":3.1509999999999998},"min":{"1min":0.91500000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":169.80799999999999,"5min":169.80799999999999,"15min":169.80799999999999},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":94.287999999999997,"5min":20.582999999999998,"15min":8.3810000000000002},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":804.62199999999996,"5min":804.62199999999996,"15min":804.62199999999996},"last":1.391},{"interface":"front","average":{"1min":28.815000000000001,"5min":19.753,"15min":21.745000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":494.78399999999999,"5min":494.78399999999999,"15min":494.78399999999999},"last":1.169}]},{"osd":7,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":79.114999999999995,"5min":17.864000000000001,"15min":7.8079999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1002.347,"5min":1002.347,"15min":1002.347},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.9019999999999999,"5min":2.4100000000000001,"15min":2.4860000000000002},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5739999999999998,"5min":10.271000000000001,"15min":10.271000000000001},"last":1.4399999999999999}]}]},{"osd":0,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1132844,"kb_used_data":84260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93238996,"statfs":{"total":96636764160,"available":95476731904,"internally_reserved":1073741824,"allocated":86282240,"data_stored":171395886,"data_compressed":1145556,"data_compressed_allocated":85557248,"data_compressed_original":171114496,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":3.7719999999999998,"15min":2.456},"min":{"1min":0.60099999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4849999999999999,"5min":178.36699999999999,"15min":178.36699999999999},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.915,"15min":1.9430000000000001},"min":{"1min":0.79600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.6509999999999998,"5min":16.902000000000001,"15min":16.902000000000001},"last":1.8129999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:23:47 2020","interfaces":[{"interface":"back","average":{"1min":22.77,"5min":22.77,"15min":22.77},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":440.65899999999999,"5min":440.65899999999999,"15min":440.65899999999999},"last":2.0840000000000001},{"interface":"front","average":{"1min":1.839,"5min":1.839,"15min":1.839},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":3.827,"5min":3.827,"15min":3.827},"last":2.2989999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:24:50 2020","interfaces":[{"interface":"back","average":{"1min":6.5069999999999997,"5min":3.1789999999999998,"15min":2.6240000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":86.161000000000001,"5min":86.161000000000001,"15min":86.161000000000001},"last":1.9319999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.8819999999999999,"15min":1.956},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4300000000000002,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":2.0169999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":2.246,"15min":2.4420000000000002},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":3.2509999999999999,"5min":10.318,"15min":10.318},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.446,"5min":2.1400000000000001,"15min":2.3780000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.411,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":2.855}]},{"osd":5,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":20.111000000000001,"15min":28.177},"min":{"1min":0.96999999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.8530000000000002,"5min":622.07799999999997,"15min":622.07799999999997},"last":2.6560000000000001},{"interface":"front","average":{"1min":1.9039999999999999,"5min":2.524,"15min":2.746},"min":{"1min":1.0640000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.3170000000000002,"5min":10.436,"15min":10.436},"last":1.494}]},{"osd":6,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":2.552,"5min":2.4769999999999999,"15min":2.5750000000000002},"min":{"1min":0.95599999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":20.686,"5min":20.686,"15min":20.686},"last":2.9729999999999999},{"interface":"front","average":{"1min":1.8660000000000001,"5min":2.3999999999999999,"15min":2.6320000000000001},"min":{"1min":1.294,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.7450000000000001,"5min":11.497999999999999,"15min":11.497999999999999},"last":2.8969999999999998}]},{"osd":7,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":2.5489999999999999,"15min":2.8029999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.363,"5min":10.513999999999999,"15min":10.513999999999999},"last":2.1680000000000001},{"interface":"front","average":{"1min":1.837,"5min":18.891999999999999,"15min":26.423999999999999},"min":{"1min":1.115,"5min":1.016,"15min":1.016},"max":{"1min":3.1520000000000001,"5min":577.35900000000004,"15min":577.35900000000004},"last":2.802}]}]}]}} 2020-11-12T17:26:10.922 INFO:tasks.thrashosds.thrasher:Setting 4.a to [1, 6] 2020-11-12T17:26:10.923 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.a', '1', '6'] 2020-11-12T17:26:10.923 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap 4.a 1 6 2020-11-12T17:26:10.924 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:10.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 79 16 69382 69366 6.85911 5.08594 0.0327627 0.0182155 2020-11-12T17:26:10.962 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:10.964 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:10.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:10.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:10.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:10.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:10.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:10.965 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:10.966 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:10.977 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:10.978 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:10.978 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:10.978 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:10.978 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:10.992 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:11.036 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:11.032+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:11.106 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:11.102+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:11.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:11.169 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:26:11.169 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:11.179 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:11.223 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:11.220+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:11.258 INFO:teuthology.orchestra.run.smithi036.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-11-12T17:26:11.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:26:11.260 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap, ignoring 2020-11-12T17:26:11.284 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:11.285 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:11.285 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:11.296 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:11.312 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:11.306+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:11.402 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:11.394+0000 7f7b4fea9700 -1 osd.4 108 handle_osd_map injecting map crc failure 2020-11-12T17:26:11.423 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:11.408+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:11.424 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:26:11.456 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:11.457 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:11.457 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:11.457 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:11.457 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:11.467 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:11.514 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:11.510+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:11.615 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:11.608+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:11.640 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:11.641 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:11.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:11.641 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:26:11.642 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:11.651 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:11.741 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:11.736+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:11.816 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:11.816 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:11.817 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:11.817 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:11.817 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:11.812+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:11.827 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:11.919 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:11.914+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:11.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:26:11.934688+0000 min lat: 0.00228632 max lat: 1.22522 avg lat: 0.0182562 2020-11-12T17:26:11.935 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:26:11.935 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 80 16 70108 70092 6.84426 5.67188 0.014312 0.0182562 2020-11-12T17:26:11.987 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:11.988 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:11.988 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:11.988 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:11.988 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:11.995 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:12.021 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:12.018+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:12.109 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:12.109 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 186.99576130299999, 2020-11-12T17:26:12.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.111 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:12.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:12.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:12.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:12.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:12.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:12.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:12.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:12.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:12.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:12.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:12.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:12.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:12.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:12.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:12.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:12.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:12.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:12.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:12.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:12.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:12.123 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.123 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.123 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.124 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:12.124 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:12.124 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 186.988669507, 2020-11-12T17:26:12.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:12.124 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.124 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.125 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:12.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:12.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:12.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:12.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:12.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:12.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:12.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:12.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:12.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:12.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:12.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:12.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:12.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:12.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:12.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:12.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:12.132 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.132 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.132 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.133 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:12.133 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:12.133 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 177.55611001, 2020-11-12T17:26:12.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:12.133 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.133 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.134 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.134 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.134 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.134 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:12.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.135 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:12.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:12.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:12.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:12.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:12.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:12.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:12.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:12.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:12.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:12.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:12.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:12.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:12.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:12.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:12.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:12.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:12.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:12.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:12.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:12.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:12.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:12.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:12.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:12.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:12.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:12.145 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.145 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.145 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.145 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:12.145 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:12.146 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.605989916, 2020-11-12T17:26:12.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:12.146 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.146 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.146 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:12.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:12.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:12.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:12.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:12.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:12.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:12.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:12.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:12.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:12.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:12.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:12.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:12.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:12.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:12.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:12.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:12.153 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.153 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.154 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.154 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:12.154 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:12.154 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 141.50038802399999, 2020-11-12T17:26:12.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:12.155 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.155 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.155 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:12.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:12.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:12.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:12.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:12.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:12.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:12.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:12.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:12.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:12.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:12.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:12.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:12.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:12.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:12.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:12.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:12.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:12.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:12.162 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.162 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.162 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.163 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:12.163 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:12.163 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.15390469, 2020-11-12T17:26:12.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:12.163 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.163 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.164 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.164 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.164 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.164 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:12.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.164 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:12.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:12.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:12.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:12.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:12.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:12.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:12.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:12.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:12.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:12.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:12.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:12.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:12.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:12.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:12.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:12.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:12.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:12.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:12.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:12.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:12.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:12.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:12.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:12.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:12.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:12.175 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.175 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.175 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.176 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:12.176 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:12.176 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 101.158062888, 2020-11-12T17:26:12.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:12.177 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.177 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.177 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:12.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:12.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:12.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:12.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:12.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:12.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:12.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:12.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:12.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:12.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:12.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:12.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:12.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:12.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:12.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:12.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:12.183 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.184 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.184 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.184 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:12.184 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:12.184 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 97.222959489000004, 2020-11-12T17:26:12.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:12.185 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.185 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:12.185 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:12.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:12.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:12.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:12.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:12.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:12.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:12.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:12.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:12.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:12.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:12.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:12.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:12.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:12.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:12.190 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.190 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.191 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.191 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:12.191 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:12.191 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 66.458318997999996, 2020-11-12T17:26:12.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:12.192 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.192 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.192 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:12.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:12.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:12.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:12.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:12.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:12.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:12.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:12.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:12.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:12.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:12.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:12.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:12.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:12.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:12.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:12.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:12.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.199 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:12.199 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:12.199 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.201810313999999, 2020-11-12T17:26:12.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:12.200 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.200 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.200 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:12.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.201 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:12.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:12.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:12.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:12.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:12.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:12.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:12.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:12.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:12.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:12.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:12.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:12.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:12.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:12.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:12.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:12.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:12.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:12.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:12.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:12.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:12.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:12.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:12.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:12.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:12.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:12.209 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.209 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.210 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:12.210 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:12.210 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.201647944000001, 2020-11-12T17:26:12.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.222 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:12.222 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:12.222 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.193078956999997, 2020-11-12T17:26:12.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:12.222 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.222 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.223 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:12.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:12.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:12.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:12.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:12.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:12.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:12.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:12.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:12.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:12.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:12.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:12.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:12.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:12.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:12.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:12.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:12.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.229 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.229 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:12.229 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:12.230 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 35.688566506999997, 2020-11-12T17:26:12.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:12.230 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.230 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.230 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.230 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.230 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.231 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:12.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.231 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:12.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:12.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:12.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:12.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:12.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:12.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:12.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:12.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:12.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:12.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:12.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:12.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:12.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:12.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:12.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:12.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:12.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:12.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:12.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:12.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:12.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:12.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:12.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:12.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:12.241 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.241 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.241 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.242 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:12.242 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:12.242 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.203018221000001, 2020-11-12T17:26:12.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:12.242 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.243 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.243 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.243 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.243 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.243 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:12.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.243 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:12.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:12.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:12.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:12.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:12.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:12.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:12.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:12.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:12.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:12.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:12.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:12.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:12.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:12.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:12.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:12.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:12.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:12.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:12.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:12.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:12.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:12.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:12.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:12.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:12.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.254 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.255 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:12.255 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:12.255 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 31.129699789, 2020-11-12T17:26:12.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:12.256 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.256 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.256 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:12.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:12.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:12.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:12.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:12.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:12.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:12.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:12.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:12.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:12.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:12.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:12.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:12.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:12.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:12.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:12.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:12.263 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.263 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.264 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.264 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:12.264 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:12.264 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.074054813, 2020-11-12T17:26:12.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:12.265 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.265 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.265 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.265 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.265 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.265 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:12.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.266 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:12.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:12.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:12.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:12.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:12.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:12.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:12.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:12.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:12.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:12.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:12.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:12.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:12.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:12.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:12.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:12.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:12.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:12.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:12.274 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.274 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.275 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.275 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:12.275 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:12.275 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.685850442, 2020-11-12T17:26:12.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:12.276 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.276 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.276 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:12.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.276 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:12.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:12.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:12.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:12.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:12.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:12.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:12.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:12.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:12.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:12.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:12.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:12.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:12.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:12.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:12.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:12.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:12.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:12.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:12.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:12.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:12.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:12.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:12.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:12.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:12.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:12.285 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.285 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.285 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.286 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:12.286 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:12.286 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.47939351, 2020-11-12T17:26:12.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:12.286 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.286 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.287 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.287 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.287 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.287 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:12.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.287 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:12.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:12.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:12.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:12.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:12.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:12.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:12.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:12.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:12.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:12.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:12.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:12.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:12.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:12.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:12.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:12.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:12.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:12.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:12.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:12.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:12.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:12.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:12.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:12.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:12.296 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.296 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.296 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.297 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:12.297 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:12.297 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.230187893, 2020-11-12T17:26:12.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:12.297 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.297 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.298 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:12.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.298 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:12.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:12.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:12.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:12.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:12.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:12.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:12.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:12.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:12.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:12.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:12.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:12.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:12.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:12.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:12.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:12.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:12.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:12.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:12.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:12.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:12.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:12.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:12.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:12.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:12.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:12.307 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.307 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.307 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.308 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:12.308 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:12.308 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.213228444, 2020-11-12T17:26:12.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:12.308 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.308 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.308 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:12.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:12.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:12.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:12.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:12.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:12.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:12.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:12.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:12.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:12.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:12.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:12.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:12.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:12.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:12.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:12.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:12.314 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.315 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.315 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.315 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.315 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.315 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:12.317 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:12.317 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:12.312+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:12.421 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:12.418+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:12.490 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:70482 4.4 4:2ccea679:::benchmark_data_smithi036_18856_object8810:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:12.487945+0000", 2020-11-12T17:26:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.002031007, 2020-11-12T17:26:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020568029999999998, 2020-11-12T17:26:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70482 2020-11-12T17:26:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.487945+0000", 2020-11-12T17:26:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.487945+0000", 2020-11-12T17:26:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.487917+0000", 2020-11-12T17:26:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0531999999999994e-05 2020-11-12T17:26:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.487997+0000", 2020-11-12T17:26:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2900000000000002e-06 2020-11-12T17:26:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.488006+0000", 2020-11-12T17:26:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2245999999999999e-05 2020-11-12T17:26:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.488018+0000", 2020-11-12T17:26:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019114889999999999 2020-11-12T17:26:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.489929+0000", 2020-11-12T17:26:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001984085 2020-11-12T17:26:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:70483 4.4 4.9e657334 (undecoded) ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:12.488588+0000", 2020-11-12T17:26:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00138802, 2020-11-12T17:26:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014678670000000001, 2020-11-12T17:26:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70483 2020-11-12T17:26:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.488588+0000", 2020-11-12T17:26:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.488588+0000", 2020-11-12T17:26:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:26:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.488558+0000", 2020-11-12T17:26:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1760000000000002e-05 2020-11-12T17:26:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.488649+0000", 2020-11-12T17:26:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3631999999999999e-05 2020-11-12T17:26:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.488663+0000", 2020-11-12T17:26:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:26:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.488670+0000", 2020-11-12T17:26:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1927000000000004e-05 2020-11-12T17:26:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:70478 4.9 e109/69 4:901286e9:::benchmark_data_smithi036_18856_object8809:head v 109'4606, mlcod=109'4601)", 2020-11-12T17:26:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:12.486524+0000", 2020-11-12T17:26:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0034524790000000001, 2020-11-12T17:26:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003576077, 2020-11-12T17:26:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486524+0000", 2020-11-12T17:26:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486524+0000", 2020-11-12T17:26:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486499+0000", 2020-11-12T17:26:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3751999999999994e-05 2020-11-12T17:26:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486583+0000", 2020-11-12T17:26:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024411189999999998 2020-11-12T17:26:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.489024+0000", 2020-11-12T17:26:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3219999999999998e-06 2020-11-12T17:26:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.489030+0000", 2020-11-12T17:26:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000124497 2020-11-12T17:26:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.489155+0000", 2020-11-12T17:26:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3212000000000001e-05 2020-11-12T17:26:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.489178+0000", 2020-11-12T17:26:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026542699999999998 2020-11-12T17:26:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:70477 4.9 e109/69 4:901286e9:::benchmark_data_smithi036_18856_object8809:head v 109'4605, mlcod=109'4599)", 2020-11-12T17:26:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:12.483993+0000", 2020-11-12T17:26:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0059836480000000003, 2020-11-12T17:26:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061520730000000001, 2020-11-12T17:26:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.483993+0000", 2020-11-12T17:26:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.483993+0000", 2020-11-12T17:26:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999871 2020-11-12T17:26:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.483980+0000", 2020-11-12T17:26:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2369e-05 2020-11-12T17:26:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.484032+0000", 2020-11-12T17:26:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026008680000000001 2020-11-12T17:26:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486633+0000", 2020-11-12T17:26:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0079999999999999e-06 2020-11-12T17:26:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486639+0000", 2020-11-12T17:26:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5939999999999997e-05 2020-11-12T17:26:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486685+0000", 2020-11-12T17:26:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6019999999999999e-05 2020-11-12T17:26:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486701+0000", 2020-11-12T17:26:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027083720000000001 2020-11-12T17:26:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:70481 4.4 4:2ccea679:::benchmark_data_smithi036_18856_object8810:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:12.486621+0000", 2020-11-12T17:26:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0033551319999999998, 2020-11-12T17:26:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035825729999999999, 2020-11-12T17:26:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70481 2020-11-12T17:26:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486621+0000", 2020-11-12T17:26:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486621+0000", 2020-11-12T17:26:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:26:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486590+0000", 2020-11-12T17:26:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1026999999999994e-05 2020-11-12T17:26:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486681+0000", 2020-11-12T17:26:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1337e-05 2020-11-12T17:26:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486692+0000", 2020-11-12T17:26:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3139999999999997e-06 2020-11-12T17:26:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486697+0000", 2020-11-12T17:26:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6520999999999997e-05 2020-11-12T17:26:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486743+0000", 2020-11-12T17:26:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000234095 2020-11-12T17:26:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.486977+0000", 2020-11-12T17:26:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022598299999999999 2020-11-12T17:26:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:12.487203+0000", 2020-11-12T17:26:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058215399999999998 2020-11-12T17:26:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 5 2020-11-12T17:26:12.531 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:12.533 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:12.534 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:12.530+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:12.635 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:12.630+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:12.663 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:12.663 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:12.664 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:12.664 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:12.664 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:12.674 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:12.737 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:12.730+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:12.811 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:12.811 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:12.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:12.811 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:12.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.812 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:12.812 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:12.812 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 178.38781194699999, 2020-11-12T17:26:12.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:12.812 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.812 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.812 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.813 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.813 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.813 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:12.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.813 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:12.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:12.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:12.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:12.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:12.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:12.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:12.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:12.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:12.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:12.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:12.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:12.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:12.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:12.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:12.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:12.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:12.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:12.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:12.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:12.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:12.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:12.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:12.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:12.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:12.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.827 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.827 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:12.827 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:12.827 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 178.38086788499999, 2020-11-12T17:26:12.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:12.828 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.828 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.828 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:12.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:12.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:12.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:12.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:12.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:12.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:12.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:12.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:12.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:12.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:12.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:12.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:12.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:12.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:12.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:12.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:12.835 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.835 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.836 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.836 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:12.837 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:12.837 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.20703009900001, 2020-11-12T17:26:12.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:12.837 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.837 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.837 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.837 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.838 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.838 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:12.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.838 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:12.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:12.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:12.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:12.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:12.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:12.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:12.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:12.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:12.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:12.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:12.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:12.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:12.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:12.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:12.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:12.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:12.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:12.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:12.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:12.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:12.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:12.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:12.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:12.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:12.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:12.849 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.850 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.850 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.850 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:12.850 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:12.850 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.73549618999999, 2020-11-12T17:26:12.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:12.851 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.851 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.851 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.851 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.851 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.851 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:26:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.72017496800001, 2020-11-12T17:26:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:26:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:26:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:26:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:26:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:26:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:26:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:26:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:26:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:26:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:26:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:26:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:26:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:26:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:26:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:26:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 125.94332500599999, 2020-11-12T17:26:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.986878164, 2020-11-12T17:26:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.85794468, 2020-11-12T17:26:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.085926394, 2020-11-12T17:26:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:26:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:26:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:26:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:26:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:26:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:26:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:26:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:26:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:26:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:26:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:26:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:26:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:26:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:26:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:26:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:26:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:26:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:26:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:26:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:26:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:26:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:26:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:26:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:26:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 109.16380640600001, 2020-11-12T17:26:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.849252759999999, 2020-11-12T17:26:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 51.494567684000003, 2020-11-12T17:26:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 51.481390924999999, 2020-11-12T17:26:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.927309475999998, 2020-11-12T17:26:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:12.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:12.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:12.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:12.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:12.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:12.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:12.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:12.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:12.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:12.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:12.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.918322170000003, 2020-11-12T17:26:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.900394855999998, 2020-11-12T17:26:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:12.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:12.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:12.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:12.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:12.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.349351458000001, 2020-11-12T17:26:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:13.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:13.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.097955958, 2020-11-12T17:26:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.018833641000001, 2020-11-12T17:26:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:13.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:13.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:13.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.236482673999999, 2020-11-12T17:26:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:13.048 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:13.048 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:13.050 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:13.050 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 81 16 70855 70839 6.8318 5.83594 0.0109365 0.0182873 2020-11-12T17:26:13.051 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:13.046+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:13.150 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:13.144+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:13.192 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:13.192 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:13.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.193 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71033 4.d 4:bf0cddcf:::benchmark_data_smithi036_18856_object8879:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.193 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.178738+0000", 2020-11-12T17:26:13.193 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.01308174, 2020-11-12T17:26:13.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013103132, 2020-11-12T17:26:13.193 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.193 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.194 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.194 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.194 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.194 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71033 2020-11-12T17:26:13.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.194 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178738+0000", 2020-11-12T17:26:13.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178738+0000", 2020-11-12T17:26:13.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:26:13.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178722+0000", 2020-11-12T17:26:13.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5102000000000003e-05 2020-11-12T17:26:13.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178767+0000", 2020-11-12T17:26:13.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0067e-05 2020-11-12T17:26:13.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178777+0000", 2020-11-12T17:26:13.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5120000000000002e-06 2020-11-12T17:26:13.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178782+0000", 2020-11-12T17:26:13.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2552000000000002e-05 2020-11-12T17:26:13.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178824+0000", 2020-11-12T17:26:13.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023829600000000001 2020-11-12T17:26:13.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.179063+0000", 2020-11-12T17:26:13.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013644500000000001 2020-11-12T17:26:13.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.179199+0000", 2020-11-12T17:26:13.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010595042000000001 2020-11-12T17:26:13.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:13.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189794+0000", 2020-11-12T17:26:13.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011056329 2020-11-12T17:26:13.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.201 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.202 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71034 4.d 4:bf0cddcf:::benchmark_data_smithi036_18856_object8879:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.202 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.178834+0000", 2020-11-12T17:26:13.202 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.012985586, 2020-11-12T17:26:13.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013069578, 2020-11-12T17:26:13.202 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.202 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.202 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.203 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.203 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.203 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71034 2020-11-12T17:26:13.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.203 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178834+0000", 2020-11-12T17:26:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178834+0000", 2020-11-12T17:26:13.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:13.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178807+0000", 2020-11-12T17:26:13.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2750999999999993e-05 2020-11-12T17:26:13.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178900+0000", 2020-11-12T17:26:13.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1464000000000001e-05 2020-11-12T17:26:13.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178911+0000", 2020-11-12T17:26:13.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3150000000000003e-06 2020-11-12T17:26:13.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178918+0000", 2020-11-12T17:26:13.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027278099999999998 2020-11-12T17:26:13.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.181646+0000", 2020-11-12T17:26:13.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011449400000000001 2020-11-12T17:26:13.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.181761+0000", 2020-11-12T17:26:13.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017870700000000001 2020-11-12T17:26:13.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.181939+0000", 2020-11-12T17:26:13.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031053949999999999 2020-11-12T17:26:13.209 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.210 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.210 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71035 4.d 4:bf0cddcf:::benchmark_data_smithi036_18856_object8879:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.212 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.178963+0000", 2020-11-12T17:26:13.212 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.012856737, 2020-11-12T17:26:13.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012987443, 2020-11-12T17:26:13.212 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.213 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.213 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.213 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.213 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.213 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71035 2020-11-12T17:26:13.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.213 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178963+0000", 2020-11-12T17:26:13.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178963+0000", 2020-11-12T17:26:13.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:13.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.178939+0000", 2020-11-12T17:26:13.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1425000000000001e-05 2020-11-12T17:26:13.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.179020+0000", 2020-11-12T17:26:13.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5967000000000001e-05 2020-11-12T17:26:13.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.179036+0000", 2020-11-12T17:26:13.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8570000000000007e-06 2020-11-12T17:26:13.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.179046+0000", 2020-11-12T17:26:13.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005507947 2020-11-12T17:26:13.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.184554+0000", 2020-11-12T17:26:13.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8245000000000002e-05 2020-11-12T17:26:13.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.184612+0000", 2020-11-12T17:26:13.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000113418 2020-11-12T17:26:13.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.184726+0000", 2020-11-12T17:26:13.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0057629600000000001 2020-11-12T17:26:13.220 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.222 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.222 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.223 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71036 4.d 4:bf0cddcf:::benchmark_data_smithi036_18856_object8879:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.223 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.181966+0000", 2020-11-12T17:26:13.223 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0098535979999999999, 2020-11-12T17:26:13.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01003074, 2020-11-12T17:26:13.224 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.224 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.224 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.224 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.224 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.224 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71036 2020-11-12T17:26:13.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.224 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.181966+0000", 2020-11-12T17:26:13.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.181966+0000", 2020-11-12T17:26:13.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:13.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.181937+0000", 2020-11-12T17:26:13.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000153008 2020-11-12T17:26:13.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.182090+0000", 2020-11-12T17:26:13.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2157999999999999e-05 2020-11-12T17:26:13.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.182102+0000", 2020-11-12T17:26:13.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3720000000000001e-06 2020-11-12T17:26:13.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.182109+0000", 2020-11-12T17:26:13.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047602640000000002 2020-11-12T17:26:13.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.186869+0000", 2020-11-12T17:26:13.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9549999999999998e-05 2020-11-12T17:26:13.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.186918+0000", 2020-11-12T17:26:13.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00039765900000000002 2020-11-12T17:26:13.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.187316+0000", 2020-11-12T17:26:13.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500359999999999 2020-11-12T17:26:13.231 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.231 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.231 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.232 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71037 4.d 4:bf0cddcf:::benchmark_data_smithi036_18856_object8879:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.232 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.182155+0000", 2020-11-12T17:26:13.232 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0096648210000000005, 2020-11-12T17:26:13.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0098861109999999995, 2020-11-12T17:26:13.232 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.232 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.232 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.232 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.233 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.233 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71037 2020-11-12T17:26:13.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.234 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.182155+0000", 2020-11-12T17:26:13.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.182155+0000", 2020-11-12T17:26:13.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:26:13.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.182129+0000", 2020-11-12T17:26:13.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7467999999999998e-05 2020-11-12T17:26:13.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.182206+0000", 2020-11-12T17:26:13.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7110000000000007e-06 2020-11-12T17:26:13.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.182216+0000", 2020-11-12T17:26:13.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5170000000000001e-06 2020-11-12T17:26:13.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.182220+0000", 2020-11-12T17:26:13.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007604993 2020-11-12T17:26:13.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189825+0000", 2020-11-12T17:26:13.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108657 2020-11-12T17:26:13.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189934+0000", 2020-11-12T17:26:13.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000163614 2020-11-12T17:26:13.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.190098+0000", 2020-11-12T17:26:13.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007942892 2020-11-12T17:26:13.244 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.244 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.244 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.244 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71038 4.d 4.f3bb30fd (undecoded) ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.244 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.183476+0000", 2020-11-12T17:26:13.245 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0083438839999999993, 2020-11-12T17:26:13.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0086061579999999992, 2020-11-12T17:26:13.245 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.245 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:13.245 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.245 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.245 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.246 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71038 2020-11-12T17:26:13.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.246 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183476+0000", 2020-11-12T17:26:13.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183476+0000", 2020-11-12T17:26:13.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:26:13.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183446+0000", 2020-11-12T17:26:13.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7813999999999996e-05 2020-11-12T17:26:13.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183534+0000", 2020-11-12T17:26:13.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3611000000000001e-05 2020-11-12T17:26:13.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183547+0000", 2020-11-12T17:26:13.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8929999999999999e-06 2020-11-12T17:26:13.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183554+0000", 2020-11-12T17:26:13.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8552000000000003e-05 2020-11-12T17:26:13.251 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.251 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.251 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.251 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71039 4.d 4.f3bb30fd (undecoded) ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.251 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.183923+0000", 2020-11-12T17:26:13.252 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0078964459999999997, 2020-11-12T17:26:13.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081904920000000006, 2020-11-12T17:26:13.252 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.252 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:13.252 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.252 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.253 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71039 2020-11-12T17:26:13.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.253 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183923+0000", 2020-11-12T17:26:13.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183923+0000", 2020-11-12T17:26:13.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:13.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183905+0000", 2020-11-12T17:26:13.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0540000000000001e-05 2020-11-12T17:26:13.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183956+0000", 2020-11-12T17:26:13.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8170000000000001e-06 2020-11-12T17:26:13.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183963+0000", 2020-11-12T17:26:13.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9700000000000001e-06 2020-11-12T17:26:13.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183967+0000", 2020-11-12T17:26:13.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3501000000000002e-05 2020-11-12T17:26:13.257 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.258 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.258 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.258 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:71027 4.e e109/69)", 2020-11-12T17:26:13.258 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.189668+0000", 2020-11-12T17:26:13.259 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0021511640000000001, 2020-11-12T17:26:13.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024801290000000002, 2020-11-12T17:26:13.259 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.259 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:13.259 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189668+0000", 2020-11-12T17:26:13.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189668+0000", 2020-11-12T17:26:13.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:26:13.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189645+0000", 2020-11-12T17:26:13.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4622999999999994e-05 2020-11-12T17:26:13.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189710+0000", 2020-11-12T17:26:13.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4283999999999997e-05 2020-11-12T17:26:13.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189764+0000", 2020-11-12T17:26:13.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9179999999999997e-06 2020-11-12T17:26:13.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189771+0000", 2020-11-12T17:26:13.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010231 2020-11-12T17:26:13.264 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.264 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.264 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.264 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:71028 4.e e109/69)", 2020-11-12T17:26:13.265 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.190217+0000", 2020-11-12T17:26:13.265 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.001603061, 2020-11-12T17:26:13.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019595260000000001, 2020-11-12T17:26:13.265 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.265 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:13.265 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.190217+0000", 2020-11-12T17:26:13.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.190217+0000", 2020-11-12T17:26:13.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:13.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.190202+0000", 2020-11-12T17:26:13.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4795000000000001e-05 2020-11-12T17:26:13.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.190237+0000", 2020-11-12T17:26:13.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5501000000000006e-05 2020-11-12T17:26:13.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.190332+0000", 2020-11-12T17:26:13.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2670000000000003e-06 2020-11-12T17:26:13.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.190339+0000", 2020-11-12T17:26:13.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012200400000000001 2020-11-12T17:26:13.270 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.270 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.270 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.270 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71027 4.e 4:750790e2:::benchmark_data_smithi036_18856_object8878:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.270 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.169049+0000", 2020-11-12T17:26:13.271 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.022770313, 2020-11-12T17:26:13.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.023159776, 2020-11-12T17:26:13.271 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.271 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.271 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.271 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.271 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.272 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71027 2020-11-12T17:26:13.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.272 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169049+0000", 2020-11-12T17:26:13.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169049+0000", 2020-11-12T17:26:13.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:13.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169012+0000", 2020-11-12T17:26:13.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103232 2020-11-12T17:26:13.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169116+0000", 2020-11-12T17:26:13.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4e-05 2020-11-12T17:26:13.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169130+0000", 2020-11-12T17:26:13.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9759999999999998e-06 2020-11-12T17:26:13.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169137+0000", 2020-11-12T17:26:13.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076927369999999998 2020-11-12T17:26:13.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.176829+0000", 2020-11-12T17:26:13.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000213093 2020-11-12T17:26:13.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.177042+0000", 2020-11-12T17:26:13.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000196226 2020-11-12T17:26:13.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.177239+0000", 2020-11-12T17:26:13.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063629899999999998 2020-11-12T17:26:13.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:13.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183602+0000", 2020-11-12T17:26:13.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014552387 2020-11-12T17:26:13.279 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.279 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.279 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.280 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71028 4.e 4:750790e2:::benchmark_data_smithi036_18856_object8878:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.280 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.169188+0000", 2020-11-12T17:26:13.280 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.022631259000000001, 2020-11-12T17:26:13.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.023076976999999999, 2020-11-12T17:26:13.280 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.280 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.280 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.281 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.281 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.281 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71028 2020-11-12T17:26:13.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.281 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169188+0000", 2020-11-12T17:26:13.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169188+0000", 2020-11-12T17:26:13.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:26:13.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169158+0000", 2020-11-12T17:26:13.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7587e-05 2020-11-12T17:26:13.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169246+0000", 2020-11-12T17:26:13.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1399999999999999e-05 2020-11-12T17:26:13.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169257+0000", 2020-11-12T17:26:13.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3619999999999997e-06 2020-11-12T17:26:13.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169263+0000", 2020-11-12T17:26:13.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011088259 2020-11-12T17:26:13.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.180351+0000", 2020-11-12T17:26:13.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6335000000000005e-05 2020-11-12T17:26:13.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.180447+0000", 2020-11-12T17:26:13.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016562200000000001 2020-11-12T17:26:13.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.180613+0000", 2020-11-12T17:26:13.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011424561 2020-11-12T17:26:13.287 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.287 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.287 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.288 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71029 4.e 4:750790e2:::benchmark_data_smithi036_18856_object8878:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.288 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.169312+0000", 2020-11-12T17:26:13.288 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.022507986000000001, 2020-11-12T17:26:13.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.023066433000000001, 2020-11-12T17:26:13.288 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.289 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.289 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.289 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.289 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.289 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71029 2020-11-12T17:26:13.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.289 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169312+0000", 2020-11-12T17:26:13.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169312+0000", 2020-11-12T17:26:13.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:26:13.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169282+0000", 2020-11-12T17:26:13.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6361999999999997e-05 2020-11-12T17:26:13.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169368+0000", 2020-11-12T17:26:13.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0243e-05 2020-11-12T17:26:13.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169378+0000", 2020-11-12T17:26:13.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1499999999999998e-06 2020-11-12T17:26:13.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.169383+0000", 2020-11-12T17:26:13.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014249852 2020-11-12T17:26:13.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183633+0000", 2020-11-12T17:26:13.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4723999999999996e-05 2020-11-12T17:26:13.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183728+0000", 2020-11-12T17:26:13.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000164706 2020-11-12T17:26:13.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.183893+0000", 2020-11-12T17:26:13.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014581123 2020-11-12T17:26:13.295 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.296 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.296 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.296 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71030 4.e 4:750790e2:::benchmark_data_smithi036_18856_object8878:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.296 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.171472+0000", 2020-11-12T17:26:13.296 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.020347866999999999, 2020-11-12T17:26:13.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.021019879000000002, 2020-11-12T17:26:13.297 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.297 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.297 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71030 2020-11-12T17:26:13.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.297 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.171472+0000", 2020-11-12T17:26:13.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.171472+0000", 2020-11-12T17:26:13.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:26:13.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.171444+0000", 2020-11-12T17:26:13.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4476999999999998e-05 2020-11-12T17:26:13.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.171528+0000", 2020-11-12T17:26:13.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2621e-05 2020-11-12T17:26:13.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.171541+0000", 2020-11-12T17:26:13.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2879999999999998e-06 2020-11-12T17:26:13.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.171547+0000", 2020-11-12T17:26:13.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014883468 2020-11-12T17:26:13.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.186431+0000", 2020-11-12T17:26:13.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4492000000000004e-05 2020-11-12T17:26:13.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.186505+0000", 2020-11-12T17:26:13.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000800948 2020-11-12T17:26:13.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.187306+0000", 2020-11-12T17:26:13.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.015834293999999999 2020-11-12T17:26:13.304 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.304 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.304 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.304 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71031 4.e 4:750790e2:::benchmark_data_smithi036_18856_object8878:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.304 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.173961+0000", 2020-11-12T17:26:13.305 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.017858804999999998, 2020-11-12T17:26:13.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.018638529000000001, 2020-11-12T17:26:13.305 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.305 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.305 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.305 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.305 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.305 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71031 2020-11-12T17:26:13.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.306 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.173961+0000", 2020-11-12T17:26:13.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.173961+0000", 2020-11-12T17:26:13.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:13.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.173930+0000", 2020-11-12T17:26:13.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8842000000000001e-05 2020-11-12T17:26:13.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.174019+0000", 2020-11-12T17:26:13.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2047e-05 2020-11-12T17:26:13.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.174031+0000", 2020-11-12T17:26:13.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7259999999999996e-06 2020-11-12T17:26:13.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.174038+0000", 2020-11-12T17:26:13.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.015584420999999999 2020-11-12T17:26:13.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189622+0000", 2020-11-12T17:26:13.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5426999999999995e-05 2020-11-12T17:26:13.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189688+0000", 2020-11-12T17:26:13.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000128718 2020-11-12T17:26:13.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.189816+0000", 2020-11-12T17:26:13.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.015855487000000001 2020-11-12T17:26:13.312 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.312 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.312 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.313 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:71032 4.e 4:750790e2:::benchmark_data_smithi036_18856_object8878:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e109)", 2020-11-12T17:26:13.313 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:13.177887+0000", 2020-11-12T17:26:13.313 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.013932129, 2020-11-12T17:26:13.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014827303999999999, 2020-11-12T17:26:13.313 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:13.313 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:13.314 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:13.314 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:13.314 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:13.314 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 71032 2020-11-12T17:26:13.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.314 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:13.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:13.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.177887+0000", 2020-11-12T17:26:13.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:13.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:13.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.177887+0000", 2020-11-12T17:26:13.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:13.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:13.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.177853+0000", 2020-11-12T17:26:13.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111362 2020-11-12T17:26:13.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:13.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.177965+0000", 2020-11-12T17:26:13.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5645e-05 2020-11-12T17:26:13.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:13.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.177980+0000", 2020-11-12T17:26:13.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5750000000000001e-06 2020-11-12T17:26:13.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:13.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.177989+0000", 2020-11-12T17:26:13.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014187966 2020-11-12T17:26:13.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:13.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.192177+0000", 2020-11-12T17:26:13.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3818999999999993e-05 2020-11-12T17:26:13.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:13.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.192241+0000", 2020-11-12T17:26:13.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031185799999999998 2020-11-12T17:26:13.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:13.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:13.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:13.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.192553+0000", 2020-11-12T17:26:13.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014665127 2020-11-12T17:26:13.321 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.321 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:13.321 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.321 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:13.321 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:13.321 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 15 2020-11-12T17:26:13.321 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:13.323 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:13.323 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:13.323 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:13.324 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:13.324 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:13.318+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:13.328 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:13.356 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:13.394 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:13.419 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:13.425 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:13.422+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:13.430 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:26:13.453 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:13.454 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:13.455 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:13.455 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:13.456 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:13.456 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:13.456 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:13.456 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:13.457 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:13.491 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:13.491 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:13.503 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:13.526 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:13.520+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:13.627 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:13.620+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:13.662 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:13.663 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:13.676 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:13.727 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:13.722+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:13.814 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:13.815 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:13.826 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:13.830 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:13.824+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:13.931 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:13.926+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:13.934 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 82 16 71488 71472 6.80879 4.94531 0.0177684 0.0183476 2020-11-12T17:26:14.003 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:14.003 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:14.013 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:14.056 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:14.054+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:14.133 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:14.128+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:14.194 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:14.194 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:14.207 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:14.252 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:14.250+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:14.335 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:14.332+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:14.336 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:14.336 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:14.349 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:14.437 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:14.432+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:14.460 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:26:14.535 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:14.535 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:14.538 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:14.534+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:14.548 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:14.638 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:14.632+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:14.727 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:14.728 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:14.740 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:14.736+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:14.742 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:14.841 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:14.836+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:14.876 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:14.876 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:14.891 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:14.935 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 83 15 72095 72080 6.78398 4.75 0.0163427 0.0184114 2020-11-12T17:26:14.941 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:14.936+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:15.028 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:15.028 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:15.039 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:15.042 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:15.036+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:15.143 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:15.136+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:15.178 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:15.179 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:15.193 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:15.244 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:15.240+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:15.308 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:15.308 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:15.318 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:15.344 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:15.342+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:15.446 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:15.442+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:15.467 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:15.484 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:15.484 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:15.494 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:15.583 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:15.580+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:15.621 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:15.647 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:15.640+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:15.654 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:15.663 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:15.664 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:26:15.664 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:15.678 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:15.687 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:15.718 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:15.747 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:15.748 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:15.742+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:15.771 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:15.794 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:15.794 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:15.794 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:15.794 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:15.796 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:15.804 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:15.828 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:15.830 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:15.830 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:15.830 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:15.830 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:15.830 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:15.830 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:15.831 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:15.831 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:15.848 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:15.846+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:15.935 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 84 16 72736 72720 6.76274 5 0.0092107 0.0184699 2020-11-12T17:26:15.942 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:15.942 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:15.942 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:15.943 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:15.943 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:15.949 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:15.944+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:15.953 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:16.050 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:16.044+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:16.130 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:16.131 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:16.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:16.131 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:26:16.131 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:16.141 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:16.150 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:16.146+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:16.251 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:16.246+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:16.261 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6] out_osds: [2, 1, 0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:16.261 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:16.262 INFO:tasks.thrashosds.thrasher:inject_pause on 2 2020-11-12T17:26:16.262 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-12T17:26:16.262 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-12T17:26:16.262 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2020-11-12T17:26:16.309 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:16.310 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:16.310 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:16.311 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:16.323 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:16.367 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:16.364+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:16.386 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:16.386 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2020-11-12T17:26:16.387 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:16.453 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:16.448+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:16.475 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:26:16.484 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:16.485 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:16.495 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:16.583 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:16.580+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:16.658 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:16.654+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:16.674 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:16.674 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:16.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:16.675 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:16.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.675 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:16.675 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:16.675 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 191.56333492499999, 2020-11-12T17:26:16.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:16.676 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.676 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.676 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.676 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:16.676 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:16.676 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:16.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.677 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:16.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:16.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:16.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:16.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:16.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:16.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:16.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:16.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:16.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:16.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:16.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:16.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:16.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:16.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:16.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:16.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:16.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:16.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:16.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:16.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:16.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:16.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:16.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:16.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:16.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:16.685 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.685 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.685 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.686 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:16.686 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:16.686 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 191.55624312899999, 2020-11-12T17:26:16.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:16.686 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.686 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:16.687 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:16.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:16.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:16.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:16.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:16.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:16.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:16.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:16.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:16.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:16.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:16.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:16.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:16.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:16.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:16.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:16.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:16.692 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.693 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.693 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.693 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:16.693 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:16.693 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 182.123683632, 2020-11-12T17:26:16.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:16.694 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.694 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.694 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.694 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:16.694 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:16.694 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:16.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.695 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:16.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:16.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:16.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:16.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:16.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:16.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:16.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:16.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:16.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:16.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:16.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:16.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:16.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:16.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:16.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:16.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:16.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:16.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:16.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:16.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:16.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:16.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:16.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:16.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:16.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:16.703 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.703 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.703 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.704 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:16.704 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:16.704 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 148.173563538, 2020-11-12T17:26:16.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:16.704 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.704 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:16.704 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:16.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:16.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:16.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:16.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:16.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:16.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:16.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:16.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:16.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:16.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:16.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:16.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:16.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:16.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:16.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:16.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:16.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.711 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.711 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.711 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:16.711 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:16.711 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 146.06796164599999, 2020-11-12T17:26:16.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:16.712 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.712 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.712 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:16.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:16.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:16.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:16.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:16.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:16.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:16.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:16.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:16.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:16.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:16.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:16.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:16.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:16.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:16.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:16.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:16.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:16.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:16.718 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.718 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.719 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.719 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:16.719 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:16.719 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 114.721478312, 2020-11-12T17:26:16.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:16.719 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.720 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.720 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.720 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:16.720 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:16.720 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:16.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.720 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:16.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:16.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:16.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:16.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:16.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:16.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:16.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:16.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:16.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:16.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:16.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:16.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:16.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:16.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:16.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:16.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:16.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:16.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:16.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:16.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:16.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:16.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:16.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:16.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:16.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:16.729 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.729 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.729 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.729 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:16.730 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:16.730 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.72563651, 2020-11-12T17:26:16.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:16.730 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.730 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:16.730 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:16.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:16.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:16.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:16.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:16.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:16.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:16.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:16.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:16.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:16.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:16.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:16.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:16.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:16.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:16.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:16.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:16.736 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.736 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.736 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.737 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:16.737 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:16.737 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 101.790533111, 2020-11-12T17:26:16.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:16.737 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.737 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:16.738 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:16.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:16.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:16.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:16.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:16.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:16.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:16.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:16.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:16.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:16.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:16.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:16.744 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:16.744 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 71.025892619999993, 2020-11-12T17:26:16.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:16.744 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.744 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:16.744 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:16.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:16.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:16.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:16.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:16.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:16.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:16.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:16.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:16.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:16.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:16.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:16.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:16.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:16.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:16.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:16.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:16.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.750 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.751 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:16.751 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:16.751 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 64.769383935999997, 2020-11-12T17:26:16.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:16.751 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.752 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:16.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:16.752 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:16.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.752 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:16.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:16.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:16.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:16.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:16.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:16.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:16.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:16.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:16.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:16.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:16.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:16.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:16.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:16.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:16.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:16.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:16.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:16.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:16.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:16.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:16.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:16.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:16.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:16.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:16.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:16.761 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.761 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.761 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.762 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:16.762 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:16.762 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 64.769221565999999, 2020-11-12T17:26:16.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:16.762 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.763 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.763 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.763 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:16.763 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:16.763 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:16.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.763 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:16.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:16.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:16.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:16.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:16.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:16.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:16.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:16.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:16.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:16.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:16.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:16.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:16.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:16.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:16.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:16.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:16.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:16.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:16.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:16.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:16.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:16.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:16.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:16.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:16.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:16.772 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.772 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.772 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.772 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 64.760652578999995, 2020-11-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:16.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:16.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:16.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:16.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:16.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:16.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:16.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:16.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:16.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:16.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:16.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:16.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:16.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:16.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:16.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:16.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:16.779 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.779 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.779 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.780 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:16.780 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:16.780 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.256140129000002, 2020-11-12T17:26:16.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:16.780 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.780 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.781 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.781 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:16.781 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:16.781 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:16.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.781 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:16.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:16.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:16.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:16.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:16.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:16.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:16.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:16.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:16.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:16.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:16.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:16.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:16.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:16.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:16.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:16.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:16.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:16.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:16.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:16.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:16.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:16.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:16.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:16.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:16.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:16.790 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.790 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.790 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.790 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:16.791 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:16.791 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 38.770591842999998, 2020-11-12T17:26:16.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:16.791 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.791 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.791 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.791 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:16.791 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:16.792 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:16.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.792 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:16.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:16.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:16.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:16.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:16.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:16.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:16.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:16.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:16.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:16.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:16.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:16.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:16.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:16.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:16.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:16.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:16.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:16.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:16.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:16.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:16.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:16.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:16.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:16.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:16.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:16.800 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.800 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.801 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.801 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:16.801 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:16.801 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 35.697273410999998, 2020-11-12T17:26:16.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:16.801 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.802 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:16.802 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:16.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:16.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:16.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:16.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:16.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:16.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:16.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:16.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:16.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:16.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:16.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:16.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:16.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:16.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:16.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:16.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:16.808 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.808 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.808 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.808 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:16.808 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:16.808 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.641628435000001, 2020-11-12T17:26:16.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:16.809 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.809 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.809 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.809 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:16.809 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:16.809 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:16.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.810 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:16.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:16.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:16.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:16.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:16.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:16.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:16.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:16.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:16.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:16.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:16.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:16.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:16.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:16.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:16.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:16.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:16.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:16.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:16.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:16.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:16.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:16.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:16.818 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.818 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.818 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.819 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:16.819 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:16.819 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.253424064000001, 2020-11-12T17:26:16.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:16.819 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.819 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.819 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.820 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:16.820 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:16.820 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:16.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.820 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:16.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:16.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:16.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:16.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:16.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:16.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:16.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:16.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:16.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:16.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:16.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:16.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:16.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:16.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:16.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:16.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:16.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:16.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:16.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:16.829 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.829 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.829 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.829 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:16.829 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:16.830 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.046967131999999, 2020-11-12T17:26:16.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:16.830 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.830 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:16.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:16.831 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:16.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.831 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:16.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:16.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:16.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:16.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:16.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:16.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:16.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:16.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:16.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:16.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:16.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:16.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:16.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:16.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:16.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:16.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:16.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:16.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:16.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:16.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:16.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:16.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:16.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:16.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:16.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:16.839 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.839 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.839 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.840 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:16.840 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:16.840 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.797761515000001, 2020-11-12T17:26:16.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:16.840 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.841 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:16.841 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:16.841 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:16.841 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:16.841 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:16.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.841 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:16.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:16.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:16.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:16.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:16.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:16.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:16.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:16.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:16.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:16.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:16.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:16.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:16.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:16.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:16.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:16.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:16.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:16.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:16.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:16.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:16.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:16.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:16.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:16.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:16.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:16.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:16.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:16.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:16.850 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.850 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.850 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.850 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:16.851 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:16.851 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.780802066, 2020-11-12T17:26:16.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:16.851 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:16.851 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:16.851 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:16.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:16.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:16.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:16.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:16.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:16.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:16.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:16.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:16.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:16.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:16.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:16.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:16.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:16.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:16.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:16.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:16.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:16.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:16.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:16.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:16.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:16.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:16.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:16.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:16.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:16.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:16.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:16.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:16.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:16.857 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.857 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.858 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.858 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:16.858 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:16.858 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:16.859 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:16.854+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:16.860 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:16.935 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 85 16 73483 73467 6.75182 5.83594 0.0157291 0.0185061 2020-11-12T17:26:16.960 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:16.958+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:17.010 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:17.011 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:17.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.011 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73456 4.0 4:043ff129:::benchmark_data_smithi036_18856_object9181:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:26:17.011 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:16.901451+0000", 2020-11-12T17:26:17.011 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.108812622, 2020-11-12T17:26:17.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10884192299999999, 2020-11-12T17:26:17.012 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.012 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:17.012 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.012 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:17.012 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.012 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73456 2020-11-12T17:26:17.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.013 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.901451+0000", 2020-11-12T17:26:17.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.901451+0000", 2020-11-12T17:26:17.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999461 2020-11-12T17:26:17.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.901397+0000", 2020-11-12T17:26:17.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015281600000000001 2020-11-12T17:26:17.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.901550+0000", 2020-11-12T17:26:17.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1399999999999998e-05 2020-11-12T17:26:17.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.901571+0000", 2020-11-12T17:26:17.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0200000000000001e-05 2020-11-12T17:26:17.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.901582+0000", 2020-11-12T17:26:17.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0069520479999999997 2020-11-12T17:26:17.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.908534+0000", 2020-11-12T17:26:17.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010584799999999999 2020-11-12T17:26:17.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.908639+0000", 2020-11-12T17:26:17.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014074500000000001 2020-11-12T17:26:17.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:17.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.908780+0000", 2020-11-12T17:26:17.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040754609999999998 2020-11-12T17:26:17.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:16.912856+0000", 2020-11-12T17:26:17.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011404595 2020-11-12T17:26:17.019 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.019 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.019 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.020 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.020 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:17.020 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 1 2020-11-12T17:26:17.020 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:17.021 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:17.062 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:17.058+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:17.163 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:17.158+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:17.178 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:17.179 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:17.179 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:17.179 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:17.179 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:17.192 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:17.263 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:17.260+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:17.316 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:17.317 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:17.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:17.317 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:17.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.317 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:17.318 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:17.318 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 182.893078551, 2020-11-12T17:26:17.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:17.318 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.318 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.318 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.318 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:17.319 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:17.319 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:17.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.319 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:17.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:17.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:17.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:17.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:17.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:17.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:17.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:17.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:17.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:17.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:17.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:17.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:17.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:17.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:17.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:17.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:17.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:17.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:17.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:17.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:17.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:17.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:17.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:17.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.329 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:17.329 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:17.329 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 182.886134489, 2020-11-12T17:26:17.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:17.329 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.329 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:17.329 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:17.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:17.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:17.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:17.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:17.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:17.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:17.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:17.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:17.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:17.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:17.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:17.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:17.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:17.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:17.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:17.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:17.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.335 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.336 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.336 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:17.336 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:17.336 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 146.71229670299999, 2020-11-12T17:26:17.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:17.337 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.337 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.337 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.337 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:17.337 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:17.337 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:17.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.338 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:17.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:17.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:17.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:17.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:17.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:17.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:17.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:17.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:17.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:17.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:17.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:17.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:17.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:17.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:17.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:17.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:17.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:17.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:17.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:17.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:17.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:17.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:17.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:17.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:17.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:17.348 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.348 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.348 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.349 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:17.349 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:17.349 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.24076279400001, 2020-11-12T17:26:17.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:17.349 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.349 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.349 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.350 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:17.350 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:17.350 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:17.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.350 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:17.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:17.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:17.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:17.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:17.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:17.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:17.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:17.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:17.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:17.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:17.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:17.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:17.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:17.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:17.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:17.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:17.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:17.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:17.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:17.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:17.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:17.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:17.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:17.359 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.359 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.360 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.360 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:34864 3.8 e49/20 ondisk, result = 0)", 2020-11-12T17:26:17.360 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:17.360 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.22544157199999, 2020-11-12T17:26:17.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998, 2020-11-12T17:26:17.361 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.361 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:17.361 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:17.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086125+0000", 2020-11-12T17:26:17.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:17.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086108+0000", 2020-11-12T17:26:17.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9651999999999999e-05 2020-11-12T17:26:17.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086148+0000", 2020-11-12T17:26:17.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32088692499999999 2020-11-12T17:26:17.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407035+0000", 2020-11-12T17:26:17.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7560000000000005e-06 2020-11-12T17:26:17.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407043+0000", 2020-11-12T17:26:17.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000614016 2020-11-12T17:26:17.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407657+0000", 2020-11-12T17:26:17.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2890000000000003e-06 2020-11-12T17:26:17.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407667+0000", 2020-11-12T17:26:17.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016312100000000001 2020-11-12T17:26:17.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407830+0000", 2020-11-12T17:26:17.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32170454399999998 2020-11-12T17:26:17.367 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.367 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.367 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.368 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:17.368 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:17.368 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 130.44859160999999, 2020-11-12T17:26:17.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:17.368 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.368 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.368 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.369 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:17.369 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:17.369 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:17.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.369 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:17.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:17.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:17.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:17.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:17.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:17.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:17.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:17.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:17.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:17.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:17.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:17.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:17.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:17.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:17.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:17.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:17.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:17.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:17.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:17.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:17.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:17.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:17.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:17.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:17.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:17.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.378 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.378 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:17.379 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:17.379 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.492144768, 2020-11-12T17:26:17.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:17.379 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.379 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.379 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.379 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:17.380 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:17.380 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:17.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.380 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:17.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:17.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:17.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:17.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:17.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:17.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:17.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:17.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:17.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:17.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:17.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:17.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:17.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:17.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:17.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:17.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:17.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:17.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:17.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:17.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:17.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:17.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:17.388 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.389 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.389 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.389 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:17.389 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:17.389 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.363211284, 2020-11-12T17:26:17.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:17.390 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.390 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.390 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:17.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:17.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:17.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:17.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:17.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:17.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:17.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:17.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:17.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:17.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:17.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:17.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:17.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:17.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:17.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:17.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:17.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:17.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:17.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.399 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57960 3.7 3:edd76a1f:::benchmark_data_smithi036_14212_object7244:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:17.399 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:17.399 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 114.591192998, 2020-11-12T17:26:17.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001, 2020-11-12T17:26:17.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:17.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:17.400 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57960 2020-11-12T17:26:17.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.400 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:17.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720374+0000", 2020-11-12T17:26:17.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:17.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720338+0000", 2020-11-12T17:26:17.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010610700000000001 2020-11-12T17:26:17.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720444+0000", 2020-11-12T17:26:17.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7382e-05 2020-11-12T17:26:17.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720472+0000", 2020-11-12T17:26:17.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3560000000000004e-06 2020-11-12T17:26:17.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.720479+0000", 2020-11-12T17:26:17.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066327929999999997 2020-11-12T17:26:17.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727112+0000", 2020-11-12T17:26:17.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9915999999999998e-05 2020-11-12T17:26:17.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727202+0000", 2020-11-12T17:26:17.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000144363 2020-11-12T17:26:17.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:17.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.727346+0000", 2020-11-12T17:26:17.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001813479 2020-11-12T17:26:17.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.729160+0000", 2020-11-12T17:26:17.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31568974599999999 2020-11-12T17:26:17.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044849+0000", 2020-11-12T17:26:17.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9640000000000004e-05 2020-11-12T17:26:17.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.044919+0000", 2020-11-12T17:26:17.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014127000000000001 2020-11-12T17:26:17.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.045060+0000", 2020-11-12T17:26:17.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639900000001 2020-11-12T17:26:17.411 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.411 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.411 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.412 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:17.412 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:17.412 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.66907301000001, 2020-11-12T17:26:17.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:17.412 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.412 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.412 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.413 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:17.413 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:17.413 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:17.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.413 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:17.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:17.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:17.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:17.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:17.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:17.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:17.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:17.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:17.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:17.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:17.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:17.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:17.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:17.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:17.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:17.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:17.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:17.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:17.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:17.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:17.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:17.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:17.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:17.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:17.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:17.424 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.424 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.424 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.424 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:17.425 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:17.425 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.354519363999998, 2020-11-12T17:26:17.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:17.425 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.425 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.425 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.425 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:17.425 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.426 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:17.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.426 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:17.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:17.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:17.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:17.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:17.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:17.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:17.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:17.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:17.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:17.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:17.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:17.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:17.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:17.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:17.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:17.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:17.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:17.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:17.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:17.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:17.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:17.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:17.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:17.434 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.435 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.435 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.435 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:17.435 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:17.435 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.999834288000002, 2020-11-12T17:26:17.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:17.436 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.436 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:17.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.436 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:17.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.437 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:17.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:17.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:17.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:17.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:17.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:17.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:17.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:17.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:17.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:17.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:17.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:17.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:17.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:17.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:17.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:17.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:17.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:17.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:17.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:17.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:17.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:17.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:17.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:17.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:17.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:17.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.445 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.446 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:17.446 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:17.446 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.986657528999999, 2020-11-12T17:26:17.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:17.446 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.446 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:17.446 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:17.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:17.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:17.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:17.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:17.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:17.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:17.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:17.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:17.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:17.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:17.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:17.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:17.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:17.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:17.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:17.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:17.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.453 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.454 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:17.454 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:17.454 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 51.432576079999997, 2020-11-12T17:26:17.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:17.454 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.454 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.454 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.454 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:17.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.455 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:17.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.455 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:17.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:17.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:17.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:17.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:17.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:17.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:17.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:17.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:17.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:17.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 51.423588774000002, 2020-11-12T17:26:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.405661459999997, 2020-11-12T17:26:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.491 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.854618062, 2020-11-12T17:26:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.603222561999999, 2020-11-12T17:26:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.524100245, 2020-11-12T17:26:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.741749278, 2020-11-12T17:26:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:17.539 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:17.541 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:17.460+0000 7f658835a700 -1 osd.0 110 handle_osd_map injecting map crc failure 2020-11-12T17:26:17.541 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:26:17.541 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:17.538+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:17.542 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:17.641 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:17.640+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:17.652 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:17.652 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:17.652 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:26:17.653 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:17.661 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:17.742 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:17.736+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:17.752 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:17.750+0000 7f2809aaf700 -1 osd.6 110 handle_osd_map injecting map crc failure 2020-11-12T17:26:17.772 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:17.773 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:17.773 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:17.773 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:17.773 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:17.787 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:17.843 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:17.840+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:17.845 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:17.923 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:17.923 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:17.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:26:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 187.235155217, 2020-11-12T17:26:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:26:17.924 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:26:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.925 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:17.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:17.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:17.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:17.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:26:17.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:26:17.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:17.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:26:17.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:26:17.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:17.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:26:17.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:26:17.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:26:17.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:26:17.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:17.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:26:17.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:26:17.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:17.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:26:17.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:26:17.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:17.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:26:17.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:26:17.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:17.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:26:17.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:26:17.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:26:17.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:26:17.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:17.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:26:17.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:26:17.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:17.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:26:17.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:26:17.942 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.942 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:17.942 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.943 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:26:17.943 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:17.943 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 187.22967514800001, 2020-11-12T17:26:17.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:26:17.943 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:17.943 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:17.944 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:17.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:17.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:17.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:17.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:26:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:26:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:26:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:26:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:26:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:26:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:26:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:26:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:26:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:26:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 179.03955354799999, 2020-11-12T17:26:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:26:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:26:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:17.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:17.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:17.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:26:17.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:17.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:26:17.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:26:17.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:17.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:26:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:26:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:26:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:26:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:26:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:26:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:26:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:26:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:26:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:26:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:26:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:26:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:26:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:26:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:26:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:26:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:26:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:26:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:26:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:26:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:26:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 179.03230983899999, 2020-11-12T17:26:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:26:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:26:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:26:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:26:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:26:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:26:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:26:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:26:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:26:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:26:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:26:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:26:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:26:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:26:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:26:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 103.036220465, 2020-11-12T17:26:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:26:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:26:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:26:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:26:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:26:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:26:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:26:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:26:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:26:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:26:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:26:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:26:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:26:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:26:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:26:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:26:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 66.010951198000001, 2020-11-12T17:26:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:26:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:26:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:17.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:26:17.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:26:17.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:17.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:26:17.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:26:17.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:17.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:26:17.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:26:17.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:26:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:26:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:26:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:26:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:26:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:26:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:26:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:26:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:26:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:26:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44206 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:26:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.345268715000003, 2020-11-12T17:26:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002, 2020-11-12T17:26:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44206 2020-11-12T17:26:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:26:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:26:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:26:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576576+0000", 2020-11-12T17:26:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1733e-05 2020-11-12T17:26:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576637+0000", 2020-11-12T17:26:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3419e-05 2020-11-12T17:26:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576651+0000", 2020-11-12T17:26:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0509999999999996e-06 2020-11-12T17:26:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576656+0000", 2020-11-12T17:26:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9773e-05 2020-11-12T17:26:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576696+0000", 2020-11-12T17:26:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2999999999999997e-05 2020-11-12T17:26:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576789+0000", 2020-11-12T17:26:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137916 2020-11-12T17:26:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576927+0000", 2020-11-12T17:26:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027075860000000001 2020-11-12T17:26:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579634+0000", 2020-11-12T17:26:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.333427529 2020-11-12T17:26:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913062+0000", 2020-11-12T17:26:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2707000000000002e-05 2020-11-12T17:26:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913114+0000", 2020-11-12T17:26:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8039e-05 2020-11-12T17:26:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913152+0000", 2020-11-12T17:26:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002 2020-11-12T17:26:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.345110183000003, 2020-11-12T17:26:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:26:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:26:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.002 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:26:18.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:26:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:26:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:26:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:26:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:26:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:26:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:26:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:26:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:26:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:26:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:26:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:26:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:26:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:26:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:26:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:26:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:26:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:26:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:26:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:26:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:26:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.341868853999998, 2020-11-12T17:26:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:26:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:26:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:26:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:26:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:26:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:26:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:26:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:26:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:26:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:26:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:26:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:26:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:26:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:26:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:26:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:26:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:26:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:26:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:18.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:26:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:26:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:26:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:26:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:26:18.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:26:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44208 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:26:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:26:18.040 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.338684264000001, 2020-11-12T17:26:18.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003, 2020-11-12T17:26:18.040 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.041 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:18.041 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:26:18.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:26:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:26:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583142+0000", 2020-11-12T17:26:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9876000000000004e-05 2020-11-12T17:26:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583242+0000", 2020-11-12T17:26:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33634110099999998 2020-11-12T17:26:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919583+0000", 2020-11-12T17:26:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3000000000000001e-06 2020-11-12T17:26:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919588+0000", 2020-11-12T17:26:18.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:26:18.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919642+0000", 2020-11-12T17:26:18.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3859999999999996e-06 2020-11-12T17:26:18.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919652+0000", 2020-11-12T17:26:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013921800000000001 2020-11-12T17:26:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919791+0000", 2020-11-12T17:26:18.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003 2020-11-12T17:26:18.054 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.054 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.055 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.055 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:26:18.056 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:18.056 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.908697953000001, 2020-11-12T17:26:18.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:26:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:18.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:26:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:26:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:26:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:26:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:26:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:26:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:26:18.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:26:18.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:26:18.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:26:18.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:26:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:26:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:26:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:26:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:49064 4.b e94/69 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head v 94'3048, mlcod=94'3040)", 2020-11-12T17:26:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.430506+0000", 2020-11-12T17:26:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.491362182000003, 2020-11-12T17:26:18.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33348710300000001, 2020-11-12T17:26:18.075 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.075 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:18.075 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430506+0000", 2020-11-12T17:26:18.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430506+0000", 2020-11-12T17:26:18.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:26:18.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430479+0000", 2020-11-12T17:26:18.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7113999999999995e-05 2020-11-12T17:26:18.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.430546+0000", 2020-11-12T17:26:18.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.32724931299999999 2020-11-12T17:26:18.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757796+0000", 2020-11-12T17:26:18.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8050000000000001e-06 2020-11-12T17:26:18.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757803+0000", 2020-11-12T17:26:18.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6453000000000003e-05 2020-11-12T17:26:18.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757859+0000", 2020-11-12T17:26:18.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7866000000000001e-05 2020-11-12T17:26:18.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.757887+0000", 2020-11-12T17:26:18.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0060471960000000003 2020-11-12T17:26:18.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:18.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.763934+0000", 2020-11-12T17:26:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8743000000000003e-05 2020-11-12T17:26:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.763993+0000", 2020-11-12T17:26:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33348710300000001 2020-11-12T17:26:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.092 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.859631292, 2020-11-12T17:26:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:26:18.094 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.094 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:18.094 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:18.095 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:18.095 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:18.096 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:26:18.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.096 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:18.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:18.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:26:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:26:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:26:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:26:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:26:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:26:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:26:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:26:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:26:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:26:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:26:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:26:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:26:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:26:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:26:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:26:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:26:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:26:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:26:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:26:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:26:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:26:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.857950511999999, 2020-11-12T17:26:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:26:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:26:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:26:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:26:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:26:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:26:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:26:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:26:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:26:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:26:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:26:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:26:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:26:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:26:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:26:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:26:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:26:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:26:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:26:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:26:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:26:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:26:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:26:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:26:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.857862316999999, 2020-11-12T17:26:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:26:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:26:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:26:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:26:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:26:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:26:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:26:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:26:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:26:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:26:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:26:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:26:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:26:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:26:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:26:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:26:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:26:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:26:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:26:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:26:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:26:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:26:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:26:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.839367001999999, 2020-11-12T17:26:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:26:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:26:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:26:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:26:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:26:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:26:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:26:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:26:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:26:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:26:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:26:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:26:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:26:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:26:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:26:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.839234011999999, 2020-11-12T17:26:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:26:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:26:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:26:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:26:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:26:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:26:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:26:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:26:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:26:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:26:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:26:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:26:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:26:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:26:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:26:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.839149284000001, 2020-11-12T17:26:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:26:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:26:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:26:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:26:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:26:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:26:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:26:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:26:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:26:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:26:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:26:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:26:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:26:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:26:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:26:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:26:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.787536754000001, 2020-11-12T17:26:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:26:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:26:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:26:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:26:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:26:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:26:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:26:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:26:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:26:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:26:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:26:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:26:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:26:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:26:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:26:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.787379737999998, 2020-11-12T17:26:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:26:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:26:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:26:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:26:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:26:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:26:18.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:26:18.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:18.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:26:18.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:26:18.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:18.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:26:18.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:26:18.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:18.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:26:18.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:26:18.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:18.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:18.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:18.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:26:18.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:26:18.174 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.174 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.174 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.174 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:18.174 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:18.174 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:18.176 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 86 15 74023 74008 6.72246 4.22656 0.0248087 0.0185868 2020-11-12T17:26:18.176 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:18.177 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:18.177 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:18.177 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:18.177 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:18.177 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:18.177 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:18.172+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:18.178 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:18.195 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:18.231 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:18.232 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:18.234 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:18.279 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:18.274+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:18.312 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:18.312 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:18.323 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:18.378 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:18.372+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:18.480 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:18.472+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:18.508 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:18.509 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:18.521 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:18.579 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:18.578+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:18.663 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:18.664 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:18.675 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:18.680 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:18.676+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:18.782 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:18.776+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:18.860 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:18.860 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:18.872 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:18.882 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:18.876+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:18.935 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 87 16 74705 74689 6.70634 5.32031 0.00977641 0.0186297 2020-11-12T17:26:18.983 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:18.980+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:19.007 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:19.007 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:19.018 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:19.084 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:19.082+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:19.154 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:19.155 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:19.168 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:19.212 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:19.210+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:19.287 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:19.280+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:19.352 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:19.353 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:19.365 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:19.388 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:19.384+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:19.490 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:19.486+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:19.509 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:19.509 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:19.521 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:19.543 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:26:19.608 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:19.606+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:19.691 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:19.688+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:19.710 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:19.711 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:19.723 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:19.792 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:19.790+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:19.849 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:19.849 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:19.861 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:19.907 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:19.904+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:19.935 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 88 16 75394 75378 6.69129 5.38281 0.0215565 0.0186728 2020-11-12T17:26:19.972 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:19.972 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:19.983 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:20.023 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:20.020+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:20.095 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:20.092+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:20.142 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:20.144 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:20.155 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:20.199 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:20.194+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:20.249 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:20.298 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:20.292+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:20.328 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:20.328 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:20.339 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:20.427 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:20.424+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:20.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:20.467 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:20.499 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:20.500 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:20.496+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:20.500 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:26:20.506 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:20.506 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:20.506 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:20.507 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:20.507 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:20.516 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:20.526 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:20.567 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:20.594 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:20.601 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:20.596+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:20.618 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:20.641 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:20.641 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:20.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:20.642 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [] 2020-11-12T17:26:20.642 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:20.644 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:20.646 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:20.646 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:20.646 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:20.646 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:20.646 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:20.647 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:20.651 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:20.747 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:20.744+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:20.804 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:20.800+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:20.808 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:20.809 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:20.818 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:20.936 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 89 16 75890 75874 6.65964 3.875 0.282591 0.0187037 2020-11-12T17:26:20.975 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:20.976 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:20.976 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:20.976 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:20.976 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:20.986 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:21.031 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:21.028+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:21.098 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:21.099 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:21.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:21.100 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:21.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.100 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:21.101 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:21.101 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 195.98517011300001, 2020-11-12T17:26:21.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:21.102 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.102 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:21.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:21.104 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:21.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.104 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:21.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:21.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:21.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:21.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:21.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:21.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:21.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:21.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:21.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:21.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:21.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:21.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:21.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:21.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:21.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:21.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:21.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:21.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:21.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:21.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:21.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:21.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:21.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:21.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:21.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:21.118 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.118 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.119 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:21.119 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:21.119 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 195.97807831700001, 2020-11-12T17:26:21.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:21.120 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.120 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:21.120 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:21.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:21.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:21.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:21.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:21.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:21.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:21.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:21.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:21.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:21.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:21.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:21.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:21.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:21.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:21.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:21.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:21.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.127 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.128 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:21.128 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:21.128 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 186.54551882000001, 2020-11-12T17:26:21.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:21.129 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.129 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:21.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:21.129 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:21.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.130 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:21.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:21.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:21.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:21.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:21.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:21.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:21.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:21.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:21.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:21.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:21.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:21.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:21.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:21.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:21.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:21.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:21.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:21.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:21.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:21.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:21.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:21.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:21.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:21.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:21.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:21.140 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.141 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.141 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.141 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:21.141 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:21.142 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 152.59539872600001, 2020-11-12T17:26:21.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:21.142 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.142 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:21.142 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:21.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:21.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:21.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:21.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:21.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:21.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:21.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:21.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:21.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:21.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:21.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:21.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:21.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:21.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:21.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:21.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:21.149 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.149 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.150 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.150 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:21.150 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:21.150 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 150.489796834, 2020-11-12T17:26:21.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:21.151 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.151 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.151 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:21.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:21.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:21.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:21.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:21.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:21.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:21.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:21.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:21.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:21.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:21.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:21.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:21.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:21.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:21.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:21.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:21.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:21.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:21.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.159 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.160 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:21.160 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:21.160 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 119.1433135, 2020-11-12T17:26:21.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:21.160 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.160 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.160 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.161 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:21.161 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:21.161 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:21.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.161 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:21.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:21.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:21.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:21.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:21.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:21.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:21.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:21.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:21.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:21.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:21.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:21.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:21.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:21.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:21.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:21.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:21.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:21.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:21.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:21.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:21.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:21.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:21.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:21.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:21.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:21.171 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.172 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.172 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:21.172 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:21.172 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.147471698, 2020-11-12T17:26:21.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:21.173 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.173 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:21.173 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:21.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:21.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:21.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:21.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:21.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:21.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:21.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:21.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:21.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:21.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:21.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:21.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:21.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:21.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:21.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:21.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:21.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.181 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:21.181 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:21.181 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 106.212368299, 2020-11-12T17:26:21.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:21.181 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.182 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:21.182 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:21.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:21.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:21.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:21.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:21.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:21.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:21.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:21.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:21.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:21.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:21.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:21.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:21.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:21.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:21.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.188 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.188 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:21.189 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:21.189 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 75.447727807999996, 2020-11-12T17:26:21.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:21.189 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.189 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:21.189 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:21.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:21.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:21.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:21.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:21.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:21.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:21.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:21.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:21.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:21.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:21.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:21.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:21.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:21.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:21.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:21.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:21.196 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.196 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.196 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.196 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:21.197 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:21.197 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.191219124, 2020-11-12T17:26:21.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:21.197 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.197 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.197 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.197 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.197 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.198 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:21.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.198 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:21.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:21.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:21.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:21.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:21.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:21.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:21.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:21.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:21.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:21.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:21.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:21.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:21.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:21.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:21.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:21.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:21.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:21.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:21.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:21.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:21.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:21.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:21.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:21.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:21.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:21.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.207 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.207 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.207 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:21.207 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:21.207 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.191056754000002, 2020-11-12T17:26:21.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:21.208 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.208 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.208 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.208 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.208 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.208 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:21.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.209 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:21.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:21.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:21.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:21.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:21.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:21.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:21.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:21.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:21.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:21.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:21.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:21.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:21.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:21.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:21.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:21.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:21.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:21.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:21.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:21.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:21.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:21.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:21.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:21.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:21.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:21.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.217 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.218 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:21.218 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:21.218 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.182487766999998, 2020-11-12T17:26:21.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:21.218 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.218 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:21.218 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:21.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:21.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:21.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:21.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:21.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:21.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:21.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:21.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:21.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:21.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:21.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:21.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:21.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:21.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:21.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:21.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:21.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.230 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.230 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:21.230 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:21.230 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.677975316999998, 2020-11-12T17:26:21.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:21.231 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.231 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.231 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.231 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.231 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.231 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:21.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.231 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:21.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:21.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:21.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:21.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:21.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:21.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:21.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:21.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:21.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:21.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:21.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:21.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:21.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:21.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:21.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:21.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:21.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:21.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:21.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:21.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:21.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:21.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:21.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:21.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:21.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:21.240 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.240 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.240 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.241 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:21.241 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:21.241 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.192427031000001, 2020-11-12T17:26:21.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:21.241 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.241 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.241 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:21.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:21.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:21.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:21.251 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.251 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.251 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.251 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:21.251 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:21.252 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.119108599, 2020-11-12T17:26:21.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:21.252 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.252 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:21.252 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:21.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:21.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:21.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:21.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:21.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:21.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:21.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:21.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:21.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:21.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:21.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:21.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:21.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:21.258 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.258 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.258 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.259 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:21.259 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:21.259 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.063463622999997, 2020-11-12T17:26:21.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:21.259 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.259 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.259 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.260 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.260 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.260 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:21.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.260 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:21.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:21.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:21.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:21.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:21.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:21.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:21.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:21.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:21.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:21.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:21.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:21.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:21.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:21.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:21.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:21.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:21.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:21.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:21.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:21.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:21.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:21.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:21.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:21.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:21.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:21.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.269 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.269 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:21.269 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:21.270 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 38.675259251999996, 2020-11-12T17:26:21.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:21.270 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.270 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.270 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.270 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.270 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.270 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:21.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.271 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:21.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:21.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:21.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:21.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:21.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:21.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:21.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:21.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:21.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:21.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:21.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:21.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:21.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:21.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:21.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:21.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:21.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:21.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:21.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:21.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:21.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:21.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:21.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:21.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:21.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:21.279 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.279 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.280 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:21.280 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:21.280 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.468802320000002, 2020-11-12T17:26:21.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:21.281 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.281 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.281 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.281 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.281 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.281 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:21.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.282 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:21.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:21.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:21.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:21.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:21.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:21.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:21.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:21.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:21.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:21.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:21.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:21.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:21.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:21.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:21.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:21.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:21.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:21.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:21.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:21.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:21.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:21.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:21.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:21.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:21.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:21.290 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.290 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.290 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.291 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:21.291 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:21.291 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.219596703000001, 2020-11-12T17:26:21.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:21.291 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.291 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.291 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.292 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.292 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.292 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:21.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.292 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:21.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:21.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:21.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:21.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:21.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:21.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:21.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:21.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:21.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:21.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:21.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:21.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:21.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:21.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:21.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:21.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:21.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:21.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:21.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:21.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:21.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:21.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:21.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:21.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:21.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:21.301 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.301 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.301 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.301 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:21.301 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:21.301 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 23.202637253999999, 2020-11-12T17:26:21.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:21.302 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.302 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:21.302 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:21.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:21.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:21.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:21.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:21.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:21.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:21.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:21.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:21.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:21.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:21.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:21.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:21.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:21.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:21.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:21.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:21.308 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.308 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.308 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.308 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.309 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.309 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:21.310 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:21.315 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:21.306+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:21.315 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:20.902+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:21.400 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6] out_osds: [2, 1, 0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:21.400 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:21.401 INFO:tasks.thrashosds.thrasher:Adding osd 1 2020-11-12T17:26:21.401 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd in 1 2020-11-12T17:26:21.412 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:21.410+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:21.512 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:21.510+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:21.516 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:76033 4.0 4:070f15ca:::benchmark_data_smithi036_18856_object9504:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.508493+0000", 2020-11-12T17:26:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0067804789999999998, 2020-11-12T17:26:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006814039, 2020-11-12T17:26:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 76033 2020-11-12T17:26:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508493+0000", 2020-11-12T17:26:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508493+0000", 2020-11-12T17:26:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999676 2020-11-12T17:26:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508460+0000", 2020-11-12T17:26:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1562000000000002e-05 2020-11-12T17:26:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508552+0000", 2020-11-12T17:26:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8944999999999999e-05 2020-11-12T17:26:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508571+0000", 2020-11-12T17:26:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0629999999999995e-06 2020-11-12T17:26:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508580+0000", 2020-11-12T17:26:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5599000000000002e-05 2020-11-12T17:26:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508626+0000", 2020-11-12T17:26:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196913 2020-11-12T17:26:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508822+0000", 2020-11-12T17:26:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129095 2020-11-12T17:26:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508952+0000", 2020-11-12T17:26:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00045871300000000002 2020-11-12T17:26:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:76034 4.0 4:070f15ca:::benchmark_data_smithi036_18856_object9504:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.508832+0000", 2020-11-12T17:26:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0064413650000000001, 2020-11-12T17:26:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006600781, 2020-11-12T17:26:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 76034 2020-11-12T17:26:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508832+0000", 2020-11-12T17:26:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508832+0000", 2020-11-12T17:26:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:26:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508797+0000", 2020-11-12T17:26:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6274999999999996e-05 2020-11-12T17:26:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508894+0000", 2020-11-12T17:26:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2371000000000001e-05 2020-11-12T17:26:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508906+0000", 2020-11-12T17:26:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1469999999999998e-06 2020-11-12T17:26:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.508912+0000", 2020-11-12T17:26:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029106689999999998 2020-11-12T17:26:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.511823+0000", 2020-11-12T17:26:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013594099999999999 2020-11-12T17:26:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.511959+0000", 2020-11-12T17:26:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024288700000000001 2020-11-12T17:26:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.512202+0000", 2020-11-12T17:26:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033696540000000001 2020-11-12T17:26:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:76035 4.0 4:070f15ca:::benchmark_data_smithi036_18856_object9504:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.510838+0000", 2020-11-12T17:26:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0044353149999999996, 2020-11-12T17:26:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047289180000000004, 2020-11-12T17:26:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 76035 2020-11-12T17:26:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.510838+0000", 2020-11-12T17:26:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.510838+0000", 2020-11-12T17:26:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.510811+0000", 2020-11-12T17:26:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0088999999999998e-05 2020-11-12T17:26:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.510891+0000", 2020-11-12T17:26:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5075999999999999e-05 2020-11-12T17:26:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.510906+0000", 2020-11-12T17:26:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7420000000000003e-06 2020-11-12T17:26:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.510915+0000", 2020-11-12T17:26:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041355469999999998 2020-11-12T17:26:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.515050+0000", 2020-11-12T17:26:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000137193 2020-11-12T17:26:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.515187+0000", 2020-11-12T17:26:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000214212 2020-11-12T17:26:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.515402+0000", 2020-11-12T17:26:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045637109999999998 2020-11-12T17:26:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:76033 4.0 e112/69)", 2020-11-12T17:26:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.512665+0000", 2020-11-12T17:26:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0026080859999999999, 2020-11-12T17:26:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030033859999999998, 2020-11-12T17:26:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.512665+0000", 2020-11-12T17:26:21.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.512665+0000", 2020-11-12T17:26:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:26:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.512630+0000", 2020-11-12T17:26:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4913000000000004e-05 2020-11-12T17:26:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.512725+0000", 2020-11-12T17:26:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2372000000000004e-05 2020-11-12T17:26:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.512797+0000", 2020-11-12T17:26:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2320000000000001e-05 2020-11-12T17:26:21.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.512810+0000", 2020-11-12T17:26:21.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014438999999999999 2020-11-12T17:26:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:76036 4.0 4.53a8f0e0 (undecoded) ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.513756+0000", 2020-11-12T17:26:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.001517511, 2020-11-12T17:26:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001978638, 2020-11-12T17:26:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 76036 2020-11-12T17:26:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513756+0000", 2020-11-12T17:26:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513756+0000", 2020-11-12T17:26:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:26:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513721+0000", 2020-11-12T17:26:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8456999999999997e-05 2020-11-12T17:26:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513810+0000", 2020-11-12T17:26:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2104e-05 2020-11-12T17:26:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513832+0000", 2020-11-12T17:26:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1807000000000001e-05 2020-11-12T17:26:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513843+0000", 2020-11-12T17:26:21.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7688000000000005e-05 2020-11-12T17:26:21.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.558 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.559 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:76037 4.0 4.53a8f0e0 (undecoded) ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:21.559 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.513914+0000", 2020-11-12T17:26:21.559 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.001359666, 2020-11-12T17:26:21.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001893825, 2020-11-12T17:26:21.560 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.560 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:21.560 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.561 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.561 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.561 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 76037 2020-11-12T17:26:21.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513914+0000", 2020-11-12T17:26:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513914+0000", 2020-11-12T17:26:21.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999585 2020-11-12T17:26:21.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513872+0000", 2020-11-12T17:26:21.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012515399999999999 2020-11-12T17:26:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.513997+0000", 2020-11-12T17:26:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6489000000000001e-05 2020-11-12T17:26:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514014+0000", 2020-11-12T17:26:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8040000000000002e-06 2020-11-12T17:26:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514021+0000", 2020-11-12T17:26:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107796 2020-11-12T17:26:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:76038 4.0 4.53a8f0e0 (undecoded) ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.514082+0000", 2020-11-12T17:26:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0011915109999999999, 2020-11-12T17:26:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017950399999999999, 2020-11-12T17:26:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 76038 2020-11-12T17:26:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514082+0000", 2020-11-12T17:26:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514082+0000", 2020-11-12T17:26:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:26:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514060+0000", 2020-11-12T17:26:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2159999999999999e-05 2020-11-12T17:26:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514142+0000", 2020-11-12T17:26:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3600000000000001e-05 2020-11-12T17:26:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514166+0000", 2020-11-12T17:26:21.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9890000000000004e-06 2020-11-12T17:26:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514176+0000", 2020-11-12T17:26:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3806000000000003e-05 2020-11-12T17:26:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:76039 4.0 4.53a8f0e0 (undecoded) ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.514247+0000", 2020-11-12T17:26:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0010260569999999999, 2020-11-12T17:26:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017143359999999999, 2020-11-12T17:26:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 76039 2020-11-12T17:26:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514247+0000", 2020-11-12T17:26:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514247+0000", 2020-11-12T17:26:21.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:21.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514207+0000", 2020-11-12T17:26:21.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2789999999999998e-05 2020-11-12T17:26:21.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514300+0000", 2020-11-12T17:26:21.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0900000000000001e-05 2020-11-12T17:26:21.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514311+0000", 2020-11-12T17:26:21.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7530000000000001e-06 2020-11-12T17:26:21.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514316+0000", 2020-11-12T17:26:21.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8565000000000005e-05 2020-11-12T17:26:21.582 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.582 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.582 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.582 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:76040 4.0 4.53a8f0e0 (undecoded) ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:21.582 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.514352+0000", 2020-11-12T17:26:21.583 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00092108200000000004, 2020-11-12T17:26:21.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001694007, 2020-11-12T17:26:21.583 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.583 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:21.583 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.583 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:21.583 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:21.583 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 76040 2020-11-12T17:26:21.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.584 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514352+0000", 2020-11-12T17:26:21.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514352+0000", 2020-11-12T17:26:21.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:26:21.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514331+0000", 2020-11-12T17:26:21.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1422999999999998e-05 2020-11-12T17:26:21.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514392+0000", 2020-11-12T17:26:21.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:26:21.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514402+0000", 2020-11-12T17:26:21.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6799999999999999e-06 2020-11-12T17:26:21.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514405+0000", 2020-11-12T17:26:21.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3096999999999997e-05 2020-11-12T17:26:21.588 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.588 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.588 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.588 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:76024 4.b e112/106 4:d0238a8b:::benchmark_data_smithi036_18856_object9502:head v 112'4824, mlcod=112'4819)", 2020-11-12T17:26:21.588 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:21.514639+0000", 2020-11-12T17:26:21.589 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00063390899999999999, 2020-11-12T17:26:21.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00149282, 2020-11-12T17:26:21.589 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.589 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:21.589 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514639+0000", 2020-11-12T17:26:21.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514639+0000", 2020-11-12T17:26:21.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:21.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514609+0000", 2020-11-12T17:26:21.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109895 2020-11-12T17:26:21.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514719+0000", 2020-11-12T17:26:21.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103861 2020-11-12T17:26:21.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514823+0000", 2020-11-12T17:26:21.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5750000000000001e-06 2020-11-12T17:26:21.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514831+0000", 2020-11-12T17:26:21.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4008000000000002e-05 2020-11-12T17:26:21.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514885+0000", 2020-11-12T17:26:21.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8520000000000001e-05 2020-11-12T17:26:21.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:21.514914+0000", 2020-11-12T17:26:21.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027455399999999999 2020-11-12T17:26:21.595 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.595 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.596 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:21.596 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 10 2020-11-12T17:26:21.596 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:21.597 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:21.643 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:21.640+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:21.710 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:21.711 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:21.711 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:21.712 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:21.712 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:21.715 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:21.710+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:21.720 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:21.743 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:26:21.736+0000 7f4952786700 -1 mon.a@0(leader).osd e112 definitely_dead 0 2020-11-12T17:26:21.816 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:21.814+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:21.920 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:21.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 187.43638202, 2020-11-12T17:26:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.921 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:21.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:21.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:21.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:21.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:21.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:21.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:21.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:21.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:21.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:21.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:21.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:21.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:21.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:21.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:21.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:21.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:21.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:21.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:21.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:21.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:21.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:21.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:21.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:21.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:21.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:21.931 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.931 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.931 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.932 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:21.932 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:21.932 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 187.42943795799999, 2020-11-12T17:26:21.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:21.932 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.932 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:21.932 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:21.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:21.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:21.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:21.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:21.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:21.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:21.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:21.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:21.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:21.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:21.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:21.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:21.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:21.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:21.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:21.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:21.939 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.939 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.939 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.939 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:21.939 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:21.940 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 151.25560017199999, 2020-11-12T17:26:21.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:21.940 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.940 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:21.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:21.940 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:21.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.941 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:21.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:21.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:21.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:21.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:21.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:21.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:21.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:21.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:21.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:21.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:21.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:21.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:21.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:21.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:21.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:21.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:21.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:21.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:21.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:21.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:21.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:21.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:21.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.950 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.950 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:21.950 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:21.951 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 146.784066263, 2020-11-12T17:26:21.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:21.951 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.951 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.951 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.951 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:21.951 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:21.952 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:21.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.952 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:21.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:21.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:21.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:21.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:21.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:21.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:21.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:21.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:21.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:21.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:21.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:21.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:21.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:21.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:21.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:21.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:21.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:21.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:21.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:21.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:21.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:21.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:21.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:21.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:21.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:21.960 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.961 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.961 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.961 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:21.961 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:21.961 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 134.99189507899999, 2020-11-12T17:26:21.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:21.962 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.962 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.962 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.962 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:21.962 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:21.962 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:21.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.963 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:21.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:21.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:21.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:21.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:21.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:21.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:21.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:21.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:21.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:21.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:21.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:21.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:21.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:21.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:21.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:21.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:21.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:21.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:21.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:21.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:21.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:21.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:21.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:21.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:21.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:21.971 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.971 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.972 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.972 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:21.972 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:21.972 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.035448237, 2020-11-12T17:26:21.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:21.973 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.973 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.973 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.973 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:21.973 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:21.973 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:21.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.973 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:21.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:21.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:21.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:21.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:21.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:21.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:21.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:21.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:21.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:21.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:21.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:21.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:21.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:21.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:21.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:21.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:21.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:21.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:21.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:21.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:21.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:21.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:21.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:21.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:21.983 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.983 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.983 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.984 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:21.984 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:21.984 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 119.906514753, 2020-11-12T17:26:21.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:21.984 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.984 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.985 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:21.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:21.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:21.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:21.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:21.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:21.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:21.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:21.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:21.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:21.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:21.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:21.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:21.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:21.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:21.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:21.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:21.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:21.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:21.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:21.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:21.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.991 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:21.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:21.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.992 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:21.992 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:21.992 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 118.212376479, 2020-11-12T17:26:21.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:21.992 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:21.992 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:21.993 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:21.993 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:21.993 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:21.993 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:21.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.993 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:21.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:21.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:21.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:21.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:21.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:21.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:21.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:21.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:21.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:21.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:21.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:21.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:21.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:21.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:21.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:21.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:21.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:21.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:21.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:21.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:21.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:21.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:21.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:22.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:22.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:22.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:22.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:22.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:22.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:22.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:22.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:22.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:22.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:22.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:22.003 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.003 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.004 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:22.004 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:22.004 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 83.897822833000006, 2020-11-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.005 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:22.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:22.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:22.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:22.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:22.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:22.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:22.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:22.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:22.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:22.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:22.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:22.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:22.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:22.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:22.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:22.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:22.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:22.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:22.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:22.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:22.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:22.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:22.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:22.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:22.017 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.018 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.018 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.018 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:22.018 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:22.019 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.543137756999997, 2020-11-12T17:26:22.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:22.019 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.019 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.019 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:22.019 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:22.020 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.020 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:22.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.020 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:22.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:22.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:22.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:22.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:22.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:22.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:22.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:22.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:22.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:22.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:22.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:22.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:22.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:22.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:22.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:22.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:22.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:22.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:22.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:22.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:22.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:22.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:22.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:22.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:22.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:22.030 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.030 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.030 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.030 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:22.030 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:22.030 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.529960998, 2020-11-12T17:26:22.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:22.031 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.031 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:22.031 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:22.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:22.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:22.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:22.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:22.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:22.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:22.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:22.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:22.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:22.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:22.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:22.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:22.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:22.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:22.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:22.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:22.037 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.037 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.037 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.038 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:22.038 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:22.038 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.975879548999998, 2020-11-12T17:26:22.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:22.038 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.038 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.039 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:22.039 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:22.039 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.039 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:22.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.039 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:22.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:22.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:22.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:22.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:22.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:22.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:22.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:22.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:22.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:22.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:22.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:22.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:22.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:22.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:22.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:22.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:22.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:22.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:22.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:22.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:22.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:22.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:22.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:22.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:22.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:22.049 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.049 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.049 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.049 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:22.050 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:22.050 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.966892242999997, 2020-11-12T17:26:22.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:22.050 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.050 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:22.050 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:22.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:22.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:22.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:22.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:22.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:22.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:22.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:22.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:22.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:22.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:22.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:22.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:22.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:22.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:22.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:22.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:22.057 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.057 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.057 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.058 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:22.058 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:22.058 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.948964928999999, 2020-11-12T17:26:22.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:22.058 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.059 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.059 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:22.059 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:22.059 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.059 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:22.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.059 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:22.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:22.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:22.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:22.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:22.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:22.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:22.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:22.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:22.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:22.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:22.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:22.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:22.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:22.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:22.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:22.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:22.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:22.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:22.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:22.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:22.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:22.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:22.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:22.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:22.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:22.069 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.069 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.069 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.069 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:22.069 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:22.070 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.397921531000001, 2020-11-12T17:26:22.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:22.070 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.070 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.070 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:22.070 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:22.070 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.071 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:22.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.071 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:22.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:22.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:22.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:22.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:22.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:22.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:22.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:22.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:22.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:22.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:22.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:22.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:22.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:22.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:22.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:22.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:22.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:22.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:22.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:22.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:22.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:22.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:22.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:22.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:22.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:22.080 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.080 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.080 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.080 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:22.081 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:22.081 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.146526031000001, 2020-11-12T17:26:22.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:22.081 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.081 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:22.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:22.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.082 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:22.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.082 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:22.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:22.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:22.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:22.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:22.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:22.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:22.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:22.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:22.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:22.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:22.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:22.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:22.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:22.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:22.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:22.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:22.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:22.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:22.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:22.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:22.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:22.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:22.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:22.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:22.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:22.091 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.091 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.091 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.091 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:22.091 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:22.092 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.067403714000001, 2020-11-12T17:26:22.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:22.092 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.092 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.092 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:22.092 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:22.092 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.092 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:22.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.093 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:22.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:22.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:22.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:22.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:22.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:22.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:22.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:22.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:22.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:22.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:22.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:22.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:22.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:22.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:22.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:22.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:22.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:22.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:22.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:22.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:22.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:22.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:22.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:22.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:22.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:22.101 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.101 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.102 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.102 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:22.102 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:22.102 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.285052747000002, 2020-11-12T17:26:22.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:22.103 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.103 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:22.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:22.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.103 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:22.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.104 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:22.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:22.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:22.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:22.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:22.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:22.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:22.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:22.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:22.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:22.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:22.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:22.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:22.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:22.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:22.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:22.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:22.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:22.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:22.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:22.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:22.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:22.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:22.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:22.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:22.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:22.113 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.113 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.113 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.113 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:26:22.113 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:22.114 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.8220103979999998, 2020-11-12T17:26:22.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:26:22.114 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.114 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.114 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:22.114 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:22.114 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.115 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:26:22.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.115 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:22.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:22.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:26:22.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:26:22.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:26:22.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:26:22.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:26:22.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:26:22.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:26:22.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:26:22.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:26:22.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:26:22.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:26:22.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:26:22.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:26:22.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:22.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:26:22.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:26:22.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:22.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:26:22.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:26:22.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:26:22.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:26:22.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:22.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:26:22.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:26:22.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:26:22.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:26:22.123 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.124 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.124 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.124 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:26:22.124 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:22.124 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.8009698639999998, 2020-11-12T17:26:22.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:26:22.125 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:22.125 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:22.125 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:22.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:22.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:22.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:22.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:22.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:22.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:26:22.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:22.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:26:22.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:26:22.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:22.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:26:22.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:26:22.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:22.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:26:22.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:26:22.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:26:22.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:26:22.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:22.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:26:22.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:26:22.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:22.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:26:22.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:26:22.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:22.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:22.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:22.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:26:22.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:26:22.131 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.131 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.131 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.131 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:22.132 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:22.132 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:22.132 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:21.914+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:22.133 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:22.134 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 90 9 76386 76377 6.6293 3.92969 0.0161527 0.0188491 2020-11-12T17:26:22.134 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:22.130+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:22.235 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:22.232+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:22.251 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:22.252 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:22.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.252 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:22.252 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:22.252 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.33261948099999999, 2020-11-12T17:26:22.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33267871399999999, 2020-11-12T17:26:22.253 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.253 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:22.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.254 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:26:22.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.254 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:22.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:22.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:22.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:26:22.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:26:22.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:26:22.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:26:22.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:26:22.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:26:22.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:26:22.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:26:22.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:26:22.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:26:22.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:26:22.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:26:22.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:22.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:26:22.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:26:22.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:26:22.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011743735999999999 2020-11-12T17:26:22.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.261 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.261 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:22.261 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:26:22.262 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:22.263 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:22.336 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:22.334+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:22.366 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:22.367 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:22.367 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:22.367 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:22.367 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:22.375 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:22.468 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:22.466+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:22.512 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:26:22.535 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:26:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:22.536 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 191.84723555299999, 2020-11-12T17:26:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:26:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:22.537 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:26:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:26:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:26:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:26:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:26:22.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:26:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:26:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:26:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:26:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:26:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:26:22.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:26:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:26:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:22.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:26:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:26:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:26:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:26:22.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:26:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:26:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:26:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:26:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:26:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:26:22.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:26:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 191.841755484, 2020-11-12T17:26:22.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:26:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:26:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:26:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:26:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:26:22.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:26:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:26:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:26:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:26:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:26:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:26:22.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:26:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:26:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:26:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:26:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.554 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:26:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 183.65163388400001, 2020-11-12T17:26:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:26:22.555 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:26:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:26:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:26:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:26:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:26:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:26:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:26:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:26:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:26:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:26:22.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:26:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:26:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:26:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:26:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:26:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:26:22.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:26:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:26:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:26:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:26:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:26:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:26:22.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:26:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:26:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:26:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 183.64439017500001, 2020-11-12T17:26:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:26:22.566 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:22.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:26:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:26:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:26:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:26:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:26:22.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:26:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:26:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:26:22.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:26:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:26:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:26:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:26:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:26:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:26:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 107.648300801, 2020-11-12T17:26:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:26:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.575 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:26:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:26:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:26:22.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:26:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:26:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:26:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:26:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:26:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:26:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:26:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:26:22.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:26:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:26:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:26:22.582 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:26:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:22.583 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 70.623031534000006, 2020-11-12T17:26:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:26:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:22.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:26:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:26:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:26:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:26:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:26:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:26:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:26:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:26:22.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:26:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:26:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:26:22.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:26:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:26:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:26:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:26:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:26:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:26:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44206 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:26:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.957349051000001, 2020-11-12T17:26:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002, 2020-11-12T17:26:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.593 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44206 2020-11-12T17:26:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:26:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576599+0000", 2020-11-12T17:26:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:26:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576576+0000", 2020-11-12T17:26:22.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1733e-05 2020-11-12T17:26:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576637+0000", 2020-11-12T17:26:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3419e-05 2020-11-12T17:26:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576651+0000", 2020-11-12T17:26:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0509999999999996e-06 2020-11-12T17:26:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576656+0000", 2020-11-12T17:26:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9773e-05 2020-11-12T17:26:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576696+0000", 2020-11-12T17:26:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2999999999999997e-05 2020-11-12T17:26:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576789+0000", 2020-11-12T17:26:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137916 2020-11-12T17:26:22.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576927+0000", 2020-11-12T17:26:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027075860000000001 2020-11-12T17:26:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579634+0000", 2020-11-12T17:26:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.333427529 2020-11-12T17:26:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913062+0000", 2020-11-12T17:26:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2707000000000002e-05 2020-11-12T17:26:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913114+0000", 2020-11-12T17:26:22.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8039e-05 2020-11-12T17:26:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.913152+0000", 2020-11-12T17:26:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33655327000000002 2020-11-12T17:26:22.604 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:22.605 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.957190519000001, 2020-11-12T17:26:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:26:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.606 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:26:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:22.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:22.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:26:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:26:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:26:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:26:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:26:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:26:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:26:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:26:22.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:26:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:26:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:26:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:26:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:22.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:26:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:26:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:26:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:26:22.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:26:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:26:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:26:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:26:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:26:22.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:26:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.617 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.953949190000003, 2020-11-12T17:26:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:26:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.618 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:26:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:22.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:26:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:26:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:26:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:26:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:26:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:26:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:26:22.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:26:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:26:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:26:22.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:26:22.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:26:22.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:22.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:26:22.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:26:22.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:26:22.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:26:22.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:26:22.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:26:22.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:26:22.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:26:22.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:26:22.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:26:22.629 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.629 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.630 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.630 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:44208 4.c e90/69 ondisk, result = 0)", 2020-11-12T17:26:22.630 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:26:22.630 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.950764599999999, 2020-11-12T17:26:22.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003, 2020-11-12T17:26:22.631 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.631 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:22.631 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:26:22.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583184+0000", 2020-11-12T17:26:22.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:26:22.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583142+0000", 2020-11-12T17:26:22.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9876000000000004e-05 2020-11-12T17:26:22.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.583242+0000", 2020-11-12T17:26:22.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33634110099999998 2020-11-12T17:26:22.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919583+0000", 2020-11-12T17:26:22.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3000000000000001e-06 2020-11-12T17:26:22.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919588+0000", 2020-11-12T17:26:22.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3776000000000001e-05 2020-11-12T17:26:22.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919642+0000", 2020-11-12T17:26:22.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3859999999999996e-06 2020-11-12T17:26:22.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919652+0000", 2020-11-12T17:26:22.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013921800000000001 2020-11-12T17:26:22.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919791+0000", 2020-11-12T17:26:22.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33660719500000003 2020-11-12T17:26:22.638 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.638 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.638 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.639 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:26:22.639 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:22.639 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.520778288999999, 2020-11-12T17:26:22.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:26:22.639 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.640 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:22.640 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:22.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:22.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:22.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:26:22.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:26:22.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:26:22.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:26:22.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:26:22.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:26:22.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:26:22.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:26:22.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:26:22.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:26:22.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:26:22.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:26:22.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:26:22.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:26:22.647 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.647 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.647 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.647 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:22.647 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:22.648 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.471711628000001, 2020-11-12T17:26:22.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:26:22.648 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.648 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.648 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.648 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.649 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:26:22.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.649 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:22.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:22.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:22.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:26:22.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:26:22.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:26:22.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:26:22.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:26:22.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:26:22.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:26:22.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:26:22.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:26:22.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:26:22.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:26:22.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:26:22.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:22.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:26:22.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:26:22.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:26:22.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:26:22.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:26:22.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:26:22.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:26:22.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:26:22.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:26:22.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:26:22.660 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.660 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.660 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.660 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:22.661 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:22.661 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.470030848, 2020-11-12T17:26:22.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:26:22.661 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.661 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.662 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.662 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:22.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.662 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:22.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:22.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:26:22.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:26:22.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:26:22.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:26:22.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:26:22.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:26:22.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:26:22.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:26:22.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:26:22.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:26:22.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:26:22.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:26:22.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:26:22.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:22.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:26:22.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:26:22.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:26:22.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:26:22.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:26:22.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:26:22.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:26:22.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:26:22.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:26:22.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:26:22.672 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.672 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.672 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.673 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:22.673 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:22.673 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.469942652999997, 2020-11-12T17:26:22.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:26:22.673 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.674 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.674 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.674 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.674 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.674 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:22.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.675 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:22.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:22.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:22.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:26:22.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:26:22.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:26:22.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:26:22.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:26:22.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:26:22.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:26:22.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:26:22.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:26:22.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:26:22.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:26:22.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:26:22.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:22.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:26:22.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:26:22.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:26:22.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:26:22.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:26:22.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:26:22.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:26:22.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:26:22.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:26:22.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:26:22.684 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.685 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.685 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.685 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:22.685 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:22.685 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.451447338000001, 2020-11-12T17:26:22.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:26:22.686 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.686 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:22.686 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:22.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:22.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:22.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:26:22.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:26:22.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:26:22.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:26:22.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:26:22.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:26:22.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:26:22.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:26:22.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:26:22.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:26:22.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:26:22.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:26:22.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:26:22.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:26:22.693 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.693 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.693 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.694 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:22.694 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:22.694 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.451314347999997, 2020-11-12T17:26:22.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:26:22.694 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.695 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:22.695 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:22.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:22.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:22.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:26:22.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:26:22.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:26:22.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:26:22.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:26:22.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:26:22.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:26:22.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:26:22.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:26:22.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:26:22.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:26:22.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:26:22.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:26:22.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:26:22.702 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.702 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.702 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.703 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:22.703 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:22.703 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.451229619999999, 2020-11-12T17:26:22.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:26:22.703 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.703 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:22.703 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:22.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:22.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:26:22.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:26:22.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:26:22.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:26:22.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:26:22.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:26:22.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:26:22.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:26:22.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:26:22.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:26:22.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:26:22.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:26:22.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:26:22.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:26:22.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:26:22.711 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.711 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.711 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.711 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:22.712 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:22.712 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.39961709, 2020-11-12T17:26:22.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:26:22.712 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.712 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:22.712 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.712 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.713 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.713 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:22.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.713 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:22.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:22.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:22.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:26:22.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:26:22.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:26:22.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:26:22.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:26:22.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:26:22.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:26:22.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:26:22.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:26:22.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:26:22.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:22.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:26:22.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:26:22.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:26:22.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:26:22.720 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.720 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.720 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.721 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:22.721 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:22.721 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.399460073999997, 2020-11-12T17:26:22.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:26:22.721 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.722 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:22.722 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.722 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.722 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.722 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:22.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.722 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:22.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:22.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:22.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:26:22.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:26:22.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:26:22.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:26:22.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:26:22.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:26:22.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:26:22.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:26:22.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:26:22.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:26:22.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:22.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:26:22.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:26:22.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:26:22.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:26:22.729 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.730 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.730 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.730 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:22.730 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:22.730 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.700407169, 2020-11-12T17:26:22.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:26:22.731 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:22.731 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:22.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:22.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:22.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:22.731 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:26:22.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.732 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:22.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:22.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:22.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:22.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:22.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:22.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:26:22.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:22.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:26:22.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:26:22.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:22.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:26:22.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:26:22.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:22.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:26:22.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:26:22.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:22.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:26:22.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:26:22.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:22.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:26:22.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:26:22.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:22.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:26:22.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:26:22.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:22.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:26:22.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:26:22.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:22.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:26:22.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:26:22.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:22.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:26:22.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:26:22.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:22.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:26:22.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:26:22.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:22.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:22.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:22.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:26:22.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:26:22.742 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.742 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.742 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.743 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:22.743 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:22.743 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:22.744 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:22.746 INFO:teuthology.orchestra.run.smithi036.stderr:marked in osd.1. 2020-11-12T17:26:22.746 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:22.740+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:22.747 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:22.747 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:22.602+0000 7f7b4fea9700 -1 osd.4 112 handle_osd_map injecting map crc failure 2020-11-12T17:26:22.748 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:22.614+0000 7f2809aaf700 -1 osd.6 112 handle_osd_map injecting map crc failure 2020-11-12T17:26:22.748 INFO:tasks.thrashosds.thrasher:Added osd 1 2020-11-12T17:26:22.845 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:22.840+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:22.906 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:22.907 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:26:22.907 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:22.916 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:22.936 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Total time run: 90.8367 2020-11-12T17:26:22.936 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Total writes made: 76386 2020-11-12T17:26:22.936 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Write size: 8192 2020-11-12T17:26:22.937 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Object size: 65536 2020-11-12T17:26:22.937 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Bandwidth (MB/sec): 6.56965 2020-11-12T17:26:22.937 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev Bandwidth: 1.71747 2020-11-12T17:26:22.937 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max bandwidth (MB/sec): 11.2266 2020-11-12T17:26:22.937 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min bandwidth (MB/sec): 0.71875 2020-11-12T17:26:22.937 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Average IOPS: 840 2020-11-12T17:26:22.937 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev IOPS: 219.836 2020-11-12T17:26:22.938 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max IOPS: 1437 2020-11-12T17:26:22.938 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min IOPS: 92 2020-11-12T17:26:22.939 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Average Latency(s): 0.0188708 2020-11-12T17:26:22.939 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev Latency(s): 0.0358052 2020-11-12T17:26:22.939 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max latency(s): 1.22522 2020-11-12T17:26:22.939 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min latency(s): 0.00228632 2020-11-12T17:26:22.944 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:22.946 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:22.940+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:22.972 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:22.999 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:23.026 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:23.026 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:23.027 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:23.035 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:23.048 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:23.044+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:23.056 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:23.093 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:23.128 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:23.140 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:23.141 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:23.148 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:23.144+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:23.150 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:23.158 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:23.161 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:23.161 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:23.161 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:23.162 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:23.162 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:23.162 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:23.162 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:23.249 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:23.246+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:23.259 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:23.259 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:23.268 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:23.350 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:23.344+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:23.424 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:23.424 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:23.433 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:23.452 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:23.448+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:23.543 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:23.544 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:23.553 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:23.554 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:23.550+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:23.627 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:23.620+0000 7f658835a700 -1 osd.0 113 handle_osd_map injecting map crc failure 2020-11-12T17:26:23.635 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:26:23.691 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:23.688+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:23.719 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:23.719 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:23.728 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:23.755 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:23.748+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:23.832 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:23.832 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:23.841 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:23.855 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:23.848+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:23.875 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Cleaning up (deleting benchmark objects) 2020-11-12T17:26:23.958 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:23.954+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:24.114 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:24.114 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:24.115 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:24.115 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:24.108+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:24.214 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:24.210+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:24.246 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:24.246 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:24.258 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:24.315 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:24.310+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:24.380 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:24.380 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:24.394 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:24.439 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:24.436+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:24.506 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:24.506 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:24.517 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:24.518 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:24.514+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:24.618 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:24.614+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:24.623 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:24.618+0000 7f7b4fea9700 -1 osd.4 114 handle_osd_map injecting map crc failure 2020-11-12T17:26:24.701 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:24.701 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:24.715 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:24.759 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:24.756+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:24.820 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:24.818+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:24.861 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:24.861 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:24.877 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:24.923 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:24.920+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:25.171 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:25.166+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:25.171 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:25.171 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:25.172 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:25.181 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:25.272 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:25.268+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:25.361 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:25.362 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:25.372 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:25.368+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:25.376 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:25.410 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:25.453 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:25.473 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:25.468+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:25.487 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:25.540 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:25.559 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:25.559 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:25.559 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:25.559 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:25.560 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:25.577 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:25.578 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:25.579 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:25.572+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:25.615 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:25.649 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:26:25.670 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:25.678 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:25.672+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:25.711 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:25.716 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:25.716 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:25.716 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:25.716 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:25.717 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:25.717 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:25.717 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:25.717 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:25.779 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:25.774+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:25.805 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:25.805 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:25.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:25.806 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:25.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.806 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:25.807 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 200.69310006200001, 2020-11-12T17:26:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:25.808 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:25.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:25.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:25.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:25.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:25.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:25.820 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:25.821 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 200.68600826599999, 2020-11-12T17:26:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:25.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:25.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.830 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 191.25344876899999, 2020-11-12T17:26:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:25.831 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:25.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:25.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:25.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:25.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:25.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:25.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:25.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:25.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:25.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:25.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:25.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:25.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:25.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:25.845 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.845 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.845 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 157.30332867499999, 2020-11-12T17:26:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:25.846 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:25.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:25.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 155.19772678300001, 2020-11-12T17:26:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.855 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:25.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:25.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:25.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:25.862 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 123.85124344899999, 2020-11-12T17:26:25.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:25.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:25.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:25.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:25.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:25.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:25.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:25.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:25.873 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:25.874 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 114.85540164699999, 2020-11-12T17:26:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:25.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:25.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:25.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:25.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:25.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:25.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:25.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:25.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:25.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:25.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:25.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:25.931 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.932 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.932 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.932 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:25.932 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:25.932 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.92029824799999, 2020-11-12T17:26:25.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:25.933 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.933 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:25.933 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:25.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:25.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:25.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:25.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:25.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:25.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:25.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:25.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:25.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:25.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:25.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:25.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:25.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:25.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:25.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.939 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.939 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.939 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:25.940 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:25.940 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.155657757, 2020-11-12T17:26:25.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:25.940 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.940 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:25.940 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:25.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:25.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:25.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:25.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:25.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:25.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:25.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:25.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:25.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:25.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:25.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:25.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:25.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:25.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:25.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:25.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:25.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.948 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.948 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:25.948 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.899149073000004, 2020-11-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:25.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:25.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:25.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:25.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:25.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:25.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:25.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:25.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:25.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:25.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:25.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:25.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:25.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:25.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:25.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:25.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:25.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:25.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:25.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:25.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:25.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:25.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:25.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.959 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.959 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:25.959 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:25.960 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.898986703000006, 2020-11-12T17:26:25.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:25.960 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.960 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:25.960 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:25.960 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:25.960 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:25.961 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:25.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.961 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:25.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:25.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:25.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:25.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:25.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:25.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:25.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:25.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:25.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:25.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:25.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:25.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:25.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:25.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:25.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:25.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:25.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:25.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:25.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:25.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:25.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:25.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:25.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:25.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:25.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:25.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:25.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:25.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:25.970 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.970 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.970 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.970 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:25.970 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:25.971 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.890417716000002, 2020-11-12T17:26:25.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:25.971 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.971 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:25.971 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:25.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:25.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:25.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:25.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:25.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:25.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:25.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:25.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:25.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:25.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:25.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:25.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:25.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:25.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:25.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.980 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:25.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:25.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.981 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:25.981 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:25.981 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.385905266000002, 2020-11-12T17:26:25.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:25.981 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:25.981 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:25.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:25.982 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:25.982 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:25.982 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:25.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.982 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:25.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:25.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:25.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:25.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:25.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:25.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:25.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:25.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:25.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:25.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:25.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:25.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:25.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:25.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:25.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:25.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:25.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:25.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:25.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:25.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:25.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:25.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:25.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:25.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:25.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:25.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:25.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:25.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:25.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:25.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:25.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:25.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:25.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:25.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:25.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:25.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:25.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:25.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:25.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:25.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:26.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:26.000 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.000 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.000 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.000 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:26.001 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:26.001 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 47.900356979999998, 2020-11-12T17:26:26.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:26.001 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.001 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.002 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.002 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.002 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:26.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.002 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:26.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:26.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:26.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:26.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:26.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:26.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:26.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:26.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:26.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:26.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:26.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:26.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:26.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:26.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:26.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:26.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:26.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:26.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:26.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:26.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:26.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:26.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:26.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:26.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:26.012 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.012 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.012 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.013 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:26.013 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:26.013 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.827038547999997, 2020-11-12T17:26:26.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:26.013 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.013 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:26.014 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:26.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:26.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:26.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:26.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:26.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:26.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:26.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:26.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:26.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:26.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:26.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:26.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:26.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:26.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:26.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:26.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:26.021 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.021 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.021 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.022 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:26.022 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:26.022 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.771393572000001, 2020-11-12T17:26:26.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:26.022 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.022 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.023 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.023 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.023 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.023 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:26.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.023 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:26.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:26.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:26.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:26.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:26.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:26.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:26.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:26.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:26.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:26.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:26.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:26.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:26.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:26.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:26.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:26.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:26.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:26.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:26.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:26.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:26.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:26.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:26.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:26.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:26.033 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.033 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.033 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.034 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:26.034 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:26.034 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.383189201, 2020-11-12T17:26:26.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:26.034 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.034 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.035 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.035 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.035 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.035 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:26.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.035 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:26.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:26.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:26.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:26.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:26.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:26.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:26.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:26.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:26.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:26.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:26.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:26.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:26.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:26.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:26.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:26.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:26.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:26.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:26.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:26.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:26.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:26.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:26.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:26.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:26.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:26.045 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.046 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.046 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.046 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:26.046 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:26.046 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.176732268999999, 2020-11-12T17:26:26.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:26.047 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.047 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.047 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.047 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.047 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.048 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:26.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.048 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:26.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:26.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:26.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:26.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:26.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:26.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:26.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:26.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:26.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:26.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:26.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:26.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:26.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:26.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:26.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:26.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:26.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:26.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:26.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:26.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:26.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:26.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:26.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:26.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:26.057 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.057 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.057 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.058 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:26.058 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:26.058 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 27.927526652000001, 2020-11-12T17:26:26.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:26.059 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.059 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.059 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.059 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.059 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.059 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:26.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.060 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:26.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:26.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:26.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:26.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:26.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:26.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:26.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:26.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:26.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:26.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:26.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:26.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:26.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:26.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:26.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:26.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:26.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:26.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:26.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:26.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:26.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:26.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:26.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:26.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:26.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:26.069 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.069 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.070 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.070 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:26.070 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:26.070 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 27.910567202999999, 2020-11-12T17:26:26.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:26.071 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.071 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:26.071 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:26.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:26.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:26.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:26.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:26.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:26.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:26.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:26.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:26.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:26.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:26.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:26.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:26.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:26.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:26.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:26.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:26.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.078 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.078 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.078 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:26.080 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:26.081 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:26.078+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:26.181 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:26.178+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:26.251 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:26.251 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:26.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.251 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:77491 4.f 4:f45accc0:::benchmark_data_smithi036_18856_object1102:head [delete] snapc 0=[] ondisk+write+known_if_redirected e115)", 2020-11-12T17:26:26.252 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:26.227338+0000", 2020-11-12T17:26:26.252 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.022989333000000001, 2020-11-12T17:26:26.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.023010202, 2020-11-12T17:26:26.252 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.252 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:26.252 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.252 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.253 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.253 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 77491 2020-11-12T17:26:26.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.253 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.227338+0000", 2020-11-12T17:26:26.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.227338+0000", 2020-11-12T17:26:26.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:26:26.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.227305+0000", 2020-11-12T17:26:26.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4258000000000006e-05 2020-11-12T17:26:26.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.227379+0000", 2020-11-12T17:26:26.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5218999999999999e-05 2020-11-12T17:26:26.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.227395+0000", 2020-11-12T17:26:26.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6890000000000004e-06 2020-11-12T17:26:26.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.227402+0000", 2020-11-12T17:26:26.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1437000000000001e-05 2020-11-12T17:26:26.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.227464+0000", 2020-11-12T17:26:26.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00087913599999999998 2020-11-12T17:26:26.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:26:26.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.228343+0000", 2020-11-12T17:26:26.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01044222 2020-11-12T17:26:26.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.238785+0000", 2020-11-12T17:26:26.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011068700000000001 2020-11-12T17:26:26.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.238896+0000", 2020-11-12T17:26:26.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000157878 2020-11-12T17:26:26.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:26.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.239054+0000", 2020-11-12T17:26:26.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0082980689999999999 2020-11-12T17:26:26.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.247352+0000", 2020-11-12T17:26:26.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.02001383 2020-11-12T17:26:26.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.262 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.262 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:77499 4.f 4:fa339a0e:::benchmark_data_smithi036_18856_object1110:head [delete] snapc 0=[] ondisk+write+known_if_redirected e115)", 2020-11-12T17:26:26.262 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:26.233194+0000", 2020-11-12T17:26:26.262 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.017133341999999999, 2020-11-12T17:26:26.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01722108, 2020-11-12T17:26:26.263 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.263 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:26.263 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.263 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.263 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.263 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 77499 2020-11-12T17:26:26.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.233194+0000", 2020-11-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.233194+0000", 2020-11-12T17:26:26.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:26.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.233160+0000", 2020-11-12T17:26:26.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2148000000000001e-05 2020-11-12T17:26:26.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.233233+0000", 2020-11-12T17:26:26.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3029e-05 2020-11-12T17:26:26.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.233246+0000", 2020-11-12T17:26:26.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5130000000000002e-06 2020-11-12T17:26:26.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.233255+0000", 2020-11-12T17:26:26.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7785999999999999e-05 2020-11-12T17:26:26.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.233313+0000", 2020-11-12T17:26:26.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00090452299999999996 2020-11-12T17:26:26.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:26:26.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.234217+0000", 2020-11-12T17:26:26.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087868890000000009 2020-11-12T17:26:26.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.243004+0000", 2020-11-12T17:26:26.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012492100000000001 2020-11-12T17:26:26.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.243129+0000", 2020-11-12T17:26:26.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000168746 2020-11-12T17:26:26.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:26.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.243298+0000", 2020-11-12T17:26:26.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040682009999999996 2020-11-12T17:26:26.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.247366+0000", 2020-11-12T17:26:26.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014172337 2020-11-12T17:26:26.271 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.272 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.272 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.272 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:77503 4.4 4:2e3b66be:::benchmark_data_smithi036_18856_object1114:head [delete] snapc 0=[] ondisk+write+known_if_redirected e115)", 2020-11-12T17:26:26.272 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:26.236392+0000", 2020-11-12T17:26:26.272 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.013934965000000001, 2020-11-12T17:26:26.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014079995999999999, 2020-11-12T17:26:26.273 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.273 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:26.273 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.273 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.273 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.273 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 77503 2020-11-12T17:26:26.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.273 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.236392+0000", 2020-11-12T17:26:26.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.236392+0000", 2020-11-12T17:26:26.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:26.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.236359+0000", 2020-11-12T17:26:26.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4318000000000002e-05 2020-11-12T17:26:26.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.236433+0000", 2020-11-12T17:26:26.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7985000000000001e-05 2020-11-12T17:26:26.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.236451+0000", 2020-11-12T17:26:26.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.009e-05 2020-11-12T17:26:26.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.236461+0000", 2020-11-12T17:26:26.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8323999999999999e-05 2020-11-12T17:26:26.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.236520+0000", 2020-11-12T17:26:26.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021207600000000001 2020-11-12T17:26:26.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.236732+0000", 2020-11-12T17:26:26.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000204324 2020-11-12T17:26:26.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:26.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.236936+0000", 2020-11-12T17:26:26.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003810917 2020-11-12T17:26:26.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.240747+0000", 2020-11-12T17:26:26.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0043547539999999997 2020-11-12T17:26:26.281 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.281 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.281 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.281 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:77507 4.4 4:2ef08f66:::benchmark_data_smithi036_18856_object1118:head [delete] snapc 0=[] ondisk+write+known_if_redirected e115)", 2020-11-12T17:26:26.282 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:26.246324+0000", 2020-11-12T17:26:26.282 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0040027709999999996, 2020-11-12T17:26:26.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041981600000000003, 2020-11-12T17:26:26.282 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.282 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:26.282 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.282 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.283 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.283 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 77507 2020-11-12T17:26:26.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.283 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.246324+0000", 2020-11-12T17:26:26.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.246324+0000", 2020-11-12T17:26:26.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:26.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.246290+0000", 2020-11-12T17:26:26.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2490000000000005e-05 2020-11-12T17:26:26.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.246373+0000", 2020-11-12T17:26:26.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3856000000000001e-05 2020-11-12T17:26:26.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.246387+0000", 2020-11-12T17:26:26.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7530000000000004e-06 2020-11-12T17:26:26.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.246394+0000", 2020-11-12T17:26:26.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3752999999999998e-05 2020-11-12T17:26:26.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.246447+0000", 2020-11-12T17:26:26.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020441599999999999 2020-11-12T17:26:26.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.246652+0000", 2020-11-12T17:26:26.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020182800000000001 2020-11-12T17:26:26.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:26.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.246854+0000", 2020-11-12T17:26:26.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0032135140000000002 2020-11-12T17:26:26.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.250067+0000", 2020-11-12T17:26:26.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037426489999999998 2020-11-12T17:26:26.289 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.290 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.290 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.290 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:77509 4.f 4:f7f11a36:::benchmark_data_smithi036_18856_object1120:head [delete] snapc 0=[] ondisk+write+known_if_redirected e115)", 2020-11-12T17:26:26.290 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:26.247799+0000", 2020-11-12T17:26:26.290 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0025282949999999998, 2020-11-12T17:26:26.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027727759999999998, 2020-11-12T17:26:26.291 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.291 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:26:26.291 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.291 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.291 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.291 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 77509 2020-11-12T17:26:26.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.292 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.247799+0000", 2020-11-12T17:26:26.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.247799+0000", 2020-11-12T17:26:26.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:26.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.247767+0000", 2020-11-12T17:26:26.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1099999999999994e-05 2020-11-12T17:26:26.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.247839+0000", 2020-11-12T17:26:26.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2169999999999994e-06 2020-11-12T17:26:26.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.247847+0000", 2020-11-12T17:26:26.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6530000000000002e-06 2020-11-12T17:26:26.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.247851+0000", 2020-11-12T17:26:26.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9673999999999999e-05 2020-11-12T17:26:26.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.247901+0000", 2020-11-12T17:26:26.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00073930199999999995 2020-11-12T17:26:26.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:26:26.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.248640+0000", 2020-11-12T17:26:26.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00084149099999999998 2020-11-12T17:26:26.297 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.297 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.297 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.297 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:77513 4.f 4:faf08b2e:::benchmark_data_smithi036_18856_object1124:head [delete] snapc 0=[] ondisk+write+known_if_redirected e115)", 2020-11-12T17:26:26.298 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:26.249185+0000", 2020-11-12T17:26:26.298 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.001141897, 2020-11-12T17:26:26.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014274310000000001, 2020-11-12T17:26:26.298 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.298 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:26:26.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.298 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.299 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.299 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 77513 2020-11-12T17:26:26.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.299 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.249185+0000", 2020-11-12T17:26:26.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.249185+0000", 2020-11-12T17:26:26.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:26.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.249147+0000", 2020-11-12T17:26:26.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3627000000000004e-05 2020-11-12T17:26:26.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.249230+0000", 2020-11-12T17:26:26.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7731e-05 2020-11-12T17:26:26.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.249248+0000", 2020-11-12T17:26:26.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1470000000000007e-06 2020-11-12T17:26:26.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.249257+0000", 2020-11-12T17:26:26.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4008000000000002e-05 2020-11-12T17:26:26.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.249311+0000", 2020-11-12T17:26:26.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094628400000000004 2020-11-12T17:26:26.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:26:26.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.250257+0000", 2020-11-12T17:26:26.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010720910000000001 2020-11-12T17:26:26.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.304 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.305 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.305 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:26.305 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 6 2020-11-12T17:26:26.305 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:26.307 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:26.307 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:26.300+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:26.407 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:26.404+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:26.454 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:26.455 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:26.455 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:26.455 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:26.455 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:26.465 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:26.536 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:26.506+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:26.609 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:26.606+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:26.664 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:26.654+0000 7f9a06aa2700 -1 osd.5 115 handle_osd_map injecting map crc failure 2020-11-12T17:26:26.666 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:26.666 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:26.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:26.667 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:26.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.667 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:26.667 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:26.667 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 192.24302272099999, 2020-11-12T17:26:26.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:26.668 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.668 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.668 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.669 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:26.669 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:26.669 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:26.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.669 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:26.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:26.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:26.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:26.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:26.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:26.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:26.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:26.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:26.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:26.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:26.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:26.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:26.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:26.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:26.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:26.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:26.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:26.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:26.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:26.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:26.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:26.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:26.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:26.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:26.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.679 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.680 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:26.680 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:26.680 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 192.23607865899999, 2020-11-12T17:26:26.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:26.680 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.680 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:26.680 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:26.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:26.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:26.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:26.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:26.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:26.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:26.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:26.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:26.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:26.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:26.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:26.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:26.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:26.687 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:26.688 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 156.06224087300001, 2020-11-12T17:26:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:26.689 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:26.690 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:26.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.690 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:26.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:26.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:26.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:26.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:26.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:26.700 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 151.59070696399999, 2020-11-12T17:26:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.702 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:26.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:26.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 139.79853578000001, 2020-11-12T17:26:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.713 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:26.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:26.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:26.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:26.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:26.724 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:26.725 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 124.842088938, 2020-11-12T17:26:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:26.726 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:26.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:26.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:26.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:26.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:26.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:26.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:26.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:26.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.736 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.737 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:26.737 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:26.737 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 124.713155454, 2020-11-12T17:26:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:26.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:26.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:26.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:26.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:26.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:26.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.746 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.747 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:26.747 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:26.747 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 123.01901718000001, 2020-11-12T17:26:26.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:26.748 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.748 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.748 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.748 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:26.748 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:26.749 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:26.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.749 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:26.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:26.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:26.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:26.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:26.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:26.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:26.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:26.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:26.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:26.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:26.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:26.772 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.773 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.773 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.773 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:26.773 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:26.773 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 88.704463533999999, 2020-11-12T17:26:26.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:26.774 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.774 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.774 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.774 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.774 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.774 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:26.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.775 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:26.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:26.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:26.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:26.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:26.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:26.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:26.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:26.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:26.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:26.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:26.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:26.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:26.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:26.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:26.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:26.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:26.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:26.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:26.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:26.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:26.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:26.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:26.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:26.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:26.783 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.784 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.784 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.784 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:26.784 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:26.784 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.349778458000003, 2020-11-12T17:26:26.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:26.785 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.785 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.785 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.785 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.785 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.785 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:26.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.786 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:26.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:26.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:26.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:26.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:26.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:26.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:26.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:26.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:26.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:26.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:26.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:26.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:26.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:26.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:26.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:26.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:26.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:26.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:26.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:26.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:26.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:26.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:26.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:26.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:26.795 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.795 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.795 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.795 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:26.795 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:26.796 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.336601698999999, 2020-11-12T17:26:26.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:26.796 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.796 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:26.796 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:26.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:26.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:26.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:26.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:26.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:26.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:26.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:26.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:26.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:26.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:26.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:26.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:26.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:26.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:26.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:26.803 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.803 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.803 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.804 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:26.804 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:26.804 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.782520249999997, 2020-11-12T17:26:26.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:26.804 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.805 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.805 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.805 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.805 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.805 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:26.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.805 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:26.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:26.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:26.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:26.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:26.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:26.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:26.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:26.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:26.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:26.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:26.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:26.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:26.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:26.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:26.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:26.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:26.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:26.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:26.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:26.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:26.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:26.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:26.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:26.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:26.814 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.814 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.814 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.815 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:26.815 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:26.815 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.773532944000003, 2020-11-12T17:26:26.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:26.815 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.816 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:26.816 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:26.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:26.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:26.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:26.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:26.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:26.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:26.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:26.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:26.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:26.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:26.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:26.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:26.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:26.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:26.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:26.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:26.822 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.823 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.823 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.823 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:26.823 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:26.823 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.755605629999998, 2020-11-12T17:26:26.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:26.824 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.824 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.824 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.824 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.824 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.824 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:26.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.825 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:26.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:26.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:26.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:26.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:26.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:26.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:26.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:26.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:26.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:26.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:26.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:26.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:26.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:26.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:26.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:26.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:26.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:26.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:26.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:26.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:26.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:26.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:26.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:26.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:26.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:26.834 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.834 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.834 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.835 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:26.835 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:26.835 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.204562232000001, 2020-11-12T17:26:26.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:26.835 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.835 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.836 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.836 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.836 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.836 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:26.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.837 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:26.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:26.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:26.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:26.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:26.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:26.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:26.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:26.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:26.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:26.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:26.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:26.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:26.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:26.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:26.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:26.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:26.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:26.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:26.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:26.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:26.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:26.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:26.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:26.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:26.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:26.845 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.845 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.845 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.846 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:26.846 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:26.846 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.953166732, 2020-11-12T17:26:26.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:26.846 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.847 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.847 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.847 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.847 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.847 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:26.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.847 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:26.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:26.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:26.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:26.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:26.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:26.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:26.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:26.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:26.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:26.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:26.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:26.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:26.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:26.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:26.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:26.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:26.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:26.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:26.856 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.857 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.857 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.857 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:26.857 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:26.857 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.874044415, 2020-11-12T17:26:26.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:26.858 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.858 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.858 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.858 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.858 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.858 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:26.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.859 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:26.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:26.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:26.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:26.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:26.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:26.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:26.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:26.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:26.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:26.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:26.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:26.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:26.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:26.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:26.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:26.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:26.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:26.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:26.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:26.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:26.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:26.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:26.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:26.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:26.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:26.867 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.867 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.867 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.868 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:26.868 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:26.868 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.091693448000001, 2020-11-12T17:26:26.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:26.868 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.868 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.869 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.869 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.869 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.869 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:26.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.869 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:26.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:26.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:26.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:26.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:26.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:26.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:26.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:26.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:26.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:26.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:26.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:26.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:26.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:26.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:26.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:26.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:26.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:26.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:26.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:26.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:26.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:26.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:26.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:26.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:26.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:26.878 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.878 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.878 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.879 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:26:26.879 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:26.879 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.6286510990000007, 2020-11-12T17:26:26.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:26:26.879 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.879 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:26.880 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:26.880 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:26.880 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:26.880 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:26:26.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.880 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:26.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:26.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:26:26.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:26:26.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:26:26.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:26:26.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:26:26.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:26:26.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:26:26.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:26:26.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:26:26.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:26:26.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:26:26.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:26:26.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:26:26.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:26.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:26:26.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:26:26.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:26.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:26:26.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:26:26.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:26.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:26:26.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:26:26.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:26.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:26:26.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:26:26.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:26:26.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:26:26.889 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.889 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.889 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.890 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:26:26.890 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:26.890 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.6076105649999999, 2020-11-12T17:26:26.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:26:26.890 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:26.890 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:26.890 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:26.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:26.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:26.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:26.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:26.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:26.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:26:26.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:26.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:26:26.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:26:26.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:26.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:26:26.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:26:26.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:26.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:26:26.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:26:26.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:26.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:26:26.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:26:26.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:26.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:26:26.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:26:26.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:26.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:26:26.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:26:26.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:26.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:26.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:26.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:26:26.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:26:26.896 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.896 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.896 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:26.897 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:26.897 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:26.898 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:26:26.899 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:26.900 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:26.892+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:26.999 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:26.994+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:27.057 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:27.058 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:27.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.058 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:77986 4.9 4:95210b5c:::benchmark_data_smithi036_18856_object1597:head [delete] snapc 0=[] ondisk+write+known_if_redirected e116)", 2020-11-12T17:26:27.058 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.042669+0000", 2020-11-12T17:26:27.059 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.012695522000000001, 2020-11-12T17:26:27.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012721082, 2020-11-12T17:26:27.059 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.059 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:27.059 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.059 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.060 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.060 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 77986 2020-11-12T17:26:27.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.060 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042669+0000", 2020-11-12T17:26:27.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042669+0000", 2020-11-12T17:26:27.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:27.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042640+0000", 2020-11-12T17:26:27.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6051999999999997e-05 2020-11-12T17:26:27.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042707+0000", 2020-11-12T17:26:27.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1582e-05 2020-11-12T17:26:27.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042718+0000", 2020-11-12T17:26:27.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2160000000000003e-06 2020-11-12T17:26:27.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042724+0000", 2020-11-12T17:26:27.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00050918800000000005 2020-11-12T17:26:27.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.043233+0000", 2020-11-12T17:26:27.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000132003 2020-11-12T17:26:27.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.043365+0000", 2020-11-12T17:26:27.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8813000000000005e-05 2020-11-12T17:26:27.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:27.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.043454+0000", 2020-11-12T17:26:27.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047432230000000004 2020-11-12T17:26:27.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.048198+0000", 2020-11-12T17:26:27.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055283550000000004 2020-11-12T17:26:27.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.073 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.074 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:77987 4.2 4:4ffe31a0:::benchmark_data_smithi036_18856_object1598:head [delete] snapc 0=[] ondisk+write+known_if_redirected e116)", 2020-11-12T17:26:27.074 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.044051+0000", 2020-11-12T17:26:27.075 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.011313646, 2020-11-12T17:26:27.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011426765, 2020-11-12T17:26:27.075 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.076 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:27.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.077 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 77987 2020-11-12T17:26:27.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.077 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.044051+0000", 2020-11-12T17:26:27.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.044051+0000", 2020-11-12T17:26:27.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:26:27.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.044032+0000", 2020-11-12T17:26:27.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9657999999999999e-05 2020-11-12T17:26:27.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.044072+0000", 2020-11-12T17:26:27.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9570000000000002e-06 2020-11-12T17:26:27.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.044080+0000", 2020-11-12T17:26:27.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6059999999999996e-06 2020-11-12T17:26:27.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.044085+0000", 2020-11-12T17:26:27.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0568999999999997e-05 2020-11-12T17:26:27.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.044125+0000", 2020-11-12T17:26:27.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0671000000000002e-05 2020-11-12T17:26:27.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.044196+0000", 2020-11-12T17:26:27.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012867999999999999 2020-11-12T17:26:27.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1,5", 2020-11-12T17:26:27.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.044325+0000", 2020-11-12T17:26:27.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003229549 2020-11-12T17:26:27.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.047554+0000", 2020-11-12T17:26:27.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003503066 2020-11-12T17:26:27.092 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.092 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.093 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:77986 4.9 4:95210b5c:::benchmark_data_smithi036_18856_object1597:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e116)", 2020-11-12T17:26:27.094 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.054874+0000", 2020-11-12T17:26:27.094 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00049031699999999999, 2020-11-12T17:26:27.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00068789100000000004, 2020-11-12T17:26:27.095 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.095 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:27.095 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.095 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.096 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.096 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 77986 2020-11-12T17:26:27.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.097 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054874+0000", 2020-11-12T17:26:27.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054874+0000", 2020-11-12T17:26:27.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999781 2020-11-12T17:26:27.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054852+0000", 2020-11-12T17:26:27.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3194999999999994e-05 2020-11-12T17:26:27.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054916+0000", 2020-11-12T17:26:27.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1599e-05 2020-11-12T17:26:27.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054927+0000", 2020-11-12T17:26:27.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0459999999999996e-06 2020-11-12T17:26:27.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054932+0000", 2020-11-12T17:26:27.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8809e-05 2020-11-12T17:26:27.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054981+0000", 2020-11-12T17:26:27.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9007999999999999e-05 2020-11-12T17:26:27.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:27.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055070+0000", 2020-11-12T17:26:27.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019566900000000001 2020-11-12T17:26:27.107 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.107 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.108 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:77987 4.2 4:4ffe31a0:::benchmark_data_smithi036_18856_object1598:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e116)", 2020-11-12T17:26:27.108 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.054980+0000", 2020-11-12T17:26:27.108 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00038456900000000002, 2020-11-12T17:26:27.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00063198099999999999, 2020-11-12T17:26:27.109 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.109 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:27.109 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.109 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.109 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.109 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 77987 2020-11-12T17:26:27.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.110 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054980+0000", 2020-11-12T17:26:27.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054980+0000", 2020-11-12T17:26:27.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:27.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.054955+0000", 2020-11-12T17:26:27.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2617999999999997e-05 2020-11-12T17:26:27.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055008+0000", 2020-11-12T17:26:27.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1240000000000001e-05 2020-11-12T17:26:27.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055019+0000", 2020-11-12T17:26:27.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0289999999999999e-06 2020-11-12T17:26:27.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055023+0000", 2020-11-12T17:26:27.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5284000000000002e-05 2020-11-12T17:26:27.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055069+0000", 2020-11-12T17:26:27.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9074999999999996e-05 2020-11-12T17:26:27.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:27.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055168+0000", 2020-11-12T17:26:27.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000187493 2020-11-12T17:26:27.115 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.115 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.115 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.116 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:77989 4.2 4:4c1b6680:::benchmark_data_smithi036_18856_object1600:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e116)", 2020-11-12T17:26:27.116 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.055073+0000", 2020-11-12T17:26:27.116 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00029145400000000002, 2020-11-12T17:26:27.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00058849, 2020-11-12T17:26:27.116 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.116 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:27.117 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.117 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.117 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.117 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 77989 2020-11-12T17:26:27.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.118 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055073+0000", 2020-11-12T17:26:27.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055073+0000", 2020-11-12T17:26:27.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:26:27.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055044+0000", 2020-11-12T17:26:27.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5537999999999995e-05 2020-11-12T17:26:27.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055109+0000", 2020-11-12T17:26:27.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2112e-05 2020-11-12T17:26:27.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055121+0000", 2020-11-12T17:26:27.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3210000000000004e-06 2020-11-12T17:26:27.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055127+0000", 2020-11-12T17:26:27.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9408999999999999e-05 2020-11-12T17:26:27.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055196+0000", 2020-11-12T17:26:27.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2843999999999994e-05 2020-11-12T17:26:27.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055289+0000", 2020-11-12T17:26:27.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014888 2020-11-12T17:26:27.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1,5", 2020-11-12T17:26:27.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055438+0000", 2020-11-12T17:26:27.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000364564 2020-11-12T17:26:27.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.124 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.125 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:77992 4.e 4:723819a2:::benchmark_data_smithi036_18856_object1603:head [delete] snapc 0=[] ondisk+write+known_if_redirected e116)", 2020-11-12T17:26:27.125 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.055162+0000", 2020-11-12T17:26:27.125 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00020279799999999999, 2020-11-12T17:26:27.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00057464899999999999, 2020-11-12T17:26:27.125 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.125 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:27.125 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.126 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.126 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.126 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 77992 2020-11-12T17:26:27.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.126 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055162+0000", 2020-11-12T17:26:27.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055162+0000", 2020-11-12T17:26:27.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:27.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055145+0000", 2020-11-12T17:26:27.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5407000000000001e-05 2020-11-12T17:26:27.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055190+0000", 2020-11-12T17:26:27.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5599999999999999e-06 2020-11-12T17:26:27.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055197+0000", 2020-11-12T17:26:27.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0910000000000001e-06 2020-11-12T17:26:27.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055200+0000", 2020-11-12T17:26:27.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5048e-05 2020-11-12T17:26:27.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055245+0000", 2020-11-12T17:26:27.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019336200000000001 2020-11-12T17:26:27.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055438+0000", 2020-11-12T17:26:27.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014177699999999999 2020-11-12T17:26:27.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:27.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055580+0000", 2020-11-12T17:26:27.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041811700000000002 2020-11-12T17:26:27.132 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.132 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.132 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.133 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:77984 4.b e116/114 4:d2c2ae5d:::benchmark_data_smithi036_18856_object1595:head v 116'4947, mlcod=71'7)", 2020-11-12T17:26:27.133 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.042094+0000", 2020-11-12T17:26:27.133 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.013270891, 2020-11-12T17:26:27.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013733229, 2020-11-12T17:26:27.133 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.134 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:27.134 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042094+0000", 2020-11-12T17:26:27.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042094+0000", 2020-11-12T17:26:27.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:26:27.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042070+0000", 2020-11-12T17:26:27.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7886999999999995e-05 2020-11-12T17:26:27.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.042148+0000", 2020-11-12T17:26:27.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013080054000000001 2020-11-12T17:26:27.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055228+0000", 2020-11-12T17:26:27.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6629999999999999e-06 2020-11-12T17:26:27.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055232+0000", 2020-11-12T17:26:27.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4400000000000001e-05 2020-11-12T17:26:27.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055286+0000", 2020-11-12T17:26:27.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6851999999999999e-05 2020-11-12T17:26:27.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.055323+0000", 2020-11-12T17:26:27.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013229360000000001 2020-11-12T17:26:27.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.141 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.142 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.142 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.142 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:27.142 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 7 2020-11-12T17:26:27.142 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:27.143 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:27.144 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:27.142+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:27.247 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:27.242+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:27.354 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:27.354 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:27.355 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:27.355 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:27.355 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:27.360 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:27.350+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:27.381 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:27.503 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:27.478+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:27.558 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:27.552+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:27.580 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:27.580 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:27.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:27.581 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:27.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.581 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:26:27.581 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:27.581 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 196.892434624, 2020-11-12T17:26:27.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:26:27.582 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.582 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.582 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.582 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:27.582 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:27.582 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:26:27.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.583 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:27.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:27.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:27.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:26:27.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:26:27.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:26:27.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:26:27.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:26:27.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:26:27.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:26:27.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:26:27.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:26:27.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:26:27.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:26:27.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:26:27.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:27.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:26:27.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:26:27.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:26:27.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:26:27.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:27.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:26:27.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:26:27.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:26:27.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:26:27.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:26:27.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:26:27.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.593 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.594 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:26:27.594 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:27.594 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 196.88695455499999, 2020-11-12T17:26:27.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:26:27.594 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.595 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:27.595 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:27.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:27.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:27.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:26:27.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:26:27.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:26:27.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:26:27.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:26:27.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:26:27.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:26:27.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:26:27.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:26:27.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:26:27.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:26:27.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:26:27.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:26:27.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:26:27.602 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.602 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.602 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.603 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:26:27.603 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:27.603 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 188.69683295499999, 2020-11-12T17:26:27.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:26:27.604 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.604 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.604 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.604 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:27.604 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:27.604 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:26:27.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.604 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:27.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:27.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:26:27.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:26:27.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:26:27.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:26:27.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:26:27.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:26:27.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:26:27.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:26:27.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:26:27.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:26:27.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:26:27.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:26:27.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:26:27.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:27.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:26:27.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:26:27.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:26:27.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:26:27.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:27.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:26:27.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:26:27.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:26:27.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:26:27.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:26:27.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:26:27.614 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.615 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.615 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.615 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:26:27.615 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:27.615 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 188.689589246, 2020-11-12T17:26:27.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:26:27.616 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.616 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:27.616 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:27.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:27.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:27.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:26:27.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:26:27.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:26:27.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:26:27.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:26:27.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:26:27.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:26:27.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:26:27.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:26:27.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:26:27.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:26:27.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:26:27.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:26:27.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:26:27.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.623 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.623 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:27.623 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:27.624 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 112.693499872, 2020-11-12T17:26:27.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:26:27.624 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.624 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:27.624 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:27.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:27.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:27.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:26:27.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:26:27.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:26:27.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:26:27.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:26:27.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:26:27.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:26:27.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:26:27.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:26:27.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:26:27.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:26:27.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:26:27.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:26:27.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.631 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 75.668230605000005, 2020-11-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.632 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.633 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:27.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:27.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:26:27.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:26:27.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:26:27.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:26:27.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:26:27.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:26:27.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:26:27.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:26:27.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:26:27.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:26:27.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:26:27.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:26:27.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:26:27.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:26:27.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:26:27.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:26:27.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.00238959, 2020-11-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:27.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:27.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:27.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:26:27.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:26:27.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:26:27.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:26:27.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:26:27.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:26:27.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:26:27.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:26:27.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:26:27.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:26:27.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:26:27.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:26:27.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:27.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:26:27.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:26:27.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:26:27.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:26:27.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:27.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:26:27.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:26:27.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:26:27.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:26:27.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:26:27.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:26:27.655 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.655 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.655 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.656 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:27.656 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:27.656 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.999148261000002, 2020-11-12T17:26:27.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:26:27.656 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.656 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.657 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.657 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.657 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.657 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:26:27.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.657 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:27.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:27.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:27.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:26:27.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:26:27.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:26:27.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:26:27.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:26:27.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:26:27.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:26:27.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:26:27.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:26:27.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:26:27.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:26:27.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:26:27.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:27.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:26:27.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:26:27.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:26:27.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:26:27.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:27.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:26:27.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:26:27.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:26:27.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:26:27.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:26:27.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:26:27.667 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.667 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.667 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.668 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:26:27.668 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:27.668 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.565977359999998, 2020-11-12T17:26:27.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:26:27.668 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.668 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:27.668 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:27.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:27.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:27.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:26:27.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:26:27.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:26:27.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:26:27.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:26:27.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:26:27.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:26:27.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:26:27.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:26:27.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:26:27.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:26:27.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:26:27.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:26:27.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:26:27.676 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.676 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.676 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.677 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:27.677 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:27.677 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.516910699, 2020-11-12T17:26:27.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:26:27.678 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.678 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.678 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:26:27.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.679 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:27.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:27.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:27.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:26:27.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:26:27.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:26:27.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:26:27.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:26:27.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:26:27.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:26:27.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:26:27.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:26:27.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:26:27.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:26:27.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:26:27.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:27.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:26:27.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:26:27.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:26:27.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:26:27.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:27.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:26:27.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:26:27.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:26:27.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:26:27.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:26:27.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:26:27.690 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.690 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.690 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.690 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:27.690 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:27.690 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.515229918999999, 2020-11-12T17:26:27.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:26:27.692 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.692 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.692 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.692 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.692 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.692 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:27.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.693 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:27.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:27.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:26:27.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:26:27.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:26:27.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:26:27.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:26:27.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:26:27.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:26:27.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:26:27.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:26:27.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:26:27.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:26:27.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:26:27.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:26:27.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:27.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:26:27.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:26:27.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:26:27.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:26:27.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:27.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:26:27.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:26:27.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:26:27.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:26:27.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:26:27.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:26:27.703 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.703 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.704 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:27.704 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:27.704 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.515141724000003, 2020-11-12T17:26:27.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:26:27.706 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.706 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.707 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:27.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.707 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:27.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:27.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:27.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:26:27.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:26:27.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:26:27.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:26:27.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:26:27.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:26:27.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:26:27.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:26:27.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:26:27.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:26:27.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:26:27.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:26:27.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:27.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:26:27.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:26:27.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:26:27.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:26:27.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:27.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:26:27.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:26:27.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:26:27.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:26:27.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:26:27.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:26:27.715 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.716 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.716 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.716 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:27.717 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:27.717 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.496646409, 2020-11-12T17:26:27.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:26:27.717 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.717 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:27.718 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:27.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:27.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:27.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:26:27.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:26:27.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:26:27.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:26:27.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:26:27.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:26:27.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:26:27.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:26:27.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:26:27.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:26:27.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:26:27.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:26:27.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:26:27.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:26:27.724 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.724 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.724 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.724 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:27.725 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:27.725 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.496513419000003, 2020-11-12T17:26:27.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:26:27.725 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.725 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:27.725 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:27.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:27.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:27.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:26:27.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:26:27.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:26:27.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:26:27.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:26:27.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:26:27.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:26:27.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:26:27.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:26:27.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:26:27.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:26:27.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:26:27.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:26:27.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:26:27.732 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.732 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.732 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.733 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:27.733 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:27.733 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.496428690999998, 2020-11-12T17:26:27.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:26:27.733 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.733 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:27.734 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:27.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:27.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:26:27.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:26:27.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:26:27.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:26:27.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:26:27.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:26:27.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:26:27.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:26:27.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:26:27.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:26:27.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:26:27.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:26:27.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:26:27.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:26:27.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:26:27.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.741 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.741 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:27.741 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:27.742 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.444816160999999, 2020-11-12T17:26:27.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:26:27.742 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.742 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:27.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.743 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:27.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.743 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:27.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:27.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:27.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:26:27.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:26:27.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:26:27.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:26:27.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.750 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:27.750 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:27.750 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.444659145000003, 2020-11-12T17:26:27.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:26:27.750 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.750 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:27.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.751 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:27.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.751 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:27.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:27.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:27.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:26:27.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:26:27.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:26:27.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:26:27.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:26:27.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:26:27.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:26:27.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:26:27.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:26:27.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:26:27.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:27.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:26:27.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:26:27.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:26:27.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:26:27.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.758 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.758 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:27.759 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:27.759 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.7456062399999999, 2020-11-12T17:26:27.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:26:27.759 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.759 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.759 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.759 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.760 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.760 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:26:27.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.760 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:27.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:27.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:26:27.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:26:27.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:26:27.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:26:27.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:26:27.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:26:27.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:26:27.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:26:27.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:26:27.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:26:27.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:26:27.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:26:27.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:26:27.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:27.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:26:27.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:26:27.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:26:27.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:26:27.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:27.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:26:27.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:26:27.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:26:27.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:26:27.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:26:27.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:26:27.769 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.769 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.769 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.769 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:27.769 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:27.769 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.658950752, 2020-11-12T17:26:27.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:26:27.770 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.770 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:27.770 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.770 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.770 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.770 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:26:27.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.771 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:27.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:27.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:27.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:26:27.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:26:27.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:26:27.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:26:27.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:26:27.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:26:27.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:26:27.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:26:27.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:26:27.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:26:27.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:26:27.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:26:27.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:27.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:26:27.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:26:27.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:26:27.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:26:27.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:27.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:26:27.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:26:27.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:27.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:26:27.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:26:27.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:26:27.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:26:27.780 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.780 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.780 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.780 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:26:27.780 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:27.781 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.6454695250000002, 2020-11-12T17:26:27.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:26:27.781 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.781 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:27.781 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:27.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:27.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:27.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:26:27.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:26:27.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:26:27.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:26:27.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:26:27.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:26:27.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:26:27.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:26:27.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:26:27.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:26:27.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:26:27.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:26:27.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:27.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:26:27.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:26:27.787 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.788 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.788 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.788 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.788 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.788 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:27.789 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:27.791 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:27.791 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 1] out_osds: [2, 0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:27.791 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:27.792 INFO:tasks.thrashosds.thrasher:Adding osd 2 2020-11-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd in 2 2020-11-12T17:26:27.793 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:27.788+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:27.895 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:27.888+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:27.939 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:27.940 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:27.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.940 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:78779 4.3 4:cb150e19:::benchmark_data_smithi036_18856_object2390:head [delete] snapc 0=[] ondisk+write+known_if_redirected e116)", 2020-11-12T17:26:27.940 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.911405+0000", 2020-11-12T17:26:27.941 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.028916830000000001, 2020-11-12T17:26:27.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.028939434, 2020-11-12T17:26:27.941 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.941 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:27.941 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.941 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.942 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.942 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 78779 2020-11-12T17:26:27.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.942 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.911405+0000", 2020-11-12T17:26:27.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.911405+0000", 2020-11-12T17:26:27.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:27.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.911369+0000", 2020-11-12T17:26:27.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8311000000000003e-05 2020-11-12T17:26:27.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.911448+0000", 2020-11-12T17:26:27.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3976e-05 2020-11-12T17:26:27.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.911462+0000", 2020-11-12T17:26:27.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7580000000000003e-06 2020-11-12T17:26:27.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.911468+0000", 2020-11-12T17:26:27.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1915e-05 2020-11-12T17:26:27.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.911520+0000", 2020-11-12T17:26:27.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115376 2020-11-12T17:26:27.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.911636+0000", 2020-11-12T17:26:27.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137109 2020-11-12T17:26:27.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:27.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.911773+0000", 2020-11-12T17:26:27.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035117899999999999 2020-11-12T17:26:27.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.915285+0000", 2020-11-12T17:26:27.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003879155 2020-11-12T17:26:27.955 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.955 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.955 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.955 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:78795 4.8 4:1ed4502e:::benchmark_data_smithi036_18856_object2406:head [delete] snapc 0=[] ondisk+write+known_if_redirected e116)", 2020-11-12T17:26:27.956 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.935347+0000", 2020-11-12T17:26:27.956 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0049756189999999997, 2020-11-12T17:26:27.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050647380000000001, 2020-11-12T17:26:27.957 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.958 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:27.958 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.958 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.958 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.958 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 78795 2020-11-12T17:26:27.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.958 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.935347+0000", 2020-11-12T17:26:27.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.935347+0000", 2020-11-12T17:26:27.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:27.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.935326+0000", 2020-11-12T17:26:27.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0002e-05 2020-11-12T17:26:27.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.935376+0000", 2020-11-12T17:26:27.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1347000000000001e-05 2020-11-12T17:26:27.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.935397+0000", 2020-11-12T17:26:27.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1012000000000001e-05 2020-11-12T17:26:27.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.935408+0000", 2020-11-12T17:26:27.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7131e-05 2020-11-12T17:26:27.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.935456+0000", 2020-11-12T17:26:27.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109035 2020-11-12T17:26:27.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.935565+0000", 2020-11-12T17:26:27.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4553000000000002e-05 2020-11-12T17:26:27.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:27.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.935649+0000", 2020-11-12T17:26:27.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041826779999999996 2020-11-12T17:26:27.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:27.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.939832+0000", 2020-11-12T17:26:27.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044851789999999997 2020-11-12T17:26:27.966 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.966 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.966 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.966 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:78796 4.3 4:c0fe282e:::benchmark_data_smithi036_18856_object2407:head [delete] snapc 0=[] ondisk+write+known_if_redirected e116)", 2020-11-12T17:26:27.966 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.936237+0000", 2020-11-12T17:26:27.967 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0040857009999999997, 2020-11-12T17:26:27.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042468230000000003, 2020-11-12T17:26:27.967 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.967 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:27.967 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.967 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.967 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.967 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 78796 2020-11-12T17:26:27.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.968 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936237+0000", 2020-11-12T17:26:27.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936237+0000", 2020-11-12T17:26:27.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:27.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936206+0000", 2020-11-12T17:26:27.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7701999999999997e-05 2020-11-12T17:26:27.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936274+0000", 2020-11-12T17:26:27.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2328e-05 2020-11-12T17:26:27.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936286+0000", 2020-11-12T17:26:27.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4409999999999998e-06 2020-11-12T17:26:27.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936293+0000", 2020-11-12T17:26:27.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5581999999999998e-05 2020-11-12T17:26:27.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936338+0000", 2020-11-12T17:26:27.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014021199999999999 2020-11-12T17:26:27.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936478+0000", 2020-11-12T17:26:27.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014860900000000001 2020-11-12T17:26:27.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:27.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936627+0000", 2020-11-12T17:26:27.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00039041800000000002 2020-11-12T17:26:27.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.974 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.975 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:78798 4.3 4:ce9f8ace:::benchmark_data_smithi036_18856_object2409:head [delete] snapc 0=[] ondisk+write+known_if_redirected e116)", 2020-11-12T17:26:27.975 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:27.936806+0000", 2020-11-12T17:26:27.975 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0035165040000000002, 2020-11-12T17:26:27.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037343630000000001, 2020-11-12T17:26:27.975 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:27.975 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:27.976 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:27.976 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:27.976 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:27.976 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 78798 2020-11-12T17:26:27.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.976 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:27.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:27.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936806+0000", 2020-11-12T17:26:27.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:27.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:27.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936806+0000", 2020-11-12T17:26:27.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999647 2020-11-12T17:26:27.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:27.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936770+0000", 2020-11-12T17:26:27.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4813000000000004e-05 2020-11-12T17:26:27.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:27.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936845+0000", 2020-11-12T17:26:27.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4419e-05 2020-11-12T17:26:27.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:27.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936860+0000", 2020-11-12T17:26:27.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1459999999999996e-06 2020-11-12T17:26:27.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:27.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.936868+0000", 2020-11-12T17:26:27.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002380634 2020-11-12T17:26:27.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:27.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.939248+0000", 2020-11-12T17:26:27.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000189144 2020-11-12T17:26:27.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:27.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.939437+0000", 2020-11-12T17:26:27.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6411999999999998e-05 2020-11-12T17:26:27.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:27.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:27.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:27.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:27.939534+0000", 2020-11-12T17:26:27.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027280730000000001 2020-11-12T17:26:27.983 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.983 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:27.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:27.985 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:27.985 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 4 2020-11-12T17:26:27.985 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:27.987 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:27.997 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:27.994+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:27.999 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:28.035 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:28.073 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:28.100 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:28.094+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:28.115 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:28.163 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:28.165 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:28.167 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:28.178 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:28.208 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:28.227 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:28.222+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:28.250 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:26:28.244+0000 7f4952786700 -1 mon.a@0(leader).osd e116 definitely_dead 0 2020-11-12T17:26:28.260 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:28.298 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:28.292+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:28.299 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:28.308 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:28.308 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:28.308 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:28.308 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:28.308 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:28.308 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:28.309 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:28.309 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:28.374 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:28.375 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:28.389 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:28.436 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:28.434+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:28.501 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:28.498+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:28.548 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:28.548 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:28.565 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:28.612 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:28.606+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:28.651 INFO:teuthology.orchestra.run.smithi036.stderr:marked in osd.2. 2020-11-12T17:26:28.671 INFO:tasks.thrashosds.thrasher:Added osd 2 2020-11-12T17:26:28.702 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:28.698+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:28.739 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:28.740 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:28.749 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:28.836 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:28.834+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:28.900 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:26:28.903 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:28.904 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:28.904 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:28.900+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:28.913 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:29.005 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:29.000+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:29.074 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:29.075 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:29.084 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:29.105 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:29.100+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:29.201 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:29.202 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:29.207 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:29.202+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:29.208 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:29.308 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:29.306+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:29.357 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:29.357 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:29.367 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:29.411 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:29.408+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:29.494 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:29.495 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:29.506 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:29.551 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:29.548+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:29.613 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:29.610+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:29.667 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:29.660+0000 7f4de5aec700 -1 osd.1 117 handle_osd_map injecting map crc failure 2020-11-12T17:26:29.682 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:26:29.687 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:29.687 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:29.701 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:29.743 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:29.740+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:29.815 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:29.812+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:29.881 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:29.881 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:29.895 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:29.939 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:29.936+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:30.017 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:30.012+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:30.078 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:30.078 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:30.090 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:30.118 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:30.114+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:30.219 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:30.214+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:30.264 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:30.264 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:30.277 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:30.322 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:30.323 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:30.320+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:30.410 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:30.411 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:30.420 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:30.418+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:30.423 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:30.499 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:30.521 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:30.518+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:30.534 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:30.553 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:30.554 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:30.554 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:30.554 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:30.566 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:30.567 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:30.600 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:30.623 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:30.620+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:30.635 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:30.664 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:30.662+0000 7f9a0b6b4700 -1 osd.5 118 handle_osd_map injecting map crc failure 2020-11-12T17:26:30.672 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:30.706 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:30.706 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:30.706 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:30.706 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:30.706 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:30.718 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:30.722 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:30.725 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:30.722+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:30.770 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:30.788 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:30.788 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:30.788 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:30.788 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:30.789 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:30.789 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:30.789 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:30.789 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:30.852 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:30.848+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:30.927 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:30.924+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:30.963 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:30.963 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:30.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:30.964 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:30.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.964 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:30.964 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:30.964 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 205.85160230899999, 2020-11-12T17:26:30.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:30.964 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:30.965 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:30.965 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:30.965 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:30.965 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:30.965 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:30.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.965 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:30.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:30.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:30.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:30.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:30.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:30.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:30.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:30.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:30.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:30.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:30.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:30.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:30.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:30.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:30.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:30.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:30.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:30.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:30.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:30.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:30.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:30.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:30.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:30.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:30.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:30.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:30.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:30.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:30.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:30.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:30.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:30.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:30.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:30.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:30.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:30.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:30.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:30.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:30.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:30.974 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:30.974 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:30.974 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:30.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.975 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:30.975 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:30.975 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 205.84451051299999, 2020-11-12T17:26:30.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:30.975 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:30.975 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:30.976 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:30.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:30.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:30.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:30.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:30.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:30.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:30.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:30.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:30.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:30.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:30.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:30.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:30.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:30.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:30.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:30.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:30.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:30.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:30.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:30.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:30.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:30.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:30.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:30.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:30.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:30.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:30.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:30.981 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:30.982 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:30.982 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:30.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.982 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:30.982 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:30.982 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 196.41195101599999, 2020-11-12T17:26:30.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:30.983 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:30.983 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:30.983 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:30.983 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:30.983 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:30.983 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:30.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.984 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:30.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:30.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:30.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:30.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:30.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:30.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:30.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:30.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:30.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:30.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:30.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:30.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:30.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 162.46183092199999, 2020-11-12T17:26:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 160.35622903000001, 2020-11-12T17:26:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 129.00974569600001, 2020-11-12T17:26:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:31.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:31.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:31.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:31.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:31.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:31.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:31.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:31.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:31.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:31.021 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:31.021 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.01390389399999, 2020-11-12T17:26:31.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:31.021 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.021 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:31.021 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:31.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:31.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:31.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:31.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:31.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:31.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:31.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:31.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:31.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:31.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:31.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:31.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:31.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:31.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:31.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:31.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:31.028 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.028 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.028 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.029 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:31.029 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:31.029 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.078800495, 2020-11-12T17:26:31.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:31.029 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.030 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:31.030 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:31.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:31.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:31.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:31.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:31.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:31.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:31.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:31.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:31.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:31.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:31.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:31.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:31.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:31.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:31.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.035 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.036 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.036 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:31.036 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:31.036 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.314160004000001, 2020-11-12T17:26:31.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:31.036 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.037 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:31.037 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:31.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:31.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:31.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:31.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:31.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:31.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:31.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:31.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:31.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:31.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:31.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:31.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:31.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:31.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:31.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:31.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:31.043 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.043 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.043 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.043 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:31.044 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:31.044 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.057651320000005, 2020-11-12T17:26:31.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:31.044 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.044 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.044 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.044 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.044 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.045 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:31.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.045 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:31.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:31.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:31.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:31.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:31.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:31.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:31.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:31.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:31.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:31.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:31.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:31.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:31.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:31.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:31.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:31.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:31.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:31.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:31.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:31.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:31.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:31.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:31.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:31.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:31.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:31.053 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.053 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.054 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.054 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:31.054 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:31.054 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.057488950000007, 2020-11-12T17:26:31.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:31.055 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.055 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.055 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.055 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.055 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.055 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:31.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.055 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:31.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:31.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:31.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:31.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:31.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:31.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:31.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:31.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:31.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:31.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:31.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:31.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:31.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:31.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:31.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:31.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:31.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:31.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:31.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:31.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:31.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:31.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:31.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:31.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:31.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:31.064 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.065 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.065 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:31.065 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:31.065 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.048919963000003, 2020-11-12T17:26:31.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:31.066 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.066 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:31.066 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:31.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:31.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:31.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:31.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:31.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:31.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:31.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:31.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:31.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:31.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:31.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:31.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:31.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:31.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:31.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:31.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:31.072 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.072 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.072 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.072 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:31.073 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:31.073 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.544407513000003, 2020-11-12T17:26:31.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:31.073 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.073 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.073 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.073 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.073 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.074 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:31.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.074 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:31.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:31.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:31.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:31.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:31.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:31.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:31.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:31.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:31.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:31.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:31.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:31.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:31.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:31.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:31.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:31.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:31.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:31.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:31.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:31.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:31.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:31.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:31.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:31.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:31.082 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.083 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.083 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.083 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:31.083 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:31.083 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 53.058859226999999, 2020-11-12T17:26:31.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:31.084 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.084 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.084 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.084 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.084 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.084 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:31.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.084 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:31.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:31.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:31.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:31.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:31.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:31.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:31.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:31.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:31.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:31.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:31.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:31.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:31.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:31.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:31.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:31.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:31.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:31.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:31.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:31.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:31.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:31.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:31.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:31.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:31.094 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.094 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.094 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.094 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:31.095 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:31.095 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.985540794999999, 2020-11-12T17:26:31.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:31.095 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.095 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:31.095 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:31.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:31.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:31.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:31.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:31.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:31.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:31.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:31.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:31.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:31.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:31.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:31.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:31.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:31.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:31.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:31.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:31.101 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.102 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.103 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.104 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:31.104 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:31.104 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 48.929895819000002, 2020-11-12T17:26:31.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:31.104 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.104 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.105 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.105 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.105 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.105 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:31.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.106 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:31.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:31.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:31.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:31.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:31.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:31.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:31.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:31.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:31.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:31.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:31.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:31.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:31.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:31.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:31.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:31.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:31.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:31.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:31.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:31.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:31.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:31.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:31.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:31.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:31.117 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.117 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.117 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.118 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:31.118 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:31.118 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 48.541691448000002, 2020-11-12T17:26:31.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:31.118 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.119 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.119 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:31.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.119 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:31.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:31.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:31.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:31.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:31.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:31.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:31.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:31.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:31.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:31.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:31.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:31.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:31.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:31.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:31.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:31.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:31.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:31.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:31.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:31.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:31.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:31.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:31.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:31.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:31.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:31.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.128 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.129 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:31.129 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:31.129 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.335234516, 2020-11-12T17:26:31.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:31.129 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.129 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.130 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.130 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.130 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:31.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.130 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:31.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:31.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:31.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:31.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:31.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:31.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:31.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:31.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:31.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:31.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:31.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:31.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:31.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:31.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:31.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:31.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:31.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:31.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:31.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:31.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:31.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:31.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:31.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:31.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:31.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.139 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.139 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:31.139 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:31.140 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 33.086028898999999, 2020-11-12T17:26:31.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:31.140 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.140 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.140 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:31.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.141 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:31.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:31.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:31.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:31.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:31.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:31.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:31.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:31.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:31.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:31.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:31.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:31.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:31.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:31.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:31.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:31.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:31.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:31.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:31.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:31.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:31.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:31.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:31.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:31.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:31.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:31.149 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.149 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.149 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.150 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:31.150 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:31.150 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 33.069069450000001, 2020-11-12T17:26:31.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:31.150 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.150 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:31.151 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:31.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:31.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:31.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:31.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:31.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:31.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:31.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:31.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:31.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:31.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:31.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:31.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:31.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:31.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:31.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:31.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:31.156 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.157 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.157 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.157 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.157 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.157 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:31.158 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:31.160 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:31.152+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:31.260 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:31.258+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:31.339 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:31.340 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:31.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.340 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79696 4.f 4:ff01bbc6:::benchmark_data_smithi036_18856_object3307:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:26:31.340 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:31.325687+0000", 2020-11-12T17:26:31.340 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0072285020000000004, 2020-11-12T17:26:31.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0072572729999999998, 2020-11-12T17:26:31.341 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.341 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:31.341 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.341 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.341 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.341 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79696 2020-11-12T17:26:31.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.342 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.325687+0000", 2020-11-12T17:26:31.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.325687+0000", 2020-11-12T17:26:31.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:31.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.325654+0000", 2020-11-12T17:26:31.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2222000000000001e-05 2020-11-12T17:26:31.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.325726+0000", 2020-11-12T17:26:31.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2815e-05 2020-11-12T17:26:31.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.325739+0000", 2020-11-12T17:26:31.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5230000000000001e-06 2020-11-12T17:26:31.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.325746+0000", 2020-11-12T17:26:31.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2642000000000001e-05 2020-11-12T17:26:31.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.325808+0000", 2020-11-12T17:26:31.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020890200000000001 2020-11-12T17:26:31.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.326017+0000", 2020-11-12T17:26:31.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019605299999999999 2020-11-12T17:26:31.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:31.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.326213+0000", 2020-11-12T17:26:31.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052172579999999998 2020-11-12T17:26:31.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.331431+0000", 2020-11-12T17:26:31.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057430509999999999 2020-11-12T17:26:31.350 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.350 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.350 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.350 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79700 4.0 4:0197b182:::benchmark_data_smithi036_18856_object3311:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:26:31.350 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:31.330886+0000", 2020-11-12T17:26:31.350 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0020298109999999999, 2020-11-12T17:26:31.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021525730000000001, 2020-11-12T17:26:31.351 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.351 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:31.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.351 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79700 2020-11-12T17:26:31.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.352 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.330886+0000", 2020-11-12T17:26:31.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.330886+0000", 2020-11-12T17:26:31.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999676 2020-11-12T17:26:31.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.330854+0000", 2020-11-12T17:26:31.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4558e-05 2020-11-12T17:26:31.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.330928+0000", 2020-11-12T17:26:31.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3089e-05 2020-11-12T17:26:31.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.330941+0000", 2020-11-12T17:26:31.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3659999999999997e-06 2020-11-12T17:26:31.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.330948+0000", 2020-11-12T17:26:31.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7379000000000001e-05 2020-11-12T17:26:31.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.331005+0000", 2020-11-12T17:26:31.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016638300000000001 2020-11-12T17:26:31.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.331171+0000", 2020-11-12T17:26:31.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014523199999999999 2020-11-12T17:26:31.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.331317+0000", 2020-11-12T17:26:31.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00043047400000000003 2020-11-12T17:26:31.358 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.358 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.358 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.358 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.358 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:31.358 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 2 2020-11-12T17:26:31.358 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:31.360 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:31.374 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:31.358+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:31.463 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:31.460+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:31.524 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:31.524 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:31.524 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:31.537 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:31.583 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:31.580+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:31.665 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:31.660+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:31.698 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:26:31.767 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:31.762+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:31.819 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:31.820 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:31.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:31.820 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:31.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.821 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:31.821 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:31.821 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 197.392368186, 2020-11-12T17:26:31.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:31.822 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.822 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.822 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.822 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:31.822 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:31.822 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:31.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.823 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:31.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:31.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:31.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:31.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:31.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:31.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:31.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:31.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:31.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:31.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:31.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:31.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:31.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:31.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:31.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:31.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:31.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:31.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:31.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:31.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:31.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:31.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:31.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:31.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:31.834 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.834 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.834 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.835 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:31.835 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:31.835 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 197.385424124, 2020-11-12T17:26:31.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:31.836 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.836 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:31.836 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:31.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:31.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:31.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:31.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:31.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:31.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:31.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:31.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:31.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:31.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:31.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:31.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:31.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:31.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:31.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:31.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:31.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.843 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.844 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:31.844 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:31.844 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 161.21158633799999, 2020-11-12T17:26:31.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:31.844 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.844 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:31.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:31.845 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:31.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.845 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:31.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:31.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:31.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:31.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:31.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:31.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:31.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:31.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:31.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:31.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:31.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:31.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:31.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:31.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:31.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:31.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:31.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:31.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:31.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:31.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:31.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:31.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:31.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:31.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:31.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:31.856 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.856 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.857 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.857 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:31.857 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:31.857 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 156.740052429, 2020-11-12T17:26:31.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:31.858 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.858 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.858 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.858 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:31.858 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:31.859 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:31.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.859 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:31.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:31.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:31.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:31.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:31.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:31.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:31.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:31.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:31.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:31.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:31.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:31.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:31.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:31.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:31.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:31.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:31.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:31.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:31.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:31.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:31.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:31.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:31.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:31.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:31.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:31.869 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.869 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.869 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.870 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:31.870 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:31.870 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 144.94788124499999, 2020-11-12T17:26:31.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:31.870 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.871 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.871 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.871 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:31.871 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:31.871 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:31.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.872 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:31.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:31.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:31.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:31.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:31.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:31.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:31.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:31.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:31.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:31.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:31.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:31.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:31.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:31.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:31.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:31.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:31.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:31.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:31.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:31.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:31.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:31.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:31.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:31.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:31.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:31.882 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.882 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.882 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.883 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:31.883 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:31.883 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 129.991434403, 2020-11-12T17:26:31.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:31.883 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.883 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.883 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.884 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:31.884 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:31.884 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:31.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.884 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:31.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:31.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:31.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:31.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:31.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:31.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:31.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:31.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:31.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:31.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:31.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:31.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:31.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:31.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:31.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:31.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:31.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:31.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:31.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:31.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:31.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:31.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:31.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:31.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:31.894 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.895 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.895 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.895 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:31.895 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:31.896 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 129.86250091900001, 2020-11-12T17:26:31.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:31.896 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.896 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.896 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:31.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:31.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:31.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:31.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:31.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:31.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:31.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:31.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:31.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:31.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:31.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:31.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:31.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:31.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:31.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:31.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:31.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:31.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:31.904 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.904 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.904 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.905 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:31.905 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:31.905 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 128.168362645, 2020-11-12T17:26:31.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:31.905 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.906 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.906 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.906 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:31.906 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:31.906 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:31.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.907 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:31.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:31.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:31.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:31.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:31.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:31.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:31.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:31.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:31.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:31.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:31.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:31.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:31.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:31.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:31.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:31.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:31.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:31.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:31.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:31.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:31.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:31.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:31.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:31.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:31.917 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.917 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.917 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.918 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:31.918 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:31.918 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 93.853808998999995, 2020-11-12T17:26:31.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:31.918 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.919 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.919 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.919 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.919 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.919 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:31.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.919 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:31.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:31.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:31.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:31.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:31.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:31.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:31.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:31.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:31.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:31.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:31.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:31.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:31.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:31.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:31.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:31.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:31.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:31.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:31.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:31.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:31.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:31.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:31.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:31.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:31.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.929 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.930 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:31.930 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:31.930 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 70.499123922999999, 2020-11-12T17:26:31.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:31.930 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.931 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.931 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:31.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.931 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:31.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:31.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:31.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:31.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:31.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:31.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:31.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:31.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:31.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:31.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:31.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:31.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:31.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:31.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:31.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:31.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:31.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:31.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:31.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:31.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:31.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:31.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:31.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:31.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:31.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.940 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.941 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:31.941 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:31.941 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 70.485947163999995, 2020-11-12T17:26:31.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:31.941 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.941 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:31.942 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:31.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:31.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:31.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:31.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:31.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:31.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:31.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:31.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:31.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:31.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:31.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:31.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:31.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:31.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:31.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:31.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:31.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.948 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.948 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:31.949 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:31.949 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.931865715000001, 2020-11-12T17:26:31.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:31.949 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.949 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.950 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.950 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.950 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:31.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.950 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:31.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:31.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:31.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:31.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:31.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:31.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:31.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:31.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:31.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:31.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:31.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:31.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:31.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:31.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:31.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:31.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:31.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:31.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:31.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:31.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:31.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:31.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:31.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:31.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:31.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:31.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.959 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.959 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:31.959 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:31.960 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.922878409000006, 2020-11-12T17:26:31.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:31.960 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.960 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:31.960 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:31.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:31.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:31.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:31.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:31.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:31.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:31.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:31.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:31.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:31.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:31.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:31.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:31.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:31.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:31.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:31.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:31.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.967 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.968 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:31.968 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:31.968 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 59.904951095000001, 2020-11-12T17:26:31.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:31.968 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.969 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.969 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.969 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.969 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.969 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:31.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.970 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:31.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:31.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:31.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:31.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:31.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:31.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:31.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:31.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:31.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:31.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:31.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:31.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:31.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:31.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:31.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:31.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:31.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:31.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:31.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:31.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:31.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:31.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:31.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:31.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:31.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:31.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.980 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.980 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:31.981 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:31.981 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.353907696999997, 2020-11-12T17:26:31.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:31.981 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.981 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.982 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.982 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:31.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.982 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:31.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:31.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:31.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:31.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:31.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:31.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:31.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:31.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:31.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:31.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:31.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:31.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:31.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:31.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:31.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:31.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:31.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:31.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:31.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:31.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:31.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:31.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:31.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:31.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:31.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:31.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:31.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:31.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:31.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:31.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:31.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:31.992 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.992 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:31.992 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:31.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.993 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:31.993 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:31.993 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.102512197000003, 2020-11-12T17:26:31.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:31.994 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:31.994 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:31.994 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:31.994 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:31.994 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:31.994 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:31.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.995 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:31.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:31.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:31.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:31.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:31.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:31.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:31.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:31.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:31.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:31.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:31.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:31.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:31.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:31.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:31.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:31.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:31.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:31.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:31.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:31.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:32.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:32.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:32.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:32.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:32.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:32.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:32.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:32.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:32.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:32.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:32.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:32.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:32.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:32.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:32.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:32.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:32.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:32.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:32.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:32.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:32.005 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.005 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:32.005 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.006 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:32.006 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:32.006 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.023389880000003, 2020-11-12T17:26:32.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:32.006 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:32.007 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.007 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:32.007 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:32.007 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.007 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:32.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.007 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:32.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:32.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:32.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:32.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:32.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:32.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:32.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:32.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:32.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:32.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:32.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:32.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:32.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:32.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:32.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:32.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:32.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:32.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:32.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:32.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:32.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:32.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:32.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:32.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:32.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:32.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:32.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:32.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:32.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:32.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:32.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:32.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:32.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:32.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:32.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:32.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:32.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:32.018 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.018 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:32.018 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.018 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:32.019 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:32.019 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.241038913000001, 2020-11-12T17:26:32.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:32.019 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:32.019 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.019 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:32.020 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:32.020 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.020 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:32.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.020 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:32.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:32.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:32.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:32.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:32.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:32.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:32.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:32.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:32.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:32.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:32.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:32.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:32.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:32.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:32.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:32.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:32.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:32.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:32.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:32.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:32.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:32.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:32.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:32.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:32.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:32.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:32.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:32.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:32.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:32.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:32.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:32.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:32.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:32.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:32.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:32.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:32.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:32.031 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.031 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:32.031 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.032 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:26:32.032 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:32.032 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.777996564, 2020-11-12T17:26:32.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:26:32.032 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:32.032 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.033 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:32.033 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:32.033 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.033 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:26:32.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.033 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:32.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:32.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:32.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:32.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:32.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:32.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:26:32.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:32.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:26:32.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:26:32.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:32.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:26:32.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:26:32.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:32.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:26:32.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:26:32.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:26:32.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:26:32.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:32.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:26:32.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:26:32.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:32.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:26:32.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:26:32.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:26:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:26:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:26:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:26:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:26:32.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:26:32.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:32.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:26:32.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:26:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:26:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:26:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.043 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:26:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.75695603, 2020-11-12T17:26:32.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:26:32.045 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:32.045 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:32.045 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:32.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:32.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:32.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:32.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:32.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:32.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:26:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:26:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:26:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:26:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:26:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:32.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:26:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:26:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:26:32.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:26:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:26:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:26:32.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:26:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:26:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:32.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:26:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:26:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.052 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:32.053 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:32.053 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:32.054 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:32.056 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:32.048+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:32.155 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:32.150+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:32.187 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:32.188 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:32.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.188 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:80300 4.c 4:31ab4aa8:::benchmark_data_smithi036_18856_object3911:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:26:32.189 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:32.174063+0000", 2020-11-12T17:26:32.189 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.014426915, 2020-11-12T17:26:32.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.014460364999999999, 2020-11-12T17:26:32.189 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.189 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:32.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.190 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.190 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 80300 2020-11-12T17:26:32.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.190 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.174063+0000", 2020-11-12T17:26:32.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.174063+0000", 2020-11-12T17:26:32.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:32.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.174028+0000", 2020-11-12T17:26:32.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4166999999999996e-05 2020-11-12T17:26:32.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.174102+0000", 2020-11-12T17:26:32.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2659e-05 2020-11-12T17:26:32.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.174114+0000", 2020-11-12T17:26:32.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1519999999999997e-06 2020-11-12T17:26:32.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.174120+0000", 2020-11-12T17:26:32.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6641999999999998e-05 2020-11-12T17:26:32.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.174167+0000", 2020-11-12T17:26:32.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019330500000000001 2020-11-12T17:26:32.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.174360+0000", 2020-11-12T17:26:32.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015818000000000001 2020-11-12T17:26:32.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:32.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.174519+0000", 2020-11-12T17:26:32.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062687790000000004 2020-11-12T17:26:32.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.180787+0000", 2020-11-12T17:26:32.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0067241310000000004 2020-11-12T17:26:32.197 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.198 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.198 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.198 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:80302 4.c 4:3b74687e:::benchmark_data_smithi036_18856_object3913:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:26:32.199 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:32.177993+0000", 2020-11-12T17:26:32.199 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.01049752, 2020-11-12T17:26:32.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010668776, 2020-11-12T17:26:32.199 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.199 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:32.199 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.199 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.200 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.200 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 80302 2020-11-12T17:26:32.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.200 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.177993+0000", 2020-11-12T17:26:32.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.177993+0000", 2020-11-12T17:26:32.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999566 2020-11-12T17:26:32.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.177949+0000", 2020-11-12T17:26:32.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0031000000000006e-05 2020-11-12T17:26:32.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.178039+0000", 2020-11-12T17:26:32.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7391999999999999e-05 2020-11-12T17:26:32.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.178057+0000", 2020-11-12T17:26:32.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4090999999999999e-05 2020-11-12T17:26:32.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.178071+0000", 2020-11-12T17:26:32.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1053e-05 2020-11-12T17:26:32.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.178132+0000", 2020-11-12T17:26:32.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013178899999999999 2020-11-12T17:26:32.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.178264+0000", 2020-11-12T17:26:32.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9739000000000002e-05 2020-11-12T17:26:32.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:32.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.178363+0000", 2020-11-12T17:26:32.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030215149999999998 2020-11-12T17:26:32.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.181385+0000", 2020-11-12T17:26:32.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033923310000000002 2020-11-12T17:26:32.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.210 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.210 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:32.210 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:26:32.210 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:32.212 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:32.256 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:32.254+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:32.358 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:32.354+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:32.402 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:32.403 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:32.403 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:32.417 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:32.462 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:32.452+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:32.559 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:32.554+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:32.609 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:32.609 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:32.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:32.609 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:32.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.610 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:26:32.610 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:32.610 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 201.92084441599999, 2020-11-12T17:26:32.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:26:32.610 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.610 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:32.612 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:32.612 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:26:32.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.613 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:32.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:32.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:32.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:26:32.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:26:32.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:26:32.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:26:32.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:26:32.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:26:32.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:26:32.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:26:32.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:26:32.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:26:32.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:26:32.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:26:32.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:32.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:26:32.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:26:32.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:26:32.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:26:32.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:26:32.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:26:32.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:26:32.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:26:32.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:26:32.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:26:32.621 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.621 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.622 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.622 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:26:32.622 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:32.622 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 201.91536434700001, 2020-11-12T17:26:32.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:26:32.622 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.623 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.623 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:32.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:32.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:32.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:26:32.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:26:32.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:26:32.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:26:32.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:26:32.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:26:32.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:26:32.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:26:32.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:26:32.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:26:32.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:26:32.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:26:32.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:26:32.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:26:32.629 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.629 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.629 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.629 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:26:32.629 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 193.72524274700001, 2020-11-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:26:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:26:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:26:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:26:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:26:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:26:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:26:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:26:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:26:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:26:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:26:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:26:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:26:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:26:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:32.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:26:32.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:26:32.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:26:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:26:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:26:32.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:26:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:26:32.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:26:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:26:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:26:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.640 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:26:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 193.71799903799999, 2020-11-12T17:26:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:26:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.641 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:26:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:26:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:26:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:26:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:26:32.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:26:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:26:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:26:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:26:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:26:32.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:26:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:26:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:26:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:26:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.649 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:32.650 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:32.650 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 117.72190966399999, 2020-11-12T17:26:32.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:26:32.650 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.650 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:26:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:26:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:26:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:26:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:26:32.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:26:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:26:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:26:32.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:26:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:26:32.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:26:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:26:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:26:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:26:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:26:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 80.696640396999996, 2020-11-12T17:26:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:26:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.659 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:26:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:26:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:26:32.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:26:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:26:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:26:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:26:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:26:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:26:32.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:26:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:26:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:26:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:26:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:26:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:26:32.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:26:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:26:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.666 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.030799381999998, 2020-11-12T17:26:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:26:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.667 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:26:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:32.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:26:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:26:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:26:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:26:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:26:32.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:26:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:26:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:26:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:26:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:26:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:26:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:26:32.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:26:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:26:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:26:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:26:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:26:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:26:32.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:26:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:26:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:26:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:26:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.677 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.027558053, 2020-11-12T17:26:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:26:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.678 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:26:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:32.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:32.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:26:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:26:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:26:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:26:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:26:32.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:26:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:26:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:26:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:26:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:26:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:26:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:26:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:26:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:26:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:26:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:26:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:26:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:26:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:26:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:26:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:26:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:26:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:26:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.594387152000003, 2020-11-12T17:26:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:26:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:26:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:26:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:26:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:26:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:26:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:26:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:26:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:26:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:26:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:26:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:26:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:26:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:26:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:26:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.545320490999998, 2020-11-12T17:26:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:26:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:26:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:26:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:26:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:26:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:26:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:26:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:26:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:26:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:26:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:26:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:26:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:26:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:26:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:26:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:26:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:26:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:26:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:26:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:26:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.543639710999997, 2020-11-12T17:26:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:26:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:26:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:26:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:26:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:26:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:26:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:26:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:26:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:26:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:26:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:26:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:26:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:26:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:26:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:26:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:26:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:26:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:26:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:26:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:26:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:26:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:26:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:26:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:26:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.543551516000001, 2020-11-12T17:26:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:26:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:26:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:26:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:26:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:26:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:26:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:26:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:26:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:26:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:26:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:26:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:26:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:26:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:26:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:26:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:26:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:26:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:26:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:26:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:26:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:26:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:26:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:26:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.525056200999998, 2020-11-12T17:26:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:26:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:26:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:26:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:26:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:26:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:26:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:26:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:26:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:26:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:26:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:26:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:26:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:26:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:26:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:26:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.524923211000001, 2020-11-12T17:26:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:26:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:26:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:26:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:26:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:26:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:26:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:26:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:26:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:26:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:26:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:26:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:26:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:26:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:26:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:26:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.524838483000003, 2020-11-12T17:26:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:26:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:26:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:26:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:26:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:26:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:26:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:26:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:26:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:26:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:26:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:26:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:26:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:26:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:26:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:26:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:26:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.473225952999996, 2020-11-12T17:26:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:26:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:26:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:26:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:26:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:26:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:26:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:26:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:26:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:26:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:26:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:26:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:26:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:26:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:26:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:26:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.473068937000001, 2020-11-12T17:26:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:26:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:26:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:26:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:26:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:26:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:26:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:26:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:26:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:26:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:26:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:26:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:26:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:26:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:26:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:26:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.774016032, 2020-11-12T17:26:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:26:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:26:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:26:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:26:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:26:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:26:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:26:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:26:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:26:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:26:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:26:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:26:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:26:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:26:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:26:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:26:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:26:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:26:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:26:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:26:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:26:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:26:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:26:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:26:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:26:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.687360544000001, 2020-11-12T17:26:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:26:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:26:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:26:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:26:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:26:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:26:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:26:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:26:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:26:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:26:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:26:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:26:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:26:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:26:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:26:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:26:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:26:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:26:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:26:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:26:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:26:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:26:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:26:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:26:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:26:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.673879317000001, 2020-11-12T17:26:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:26:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:26:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:26:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:26:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:26:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:26:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:26:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:26:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:26:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:26:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:26:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:26:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:26:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:26:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:26:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.795 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.795 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:32.796 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:26:32.797 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:32.797 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:32.794+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:32.804 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:32.899 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:32.896+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:32.974 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:32.975 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:32.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.975 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:80858 4.2 e120/114 4:40f985d5:::benchmark_data_smithi036_18856_object4469:head v 120'5177, mlcod=109'4431)", 2020-11-12T17:26:32.975 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:32.966773+0000", 2020-11-12T17:26:32.975 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0087062870000000001, 2020-11-12T17:26:32.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0087333350000000001, 2020-11-12T17:26:32.976 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.976 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.976 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.966773+0000", 2020-11-12T17:26:32.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.966773+0000", 2020-11-12T17:26:32.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:32.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.966745+0000", 2020-11-12T17:26:32.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9034000000000002e-05 2020-11-12T17:26:32.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.966834+0000", 2020-11-12T17:26:32.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112254 2020-11-12T17:26:32.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.966946+0000", 2020-11-12T17:26:32.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7949999999999999e-05 2020-11-12T17:26:32.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.966964+0000", 2020-11-12T17:26:32.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3173000000000002e-05 2020-11-12T17:26:32.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.967007+0000", 2020-11-12T17:26:32.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8960999999999999e-05 2020-11-12T17:26:32.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.967036+0000", 2020-11-12T17:26:32.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026287800000000003 2020-11-12T17:26:32.981 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.981 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.982 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:80859 4.3 4:c805b553:::benchmark_data_smithi036_18856_object4470:head [delete] snapc 0=[] ondisk+write+known_if_redirected e120)", 2020-11-12T17:26:32.982 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:32.969620+0000", 2020-11-12T17:26:32.982 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0058588989999999999, 2020-11-12T17:26:32.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0059561470000000002, 2020-11-12T17:26:32.983 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.983 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:32.983 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.983 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.983 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.983 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 80859 2020-11-12T17:26:32.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.983 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969620+0000", 2020-11-12T17:26:32.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969620+0000", 2020-11-12T17:26:32.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:32.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969584+0000", 2020-11-12T17:26:32.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3208000000000006e-05 2020-11-12T17:26:32.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969677+0000", 2020-11-12T17:26:32.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2941e-05 2020-11-12T17:26:32.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969690+0000", 2020-11-12T17:26:32.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4080000000000003e-06 2020-11-12T17:26:32.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969696+0000", 2020-11-12T17:26:32.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000164031 2020-11-12T17:26:32.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969860+0000", 2020-11-12T17:26:32.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032911030000000001 2020-11-12T17:26:32.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973151+0000", 2020-11-12T17:26:32.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016208800000000001 2020-11-12T17:26:32.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:32.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973314+0000", 2020-11-12T17:26:32.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036931569999999999 2020-11-12T17:26:32.989 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.989 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.990 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:80861 4.8 4:1810cb4b:::benchmark_data_smithi036_18856_object4472:head [delete] snapc 0=[] ondisk+write+known_if_redirected e120)", 2020-11-12T17:26:32.990 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:32.969750+0000", 2020-11-12T17:26:32.990 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0057292879999999999, 2020-11-12T17:26:32.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0059047550000000002, 2020-11-12T17:26:32.990 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.991 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:32.991 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:32.991 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:32.991 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:32.991 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 80861 2020-11-12T17:26:32.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.991 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:32.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:32.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969750+0000", 2020-11-12T17:26:32.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:32.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:32.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969750+0000", 2020-11-12T17:26:32.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:26:32.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:32.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969722+0000", 2020-11-12T17:26:32.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6938999999999998e-05 2020-11-12T17:26:32.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:32.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969779+0000", 2020-11-12T17:26:32.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3430000000000001e-06 2020-11-12T17:26:32.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:32.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969785+0000", 2020-11-12T17:26:32.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.532e-06 2020-11-12T17:26:32.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:32.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969790+0000", 2020-11-12T17:26:32.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7970000000000001e-05 2020-11-12T17:26:32.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:32.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.969858+0000", 2020-11-12T17:26:32.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017178500000000001 2020-11-12T17:26:32.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:32.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970029+0000", 2020-11-12T17:26:32.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144757 2020-11-12T17:26:32.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:32.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970174+0000", 2020-11-12T17:26:32.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040187900000000004 2020-11-12T17:26:32.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:32.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.974193+0000", 2020-11-12T17:26:32.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044429939999999996 2020-11-12T17:26:32.998 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.998 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:32.998 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:32.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:32.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:32.998 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:80862 4.2 e120/114 4:4710724b:::benchmark_data_smithi036_18856_object4473:head v 120'5178, mlcod=109'4431)", 2020-11-12T17:26:32.999 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:32.970572+0000", 2020-11-12T17:26:32.999 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0049071490000000004, 2020-11-12T17:26:32.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0051606070000000002, 2020-11-12T17:26:32.999 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:32.999 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:32.999 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:33.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:33.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970572+0000", 2020-11-12T17:26:33.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:33.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970572+0000", 2020-11-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99998 2020-11-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970552+0000", 2020-11-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4663000000000001e-05 2020-11-12T17:26:33.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:33.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970617+0000", 2020-11-12T17:26:33.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2422000000000001e-05 2020-11-12T17:26:33.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:33.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970659+0000", 2020-11-12T17:26:33.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5929999999999996e-06 2020-11-12T17:26:33.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:33.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970665+0000", 2020-11-12T17:26:33.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1007000000000001e-05 2020-11-12T17:26:33.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:33.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970716+0000", 2020-11-12T17:26:33.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2787999999999998e-05 2020-11-12T17:26:33.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:33.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.970748+0000", 2020-11-12T17:26:33.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000176233 2020-11-12T17:26:33.005 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:33.005 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:33.005 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:33.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.005 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:80864 4.7 4:ec4c9d3e:::benchmark_data_smithi036_18856_object4475:head [delete] snapc 0=[] ondisk+write+known_if_redirected e120)", 2020-11-12T17:26:33.005 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:32.973139+0000", 2020-11-12T17:26:33.006 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0023404609999999998, 2020-11-12T17:26:33.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002656027, 2020-11-12T17:26:33.006 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:33.006 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:33.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:33.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:33.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:33.006 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 80864 2020-11-12T17:26:33.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.007 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:33.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:33.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973139+0000", 2020-11-12T17:26:33.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:33.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:33.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973139+0000", 2020-11-12T17:26:33.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:33.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:33.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973108+0000", 2020-11-12T17:26:33.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9987999999999995e-05 2020-11-12T17:26:33.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:33.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973177+0000", 2020-11-12T17:26:33.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:26:33.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:33.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973191+0000", 2020-11-12T17:26:33.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7969999999999997e-06 2020-11-12T17:26:33.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:33.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973196+0000", 2020-11-12T17:26:33.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1848000000000002e-05 2020-11-12T17:26:33.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:33.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973248+0000", 2020-11-12T17:26:33.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019165299999999999 2020-11-12T17:26:33.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:33.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973440+0000", 2020-11-12T17:26:33.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018232799999999999 2020-11-12T17:26:33.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:33.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:33.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:33.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:32.973622+0000", 2020-11-12T17:26:33.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048338800000000001 2020-11-12T17:26:33.013 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:33.013 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:33.013 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:33.013 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:33.013 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:33.013 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 5 2020-11-12T17:26:33.013 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:33.015 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:33.016 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:33.010+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:33.065 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:33.113 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:33.116 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:33.114+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:33.155 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:33.193 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:33.216 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:33.216 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:33.216 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:33.217 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:33.217 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:33.219 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:33.214+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:33.226 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:33.228 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:33.271 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:33.315 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:33.321 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:33.318+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:33.353 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:33.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:33.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:33.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:33.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:33.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:33.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:33.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:33.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:33.418 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:33.418 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:33.422 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:33.418+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:33.428 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:33.523 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:33.520+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:33.619 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:33.619 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:33.624 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:33.622+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:33.632 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:33.672 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 1, 2] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:33.673 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:33.673 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [3, 4, 5, 7, 6, 1, 2] 2020-11-12T17:26:33.673 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 1 2020-11-12T17:26:33.713 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:33.704+0000 7f658835a700 -1 osd.0 120 handle_osd_map injecting map crc failure 2020-11-12T17:26:33.716 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:33.714+0000 7f928515c700 -1 osd.7 120 handle_osd_map injecting map crc failure 2020-11-12T17:26:33.718 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:33.708+0000 7f4dea6fe700 -1 osd.1 120 handle_osd_map injecting map crc failure 2020-11-12T17:26:33.724 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:33.720+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:33.814 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:33.815 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:33.826 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:33.827 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:33.820+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:33.926 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:33.922+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:33.980 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:33.981 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:33.991 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:34.031 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:26:34.028+0000 7f4952786700 -1 mon.a@0(leader).osd e121 definitely_dead 0 2020-11-12T17:26:34.032 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:34.030+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:34.127 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:34.124+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:34.157 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:34.157 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:34.166 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:34.228 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:34.224+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:34.274 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:34.275 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:34.285 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:34.336 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:34.334+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:34.402 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:34.403 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:34.412 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:34.456 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:34.454+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:34.533 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:34.530+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:34.551 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:34.551 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:34.568 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:34.634 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:34.628+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:34.695 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:34.696 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:34.708 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:34.719 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:34.716+0000 7fc24d2e3700 -1 osd.3 121 handle_osd_map injecting map crc failure 2020-11-12T17:26:34.721 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:34.718+0000 7f9a06aa2700 -1 osd.5 121 handle_osd_map injecting map crc failure 2020-11-12T17:26:34.726 INFO:teuthology.orchestra.run.smithi036.stderr:marked out osd.1. 2020-11-12T17:26:34.736 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:34.732+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:34.798 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:26:34.832 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:34.832 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:34.836 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:34.832+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:34.842 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:34.938 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:34.932+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:35.000 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:35.000 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:35.009 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:35.039 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:35.038+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:35.140 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:35.136+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:35.158 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:35.158 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:35.167 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:35.241 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:35.238+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:35.326 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:35.327 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:35.334 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:35.342 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:35.342+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:35.374 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:35.443 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:35.438+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:35.446 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:35.446 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:35.456 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:35.537 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:35.544 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:35.542+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:35.560 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:35.570 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:35.571 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:35.571 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:35.571 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:35.571 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:35.580 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:35.595 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:35.612 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:35.638 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:35.645 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:35.642+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:35.666 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:35.690 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:35.690 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:35.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 210.575133634, 2020-11-12T17:26:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:35.691 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.692 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:35.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:35.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:35.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:35.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:35.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:35.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:35.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:35.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:35.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.704 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 210.568041838, 2020-11-12T17:26:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:35.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:35.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:35.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.712 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 201.135482341, 2020-11-12T17:26:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.713 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:35.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:35.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:35.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:35.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:35.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:35.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.724 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:35.724 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:35.724 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 167.185362247, 2020-11-12T17:26:35.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:35.724 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:35.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:35.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:35.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:35.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:35.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:35.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 165.07976035499999, 2020-11-12T17:26:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.733 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:35.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:35.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:35.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:35.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:35.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:35.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:35.742 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.742 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.742 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.742 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 133.73327702099999, 2020-11-12T17:26:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.743 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:35.744 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:35.744 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:35.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.744 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:35.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:35.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:35.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:35.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:35.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:35.753 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:35.754 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 124.73743521900001, 2020-11-12T17:26:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:35.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:35.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:35.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.80233182000001, 2020-11-12T17:26:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:35.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:35.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:35.769 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.037691328999998, 2020-11-12T17:26:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 83.781182645000001, 2020-11-12T17:26:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.777 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:35.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:35.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:35.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:35.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:35.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:35.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.788 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:35.789 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:35.789 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 83.781020275000003, 2020-11-12T17:26:35.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:35.789 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.789 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.789 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.789 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:35.789 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:35.790 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:35.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.790 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:35.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:35.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:35.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:35.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:35.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:35.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.799 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 83.772451287999999, 2020-11-12T17:26:35.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:35.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:35.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:35.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:35.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:35.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:35.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.812 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 59.267938837999999, 2020-11-12T17:26:35.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:35.814 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.814 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.814 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.814 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:35.814 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:35.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:35.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:35.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:35.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:35.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:35.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:35.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:35.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:35.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:35.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.827 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.828 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:35.828 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:35.828 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.782390552000003, 2020-11-12T17:26:35.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:35.829 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.829 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.829 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.829 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:35.829 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:35.829 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:35.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.830 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:35.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:35.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:35.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:35.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:35.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:35.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:35.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:35.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:35.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:35.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:35.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:35.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:35.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:35.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:35.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:35.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:35.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:35.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:35.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.842 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.843 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:35.843 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:35.843 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.709072120000002, 2020-11-12T17:26:35.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:35.844 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.844 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:35.844 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:35.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:35.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:35.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:35.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:35.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:35.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:35.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:35.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:35.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:35.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:35.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:35.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:35.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:35.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:35.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:35.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:35.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.853 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.854 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:35.854 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:35.855 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 53.653427143999998, 2020-11-12T17:26:35.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:35.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.855 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.856 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:35.856 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:35.856 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:35.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.857 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:35.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:35.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:35.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:35.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:35.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:35.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:35.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:35.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:35.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:35.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:35.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:35.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:35.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:35.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:35.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:35.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:35.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:35.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:35.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:35.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:35.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:35.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:35.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:35.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:35.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:35.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.868 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.869 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:35.869 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:35.869 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 53.265222772999998, 2020-11-12T17:26:35.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:35.870 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.870 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.870 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.870 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:35.870 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:35.871 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:35.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.871 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:35.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:35.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:35.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:35.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:35.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:35.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:35.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:35.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:35.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:35.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:35.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:35.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:35.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:35.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:35.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:35.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:35.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:35.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:35.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:35.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:35.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:35.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:35.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:35.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:35.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:35.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.884 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.884 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.884 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:35.884 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:35.885 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.058765841000003, 2020-11-12T17:26:35.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:35.885 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.885 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:35.886 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:35.886 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:35.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.886 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:35.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:35.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:35.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:35.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:35.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:35.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:35.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:35.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:35.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:35.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:35.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:35.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:35.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:35.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:35.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:35.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:35.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:35.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:35.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:35.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:35.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:35.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:35.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:35.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:35.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:35.898 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.899 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.899 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.899 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:35.899 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:35.900 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 37.809560224000002, 2020-11-12T17:26:35.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:35.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.900 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:35.900 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:35.900 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:35.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:35.901 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:35.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.901 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:35.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:35.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:35.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:35.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:35.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:35.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:35.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:35.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:35.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:35.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:35.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:35.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:35.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:35.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:35.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:35.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:35.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:35.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:35.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:35.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:35.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:35.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:35.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:35.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:35.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:35.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:35.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:35.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:35.913 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.913 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.913 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.914 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:35.914 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:35.914 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 37.792600774999997, 2020-11-12T17:26:35.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:35.915 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:35.915 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:35.915 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:35.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:35.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:35.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:35.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:35.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:35.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:35.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:35.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:35.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:35.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:35.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:35.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:35.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:35.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:35.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:35.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:35.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:35.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:35.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:35.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:35.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:35.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:35.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:35.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:35.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:35.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:35.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:35.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:35.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:35.923 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.923 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.923 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.923 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:35.923 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:35.924 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:35.926 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:35.926 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:35.928 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:35.928 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:35.928 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:35.928 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:35.929 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:35.929 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:35.929 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:35.929 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:35.929 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:26:35.930 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:35.920+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:35.930 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:36.027 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:36.020+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:36.098 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:36.099 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:36.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:81533 4.f 4:f44070eb:::benchmark_data_smithi036_18856_object5144:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.073804+0000", 2020-11-12T17:26:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.024207869, 2020-11-12T17:26:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.024240819, 2020-11-12T17:26:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.100 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 81533 2020-11-12T17:26:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.101 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.073804+0000", 2020-11-12T17:26:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.073804+0000", 2020-11-12T17:26:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:26:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.073771+0000", 2020-11-12T17:26:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0951999999999994e-05 2020-11-12T17:26:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.073842+0000", 2020-11-12T17:26:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3767e-05 2020-11-12T17:26:36.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.073856+0000", 2020-11-12T17:26:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9480000000000002e-06 2020-11-12T17:26:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.073863+0000", 2020-11-12T17:26:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00056141600000000002 2020-11-12T17:26:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.074424+0000", 2020-11-12T17:26:36.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1493e-05 2020-11-12T17:26:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.074516+0000", 2020-11-12T17:26:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3436999999999993e-05 2020-11-12T17:26:36.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:36.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.074609+0000", 2020-11-12T17:26:36.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046857499999999998 2020-11-12T17:26:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.079295+0000", 2020-11-12T17:26:36.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054907419999999998 2020-11-12T17:26:36.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.111 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.112 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:81550 4.0 4:07d4b4a5:::benchmark_data_smithi036_18856_object5161:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:36.112 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.094314+0000", 2020-11-12T17:26:36.112 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.003698425, 2020-11-12T17:26:36.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003847334, 2020-11-12T17:26:36.112 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 81550 2020-11-12T17:26:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.113 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.094314+0000", 2020-11-12T17:26:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.094314+0000", 2020-11-12T17:26:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:26:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.094281+0000", 2020-11-12T17:26:36.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6292999999999996e-05 2020-11-12T17:26:36.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.094357+0000", 2020-11-12T17:26:36.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8427000000000002e-05 2020-11-12T17:26:36.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.094375+0000", 2020-11-12T17:26:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8169999999999999e-06 2020-11-12T17:26:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.094383+0000", 2020-11-12T17:26:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1564999999999998e-05 2020-11-12T17:26:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.094435+0000", 2020-11-12T17:26:36.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016784100000000001 2020-11-12T17:26:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.094603+0000", 2020-11-12T17:26:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015286600000000001 2020-11-12T17:26:36.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.094756+0000", 2020-11-12T17:26:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044184200000000002 2020-11-12T17:26:36.123 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.124 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:81551 4.4 e123/122 4:25d7a2a7:::benchmark_data_smithi036_18856_object5162:head v 123'5044, mlcod=99'3311)", 2020-11-12T17:26:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.096174+0000", 2020-11-12T17:26:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0018385809999999999, 2020-11-12T17:26:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020635739999999999, 2020-11-12T17:26:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:36.125 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.096174+0000", 2020-11-12T17:26:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.096174+0000", 2020-11-12T17:26:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.096144+0000", 2020-11-12T17:26:36.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1457000000000002e-05 2020-11-12T17:26:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.096235+0000", 2020-11-12T17:26:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9424000000000005e-05 2020-11-12T17:26:36.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.096305+0000", 2020-11-12T17:26:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.255e-06 2020-11-12T17:26:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.096312+0000", 2020-11-12T17:26:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011900699999999999 2020-11-12T17:26:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.096431+0000", 2020-11-12T17:26:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2187000000000002e-05 2020-11-12T17:26:36.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.096463+0000", 2020-11-12T17:26:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028950800000000001 2020-11-12T17:26:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.133 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:36.134 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 3 2020-11-12T17:26:36.134 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:36.135 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:36.136 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:36.134+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:36.238 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:36.234+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:36.311 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:36.311 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:36.311 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:36.311 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:36.311 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:36.325 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:36.338 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:36.334+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:36.438 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:36.432+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:36.460 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 202.038143706, 2020-11-12T17:26:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 202.031199644, 2020-11-12T17:26:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 165.85736185799999, 2020-11-12T17:26:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 161.385827949, 2020-11-12T17:26:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 149.59365676499999, 2020-11-12T17:26:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 134.637209923, 2020-11-12T17:26:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 134.50827643900001, 2020-11-12T17:26:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.814138165, 2020-11-12T17:26:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.499584518999995, 2020-11-12T17:26:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 75.144899443, 2020-11-12T17:26:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:36.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:36.590 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:36.591 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 75.131722683999996, 2020-11-12T17:26:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:36.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:36.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 70.577641235000002, 2020-11-12T17:26:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.599 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:36.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:36.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:36.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:36.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:36.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:36.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:36.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:36.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:36.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:36.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:36.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:36.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:36.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:36.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:36.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:36.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:36.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:36.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:36.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:36.610 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.610 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.611 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:36.611 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:36.611 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 70.568653929000007, 2020-11-12T17:26:36.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:36.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.612 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:36.612 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:36.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:36.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:36.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:36.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:36.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:36.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:36.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:36.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:36.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:36.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:36.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:36.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:36.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:36.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:36.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:36.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:36.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.620 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.620 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:36.621 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:36.621 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 64.550726615000002, 2020-11-12T17:26:36.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:36.621 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.621 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.622 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:36.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.622 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:36.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:36.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:36.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:36.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:36.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:36.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:36.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:36.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:36.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:36.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:36.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:36.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:36.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:36.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:36.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:36.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:36.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:36.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:36.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:36.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:36.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:36.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:36.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:36.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:36.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:36.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.631 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.632 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:36.632 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:36.632 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 59.999683216999998, 2020-11-12T17:26:36.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:36.632 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.633 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.633 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.633 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.633 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.633 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:36.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.633 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:36.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:36.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:36.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:36.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:36.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:36.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:36.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:36.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:36.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:36.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:36.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:36.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:36.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:36.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:36.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:36.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:36.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:36.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:36.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:36.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:36.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:36.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:36.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:36.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:36.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:36.643 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.643 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.643 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.643 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:36.643 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:36.643 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 59.748287716999997, 2020-11-12T17:26:36.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:36.644 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.644 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.644 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.644 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.645 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.645 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:36.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.645 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:36.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:36.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:36.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:36.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:36.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:36.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:36.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:36.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:36.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:36.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:36.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:36.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:36.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:36.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:36.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:36.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:36.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:36.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:36.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:36.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:36.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:36.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:36.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:36.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:36.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:36.655 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.655 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.655 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.656 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:36.656 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:36.656 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 59.669165399999997, 2020-11-12T17:26:36.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:36.656 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.656 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.657 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:36.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.657 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:36.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:36.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:36.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:36.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:36.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:36.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:36.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:36.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:36.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:36.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:36.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:36.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:36.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:36.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:36.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:36.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:36.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:36.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:36.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:36.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:36.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:36.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:36.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:36.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:36.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:36.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.670 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.670 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:36.671 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:36.671 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.886814432999998, 2020-11-12T17:26:36.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:36.671 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.671 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.672 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.672 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.672 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.672 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:36.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.672 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:36.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:36.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:36.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:36.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:36.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:36.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:36.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:36.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:36.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:36.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:36.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:36.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:36.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:36.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:36.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:36.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:36.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:36.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:36.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:36.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:36.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:36.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:36.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:36.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:36.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:36.683 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.683 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.684 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.684 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:26:36.684 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:36.684 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.423772083999999, 2020-11-12T17:26:36.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:26:36.685 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.685 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.685 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:36.685 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:36.685 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.686 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:26:36.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.689 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:36.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:36.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:26:36.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:26:36.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:26:36.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:26:36.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:26:36.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:26:36.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:26:36.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:26:36.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:26:36.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:26:36.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:26:36.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:26:36.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:26:36.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:36.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:26:36.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:26:36.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:36.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:26:36.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:26:36.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:26:36.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:26:36.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:36.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:26:36.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:26:36.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:26:36.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:26:36.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.700 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.700 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:26:36.700 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:36.701 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.402731549999999, 2020-11-12T17:26:36.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:26:36.701 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:36.701 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:36.701 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:36.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:36.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:36.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:36.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:36.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:36.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:26:36.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:36.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:26:36.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:26:36.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:36.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:26:36.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:26:36.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:36.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:26:36.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:26:36.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:26:36.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:26:36.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:36.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:26:36.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:26:36.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:36.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:26:36.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:26:36.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:36.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:36.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:36.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:26:36.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:26:36.708 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.708 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.708 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.709 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:36.709 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:36.709 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:36.710 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:36.711 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:36.704+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:36.816 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:36.810+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:36.880 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:36.881 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:36.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.881 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:82214 4.b 4:d9064dbc:::benchmark_data_smithi036_18856_object5825:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:36.881 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:36.867075+0000", 2020-11-12T17:26:36.881 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.013552331000000001, 2020-11-12T17:26:36.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013578586, 2020-11-12T17:26:36.882 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:36.882 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:36.882 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:36.882 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:36.883 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.883 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 82214 2020-11-12T17:26:36.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.884 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:36.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:36.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867075+0000", 2020-11-12T17:26:36.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:36.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:36.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867075+0000", 2020-11-12T17:26:36.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:26:36.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:36.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867045+0000", 2020-11-12T17:26:36.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5548000000000003e-05 2020-11-12T17:26:36.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:36.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867110+0000", 2020-11-12T17:26:36.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2115e-05 2020-11-12T17:26:36.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:36.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867123+0000", 2020-11-12T17:26:36.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9020000000000004e-06 2020-11-12T17:26:36.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867128+0000", 2020-11-12T17:26:36.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6221999999999999e-05 2020-11-12T17:26:36.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:36.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867175+0000", 2020-11-12T17:26:36.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011239999999999999 2020-11-12T17:26:36.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:36.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867287+0000", 2020-11-12T17:26:36.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121087 2020-11-12T17:26:36.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:36.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867408+0000", 2020-11-12T17:26:36.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0094953069999999997 2020-11-12T17:26:36.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:36.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.876903+0000", 2020-11-12T17:26:36.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036879510000000001 2020-11-12T17:26:36.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880591+0000", 2020-11-12T17:26:36.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9914999999999999e-05 2020-11-12T17:26:36.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:36.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880641+0000", 2020-11-12T17:26:36.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013566419 2020-11-12T17:26:36.897 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.897 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:36.897 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.898 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:82218 4.9 4:93656b04:::benchmark_data_smithi036_18856_object5829:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:36.898 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:36.867376+0000", 2020-11-12T17:26:36.898 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.013250776000000001, 2020-11-12T17:26:36.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013386363, 2020-11-12T17:26:36.899 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:36.899 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:36.899 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:36.899 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:36.899 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.899 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 82218 2020-11-12T17:26:36.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.900 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:36.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:36.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867376+0000", 2020-11-12T17:26:36.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:36.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:36.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867376+0000", 2020-11-12T17:26:36.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:36.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:36.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867349+0000", 2020-11-12T17:26:36.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1308000000000003e-05 2020-11-12T17:26:36.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:36.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867411+0000", 2020-11-12T17:26:36.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0080000000000008e-06 2020-11-12T17:26:36.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:36.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867420+0000", 2020-11-12T17:26:36.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9160000000000003e-06 2020-11-12T17:26:36.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.867423+0000", 2020-11-12T17:26:36.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035210860000000001 2020-11-12T17:26:36.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:36.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.870945+0000", 2020-11-12T17:26:36.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0223999999999996e-05 2020-11-12T17:26:36.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for degraded object", 2020-11-12T17:26:36.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.871025+0000", 2020-11-12T17:26:36.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00066315799999999995 2020-11-12T17:26:36.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:36.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.871688+0000", 2020-11-12T17:26:36.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8720000000000003e-05 2020-11-12T17:26:36.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:36.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.871787+0000", 2020-11-12T17:26:36.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014336700000000001 2020-11-12T17:26:36.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:36.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.871930+0000", 2020-11-12T17:26:36.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082161779999999993 2020-11-12T17:26:36.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880146+0000", 2020-11-12T17:26:36.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012769763 2020-11-12T17:26:36.909 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.909 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:36.909 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.910 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:82222 4.d 4:b15b9d87:::benchmark_data_smithi036_18856_object5833:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:36.910 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:36.873822+0000", 2020-11-12T17:26:36.910 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0068053829999999999, 2020-11-12T17:26:36.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007067795, 2020-11-12T17:26:36.910 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:36.910 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:36.910 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:36.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:36.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.911 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 82222 2020-11-12T17:26:36.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.912 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:36.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:36.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.873822+0000", 2020-11-12T17:26:36.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:36.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:36.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.873822+0000", 2020-11-12T17:26:36.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:26:36.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:36.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.873794+0000", 2020-11-12T17:26:36.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5333999999999995e-05 2020-11-12T17:26:36.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:36.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.873859+0000", 2020-11-12T17:26:36.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:26:36.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:36.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.873870+0000", 2020-11-12T17:26:36.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5419999999999996e-06 2020-11-12T17:26:36.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.873876+0000", 2020-11-12T17:26:36.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6149000000000001e-05 2020-11-12T17:26:36.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:36.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.873922+0000", 2020-11-12T17:26:36.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000157851 2020-11-12T17:26:36.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:36.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.874080+0000", 2020-11-12T17:26:36.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013520200000000001 2020-11-12T17:26:36.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:36.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.874215+0000", 2020-11-12T17:26:36.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039614669999999998 2020-11-12T17:26:36.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:36.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.878177+0000", 2020-11-12T17:26:36.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002674573 2020-11-12T17:26:36.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:36.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880851+0000", 2020-11-12T17:26:36.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7036999999999997e-05 2020-11-12T17:26:36.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:36.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880898+0000", 2020-11-12T17:26:36.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0070764670000000003 2020-11-12T17:26:36.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.921 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:36.922 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.923 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:82225 4.f e123/122 4:ff056806:::benchmark_data_smithi036_18856_object5836:head v 123'5119, mlcod=94'3079)", 2020-11-12T17:26:36.923 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:36.876169+0000", 2020-11-12T17:26:36.923 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0044584070000000002, 2020-11-12T17:26:36.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048200999999999999, 2020-11-12T17:26:36.924 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:36.924 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:36.924 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:36.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:36.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.876169+0000", 2020-11-12T17:26:36.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:36.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:36.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.876169+0000", 2020-11-12T17:26:36.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:36.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:36.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.876148+0000", 2020-11-12T17:26:36.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5919000000000004e-05 2020-11-12T17:26:36.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:36.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.876214+0000", 2020-11-12T17:26:36.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.347e-05 2020-11-12T17:26:36.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:36.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.876287+0000", 2020-11-12T17:26:36.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5480000000000001e-06 2020-11-12T17:26:36.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.876293+0000", 2020-11-12T17:26:36.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9277000000000003e-05 2020-11-12T17:26:36.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:36.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.876342+0000", 2020-11-12T17:26:36.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3255e-05 2020-11-12T17:26:36.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:36.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.876365+0000", 2020-11-12T17:26:36.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000196448 2020-11-12T17:26:36.930 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.930 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:36.930 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.931 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:82230 4.c 4:3e497a4b:::benchmark_data_smithi036_18856_object5841:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:36.931 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:36.879953+0000", 2020-11-12T17:26:36.931 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00067454899999999998, 2020-11-12T17:26:36.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011038599999999999, 2020-11-12T17:26:36.931 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:36.932 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:36.932 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:36.932 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:36.932 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:36.932 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 82230 2020-11-12T17:26:36.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.932 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:36.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:36.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.879953+0000", 2020-11-12T17:26:36.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:36.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:36.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.879953+0000", 2020-11-12T17:26:36.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:26:36.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:36.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.879924+0000", 2020-11-12T17:26:36.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2397000000000006e-05 2020-11-12T17:26:36.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:36.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.879987+0000", 2020-11-12T17:26:36.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1423000000000001e-05 2020-11-12T17:26:36.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:36.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.879998+0000", 2020-11-12T17:26:36.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.066e-06 2020-11-12T17:26:36.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880004+0000", 2020-11-12T17:26:36.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7790999999999997e-05 2020-11-12T17:26:36.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:36.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880052+0000", 2020-11-12T17:26:36.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014201099999999999 2020-11-12T17:26:36.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:36.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880194+0000", 2020-11-12T17:26:36.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000130517 2020-11-12T17:26:36.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:36.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880325+0000", 2020-11-12T17:26:36.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00037193000000000003 2020-11-12T17:26:36.939 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.939 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:36.939 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.939 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:82226 4.5 e123/69 4:a2d17c9f:::benchmark_data_smithi036_18856_object5837:head v 123'5167, mlcod=123'5165)", 2020-11-12T17:26:36.940 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:36.880174+0000", 2020-11-12T17:26:36.940 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00045281500000000002, 2020-11-12T17:26:36.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00095900800000000002, 2020-11-12T17:26:36.940 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:36.940 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:36.940 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:36.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:36.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880174+0000", 2020-11-12T17:26:36.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:36.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:36.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880174+0000", 2020-11-12T17:26:36.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:26:36.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:36.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880151+0000", 2020-11-12T17:26:36.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7383000000000001e-05 2020-11-12T17:26:36.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:36.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880228+0000", 2020-11-12T17:26:36.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026972699999999999 2020-11-12T17:26:36.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:36.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880498+0000", 2020-11-12T17:26:36.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1340000000000003e-06 2020-11-12T17:26:36.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:36.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.880503+0000", 2020-11-12T17:26:36.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00050063400000000002 2020-11-12T17:26:36.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:36.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.881004+0000", 2020-11-12T17:26:36.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0891999999999999e-05 2020-11-12T17:26:36.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:36.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:36.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:36.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:36.881025+0000", 2020-11-12T17:26:36.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00085030000000000001 2020-11-12T17:26:36.947 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.947 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:36.947 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.948 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:36.948 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:36.948 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 6 2020-11-12T17:26:36.948 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:36.950 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:36.944+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:36.950 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:37.051 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:37.048+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:37.152 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:37.148+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:37.185 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:37.185 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:37.186 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:37.186 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:37.186 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:37.199 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:37.254 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:37.250+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:37.356 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:37.350+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:37.400 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:37.400 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:37.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:37.400 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:37.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.401 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:26:37.401 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:37.401 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 206.71140677899999, 2020-11-12T17:26:37.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:26:37.401 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.402 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.402 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.402 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:37.402 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:37.402 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:26:37.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.403 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:37.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:37.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:37.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:26:37.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:26:37.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:26:37.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:26:37.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:26:37.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:26:37.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:26:37.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:26:37.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:26:37.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:26:37.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:26:37.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:26:37.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:37.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:26:37.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:26:37.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:26:37.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:26:37.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:37.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:26:37.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:26:37.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:26:37.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:26:37.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:26:37.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:26:37.412 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.412 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.412 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.413 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:26:37.413 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:37.413 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 206.70592671, 2020-11-12T17:26:37.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:26:37.413 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.414 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:37.414 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:37.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:37.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:37.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:26:37.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:26:37.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:26:37.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:26:37.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:26:37.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:26:37.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:26:37.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:26:37.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:26:37.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:26:37.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:26:37.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:26:37.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:26:37.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:26:37.421 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.421 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.421 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.422 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:26:37.422 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:37.422 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 198.51580511, 2020-11-12T17:26:37.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:26:37.423 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.424 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.424 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.424 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:37.424 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:37.424 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:26:37.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.425 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:37.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:37.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:26:37.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:26:37.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:26:37.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:26:37.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:26:37.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:26:37.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:26:37.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:26:37.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:26:37.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:26:37.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:26:37.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:26:37.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:26:37.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:37.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:26:37.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:26:37.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:26:37.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:26:37.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:37.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:26:37.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:26:37.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:26:37.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:26:37.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:26:37.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:26:37.434 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.434 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.435 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.435 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:26:37.435 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:37.435 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 198.50856140100001, 2020-11-12T17:26:37.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:26:37.436 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.436 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:37.436 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:37.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:37.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:37.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:26:37.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:26:37.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:26:37.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:26:37.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:26:37.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:26:37.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:26:37.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:26:37.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:26:37.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:26:37.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:26:37.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:26:37.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:26:37.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:26:37.443 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.443 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.443 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.444 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:37.444 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:37.444 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.512472027, 2020-11-12T17:26:37.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:26:37.444 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.445 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:37.445 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:37.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:37.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:37.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:26:37.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:26:37.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:26:37.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:26:37.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:26:37.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:26:37.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:26:37.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:26:37.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:26:37.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:26:37.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:26:37.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:26:37.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:26:37.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:26:37.451 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.452 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.452 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.452 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:26:37.452 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:37.452 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.487202760000002, 2020-11-12T17:26:37.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:26:37.453 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.453 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.453 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:37.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:37.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:26:37.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:26:37.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:26:37.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:26:37.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:26:37.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:26:37.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:26:37.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:26:37.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:26:37.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:26:37.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:26:37.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:26:37.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:26:37.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:26:37.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:26:37.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:26:37.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:26:37.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.460 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.461 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:37.461 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:37.461 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 60.821361744999997, 2020-11-12T17:26:37.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:26:37.461 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.461 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.462 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:26:37.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.462 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:37.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:37.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:37.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:26:37.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:26:37.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:26:37.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:26:37.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:26:37.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:26:37.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:26:37.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:26:37.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:26:37.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:26:37.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:26:37.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:26:37.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:37.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:26:37.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:26:37.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:26:37.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:26:37.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:37.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:26:37.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:26:37.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:26:37.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:26:37.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:26:37.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:26:37.471 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.471 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.472 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:37.472 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:37.472 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 60.818120415999999, 2020-11-12T17:26:37.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:26:37.473 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.473 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.473 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.473 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.473 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.473 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:26:37.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.474 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:37.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:37.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:37.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:26:37.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:26:37.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:26:37.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:26:37.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:26:37.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:26:37.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:26:37.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:26:37.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:26:37.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:26:37.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:26:37.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:26:37.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:37.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:26:37.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:26:37.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:26:37.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:26:37.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:37.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:26:37.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:26:37.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:26:37.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:26:37.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:26:37.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:26:37.483 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.483 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.483 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.484 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:26:37.484 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:37.484 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.384949515000002, 2020-11-12T17:26:37.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:26:37.486 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.486 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:37.486 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:37.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:37.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:37.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:26:37.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:26:37.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:26:37.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:26:37.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:26:37.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:26:37.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:26:37.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:26:37.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:26:37.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:26:37.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:26:37.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:26:37.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:26:37.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:26:37.502 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.502 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.503 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.504 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:37.504 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:37.504 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.335882853999998, 2020-11-12T17:26:37.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:26:37.505 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.505 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.505 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.506 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.506 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.506 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:26:37.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.507 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:37.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:37.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:37.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:26:37.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:26:37.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:26:37.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:26:37.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:26:37.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:26:37.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:26:37.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:26:37.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:26:37.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:26:37.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:26:37.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:26:37.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:37.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:26:37.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:26:37.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:26:37.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:26:37.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:37.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:26:37.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:26:37.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:26:37.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:26:37.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:26:37.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:26:37.528 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.528 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.529 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.529 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:37.529 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:37.529 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.334202073999997, 2020-11-12T17:26:37.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:26:37.530 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.530 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.530 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.530 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.530 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.530 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:37.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.531 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:37.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:37.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:26:37.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:26:37.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:26:37.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:26:37.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:26:37.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:26:37.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:26:37.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:26:37.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:26:37.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:26:37.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:26:37.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:26:37.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:26:37.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:37.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:26:37.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:26:37.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:26:37.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:26:37.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:37.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:26:37.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:26:37.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:26:37.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:26:37.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:26:37.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:26:37.540 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.540 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.540 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.541 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:37.541 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:37.541 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.334113879, 2020-11-12T17:26:37.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:26:37.541 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.541 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.542 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.542 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.542 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.542 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:37.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.542 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:37.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:37.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:37.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:26:37.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:26:37.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:26:37.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:26:37.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:26:37.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:26:37.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:26:37.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:26:37.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:26:37.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:26:37.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:26:37.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:26:37.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:37.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:26:37.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:26:37.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:26:37.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:26:37.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:37.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:26:37.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:26:37.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:26:37.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:26:37.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:26:37.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:26:37.551 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.552 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.552 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.552 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:37.552 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:37.553 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.315618563999998, 2020-11-12T17:26:37.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:26:37.553 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.553 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:37.553 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:37.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:37.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:37.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:26:37.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:26:37.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:26:37.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:26:37.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:26:37.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:26:37.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:26:37.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:26:37.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:26:37.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:26:37.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:26:37.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:26:37.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:26:37.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:26:37.560 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.560 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.560 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.561 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:37.561 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:37.561 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.315485574, 2020-11-12T17:26:37.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:26:37.562 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.562 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:37.562 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:37.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:37.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:37.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:26:37.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:26:37.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:26:37.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:26:37.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:26:37.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:26:37.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:26:37.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:26:37.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:26:37.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:26:37.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:26:37.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:26:37.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:26:37.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:26:37.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.570 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.570 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.570 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:37.571 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:37.571 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.315400846000003, 2020-11-12T17:26:37.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:26:37.571 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.571 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:37.571 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:37.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:37.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:26:37.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:26:37.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:26:37.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:26:37.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:26:37.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:26:37.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:26:37.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:26:37.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:26:37.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:26:37.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:26:37.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:26:37.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:26:37.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:26:37.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:26:37.579 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.579 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.579 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.579 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:37.580 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:37.580 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.263788316000003, 2020-11-12T17:26:37.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:26:37.580 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.580 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:37.580 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.580 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.581 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.581 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:37.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.581 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:37.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:37.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:37.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:26:37.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:26:37.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:26:37.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:26:37.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:26:37.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:26:37.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:26:37.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:26:37.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:26:37.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:26:37.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:37.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:26:37.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:26:37.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:26:37.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:26:37.587 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.587 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.588 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.588 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:37.588 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:37.588 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.2636313, 2020-11-12T17:26:37.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:26:37.589 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.589 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:37.589 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.589 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.589 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.589 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:37.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.590 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:37.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:37.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:37.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:26:37.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:26:37.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:26:37.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:26:37.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:26:37.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:26:37.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:26:37.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:26:37.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:26:37.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:26:37.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:37.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:26:37.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:26:37.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:26:37.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:26:37.597 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.597 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.597 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.598 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:37.598 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:37.598 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.564578395000002, 2020-11-12T17:26:37.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:26:37.598 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.598 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.598 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.599 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.599 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.599 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:26:37.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.599 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:37.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:37.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:26:37.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:26:37.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:26:37.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:26:37.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:26:37.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:26:37.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:26:37.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:26:37.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:26:37.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:26:37.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:26:37.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:26:37.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:26:37.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:37.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:26:37.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:26:37.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:26:37.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:26:37.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:37.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:26:37.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:26:37.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:26:37.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:26:37.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:26:37.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:26:37.609 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.609 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.610 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.610 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:37.610 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:37.610 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 15.477922907, 2020-11-12T17:26:37.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:26:37.611 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.611 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:37.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.611 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.611 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:26:37.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.612 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:37.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:37.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:37.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:26:37.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:26:37.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:26:37.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:26:37.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:26:37.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:26:37.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:26:37.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:26:37.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:26:37.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:26:37.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:26:37.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:26:37.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:37.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:26:37.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:26:37.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:26:37.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:26:37.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:37.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:26:37.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:26:37.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:37.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:26:37.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:26:37.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:26:37.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:26:37.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.623 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.624 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:26:37.624 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:37.624 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 15.46444168, 2020-11-12T17:26:37.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:26:37.625 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.625 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:37.625 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:37.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:37.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:37.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:26:37.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:26:37.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:26:37.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:26:37.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:26:37.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:26:37.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:26:37.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:26:37.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:26:37.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:26:37.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:26:37.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:26:37.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:37.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:26:37.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:26:37.632 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.632 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.632 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.633 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.633 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.633 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:37.635 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:37.635 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:37.628+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:37.736 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:37.734+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:37.837 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:37.832+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:37.853 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:83040 4.7 4:e41070c2:::benchmark_data_smithi036_18856_object6651:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:37.850214+0000", 2020-11-12T17:26:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0039090890000000001, 2020-11-12T17:26:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039331260000000003, 2020-11-12T17:26:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 83040 2020-11-12T17:26:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.850214+0000", 2020-11-12T17:26:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.850214+0000", 2020-11-12T17:26:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:26:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.850186+0000", 2020-11-12T17:26:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2531000000000002e-05 2020-11-12T17:26:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.850248+0000", 2020-11-12T17:26:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1735e-05 2020-11-12T17:26:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.850260+0000", 2020-11-12T17:26:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9209999999999997e-06 2020-11-12T17:26:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.850266+0000", 2020-11-12T17:26:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000142347 2020-11-12T17:26:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.850408+0000", 2020-11-12T17:26:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109966 2020-11-12T17:26:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.850518+0000", 2020-11-12T17:26:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013053899999999999 2020-11-12T17:26:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.850649+0000", 2020-11-12T17:26:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027027790000000002 2020-11-12T17:26:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853351+0000", 2020-11-12T17:26:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003137702 2020-11-12T17:26:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:83042 4.1 e123/69 4:87fbbce0:::benchmark_data_smithi036_18856_object6653:head v 123'5339, mlcod=123'5336)", 2020-11-12T17:26:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:37.852874+0000", 2020-11-12T17:26:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.001249158, 2020-11-12T17:26:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001361667, 2020-11-12T17:26:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.852874+0000", 2020-11-12T17:26:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.852874+0000", 2020-11-12T17:26:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.852849+0000", 2020-11-12T17:26:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3650000000000001e-05 2020-11-12T17:26:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.852923+0000", 2020-11-12T17:26:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4778999999999999e-05 2020-11-12T17:26:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.852967+0000", 2020-11-12T17:26:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8320000000000002e-06 2020-11-12T17:26:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.852973+0000", 2020-11-12T17:26:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7505000000000001e-05 2020-11-12T17:26:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853011+0000", 2020-11-12T17:26:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2555999999999999e-05 2020-11-12T17:26:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853033+0000", 2020-11-12T17:26:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015964700000000001 2020-11-12T17:26:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:83045 4.8 4:1efeacbd:::benchmark_data_smithi036_18856_object6656:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:37.853297+0000", 2020-11-12T17:26:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00082615499999999997, 2020-11-12T17:26:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010004059999999999, 2020-11-12T17:26:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 83045 2020-11-12T17:26:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853297+0000", 2020-11-12T17:26:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853297+0000", 2020-11-12T17:26:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853269+0000", 2020-11-12T17:26:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0992999999999997e-05 2020-11-12T17:26:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853330+0000", 2020-11-12T17:26:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0635999999999999e-05 2020-11-12T17:26:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853341+0000", 2020-11-12T17:26:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1569999999999999e-06 2020-11-12T17:26:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853346+0000", 2020-11-12T17:26:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5173999999999998e-05 2020-11-12T17:26:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853391+0000", 2020-11-12T17:26:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015862499999999999 2020-11-12T17:26:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853550+0000", 2020-11-12T17:26:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013288500000000001 2020-11-12T17:26:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853683+0000", 2020-11-12T17:26:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038610899999999999 2020-11-12T17:26:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:83037 4.3 e123/106)", 2020-11-12T17:26:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:37.853703+0000", 2020-11-12T17:26:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00041952100000000001, 2020-11-12T17:26:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00066219800000000002, 2020-11-12T17:26:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853703+0000", 2020-11-12T17:26:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853703+0000", 2020-11-12T17:26:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:26:37.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853682+0000", 2020-11-12T17:26:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7606000000000003e-05 2020-11-12T17:26:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853749+0000", 2020-11-12T17:26:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7552999999999994e-05 2020-11-12T17:26:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853827+0000", 2020-11-12T17:26:37.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.191e-06 2020-11-12T17:26:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.853835+0000", 2020-11-12T17:26:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013175900000000001 2020-11-12T17:26:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.884 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:83029 4.2 4:48652c51:::benchmark_data_smithi036_18856_object6640:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:37.837671+0000", 2020-11-12T17:26:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.016452014000000001, 2020-11-12T17:26:37.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.016747484999999999, 2020-11-12T17:26:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 83029 2020-11-12T17:26:37.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.837671+0000", 2020-11-12T17:26:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.837671+0000", 2020-11-12T17:26:37.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:37.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.837646+0000", 2020-11-12T17:26:37.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5241000000000002e-05 2020-11-12T17:26:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.837701+0000", 2020-11-12T17:26:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4970000000000007e-06 2020-11-12T17:26:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.837711+0000", 2020-11-12T17:26:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5770000000000004e-06 2020-11-12T17:26:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.837715+0000", 2020-11-12T17:26:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032335879999999999 2020-11-12T17:26:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.840949+0000", 2020-11-12T17:26:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015161100000000001 2020-11-12T17:26:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.841100+0000", 2020-11-12T17:26:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013934799999999999 2020-11-12T17:26:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.841240+0000", 2020-11-12T17:26:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042806629999999997 2020-11-12T17:26:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.845520+0000", 2020-11-12T17:26:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078497380000000002 2020-11-12T17:26:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:83037 4.3 4:cd6ba720:::benchmark_data_smithi036_18856_object6648:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:37.846736+0000", 2020-11-12T17:26:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0073864439999999998, 2020-11-12T17:26:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077596410000000003, 2020-11-12T17:26:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:37.896 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 83037 2020-11-12T17:26:37.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.896 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:37.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.846736+0000", 2020-11-12T17:26:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.846736+0000", 2020-11-12T17:26:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:26:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.846710+0000", 2020-11-12T17:26:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8152999999999997e-05 2020-11-12T17:26:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.846768+0000", 2020-11-12T17:26:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0603e-05 2020-11-12T17:26:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.846779+0000", 2020-11-12T17:26:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2800000000000003e-06 2020-11-12T17:26:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.846784+0000", 2020-11-12T17:26:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7669e-05 2020-11-12T17:26:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.846832+0000", 2020-11-12T17:26:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012828199999999999 2020-11-12T17:26:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:37.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.846960+0000", 2020-11-12T17:26:37.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010663299999999999 2020-11-12T17:26:37.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:37.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:37.847067+0000", 2020-11-12T17:26:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033051599999999999 2020-11-12T17:26:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 6 2020-11-12T17:26:37.904 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:37.906 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:37.930 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:37.934 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:26:37.981 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:37.976+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:38.041 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:38.036+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:38.135 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:38.135 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:38.135 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:38.136 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:38.136 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:38.142 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:38.145 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:38.136+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:38.151 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:38.183 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:38.222 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:38.243 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:38.240+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:38.255 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:38.287 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:38.295 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:38.295 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 203.76796100600001, 2020-11-12T17:26:38.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:26:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:26:38.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:26:38.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:26:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:26:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:26:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:26:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:26:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:26:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:26:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:26:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:26:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:26:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:26:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:26:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:26:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:26:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:26:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:26:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:26:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:26:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:26:38.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:26:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:26:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.307 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:26:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:38.308 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 203.76456107199999, 2020-11-12T17:26:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:26:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:38.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:26:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:26:38.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:26:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:26:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:26:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:26:38.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:26:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:26:38.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:26:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:26:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:26:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:26:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:26:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:26:38.316 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:26:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:38.317 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 168.28867162500001, 2020-11-12T17:26:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:26:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:38.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:26:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:26:38.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:26:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:26:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:26:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:26:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:26:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:26:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:26:38.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:26:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:26:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:26:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:26:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:26:38.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:26:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:26:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 136.34868628199999, 2020-11-12T17:26:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:26:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.327 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:26:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:26:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:26:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:26:38.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:26:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:26:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:26:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:26:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:26:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:26:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:26:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:26:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:26:38.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:26:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:26:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:26:38.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:26:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:26:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:26:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:26:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:26:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:26:38.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:26:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:26:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.338 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:26:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 124.871585208, 2020-11-12T17:26:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:26:38.339 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:26:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:26:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:26:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:26:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:26:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:26:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:26:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:26:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:26:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:26:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:26:38.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:26:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:26:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:26:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.345 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:26:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:38.346 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 123.752574821, 2020-11-12T17:26:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:26:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:38.347 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:26:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:38.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:26:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:26:38.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:26:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:26:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:26:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:26:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:26:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:26:38.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:26:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:26:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:26:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:26:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:26:38.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:26:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:26:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:26:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:26:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:26:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:26:38.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:26:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:26:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:26:38.357 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:26:38.358 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 123.736436817, 2020-11-12T17:26:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:26:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:26:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:26:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:26:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:26:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:26:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:26:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:26:38.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:26:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:26:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:26:38.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:26:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:26:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:26:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:26:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:26:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 123.731709138, 2020-11-12T17:26:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:26:38.368 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:26:38.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:26:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:26:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:26:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:26:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:26:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:26:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:26:38.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:26:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:26:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:26:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:26:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:26:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:26:38.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:26:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:26:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:38.377 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.350150071000002, 2020-11-12T17:26:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:26:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.378 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:26:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:38.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:26:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:26:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:26:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:26:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:26:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:26:38.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:26:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:26:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:26:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:26:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:26:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:26:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:26:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:26:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:26:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:26:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:26:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:26:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:26:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:26:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:26:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:26:38.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:26:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.390 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:26:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.344596249999995, 2020-11-12T17:26:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:26:38.391 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:38.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:26:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:26:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:26:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:26:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:26:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:26:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:26:38.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:26:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:26:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:26:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:26:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:26:38.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:26:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:26:38.399 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:73896 4.3 4:cac907c9:::benchmark_data_smithi036_18856_object9236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e111)", 2020-11-12T17:26:38.400 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.806074293999998, 2020-11-12T17:26:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34147229000000001, 2020-11-12T17:26:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.401 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 73896 2020-11-12T17:26:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:38.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488091+0000", 2020-11-12T17:26:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109295 2020-11-12T17:26:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488200+0000", 2020-11-12T17:26:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2892e-05 2020-11-12T17:26:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488213+0000", 2020-11-12T17:26:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2709999999999998e-06 2020-11-12T17:26:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488219+0000", 2020-11-12T17:26:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0085628400000000004 2020-11-12T17:26:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.496782+0000", 2020-11-12T17:26:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011530499999999999 2020-11-12T17:26:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.496897+0000", 2020-11-12T17:26:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017658600000000001 2020-11-12T17:26:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.497074+0000", 2020-11-12T17:26:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018301089999999999 2020-11-12T17:26:38.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.498904+0000", 2020-11-12T17:26:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33056671100000001 2020-11-12T17:26:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829471+0000", 2020-11-12T17:26:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7509999999999995e-05 2020-11-12T17:26:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829548+0000", 2020-11-12T17:26:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9070999999999998e-05 2020-11-12T17:26:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829597+0000", 2020-11-12T17:26:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34147229000000001 2020-11-12T17:26:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.414 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:38.414 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:38.414 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.687947239, 2020-11-12T17:26:38.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:26:38.414 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.414 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.415 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:26:38.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.415 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:38.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:38.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:26:38.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:26:38.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:26:38.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:26:38.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:26:38.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:26:38.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:26:38.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:26:38.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:26:38.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:26:38.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:26:38.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:26:38.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:26:38.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:26:38.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:26:38.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:26:38.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:26:38.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:26:38.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:26:38.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:26:38.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:26:38.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:26:38.427 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.427 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.427 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.428 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:38.428 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:38.428 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.686053626, 2020-11-12T17:26:38.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:26:38.428 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.429 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.429 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.429 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.429 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.429 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:26:38.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.429 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:38.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:38.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:38.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:26:38.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:26:38.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:26:38.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:26:38.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:26:38.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:26:38.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:26:38.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:26:38.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:26:38.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:26:38.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:26:38.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:26:38.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:26:38.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:26:38.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:26:38.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:26:38.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:26:38.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:26:38.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:26:38.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:26:38.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:26:38.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:26:38.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.440 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.441 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:38.441 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:38.441 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.685300978000001, 2020-11-12T17:26:38.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:26:38.441 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.441 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.442 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.442 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.442 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.442 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:26:38.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.442 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:38.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:38.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:38.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:26:38.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:26:38.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:26:38.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:26:38.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:26:38.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:26:38.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:26:38.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:26:38.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:26:38.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:26:38.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:26:38.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:26:38.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:26:38.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:26:38.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:26:38.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:26:38.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:26:38.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:26:38.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:26:38.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:26:38.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:26:38.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:26:38.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.455 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.455 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:38.455 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:38.456 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.682139460999998, 2020-11-12T17:26:38.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:26:38.456 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.456 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.456 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.456 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.456 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.457 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:26:38.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.457 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:38.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:38.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:26:38.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:26:38.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:26:38.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:26:38.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:26:38.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:26:38.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:26:38.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:26:38.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:26:38.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:26:38.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:26:38.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:26:38.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:26:38.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:26:38.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:26:38.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:26:38.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:26:38.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:26:38.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:26:38.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:26:38.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:26:38.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:26:38.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:26:38.467 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.467 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.468 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.468 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:38.468 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:38.468 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.681058294, 2020-11-12T17:26:38.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:26:38.469 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.469 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.469 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.469 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.469 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.469 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:26:38.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.469 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:38.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:38.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:38.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:26:38.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:26:38.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:26:38.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:26:38.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:26:38.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:26:38.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:26:38.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:26:38.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:26:38.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:26:38.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:26:38.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:26:38.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:26:38.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:26:38.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:26:38.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:26:38.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:26:38.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:26:38.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:26:38.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:26:38.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:26:38.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:26:38.481 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.481 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.481 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.481 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:38.482 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:38.482 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.680889200999999, 2020-11-12T17:26:38.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:26:38.482 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.482 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.483 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.483 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.483 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.483 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:26:38.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.484 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:38.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:38.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:38.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:26:38.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:26:38.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:26:38.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:26:38.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:26:38.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:26:38.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:26:38.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:26:38.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:26:38.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:26:38.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:26:38.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:26:38.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:26:38.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:26:38.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:26:38.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:26:38.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:26:38.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:26:38.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:26:38.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:26:38.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:26:38.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:26:38.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.494 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.495 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:38.495 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:38.495 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.678270555000001, 2020-11-12T17:26:38.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:26:38.495 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.496 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.496 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.496 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.496 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.496 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:26:38.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.496 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:38.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:38.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:38.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:26:38.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:26:38.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:26:38.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:26:38.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:26:38.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:26:38.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:26:38.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:26:38.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:26:38.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:26:38.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:26:38.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:26:38.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:26:38.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:26:38.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:26:38.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:26:38.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:26:38.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:26:38.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:26:38.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:26:38.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:26:38.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:26:38.507 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.507 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.507 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.508 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:38.508 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:38.508 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.678162472, 2020-11-12T17:26:38.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:26:38.509 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.509 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:38.509 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:38.509 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:38.509 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:38.509 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:26:38.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.510 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:38.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:38.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:26:38.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:26:38.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:26:38.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:26:38.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:26:38.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:26:38.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:26:38.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:26:38.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:26:38.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:26:38.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:26:38.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:26:38.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:26:38.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:38.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:26:38.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:26:38.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:38.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:26:38.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:26:38.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:38.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:26:38.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:26:38.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:38.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:26:38.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:26:38.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:26:38.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:26:38.521 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.522 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.523 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:26:38.523 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:38.523 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.674199789999999, 2020-11-12T17:26:38.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:26:38.524 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:38.524 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:38.525 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:38.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:38.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:38.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:38.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:38.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:38.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:26:38.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:38.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:26:38.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:26:38.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:38.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:26:38.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:26:38.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:38.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:26:38.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:26:38.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:38.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:26:38.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:26:38.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:38.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:26:38.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:26:38.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:38.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:26:38.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:26:38.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:38.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:38.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:38.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:26:38.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:26:38.537 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.537 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.537 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.537 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:38.537 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:38.537 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:38.540 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:38.540 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:38.540 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:38.541 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:38.541 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:38.541 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:38.541 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:38.541 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:38.542 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:38.542 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:38.542 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:26:38.542 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:38.538+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:38.543 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:38.640 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:38.636+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:38.740 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:38.741 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:38.743 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:38.738+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:38.754 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:38.842 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:38.836+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:38.944 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:38.938+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:38.987 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:38.987 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:39.002 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:39.047 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:39.042+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:39.145 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:39.142+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:39.232 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:39.233 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:39.245 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:39.247 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:39.244+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:39.349 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:39.346+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:39.450 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:39.450 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:39.451 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:39.446+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:39.463 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:39.552 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:39.550+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:39.652 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:39.648+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:39.656 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:39.657 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:39.670 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:39.743 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2] out_osds: [0, 1] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:39.744 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:39.745 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_1 2020-11-12T17:26:39.745 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:26:39.791 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:39.788+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:39.856 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:39.850+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:39.870 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:39.870 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:39.884 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:39.955 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:39.954+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:40.018 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:40.018 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:40.032 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:40.075 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:40.072+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:40.082 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:26:40.085 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:26:40.098 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2020-11-12T17:26:39.588868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":280248344,"num_objects":4280,"num_object_clones":0,"num_object_copies":8560,"num_objects_missing_on_primary":616,"num_objects_missing":777,"num_objects_degraded":625,"num_objects_misplaced":426,"num_objects_unfound":0,"num_objects_dirty":4280,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":81661,"num_write_kb":611091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7259,"num_bytes_recovered":452313112,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81661,"ondisk_log_size":81661,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":6559460,"kb_used_data":267736,"kb_used_omap":4,"kb_used_meta":6291451,"kb_avail":559671580,"statfs":{"total":579820584960,"available":573103697920,"internally_reserved":6442450944,"allocated":274161664,"data_stored":606104552,"data_compressed":3667356,"data_compressed_allocated":270262272,"data_compressed_original":604553216,"omap_allocated":4385,"internal_metadata":6442446559},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-130088960,"num_objects":-1985,"num_object_clones":0,"num_object_copies":-3970,"num_objects_missing_on_primary":-205,"num_objects_missing":-44,"num_objects_degraded":625,"num_objects_misplaced":-2165,"num_objects_unfound":0,"num_objects_dirty":-1985,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1985,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1765,"num_bytes_recovered":92749848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.878153"},"pg_stats":[{"pgid":"4.f","version":"123'5103","reported_seq":"6473","reported_epoch":"123","state":"active+recovering","last_fresh":"2020-11-12T17:26:36.650712+0000","last_change":"2020-11-12T17:26:35.978743+0000","last_active":"2020-11-12T17:26:36.650712+0000","last_peered":"2020-11-12T17:26:36.650712+0000","last_clean":"2020-11-12T17:26:33.705466+0000","last_became_active":"2020-11-12T17:26:35.953462+0000","last_became_peered":"2020-11-12T17:26:35.953462+0000","last_unstale":"2020-11-12T17:26:36.650712+0000","last_undegraded":"2020-11-12T17:26:36.650712+0000","last_fullsized":"2020-11-12T17:26:36.650712+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":5103,"ondisk_log_size":5103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15335424,"num_objects":234,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":224,"num_objects_unfound":0,"num_objects_dirty":234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5103,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":647,"num_bytes_recovered":42401792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":224},{"shards":"3,4","objects":10}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"121'5098","reported_seq":"5159","reported_epoch":"122","state":"active+clean","last_fresh":"2020-11-12T17:26:34.727154+0000","last_change":"2020-11-12T17:24:50.864218+0000","last_active":"2020-11-12T17:26:34.727154+0000","last_peered":"2020-11-12T17:26:34.727154+0000","last_clean":"2020-11-12T17:26:34.727154+0000","last_became_active":"2020-11-12T17:24:50.863828+0000","last_became_peered":"2020-11-12T17:24:50.863828+0000","last_unstale":"2020-11-12T17:26:34.727154+0000","last_undegraded":"2020-11-12T17:26:34.727154+0000","last_fullsized":"2020-11-12T17:26:34.727154+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":5098,"ondisk_log_size":5098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18022400,"num_objects":275,"num_object_clones":0,"num_object_copies":550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":275,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5098,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"121'5279","reported_seq":"7114","reported_epoch":"122","state":"active+clean","last_fresh":"2020-11-12T17:26:35.522741+0000","last_change":"2020-11-12T17:26:35.520976+0000","last_active":"2020-11-12T17:26:35.522741+0000","last_peered":"2020-11-12T17:26:35.522741+0000","last_clean":"2020-11-12T17:26:35.522741+0000","last_became_active":"2020-11-12T17:26:29.835379+0000","last_became_peered":"2020-11-12T17:26:29.835379+0000","last_unstale":"2020-11-12T17:26:35.522741+0000","last_undegraded":"2020-11-12T17:26:35.522741+0000","last_fullsized":"2020-11-12T17:26:35.522741+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4752","last_scrub_stamp":"2020-11-12T17:26:16.640613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:16.640613+0000","log_size":5279,"ondisk_log_size":5279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18169880,"num_objects":279,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5279,"num_write_kb":39505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":877,"num_bytes_recovered":44843032,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.c","version":"121'5144","reported_seq":"5205","reported_epoch":"122","state":"active+clean","last_fresh":"2020-11-12T17:26:34.727055+0000","last_change":"2020-11-12T17:24:50.858690+0000","last_active":"2020-11-12T17:26:34.727055+0000","last_peered":"2020-11-12T17:26:34.727055+0000","last_clean":"2020-11-12T17:26:34.727055+0000","last_became_active":"2020-11-12T17:24:50.858126+0000","last_became_peered":"2020-11-12T17:24:50.858126+0000","last_unstale":"2020-11-12T17:26:34.727055+0000","last_undegraded":"2020-11-12T17:26:34.727055+0000","last_fullsized":"2020-11-12T17:26:34.727055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":5144,"ondisk_log_size":5144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19726336,"num_objects":301,"num_object_clones":0,"num_object_copies":602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5144,"num_write_kb":38720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.b","version":"121'5165","reported_seq":"7467","reported_epoch":"123","state":"active+clean","last_fresh":"2020-11-12T17:26:35.798959+0000","last_change":"2020-11-12T17:26:35.798959+0000","last_active":"2020-11-12T17:26:35.798959+0000","last_peered":"2020-11-12T17:26:35.798959+0000","last_clean":"2020-11-12T17:26:35.798959+0000","last_became_active":"2020-11-12T17:26:35.790390+0000","last_became_peered":"2020-11-12T17:26:35.790390+0000","last_unstale":"2020-11-12T17:26:35.798959+0000","last_undegraded":"2020-11-12T17:26:35.798959+0000","last_fullsized":"2020-11-12T17:26:35.798959+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4576","last_scrub_stamp":"2020-11-12T17:26:15.201956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:15.201956+0000","log_size":5165,"ondisk_log_size":5165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":298,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5165,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1111,"num_bytes_recovered":63307776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"121'5133","reported_seq":"6411","reported_epoch":"122","state":"peering","last_fresh":"2020-11-12T17:26:34.722043+0000","last_change":"2020-11-12T17:26:34.722931+0000","last_active":"2020-11-12T17:26:34.722043+0000","last_peered":"2020-11-12T17:26:34.329436+0000","last_clean":"2020-11-12T17:26:34.329436+0000","last_became_active":"2020-11-12T17:26:23.871550+0000","last_became_peered":"2020-11-12T17:26:23.871550+0000","last_unstale":"2020-11-12T17:26:34.722043+0000","last_undegraded":"2020-11-12T17:26:34.722043+0000","last_fullsized":"2020-11-12T17:26:34.722043+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4480","last_scrub_stamp":"2020-11-12T17:26:14.557456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:14.557456+0000","log_size":5133,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18677760,"num_objects":285,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":285,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5133,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":602,"num_bytes_recovered":39452672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"121'5316","reported_seq":"6639","reported_epoch":"123","state":"activating","last_fresh":"2020-11-12T17:26:35.733543+0000","last_change":"2020-11-12T17:26:35.755377+0000","last_active":"2020-11-12T17:26:34.726425+0000","last_peered":"2020-11-12T17:26:34.681267+0000","last_clean":"2020-11-12T17:26:34.681267+0000","last_became_active":"2020-11-12T17:26:23.871193+0000","last_became_peered":"2020-11-12T17:26:23.871193+0000","last_unstale":"2020-11-12T17:26:35.733543+0000","last_undegraded":"2020-11-12T17:26:35.733543+0000","last_fullsized":"2020-11-12T17:26:35.733543+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":5316,"ondisk_log_size":5316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":625,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5316,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":625,"num_bytes_recovered":40960000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","1"],"object_location_counts":[{"shards":"4","objects":309}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"123'4897","reported_seq":"4961","reported_epoch":"123","state":"active+clean","last_fresh":"2020-11-12T17:26:36.558369+0000","last_change":"2020-11-12T17:26:24.951407+0000","last_active":"2020-11-12T17:26:36.558369+0000","last_peered":"2020-11-12T17:26:36.558369+0000","last_clean":"2020-11-12T17:26:36.558369+0000","last_became_active":"2020-11-12T17:24:51.721107+0000","last_became_peered":"2020-11-12T17:24:51.721107+0000","last_unstale":"2020-11-12T17:26:36.558369+0000","last_undegraded":"2020-11-12T17:26:36.558369+0000","last_fullsized":"2020-11-12T17:26:36.558369+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'4546","last_scrub_stamp":"2020-11-12T17:26:24.951247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:24.951247+0000","log_size":4897,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4897,"num_write_kb":36352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"123'5252","reported_seq":"6555","reported_epoch":"123","state":"active+clean","last_fresh":"2020-11-12T17:26:36.542926+0000","last_change":"2020-11-12T17:26:35.751347+0000","last_active":"2020-11-12T17:26:36.542926+0000","last_peered":"2020-11-12T17:26:36.542926+0000","last_clean":"2020-11-12T17:26:36.542926+0000","last_became_active":"2020-11-12T17:26:35.743284+0000","last_became_peered":"2020-11-12T17:26:35.743284+0000","last_unstale":"2020-11-12T17:26:36.542926+0000","last_undegraded":"2020-11-12T17:26:36.542926+0000","last_fullsized":"2020-11-12T17:26:36.542926+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'3976","last_scrub_stamp":"2020-11-12T17:26:01.833755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:01.833755+0000","log_size":5252,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":274,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5252,"num_write_kb":39296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":39256064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"31","reported_epoch":"123","state":"active+clean","last_fresh":"2020-11-12T17:26:35.791257+0000","last_change":"2020-11-12T17:26:35.791257+0000","last_active":"2020-11-12T17:26:35.791257+0000","last_peered":"2020-11-12T17:26:35.791257+0000","last_clean":"2020-11-12T17:26:35.791257+0000","last_became_active":"2020-11-12T17:26:35.790805+0000","last_became_peered":"2020-11-12T17:26:35.790805+0000","last_unstale":"2020-11-12T17:26:35.791257+0000","last_undegraded":"2020-11-12T17:26:35.791257+0000","last_fullsized":"2020-11-12T17:26:35.791257+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:46.329629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:46.329629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"121'5037","reported_seq":"6274","reported_epoch":"122","state":"peering","last_fresh":"2020-11-12T17:26:34.725312+0000","last_change":"2020-11-12T17:26:34.725312+0000","last_active":"2020-11-12T17:26:34.725112+0000","last_peered":"2020-11-12T17:26:34.699768+0000","last_clean":"2020-11-12T17:26:21.867950+0000","last_became_active":"2020-11-12T17:26:30.967640+0000","last_became_peered":"2020-11-12T17:26:30.967640+0000","last_unstale":"2020-11-12T17:26:34.725312+0000","last_undegraded":"2020-11-12T17:26:34.725312+0000","last_fullsized":"2020-11-12T17:26:34.725312+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'3904","last_scrub_stamp":"2020-11-12T17:26:01.232418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:01.232418+0000","log_size":5037,"ondisk_log_size":5037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":186,"num_objects_missing":368,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":300,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5037,"num_write_kb":37952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":34930688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"144","reported_epoch":"123","state":"active+clean","last_fresh":"2020-11-12T17:26:35.785534+0000","last_change":"2020-11-12T17:26:35.785534+0000","last_active":"2020-11-12T17:26:35.785534+0000","last_peered":"2020-11-12T17:26:35.785534+0000","last_clean":"2020-11-12T17:26:35.785534+0000","last_became_active":"2020-11-12T17:26:35.785065+0000","last_became_peered":"2020-11-12T17:26:35.785065+0000","last_unstale":"2020-11-12T17:26:35.785534+0000","last_undegraded":"2020-11-12T17:26:35.785534+0000","last_fullsized":"2020-11-12T17:26:35.785534+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:23.254853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:23.254853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"123'4818","reported_seq":"7123","reported_epoch":"123","state":"active+recovering","last_fresh":"2020-11-12T17:26:36.616104+0000","last_change":"2020-11-12T17:26:35.962593+0000","last_active":"2020-11-12T17:26:36.616104+0000","last_peered":"2020-11-12T17:26:36.616104+0000","last_clean":"2020-11-12T17:26:33.704871+0000","last_became_active":"2020-11-12T17:26:35.930883+0000","last_became_peered":"2020-11-12T17:26:35.930883+0000","last_unstale":"2020-11-12T17:26:36.616104+0000","last_undegraded":"2020-11-12T17:26:36.616104+0000","last_fullsized":"2020-11-12T17:26:36.616104+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4264","last_scrub_stamp":"2020-11-12T17:26:14.915537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:14.915537+0000","log_size":4818,"ondisk_log_size":4818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14548992,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":202,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4818,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1108,"num_bytes_recovered":72613888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","1"],"object_location_counts":[{"shards":"1,5","objects":202},{"shards":"5,7","objects":20}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"121","state":"active+clean","last_fresh":"2020-11-12T17:26:33.710766+0000","last_change":"2020-11-12T17:26:29.669707+0000","last_active":"2020-11-12T17:26:33.710766+0000","last_peered":"2020-11-12T17:26:33.710766+0000","last_clean":"2020-11-12T17:26:33.710766+0000","last_became_active":"2020-11-12T17:26:29.669260+0000","last_became_peered":"2020-11-12T17:26:29.669260+0000","last_unstale":"2020-11-12T17:26:33.710766+0000","last_undegraded":"2020-11-12T17:26:33.710766+0000","last_fullsized":"2020-11-12T17:26:33.710766+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:45.040397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:24:45.040397+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"121'5119","reported_seq":"5179","reported_epoch":"121","state":"active+clean","last_fresh":"2020-11-12T17:26:34.689450+0000","last_change":"2020-11-12T17:24:50.867446+0000","last_active":"2020-11-12T17:26:34.689450+0000","last_peered":"2020-11-12T17:26:34.689450+0000","last_clean":"2020-11-12T17:26:34.689450+0000","last_became_active":"2020-11-12T17:24:50.867064+0000","last_became_peered":"2020-11-12T17:24:50.867064+0000","last_unstale":"2020-11-12T17:26:34.689450+0000","last_undegraded":"2020-11-12T17:26:34.689450+0000","last_fullsized":"2020-11-12T17:26:34.689450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":5119,"ondisk_log_size":5119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5119,"num_write_kb":38272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"135","reported_epoch":"122","state":"active+clean","last_fresh":"2020-11-12T17:26:34.731519+0000","last_change":"2020-11-12T17:26:29.681207+0000","last_active":"2020-11-12T17:26:34.731519+0000","last_peered":"2020-11-12T17:26:34.731519+0000","last_clean":"2020-11-12T17:26:34.731519+0000","last_became_active":"2020-11-12T17:26:29.680644+0000","last_became_peered":"2020-11-12T17:26:29.680644+0000","last_unstale":"2020-11-12T17:26:34.731519+0000","last_undegraded":"2020-11-12T17:26:34.731519+0000","last_fullsized":"2020-11-12T17:26:34.731519+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:46.581637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:46.581637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"141","reported_epoch":"122","state":"active+clean","last_fresh":"2020-11-12T17:26:34.730829+0000","last_change":"2020-11-12T17:26:23.752402+0000","last_active":"2020-11-12T17:26:34.730829+0000","last_peered":"2020-11-12T17:26:34.730829+0000","last_clean":"2020-11-12T17:26:34.730829+0000","last_became_active":"2020-11-12T17:26:06.057282+0000","last_became_peered":"2020-11-12T17:26:06.057282+0000","last_unstale":"2020-11-12T17:26:34.730829+0000","last_undegraded":"2020-11-12T17:26:34.730829+0000","last_fullsized":"2020-11-12T17:26:34.730829+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:26:23.752291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:26:23.752291+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"121'4790","reported_seq":"6240","reported_epoch":"122","state":"peering","last_fresh":"2020-11-12T17:26:34.723932+0000","last_change":"2020-11-12T17:26:34.723932+0000","last_active":"2020-11-12T17:26:34.723711+0000","last_peered":"2020-11-12T17:26:34.084202+0000","last_clean":"2020-11-12T17:26:21.721906+0000","last_became_active":"2020-11-12T17:26:30.880302+0000","last_became_peered":"2020-11-12T17:26:30.880302+0000","last_unstale":"2020-11-12T17:26:34.723932+0000","last_undegraded":"2020-11-12T17:26:34.723932+0000","last_fullsized":"2020-11-12T17:26:34.723932+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'3680","last_scrub_stamp":"2020-11-12T17:26:00.856078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:00.856078+0000","log_size":4790,"ondisk_log_size":4790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":536,"num_objects_missing_on_primary":430,"num_objects_missing":409,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4790,"num_write_kb":35968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":620,"num_bytes_recovered":40468480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"152","reported_epoch":"123","state":"active+clean","last_fresh":"2020-11-12T17:26:35.752216+0000","last_change":"2020-11-12T17:26:35.752216+0000","last_active":"2020-11-12T17:26:35.752216+0000","last_peered":"2020-11-12T17:26:35.752216+0000","last_clean":"2020-11-12T17:26:35.752216+0000","last_became_active":"2020-11-12T17:26:35.751682+0000","last_became_peered":"2020-11-12T17:26:35.751682+0000","last_unstale":"2020-11-12T17:26:35.752216+0000","last_undegraded":"2020-11-12T17:26:35.752216+0000","last_fullsized":"2020-11-12T17:26:35.752216+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:33.820630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:33.820630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"123'5115","reported_seq":"6226","reported_epoch":"123","state":"active+clean","last_fresh":"2020-11-12T17:26:36.623079+0000","last_change":"2020-11-12T17:26:12.457552+0000","last_active":"2020-11-12T17:26:36.623079+0000","last_peered":"2020-11-12T17:26:36.623079+0000","last_clean":"2020-11-12T17:26:36.623079+0000","last_became_active":"2020-11-12T17:26:06.202691+0000","last_became_peered":"2020-11-12T17:26:06.202691+0000","last_unstale":"2020-11-12T17:26:36.623079+0000","last_undegraded":"2020-11-12T17:26:36.623079+0000","last_fullsized":"2020-11-12T17:26:36.623079+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'4120","last_scrub_stamp":"2020-11-12T17:26:03.373193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:26:03.373193+0000","log_size":5115,"ondisk_log_size":5115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5115,"num_write_kb":38080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":520,"num_bytes_recovered":34078720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"127","reported_epoch":"122","state":"active+clean","last_fresh":"2020-11-12T17:26:34.726747+0000","last_change":"2020-11-12T17:26:06.060044+0000","last_active":"2020-11-12T17:26:34.726747+0000","last_peered":"2020-11-12T17:26:34.726747+0000","last_clean":"2020-11-12T17:26:34.726747+0000","last_became_active":"2020-11-12T17:26:06.058701+0000","last_became_peered":"2020-11-12T17:26:06.058701+0000","last_unstale":"2020-11-12T17:26:34.726747+0000","last_undegraded":"2020-11-12T17:26:34.726747+0000","last_fullsized":"2020-11-12T17:26:34.726747+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:34.809567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:25:34.809567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"123'5158","reported_seq":"5218","reported_epoch":"123","state":"active+clean","last_fresh":"2020-11-12T17:26:36.637290+0000","last_change":"2020-11-12T17:24:51.720640+0000","last_active":"2020-11-12T17:26:36.637290+0000","last_peered":"2020-11-12T17:26:36.637290+0000","last_clean":"2020-11-12T17:26:36.637290+0000","last_became_active":"2020-11-12T17:24:51.719333+0000","last_became_peered":"2020-11-12T17:24:51.719333+0000","last_unstale":"2020-11-12T17:26:36.637290+0000","last_undegraded":"2020-11-12T17:26:36.637290+0000","last_fullsized":"2020-11-12T17:26:36.637290+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":5158,"ondisk_log_size":5158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5158,"num_write_kb":38400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"97","reported_epoch":"122","state":"peering","last_fresh":"2020-11-12T17:26:34.722393+0000","last_change":"2020-11-12T17:26:34.722918+0000","last_active":"2020-11-12T17:23:14.605262+0000","last_peered":"2020-11-12T17:23:11.525196+0000","last_clean":"2020-11-12T17:23:11.525196+0000","last_became_active":"2020-11-12T17:23:09.514487+0000","last_became_peered":"2020-11-12T17:23:09.514487+0000","last_unstale":"2020-11-12T17:26:34.722393+0000","last_undegraded":"2020-11-12T17:26:34.722393+0000","last_fullsized":"2020-11-12T17:26:34.722393+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:38.366685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:38.366685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"121'5235","reported_seq":"5296","reported_epoch":"122","state":"active+clean","last_fresh":"2020-11-12T17:26:34.728018+0000","last_change":"2020-11-12T17:24:50.865566+0000","last_active":"2020-11-12T17:26:34.728018+0000","last_peered":"2020-11-12T17:26:34.728018+0000","last_clean":"2020-11-12T17:26:34.728018+0000","last_became_active":"2020-11-12T17:24:50.865159+0000","last_became_peered":"2020-11-12T17:24:50.865159+0000","last_unstale":"2020-11-12T17:26:34.728018+0000","last_undegraded":"2020-11-12T17:26:34.728018+0000","last_fullsized":"2020-11-12T17:26:34.728018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:49.824719+0000","last_clean_scrub_stamp":"2020-11-12T17:24:49.824719+0000","log_size":5235,"ondisk_log_size":5235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5235,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"109","reported_epoch":"121","state":"active+clean","last_fresh":"2020-11-12T17:26:33.721278+0000","last_change":"2020-11-12T17:25:37.363305+0000","last_active":"2020-11-12T17:26:33.721278+0000","last_peered":"2020-11-12T17:26:33.721278+0000","last_clean":"2020-11-12T17:26:33.721278+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:26:33.721278+0000","last_undegraded":"2020-11-12T17:26:33.721278+0000","last_fullsized":"2020-11-12T17:26:33.721278+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:37.363220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:25:37.363220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":280248344,"num_objects":4278,"num_object_clones":0,"num_object_copies":8556,"num_objects_missing_on_primary":616,"num_objects_missing":777,"num_objects_degraded":625,"num_objects_misplaced":426,"num_objects_unfound":0,"num_objects_dirty":4278,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":81659,"num_write_kb":611089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7257,"num_bytes_recovered":452313112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":310411264,"data_stored":757661744,"data_compressed":4249650,"data_compressed_allocated":310403072,"data_compressed_original":757661696,"omap_allocated":0,"internal_metadata":0},"log_size":81659,"ondisk_log_size":81659,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542192,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1081240,"kb_used_data":32656,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93290600,"statfs":{"total":96636764160,"available":95529574400,"internally_reserved":1073741824,"allocated":33439744,"data_stored":77591384,"data_compressed":447587,"data_compressed_allocated":32788480,"data_compressed_original":77332480,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.466,"15min":1.534},"min":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.2949999999999999,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":2.1970000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.8460000000000001,"15min":2.0459999999999998},"min":{"1min":0.80800000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.2280000000000002,"5min":7.4349999999999996,"15min":7.4349999999999996},"last":1.4019999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:26:34 2020","interfaces":[{"interface":"back","average":{"1min":7.226,"5min":7.226,"15min":7.226},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":102.354,"5min":102.354,"15min":102.354},"last":0.91000000000000003},{"interface":"front","average":{"1min":6.8630000000000004,"5min":6.8630000000000004,"15min":6.8630000000000004},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":102.08199999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.617}]},{"osd":2,"last update":"Thu Nov 12 17:24:54 2020","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.6120000000000001,"15min":1.6339999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.694},{"interface":"front","average":{"1min":1.645,"5min":2.0830000000000002,"15min":2.1560000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.9769999999999999,"5min":7.6310000000000002,"15min":7.6310000000000002},"last":2.653}]},{"osd":3,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.863,"15min":2.0950000000000002},"min":{"1min":0.79700000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.4630000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.581,"5min":8.5990000000000002,"15min":4.5389999999999997},"min":{"1min":0.871,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5630000000000002,"5min":871.76700000000005,"15min":871.76700000000005},"last":1.756}]},{"osd":4,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":7.9630000000000001,"5min":35.207000000000001,"15min":47.573999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":110.66800000000001,"5min":503.50200000000001,"15min":503.50200000000001},"last":2.101},{"interface":"front","average":{"1min":7.6310000000000002,"5min":3.105,"15min":2.371},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":108.14,"5min":108.14,"15min":108.14},"last":2.601}]},{"osd":5,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.7390000000000001,"5min":2.3759999999999999,"15min":2.6200000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.5259999999999998,"5min":7.7169999999999996,"15min":7.7169999999999996},"last":2.367},{"interface":"front","average":{"1min":1.865,"5min":2.4900000000000002,"15min":2.742},"min":{"1min":1.131,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.597,"5min":7.7480000000000002,"15min":7.7480000000000002},"last":2.399}]},{"osd":6,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":24.794,"5min":6.9850000000000003,"15min":4.202},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":375.04199999999997,"5min":375.04199999999997,"15min":375.04199999999997},"last":2.867},{"interface":"front","average":{"1min":1.2470000000000001,"5min":39.052999999999997,"15min":48.645000000000003},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.8159999999999998,"5min":975.20899999999995,"15min":975.20899999999995},"last":2.1509999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1096344,"kb_used_data":47760,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93275496,"statfs":{"total":96636764160,"available":95514107904,"internally_reserved":1073741824,"allocated":48906240,"data_stored":114356174,"data_compressed":658980,"data_compressed_allocated":48263168,"data_compressed_original":114098176,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.597,"15min":1.7490000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.3180000000000001,"5min":3.339,"15min":3.339},"last":5.0309999999999997},{"interface":"front","average":{"1min":1.385,"5min":1.849,"15min":2.0369999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6019999999999999,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":4.5810000000000004}]},{"osd":1,"last update":"Thu Nov 12 17:26:32 2020","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":4.6959999999999997},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":4.4370000000000003}]},{"osd":2,"last update":"Thu Nov 12 17:24:48 2020","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":2.0800000000000001,"15min":2.1789999999999998},"min":{"1min":0.79400000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6099999999999999,"5min":5.4329999999999998,"15min":5.4329999999999998},"last":4.5380000000000003},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.1819999999999999,"15min":2.27},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3130000000000002,"5min":8.0969999999999995,"15min":8.0969999999999995},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":2.8900000000000001,"15min":2.7909999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.3360000000000003,"5min":49.442999999999998,"15min":49.442999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.8660000000000001,"5min":2.2290000000000001,"15min":2.3999999999999999},"min":{"1min":0.93100000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":6.2809999999999997,"5min":8.202,"15min":8.202},"last":4.7359999999999998}]},{"osd":4,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":23.341000000000001,"5min":6.3440000000000003,"15min":3.5990000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":459.15499999999997,"5min":459.15499999999997,"15min":459.15499999999997},"last":5.0789999999999997},{"interface":"front","average":{"1min":1.595,"5min":2.4969999999999999,"15min":2.8660000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.6589999999999998,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":4.6340000000000003}]},{"osd":6,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":2.1389999999999998,"15min":2.274},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":6.3300000000000001,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":4.4660000000000002},{"interface":"front","average":{"1min":1.7370000000000001,"5min":2.1299999999999999,"15min":2.2919999999999998},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":4.8440000000000003,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":5.1210000000000004}]},{"osd":7,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":3.0009999999999999,"15min":3.069},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":4.1070000000000002,"5min":40.268000000000001,"15min":40.268000000000001},"last":4.9939999999999998},{"interface":"front","average":{"1min":2.0339999999999998,"5min":2.5209999999999999,"15min":2.7770000000000001},"min":{"1min":1.097,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":6.1470000000000002,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":3.9420000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1123132,"kb_used_data":74440,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93248708,"statfs":{"total":96636764160,"available":95486676992,"internally_reserved":1073741824,"allocated":76226560,"data_stored":151401322,"data_compressed":1014750,"data_compressed_allocated":75571200,"data_compressed_original":151142400,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":21.207000000000001,"5min":5.4740000000000002,"15min":2.8799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":358.101,"5min":358.101,"15min":358.101},"last":6.9939999999999998},{"interface":"front","average":{"1min":20.922999999999998,"5min":32.770000000000003,"15min":42.277999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":357.41199999999998,"5min":948.30899999999997,"15min":948.30899999999997},"last":0.878}]},{"osd":1,"last update":"Thu Nov 12 17:26:32 2020","interfaces":[{"interface":"back","average":{"1min":19.036000000000001,"5min":19.036000000000001,"15min":19.036000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":356.46699999999998,"5min":356.46699999999998,"15min":356.46699999999998},"last":7.4329999999999998},{"interface":"front","average":{"1min":18.934000000000001,"5min":18.934000000000001,"15min":18.934000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":356.18599999999998,"5min":356.18599999999998,"15min":356.18599999999998},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Nov 12 17:24:49 2020","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.7230000000000001,"15min":1.7549999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":6.9630000000000001},{"interface":"front","average":{"1min":1.7370000000000001,"5min":1.8400000000000001,"15min":1.857},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":1.2729999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":21.018000000000001,"5min":5.8150000000000004,"15min":3.2970000000000002},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":356.02300000000002,"5min":356.02300000000002,"15min":356.02300000000002},"last":7.5629999999999997},{"interface":"front","average":{"1min":21.254999999999999,"5min":5.9349999999999996,"15min":3.4220000000000002},"min":{"1min":0.751,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":357.79000000000002,"5min":357.79000000000002,"15min":357.79000000000002},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Nov 12 17:25:50 2020","interfaces":[{"interface":"back","average":{"1min":53.131999999999998,"5min":12.183999999999999,"15min":5.4299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":575.16800000000001,"5min":575.16800000000001,"15min":575.16800000000001},"last":6.9089999999999998},{"interface":"front","average":{"1min":71.412999999999997,"5min":16.030999999999999,"15min":6.851},"min":{"1min":0.78000000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":908.52700000000004,"5min":908.52700000000004,"15min":908.52700000000004},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":21.048999999999999,"5min":24.763000000000002,"15min":30.684999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":356.57900000000001,"5min":665.13999999999999,"15min":665.13999999999999},"last":7.3940000000000001},{"interface":"front","average":{"1min":21.399999999999999,"5min":5.9889999999999999,"15min":3.4910000000000001},"min":{"1min":0.92500000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":359.05200000000002,"5min":359.05200000000002,"15min":359.05200000000002},"last":7.0289999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":33.764000000000003,"5min":14.426,"15min":6.4039999999999999},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":358.29199999999997,"5min":584.00300000000004,"15min":584.00300000000004},"last":1.2330000000000001},{"interface":"front","average":{"1min":21.434999999999999,"5min":6.0549999999999997,"15min":3.4769999999999999},"min":{"1min":1.0880000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":358.06,"5min":358.06,"15min":358.06},"last":7.9489999999999998}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1114400,"kb_used_data":65704,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93257440,"statfs":{"total":96636764160,"available":95495618560,"internally_reserved":1073741824,"allocated":67280896,"data_stored":133510156,"data_compressed":893190,"data_compressed_allocated":66625536,"data_compressed_original":133251072,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.649,"15min":1.728},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4260000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.379,"5min":1.8,"15min":1.974},"min":{"1min":0.85899999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1930000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.468}]},{"osd":1,"last update":"Thu Nov 12 17:26:32 2020","interfaces":[{"interface":"back","average":{"1min":42.832999999999998,"5min":42.832999999999998,"15min":42.832999999999998},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":665.476,"5min":665.476,"15min":665.476},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.6519999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:24:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.954,"15min":2.0329999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.4390000000000001,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.9470000000000001,"15min":2.0219999999999998},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.2989999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.534}]},{"osd":3,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.9390000000000001,"15min":2.0529999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.6720000000000002,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":3.2360000000000002},{"interface":"front","average":{"1min":1.5429999999999999,"5min":2.1320000000000001,"15min":2.3500000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3490000000000002,"5min":9.2550000000000008,"15min":9.2550000000000008},"last":3.2839999999999998}]},{"osd":4,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.9810000000000001,"15min":2.1469999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.7559999999999998,"5min":6.3049999999999997,"15min":6.3049999999999997},"last":1.5669999999999999},{"interface":"front","average":{"1min":10.989000000000001,"5min":4.1109999999999998,"15min":3.1509999999999998},"min":{"1min":0.91500000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":169.80799999999999,"5min":169.80799999999999,"15min":169.80799999999999},"last":3.8079999999999998}]},{"osd":5,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":94.287999999999997,"5min":20.582999999999998,"15min":8.3810000000000002},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":804.62199999999996,"5min":804.62199999999996,"15min":804.62199999999996},"last":1.6839999999999999},{"interface":"front","average":{"1min":28.815000000000001,"5min":19.753,"15min":21.745000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":494.78399999999999,"5min":494.78399999999999,"15min":494.78399999999999},"last":1.609}]},{"osd":7,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":79.114999999999995,"5min":17.864000000000001,"15min":7.8079999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1002.347,"5min":1002.347,"15min":1002.347},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.9019999999999999,"5min":2.4100000000000001,"15min":2.4860000000000002},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5739999999999998,"5min":10.271000000000001,"15min":10.271000000000001},"last":1.7210000000000001}]}]},{"osd":0,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":102,"seq":438086664201,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050720,"kb_used_data":2136,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93321120,"statfs":{"total":96636764160,"available":95560826880,"internally_reserved":1073741824,"allocated":2187264,"data_stored":25303170,"data_compressed":34678,"data_compressed_allocated":1568768,"data_compressed_original":25051136,"omap_allocated":4385,"internal_metadata":1073737439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9889999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5430000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.319}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1640000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1093624,"kb_used_data":45040,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93278216,"statfs":{"total":96636764160,"available":95516893184,"internally_reserved":1073741824,"allocated":46120960,"data_stored":103942346,"data_compressed":618171,"data_compressed_allocated":45445120,"data_compressed_original":103677952,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":3.7719999999999998,"15min":2.456},"min":{"1min":0.60099999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4849999999999999,"5min":178.36699999999999,"15min":178.36699999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.915,"15min":1.9430000000000001},"min":{"1min":0.79600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.6509999999999998,"5min":16.902000000000001,"15min":16.902000000000001},"last":1.0409999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:26:34 2020","interfaces":[{"interface":"back","average":{"1min":38.305999999999997,"5min":38.305999999999997,"15min":38.305999999999997},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":501.91199999999998,"5min":501.91199999999998,"15min":501.91199999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":26.684000000000001,"5min":26.684000000000001,"15min":26.684000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":501.774,"5min":501.774,"15min":501.774},"last":1.2110000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:24:50 2020","interfaces":[{"interface":"back","average":{"1min":6.5069999999999997,"5min":3.1789999999999998,"15min":2.6240000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":86.161000000000001,"5min":86.161000000000001,"15min":86.161000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.8819999999999999,"15min":1.956},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4300000000000002,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":1.8460000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":2.246,"15min":2.4420000000000002},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":3.2509999999999999,"5min":10.318,"15min":10.318},"last":2.339},{"interface":"front","average":{"1min":1.446,"5min":2.1400000000000001,"15min":2.3780000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.411,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":1.6699999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":20.111000000000001,"15min":28.177},"min":{"1min":0.96999999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.8530000000000002,"5min":622.07799999999997,"15min":622.07799999999997},"last":1.9430000000000001},{"interface":"front","average":{"1min":1.9039999999999999,"5min":2.524,"15min":2.746},"min":{"1min":1.0640000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.3170000000000002,"5min":10.436,"15min":10.436},"last":1.74}]},{"osd":6,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":2.552,"5min":2.4769999999999999,"15min":2.5750000000000002},"min":{"1min":0.95599999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":20.686,"5min":20.686,"15min":20.686},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.8660000000000001,"5min":2.3999999999999999,"15min":2.6320000000000001},"min":{"1min":1.294,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.7450000000000001,"5min":11.497999999999999,"15min":11.497999999999999},"last":2.0670000000000002}]},{"osd":7,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":2.5489999999999999,"15min":2.8029999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.363,"5min":10.513999999999999,"15min":10.513999999999999},"last":2.1040000000000001},{"interface":"front","average":{"1min":1.837,"5min":18.891999999999999,"15min":26.423999999999999},"min":{"1min":1.115,"5min":1.016,"15min":1.016},"max":{"1min":3.1520000000000001,"5min":577.35900000000004,"15min":577.35900000000004},"last":1.903}]}]}]}} 2020-11-12T17:26:40.101 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set unique_pool_1 pgp_num 16 2020-11-12T17:26:40.157 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:40.154+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:40.161 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:40.161 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:40.174 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:40.259 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:40.254+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:40.347 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:40.348 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:40.360 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:40.358+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:40.362 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:40.461 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:40.456+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:40.496 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:40.497 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:40.508 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:40.543 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:40.544 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:26:40.563 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:40.558+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:40.663 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:40.660+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:40.697 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:40.698 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:40.713 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:40.783 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:40.783 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:40.776+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:40.815 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:40.865 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:40.860+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:40.866 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:40.905 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:40.909 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:40.909 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:40.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:40.909 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:40.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.909 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.d 119/117 [PushOp(4:bf702507:::benchmark_data_smithi036_18856_object7341:head, version: 101'3928, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:bf702507:::benchmark_data_smithi036_18856_object7341:head@101'3928, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:40.910 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:32.487099+0000", 2020-11-12T17:26:40.910 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.4202954200000004, 2020-11-12T17:26:40.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.041114368999999998, 2020-11-12T17:26:40.910 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.910 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:40.910 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.487099+0000", 2020-11-12T17:26:40.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.487099+0000", 2020-11-12T17:26:40.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:26:40.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.487064+0000", 2020-11-12T17:26:40.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011362300000000001 2020-11-12T17:26:40.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.487178+0000", 2020-11-12T17:26:40.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.038340676999999997 2020-11-12T17:26:40.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.525519+0000", 2020-11-12T17:26:40.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3584000000000001e-05 2020-11-12T17:26:40.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.525532+0000", 2020-11-12T17:26:40.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108614 2020-11-12T17:26:40.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.525641+0000", 2020-11-12T17:26:40.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1654000000000001e-05 2020-11-12T17:26:40.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:40.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.525653+0000", 2020-11-12T17:26:40.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002560803 2020-11-12T17:26:40.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:40.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.528213+0000", 2020-11-12T17:26:40.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.041114368999999998 2020-11-12T17:26:40.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.918 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:40.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.919 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.d 119/117 [PushOp(4:b0af8a00:::benchmark_data_smithi036_18856_object7437:head, version: 101'3984, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:b0af8a00:::benchmark_data_smithi036_18856_object7437:head@101'3984, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:40.919 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:32.639692+0000", 2020-11-12T17:26:40.919 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.2677022400000002, 2020-11-12T17:26:40.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.059067623, 2020-11-12T17:26:40.919 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.919 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:40.919 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.639692+0000", 2020-11-12T17:26:40.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.639692+0000", 2020-11-12T17:26:40.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:26:40.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.639667+0000", 2020-11-12T17:26:40.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3287000000000003e-05 2020-11-12T17:26:40.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.639760+0000", 2020-11-12T17:26:40.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.052718190999999998 2020-11-12T17:26:40.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.692478+0000", 2020-11-12T17:26:40.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1688000000000001e-05 2020-11-12T17:26:40.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.692490+0000", 2020-11-12T17:26:40.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010102699999999999 2020-11-12T17:26:40.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.692591+0000", 2020-11-12T17:26:40.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.747e-06 2020-11-12T17:26:40.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:40.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.692601+0000", 2020-11-12T17:26:40.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0061592390000000004 2020-11-12T17:26:40.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:40.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.698760+0000", 2020-11-12T17:26:40.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.059067623 2020-11-12T17:26:40.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.927 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:40.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.928 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.d 120/117 [PushOp(4:ba7df4d3:::benchmark_data_smithi036_18856_object7655:head, version: 103'4056, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:ba7df4d3:::benchmark_data_smithi036_18856_object7655:head@103'4056, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:40.928 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:32.750640+0000", 2020-11-12T17:26:40.928 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.1567542189999998, 2020-11-12T17:26:40.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.054366113000000001, 2020-11-12T17:26:40.928 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.928 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:40.929 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.750640+0000", 2020-11-12T17:26:40.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.750640+0000", 2020-11-12T17:26:40.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:26:40.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.750614+0000", 2020-11-12T17:26:40.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3597999999999994e-05 2020-11-12T17:26:40.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.750708+0000", 2020-11-12T17:26:40.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.052176553000000001 2020-11-12T17:26:40.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.802885+0000", 2020-11-12T17:26:40.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0604e-05 2020-11-12T17:26:40.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.802895+0000", 2020-11-12T17:26:40.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2064000000000007e-05 2020-11-12T17:26:40.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.802967+0000", 2020-11-12T17:26:40.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4490000000000005e-06 2020-11-12T17:26:40.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:40.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.802977+0000", 2020-11-12T17:26:40.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020296680000000001 2020-11-12T17:26:40.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:40.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:32.805006+0000", 2020-11-12T17:26:40.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.054366113000000001 2020-11-12T17:26:40.935 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.935 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:40.936 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.936 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.6 123/122 [PushOp(4:676c88aa:::benchmark_data_smithi036_18856_object5701:head, version: 92'2688, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:676c88aa:::benchmark_data_smithi036_18856_object5701:head@92'2688, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:40.936 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:35.808561+0000", 2020-11-12T17:26:40.936 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0988336890000001, 2020-11-12T17:26:40.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.083839379000000006, 2020-11-12T17:26:40.936 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.937 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:40.937 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:35.808561+0000", 2020-11-12T17:26:40.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:35.808561+0000", 2020-11-12T17:26:40.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:26:40.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:35.808530+0000", 2020-11-12T17:26:40.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016035999999999999 2020-11-12T17:26:40.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:35.808690+0000", 2020-11-12T17:26:40.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8015000000000004e-05 2020-11-12T17:26:40.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:35.808768+0000", 2020-11-12T17:26:40.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3132000000000001e-05 2020-11-12T17:26:40.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:35.808781+0000", 2020-11-12T17:26:40.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.078012338000000001 2020-11-12T17:26:40.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:35.886794+0000", 2020-11-12T17:26:40.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5123999999999994e-05 2020-11-12T17:26:40.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:40.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:35.886869+0000", 2020-11-12T17:26:40.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055313080000000004 2020-11-12T17:26:40.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:40.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:35.892400+0000", 2020-11-12T17:26:40.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.083839379000000006 2020-11-12T17:26:40.943 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.943 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:40.944 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.944 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.4 123/122 [PushOp(4:220c8448:::benchmark_data_smithi036_18856_object6827:head, version: 99'3320, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:220c8448:::benchmark_data_smithi036_18856_object6827:head@99'3320, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:40.944 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.074153+0000", 2020-11-12T17:26:40.944 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.8332411190000002, 2020-11-12T17:26:40.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.035874975000000003, 2020-11-12T17:26:40.945 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.945 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:40.945 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.074153+0000", 2020-11-12T17:26:40.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.074153+0000", 2020-11-12T17:26:40.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:26:40.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.074140+0000", 2020-11-12T17:26:40.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7878999999999999e-05 2020-11-12T17:26:40.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.074197+0000", 2020-11-12T17:26:40.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.027104375999999999 2020-11-12T17:26:40.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.101302+0000", 2020-11-12T17:26:40.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4137e-05 2020-11-12T17:26:40.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.101316+0000", 2020-11-12T17:26:40.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057133180000000002 2020-11-12T17:26:40.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.107029+0000", 2020-11-12T17:26:40.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8069000000000003e-05 2020-11-12T17:26:40.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:40.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.107087+0000", 2020-11-12T17:26:40.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029409150000000001 2020-11-12T17:26:40.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:40.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.110028+0000", 2020-11-12T17:26:40.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.035874975000000003 2020-11-12T17:26:40.951 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.951 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:40.951 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.952 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:81582 4.4 4:2b05b5d9:::benchmark_data_smithi036_18856_object5193:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:40.952 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.127383+0000", 2020-11-12T17:26:40.952 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.7800119199999997, 2020-11-12T17:26:40.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.036461634, 2020-11-12T17:26:40.952 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.952 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:40.953 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:40.953 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:40.953 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:40.953 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 81582 2020-11-12T17:26:40.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.953 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.127383+0000", 2020-11-12T17:26:40.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.127383+0000", 2020-11-12T17:26:40.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999447 2020-11-12T17:26:40.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.127327+0000", 2020-11-12T17:26:40.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1683999999999998e-05 2020-11-12T17:26:40.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.127419+0000", 2020-11-12T17:26:40.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3011e-05 2020-11-12T17:26:40.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.127432+0000", 2020-11-12T17:26:40.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9469999999999997e-06 2020-11-12T17:26:40.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.127439+0000", 2020-11-12T17:26:40.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001191166 2020-11-12T17:26:40.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.128630+0000", 2020-11-12T17:26:40.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000389787 2020-11-12T17:26:40.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:40.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.129020+0000", 2020-11-12T17:26:40.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00065230300000000002 2020-11-12T17:26:40.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:40.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.129672+0000", 2020-11-12T17:26:40.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020653780000000001 2020-11-12T17:26:40.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:40.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.131737+0000", 2020-11-12T17:26:40.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.031266264000000002 2020-11-12T17:26:40.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:40.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.163004+0000", 2020-11-12T17:26:40.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000150514 2020-11-12T17:26:40.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:40.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.163154+0000", 2020-11-12T17:26:40.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068999100000000004 2020-11-12T17:26:40.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:40.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.163844+0000", 2020-11-12T17:26:40.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.036461634 2020-11-12T17:26:40.965 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.965 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:40.965 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.965 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.4 123/122 [PushOp(4:2623cc7a:::benchmark_data_smithi036_18856_object7045:head, version: 100'3424, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:2623cc7a:::benchmark_data_smithi036_18856_object7045:head@100'3424, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:40.966 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.290017+0000", 2020-11-12T17:26:40.966 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.6173773120000003, 2020-11-12T17:26:40.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.045383659, 2020-11-12T17:26:40.966 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.966 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:40.966 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.290017+0000", 2020-11-12T17:26:40.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.290017+0000", 2020-11-12T17:26:40.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:40.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.289999+0000", 2020-11-12T17:26:40.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3799000000000003e-05 2020-11-12T17:26:40.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.290073+0000", 2020-11-12T17:26:40.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.028772155000000001 2020-11-12T17:26:40.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.318845+0000", 2020-11-12T17:26:40.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8603000000000001e-05 2020-11-12T17:26:40.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.318864+0000", 2020-11-12T17:26:40.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013496678999999999 2020-11-12T17:26:40.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.332361+0000", 2020-11-12T17:26:40.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9082999999999998e-05 2020-11-12T17:26:40.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:40.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.332400+0000", 2020-11-12T17:26:40.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030011399999999998 2020-11-12T17:26:40.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:40.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.335401+0000", 2020-11-12T17:26:40.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.045383659 2020-11-12T17:26:40.972 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.973 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:40.973 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.974 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.4 123/122 [PushOp(4:2b77b25c:::benchmark_data_smithi036_18856_object7097:head, version: 100'3448, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:2b77b25c:::benchmark_data_smithi036_18856_object7097:head@100'3448, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:40.974 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.371912+0000", 2020-11-12T17:26:40.974 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.5354828559999998, 2020-11-12T17:26:40.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.052181198999999998, 2020-11-12T17:26:40.975 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.975 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:40.975 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.371912+0000", 2020-11-12T17:26:40.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.371912+0000", 2020-11-12T17:26:40.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:40.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.371886+0000", 2020-11-12T17:26:40.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9675999999999999e-05 2020-11-12T17:26:40.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.371986+0000", 2020-11-12T17:26:40.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.049000637 2020-11-12T17:26:40.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.420986+0000", 2020-11-12T17:26:40.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3186e-05 2020-11-12T17:26:40.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.421000+0000", 2020-11-12T17:26:40.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014178500000000001 2020-11-12T17:26:40.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.421141+0000", 2020-11-12T17:26:40.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8282999999999998e-05 2020-11-12T17:26:40.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:40.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.421190+0000", 2020-11-12T17:26:40.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029030269999999999 2020-11-12T17:26:40.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:40.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.424093+0000", 2020-11-12T17:26:40.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.052181198999999998 2020-11-12T17:26:40.982 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.982 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:40.982 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.983 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:81929 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:40.983 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.530683+0000", 2020-11-12T17:26:40.983 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.3767109609999997, 2020-11-12T17:26:40.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063181550000000003, 2020-11-12T17:26:40.983 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.983 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:40.984 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:40.984 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:40.984 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:40.984 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 81929 2020-11-12T17:26:40.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.984 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.530683+0000", 2020-11-12T17:26:40.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.530683+0000", 2020-11-12T17:26:40.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:26:40.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.530641+0000", 2020-11-12T17:26:40.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9625999999999999e-05 2020-11-12T17:26:40.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.530730+0000", 2020-11-12T17:26:40.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5186e-05 2020-11-12T17:26:40.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.530746+0000", 2020-11-12T17:26:40.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3365e-05 2020-11-12T17:26:40.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.530759+0000", 2020-11-12T17:26:40.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017373900000000001 2020-11-12T17:26:40.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.530933+0000", 2020-11-12T17:26:40.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00065835600000000002 2020-11-12T17:26:40.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:40.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.531591+0000", 2020-11-12T17:26:40.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00085430200000000003 2020-11-12T17:26:40.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:40.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.532445+0000", 2020-11-12T17:26:40.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0099395430000000003 2020-11-12T17:26:40.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:40.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.542385+0000", 2020-11-12T17:26:40.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.050504092 2020-11-12T17:26:40.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:40.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.592889+0000", 2020-11-12T17:26:40.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024214000000000001 2020-11-12T17:26:40.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:40.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.593131+0000", 2020-11-12T17:26:40.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00073392800000000001 2020-11-12T17:26:40.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:40.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.593865+0000", 2020-11-12T17:26:40.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.063181550000000003 2020-11-12T17:26:40.993 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.993 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:40.993 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:40.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.994 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:81929 4.4 e123/122 ondisk, result = 0)", 2020-11-12T17:26:40.994 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.537316+0000", 2020-11-12T17:26:40.994 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.3700783359999997, 2020-11-12T17:26:40.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.056555589000000003, 2020-11-12T17:26:40.994 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:40.994 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:40.994 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:40.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:40.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.537316+0000", 2020-11-12T17:26:40.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:40.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:40.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.537316+0000", 2020-11-12T17:26:40.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:26:40.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:40.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.537293+0000", 2020-11-12T17:26:40.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9552999999999997e-05 2020-11-12T17:26:40.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:40.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.537352+0000", 2020-11-12T17:26:40.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.052172606000000003 2020-11-12T17:26:40.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:40.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.589525+0000", 2020-11-12T17:26:40.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.302e-06 2020-11-12T17:26:40.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:40.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.589531+0000", 2020-11-12T17:26:40.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0032674140000000002 2020-11-12T17:26:40.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:40.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:40.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:40.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.592799+0000", 2020-11-12T17:26:40.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5821000000000001e-05 2020-11-12T17:26:40.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.592845+0000", 2020-11-12T17:26:41.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001027151 2020-11-12T17:26:41.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.593872+0000", 2020-11-12T17:26:41.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.056555589000000003 2020-11-12T17:26:41.001 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.001 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.001 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.001 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.4 123/122 [PushOp(4:2e0266fb:::benchmark_data_smithi036_18856_object7241:head, version: 101'3568, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:2e0266fb:::benchmark_data_smithi036_18856_object7241:head@101'3568, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:41.002 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.653444+0000", 2020-11-12T17:26:41.002 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.253950723, 2020-11-12T17:26:41.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.042057750999999997, 2020-11-12T17:26:41.002 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.002 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.002 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.653444+0000", 2020-11-12T17:26:41.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.653444+0000", 2020-11-12T17:26:41.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:41.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.653420+0000", 2020-11-12T17:26:41.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6104e-05 2020-11-12T17:26:41.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.653516+0000", 2020-11-12T17:26:41.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.038836266000000001 2020-11-12T17:26:41.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.692352+0000", 2020-11-12T17:26:41.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3739999999999998e-06 2020-11-12T17:26:41.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.692361+0000", 2020-11-12T17:26:41.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013939000000000001 2020-11-12T17:26:41.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.692500+0000", 2020-11-12T17:26:41.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1533999999999998e-05 2020-11-12T17:26:41.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.692552+0000", 2020-11-12T17:26:41.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002949826 2020-11-12T17:26:41.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.695501+0000", 2020-11-12T17:26:41.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.042057750999999997 2020-11-12T17:26:41.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.008 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.009 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.6 123/122 [PushOp(4:60824407:::benchmark_data_smithi036_18856_object6950:head, version: 100'3208, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:60824407:::benchmark_data_smithi036_18856_object6950:head@100'3208, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:41.009 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:26:41.009 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.2201113880000003, 2020-11-12T17:26:41.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998, 2020-11-12T17:26:41.009 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.010 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.010 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:26:41.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:26:41.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:26:41.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687268+0000", 2020-11-12T17:26:41.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2052999999999994e-05 2020-11-12T17:26:41.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687360+0000", 2020-11-12T17:26:41.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54419334699999999 2020-11-12T17:26:41.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231553+0000", 2020-11-12T17:26:41.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.362e-06 2020-11-12T17:26:41.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231560+0000", 2020-11-12T17:26:41.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000185682 2020-11-12T17:26:41.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231746+0000", 2020-11-12T17:26:41.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0793e-05 2020-11-12T17:26:41.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231797+0000", 2020-11-12T17:26:41.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003344549 2020-11-12T17:26:41.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.235141+0000", 2020-11-12T17:26:41.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998 2020-11-12T17:26:41.016 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.016 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.016 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.017 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:82109 4.4 4:2e48640b:::benchmark_data_smithi036_18856_object5720:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:41.017 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.737812+0000", 2020-11-12T17:26:41.017 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.1695823770000002, 2020-11-12T17:26:41.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.045698964000000002, 2020-11-12T17:26:41.017 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.017 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.017 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.018 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.018 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.018 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 82109 2020-11-12T17:26:41.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.018 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.737812+0000", 2020-11-12T17:26:41.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.737812+0000", 2020-11-12T17:26:41.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:41.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.737782+0000", 2020-11-12T17:26:41.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7872000000000003e-05 2020-11-12T17:26:41.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.737850+0000", 2020-11-12T17:26:41.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2455e-05 2020-11-12T17:26:41.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.737862+0000", 2020-11-12T17:26:41.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0959e-05 2020-11-12T17:26:41.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.737873+0000", 2020-11-12T17:26:41.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00039366599999999998 2020-11-12T17:26:41.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.738267+0000", 2020-11-12T17:26:41.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00043960100000000002 2020-11-12T17:26:41.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.738707+0000", 2020-11-12T17:26:41.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00056550899999999996 2020-11-12T17:26:41.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:41.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.739272+0000", 2020-11-12T17:26:41.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025644489999999999 2020-11-12T17:26:41.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.741837+0000", 2020-11-12T17:26:41.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.040661903999999999 2020-11-12T17:26:41.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.782499+0000", 2020-11-12T17:26:41.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021546299999999999 2020-11-12T17:26:41.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.782714+0000", 2020-11-12T17:26:41.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079703100000000002 2020-11-12T17:26:41.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.783511+0000", 2020-11-12T17:26:41.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.045698964000000002 2020-11-12T17:26:41.027 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.027 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.027 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.027 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:82109 4.4 e123/122 ondisk, result = 0)", 2020-11-12T17:26:41.027 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.745012+0000", 2020-11-12T17:26:41.028 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.1623828569999999, 2020-11-12T17:26:41.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.038523900999999999, 2020-11-12T17:26:41.028 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.028 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.028 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.745012+0000", 2020-11-12T17:26:41.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.745012+0000", 2020-11-12T17:26:41.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999876 2020-11-12T17:26:41.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.744999+0000", 2020-11-12T17:26:41.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5206000000000001e-05 2020-11-12T17:26:41.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.745045+0000", 2020-11-12T17:26:41.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.035907779000000001 2020-11-12T17:26:41.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.780952+0000", 2020-11-12T17:26:41.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8060000000000001e-06 2020-11-12T17:26:41.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.780961+0000", 2020-11-12T17:26:41.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001426432 2020-11-12T17:26:41.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.782388+0000", 2020-11-12T17:26:41.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0844999999999998e-05 2020-11-12T17:26:41.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.782448+0000", 2020-11-12T17:26:41.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00108701 2020-11-12T17:26:41.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.783535+0000", 2020-11-12T17:26:41.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.038523900999999999 2020-11-12T17:26:41.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.035 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.035 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:82166 4.4 4:23a51028:::benchmark_data_smithi036_18856_object5777:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:41.035 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.807960+0000", 2020-11-12T17:26:41.036 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.0994348430000001, 2020-11-12T17:26:41.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.046021716999999997, 2020-11-12T17:26:41.036 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.036 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.036 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.036 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.036 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.036 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 82166 2020-11-12T17:26:41.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.037 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.807960+0000", 2020-11-12T17:26:41.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.807960+0000", 2020-11-12T17:26:41.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:41.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.807939+0000", 2020-11-12T17:26:41.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7116000000000001e-05 2020-11-12T17:26:41.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.807986+0000", 2020-11-12T17:26:41.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5599999999999999e-06 2020-11-12T17:26:41.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.807995+0000", 2020-11-12T17:26:41.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4009999999999997e-06 2020-11-12T17:26:41.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.808004+0000", 2020-11-12T17:26:41.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058237899999999995 2020-11-12T17:26:41.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.808586+0000", 2020-11-12T17:26:41.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00056008100000000003 2020-11-12T17:26:41.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.809146+0000", 2020-11-12T17:26:41.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00061691999999999997 2020-11-12T17:26:41.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:41.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.809763+0000", 2020-11-12T17:26:41.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033454969999999998 2020-11-12T17:26:41.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.813109+0000", 2020-11-12T17:26:41.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.039700570999999997 2020-11-12T17:26:41.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.852809+0000", 2020-11-12T17:26:41.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00037960199999999999 2020-11-12T17:26:41.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.853189+0000", 2020-11-12T17:26:41.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000792616 2020-11-12T17:26:41.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.853981+0000", 2020-11-12T17:26:41.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.046021716999999997 2020-11-12T17:26:41.045 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.046 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.046 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.046 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:82871 4.d e123/117 4:bb473acb:::benchmark_data_smithi036_18856_object6482:head v 123'5376, mlcod=123'5370)", 2020-11-12T17:26:41.046 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:37.636977+0000", 2020-11-12T17:26:41.046 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.2704176679999999, 2020-11-12T17:26:41.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.038175710000000002, 2020-11-12T17:26:41.047 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.047 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.047 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.636977+0000", 2020-11-12T17:26:41.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.636977+0000", 2020-11-12T17:26:41.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:41.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.636948+0000", 2020-11-12T17:26:41.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1990999999999995e-05 2020-11-12T17:26:41.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.637030+0000", 2020-11-12T17:26:41.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.034043217000000001 2020-11-12T17:26:41.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.671073+0000", 2020-11-12T17:26:41.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1459e-05 2020-11-12T17:26:41.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.671084+0000", 2020-11-12T17:26:41.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9004e-05 2020-11-12T17:26:41.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.671133+0000", 2020-11-12T17:26:41.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7702999999999999e-05 2020-11-12T17:26:41.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.671161+0000", 2020-11-12T17:26:41.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0039562829999999997 2020-11-12T17:26:41.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.675117+0000", 2020-11-12T17:26:41.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5051e-05 2020-11-12T17:26:41.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.675152+0000", 2020-11-12T17:26:41.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.038175710000000002 2020-11-12T17:26:41.054 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.054 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.054 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.054 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:82903 4.d e123/117 4:bb9fa3cd:::benchmark_data_smithi036_18856_object6514:head v 123'5378, mlcod=123'5374)", 2020-11-12T17:26:41.055 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:37.670998+0000", 2020-11-12T17:26:41.055 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.2363959599999998, 2020-11-12T17:26:41.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.034413949999999999, 2020-11-12T17:26:41.055 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.055 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.055 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.670998+0000", 2020-11-12T17:26:41.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.670998+0000", 2020-11-12T17:26:41.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:41.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.670974+0000", 2020-11-12T17:26:41.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6760000000000004e-05 2020-11-12T17:26:41.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.671051+0000", 2020-11-12T17:26:41.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.032179766999999998 2020-11-12T17:26:41.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.703230+0000", 2020-11-12T17:26:41.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0194999999999999e-05 2020-11-12T17:26:41.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.703250+0000", 2020-11-12T17:26:41.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8677000000000002e-05 2020-11-12T17:26:41.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.703299+0000", 2020-11-12T17:26:41.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9126e-05 2020-11-12T17:26:41.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.703318+0000", 2020-11-12T17:26:41.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002017095 2020-11-12T17:26:41.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.705335+0000", 2020-11-12T17:26:41.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7034999999999997e-05 2020-11-12T17:26:41.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.705412+0000", 2020-11-12T17:26:41.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.034413949999999999 2020-11-12T17:26:41.062 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.062 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.062 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.063 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:82926 4.d e123/117 4:b6817efd:::benchmark_data_smithi036_18856_object6537:head v 123'5379, mlcod=123'5376)", 2020-11-12T17:26:41.063 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:37.703149+0000", 2020-11-12T17:26:41.063 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.2042451999999999, 2020-11-12T17:26:41.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.071429758999999995, 2020-11-12T17:26:41.064 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.064 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.064 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.703149+0000", 2020-11-12T17:26:41.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.703149+0000", 2020-11-12T17:26:41.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:26:41.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.703127+0000", 2020-11-12T17:26:41.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0464999999999997e-05 2020-11-12T17:26:41.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.703198+0000", 2020-11-12T17:26:41.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.066624129000000004 2020-11-12T17:26:41.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.769822+0000", 2020-11-12T17:26:41.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4669999999999998e-06 2020-11-12T17:26:41.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.769829+0000", 2020-11-12T17:26:41.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5109999999999999e-05 2020-11-12T17:26:41.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.769884+0000", 2020-11-12T17:26:41.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6543999999999999e-05 2020-11-12T17:26:41.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.769901+0000", 2020-11-12T17:26:41.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045926259999999998 2020-11-12T17:26:41.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.774493+0000", 2020-11-12T17:26:41.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5520999999999997e-05 2020-11-12T17:26:41.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.774579+0000", 2020-11-12T17:26:41.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.071429758999999995 2020-11-12T17:26:41.071 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.071 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.071 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.071 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4971.0:82976 4.d e123/117 4:b4349c3b:::benchmark_data_smithi036_18856_object6587:head v 123'5380, mlcod=123'5377)", 2020-11-12T17:26:41.072 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:37.769720+0000", 2020-11-12T17:26:41.072 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.1376742119999999, 2020-11-12T17:26:41.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.050066847999999997, 2020-11-12T17:26:41.072 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.072 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.072 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.769720+0000", 2020-11-12T17:26:41.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.769720+0000", 2020-11-12T17:26:41.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:26:41.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.769689+0000", 2020-11-12T17:26:41.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8988999999999997e-05 2020-11-12T17:26:41.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.769788+0000", 2020-11-12T17:26:41.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.044061863999999999 2020-11-12T17:26:41.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.813850+0000", 2020-11-12T17:26:41.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1920000000000002e-06 2020-11-12T17:26:41.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.813856+0000", 2020-11-12T17:26:41.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6588000000000001e-05 2020-11-12T17:26:41.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.813913+0000", 2020-11-12T17:26:41.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8586999999999999e-05 2020-11-12T17:26:41.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.813942+0000", 2020-11-12T17:26:41.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057866539999999996 2020-11-12T17:26:41.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.819728+0000", 2020-11-12T17:26:41.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8786000000000003e-05 2020-11-12T17:26:41.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.819787+0000", 2020-11-12T17:26:41.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.050066847999999997 2020-11-12T17:26:41.079 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.079 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.079 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.080 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:83131 4.6 4:685799c6:::benchmark_data_smithi036_18856_object6742:head [delete] snapc 0=[] ondisk+write+known_if_redirected e123)", 2020-11-12T17:26:41.080 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:37.960198+0000", 2020-11-12T17:26:41.080 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 2.9471968789999998, 2020-11-12T17:26:41.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.035145920999999997, 2020-11-12T17:26:41.080 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.080 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.081 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 83131 2020-11-12T17:26:41.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.081 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.960198+0000", 2020-11-12T17:26:41.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.960198+0000", 2020-11-12T17:26:41.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:41.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.960166+0000", 2020-11-12T17:26:41.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0998e-05 2020-11-12T17:26:41.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.960237+0000", 2020-11-12T17:26:41.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4622e-05 2020-11-12T17:26:41.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.960252+0000", 2020-11-12T17:26:41.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.464e-06 2020-11-12T17:26:41.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.960259+0000", 2020-11-12T17:26:41.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021703320000000001 2020-11-12T17:26:41.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.962429+0000", 2020-11-12T17:26:41.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00039614700000000001 2020-11-12T17:26:41.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.962826+0000", 2020-11-12T17:26:41.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00056741199999999999 2020-11-12T17:26:41.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:41.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.963393+0000", 2020-11-12T17:26:41.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0071683010000000002 2020-11-12T17:26:41.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.970561+0000", 2020-11-12T17:26:41.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.024126604999999999 2020-11-12T17:26:41.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.994688+0000", 2020-11-12T17:26:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022397899999999999 2020-11-12T17:26:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.994912+0000", 2020-11-12T17:26:41.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00043160399999999998 2020-11-12T17:26:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.995343+0000", 2020-11-12T17:26:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.035145920999999997 2020-11-12T17:26:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.090 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.091 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.091 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:41.093 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:41.093 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:41.093 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:41.093 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:41.093 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:41.094 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:41.094 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:41.094 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:41.094 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:41.094 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:41.094 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:41.095 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:41.095 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:41.090+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:41.095 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:41.193 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:41.188+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:41.260 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:41.261 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:41.261 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:41.261 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:41.272 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:41.294 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:41.290+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:41.396 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:41.392+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:41.430 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:41.431 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:41.431 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:41.431 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:41.431 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:41.443 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:41.444 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:41.438+0000 7f2809aaf700 -1 osd.6 124 handle_osd_map injecting map crc failure 2020-11-12T17:26:41.445 INFO:teuthology.orchestra.run.smithi036.stderr:set pool 4 pgp_num to 16 2020-11-12T17:26:41.447 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:26:41.496 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:41.494+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:41.551 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:41.670 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:41.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.671 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 216.44023329800001, 2020-11-12T17:26:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:41.672 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.673 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:41.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:41.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:41.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:41.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:41.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:41.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:41.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:41.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:41.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:41.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:41.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:41.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:41.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:41.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:41.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.696 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.697 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:41.698 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 216.43314150200001, 2020-11-12T17:26:41.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:41.699 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.699 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:41.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:41.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:41.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:41.709 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:41.710 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 207.00058200500001, 2020-11-12T17:26:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.711 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:41.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:41.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:41.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:41.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:41.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:41.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.726 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 173.05046191100001, 2020-11-12T17:26:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.727 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:41.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:41.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:41.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:41.737 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 170.944860019, 2020-11-12T17:26:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:41.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:41.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:41.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:41.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:41.747 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:41.748 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 139.59837668500001, 2020-11-12T17:26:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:41.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:41.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:41.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:41.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:41.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:41.759 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 130.602534883, 2020-11-12T17:26:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:41.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:41.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:41.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.66743148400001, 2020-11-12T17:26:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.767 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:41.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:41.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.902790992999996, 2020-11-12T17:26:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:41.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:41.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.780 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.646282309, 2020-11-12T17:26:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:41.781 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.782 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:41.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:41.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:41.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.791 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.646119939000002, 2020-11-12T17:26:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.792 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:41.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:41.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:41.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:41.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:41.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:41.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:41.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:41.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:41.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:41.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:41.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:41.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:41.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:41.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:41.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:41.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:41.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:41.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:41.801 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.802 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.802 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.802 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:41.802 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:41.802 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.637550951999998, 2020-11-12T17:26:41.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:41.803 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.803 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.803 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:41.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:41.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:41.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:41.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:41.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:41.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:41.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:41.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:41.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:41.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:41.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:41.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:41.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:41.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:41.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:41.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:41.809 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.809 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.809 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.810 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:41.810 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:41.810 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.133038502000005, 2020-11-12T17:26:41.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:41.810 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.810 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.810 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.810 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.811 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.811 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:41.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.811 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:41.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:41.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:41.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:41.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:41.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:41.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:41.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:41.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:41.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:41.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:41.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:41.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:41.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:41.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:41.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:41.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:41.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:41.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:41.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:41.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:41.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:41.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:41.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:41.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:41.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:41.820 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.820 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.820 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.820 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:41.820 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:41.820 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 63.647490216000001, 2020-11-12T17:26:41.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:41.821 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.821 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.821 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.821 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.821 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.821 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:41.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.822 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:41.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:41.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:41.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:41.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:41.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:41.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:41.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:41.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:41.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:41.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:41.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:41.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:41.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:41.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:41.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:41.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:41.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:41.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:41.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:41.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:41.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:41.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:41.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:41.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:41.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:41.830 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.830 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.831 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.831 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:41.831 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:41.831 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 60.574171784000001, 2020-11-12T17:26:41.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:41.831 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.832 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.832 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:41.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:41.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:41.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:41.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:41.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:41.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:41.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:41.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:41.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:41.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:41.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:41.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:41.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:41.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:41.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:41.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:41.838 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.838 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.838 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.838 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:41.838 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:41.839 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 59.518526807999997, 2020-11-12T17:26:41.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:41.839 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.839 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.839 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.839 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.839 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.839 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:41.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.840 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:41.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:41.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:41.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:41.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:41.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:41.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:41.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:41.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:41.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:41.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:41.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:41.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:41.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:41.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:41.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:41.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:41.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:41.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:41.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:41.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:41.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:41.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:41.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:41.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:41.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:41.848 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.848 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.848 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.849 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:41.849 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:41.849 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 59.130322436999997, 2020-11-12T17:26:41.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:41.849 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.850 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.850 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.850 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.850 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.850 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:41.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.850 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:41.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:41.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:41.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:41.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:41.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:41.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:41.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:41.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:41.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:41.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:41.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:41.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:41.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:41.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:41.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:41.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:41.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:41.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:41.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:41.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:41.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:41.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:41.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:41.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:41.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:41.859 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.859 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.859 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.860 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:41.860 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:41.860 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.923865505000002, 2020-11-12T17:26:41.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:41.860 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.860 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.860 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.860 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.861 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.861 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:41.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.861 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:41.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:41.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:41.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:41.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:41.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:41.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:41.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:41.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:41.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:41.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:41.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:41.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:41.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:41.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:41.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:41.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:41.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:41.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:41.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:41.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:41.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:41.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:41.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:41.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:41.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:41.869 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.870 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.870 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.870 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:41.870 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:41.870 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.674659888000001, 2020-11-12T17:26:41.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:41.871 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.871 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:41.871 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:41.871 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:41.871 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:41.871 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:41.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.872 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:41.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:41.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:41.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:41.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:41.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:41.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:41.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:41.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:41.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:41.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:41.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:41.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:41.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:41.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:41.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:41.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:41.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:41.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:41.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:41.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:41.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:41.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:41.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:41.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.880 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.881 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:41.881 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:41.881 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 43.657700439000003, 2020-11-12T17:26:41.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:41.881 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:41.881 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:41.882 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:41.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:41.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:41.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:41.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:41.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:41.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:41.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:41.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:41.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:41.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:41.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:41.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:41.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:41.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:41.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:41.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:41.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:41.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:41.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:41.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:41.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:41.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:41.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:41.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:41.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:41.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:41.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:41.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:41.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:41.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.888 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.888 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.888 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:41.888 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:41.888 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:41.890 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:41.891 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Removed 9549 objects 2020-11-12T17:26:41.891 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Clean up completed and total clean up time :17.974 2020-11-12T17:26:41.891 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:41.886+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:41.991 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:41.984+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:42.014 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:42.014 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:42.015 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:42.015 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:42.025 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:42.111 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:42.108+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:42.192 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:42.188+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:42.201 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:42.201 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:42.201 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:42.201 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:42.202 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:42.211 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:42.307 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:42.304+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:42.347 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2020-11-12T17:26:42.348 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2020-11-12T17:26:42.383 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:42.383 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:42.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:42.384 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:42.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.384 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:42.384 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:42.385 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 207.96174361600001, 2020-11-12T17:26:42.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:42.385 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.385 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.385 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.385 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:42.385 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:42.386 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:42.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.386 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:42.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:42.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:42.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:42.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:42.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:42.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:42.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:42.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:42.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:42.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:42.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:42.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:42.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:42.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:42.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:42.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:42.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:42.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:42.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:42.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:42.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:42.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:42.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:42.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:42.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:42.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.397 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.398 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:42.398 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:42.398 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 207.954799554, 2020-11-12T17:26:42.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:42.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:42.399 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:42.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:42.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:42.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:42.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:42.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:42.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:42.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:42.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:42.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:42.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:42.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:42.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:42.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:42.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:42.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:42.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:42.408 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.408 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.408 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.408 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:42.408 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:42.409 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 171.780961768, 2020-11-12T17:26:42.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:42.409 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.409 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.409 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.409 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:42.409 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:42.409 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:42.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.410 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:42.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:42.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:42.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:42.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:42.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:42.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:42.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:42.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:42.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:42.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:42.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:42.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:42.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:42.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:42.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:42.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:42.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:42.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:42.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:42.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:42.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:42.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:42.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:42.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:42.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:42.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.420 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.421 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:42.421 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:42.421 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 167.30942785900001, 2020-11-12T17:26:42.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:42.421 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.421 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.422 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.422 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:42.422 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:42.422 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:42.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.422 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:42.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:42.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:42.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:42.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:42.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:42.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:42.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:42.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:42.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:42.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:42.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:42.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:42.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:42.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:42.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:42.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:42.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:42.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:42.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:42.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:42.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:42.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:42.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:42.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:42.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:42.433 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.433 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.433 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.434 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:42.434 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:42.434 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 155.517256675, 2020-11-12T17:26:42.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:42.434 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.434 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.434 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.435 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:42.435 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:42.435 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:42.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.435 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:42.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:42.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:42.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:42.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:42.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:42.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:42.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:42.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:42.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:42.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:42.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:42.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:42.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:42.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:42.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:42.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:42.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:42.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:42.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:42.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:42.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:42.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:42.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:42.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:42.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:42.447 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.447 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.447 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.448 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:42.448 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:42.448 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 140.56080983300001, 2020-11-12T17:26:42.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:42.448 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.448 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.449 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.449 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:42.449 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:42.450 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:42.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.450 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:42.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:42.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:42.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:42.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:42.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:42.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:42.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:42.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:42.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:42.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:42.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:42.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:42.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:42.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:42.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:42.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:42.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:42.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:42.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:42.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:42.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:42.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:42.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:42.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:42.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:42.505 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.505 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.505 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.506 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:42.506 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:42.506 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 140.43187634899999, 2020-11-12T17:26:42.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:42.506 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.507 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.507 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:42.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:42.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:42.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:42.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:42.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:42.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:42.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:42.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:42.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:42.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:42.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:42.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:42.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:42.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:42.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:42.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:42.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:42.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:42.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.519 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:42.520 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:42.520 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.73773807500001, 2020-11-12T17:26:42.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:42.521 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.521 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.521 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.521 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:42.522 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:42.522 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:42.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.523 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:42.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:42.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:42.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:42.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:42.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:42.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:42.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:42.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:42.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:42.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:42.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:42.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:42.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:42.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:42.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:42.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:42.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:42.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:42.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:42.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:42.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:42.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:42.539 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.539 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.539 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.540 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:42.540 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:42.540 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 104.423184429, 2020-11-12T17:26:42.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:42.540 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.540 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.540 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.541 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:42.541 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:42.541 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:42.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.541 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:42.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:42.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:42.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:42.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:42.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:42.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:42.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:42.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:42.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:42.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:42.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:42.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:42.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:42.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:42.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:42.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:42.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:42.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:42.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:42.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:42.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:42.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:42.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:42.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:42.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:42.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.551 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.552 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.552 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:42.552 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:42.552 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.068499353000007, 2020-11-12T17:26:42.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:42.553 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.553 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.553 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.553 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:42.553 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:42.553 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:42.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.554 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:42.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:42.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:42.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:42.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:42.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:42.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:42.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:42.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:42.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:42.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:42.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:42.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:42.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:42.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:42.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:42.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:42.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:42.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:42.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:42.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:42.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:42.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:42.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:42.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:42.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:42.563 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.563 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.563 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.564 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:42.564 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:42.564 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.055322594000003, 2020-11-12T17:26:42.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:42.564 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.564 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:42.564 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:42.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:42.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:42.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:42.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:42.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:42.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:42.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:42.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:42.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:42.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:42.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:42.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:42.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:42.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:42.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:42.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:42.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.570 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.571 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.571 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:42.571 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:42.571 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.501241144999995, 2020-11-12T17:26:42.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:42.572 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.572 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:42.572 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:42.572 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:42.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.572 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:42.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:42.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:42.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:42.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:42.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:42.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:42.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:42.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:42.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:42.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:42.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:42.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:42.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:42.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:42.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:42.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:42.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:42.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:42.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:42.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:42.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:42.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:42.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:42.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:42.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:42.581 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.581 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.582 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.582 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:42.582 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:42.582 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.492253839, 2020-11-12T17:26:42.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:42.583 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.583 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:42.583 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:42.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:42.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:42.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:42.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:42.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:42.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:42.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:42.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:42.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:42.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:42.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:42.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:42.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:42.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:42.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:42.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:42.589 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.589 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.589 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.590 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:42.590 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:42.590 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 70.474326524999995, 2020-11-12T17:26:42.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:42.590 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.590 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.591 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.591 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:42.591 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:42.591 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:42.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.592 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:42.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:42.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:42.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:42.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:42.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:42.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:42.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:42.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:42.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:42.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:42.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:42.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:42.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:42.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:42.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:42.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:42.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:42.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:42.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:42.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:42.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:42.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:42.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:42.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:42.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:42.605 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.605 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.605 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.606 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:42.606 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:42.606 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.923283127000005, 2020-11-12T17:26:42.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:42.606 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.606 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.607 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.607 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:42.607 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:42.607 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:42.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.608 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:42.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:42.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:42.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:42.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:42.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:42.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:42.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:42.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:42.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:42.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:42.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:42.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:42.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:42.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:42.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:42.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:42.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:42.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:42.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:42.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:42.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:42.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:42.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:42.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:42.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:42.618 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.618 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.618 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.618 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:42.619 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:42.619 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.671887627000004, 2020-11-12T17:26:42.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:42.619 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.619 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.619 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.619 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:42.620 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:42.620 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:42.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.620 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:42.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:42.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:42.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:42.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:42.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:42.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:42.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:42.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:42.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:42.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:42.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:42.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:42.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:42.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:42.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:42.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:42.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:42.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:42.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:42.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:42.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:42.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:42.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:42.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:42.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:42.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.631 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.632 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:42.632 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:42.632 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.592765310000004, 2020-11-12T17:26:42.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:42.632 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.632 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.632 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.633 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:42.633 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:42.633 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:42.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.633 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:42.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:42.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:42.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:42.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:42.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:42.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:42.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:42.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:42.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:42.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:42.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:42.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:42.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:42.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:42.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:42.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:42.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:42.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:42.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:42.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:42.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:42.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:42.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:42.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:42.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:42.644 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.644 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.644 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.644 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:42.644 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:42.645 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.810414342999998, 2020-11-12T17:26:42.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:42.645 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.645 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.645 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.645 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:42.645 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:42.646 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:42.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.646 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:42.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:42.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:42.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:42.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:42.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:42.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:42.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:42.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:42.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:42.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:42.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:42.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:42.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:42.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:42.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:42.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:42.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:42.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:42.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:42.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:42.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:42.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:42.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:42.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:42.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:42.655 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.655 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.656 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.656 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:26:42.656 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:42.656 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.347371994, 2020-11-12T17:26:42.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:26:42.657 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.657 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:42.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:42.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:42.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:42.657 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:26:42.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.658 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:42.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:42.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:26:42.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:26:42.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:26:42.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:26:42.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:26:42.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:26:42.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:26:42.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:26:42.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:26:42.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:26:42.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:26:42.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:26:42.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:26:42.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:42.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:26:42.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:26:42.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:42.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:26:42.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:26:42.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:42.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:26:42.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:26:42.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:42.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:26:42.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:26:42.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:26:42.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:26:42.669 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.669 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.671 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:26:42.671 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:42.671 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.326331459999999, 2020-11-12T17:26:42.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:26:42.671 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:42.672 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:42.672 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:42.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:42.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:42.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:42.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:42.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:42.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:26:42.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:42.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:26:42.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:26:42.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:42.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:26:42.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:26:42.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:42.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:26:42.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:26:42.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:26:42.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:26:42.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:42.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:26:42.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:26:42.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:42.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:26:42.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:26:42.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:42.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:42.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:42.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:26:42.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:26:42.678 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.678 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:42.679 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:42.679 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:42.681 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:42.681 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:42.676+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:42.788 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:42.780+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:42.792 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:42.792 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:42.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:42.792 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGRecoveryDeleteReply(4.9 e125,122 4:9bf13bf1:::benchmark_data_smithi036_18856_object3318:head,119'5206)", 2020-11-12T17:26:42.793 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:42.792563+0000", 2020-11-12T17:26:42.793 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.000499772, 2020-11-12T17:26:42.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00053550899999999999, 2020-11-12T17:26:42.793 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:42.793 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:26:42.793 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:42.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:42.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:42.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.792563+0000", 2020-11-12T17:26:42.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:42.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:42.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:42.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:42.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.792563+0000", 2020-11-12T17:26:42.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999929 2020-11-12T17:26:42.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:42.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:42.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:42.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.792492+0000", 2020-11-12T17:26:42.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018342599999999999 2020-11-12T17:26:42.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:42.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:42.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:42.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.792675+0000", 2020-11-12T17:26:42.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103 2020-11-12T17:26:42.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:42.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:42.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:42.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.792778+0000", 2020-11-12T17:26:42.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2962999999999999e-05 2020-11-12T17:26:42.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:42.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:42.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:42.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.792791+0000", 2020-11-12T17:26:42.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013977999999999999 2020-11-12T17:26:42.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:42.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:42.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:42.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.792931+0000", 2020-11-12T17:26:42.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000368317 2020-11-12T17:26:42.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:42.799 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:42.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:42.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:42.799 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:42.799 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:26:42.800 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:42.803 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:42.894 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:42.888+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:42.939 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:42.939 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:42.939 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:42.939 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:42.939 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:42.951 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:42.992 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:42.988+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:43.086 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:43.086 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.087 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:26:43.088 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:43.088 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 212.391478885, 2020-11-12T17:26:43.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:26:43.088 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.088 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.089 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.089 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:43.089 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:43.089 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:26:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:26:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:26:43.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:26:43.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:26:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:26:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:26:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:26:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:26:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:26:43.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:26:43.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:26:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:26:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:26:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:26:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:43.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:26:43.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:26:43.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:43.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:26:43.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:26:43.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:26:43.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:26:43.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:26:43.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:26:43.109 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.109 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.109 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:26:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 212.38599881600001, 2020-11-12T17:26:43.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:26:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:26:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:26:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:26:43.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:26:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:26:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:26:43.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:26:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:26:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:26:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:26:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:26:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:26:43.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:26:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:26:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.119 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:26:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 204.19587721600001, 2020-11-12T17:26:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:26:43.120 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:26:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:26:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:26:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:26:43.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:26:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:26:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:26:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:26:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:26:43.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:26:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:26:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:26:43.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:26:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:26:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:26:43.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:26:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:26:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:26:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:26:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:26:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:26:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:26:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:26:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:26:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.133 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.135 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:26:43.136 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:43.136 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 204.18863350699999, 2020-11-12T17:26:43.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:26:43.137 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:26:43.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:26:43.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:26:43.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:26:43.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:26:43.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:26:43.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:26:43.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:26:43.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:26:43.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:26:43.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:26:43.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:26:43.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:26:43.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:26:43.148 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.149 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.149 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.150 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:43.150 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:43.150 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 128.19254413300001, 2020-11-12T17:26:43.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:26:43.150 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.151 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:43.151 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:43.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:26:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:26:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:26:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:26:43.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:26:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:26:43.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:26:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:26:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:26:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:26:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:26:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:26:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:26:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:26:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.161 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:26:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:43.162 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 91.167274866, 2020-11-12T17:26:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:26:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:26:43.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:26:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:26:43.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:26:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:26:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:26:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:26:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:26:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:26:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:26:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:26:43.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:26:43.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:26:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:26:43.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:26:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:26:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:26:43.173 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.174 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 66.501433851000002, 2020-11-12T17:26:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:26:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.175 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:26:43.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.177 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:26:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:26:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:26:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:26:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:26:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:26:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:26:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:26:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:26:43.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:26:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:26:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:26:43.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:26:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:26:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:26:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:26:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:26:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:26:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:26:43.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:26:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:26:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:26:43.188 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 66.498192521999997, 2020-11-12T17:26:43.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:26:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:43.190 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:26:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:43.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:26:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:26:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:26:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:26:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:26:43.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:26:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:26:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:26:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:26:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:26:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:26:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:26:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:26:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:26:43.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:26:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:26:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:26:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:26:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:26:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:26:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:26:43.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:26:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:26:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:43.202 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 62.065021621, 2020-11-12T17:26:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:26:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:26:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:26:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:26:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:26:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:26:43.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:26:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:26:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:26:43.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:26:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:26:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:26:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:26:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:26:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:26:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.015954960000002, 2020-11-12T17:26:43.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:26:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:43.213 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:26:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:43.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:43.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:26:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:26:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:26:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:26:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:26:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:26:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:26:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:26:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:26:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:26:43.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:26:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:26:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:26:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:26:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:43.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:26:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:26:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:26:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:26:43.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:26:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:26:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:26:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:26:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.014274180000001, 2020-11-12T17:26:43.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:26:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:43.226 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:26:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:26:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:26:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:26:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:26:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:26:43.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:26:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:26:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:26:43.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:26:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:26:43.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:26:43.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:26:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:26:43.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:26:43.235 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:43.238 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:43.080+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:43.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:26:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:26:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:26:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:26:43.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:26:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:26:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:26:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:26:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.242 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 55.014185984999997, 2020-11-12T17:26:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:26:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.243 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:43.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:43.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:26:43.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:26:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:26:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:26:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:26:43.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:26:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:26:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:26:43.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:26:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:26:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:26:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:26:43.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:26:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:26:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:26:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:26:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:26:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:26:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:26:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:26:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:26:43.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:26:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.257 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.995690670000002, 2020-11-12T17:26:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:26:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:43.258 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:26:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:26:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:26:43.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:26:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:26:43.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:26:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:26:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:26:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:26:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:26:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:26:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:26:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:26:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:26:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.995557679999997, 2020-11-12T17:26:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:26:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:43.267 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:26:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:26:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:26:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:26:43.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:26:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:26:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:26:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:26:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:26:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:26:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:26:43.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:26:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:26:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:26:43.274 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:43.275 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.995472952, 2020-11-12T17:26:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:26:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:43.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:43.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:26:43.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:26:43.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:26:43.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:26:43.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:26:43.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:26:43.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:26:43.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:26:43.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:26:43.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:26:43.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:26:43.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:26:43.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:26:43.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:26:43.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:26:43.283 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.283 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.284 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.284 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:43.284 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:43.284 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.943860422, 2020-11-12T17:26:43.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:26:43.285 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.285 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:43.285 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.285 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:43.285 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:43.285 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:43.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.286 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:43.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:43.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:43.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:26:43.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:26:43.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:26:43.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:26:43.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:26:43.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:26:43.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:26:43.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:26:43.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:26:43.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:26:43.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:43.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:26:43.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:26:43.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:26:43.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:26:43.292 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.293 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.293 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:43.293 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:43.293 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.943703405999997, 2020-11-12T17:26:43.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:26:43.294 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.294 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:43.294 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.294 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:43.295 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:43.295 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:43.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.295 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:43.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:43.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:43.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:26:43.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:26:43.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:26:43.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:26:43.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:26:43.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:26:43.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:26:43.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:26:43.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:26:43.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:26:43.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:43.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:26:43.301 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.302 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.302 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.302 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:43.302 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:43.302 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 22.244650500999999, 2020-11-12T17:26:43.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:26:43.303 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.303 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.303 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.303 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:43.303 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:43.303 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:26:43.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.304 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:43.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:43.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:26:43.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:26:43.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:26:43.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:26:43.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:26:43.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:26:43.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:26:43.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:26:43.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:26:43.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:26:43.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:26:43.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:26:43.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:26:43.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:43.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:26:43.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:26:43.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:43.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:26:43.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:26:43.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:43.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:26:43.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:26:43.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:26:43.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:26:43.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:26:43.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:26:43.314 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.314 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.314 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.314 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:43.314 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:43.315 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.157995013000001, 2020-11-12T17:26:43.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:26:43.315 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.315 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:43.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:43.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:43.316 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:43.316 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:26:43.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.316 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:43.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:43.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:43.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:26:43.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:26:43.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:26:43.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:26:43.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:26:43.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:26:43.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:26:43.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:26:43.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:26:43.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:26:43.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:26:43.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:26:43.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:43.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:26:43.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:26:43.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:43.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:26:43.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:26:43.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:43.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:26:43.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:26:43.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:43.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:26:43.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:26:43.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:26:43.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:26:43.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.326 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.327 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:26:43.327 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:43.327 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.144513786000001, 2020-11-12T17:26:43.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:26:43.327 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:43.327 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:43.328 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:43.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:43.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:43.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:43.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:43.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:43.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:43.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:43.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:26:43.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:26:43.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:43.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:26:43.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:26:43.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:43.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:26:43.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:26:43.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:43.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:26:43.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:26:43.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:43.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:26:43.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:26:43.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:43.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:26:43.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:26:43.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:43.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:43.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:43.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:26:43.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:26:43.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.334 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:43.335 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:43.335 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:43.335 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:43.337 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:43.242+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:43.379 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:43.376+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:43.398 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:43.436 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:43.440 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:43.436+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:43.465 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:26:43.468 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:43.471 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'unique_pool_1' removed 2020-11-12T17:26:43.475 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:43.476 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:43.477 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:26:43.479 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:43.483 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2020-11-12T17:26:43.484 INFO:tasks.radosbench:Beginning radosbench... 2020-11-12T17:26:43.486 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2020-11-12T17:26:43.487 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create unique_pool_2 16 2020-11-12T17:26:43.488 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:43.495 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:43.534 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:43.543 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:43.538+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:43.571 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:43.601 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:43.627 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:43.627 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:43.632 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:43.636 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:43.648 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:43.648 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:43.648 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:43.649 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:43.649 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:43.649 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:43.649 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:43.650 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:43.680 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:43.678+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:43.746 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:43.740+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:43.828 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:43.828 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:43.846 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:43.854 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:43.850+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:43.951 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:43.948+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:43.954 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:43.955 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:43.967 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:44.052 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:44.048+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:44.068 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:44.069 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:44.078 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:44.153 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:44.150+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:44.175 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:44.175 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:44.182 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:44.270 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:44.266+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:44.322 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:44.322 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:44.332 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:44.376 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:44.374+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:44.456 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:44.454+0000 7f7b4fea9700 -1 osd.4 126 handle_osd_map injecting map crc failure 2020-11-12T17:26:44.457 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:44.452+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:44.466 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:26:44.466 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'unique_pool_2' created 2020-11-12T17:26:44.479 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2020-11-12T17:26:44.490 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:44.491 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:44.499 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:44.557 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:44.554+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:44.608 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:44.608 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:44.618 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:44.663 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:44.662+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:44.724 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:44.724 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:44.734 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:44.779 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:44.776+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:44.838 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:44.838 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:44.848 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:44.868 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:44.866+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:44.969 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:44.964+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:44.998 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:44.998 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:45.008 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:45.096 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:45.092+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:45.157 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:45.157 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:45.167 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:45.171 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:45.170+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:45.272 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:45.268+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:45.323 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:45.323 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:45.332 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:45.375 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:45.372+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:45.468 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:45.466+0000 7f7b4fea9700 -1 osd.4 127 handle_osd_map injecting map crc failure 2020-11-12T17:26:45.476 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:45.470+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:45.477 INFO:teuthology.orchestra.run.smithi036.stderr:enabled application 'rados' on pool 'unique_pool_2' 2020-11-12T17:26:45.498 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:45.499 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:45.509 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:45.577 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:45.574+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:45.659 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:45.662 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:45.663 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:45.673 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:45.715 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:45.712+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:45.777 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:45.772+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:45.814 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:45.824 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:45.824 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:45.824 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:45.825 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:45.825 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:45.833 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:45.840 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:45.865 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:45.879 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:45.874+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:45.890 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:45.920 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:45.945 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:45.946 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:45.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:45.946 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:45.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.947 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:26:45.947 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:45.947 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 220.83287615899999, 2020-11-12T17:26:45.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:26:45.948 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:45.948 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:45.948 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:45.948 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:45.948 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:45.949 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:26:45.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.949 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:45.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:45.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:45.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:45.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:45.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:26:45.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:26:45.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:45.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:26:45.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:26:45.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:45.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:26:45.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:26:45.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:45.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:26:45.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:26:45.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:45.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:26:45.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:26:45.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:45.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:26:45.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:26:45.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:45.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:26:45.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:26:45.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:45.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:26:45.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:26:45.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:45.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:26:45.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:26:45.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:45.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:26:45.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:26:45.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:45.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:26:45.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:26:45.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:45.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:26:45.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:26:45.961 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:45.961 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:45.961 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:45.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.961 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:26:45.962 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:45.962 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 220.825784363, 2020-11-12T17:26:45.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:26:45.962 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:45.962 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:45.963 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:45.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:45.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:45.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:45.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:45.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:26:45.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:45.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:45.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:26:45.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:26:45.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:45.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:26:45.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:26:45.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:45.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:26:45.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:26:45.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:45.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:26:45.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:26:45.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:45.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:26:45.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:26:45.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:45.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:26:45.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:26:45.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:45.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:26:45.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:26:45.972 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:45.972 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:45.972 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:45.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.973 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:45.974 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:45.974 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 211.393224866, 2020-11-12T17:26:45.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:26:45.975 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:45.975 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:45.975 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:45.975 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:45.976 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:45.976 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:26:45.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.977 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:45.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:45.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:45.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:45.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:45.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:26:45.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:26:45.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:45.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:26:45.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:26:45.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:45.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:26:45.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:26:45.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:45.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:26:45.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:26:45.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:45.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:26:45.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:26:45.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:45.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:26:45.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:26:45.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:45.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:26:45.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:26:45.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:45.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:26:45.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:26:45.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:45.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:26:45.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:26:45.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:45.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:26:45.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:26:45.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:45.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:26:45.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:26:45.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:45.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:26:45.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:26:45.996 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:45.996 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:45.996 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:45.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.996 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:26:45.997 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:45.997 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 177.443104772, 2020-11-12T17:26:45.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:26:45.997 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:45.997 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:45.997 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:45.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:45.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:45.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:45.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:45.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:26:45.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:45.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:45.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:45.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:45.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:26:46.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:26:46.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:26:46.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:26:46.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:26:46.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:26:46.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:26:46.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:26:46.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:26:46.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:26:46.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:26:46.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:26:46.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:26:46.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:26:46.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.005 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.005 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.006 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:26:46.006 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:46.006 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 175.33750287999999, 2020-11-12T17:26:46.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:26:46.007 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.007 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.007 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:46.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:26:46.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:26:46.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:26:46.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:26:46.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:26:46.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:26:46.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:26:46.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:46.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:26:46.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:26:46.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:26:46.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:26:46.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:26:46.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:26:46.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:26:46.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:26:46.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:26:46.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:26:46.023 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.023 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.023 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.024 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:46.024 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:46.024 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.99101954599999, 2020-11-12T17:26:46.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:26:46.024 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.024 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.025 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.025 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:46.025 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:46.025 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:26:46.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.025 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:46.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:26:46.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:26:46.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:26:46.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:26:46.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:26:46.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:26:46.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:26:46.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:26:46.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:26:46.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:26:46.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:26:46.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:26:46.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:26:46.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:26:46.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:46.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:26:46.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:26:46.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:26:46.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:26:46.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:26:46.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:26:46.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:26:46.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:26:46.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:26:46.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:26:46.046 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.046 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.046 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.047 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:46.047 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:46.047 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 134.99517774399999, 2020-11-12T17:26:46.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:26:46.049 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.049 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:46.049 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:46.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:26:46.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:46.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:26:46.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:26:46.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:26:46.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:26:46.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:26:46.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:26:46.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:26:46.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:26:46.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:26:46.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:26:46.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:26:46.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:26:46.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:26:46.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:26:46.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.065 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.066 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:26:46.067 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:46.067 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 131.060074345, 2020-11-12T17:26:46.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:26:46.067 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.068 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:26:46.068 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:46.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:26:46.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:46.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:26:46.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:26:46.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:26:46.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:26:46.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:26:46.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:26:46.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:26:46.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:26:46.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:26:46.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:26:46.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:26:46.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:26:46.076 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.077 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.077 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.078 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:26:46.078 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:46.079 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 100.295433854, 2020-11-12T17:26:46.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:26:46.079 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.079 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:46.080 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:46.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:26:46.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:26:46.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:26:46.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:26:46.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:26:46.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:26:46.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:26:46.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:26:46.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:26:46.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:26:46.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:26:46.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:26:46.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:26:46.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:26:46.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:26:46.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:26:46.089 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.089 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.089 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.090 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:46.090 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:46.090 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.038925169999999, 2020-11-12T17:26:46.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:26:46.090 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.091 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.091 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:26:46.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.092 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:46.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:26:46.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:46.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:26:46.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:26:46.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:26:46.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:26:46.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:26:46.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:26:46.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:26:46.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:26:46.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:26:46.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:26:46.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:26:46.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:26:46.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:46.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:26:46.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:26:46.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:26:46.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:26:46.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:26:46.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:26:46.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:26:46.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:26:46.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:26:46.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:26:46.100 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.101 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.101 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.101 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:26:46.101 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:46.101 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.038762800000001, 2020-11-12T17:26:46.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:26:46.102 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.102 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.102 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.102 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.102 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.102 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:26:46.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.103 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:46.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:26:46.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:46.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:26:46.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:26:46.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:26:46.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:26:46.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:26:46.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:26:46.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:26:46.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:26:46.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:26:46.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:26:46.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:26:46.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:26:46.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:46.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:26:46.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:26:46.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:26:46.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:26:46.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:26:46.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:26:46.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:26:46.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:26:46.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:26:46.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:26:46.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.111 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.112 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:26:46.112 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:46.112 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.030193812999997, 2020-11-12T17:26:46.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:26:46.112 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.112 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:46.113 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:46.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:26:46.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:46.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:26:46.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:26:46.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:26:46.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:26:46.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:26:46.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:26:46.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:26:46.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:26:46.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:26:46.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:26:46.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:26:46.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:26:46.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:26:46.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:26:46.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.119 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.119 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:46.119 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:46.120 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.525681363000004, 2020-11-12T17:26:46.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:26:46.120 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.120 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.120 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.120 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.120 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.121 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:26:46.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.121 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:46.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:26:46.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:46.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:26:46.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:26:46.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:26:46.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:26:46.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:26:46.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:26:46.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:26:46.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:26:46.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:26:46.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:26:46.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:26:46.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:26:46.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:26:46.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:26:46.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:26:46.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:26:46.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:26:46.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:26:46.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:26:46.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:26:46.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:26:46.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:26:46.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.130 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.130 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:26:46.130 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:46.131 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.040133076999993, 2020-11-12T17:26:46.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:26:46.131 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.131 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.131 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.131 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.131 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.131 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:26:46.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.132 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:46.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:26:46.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:26:46.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:26:46.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:26:46.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:26:46.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:26:46.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:26:46.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:26:46.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:26:46.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:26:46.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:26:46.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:26:46.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:26:46.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:26:46.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:26:46.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:26:46.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:26:46.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:26:46.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:26:46.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:26:46.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:26:46.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:26:46.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:26:46.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:26:46.140 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.140 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.141 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.141 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:26:46.141 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:46.141 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 64.966814644999999, 2020-11-12T17:26:46.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:26:46.142 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.142 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:46.142 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:46.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:26:46.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:46.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:26:46.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:26:46.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:26:46.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:26:46.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:26:46.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:26:46.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:26:46.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:26:46.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:26:46.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:26:46.148 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.148 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.148 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.148 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:46.148 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:46.149 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 63.911169669000003, 2020-11-12T17:26:46.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:26:46.149 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.149 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.149 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.149 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.149 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.150 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:26:46.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.150 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:46.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:26:46.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:46.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:26:46.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:26:46.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:26:46.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:26:46.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:26:46.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:26:46.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:26:46.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:26:46.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:26:46.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:26:46.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:26:46.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:26:46.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:26:46.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:26:46.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:26:46.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:26:46.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:26:46.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:26:46.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:26:46.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:26:46.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:26:46.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:26:46.158 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.158 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.159 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:26:46.159 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:46.159 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 63.522965298000003, 2020-11-12T17:26:46.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:26:46.160 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.160 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.160 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.160 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.160 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.160 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:26:46.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.160 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:46.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:26:46.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:26:46.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:26:46.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:26:46.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:26:46.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:26:46.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:26:46.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:26:46.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:26:46.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:26:46.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:26:46.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:26:46.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:26:46.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:26:46.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:46.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:26:46.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:26:46.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:26:46.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:26:46.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:26:46.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:26:46.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:26:46.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:26:46.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:26:46.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:26:46.169 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.169 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.169 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.170 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:26:46.170 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:46.170 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.316508366000001, 2020-11-12T17:26:46.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:26:46.170 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.170 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.171 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.171 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.171 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.171 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:26:46.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.171 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:46.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:26:46.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:46.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:26:46.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:26:46.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:26:46.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:26:46.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:26:46.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:26:46.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:26:46.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:26:46.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:26:46.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:26:46.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:26:46.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:26:46.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:26:46.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:26:46.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:26:46.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:26:46.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:26:46.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:26:46.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:26:46.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:26:46.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:26:46.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:26:46.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.181 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:26:46.181 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:46.181 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 48.067302749, 2020-11-12T17:26:46.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:26:46.181 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.181 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.182 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.182 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.182 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.182 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:26:46.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.182 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:46.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:26:46.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:26:46.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:26:46.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:26:46.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:26:46.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:26:46.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:26:46.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:26:46.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:26:46.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:26:46.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:26:46.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:26:46.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:26:46.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:26:46.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:46.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:26:46.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:26:46.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:26:46.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:26:46.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:26:46.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:26:46.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:26:46.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:26:46.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:26:46.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:26:46.191 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.191 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.191 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.192 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:26:46.192 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:46.192 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 48.050343300000002, 2020-11-12T17:26:46.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:26:46.192 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.192 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:46.192 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:46.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:26:46.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:46.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:26:46.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:26:46.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:26:46.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:26:46.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:26:46.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:26:46.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:26:46.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:26:46.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:26:46.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:26:46.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:26:46.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:26:46.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:26:46.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:26:46.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.199 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.199 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:46.201 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:46.201 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:46.201 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:46.202 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:46.202 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:46.202 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:46.204 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:46.198+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:46.302 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:46.296+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:46.360 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:46.360 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:46.360 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:26:46.360 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:46.370 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:46.403 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:46.402+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:46.460 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2] out_osds: [0, 1] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:46.461 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:46.461 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 1.000000 2020-11-12T17:26:46.462 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd primary-affinity 4 1 2020-11-12T17:26:46.480 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:26:46.495 INFO:teuthology.orchestra.run.smithi036:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_2 bench 90 write' 2020-11-12T17:26:46.507 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:46.504+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:46.509 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2020-11-12T17:26:46.509 INFO:teuthology.orchestra.run:waiting for 3000 2020-11-12T17:26:46.534 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:46.534 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:46.534 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:46.535 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:46.535 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:46.545 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:46.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:hints = 1 2020-11-12T17:26:46.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2020-11-12T17:26:46.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Object prefix: benchmark_data_smithi036_24110 2020-11-12T17:26:46.556 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:26:46.556 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 0 0 0 0 0 0 - 0 2020-11-12T17:26:46.605 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:46.600+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:46.690 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:46.690 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:46.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:46.690 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:46.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.691 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:46.691 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:46.691 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 212.268802268, 2020-11-12T17:26:46.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:46.691 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.692 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.692 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.692 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:46.692 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:46.693 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:46.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.693 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:46.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:46.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:46.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:46.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:46.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:46.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:46.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:46.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:46.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:46.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:46.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:46.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:46.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:46.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:46.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:46.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:46.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:46.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:46.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:46.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:46.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:46.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:46.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:46.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:46.715 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.715 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.715 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.715 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:46.715 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:46.716 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 212.261858206, 2020-11-12T17:26:46.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:46.716 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.716 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:46.716 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:46.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:46.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:46.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:46.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:46.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:46.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:46.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:46.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:46.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:46.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:46.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:46.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:46.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:46.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:46.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:46.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:46.722 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.722 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.723 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.723 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:46.723 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:46.723 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 176.08802041999999, 2020-11-12T17:26:46.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:46.724 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.724 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.724 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.724 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:46.724 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:46.724 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:46.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.725 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:46.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:46.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:46.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:46.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:46.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:46.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:46.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:46.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:46.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:46.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:46.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:46.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:46.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:46.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:46.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:46.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:46.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:46.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:46.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:46.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:46.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:46.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:46.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:46.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:46.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:46.735 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.735 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.736 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.737 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:46.737 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:46.737 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 171.61648651100001, 2020-11-12T17:26:46.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:46.737 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.738 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:46.738 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:46.738 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:46.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.739 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:46.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:46.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:46.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:46.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:46.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:46.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:46.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:46.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:46.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:46.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:46.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:46.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:46.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:46.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:46.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:46.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:46.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:46.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:46.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:46.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:46.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:46.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:46.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:46.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:46.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:46.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.749 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.750 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:46.750 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:46.750 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 159.82431532699999, 2020-11-12T17:26:46.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:46.750 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.750 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.750 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:46.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:46.751 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:46.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.751 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:46.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:46.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:46.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:46.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:46.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:46.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:46.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:46.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:46.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:46.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:46.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:46.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:46.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:46.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:46.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:46.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:46.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:46.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:46.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:46.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:46.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:46.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:46.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:46.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:46.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:46.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.766 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.767 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:46.767 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:46.767 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 144.867868485, 2020-11-12T17:26:46.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:46.768 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.768 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:46.768 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:46.769 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:46.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.769 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:46.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:46.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:46.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:46.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:46.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:46.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:46.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:46.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:46.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:46.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:46.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:46.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:46.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:46.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:46.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:46.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:46.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:46.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:46.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:46.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:46.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:46.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:46.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:46.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:46.779 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.779 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.779 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.780 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:46.780 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:46.780 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 144.73893500099999, 2020-11-12T17:26:46.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:46.780 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.781 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.781 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:46.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:46.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:46.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:46.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:46.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:46.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:46.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:46.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:46.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:46.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:46.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:46.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:46.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:46.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:46.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:46.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:46.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:46.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:46.788 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.788 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.788 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.788 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:46.789 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:46.789 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.044796727, 2020-11-12T17:26:46.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:46.789 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.789 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.789 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.789 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:46.790 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:46.790 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:46.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.790 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:46.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:46.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:46.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:46.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:46.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:46.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:46.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:46.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:46.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:46.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:46.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:46.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:46.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:46.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:46.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:46.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:46.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:46.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:46.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:46.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:46.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:46.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:46.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:46.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:46.801 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.802 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.802 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.802 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:46.802 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:46.802 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.730243081, 2020-11-12T17:26:46.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:46.803 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.803 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.803 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.803 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.803 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.803 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:46.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.804 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:46.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:46.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:46.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:46.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:46.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:46.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:46.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:46.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:46.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:46.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:46.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:46.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:46.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:46.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:46.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:46.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:46.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:46.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:46.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:46.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:46.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:46.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:46.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:46.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:46.813 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.813 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.813 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.813 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:46.814 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:46.814 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.375558005000002, 2020-11-12T17:26:46.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:46.814 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.814 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.814 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.814 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.815 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.815 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:46.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.815 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:46.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:46.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:46.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:46.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:46.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:46.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:46.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:46.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:46.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:46.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:46.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:46.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:46.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:46.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:46.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:46.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:46.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:46.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:46.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:46.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:46.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:46.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:46.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:46.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:46.824 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.824 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.824 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.825 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:46.825 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:46.825 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.362381245999998, 2020-11-12T17:26:46.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:46.825 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.826 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:46.826 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:46.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:46.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:46.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:46.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:46.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:46.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:46.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:46.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:46.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:46.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:46.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:46.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:46.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:46.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:46.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:46.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:46.832 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.832 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.832 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.833 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:46.833 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:46.833 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.808299797000004, 2020-11-12T17:26:46.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:46.833 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.834 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.834 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:46.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.834 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:46.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:46.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:46.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:46.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:46.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:46.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:46.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:46.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:46.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:46.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:46.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:46.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:46.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:46.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:46.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:46.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:46.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:46.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:46.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:46.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:46.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:46.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:46.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:46.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:46.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.843 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.844 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:46.844 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:46.844 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.799312490999995, 2020-11-12T17:26:46.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:46.844 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.844 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:46.844 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:46.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:46.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:46.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:46.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:46.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:46.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:46.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:46.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:46.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:46.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:46.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:46.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:46.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:46.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:46.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:46.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:46.852 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.852 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.852 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.852 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:46.853 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:46.853 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.781385177000004, 2020-11-12T17:26:46.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:46.853 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.853 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.853 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.853 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.854 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.854 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:46.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.854 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:46.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:46.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:46.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:46.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:46.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:46.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:46.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:46.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:46.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:46.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:46.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:46.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:46.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:46.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:46.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:46.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:46.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:46.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:46.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:46.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:46.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:46.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:46.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:46.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:46.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:46.864 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.864 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.865 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.865 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:46.865 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:46.865 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 70.230341779, 2020-11-12T17:26:46.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:46.866 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.866 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.866 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.866 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.866 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.866 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:46.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.867 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:46.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:46.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:46.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:46.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:46.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:46.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:46.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:46.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:46.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:46.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:46.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:46.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:46.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:46.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:46.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:46.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:46.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:46.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:46.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:46.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:46.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:46.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:46.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:46.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:46.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:46.878 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.880 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.881 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:46.881 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:46.881 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.978946278999999, 2020-11-12T17:26:46.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:46.881 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.881 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.881 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.882 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.882 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.882 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:46.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.882 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:46.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:46.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:46.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:46.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:46.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:46.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:46.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:46.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:46.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:46.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:46.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:46.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:46.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:46.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:46.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:46.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:46.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:46.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:46.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:46.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:46.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:46.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:46.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:46.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:46.891 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.892 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.892 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.892 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:46.892 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:46.892 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.899823961999999, 2020-11-12T17:26:46.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:46.893 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.893 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.893 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.893 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.893 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.893 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:46.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.894 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:46.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:46.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:46.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:46.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:46.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:46.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:46.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:46.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:46.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:46.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:46.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:46.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:46.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:46.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:46.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:46.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:46.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:46.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:46.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:46.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:46.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:46.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:46.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:46.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:46.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:46.904 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.904 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.904 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.904 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:46.905 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:46.905 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.117472995, 2020-11-12T17:26:46.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:46.905 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.905 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.905 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.905 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.906 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.906 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:46.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.906 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:46.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:46.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:46.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:46.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:46.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:46.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:46.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:46.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:46.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:46.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:46.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:46.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:46.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:46.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:46.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:46.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:46.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:46.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:46.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:46.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:46.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:46.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:46.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:46.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:46.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:46.915 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.915 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.915 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.916 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:26:46.916 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:46.916 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.654430646000002, 2020-11-12T17:26:46.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:26:46.916 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.916 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:46.916 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:46.917 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:46.917 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:46.917 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:26:46.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.917 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:26:46.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:26:46.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:26:46.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:26:46.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:26:46.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:26:46.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:26:46.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:26:46.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:26:46.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:26:46.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:26:46.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:26:46.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:26:46.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:46.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:26:46.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:26:46.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:46.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:26:46.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:26:46.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:46.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:26:46.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:26:46.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:46.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:26:46.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:26:46.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:26:46.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:26:46.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.927 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.928 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:26:46.928 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:46.928 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.633390112000001, 2020-11-12T17:26:46.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:26:46.929 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:46.929 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:46.929 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:46.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:46.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:46.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:46.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:46.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:46.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:26:46.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:46.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:26:46.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:26:46.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:46.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:26:46.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:26:46.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:46.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:26:46.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:26:46.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:46.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:26:46.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:26:46.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:46.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:26:46.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:26:46.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:46.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:26:46.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:26:46.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:46.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:46.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:46.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:26:46.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:26:46.935 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.935 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.935 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.935 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:46.936 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:46.936 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:46.937 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:46.932+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:46.938 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:47.038 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:47.032+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:47.074 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:47.075 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:26:47.075 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:47.087 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:47.192 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:47.193 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:47.193 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:47.193 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:47.193 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:47.202 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:47.234 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:47.136+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:47.241 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:47.236+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:47.319 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:47.319 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:47.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:47.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:26:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 216.629938624, 2020-11-12T17:26:47.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:26:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:47.322 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:26:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:47.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:47.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:26:47.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:26:47.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:26:47.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:26:47.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:26:47.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:26:47.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:26:47.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:26:47.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:26:47.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:26:47.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:26:47.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:26:47.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:47.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:26:47.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:26:47.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:47.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:26:47.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:26:47.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:47.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:26:47.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:26:47.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:26:47.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:26:47.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:26:47.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:26:47.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.334 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.335 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:26:47.335 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:47.335 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 216.62445855499999, 2020-11-12T17:26:47.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:26:47.335 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.335 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:47.336 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:47.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:47.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:47.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:26:47.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:26:47.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:26:47.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:26:47.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:26:47.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:26:47.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:26:47.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:26:47.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:26:47.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:26:47.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:26:47.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:26:47.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:26:47.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:26:47.348 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.348 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.348 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.349 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:26:47.349 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:47.349 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 208.43433695499999, 2020-11-12T17:26:47.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:26:47.349 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.350 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.350 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.350 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:47.350 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:47.350 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:26:47.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.350 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:47.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:47.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:26:47.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:26:47.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:26:47.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:26:47.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:26:47.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:26:47.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:26:47.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:26:47.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:26:47.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:26:47.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:26:47.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:26:47.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:26:47.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:47.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:26:47.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:26:47.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:47.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:26:47.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:26:47.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:47.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:26:47.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:26:47.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:26:47.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:26:47.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:26:47.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:26:47.359 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.359 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.359 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.360 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:26:47.360 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:47.360 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 208.427093246, 2020-11-12T17:26:47.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:26:47.360 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.360 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:47.361 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:47.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:47.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:47.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:26:47.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:26:47.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:26:47.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:26:47.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:26:47.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:26:47.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:26:47.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:26:47.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:26:47.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:26:47.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:26:47.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:26:47.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:26:47.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:26:47.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.368 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.369 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:47.369 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:47.369 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.43100387199999, 2020-11-12T17:26:47.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:26:47.369 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.369 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:47.370 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:47.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:47.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:47.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:26:47.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:26:47.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:26:47.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:26:47.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:26:47.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:26:47.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:26:47.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:26:47.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:26:47.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:26:47.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:26:47.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:26:47.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:26:47.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:26:47.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.377 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.378 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:26:47.378 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:47.378 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 95.405734605000006, 2020-11-12T17:26:47.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:26:47.378 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.379 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.379 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:47.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:47.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:26:47.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:26:47.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:26:47.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:26:47.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:26:47.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:26:47.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:26:47.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:26:47.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:26:47.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:26:47.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:26:47.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:26:47.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:26:47.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:26:47.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:26:47.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:26:47.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:26:47.389 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.390 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.390 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.391 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:47.391 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:47.391 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 70.739893589999994, 2020-11-12T17:26:47.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:26:47.392 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.392 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.393 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.393 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:47.394 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:47.394 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:26:47.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.395 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:47.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:47.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:47.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:26:47.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:26:47.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:26:47.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:26:47.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:26:47.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:26:47.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:26:47.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:26:47.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:26:47.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:26:47.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:26:47.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:26:47.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:47.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:26:47.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:26:47.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:47.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:26:47.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:26:47.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:47.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:26:47.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:26:47.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:26:47.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:26:47.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:26:47.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:26:47.412 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.412 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.412 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.413 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:47.413 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:47.413 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 70.736652261000003, 2020-11-12T17:26:47.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:26:47.414 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.414 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.414 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:47.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:47.415 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:26:47.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.415 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:47.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:47.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:47.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:26:47.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:26:47.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:26:47.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:26:47.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:26:47.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:26:47.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:26:47.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:26:47.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:26:47.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:26:47.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:26:47.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:26:47.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:47.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:26:47.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:26:47.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:47.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:26:47.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:26:47.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:47.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:26:47.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:26:47.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:26:47.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:26:47.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:26:47.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:26:47.430 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.430 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.430 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.430 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:26:47.431 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:47.431 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 66.303481360000006, 2020-11-12T17:26:47.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:26:47.431 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.431 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:47.431 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:47.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:47.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:47.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:26:47.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:26:47.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:26:47.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:26:47.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:26:47.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:26:47.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:26:47.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:26:47.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:26:47.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:26:47.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:26:47.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:26:47.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:26:47.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:26:47.437 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.437 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.437 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.438 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:47.438 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:47.438 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.254414699000002, 2020-11-12T17:26:47.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:26:47.438 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.438 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:47.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:47.439 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:26:47.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.439 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:47.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:47.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:47.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:26:47.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:26:47.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:26:47.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:26:47.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:26:47.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:26:47.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:26:47.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:26:47.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:26:47.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:26:47.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:26:47.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:26:47.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:47.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:26:47.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:26:47.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:47.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:26:47.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:26:47.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:47.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:26:47.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:26:47.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:26:47.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:26:47.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:26:47.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:26:47.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.448 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.448 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:47.449 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:47.449 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.252733919000001, 2020-11-12T17:26:47.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:26:47.449 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.449 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:47.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:47.450 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:47.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.450 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:47.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:47.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:26:47.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:26:47.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:26:47.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:26:47.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:26:47.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:26:47.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:26:47.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:26:47.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:26:47.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:26:47.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:26:47.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:26:47.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:26:47.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:47.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:26:47.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:26:47.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:47.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:26:47.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:26:47.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:47.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:26:47.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:26:47.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:26:47.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:26:47.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:26:47.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:26:47.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.465 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.465 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:47.465 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:47.466 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.252645723999997, 2020-11-12T17:26:47.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:26:47.466 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.466 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.466 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.466 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:47.466 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:47.467 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:47.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.467 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:47.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:47.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:47.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:26:47.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:26:47.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:26:47.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:26:47.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:26:47.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:26:47.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:26:47.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:26:47.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:26:47.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:26:47.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:26:47.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:26:47.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:47.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:26:47.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:26:47.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:47.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:26:47.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:26:47.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:47.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:26:47.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:26:47.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:26:47.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:26:47.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:26:47.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:26:47.476 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.476 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:47.477 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.234150409000002, 2020-11-12T17:26:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:26:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:47.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:26:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:26:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:26:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:26:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:26:47.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:26:47.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:26:47.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:26:47.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:26:47.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:26:47.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:26:47.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:26:47.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:26:47.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:26:47.484 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.484 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.234017418999997, 2020-11-12T17:26:47.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:26:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:47.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:26:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:26:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:26:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:26:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:26:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:26:47.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:26:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:26:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:26:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:26:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:26:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:26:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:26:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:26:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.492 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.233932691, 2020-11-12T17:26:47.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:26:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:47.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:26:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:26:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:26:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:26:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:26:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:26:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:26:47.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:26:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:26:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:26:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:26:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:26:47.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:26:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:26:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:26:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.500 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.182320161, 2020-11-12T17:26:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:26:47.501 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.502 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:26:47.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:26:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:26:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:26:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:26:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:26:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:26:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:26:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:26:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:26:47.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:26:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:26:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:26:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:26:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.182163144999997, 2020-11-12T17:26:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:26:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:47.510 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:47.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:47.511 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:47.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.511 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:47.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:47.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:47.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:26:47.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:26:47.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:26:47.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:26:47.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:26:47.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:26:47.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:26:47.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:26:47.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:26:47.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:26:47.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:47.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:26:47.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:26:47.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:26:47.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:26:47.517 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.518 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.518 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.518 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:47.518 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:47.518 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.483110239999998, 2020-11-12T17:26:47.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:26:47.519 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.519 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.519 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.519 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:47.519 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:47.519 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:26:47.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.520 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:47.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:47.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:26:47.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:26:47.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:26:47.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:26:47.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:26:47.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:26:47.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:26:47.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:26:47.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:26:47.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:26:47.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:26:47.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:26:47.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:26:47.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:47.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:26:47.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:26:47.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:47.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:26:47.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:26:47.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:47.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:26:47.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:26:47.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:26:47.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:26:47.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:26:47.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:26:47.529 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.529 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.529 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.530 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:47.530 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:47.530 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.396454752, 2020-11-12T17:26:47.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:26:47.530 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.530 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.530 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:47.531 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:47.531 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:47.531 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:26:47.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.531 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:47.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:47.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:47.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:26:47.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:26:47.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:26:47.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:26:47.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:26:47.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:26:47.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:26:47.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:26:47.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:26:47.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:26:47.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:26:47.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:26:47.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:47.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:26:47.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:26:47.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:47.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:26:47.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:26:47.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:47.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:26:47.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:26:47.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:26:47.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:26:47.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:26:47.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:26:47.540 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.540 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.541 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.541 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:26:47.541 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:47.541 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.382973525000001, 2020-11-12T17:26:47.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:26:47.542 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.542 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:47.542 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:47.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:47.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:47.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:26:47.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:26:47.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:26:47.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:26:47.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:26:47.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:26:47.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:26:47.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:26:47.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:26:47.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:26:47.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:26:47.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:26:47.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:47.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:26:47.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:26:47.549 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.549 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.550 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.550 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.550 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.550 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:47.554 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:47.480+0000 7f038ead6700 -1 osd.2 129 handle_osd_map injecting map crc failure 2020-11-12T17:26:47.554 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:26:47.555 INFO:teuthology.orchestra.run.smithi036.stderr:set osd.4 primary-affinity to 1 (8655362) 2020-11-12T17:26:47.556 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:47.502+0000 7f7b4fea9700 -1 osd.4 129 handle_osd_map injecting map crc failure 2020-11-12T17:26:47.556 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:47.550+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:47.557 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:47.558 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 1 16 1029 1013 7.9136 7.91406 0.00857531 0.0153468 2020-11-12T17:26:47.653 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:47.650+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:47.724 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:47.725 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:47.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.725 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:1265 5.b e130/127 5:d9bd92e2:::benchmark_data_smithi036_24110_object158:head v 130'41, mlcod=130'34)", 2020-11-12T17:26:47.725 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:47.721581+0000", 2020-11-12T17:26:47.727 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.004522084, 2020-11-12T17:26:47.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045433100000000001, 2020-11-12T17:26:47.727 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.727 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.728 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.721581+0000", 2020-11-12T17:26:47.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.721581+0000", 2020-11-12T17:26:47.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:47.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.721553+0000", 2020-11-12T17:26:47.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6532000000000003e-05 2020-11-12T17:26:47.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.721650+0000", 2020-11-12T17:26:47.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9864999999999998e-05 2020-11-12T17:26:47.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.721700+0000", 2020-11-12T17:26:47.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1359999999999999e-06 2020-11-12T17:26:47.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.721707+0000", 2020-11-12T17:26:47.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052851600000000003 2020-11-12T17:26:47.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722235+0000", 2020-11-12T17:26:47.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1755000000000001e-05 2020-11-12T17:26:47.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722257+0000", 2020-11-12T17:26:47.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038451449999999999 2020-11-12T17:26:47.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.726102+0000", 2020-11-12T17:26:47.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045216049999999997 2020-11-12T17:26:47.734 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.734 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.734 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.734 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:1266 5.b e130/127 5:d9bd92e2:::benchmark_data_smithi036_24110_object158:head v 130'42, mlcod=130'34)", 2020-11-12T17:26:47.735 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:47.722457+0000", 2020-11-12T17:26:47.735 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0036460260000000001, 2020-11-12T17:26:47.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0037318270000000001, 2020-11-12T17:26:47.735 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.735 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.735 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722457+0000", 2020-11-12T17:26:47.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722457+0000", 2020-11-12T17:26:47.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:47.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722431+0000", 2020-11-12T17:26:47.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6374999999999999e-05 2020-11-12T17:26:47.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722518+0000", 2020-11-12T17:26:47.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7688000000000001e-05 2020-11-12T17:26:47.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722565+0000", 2020-11-12T17:26:47.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1250000000000001e-05 2020-11-12T17:26:47.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722597+0000", 2020-11-12T17:26:47.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8733000000000002e-05 2020-11-12T17:26:47.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722645+0000", 2020-11-12T17:26:47.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3638999999999998e-05 2020-11-12T17:26:47.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.722669+0000", 2020-11-12T17:26:47.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003503576 2020-11-12T17:26:47.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.726172+0000", 2020-11-12T17:26:47.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003715791 2020-11-12T17:26:47.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.741 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.742 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:1267 5.b e130/127 5:d9bd92e2:::benchmark_data_smithi036_24110_object158:head v 130'43, mlcod=130'34)", 2020-11-12T17:26:47.742 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:47.724062+0000", 2020-11-12T17:26:47.742 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0020409550000000001, 2020-11-12T17:26:47.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021735740000000002, 2020-11-12T17:26:47.742 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:47.743 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:47.743 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:47.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:47.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.724062+0000", 2020-11-12T17:26:47.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:47.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:47.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.724062+0000", 2020-11-12T17:26:47.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:26:47.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:47.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.724034+0000", 2020-11-12T17:26:47.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101141 2020-11-12T17:26:47.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:47.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.724135+0000", 2020-11-12T17:26:47.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9432000000000003e-05 2020-11-12T17:26:47.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:47.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.724194+0000", 2020-11-12T17:26:47.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1420000000000004e-06 2020-11-12T17:26:47.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:47.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.724201+0000", 2020-11-12T17:26:47.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7015999999999998e-05 2020-11-12T17:26:47.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:47.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.724248+0000", 2020-11-12T17:26:47.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0894999999999999e-05 2020-11-12T17:26:47.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:47.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.724269+0000", 2020-11-12T17:26:47.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019631459999999998 2020-11-12T17:26:47.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:47.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:47.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:47.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:47.726232+0000", 2020-11-12T17:26:47.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021705499999999998 2020-11-12T17:26:47.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.749 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:47.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:47.749 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:47.749 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 3 2020-11-12T17:26:47.750 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:47.751 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:47.753 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:47.748+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:47.855 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:47.850+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:47.920 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:47.920 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:47.921 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:47.921 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:47.921 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:47.935 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:47.980 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:47.978+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:48.058 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:48.054+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:48.100 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:48.101 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 213.57303075600001, 2020-11-12T17:26:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:26:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:48.102 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:26:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:26:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:26:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:26:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:26:48.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:26:48.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:26:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:26:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:26:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:26:48.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:26:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:26:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:26:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:26:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:26:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:26:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:26:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:26:48.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:26:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:26:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:26:48.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:26:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:26:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.114 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.115 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:26:48.115 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:48.115 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 213.56963082199999, 2020-11-12T17:26:48.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:26:48.116 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.116 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:48.116 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:48.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:48.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:48.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:26:48.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:26:48.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:26:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:26:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:26:48.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:26:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:26:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:26:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:26:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:26:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:26:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:26:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:26:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:26:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:26:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 178.09374137500001, 2020-11-12T17:26:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:26:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.125 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:48.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:48.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:26:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:26:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:26:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:26:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:26:48.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:26:48.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:26:48.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:26:48.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:26:48.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:26:48.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:26:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:26:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:26:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:26:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:26:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:26:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 146.15375603199999, 2020-11-12T17:26:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:26:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.135 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:26:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.136 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:26:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:26:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:26:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:26:48.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:26:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:26:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:26:48.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:26:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:26:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:26:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:26:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:26:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:26:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:26:48.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:26:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:26:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:26:48.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:26:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:26:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:26:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:26:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:26:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:26:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:26:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 134.676654958, 2020-11-12T17:26:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:26:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:26:48.148 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:26:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:26:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:26:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:26:48.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:26:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:26:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:26:48.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:26:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:26:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:26:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:26:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:26:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:26:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.155 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:26:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 133.557644571, 2020-11-12T17:26:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:26:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.156 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:26:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:26:48.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:26:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:26:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:26:48.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:26:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:26:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:26:48.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:26:48.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:26:48.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:26:48.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:26:48.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:26:48.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:48.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:26:48.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:26:48.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:26:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:26:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:26:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:26:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:26:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:26:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:26:48.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:26:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:26:48.168 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 133.541506567, 2020-11-12T17:26:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:26:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:48.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:26:48.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:26:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:26:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:26:48.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:26:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:26:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:26:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:26:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:26:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:26:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:26:48.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:26:48.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:26:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:26:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:26:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 133.53677888799999, 2020-11-12T17:26:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:26:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.178 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:26:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.179 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:26:48.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:26:48.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:26:48.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:26:48.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:26:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:26:48.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:26:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:26:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:26:48.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:26:48.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:48.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:26:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:26:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:26:48.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:26:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:26:48.188 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.155219821000003, 2020-11-12T17:26:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:26:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:26:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:26:48.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:26:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:26:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:26:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:26:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:26:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:26:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:26:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:26:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:26:48.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:26:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:26:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:26:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:26:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:26:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:26:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:26:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:26:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:26:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:26:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:26:48.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:26:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:26:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.200 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:26:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:48.201 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.149665999999996, 2020-11-12T17:26:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:26:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:48.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:26:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:26:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:26:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:26:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:26:48.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:26:48.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:26:48.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:26:48.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:26:48.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:26:48.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:26:48.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:26:48.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:26:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:26:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:73896 4.3 4:cac907c9:::benchmark_data_smithi036_18856_object9236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e111)", 2020-11-12T17:26:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.611144044, 2020-11-12T17:26:48.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34147229000000001, 2020-11-12T17:26:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.212 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 73896 2020-11-12T17:26:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488091+0000", 2020-11-12T17:26:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109295 2020-11-12T17:26:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488200+0000", 2020-11-12T17:26:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2892e-05 2020-11-12T17:26:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488213+0000", 2020-11-12T17:26:48.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2709999999999998e-06 2020-11-12T17:26:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488219+0000", 2020-11-12T17:26:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0085628400000000004 2020-11-12T17:26:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.496782+0000", 2020-11-12T17:26:48.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011530499999999999 2020-11-12T17:26:48.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.496897+0000", 2020-11-12T17:26:48.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017658600000000001 2020-11-12T17:26:48.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.497074+0000", 2020-11-12T17:26:48.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018301089999999999 2020-11-12T17:26:48.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.498904+0000", 2020-11-12T17:26:48.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33056671100000001 2020-11-12T17:26:48.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829471+0000", 2020-11-12T17:26:48.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7509999999999995e-05 2020-11-12T17:26:48.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829548+0000", 2020-11-12T17:26:48.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9070999999999998e-05 2020-11-12T17:26:48.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829597+0000", 2020-11-12T17:26:48.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34147229000000001 2020-11-12T17:26:48.223 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.223 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:48.224 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.493016989000001, 2020-11-12T17:26:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:26:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.225 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.226 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:26:48.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.226 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:48.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:48.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:48.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:26:48.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:26:48.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:26:48.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:26:48.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:26:48.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:26:48.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:26:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:26:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:26:48.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:26:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:26:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:26:48.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:26:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:26:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:26:48.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:26:48.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:26:48.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:26:48.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:26:48.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:26:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:26:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:26:48.236 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.237 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.237 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.491123376000001, 2020-11-12T17:26:48.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:26:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:26:48.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:48.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:26:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:26:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:26:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:26:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:26:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:26:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:26:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:26:48.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:26:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:26:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:26:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:26:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:26:48.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:26:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:26:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:26:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:26:48.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:26:48.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:26:48.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:26:48.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:26:48.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:26:48.251 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.251 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.251 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.252 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:48.252 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:48.252 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.490370727999998, 2020-11-12T17:26:48.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:26:48.252 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.253 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.253 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:26:48.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:48.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:26:48.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:26:48.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:26:48.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:26:48.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:26:48.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:26:48.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:26:48.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:26:48.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:26:48.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:26:48.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:26:48.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:26:48.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:26:48.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:26:48.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:26:48.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:26:48.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:26:48.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:26:48.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:26:48.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:26:48.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:26:48.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:26:48.264 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.264 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.264 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.265 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:48.265 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:48.265 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.487209211, 2020-11-12T17:26:48.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:26:48.265 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.265 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.265 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.266 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.266 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.266 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:26:48.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.266 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:48.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:48.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:26:48.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:26:48.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:26:48.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:26:48.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:26:48.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:26:48.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:26:48.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:26:48.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:26:48.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:26:48.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:26:48.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:26:48.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:26:48.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:26:48.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:26:48.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:26:48.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:26:48.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:26:48.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:26:48.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:26:48.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:26:48.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:26:48.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:26:48.275 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.276 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.276 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.276 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:48.276 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:48.276 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.486128044000001, 2020-11-12T17:26:48.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:26:48.277 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.277 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.277 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.277 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.277 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.277 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:26:48.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.278 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:48.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:48.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:48.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:26:48.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:26:48.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:26:48.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:26:48.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:26:48.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:26:48.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:26:48.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:26:48.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:26:48.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:26:48.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:26:48.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:26:48.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:26:48.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:26:48.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:26:48.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:26:48.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:26:48.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:26:48.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:26:48.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:26:48.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:26:48.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:26:48.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.288 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.289 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:48.289 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:48.289 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.485958951000001, 2020-11-12T17:26:48.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:26:48.289 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.289 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.289 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.290 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.290 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.290 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:26:48.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.290 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:48.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:48.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:48.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:26:48.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:26:48.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:26:48.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:26:48.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:26:48.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:26:48.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:26:48.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:26:48.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:26:48.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:26:48.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:26:48.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:26:48.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:26:48.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:26:48.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:26:48.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:26:48.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:26:48.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:26:48.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:26:48.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:26:48.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:26:48.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:26:48.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.300 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.301 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.301 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:48.301 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:48.301 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.483340304999999, 2020-11-12T17:26:48.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:26:48.302 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.302 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.302 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.302 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.302 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.302 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:26:48.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.303 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:48.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:48.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:48.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:26:48.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:26:48.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:26:48.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:26:48.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:26:48.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:26:48.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:26:48.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:26:48.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:26:48.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:26:48.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:26:48.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:26:48.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:26:48.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:26:48.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:26:48.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:26:48.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:26:48.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:26:48.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:26:48.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:26:48.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:26:48.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:26:48.312 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.312 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.312 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.312 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:48.313 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:48.313 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.483232222000002, 2020-11-12T17:26:48.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:26:48.313 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.313 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:48.313 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.313 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:48.314 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:48.314 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:26:48.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.314 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:48.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:48.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:26:48.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:26:48.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:26:48.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:26:48.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:26:48.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:26:48.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:26:48.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:26:48.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:26:48.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:26:48.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:26:48.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:26:48.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:26:48.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:48.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:26:48.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:26:48.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:26:48.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:26:48.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:48.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:26:48.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:26:48.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:48.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:26:48.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:26:48.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:26:48.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:26:48.324 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.324 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.324 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.324 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:26:48.325 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:48.325 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 27.479269540000001, 2020-11-12T17:26:48.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:26:48.325 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.325 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:48.325 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:48.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:48.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:26:48.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:26:48.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:26:48.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:26:48.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:26:48.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:26:48.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:26:48.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:26:48.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:26:48.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:26:48.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:26:48.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:26:48.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:26:48.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:48.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:26:48.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:26:48.332 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.332 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.332 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.332 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.332 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.332 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:48.333 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:48.334 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:48.330+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:48.335 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:48.435 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:48.432+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:48.487 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:48.513 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:48.513 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:48.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.513 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:2024 5.2 5:42acf85f:::benchmark_data_smithi036_24110_object252:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e130)", 2020-11-12T17:26:48.514 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:48.494655+0000", 2020-11-12T17:26:48.514 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.019616425, 2020-11-12T17:26:48.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.019642415999999999, 2020-11-12T17:26:48.514 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:48.514 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:48.514 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:48.514 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:48.515 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:48.515 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 2024 2020-11-12T17:26:48.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.515 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:48.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:48.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.494655+0000", 2020-11-12T17:26:48.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:48.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:48.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.494655+0000", 2020-11-12T17:26:48.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:26:48.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:48.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.494625+0000", 2020-11-12T17:26:48.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7287000000000006e-05 2020-11-12T17:26:48.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:48.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.494712+0000", 2020-11-12T17:26:48.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7136999999999999e-05 2020-11-12T17:26:48.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:48.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.494729+0000", 2020-11-12T17:26:48.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2909999999999996e-06 2020-11-12T17:26:48.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:48.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.494739+0000", 2020-11-12T17:26:48.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5022999999999998e-05 2020-11-12T17:26:48.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:48.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.494794+0000", 2020-11-12T17:26:48.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011676900000000001 2020-11-12T17:26:48.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:48.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.494911+0000", 2020-11-12T17:26:48.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000189789 2020-11-12T17:26:48.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:48.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.495100+0000", 2020-11-12T17:26:48.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014971190000000001 2020-11-12T17:26:48.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:48.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:48.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:48.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:48.496597+0000", 2020-11-12T17:26:48.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019424080000000001 2020-11-12T17:26:48.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.522 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:48.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:48.522 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:48.523 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:26:48.523 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:48.524 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:48.524 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:48.537 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:48.532+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:48.542 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:48.554 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 2 16 2105 2089 8.15954 8.40625 0.00880679 0.0152448 2020-11-12T17:26:48.572 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:48.600 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:48.632 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:48.636 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:48.632+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:48.649 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:48.650 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:48.650 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:48.650 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:48.650 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:48.662 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:48.663 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:48.690 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:48.692 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:48.693 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:48.693 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:48.693 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:48.693 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:48.693 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:48.693 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:48.694 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:48.751 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:48.748+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:48.784 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:48.784 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:48.797 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:48.838 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:48.832+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:48.923 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:48.923 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:48.934 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:48.980 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:48.978+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:49.040 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:49.036+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:49.063 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:49.063 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:49.076 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:49.142 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:49.136+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:49.243 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:49.240+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:49.253 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:49.254 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:49.265 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:49.344 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:49.342+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:49.384 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:49.384 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:49.394 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:49.445 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:49.442+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:49.509 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:49.509 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:49.525 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:49.658 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:26:49.660 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 3 16 3409 3393 8.83518 10.1875 0.00944022 0.0140853 2020-11-12T17:26:49.660 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:49.656+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:49.761 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:49.758+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:49.788 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:49.788 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:49.800 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:49.862 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:49.856+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:49.914 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:49.914 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:49.926 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:49.963 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:49.958+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:50.063 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:50.058+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:50.094 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:50.094 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:50.103 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:50.165 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:50.160+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:50.219 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:50.220 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:50.235 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:50.265 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:50.262+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:50.366 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:50.360+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:50.384 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:50.384 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:50.395 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:50.468 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:50.466+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:50.523 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:26:50.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 4 16 4613 4597 8.97774 9.40625 0.0105683 0.0138054 2020-11-12T17:26:50.568 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:50.566+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:50.571 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:50.572 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:50.582 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:50.668 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:50.664+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:50.710 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:50.744 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:50.745 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:50.757 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:50.799 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:50.796+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:50.870 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:50.866+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:50.871 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:50.900 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:50.923 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:50.924 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:50.931 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:50.934 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:50.956 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:50.971 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:50.968+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:50.985 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:51.015 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:51.057 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:51.058 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:51.059 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:26:51.059 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:26:51.059 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:26:51.059 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:51.070 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:51.073 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:51.070+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:51.173 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:51.170+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:51.228 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:51.269 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:51.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:51.270 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:51.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.270 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:51.270 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:51.270 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 216.80722292199999, 2020-11-12T17:26:51.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:51.271 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.271 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.271 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.271 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:51.271 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:51.271 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:51.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.272 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:51.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:51.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:51.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:51.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:51.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:51.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:51.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:51.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:51.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:51.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:51.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:51.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:51.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:51.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:51.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:51.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:51.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:51.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:51.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:51.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:51.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:51.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:51.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:51.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:51.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:51.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.286 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.287 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:51.287 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:51.288 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 216.80027885999999, 2020-11-12T17:26:51.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:51.288 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.288 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:51.289 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:51.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:51.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:51.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:51.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:51.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:51.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:51.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:51.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:51.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:51.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:51.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:51.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:51.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:51.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:51.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:51.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:51.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.304 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.305 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:51.305 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:51.305 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 180.62644107400001, 2020-11-12T17:26:51.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:51.305 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.305 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.306 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.306 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:51.306 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:51.306 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:51.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.306 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:51.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:51.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:51.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:51.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:51.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:51.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:51.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:51.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:51.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:51.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:51.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:51.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:51.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:51.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:51.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:51.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:51.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:51.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:51.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:51.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:51.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:51.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:51.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:51.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:51.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:51.320 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.320 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.321 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.321 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:51.322 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:51.322 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 176.154907165, 2020-11-12T17:26:51.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:51.322 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.323 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.323 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.323 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:51.323 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:51.323 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:51.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.324 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:51.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:51.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:51.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:51.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:51.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:51.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:51.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:51.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:51.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:51.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:51.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:51.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:51.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:51.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:51.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:51.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:51.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:51.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:51.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:51.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:51.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:51.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:51.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:51.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:51.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:51.368 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.368 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.368 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.369 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:51.369 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:51.369 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 164.36273598099999, 2020-11-12T17:26:51.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:51.369 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.369 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.369 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.370 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:51.370 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:51.370 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:51.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.370 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:51.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:51.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:51.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:51.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:51.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:51.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:51.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:51.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:51.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:51.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:51.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:51.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:51.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:51.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:51.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:51.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:51.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:51.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:51.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:51.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:51.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:51.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:51.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:51.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:51.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:51.379 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.379 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.379 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.380 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:51.380 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:51.380 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 149.40628913899999, 2020-11-12T17:26:51.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:51.380 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.380 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.380 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.380 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:51.381 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:51.381 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:51.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.381 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:51.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:51.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:51.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:51.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:51.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:51.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:51.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:51.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:51.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:51.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:51.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:51.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:51.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:51.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:51.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:51.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:51.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:51.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:51.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:51.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:51.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:51.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:51.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:51.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:51.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:51.391 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.391 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.391 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.392 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:51.392 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:51.392 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 149.27735565500001, 2020-11-12T17:26:51.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:51.392 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.392 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.393 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:51.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:51.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:51.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:51.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:51.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:51.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:51.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:51.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:51.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:51.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:51.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:51.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:51.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:51.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:51.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:51.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:51.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:51.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:51.399 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.399 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.583217381, 2020-11-12T17:26:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:51.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:51.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:51.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:51.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:51.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:51.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:51.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:51.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:51.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:51.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:51.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:51.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:51.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:51.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:51.413 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.413 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.413 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.414 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:51.414 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:51.414 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.268663735, 2020-11-12T17:26:51.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:51.415 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.415 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.416 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.416 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:51.416 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:51.416 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:51.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.417 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:51.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:51.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:51.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:51.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:51.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:51.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:51.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:51.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:51.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:51.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:51.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:51.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:51.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:51.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:51.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:51.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:51.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:51.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:51.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:51.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:51.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:51.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:51.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:51.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:51.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:51.436 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.437 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.438 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:51.438 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:51.438 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.913978658999994, 2020-11-12T17:26:51.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:51.439 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.439 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.440 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:51.440 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:51.440 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:51.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.441 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:51.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:51.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:51.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:51.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:51.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:51.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:51.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:51.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:51.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:51.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:51.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:51.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:51.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:51.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:51.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:51.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:51.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:51.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:51.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:51.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:51.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:51.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:51.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:51.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:51.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:51.458 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.458 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.458 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.459 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:51.459 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:51.459 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 89.900801900000005, 2020-11-12T17:26:51.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:51.459 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.460 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:51.460 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:51.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:51.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:51.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:51.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:51.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:51.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:51.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:51.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:51.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:51.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:51.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:51.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:51.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:51.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:51.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:51.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:51.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.501 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.505 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:51.506 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:51.506 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.346720450999996, 2020-11-12T17:26:51.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:51.506 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.507 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.507 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.507 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:51.507 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:51.507 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:51.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.508 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:51.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:51.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:51.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:51.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:51.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:51.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:51.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:51.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:51.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:51.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:51.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:51.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:51.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:51.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:51.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:51.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:51.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:51.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:51.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:51.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:51.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:51.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:51.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:51.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:51.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:51.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.517 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.518 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:51.518 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:51.518 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.337733145000001, 2020-11-12T17:26:51.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:51.518 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.518 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:51.519 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:51.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:51.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:51.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:51.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:51.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:51.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:51.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:51.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:51.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:51.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:51.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:51.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:51.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:51.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:51.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:51.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:51.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.526 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.527 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:51.527 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:51.527 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.319805830999996, 2020-11-12T17:26:51.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:51.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.528 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.528 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.528 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:51.529 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:51.529 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:51.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.529 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:51.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:51.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:51.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:51.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:51.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:51.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:51.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:51.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:51.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:51.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:51.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:51.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:51.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:51.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:51.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:51.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:51.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:51.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:51.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:51.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:51.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:51.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:51.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:51.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:51.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:51.546 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.547 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.547 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.548 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:51.548 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:51.548 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.768762433000006, 2020-11-12T17:26:51.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:51.549 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.549 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.549 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.549 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:51.550 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:51.550 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:51.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.551 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:51.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:51.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:51.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:51.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:51.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:51.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:51.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:51.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:51.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:51.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:51.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:51.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:51.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:51.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:51.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:51.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:51.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:51.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:51.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:51.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:51.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:51.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:51.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:51.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:51.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:51.564 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.564 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.564 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.564 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:51.565 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:51.565 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.517366933000005, 2020-11-12T17:26:51.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:51.565 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.565 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.565 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.565 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:51.566 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:51.566 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:51.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.566 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:51.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:51.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:51.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:51.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:51.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:51.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:51.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:51.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:51.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:51.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:51.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:51.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:51.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:51.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:51.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:51.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:51.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:51.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:51.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:51.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:51.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:51.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:51.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:51.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:51.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:51.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.576 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.576 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:51.576 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:51.576 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.438244616000006, 2020-11-12T17:26:51.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:51.577 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.577 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:51.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:51.577 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:51.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.578 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:51.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:51.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:51.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:51.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:51.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:51.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:51.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:51.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:51.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:51.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:51.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:51.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:51.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:51.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:51.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:51.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:51.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:51.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:51.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:51.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:51.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:51.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:51.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:51.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:51.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:51.586 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.586 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.587 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.587 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:51.587 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:51.587 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.655893648999999, 2020-11-12T17:26:51.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:51.587 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.588 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.588 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.588 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:51.588 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:51.588 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:51.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.588 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:51.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:26:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.192851300000001, 2020-11-12T17:26:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:26:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:26:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:26:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:26:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:26:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:26:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:26:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:26:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:26:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:26:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:26:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:26:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:26:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:26:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:26:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:26:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:26:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:26:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:26:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:26:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:26:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:26:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:26:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:26:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:26:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:26:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.171810766, 2020-11-12T17:26:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:26:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:26:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:26:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:26:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:26:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:26:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:26:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:26:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:26:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:26:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:26:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:26:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:26:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:51.747 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:51.749 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 5 16 5826 5810 9.07735 9.47656 0.0586952 0.0137183 2020-11-12T17:26:51.749 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:51.746+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:51.749 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:51.850 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:51.846+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:51.882 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:51.883 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:51.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.883 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:6207 5.e 5:7aff6c37:::benchmark_data_smithi036_24110_object775:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e131)", 2020-11-12T17:26:51.883 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:51.841278+0000", 2020-11-12T17:26:51.883 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.042519249000000002, 2020-11-12T17:26:51.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.042545446000000001, 2020-11-12T17:26:51.883 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:51.884 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:51.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:51.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:51.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:51.884 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 6207 2020-11-12T17:26:51.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.884 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:51.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:51.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.841278+0000", 2020-11-12T17:26:51.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:51.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:51.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.841278+0000", 2020-11-12T17:26:51.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.99997 2020-11-12T17:26:51.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:51.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.841248+0000", 2020-11-12T17:26:51.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7151999999999995e-05 2020-11-12T17:26:51.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:51.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.841335+0000", 2020-11-12T17:26:51.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2301e-05 2020-11-12T17:26:51.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:51.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.841347+0000", 2020-11-12T17:26:51.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5390000000000004e-06 2020-11-12T17:26:51.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.841354+0000", 2020-11-12T17:26:51.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00051292299999999998 2020-11-12T17:26:51.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:51.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.841867+0000", 2020-11-12T17:26:51.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6414999999999993e-05 2020-11-12T17:26:51.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:51.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.841933+0000", 2020-11-12T17:26:51.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010639799999999999 2020-11-12T17:26:51.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:51.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842039+0000", 2020-11-12T17:26:51.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045123159999999997 2020-11-12T17:26:51.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:51.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.846552+0000", 2020-11-12T17:26:51.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052738070000000001 2020-11-12T17:26:51.893 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:51.893 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:51.893 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:51.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.893 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:6208 5.e 5:7aff6c37:::benchmark_data_smithi036_24110_object775:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e131)", 2020-11-12T17:26:51.893 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:51.842094+0000", 2020-11-12T17:26:51.894 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.041703577999999998, 2020-11-12T17:26:51.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.041790584999999998, 2020-11-12T17:26:51.894 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:51.894 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:51.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:51.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:51.894 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:51.895 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 6208 2020-11-12T17:26:51.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.895 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:51.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:51.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842094+0000", 2020-11-12T17:26:51.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:51.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:51.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842094+0000", 2020-11-12T17:26:51.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:26:51.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:51.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842061+0000", 2020-11-12T17:26:51.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9237e-05 2020-11-12T17:26:51.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:51.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842150+0000", 2020-11-12T17:26:51.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.256e-05 2020-11-12T17:26:51.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:51.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842163+0000", 2020-11-12T17:26:51.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0599999999999996e-06 2020-11-12T17:26:51.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842169+0000", 2020-11-12T17:26:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020155300000000001 2020-11-12T17:26:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842370+0000", 2020-11-12T17:26:51.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5491e-05 2020-11-12T17:26:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842436+0000", 2020-11-12T17:26:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010432 2020-11-12T17:26:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.842540+0000", 2020-11-12T17:26:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040189850000000001 2020-11-12T17:26:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:51.846559+0000", 2020-11-12T17:26:51.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044653119999999999 2020-11-12T17:26:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:51.902 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:26:51.902 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:51.904 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:51.904 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:51.904 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:51.904 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:51.905 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:51.905 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:51.905 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:51.905 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:51.905 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:51.906 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:51.952 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:51.948+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:52.054 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:52.050+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:52.082 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:52.103 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:52.103 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:52.104 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:52.104 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:52.105 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:52.193 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:52.190+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:52.253 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:52.248+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:52.281 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:52.281 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:26:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 221.59366639500001, 2020-11-12T17:26:52.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:26:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:26:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.283 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:26:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:26:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:26:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:26:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:26:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:26:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:26:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:26:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:26:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:26:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:26:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:26:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:52.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:26:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:26:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:26:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:26:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:26:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:26:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:26:52.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:26:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:26:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:26:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:26:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 221.588186326, 2020-11-12T17:26:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:26:52.296 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:26:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:26:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:26:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:26:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:26:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:26:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:26:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:26:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:26:52.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:26:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:26:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:26:52.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:26:52.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:26:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:26:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:52.310 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 213.398064726, 2020-11-12T17:26:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:26:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.311 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:26:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:52.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:26:52.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:26:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:26:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:26:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:26:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:26:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:26:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:26:52.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:26:52.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:26:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:26:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:26:52.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:26:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:52.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:26:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:26:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:52.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:26:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:26:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:52.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:26:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:26:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:26:52.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:26:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:26:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:26:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.325 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:26:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 213.39082101700001, 2020-11-12T17:26:52.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:26:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:52.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:52.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:26:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:26:52.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:26:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:26:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:26:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:26:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:26:52.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:26:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:26:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:26:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:26:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:26:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:26:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:26:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.394731643, 2020-11-12T17:26:52.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:26:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:26:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:26:52.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:26:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:26:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:26:52.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:26:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:26:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:26:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:26:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:26:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:26:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:26:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:26:52.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:26:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:26:52.344 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.369462376, 2020-11-12T17:26:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:26:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:26:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:26:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:26:52.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:26:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:26:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:26:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:26:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:26:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:26:52.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:26:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:26:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:26:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:26:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:26:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:26:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:26:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:26:52.353 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.354 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 75.703621361000003, 2020-11-12T17:26:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:26:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.355 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:26:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.356 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:26:52.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:26:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:26:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:26:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:26:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:26:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:26:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:26:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:26:52.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:26:52.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:26:52.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:26:52.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:52.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:26:52.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:26:52.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:52.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:26:52.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:26:52.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:52.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:26:52.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:26:52.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:26:52.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:26:52.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:26:52.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:26:52.366 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.367 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.367 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.367 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:52.367 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:52.367 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 75.700380031999998, 2020-11-12T17:26:52.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:26:52.368 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.368 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.368 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.368 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:52.368 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:52.368 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:26:52.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.369 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:52.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:52.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:52.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:26:52.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:26:52.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:26:52.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:26:52.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:26:52.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:26:52.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:26:52.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:26:52.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:26:52.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:26:52.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:26:52.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:26:52.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:52.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:26:52.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:26:52.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:52.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:26:52.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:26:52.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:52.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:26:52.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:26:52.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:26:52.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:26:52.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:26:52.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:26:52.381 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.381 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.381 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.381 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:26:52.381 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:52.382 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.267209131000001, 2020-11-12T17:26:52.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:26:52.382 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.382 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:52.382 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:52.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:52.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:52.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:26:52.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:26:52.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:26:52.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:26:52.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:26:52.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:26:52.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:26:52.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:26:52.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:26:52.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:26:52.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:26:52.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:26:52.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:26:52.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:26:52.391 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.391 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.391 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.392 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:52.392 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:52.392 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.218142470000004, 2020-11-12T17:26:52.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:26:52.392 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.393 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.393 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.393 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:52.393 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:52.393 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:26:52.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.394 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:52.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:52.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:52.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:26:52.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:26:52.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:26:52.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:26:52.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:26:52.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:26:52.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:26:52.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:26:52.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:26:52.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:26:52.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:26:52.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:26:52.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:52.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:26:52.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:26:52.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:52.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:26:52.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:26:52.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:52.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:26:52.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:26:52.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:26:52.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:26:52.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:26:52.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:26:52.407 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.408 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.408 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:52.409 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:52.437 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.216461690000003, 2020-11-12T17:26:52.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:26:52.437 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.438 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.438 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.438 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:52.438 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:52.438 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:52.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.438 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:52.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:52.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:26:52.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:26:52.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:26:52.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:26:52.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:26:52.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:26:52.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:26:52.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:26:52.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:26:52.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:26:52.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:26:52.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:26:52.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:26:52.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:52.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:26:52.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:26:52.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:52.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:26:52.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:26:52.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:52.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:26:52.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:26:52.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:26:52.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:26:52.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:26:52.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:26:52.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.447 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.448 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:52.448 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:52.448 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.216373494999999, 2020-11-12T17:26:52.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:26:52.448 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:52.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:52.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:52.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:26:52.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:26:52.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:26:52.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:26:52.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:26:52.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:26:52.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:26:52.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:26:52.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:26:52.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:26:52.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:26:52.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:26:52.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:52.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:26:52.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:26:52.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:52.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:26:52.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:26:52.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:52.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:26:52.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:26:52.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:26:52.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:26:52.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:26:52.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:26:52.459 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.459 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.459 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.459 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:52.460 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:52.460 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.197878180000004, 2020-11-12T17:26:52.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:26:52.460 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.460 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:52.460 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:52.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:52.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:52.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:26:52.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:26:52.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:26:52.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:26:52.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:26:52.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:26:52.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:26:52.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:26:52.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:26:52.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:26:52.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:26:52.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:26:52.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:26:52.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:26:52.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.466 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.467 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:52.467 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:52.467 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.197745190000006, 2020-11-12T17:26:52.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:26:52.467 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.468 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:52.468 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:52.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:52.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:52.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:26:52.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:26:52.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:26:52.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:26:52.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:26:52.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:26:52.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:26:52.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:26:52.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:26:52.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:26:52.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:26:52.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:26:52.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:26:52.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:26:52.474 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.475 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.475 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.475 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:52.475 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:52.475 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.197660462000002, 2020-11-12T17:26:52.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:26:52.476 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.476 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:52.476 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:52.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:52.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:26:52.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:26:52.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:26:52.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:26:52.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:26:52.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:26:52.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:26:52.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:26:52.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:26:52.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:26:52.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:26:52.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:26:52.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:26:52.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:26:52.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:26:52.482 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.482 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.482 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.482 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:52.483 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:52.483 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.146047932000002, 2020-11-12T17:26:52.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:26:52.483 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.483 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:52.483 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.483 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:52.483 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:52.484 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:52.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.484 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:52.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:52.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:52.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:26:52.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:26:52.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:26:52.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:26:52.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:26:52.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:26:52.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:26:52.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:26:52.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:26:52.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:26:52.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:52.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:26:52.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:26:52.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:26:52.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:26:52.490 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.490 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.490 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.490 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:52.491 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:52.491 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.145890915999999, 2020-11-12T17:26:52.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:26:52.491 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.491 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:52.491 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.491 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:52.491 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:52.492 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:52.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.492 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:52.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:52.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:52.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:26:52.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:26:52.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:26:52.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:26:52.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:26:52.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:26:52.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:26:52.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:26:52.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:26:52.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:26:52.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:52.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:26:52.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:26:52.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:26:52.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:26:52.499 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.499 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.499 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.499 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:52.499 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:52.500 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.446838011000001, 2020-11-12T17:26:52.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:26:52.500 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.500 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.500 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.500 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:52.500 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:52.500 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:26:52.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.501 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:52.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:52.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:26:52.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:26:52.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:26:52.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:26:52.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:26:52.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:26:52.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:26:52.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:26:52.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:26:52.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:26:52.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:26:52.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:26:52.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:26:52.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:52.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:26:52.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:26:52.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:52.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:26:52.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:26:52.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:52.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:26:52.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:26:52.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:26:52.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:26:52.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:26:52.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:26:52.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.510 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.510 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:52.510 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:52.511 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.360182522999999, 2020-11-12T17:26:52.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:26:52.511 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.511 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:52.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:52.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:52.512 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:26:52.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.512 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:52.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:52.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:52.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:26:52.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:26:52.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:26:52.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:26:52.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:26:52.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:26:52.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:26:52.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:26:52.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:26:52.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:26:52.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:26:52.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:26:52.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:52.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:26:52.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:26:52.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:52.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:26:52.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:26:52.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:52.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:26:52.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:26:52.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:52.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:26:52.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:26:52.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:26:52.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:26:52.520 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.520 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.520 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.521 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:26:52.521 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:52.521 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.346701295999999, 2020-11-12T17:26:52.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:26:52.521 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.522 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:52.522 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:52.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:52.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:52.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:26:52.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:26:52.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:26:52.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:26:52.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:26:52.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:26:52.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:26:52.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:26:52.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:26:52.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:26:52.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:26:52.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:26:52.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:52.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:26:52.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:26:52.528 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.528 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.528 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.529 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.529 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.529 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:52.530 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:52.531 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:52.524+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:52.533 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:26:52.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 6 16 7063 7047 9.175 9.66406 0.0117083 0.0136021 2020-11-12T17:26:52.557 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2] out_osds: [0, 1] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:52.558 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:52.558 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-11-12T17:26:52.631 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:52.630+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:52.705 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:7233 5.f 5:f4f5929b:::benchmark_data_smithi036_24110_object904:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e131)", 2020-11-12T17:26:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:52.702697+0000", 2020-11-12T17:26:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0037919429999999999, 2020-11-12T17:26:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038249669999999999, 2020-11-12T17:26:52.706 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 7233 2020-11-12T17:26:52.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.702697+0000", 2020-11-12T17:26:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.702697+0000", 2020-11-12T17:26:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.702676+0000", 2020-11-12T17:26:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7244000000000003e-05 2020-11-12T17:26:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.702733+0000", 2020-11-12T17:26:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0437e-05 2020-11-12T17:26:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.702743+0000", 2020-11-12T17:26:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2299999999999996e-06 2020-11-12T17:26:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.702750+0000", 2020-11-12T17:26:52.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9987000000000002e-05 2020-11-12T17:26:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.702790+0000", 2020-11-12T17:26:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015884100000000001 2020-11-12T17:26:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.702948+0000", 2020-11-12T17:26:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012916499999999999 2020-11-12T17:26:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.703078+0000", 2020-11-12T17:26:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000380925 2020-11-12T17:26:52.715 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:7234 5.f 5:f4f5929b:::benchmark_data_smithi036_24110_object904:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e131)", 2020-11-12T17:26:52.716 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:52.704019+0000", 2020-11-12T17:26:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.002469808, 2020-11-12T17:26:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025951699999999999, 2020-11-12T17:26:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:52.717 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 7234 2020-11-12T17:26:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704019+0000", 2020-11-12T17:26:52.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704019+0000", 2020-11-12T17:26:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:52.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.703995+0000", 2020-11-12T17:26:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3245999999999995e-05 2020-11-12T17:26:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704078+0000", 2020-11-12T17:26:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1959e-05 2020-11-12T17:26:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704090+0000", 2020-11-12T17:26:52.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.827e-06 2020-11-12T17:26:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704097+0000", 2020-11-12T17:26:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8205000000000003e-05 2020-11-12T17:26:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704155+0000", 2020-11-12T17:26:52.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1236999999999994e-05 2020-11-12T17:26:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704246+0000", 2020-11-12T17:26:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170531 2020-11-12T17:26:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:52.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704417+0000", 2020-11-12T17:26:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00039780099999999998 2020-11-12T17:26:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:7235 5.f 5:f4f5929b:::benchmark_data_smithi036_24110_object904:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e131)", 2020-11-12T17:26:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:52.704473+0000", 2020-11-12T17:26:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0020156660000000002, 2020-11-12T17:26:52.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002235024, 2020-11-12T17:26:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:52.751 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 7235 2020-11-12T17:26:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704473+0000", 2020-11-12T17:26:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704473+0000", 2020-11-12T17:26:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704456+0000", 2020-11-12T17:26:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1285000000000001e-05 2020-11-12T17:26:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704507+0000", 2020-11-12T17:26:52.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9449999999999993e-06 2020-11-12T17:26:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704515+0000", 2020-11-12T17:26:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5260000000000004e-06 2020-11-12T17:26:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.704520+0000", 2020-11-12T17:26:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017165520000000001 2020-11-12T17:26:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.706236+0000", 2020-11-12T17:26:52.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011402499999999999 2020-11-12T17:26:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.706350+0000", 2020-11-12T17:26:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183826 2020-11-12T17:26:52.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.706534+0000", 2020-11-12T17:26:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020610609999999999 2020-11-12T17:26:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.759 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:7236 5.f 5.d949af2f (undecoded) ondisk+write+known_if_redirected e131)", 2020-11-12T17:26:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:52.705128+0000", 2020-11-12T17:26:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00136028, 2020-11-12T17:26:52.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00168337, 2020-11-12T17:26:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:26:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 7236 2020-11-12T17:26:52.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.705128+0000", 2020-11-12T17:26:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:52.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.705128+0000", 2020-11-12T17:26:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.705111+0000", 2020-11-12T17:26:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9444999999999998e-05 2020-11-12T17:26:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.705160+0000", 2020-11-12T17:26:52.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8839999999999994e-06 2020-11-12T17:26:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.705168+0000", 2020-11-12T17:26:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5700000000000003e-06 2020-11-12T17:26:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:52.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:52.705173+0000", 2020-11-12T17:26:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4511999999999997e-05 2020-11-12T17:26:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:52.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.767 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:52.768 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:52.768 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 4 2020-11-12T17:26:52.768 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:52.770 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:52.770 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:52.764+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:52.871 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:52.864+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:52.874 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:26:52.875 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:52.875 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 131, 2020-11-12T17:26:52.875 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:26:52.875 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2020-11-12T17:22:37.581394+0000", 2020-11-12T17:26:52.875 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2020-11-12T17:26:50.492297+0000", 2020-11-12T17:26:52.876 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2020-11-12T17:25:55.942493+0000", 2020-11-12T17:26:52.876 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2020-11-12T17:26:34.707632+0000", 2020-11-12T17:26:52.876 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-12T17:26:52.876 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2020-11-12T17:26:52.876 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2020-11-12T17:26:52.876 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2020-11-12T17:26:52.876 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2020-11-12T17:26:52.877 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2020-11-12T17:26:52.877 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2020-11-12T17:26:52.877 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:52.877 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 4, 2020-11-12T17:26:52.877 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2020-11-12T17:26:52.877 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-12T17:26:52.877 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-12T17:26:52.878 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2020-11-12T17:26:52.878 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 5, 2020-11-12T17:26:52.878 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2020-11-12T17:26:52.878 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2020-11-12T17:26:52.878 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2020-11-12T17:26:52.878 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2020-11-12T17:26:52.878 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2020-11-12T17:26:52.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.879 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2020-11-12T17:26:52.879 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2020-11-12T17:26:52.879 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:41.596657+0000", 2020-11-12T17:26:52.879 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:26:52.879 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:26:52.879 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:26:52.880 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:26:52.880 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:26:52.880 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:26:52.881 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:26:52.881 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:26:52.881 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2020-11-12T17:26:52.881 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2020-11-12T17:26:52.881 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2020-11-12T17:26:52.881 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2020-11-12T17:26:52.882 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2020-11-12T17:26:52.882 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:26:52.882 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:26:52.882 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:26:52.882 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:26:52.882 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:26:52.883 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:26:52.883 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:26:52.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.884 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "16", 2020-11-12T17:26:52.884 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:26:52.884 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:26:52.884 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:26:52.884 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:26:52.885 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:26:52.885 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:26:52.885 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:26:52.885 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:26:52.885 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:26:52.885 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:26:52.885 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:26:52.886 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:26:52.886 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:26:52.886 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:26:52.886 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:26:52.887 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:26:52.887 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:26:52.887 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:26:52.887 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:26:52.887 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:26:52.887 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:26:52.888 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:26:52.888 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:26:52.888 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:26:52.888 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:26:52.888 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:26:52.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.889 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:26:52.889 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:26:52.889 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:26:52.889 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:26:52.889 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:26:52.889 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:26:52.889 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:26:52.890 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:26:52.890 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:26:52.890 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:26:52.891 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:26:52.891 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2020-11-12T17:26:52.891 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2020-11-12T17:26:52.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.891 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:26:52.891 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2020-11-12T17:26:52.892 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.892 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2020-11-12T17:26:52.892 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2020-11-12T17:26:52.892 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:49.905816+0000", 2020-11-12T17:26:52.892 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:26:52.893 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:26:52.893 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:26:52.893 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:26:52.893 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:26:52.893 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:26:52.893 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:26:52.893 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:26:52.894 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2020-11-12T17:26:52.894 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2020-11-12T17:26:52.894 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2020-11-12T17:26:52.894 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2020-11-12T17:26:52.895 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2020-11-12T17:26:52.895 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:26:52.895 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:26:52.895 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:26:52.895 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:26:52.895 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:26:52.895 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:26:52.896 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:26:52.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.896 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "19", 2020-11-12T17:26:52.896 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:26:52.896 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:26:52.896 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:26:52.896 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:26:52.897 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:26:52.897 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:26:52.897 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:26:52.897 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:26:52.897 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:26:52.897 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:26:52.897 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:26:52.897 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:26:52.898 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:26:52.898 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:26:52.898 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:26:52.898 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:26:52.898 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:26:52.898 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:26:52.898 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:26:52.899 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:26:52.899 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:26:52.899 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:26:52.899 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:26:52.899 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:26:52.899 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:26:52.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:26:52.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.900 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:26:52.900 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:26:52.900 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:26:52.900 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:26:52.900 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:26:52.901 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:26:52.901 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:26:52.902 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:26:52.902 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:26:52.902 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:26:52.902 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:26:52.902 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:26:52.902 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:26:52.903 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2020-11-12T17:26:52.903 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.904 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 5, 2020-11-12T17:26:52.904 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "unique_pool_2", 2020-11-12T17:26:52.904 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:26:43.854598+0000", 2020-11-12T17:26:52.904 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:26:52.905 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:26:52.905 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:26:52.905 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:26:52.905 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:26:52.905 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:26:52.905 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:26:52.906 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:26:52.906 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 16, 2020-11-12T17:26:52.906 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 16, 2020-11-12T17:26:52.906 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 16, 2020-11-12T17:26:52.906 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 16, 2020-11-12T17:26:52.906 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 16, 2020-11-12T17:26:52.906 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:26:52.907 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:26:52.907 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:26:52.907 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:26:52.907 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:26:52.908 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:26:52.908 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:26:52.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.908 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "129", 2020-11-12T17:26:52.908 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:26:52.908 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:26:52.908 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:26:52.909 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:26:52.909 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:26:52.909 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:26:52.909 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:26:52.909 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:26:52.909 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:26:52.910 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:26:52.911 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:26:52.911 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:26:52.911 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:26:52.911 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:26:52.912 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:26:52.912 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:26:52.912 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:26:52.913 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:26:52.913 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:26:52.913 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:26:52.913 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:26:52.913 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:26:52.913 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:26:52.913 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:26:52.914 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:26:52.914 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:26:52.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.914 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:26:52.914 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:26:52.914 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:26:52.914 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:26:52.915 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:26:52.915 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:26:52.915 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:26:52.915 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:26:52.915 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:26:52.915 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:26:52.915 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:26:52.916 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:26:52.916 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:26:52.916 INFO:teuthology.orchestra.run.smithi036.stdout: "rados": {} 2020-11-12T17:26:52.916 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.916 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.916 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:52.917 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2020-11-12T17:26:52.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.917 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:26:52.917 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "bd1d5457-5d54-4074-b378-9da417f42976", 2020-11-12T17:26:52.917 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:52.917 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 0, 2020-11-12T17:26:52.917 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 0, 2020-11-12T17:26:52.918 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:52.918 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:52.918 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:52.918 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:52.918 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:26:52.918 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:52.918 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:52.919 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:52.919 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.919 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.919 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6801", 2020-11-12T17:26:52.919 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:26:52.919 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.920 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.920 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:52.920 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.920 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.920 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2020-11-12T17:26:52.921 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:26:52.921 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.921 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.921 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:52.921 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.922 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.922 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2020-11-12T17:26:52.922 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:26:52.922 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.922 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.923 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:52.923 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.923 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.923 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2020-11-12T17:26:52.923 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:26:52.923 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.924 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.924 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6801/12304", 2020-11-12T17:26:52.924 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6802/12304", 2020-11-12T17:26:52.924 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6806/12304", 2020-11-12T17:26:52.925 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6804/12304", 2020-11-12T17:26:52.925 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:52.925 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:52.925 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:52.925 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.926 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:26:52.926 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "37152eee-a8d8-40f1-8e27-2899e7b94c98", 2020-11-12T17:26:52.926 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:52.926 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 0, 2020-11-12T17:26:52.926 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 0, 2020-11-12T17:26:52.926 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:52.926 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:26:52.927 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 57, 2020-11-12T17:26:52.927 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 88, 2020-11-12T17:26:52.927 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 121, 2020-11-12T17:26:52.927 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 58, 2020-11-12T17:26:52.927 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:52.927 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:52.927 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.928 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.928 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2020-11-12T17:26:52.928 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:26:52.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.928 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.929 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:52.929 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.929 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.929 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2020-11-12T17:26:52.929 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:26:52.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.929 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.930 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:52.930 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.930 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.930 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2020-11-12T17:26:52.930 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:26:52.931 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.931 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.931 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:52.931 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.931 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.932 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2020-11-12T17:26:52.932 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:26:52.932 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.932 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.932 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/20274", 2020-11-12T17:26:52.932 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6814/20274", 2020-11-12T17:26:52.932 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6816/20274", 2020-11-12T17:26:52.933 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6815/20274", 2020-11-12T17:26:52.933 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:52.933 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:52.933 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:52.933 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.933 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:26:52.934 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "d8ec2abb-38bf-4863-969a-482c4fa44f41", 2020-11-12T17:26:52.934 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:52.934 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:52.934 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:52.934 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:52.934 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:26:52.934 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 93, 2020-11-12T17:26:52.935 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 102, 2020-11-12T17:26:52.935 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 127, 2020-11-12T17:26:52.935 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 94, 2020-11-12T17:26:52.935 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:52.935 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:52.935 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.935 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.936 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2020-11-12T17:26:52.936 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:26:52.936 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.936 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.936 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:52.936 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.937 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.937 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2020-11-12T17:26:52.937 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:26:52.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.937 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.937 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:52.938 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.938 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.938 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2020-11-12T17:26:52.938 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:26:52.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.938 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.939 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:52.939 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.939 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.939 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2020-11-12T17:26:52.939 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:26:52.939 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.940 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.940 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/21493", 2020-11-12T17:26:52.940 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/21493", 2020-11-12T17:26:52.940 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6808/21493", 2020-11-12T17:26:52.940 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/21493", 2020-11-12T17:26:52.940 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:52.941 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:52.941 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:52.941 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.941 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:26:52.941 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "799d3499-577c-4510-a00c-9b2e126fc449", 2020-11-12T17:26:52.941 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:52.942 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:52.942 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:52.942 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:52.942 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:52.944 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:52.944 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:52.944 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 127, 2020-11-12T17:26:52.944 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:52.944 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:52.945 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:52.945 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.945 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.945 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2020-11-12T17:26:52.945 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:26:52.946 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.946 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.946 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:52.946 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.947 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.947 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2020-11-12T17:26:52.948 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:26:52.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.948 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.948 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:52.948 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.949 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.949 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2020-11-12T17:26:52.949 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:26:52.949 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.949 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.950 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:52.950 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.950 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.950 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2020-11-12T17:26:52.950 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:26:52.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.951 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.951 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6809/12305", 2020-11-12T17:26:52.951 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6810/12305", 2020-11-12T17:26:52.951 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6813/12305", 2020-11-12T17:26:52.951 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6811/12305", 2020-11-12T17:26:52.951 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:52.951 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:52.952 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:52.952 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:26:52.952 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "c36e3100-aadc-4117-b495-24fb08a34148", 2020-11-12T17:26:52.953 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:52.953 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:52.953 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:52.953 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:52.953 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:52.953 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:52.953 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:52.954 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 127, 2020-11-12T17:26:52.954 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:52.954 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:52.954 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:52.954 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.954 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.955 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6804", 2020-11-12T17:26:52.955 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:26:52.955 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.955 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.955 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:52.956 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.956 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.956 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6805", 2020-11-12T17:26:52.956 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:26:52.957 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.957 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.957 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:52.958 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.958 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.958 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6807", 2020-11-12T17:26:52.959 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:26:52.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.959 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.960 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:52.960 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.960 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.960 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6806", 2020-11-12T17:26:52.960 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:26:52.960 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.961 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.961 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6804/12499", 2020-11-12T17:26:52.961 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6805/12499", 2020-11-12T17:26:52.961 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6807/12499", 2020-11-12T17:26:52.961 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6806/12499", 2020-11-12T17:26:52.962 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:52.962 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:52.962 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:52.962 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:26:52.963 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "b152141f-b530-448e-8dff-fe200559eff0", 2020-11-12T17:26:52.963 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:52.963 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:52.963 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:52.963 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:52.963 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:52.964 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:52.964 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:52.964 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 127, 2020-11-12T17:26:52.964 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:52.964 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:52.964 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:52.964 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.965 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.965 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6808", 2020-11-12T17:26:52.965 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:26:52.965 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.965 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.966 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:52.966 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.966 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.966 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6810", 2020-11-12T17:26:52.966 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:26:52.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.967 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.967 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:52.967 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.967 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.968 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6814", 2020-11-12T17:26:52.968 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:26:52.968 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.968 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.968 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:52.968 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.969 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.969 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6812", 2020-11-12T17:26:52.969 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:26:52.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.969 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6808/12525", 2020-11-12T17:26:52.970 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6810/12525", 2020-11-12T17:26:52.970 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6814/12525", 2020-11-12T17:26:52.970 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6812/12525", 2020-11-12T17:26:52.970 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:52.970 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:52.970 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:52.970 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.971 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:26:52.971 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "62a140ba-7f94-4bb6-8a62-fda077f81354", 2020-11-12T17:26:52.971 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:52.971 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:52.971 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:52.971 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:52.972 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:52.972 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:52.972 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:52.972 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 127, 2020-11-12T17:26:52.972 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:52.972 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:52.972 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:52.973 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.973 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.973 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6809", 2020-11-12T17:26:52.973 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:26:52.973 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.973 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.974 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:52.974 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.974 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.974 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6811", 2020-11-12T17:26:52.974 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:26:52.974 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.975 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.975 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:52.975 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.975 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.975 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6815", 2020-11-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.976 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6813", 2020-11-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.977 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6809/12524", 2020-11-12T17:26:52.978 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6811/12524", 2020-11-12T17:26:52.978 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6815/12524", 2020-11-12T17:26:52.978 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6813/12524", 2020-11-12T17:26:52.978 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:52.978 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:52.978 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:52.978 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.979 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:26:52.979 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "32879bd7-780c-4da6-9838-5850b6277902", 2020-11-12T17:26:52.979 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:26:52.979 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:26:52.979 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:26:52.979 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:26:52.980 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:26:52.980 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:26:52.980 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:26:52.980 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 127, 2020-11-12T17:26:52.980 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:26:52.980 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:26:52.980 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:26:52.981 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.981 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.981 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6800", 2020-11-12T17:26:52.981 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:26:52.981 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.982 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.982 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:26:52.983 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.983 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.984 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6801", 2020-11-12T17:26:52.984 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:26:52.984 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.984 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.984 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:26:52.985 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.985 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.985 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6803", 2020-11-12T17:26:52.986 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:26:52.986 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.986 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.987 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:26:52.987 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:26:52.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.988 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:26:52.988 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6802", 2020-11-12T17:26:52.988 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:26:52.988 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.989 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.989 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6800/12522", 2020-11-12T17:26:52.989 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6801/12522", 2020-11-12T17:26:52.990 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6803/12522", 2020-11-12T17:26:52.990 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6802/12522", 2020-11-12T17:26:52.990 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:26:52.990 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:26:52.990 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:26:52.991 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:52.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:52.991 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:52.991 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2020-11-12T17:26:52.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.992 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:26:52.992 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:52.992 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:52.992 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:52.992 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:52.992 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 65536, 2020-11-12T17:26:52.993 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:44.321824+0000", 2020-11-12T17:26:52.993 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:52.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:52.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:52.993 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:26:53.018 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:53.019 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:53.019 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:53.019 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:53.019 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 65536, 2020-11-12T17:26:53.019 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:32.526486+0000", 2020-11-12T17:26:53.019 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 58 2020-11-12T17:26:53.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:53.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:53.020 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:26:53.020 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:53.020 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:53.020 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:53.020 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:53.021 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:53.021 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:25:56.086138+0000", 2020-11-12T17:26:53.021 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 94 2020-11-12T17:26:53.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:53.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:53.021 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:26:53.021 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:53.021 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:53.022 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:53.022 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:53.022 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:53.022 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:46.505759+0000", 2020-11-12T17:26:53.022 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:53.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:53.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:53.023 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:26:53.023 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:53.023 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:53.023 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:53.023 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:53.023 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:53.023 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:45.395865+0000", 2020-11-12T17:26:53.024 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:53.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:53.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:53.024 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:26:53.024 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:53.024 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:53.024 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:53.024 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:53.025 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:53.025 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:47.060879+0000", 2020-11-12T17:26:53.025 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:53.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:53.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:53.025 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:26:53.025 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:53.025 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:53.026 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:53.026 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:53.026 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:53.026 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:44.435814+0000", 2020-11-12T17:26:53.026 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:53.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:53.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:53.027 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:26:53.027 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:26:53.027 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:26:53.027 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:26:53.027 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:26:53.027 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:26:53.027 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:45.631568+0000", 2020-11-12T17:26:53.028 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:26:53.028 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:53.028 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:26:53.028 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2020-11-12T17:26:53.028 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2020-11-12T17:26:53.028 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2020-11-12T17:26:53.028 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2020-11-12T17:26:53.028 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2020-11-12T17:26:53.029 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2020-11-12T17:26:53.029 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2020-11-12T17:26:53.029 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2020-11-12T17:26:53.029 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2020-11-12T17:26:53.029 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2020-11-12T17:26:53.029 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2020-11-12T17:26:53.029 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2020-11-12T17:26:53.030 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2020-11-12T17:26:53.030 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:53.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:53.030 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2020-11-12T17:26:53.030 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2020-11-12T17:26:53.030 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2020-11-12T17:26:53.031 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2020-11-12T17:26:53.032 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2020-11-12T17:26:53.032 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:53.034 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:53.034 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:53.034 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:53.035 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:53.035 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:53.035 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:53.036 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:53.030+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:53.037 INFO:tasks.thrashosds.thrasher:j is {'epoch': 131, 'fsid': '8c8a6bcc-49d4-47d1-904f-e20798ef8e1f', 'created': '2020-11-12T17:22:37.581394+0000', 'modified': '2020-11-12T17:26:50.492297+0000', 'last_up_change': '2020-11-12T17:25:55.942493+0000', 'last_in_change': '2020-11-12T17:26:34.707632+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'unique_pool_2', 'create_time': '2020-11-12T17:26:43.854598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'bd1d5457-5d54-4074-b378-9da417f42976', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6801', 'nonce': 12304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6802', 'nonce': 12304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6806', 'nonce': 12304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6804', 'nonce': 12304}]}, 'public_addr': '172.21.15.36:6801/12304', 'cluster_addr': '172.21.15.36:6802/12304', 'heartbeat_back_addr': '172.21.15.36:6806/12304', 'heartbeat_front_addr': '172.21.15.36:6804/12304', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '37152eee-a8d8-40f1-8e27-2899e7b94c98', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 57, 'up_from': 88, 'up_thru': 121, 'down_at': 58, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6812', 'nonce': 20274}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6814', 'nonce': 20274}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6816', 'nonce': 20274}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6815', 'nonce': 20274}]}, 'public_addr': '172.21.15.36:6812/20274', 'cluster_addr': '172.21.15.36:6814/20274', 'heartbeat_back_addr': '172.21.15.36:6816/20274', 'heartbeat_front_addr': '172.21.15.36:6815/20274', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd8ec2abb-38bf-4863-969a-482c4fa44f41', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 93, 'up_from': 102, 'up_thru': 127, 'down_at': 94, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6803', 'nonce': 21493}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6805', 'nonce': 21493}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6808', 'nonce': 21493}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6807', 'nonce': 21493}]}, 'public_addr': '172.21.15.36:6803/21493', 'cluster_addr': '172.21.15.36:6805/21493', 'heartbeat_back_addr': '172.21.15.36:6808/21493', 'heartbeat_front_addr': '172.21.15.36:6807/21493', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '799d3499-577c-4510-a00c-9b2e126fc449', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 127, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6809', 'nonce': 12305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6810', 'nonce': 12305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6813', 'nonce': 12305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6811', 'nonce': 12305}]}, 'public_addr': '172.21.15.36:6809/12305', 'cluster_addr': '172.21.15.36:6810/12305', 'heartbeat_back_addr': '172.21.15.36:6813/12305', 'heartbeat_front_addr': '172.21.15.36:6811/12305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c36e3100-aadc-4117-b495-24fb08a34148', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 127, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6804', 'nonce': 12499}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6805', 'nonce': 12499}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6807', 'nonce': 12499}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6806', 'nonce': 12499}]}, 'public_addr': '172.21.15.205:6804/12499', 'cluster_addr': '172.21.15.205:6805/12499', 'heartbeat_back_addr': '172.21.15.205:6807/12499', 'heartbeat_front_addr': '172.21.15.205:6806/12499', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b152141f-b530-448e-8dff-fe200559eff0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 127, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6808', 'nonce': 12525}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6810', 'nonce': 12525}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6814', 'nonce': 12525}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6812', 'nonce': 12525}]}, 'public_addr': '172.21.15.205:6808/12525', 'cluster_addr': '172.21.15.205:6810/12525', 'heartbeat_back_addr': '172.21.15.205:6814/12525', 'heartbeat_front_addr': '172.21.15.205:6812/12525', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '62a140ba-7f94-4bb6-8a62-fda077f81354', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 127, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6809', 'nonce': 12524}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6811', 'nonce': 12524}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6815', 'nonce': 12524}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6813', 'nonce': 12524}]}, 'public_addr': '172.21.15.205:6809/12524', 'cluster_addr': '172.21.15.205:6811/12524', 'heartbeat_back_addr': '172.21.15.205:6815/12524', 'heartbeat_front_addr': '172.21.15.205:6813/12524', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '32879bd7-780c-4da6-9838-5850b6277902', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 127, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6800', 'nonce': 12522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6801', 'nonce': 12522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6803', 'nonce': 12522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6802', 'nonce': 12522}]}, 'public_addr': '172.21.15.205:6800/12522', 'cluster_addr': '172.21.15.205:6801/12522', 'heartbeat_back_addr': '172.21.15.205:6803/12522', 'heartbeat_front_addr': '172.21.15.205:6802/12522', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-12T17:26:44.321824+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-12T17:26:32.526486+0000', 'dead_epoch': 58}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:25:56.086138+0000', 'dead_epoch': 94}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:46.505759+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:45.395865+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:47.060879+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:44.435814+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:45.631568+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-11-12T17:26:53.037 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:26:53.134 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:53.130+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:53.335 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:53.336 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:53.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:53.336 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:53.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.336 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:53.337 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:53.337 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 218.68058024499999, 2020-11-12T17:26:53.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:26:53.337 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.337 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.337 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.338 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:53.344 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:53.345 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:26:53.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.345 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:53.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:53.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:53.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:26:53.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:26:53.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:26:53.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:26:53.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:26:53.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:26:53.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:26:53.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:26:53.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:26:53.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:26:53.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:26:53.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:26:53.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:53.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:26:53.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:26:53.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:26:53.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:26:53.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:26:53.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:26:53.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:26:53.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:26:53.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:26:53.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:26:53.358 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.358 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.358 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.360 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:26:53.361 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:53.361 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 218.677180311, 2020-11-12T17:26:53.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:26:53.362 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.362 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:53.362 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:53.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:53.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:53.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:26:53.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:26:53.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:26:53.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:26:53.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:26:53.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:26:53.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:26:53.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:26:53.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:26:53.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:26:53.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:26:53.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:26:53.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:26:53.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:26:53.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.373 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.374 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:26:53.374 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:53.374 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 183.20129086399999, 2020-11-12T17:26:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:26:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:53.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:26:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:26:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:26:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:26:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:26:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:26:53.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:26:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:26:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:26:53.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:26:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:26:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:26:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:26:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:26:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:26:53.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:26:53.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.386 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 151.261305521, 2020-11-12T17:26:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:26:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.387 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:26:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:26:53.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:26:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:26:53.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:26:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:26:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:26:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:26:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:26:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:26:53.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:26:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:26:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:26:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:26:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:26:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:26:53.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:26:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:26:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:26:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:26:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:26:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:26:53.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:26:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:26:53.398 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:26:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:53.399 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 139.78420444700001, 2020-11-12T17:26:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:26:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:26:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:53.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:26:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:26:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:26:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:26:53.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:26:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:26:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:26:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:26:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:26:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:26:53.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:26:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:26:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:26:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.405 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.406 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:26:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 138.66519406, 2020-11-12T17:26:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:26:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:53.407 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:26:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:53.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:26:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:26:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:26:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:26:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:26:53.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:26:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:26:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:26:53.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:26:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:26:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:26:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:26:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:53.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:26:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:26:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:26:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:26:53.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:26:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:26:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:26:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:26:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:26:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:26:53.420 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:26:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:53.421 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 138.64905605600001, 2020-11-12T17:26:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:26:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:26:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:26:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:26:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:26:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:26:53.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:26:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:26:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:26:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:26:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:26:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:26:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:26:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:26:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:26:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.428 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:26:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 138.64432837699999, 2020-11-12T17:26:53.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:26:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:26:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.430 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:26:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:26:53.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:26:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:26:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:26:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:26:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:26:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:26:53.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:26:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:26:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:53.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:26:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:26:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:26:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:26:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.437 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:26:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:53.438 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 82.262769309999996, 2020-11-12T17:26:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:26:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:26:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:53.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:26:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:26:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:26:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:26:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:26:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:26:53.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:26:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:26:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:26:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:26:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:26:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:26:53.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:26:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:26:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:26:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:26:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:26:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:26:53.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:26:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:26:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:26:53.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:26:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:26:53.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.454 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.456 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:26:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 82.257215489000004, 2020-11-12T17:26:53.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:26:53.458 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.459 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:53.462 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:53.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:53.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:53.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:26:53.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:26:53.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:26:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:26:53.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:26:53.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:26:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:26:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:26:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:26:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:26:53.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:26:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:26:53.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:26:53.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:26:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:73896 4.3 4:cac907c9:::benchmark_data_smithi036_18856_object9236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e111)", 2020-11-12T17:26:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:53.482 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.718693533, 2020-11-12T17:26:53.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34147229000000001, 2020-11-12T17:26:53.483 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.484 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 73896 2020-11-12T17:26:53.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:53.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488091+0000", 2020-11-12T17:26:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109295 2020-11-12T17:26:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488200+0000", 2020-11-12T17:26:53.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2892e-05 2020-11-12T17:26:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488213+0000", 2020-11-12T17:26:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2709999999999998e-06 2020-11-12T17:26:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488219+0000", 2020-11-12T17:26:53.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0085628400000000004 2020-11-12T17:26:53.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.496782+0000", 2020-11-12T17:26:53.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011530499999999999 2020-11-12T17:26:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.496897+0000", 2020-11-12T17:26:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017658600000000001 2020-11-12T17:26:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.497074+0000", 2020-11-12T17:26:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018301089999999999 2020-11-12T17:26:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.498904+0000", 2020-11-12T17:26:53.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33056671100000001 2020-11-12T17:26:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829471+0000", 2020-11-12T17:26:53.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7509999999999995e-05 2020-11-12T17:26:53.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829548+0000", 2020-11-12T17:26:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9070999999999998e-05 2020-11-12T17:26:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829597+0000", 2020-11-12T17:26:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34147229000000001 2020-11-12T17:26:53.519 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.600566477999998, 2020-11-12T17:26:53.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:26:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:26:53.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:26:53.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:26:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:26:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:26:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:26:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:26:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:26:53.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:26:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:26:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:26:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:26:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:26:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:26:53.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:26:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:26:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:26:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:26:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:26:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:26:53.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:26:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:26:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:26:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.530 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:53.531 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.598672864999998, 2020-11-12T17:26:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:26:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.532 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:26:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:53.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:26:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:26:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:26:53.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:26:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:26:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:26:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:26:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:26:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:26:53.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:26:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:26:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:26:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:26:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:26:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:26:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:26:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:26:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:26:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:26:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:26:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:26:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:26:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:53.543 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.597920217000002, 2020-11-12T17:26:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:26:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.544 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:26:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:26:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:26:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:26:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:26:53.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:26:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:26:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:26:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:26:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:26:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:26:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:26:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:26:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:26:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:26:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:26:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:26:53.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:26:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:26:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:26:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:26:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:26:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:26:53.553 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:53.554 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.5947587, 2020-11-12T17:26:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:26:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:26:53.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:26:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:26:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:26:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:26:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:26:53.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:26:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:26:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:26:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:26:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:26:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:26:53.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:26:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:26:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:26:53.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:26:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:26:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:26:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:26:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:26:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:26:53.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:26:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:26:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:26:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.593677532999997, 2020-11-12T17:26:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:26:53.566 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:26:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:26:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:26:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:26:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:26:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:26:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:26:53.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:26:53.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:26:53.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:26:53.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:26:53.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:26:53.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:26:53.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:26:53.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:26:53.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:26:53.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:26:53.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:26:53.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:26:53.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:26:53.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:26:53.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:26:53.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:26:53.580 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.580 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.580 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.581 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:53.581 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:53.581 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.593508440000001, 2020-11-12T17:26:53.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:26:53.581 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.581 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.582 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.582 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.582 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.582 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:26:53.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.583 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:53.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:53.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:53.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:26:53.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:26:53.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:26:53.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:26:53.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:26:53.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:26:53.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:26:53.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:26:53.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:26:53.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:26:53.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:26:53.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:26:53.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:26:53.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:26:53.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:26:53.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:26:53.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:26:53.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:26:53.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:26:53.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:26:53.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:26:53.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:26:53.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.593 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.594 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:53.594 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:53.595 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.590889793999999, 2020-11-12T17:26:53.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:26:53.595 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.595 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.595 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:26:53.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.596 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:53.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:53.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:53.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:26:53.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:26:53.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:26:53.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:26:53.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:26:53.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:26:53.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:26:53.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:26:53.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:26:53.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:26:53.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:26:53.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:26:53.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:26:53.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:26:53.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:26:53.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:26:53.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:26:53.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:26:53.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:26:53.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:26:53.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:26:53.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:26:53.606 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.606 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.606 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.606 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:53.606 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:53.606 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.590781710999998, 2020-11-12T17:26:53.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:26:53.607 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.607 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:53.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:53.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:53.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:53.607 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:26:53.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.608 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:53.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:53.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:26:53.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:26:53.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:26:53.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:26:53.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:26:53.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:26:53.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:26:53.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:26:53.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:26:53.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:26:53.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:26:53.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:26:53.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:26:53.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:53.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:26:53.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:26:53.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:53.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:26:53.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:26:53.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:53.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:26:53.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:26:53.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:53.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:26:53.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:26:53.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:26:53.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:26:53.617 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.617 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.617 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.617 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:26:53.617 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:53.618 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.586819028999997, 2020-11-12T17:26:53.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:26:53.618 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:53.618 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:53.618 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:53.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:53.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:53.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:53.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:53.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:53.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:26:53.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:53.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:26:53.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:26:53.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:53.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:26:53.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:26:53.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:53.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:26:53.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:26:53.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:26:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:26:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:53.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:26:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:26:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:26:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:26:53.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:26:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:26:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:53.625 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:53.625 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:53.625 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:53.628 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:26:53.629 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2020-11-12T17:26:51.592083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26230784,"num_objects":403,"num_object_clones":0,"num_object_copies":806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":403,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3204,"num_write_kb":25618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3204,"ondisk_log_size":3204,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":7,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":660602880,"kb_used":7364056,"kb_used_data":23964,"kb_used_omap":118,"kb_used_meta":7339913,"kb_avail":653238824,"statfs":{"total":676457349120,"available":668916555776,"internally_reserved":7516192768,"allocated":24539136,"data_stored":40817365,"data_compressed":254124,"data_compressed_allocated":19378176,"data_compressed_original":38756352,"omap_allocated":121799,"internal_metadata":7516070969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,6,0,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26230784,"num_objects":401,"num_object_clones":0,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3202,"num_write_kb":25616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001576"},"pg_stats":[{"pgid":"5.f","version":"129'8","reported_seq":"17","reported_epoch":"129","state":"active+clean","last_fresh":"2020-11-12T17:26:46.576767+0000","last_change":"2020-11-12T17:26:45.503348+0000","last_active":"2020-11-12T17:26:46.576767+0000","last_peered":"2020-11-12T17:26:46.576767+0000","last_clean":"2020-11-12T17:26:46.576767+0000","last_became_active":"2020-11-12T17:26:45.502940+0000","last_became_peered":"2020-11-12T17:26:45.502940+0000","last_unstale":"2020-11-12T17:26:46.576767+0000","last_undegraded":"2020-11-12T17:26:46.576767+0000","last_fullsized":"2020-11-12T17:26:46.576767+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"131'304","reported_seq":"315","reported_epoch":"131","state":"active+clean","last_fresh":"2020-11-12T17:26:50.833623+0000","last_change":"2020-11-12T17:26:45.491058+0000","last_active":"2020-11-12T17:26:50.833623+0000","last_peered":"2020-11-12T17:26:50.833623+0000","last_clean":"2020-11-12T17:26:50.833623+0000","last_became_active":"2020-11-12T17:26:45.490308+0000","last_became_peered":"2020-11-12T17:26:45.490308+0000","last_unstale":"2020-11-12T17:26:50.833623+0000","last_undegraded":"2020-11-12T17:26:50.833623+0000","last_fullsized":"2020-11-12T17:26:50.833623+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":304,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"130'296","reported_seq":"306","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:50.058373+0000","last_change":"2020-11-12T17:26:45.490550+0000","last_active":"2020-11-12T17:26:50.058373+0000","last_peered":"2020-11-12T17:26:50.058373+0000","last_clean":"2020-11-12T17:26:50.058373+0000","last_became_active":"2020-11-12T17:26:45.490025+0000","last_became_peered":"2020-11-12T17:26:45.490025+0000","last_unstale":"2020-11-12T17:26:50.058373+0000","last_undegraded":"2020-11-12T17:26:50.058373+0000","last_fullsized":"2020-11-12T17:26:50.058373+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":296,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"131'288","reported_seq":"299","reported_epoch":"131","state":"active+clean","last_fresh":"2020-11-12T17:26:50.725094+0000","last_change":"2020-11-12T17:26:45.491058+0000","last_active":"2020-11-12T17:26:50.725094+0000","last_peered":"2020-11-12T17:26:50.725094+0000","last_clean":"2020-11-12T17:26:50.725094+0000","last_became_active":"2020-11-12T17:26:45.489935+0000","last_became_peered":"2020-11-12T17:26:45.489935+0000","last_unstale":"2020-11-12T17:26:50.725094+0000","last_undegraded":"2020-11-12T17:26:50.725094+0000","last_fullsized":"2020-11-12T17:26:50.725094+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":288,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"130'264","reported_seq":"274","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:50.007675+0000","last_change":"2020-11-12T17:26:45.484541+0000","last_active":"2020-11-12T17:26:50.007675+0000","last_peered":"2020-11-12T17:26:50.007675+0000","last_clean":"2020-11-12T17:26:50.007675+0000","last_became_active":"2020-11-12T17:26:45.484017+0000","last_became_peered":"2020-11-12T17:26:45.484017+0000","last_unstale":"2020-11-12T17:26:50.007675+0000","last_undegraded":"2020-11-12T17:26:50.007675+0000","last_fullsized":"2020-11-12T17:26:50.007675+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":264,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"130'240","reported_seq":"250","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:50.092210+0000","last_change":"2020-11-12T17:26:45.490968+0000","last_active":"2020-11-12T17:26:50.092210+0000","last_peered":"2020-11-12T17:26:50.092210+0000","last_clean":"2020-11-12T17:26:50.092210+0000","last_became_active":"2020-11-12T17:26:45.490602+0000","last_became_peered":"2020-11-12T17:26:45.490602+0000","last_unstale":"2020-11-12T17:26:50.092210+0000","last_undegraded":"2020-11-12T17:26:50.092210+0000","last_fullsized":"2020-11-12T17:26:50.092210+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":240,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"129'2","reported_seq":"10","reported_epoch":"129","state":"active+clean","last_fresh":"2020-11-12T17:26:46.483609+0000","last_change":"2020-11-12T17:26:45.490076+0000","last_active":"2020-11-12T17:26:46.483609+0000","last_peered":"2020-11-12T17:26:46.483609+0000","last_clean":"2020-11-12T17:26:46.483609+0000","last_became_active":"2020-11-12T17:26:45.489832+0000","last_became_peered":"2020-11-12T17:26:45.489832+0000","last_unstale":"2020-11-12T17:26:46.483609+0000","last_undegraded":"2020-11-12T17:26:46.483609+0000","last_fullsized":"2020-11-12T17:26:46.483609+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16384,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"130'216","reported_seq":"226","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:49.980549+0000","last_change":"2020-11-12T17:26:45.484494+0000","last_active":"2020-11-12T17:26:49.980549+0000","last_peered":"2020-11-12T17:26:49.980549+0000","last_clean":"2020-11-12T17:26:49.980549+0000","last_became_active":"2020-11-12T17:26:45.483996+0000","last_became_peered":"2020-11-12T17:26:45.483996+0000","last_unstale":"2020-11-12T17:26:49.980549+0000","last_undegraded":"2020-11-12T17:26:49.980549+0000","last_fullsized":"2020-11-12T17:26:49.980549+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":216,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"130'320","reported_seq":"330","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:50.420615+0000","last_change":"2020-11-12T17:26:45.485794+0000","last_active":"2020-11-12T17:26:50.420615+0000","last_peered":"2020-11-12T17:26:50.420615+0000","last_clean":"2020-11-12T17:26:50.420615+0000","last_became_active":"2020-11-12T17:26:45.485374+0000","last_became_peered":"2020-11-12T17:26:45.485374+0000","last_unstale":"2020-11-12T17:26:50.420615+0000","last_undegraded":"2020-11-12T17:26:50.420615+0000","last_fullsized":"2020-11-12T17:26:50.420615+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":320,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"37","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-12T17:26:45.482547+0000","last_change":"2020-11-12T17:26:35.791257+0000","last_active":"2020-11-12T17:26:45.482547+0000","last_peered":"2020-11-12T17:26:45.482547+0000","last_clean":"2020-11-12T17:26:45.482547+0000","last_became_active":"2020-11-12T17:26:35.790805+0000","last_became_peered":"2020-11-12T17:26:35.790805+0000","last_unstale":"2020-11-12T17:26:45.482547+0000","last_undegraded":"2020-11-12T17:26:45.482547+0000","last_fullsized":"2020-11-12T17:26:45.482547+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:46.329629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:46.329629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"131'320","reported_seq":"331","reported_epoch":"131","state":"active+clean","last_fresh":"2020-11-12T17:26:50.861827+0000","last_change":"2020-11-12T17:26:45.490297+0000","last_active":"2020-11-12T17:26:50.861827+0000","last_peered":"2020-11-12T17:26:50.861827+0000","last_clean":"2020-11-12T17:26:50.861827+0000","last_became_active":"2020-11-12T17:26:45.489867+0000","last_became_peered":"2020-11-12T17:26:45.489867+0000","last_unstale":"2020-11-12T17:26:50.861827+0000","last_undegraded":"2020-11-12T17:26:50.861827+0000","last_fullsized":"2020-11-12T17:26:50.861827+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":320,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"150","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-12T17:26:45.473094+0000","last_change":"2020-11-12T17:26:35.785534+0000","last_active":"2020-11-12T17:26:45.473094+0000","last_peered":"2020-11-12T17:26:45.473094+0000","last_clean":"2020-11-12T17:26:45.473094+0000","last_became_active":"2020-11-12T17:26:35.785065+0000","last_became_peered":"2020-11-12T17:26:35.785065+0000","last_unstale":"2020-11-12T17:26:45.473094+0000","last_undegraded":"2020-11-12T17:26:45.473094+0000","last_fullsized":"2020-11-12T17:26:45.473094+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:23.254853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:23.254853+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"130'240","reported_seq":"249","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:50.091268+0000","last_change":"2020-11-12T17:26:45.480866+0000","last_active":"2020-11-12T17:26:50.091268+0000","last_peered":"2020-11-12T17:26:50.091268+0000","last_clean":"2020-11-12T17:26:50.091268+0000","last_became_active":"2020-11-12T17:26:45.480445+0000","last_became_peered":"2020-11-12T17:26:45.480445+0000","last_unstale":"2020-11-12T17:26:50.091268+0000","last_undegraded":"2020-11-12T17:26:50.091268+0000","last_fullsized":"2020-11-12T17:26:50.091268+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":240,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"24","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:48.417869+0000","last_change":"2020-11-12T17:26:48.417978+0000","last_active":"2020-11-12T17:26:48.417869+0000","last_peered":"2020-11-12T17:26:48.417869+0000","last_clean":"2020-11-12T17:26:48.417869+0000","last_became_active":"2020-11-12T17:26:29.669260+0000","last_became_peered":"2020-11-12T17:26:29.669260+0000","last_unstale":"2020-11-12T17:26:48.417869+0000","last_undegraded":"2020-11-12T17:26:48.417869+0000","last_fullsized":"2020-11-12T17:26:48.417869+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"9","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-12T17:26:45.492889+0000","last_change":"2020-11-12T17:26:45.489798+0000","last_active":"2020-11-12T17:26:45.492889+0000","last_peered":"2020-11-12T17:26:45.492889+0000","last_clean":"2020-11-12T17:26:45.492889+0000","last_became_active":"2020-11-12T17:26:45.489407+0000","last_became_peered":"2020-11-12T17:26:45.489407+0000","last_unstale":"2020-11-12T17:26:45.492889+0000","last_undegraded":"2020-11-12T17:26:45.492889+0000","last_fullsized":"2020-11-12T17:26:45.492889+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"141","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-12T17:26:45.473078+0000","last_change":"2020-11-12T17:26:29.681207+0000","last_active":"2020-11-12T17:26:45.473078+0000","last_peered":"2020-11-12T17:26:45.473078+0000","last_clean":"2020-11-12T17:26:45.473078+0000","last_became_active":"2020-11-12T17:26:29.680644+0000","last_became_peered":"2020-11-12T17:26:29.680644+0000","last_unstale":"2020-11-12T17:26:45.473078+0000","last_undegraded":"2020-11-12T17:26:45.473078+0000","last_fullsized":"2020-11-12T17:26:45.473078+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:46.581637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:46.581637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"147","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-12T17:26:45.481952+0000","last_change":"2020-11-12T17:26:23.752402+0000","last_active":"2020-11-12T17:26:45.481952+0000","last_peered":"2020-11-12T17:26:45.481952+0000","last_clean":"2020-11-12T17:26:45.481952+0000","last_became_active":"2020-11-12T17:26:06.057282+0000","last_became_peered":"2020-11-12T17:26:06.057282+0000","last_unstale":"2020-11-12T17:26:45.481952+0000","last_undegraded":"2020-11-12T17:26:45.481952+0000","last_fullsized":"2020-11-12T17:26:45.481952+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:26:23.752291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:26:23.752291+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"9","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-12T17:26:45.504495+0000","last_change":"2020-11-12T17:26:45.503344+0000","last_active":"2020-11-12T17:26:45.504495+0000","last_peered":"2020-11-12T17:26:45.504495+0000","last_clean":"2020-11-12T17:26:45.504495+0000","last_became_active":"2020-11-12T17:26:45.502925+0000","last_became_peered":"2020-11-12T17:26:45.502925+0000","last_unstale":"2020-11-12T17:26:45.504495+0000","last_undegraded":"2020-11-12T17:26:45.504495+0000","last_fullsized":"2020-11-12T17:26:45.504495+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"158","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-12T17:26:45.482096+0000","last_change":"2020-11-12T17:26:35.752216+0000","last_active":"2020-11-12T17:26:45.482096+0000","last_peered":"2020-11-12T17:26:45.482096+0000","last_clean":"2020-11-12T17:26:45.482096+0000","last_became_active":"2020-11-12T17:26:35.751682+0000","last_became_peered":"2020-11-12T17:26:35.751682+0000","last_unstale":"2020-11-12T17:26:45.482096+0000","last_undegraded":"2020-11-12T17:26:45.482096+0000","last_fullsized":"2020-11-12T17:26:45.482096+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:33.820630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:33.820630+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"130'352","reported_seq":"363","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:50.387282+0000","last_change":"2020-11-12T17:26:45.488276+0000","last_active":"2020-11-12T17:26:50.387282+0000","last_peered":"2020-11-12T17:26:50.387282+0000","last_clean":"2020-11-12T17:26:50.387282+0000","last_became_active":"2020-11-12T17:26:45.487913+0000","last_became_peered":"2020-11-12T17:26:45.487913+0000","last_unstale":"2020-11-12T17:26:50.387282+0000","last_undegraded":"2020-11-12T17:26:50.387282+0000","last_fullsized":"2020-11-12T17:26:50.387282+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":352,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"133","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-12T17:26:45.483293+0000","last_change":"2020-11-12T17:26:06.060044+0000","last_active":"2020-11-12T17:26:45.483293+0000","last_peered":"2020-11-12T17:26:45.483293+0000","last_clean":"2020-11-12T17:26:45.483293+0000","last_became_active":"2020-11-12T17:26:06.058701+0000","last_became_peered":"2020-11-12T17:26:06.058701+0000","last_unstale":"2020-11-12T17:26:45.483293+0000","last_undegraded":"2020-11-12T17:26:45.483293+0000","last_fullsized":"2020-11-12T17:26:45.483293+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:34.809567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:25:34.809567+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"131'352","reported_seq":"363","reported_epoch":"131","state":"active+clean","last_fresh":"2020-11-12T17:26:50.850201+0000","last_change":"2020-11-12T17:26:45.490394+0000","last_active":"2020-11-12T17:26:50.850201+0000","last_peered":"2020-11-12T17:26:50.850201+0000","last_clean":"2020-11-12T17:26:50.850201+0000","last_became_active":"2020-11-12T17:26:45.489929+0000","last_became_peered":"2020-11-12T17:26:45.489929+0000","last_unstale":"2020-11-12T17:26:50.850201+0000","last_undegraded":"2020-11-12T17:26:50.850201+0000","last_fullsized":"2020-11-12T17:26:50.850201+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":352,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"113","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:47.490691+0000","last_change":"2020-11-12T17:26:35.769485+0000","last_active":"2020-11-12T17:26:47.490691+0000","last_peered":"2020-11-12T17:26:47.490691+0000","last_clean":"2020-11-12T17:26:47.490691+0000","last_became_active":"2020-11-12T17:26:35.768982+0000","last_became_peered":"2020-11-12T17:26:35.768982+0000","last_unstale":"2020-11-12T17:26:47.490691+0000","last_undegraded":"2020-11-12T17:26:47.490691+0000","last_fullsized":"2020-11-12T17:26:47.490691+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:38.366685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:38.366685+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":"9","reported_epoch":"128","state":"active+clean","last_fresh":"2020-11-12T17:26:45.492537+0000","last_change":"2020-11-12T17:26:45.491135+0000","last_active":"2020-11-12T17:26:45.492537+0000","last_peered":"2020-11-12T17:26:45.492537+0000","last_clean":"2020-11-12T17:26:45.492537+0000","last_became_active":"2020-11-12T17:26:45.490602+0000","last_became_peered":"2020-11-12T17:26:45.490602+0000","last_unstale":"2020-11-12T17:26:45.492537+0000","last_undegraded":"2020-11-12T17:26:45.492537+0000","last_fullsized":"2020-11-12T17:26:45.492537+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"118","reported_epoch":"130","state":"active+clean","last_fresh":"2020-11-12T17:26:47.490613+0000","last_change":"2020-11-12T17:25:37.363305+0000","last_active":"2020-11-12T17:26:47.490613+0000","last_peered":"2020-11-12T17:26:47.490613+0000","last_clean":"2020-11-12T17:26:47.490613+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:26:47.490613+0000","last_undegraded":"2020-11-12T17:26:47.490613+0000","last_fullsized":"2020-11-12T17:26:47.490613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:37.363220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:25:37.363220+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":26230784,"num_objects":401,"num_object_clones":0,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3202,"num_write_kb":25616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22417408,"data_stored":44834816,"data_compressed":294090,"data_compressed_allocated":22417408,"data_compressed_original":44834816,"omap_allocated":0,"internal_metadata":0},"log_size":3202,"ondisk_log_size":3202,"up":32,"acting":32,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049292,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322548,"statfs":{"total":96636764160,"available":95562289152,"internally_reserved":1073741824,"allocated":724992,"data_stored":287809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.466,"15min":1.534},"min":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.2949999999999999,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.8460000000000001,"15min":2.0459999999999998},"min":{"1min":0.80800000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.2280000000000002,"5min":7.4349999999999996,"15min":7.4349999999999996},"last":1.8360000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:26:34 2020","interfaces":[{"interface":"back","average":{"1min":7.226,"5min":7.226,"15min":7.226},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":102.354,"5min":102.354,"15min":102.354},"last":2.6240000000000001},{"interface":"front","average":{"1min":6.8630000000000004,"5min":6.8630000000000004,"15min":6.8630000000000004},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":102.08199999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":2.2919999999999998}]},{"osd":2,"last update":"Thu Nov 12 17:24:54 2020","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.6120000000000001,"15min":1.6339999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":3.3140000000000001},{"interface":"front","average":{"1min":1.645,"5min":2.0830000000000002,"15min":2.1560000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.9769999999999999,"5min":7.6310000000000002,"15min":7.6310000000000002},"last":2.5609999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.863,"15min":2.0950000000000002},"min":{"1min":0.79700000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.4630000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.581,"5min":8.5990000000000002,"15min":4.5389999999999997},"min":{"1min":0.871,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.5630000000000002,"5min":871.76700000000005,"15min":871.76700000000005},"last":2.4609999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":7.9630000000000001,"5min":35.207000000000001,"15min":47.573999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":110.66800000000001,"5min":503.50200000000001,"15min":503.50200000000001},"last":2.6920000000000002},{"interface":"front","average":{"1min":7.6310000000000002,"5min":3.105,"15min":2.371},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":108.14,"5min":108.14,"15min":108.14},"last":1.9419999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.7390000000000001,"5min":2.3759999999999999,"15min":2.6200000000000001},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.5259999999999998,"5min":7.7169999999999996,"15min":7.7169999999999996},"last":2.8399999999999999},{"interface":"front","average":{"1min":1.865,"5min":2.4900000000000002,"15min":2.742},"min":{"1min":1.131,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.597,"5min":7.7480000000000002,"15min":7.7480000000000002},"last":2.8919999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":24.794,"5min":6.9850000000000003,"15min":4.202},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":375.04199999999997,"5min":375.04199999999997,"15min":375.04199999999997},"last":2.7629999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":39.052999999999997,"15min":48.645000000000003},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.8159999999999998,"5min":975.20899999999995,"15min":975.20899999999995},"last":3.3999999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542195,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049284,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322556,"statfs":{"total":96636764160,"available":95562297344,"internally_reserved":1073741824,"allocated":716800,"data_stored":286903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.597,"15min":1.7490000000000001},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.3180000000000001,"5min":3.339,"15min":3.339},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.849,"15min":2.0369999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.6019999999999999,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":2.1869999999999998}]},{"osd":1,"last update":"Thu Nov 12 17:26:32 2020","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":1.762},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":2.27}]},{"osd":2,"last update":"Thu Nov 12 17:24:48 2020","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":2.0800000000000001,"15min":2.1789999999999998},"min":{"1min":0.79400000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6099999999999999,"5min":5.4329999999999998,"15min":5.4329999999999998},"last":1.234},{"interface":"front","average":{"1min":1.6579999999999999,"5min":2.1819999999999999,"15min":2.27},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3130000000000002,"5min":8.0969999999999995,"15min":8.0969999999999995},"last":1.3069999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":2.8900000000000001,"15min":2.7909999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":4.3360000000000003,"5min":49.442999999999998,"15min":49.442999999999998},"last":1.587},{"interface":"front","average":{"1min":1.8660000000000001,"5min":2.2290000000000001,"15min":2.3999999999999999},"min":{"1min":0.93100000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":6.2809999999999997,"5min":8.202,"15min":8.202},"last":2.2440000000000002}]},{"osd":4,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":23.341000000000001,"5min":6.3440000000000003,"15min":3.5990000000000002},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":459.15499999999997,"5min":459.15499999999997,"15min":459.15499999999997},"last":1.73},{"interface":"front","average":{"1min":1.595,"5min":2.4969999999999999,"15min":2.8660000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.6589999999999998,"5min":8.3680000000000003,"15min":8.3680000000000003},"last":2.2959999999999998}]},{"osd":6,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":2.1389999999999998,"15min":2.274},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":6.3300000000000001,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":1.272},{"interface":"front","average":{"1min":1.7370000000000001,"5min":2.1299999999999999,"15min":2.2919999999999998},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":4.8440000000000003,"5min":4.8440000000000003,"15min":4.8440000000000003},"last":1.8759999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:25:48 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":3.0009999999999999,"15min":3.069},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":4.1070000000000002,"5min":40.268000000000001,"15min":40.268000000000001},"last":2.218},{"interface":"front","average":{"1min":2.0339999999999998,"5min":2.5209999999999999,"15min":2.7770000000000001},"min":{"1min":1.097,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":6.1470000000000002,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":1.2030000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1058604,"kb_used_data":10020,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93313236,"statfs":{"total":96636764160,"available":95552753664,"internally_reserved":1073741824,"allocated":10260480,"data_stored":19307563,"data_compressed":124642,"data_compressed_allocated":9502720,"data_compressed_original":19005440,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":21.207000000000001,"5min":5.4740000000000002,"15min":2.8799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":358.101,"5min":358.101,"15min":358.101},"last":1.3120000000000001},{"interface":"front","average":{"1min":20.922999999999998,"5min":32.770000000000003,"15min":42.277999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":357.41199999999998,"5min":948.30899999999997,"15min":948.30899999999997},"last":1.1100000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:26:32 2020","interfaces":[{"interface":"back","average":{"1min":19.036000000000001,"5min":19.036000000000001,"15min":19.036000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":356.46699999999998,"5min":356.46699999999998,"15min":356.46699999999998},"last":1.702},{"interface":"front","average":{"1min":18.934000000000001,"5min":18.934000000000001,"15min":18.934000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":356.18599999999998,"5min":356.18599999999998,"15min":356.18599999999998},"last":1.1559999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:24:49 2020","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.7230000000000001,"15min":1.7549999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.9409999999999998,"5min":2.9409999999999998,"15min":2.9409999999999998},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.7370000000000001,"5min":1.8400000000000001,"15min":1.857},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":1.6379999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":21.018000000000001,"5min":5.8150000000000004,"15min":3.2970000000000002},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":356.02300000000002,"5min":356.02300000000002,"15min":356.02300000000002},"last":1.736},{"interface":"front","average":{"1min":21.254999999999999,"5min":5.9349999999999996,"15min":3.4220000000000002},"min":{"1min":0.751,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":357.79000000000002,"5min":357.79000000000002,"15min":357.79000000000002},"last":1.671}]},{"osd":5,"last update":"Thu Nov 12 17:25:50 2020","interfaces":[{"interface":"back","average":{"1min":53.131999999999998,"5min":12.183999999999999,"15min":5.4299999999999997},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":575.16800000000001,"5min":575.16800000000001,"15min":575.16800000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":71.412999999999997,"5min":16.030999999999999,"15min":6.851},"min":{"1min":0.78000000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":908.52700000000004,"5min":908.52700000000004,"15min":908.52700000000004},"last":1.571}]},{"osd":6,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":21.048999999999999,"5min":24.763000000000002,"15min":30.684999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":356.57900000000001,"5min":665.13999999999999,"15min":665.13999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":21.399999999999999,"5min":5.9889999999999999,"15min":3.4910000000000001},"min":{"1min":0.92500000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":359.05200000000002,"5min":359.05200000000002,"15min":359.05200000000002},"last":1.2270000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:26:49 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":14.317,"15min":6.367},"min":{"1min":0.90100000000000002,"5min":0.87,"15min":0.87},"max":{"1min":3.5310000000000001,"5min":584.00300000000004,"15min":584.00300000000004},"last":1.607},{"interface":"front","average":{"1min":47.753,"5min":15.167,"15min":6.5149999999999997},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":915.22900000000004,"5min":915.22900000000004,"15min":915.22900000000004},"last":915.22900000000004}]}]},{"osd":1,"up_from":88,"seq":377957122065,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1049316,"kb_used_data":732,"kb_used_omap":114,"kb_used_meta":1048461,"kb_avail":93322524,"statfs":{"total":96636764160,"available":95562264576,"internally_reserved":1073741824,"allocated":749568,"data_stored":302037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":117414,"internal_metadata":1073624410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":4.202,"5min":4.202,"15min":4.202},"last":1.466}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5600000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.976},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":6.056,"5min":6.056,"15min":6.056},"last":1.282}]},{"osd":4,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.6459999999999999},{"interface":"front","average":{"1min":2.077,"5min":2.077,"15min":2.077},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":2.278}]},{"osd":5,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":2.024,"5min":2.024,"15min":2.024},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":6.1159999999999997,"5min":6.1159999999999997,"15min":6.1159999999999997},"last":2.1179999999999999},{"interface":"front","average":{"1min":2.427,"5min":2.427,"15min":2.427},"min":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":6.7859999999999996,"5min":6.7859999999999996,"15min":6.7859999999999996},"last":2.052}]},{"osd":6,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":2.343,"5min":2.343,"15min":2.343},"min":{"1min":1.115,"5min":1.115,"15min":1.115},"max":{"1min":6.1689999999999996,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":2.496},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.161,"5min":1.161,"15min":1.161},"max":{"1min":6.5469999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":2.3250000000000002}]},{"osd":7,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":6.577,"5min":6.577,"15min":6.577},"last":2.617},{"interface":"front","average":{"1min":2.496,"5min":2.496,"15min":2.496},"min":{"1min":1.319,"5min":1.319,"15min":1.319},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":2.391}]}]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1054736,"kb_used_data":6148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93317104,"statfs":{"total":96636764160,"available":95556714496,"internally_reserved":1073741824,"allocated":6295552,"data_stored":11389323,"data_compressed":72756,"data_compressed_allocated":5545984,"data_compressed_original":11091968,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.649,"15min":1.728},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4260000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.2},{"interface":"front","average":{"1min":1.379,"5min":1.8,"15min":1.974},"min":{"1min":0.85899999999999999,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.1930000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":2.496}]},{"osd":1,"last update":"Thu Nov 12 17:26:32 2020","interfaces":[{"interface":"back","average":{"1min":42.832999999999998,"5min":42.832999999999998,"15min":42.832999999999998},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":665.476,"5min":665.476,"15min":665.476},"last":1.706},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":2.427}]},{"osd":2,"last update":"Thu Nov 12 17:24:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.954,"15min":2.0329999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.4390000000000001,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":1.669},{"interface":"front","average":{"1min":1.4990000000000001,"5min":1.9470000000000001,"15min":2.0219999999999998},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":2.2989999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":2.5990000000000002}]},{"osd":3,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.9390000000000001,"15min":2.0529999999999999},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.6720000000000002,"5min":4.2130000000000001,"15min":4.2130000000000001},"last":1.323},{"interface":"front","average":{"1min":1.5429999999999999,"5min":2.1320000000000001,"15min":2.3500000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3490000000000002,"5min":9.2550000000000008,"15min":9.2550000000000008},"last":1.754}]},{"osd":4,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.9810000000000001,"15min":2.1469999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.7559999999999998,"5min":6.3049999999999997,"15min":6.3049999999999997},"last":2.4710000000000001},{"interface":"front","average":{"1min":10.989000000000001,"5min":4.1109999999999998,"15min":3.1509999999999998},"min":{"1min":0.91500000000000004,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":169.80799999999999,"5min":169.80799999999999,"15min":169.80799999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":94.287999999999997,"5min":20.582999999999998,"15min":8.3810000000000002},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":804.62199999999996,"5min":804.62199999999996,"15min":804.62199999999996},"last":1.2789999999999999},{"interface":"front","average":{"1min":28.815000000000001,"5min":19.753,"15min":21.745000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":494.78399999999999,"5min":494.78399999999999,"15min":494.78399999999999},"last":3.101}]},{"osd":7,"last update":"Thu Nov 12 17:25:49 2020","interfaces":[{"interface":"back","average":{"1min":79.114999999999995,"5min":17.864000000000001,"15min":7.8079999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1002.347,"5min":1002.347,"15min":1002.347},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.9019999999999999,"5min":2.4100000000000001,"15min":2.4860000000000002},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":3.5739999999999998,"5min":10.271000000000001,"15min":10.271000000000001},"last":1.238}]}]},{"osd":0,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":102,"seq":438086664204,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1053516,"kb_used_data":4932,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93318324,"statfs":{"total":96636764160,"available":95557963776,"internally_reserved":1073741824,"allocated":5050368,"data_stored":8954513,"data_compressed":56726,"data_compressed_allocated":4329472,"data_compressed_original":8658944,"omap_allocated":4385,"internal_metadata":1073737439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,6],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.093}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4039999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.95}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1400000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049308,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322532,"statfs":{"total":96636764160,"available":95562272768,"internally_reserved":1073741824,"allocated":741376,"data_stored":289217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":3.7719999999999998,"15min":2.456},"min":{"1min":0.60099999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4849999999999999,"5min":178.36699999999999,"15min":178.36699999999999},"last":2.0529999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.915,"15min":1.9430000000000001},"min":{"1min":0.79600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.6509999999999998,"5min":16.902000000000001,"15min":16.902000000000001},"last":1.044}]},{"osd":1,"last update":"Thu Nov 12 17:26:34 2020","interfaces":[{"interface":"back","average":{"1min":38.305999999999997,"5min":38.305999999999997,"15min":38.305999999999997},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":501.91199999999998,"5min":501.91199999999998,"15min":501.91199999999998},"last":1.8680000000000001},{"interface":"front","average":{"1min":26.684000000000001,"5min":26.684000000000001,"15min":26.684000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":501.774,"5min":501.774,"15min":501.774},"last":1.2490000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:24:50 2020","interfaces":[{"interface":"back","average":{"1min":6.5069999999999997,"5min":3.1789999999999998,"15min":2.6240000000000001},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":86.161000000000001,"5min":86.161000000000001,"15min":86.161000000000001},"last":1.181},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.8819999999999999,"15min":1.956},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.4300000000000002,"5min":3.7389999999999999,"15min":3.7389999999999999},"last":1.9690000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":2.246,"15min":2.4420000000000002},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":3.2509999999999999,"5min":10.318,"15min":10.318},"last":3.1320000000000001},{"interface":"front","average":{"1min":1.446,"5min":2.1400000000000001,"15min":2.3780000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.411,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":2.1230000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":20.111000000000001,"15min":28.177},"min":{"1min":0.96999999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.8530000000000002,"5min":622.07799999999997,"15min":622.07799999999997},"last":2.1669999999999998},{"interface":"front","average":{"1min":1.9039999999999999,"5min":2.524,"15min":2.746},"min":{"1min":1.0640000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.3170000000000002,"5min":10.436,"15min":10.436},"last":3.2450000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":2.552,"5min":2.4769999999999999,"15min":2.5750000000000002},"min":{"1min":0.95599999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":20.686,"5min":20.686,"15min":20.686},"last":2.3799999999999999},{"interface":"front","average":{"1min":1.8660000000000001,"5min":2.3999999999999999,"15min":2.6320000000000001},"min":{"1min":1.294,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.7450000000000001,"5min":11.497999999999999,"15min":11.497999999999999},"last":2.222}]},{"osd":7,"last update":"Thu Nov 12 17:25:55 2020","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":2.5489999999999999,"15min":2.8029999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.363,"5min":10.513999999999999,"15min":10.513999999999999},"last":3.0369999999999999},{"interface":"front","average":{"1min":1.837,"5min":18.891999999999999,"15min":26.423999999999999},"min":{"1min":1.115,"5min":1.016,"15min":1.016},"max":{"1min":3.1520000000000001,"5min":577.35900000000004,"15min":577.35900000000004},"last":2.4380000000000002}]}]}]}} 2020-11-12T17:26:53.632 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:26:53.634 INFO:tasks.thrashosds.thrasher:Setting 2.5 to [7, 6, 4, 3] 2020-11-12T17:26:53.635 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.5', '7', '6', '4', '3'] 2020-11-12T17:26:53.635 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap-items 2.5 7 6 4 3 2020-11-12T17:26:53.635 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:53.516+0000 7f038ead6700 -1 osd.2 131 handle_osd_map injecting map crc failure 2020-11-12T17:26:53.636 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:26:53.636 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 7 16 8294 8278 9.23805 9.61719 0.0120818 0.0134916 2020-11-12T17:26:53.636 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:53.334+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:53.636 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:53.626+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:53.731 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:53.728+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:53.759 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:53.759 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:53.759 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:26:53.760 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:53.770 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:53.831 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:53.826+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:53.906 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:53.911 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:53.912 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:53.912 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:53.912 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:53.912 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:53.924 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:53.959 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:53.956+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:53.986 INFO:teuthology.orchestra.run.smithi036.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-11-12T17:26:53.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:26:53.989 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2020-11-12T17:26:54.033 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:54.030+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:54.073 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:54.099 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:54.101 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:54.101 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:54.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:54.102 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:54.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.102 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:26:54.102 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:26:54.102 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.43023742700001, 2020-11-12T17:26:54.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:26:54.102 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.103 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:26:54.103 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.103 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.103 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.105 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:26:54.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.105 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:26:54.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:26:54.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:26:54.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:26:54.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:26:54.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:26:54.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:26:54.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:26:54.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:26:54.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:26:54.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:26:54.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:26:54.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:26:54.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:26:54.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:26:54.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:26:54.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:26:54.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:26:54.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:26:54.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:26:54.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:26:54.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:26:54.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:26:54.123 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.124 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.125 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.126 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:26:54.126 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42983506600001, 2020-11-12T17:26:54.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:26:54.126 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.127 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.127 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.127 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.127 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.127 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:26:54.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.127 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:26:54.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:26:54.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:26:54.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:26:54.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:26:54.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:26:54.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:26:54.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:26:54.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:26:54.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:26:54.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:26:54.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:26:54.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:26:54.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:26:54.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:26:54.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:26:54.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:26:54.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:26:54.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:26:54.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:26:54.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:26:54.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:26:54.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:26:54.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:26:54.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:26:54.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:26:54.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:26:54.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:26:54.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:26:54.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:26:54.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:26:54.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:26:54.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:26:54.142 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.142 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.142 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.142 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.143 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:26:54.143 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42951107299999, 2020-11-12T17:26:54.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:26:54.143 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.143 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.144 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.144 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:26:54.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.144 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:26:54.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:26:54.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:26:54.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:26:54.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:26:54.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:26:54.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:26:54.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:26:54.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:26:54.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:26:54.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:26:54.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:26:54.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:26:54.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:26:54.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:26:54.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:26:54.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:26:54.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:26:54.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:26:54.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:26:54.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:26:54.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:26:54.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:26:54.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:26:54.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:26:54.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:26:54.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:26:54.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:26:54.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:26:54.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:26:54.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:26:54.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:26:54.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:26:54.156 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.156 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.157 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.157 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.157 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:26:54.157 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42926736199999, 2020-11-12T17:26:54.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:26:54.157 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.158 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.158 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.158 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.158 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.158 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:26:54.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.158 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:26:54.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:26:54.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:26:54.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:26:54.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:26:54.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:26:54.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:26:54.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:26:54.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:26:54.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:26:54.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:26:54.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:26:54.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:26:54.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:26:54.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:26:54.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:26:54.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:26:54.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:26:54.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:26:54.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:26:54.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:26:54.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:26:54.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:26:54.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:26:54.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:26:54.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:26:54.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:26:54.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:26:54.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:26:54.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:26:54.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:26:54.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:26:54.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:26:54.184 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.185 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.185 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.185 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.186 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:26:54.186 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42902921500001, 2020-11-12T17:26:54.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:26:54.186 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.186 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.186 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.187 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.187 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.187 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:26:54.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.188 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:26:54.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:26:54.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:26:54.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:26:54.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:26:54.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:26:54.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:26:54.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:26:54.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:26:54.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:26:54.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:26:54.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:26:54.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:26:54.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:26:54.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:26:54.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:26:54.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:26:54.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:26:54.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:26:54.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:26:54.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:26:54.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:26:54.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:26:54.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:26:54.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:26:54.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:26:54.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:26:54.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:26:54.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:26:54.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:26:54.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:26:54.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:26:54.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:26:54.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.212 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.212 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:26:54.212 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42882717500001, 2020-11-12T17:26:54.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:26:54.213 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.213 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.213 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.213 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.214 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.214 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:26:54.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.214 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:26:54.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:26:54.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:54.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:26:54.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:26:54.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:26:54.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:26:54.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:26:54.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:26:54.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:26:54.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:26:54.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:26:54.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:26:54.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:26:54.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:26:54.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:26:54.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:26:54.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:26:54.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:26:54.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:26:54.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:26:54.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:26:54.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:26:54.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:26:54.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:26:54.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:26:54.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:26:54.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:26:54.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:26:54.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:26:54.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:26:54.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:26:54.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:26:54.238 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.238 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.238 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.239 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.239 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:26:54.239 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42862180500001, 2020-11-12T17:26:54.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:26:54.239 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.239 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.239 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.240 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:26:54.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.240 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:26:54.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:26:54.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:26:54.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:26:54.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:26:54.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:26:54.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:26:54.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:26:54.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:26:54.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:26:54.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:26:54.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:26:54.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:26:54.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:26:54.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:26:54.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:26:54.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:26:54.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:26:54.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:26:54.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:26:54.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:26:54.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:26:54.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:26:54.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:26:54.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:26:54.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:26:54.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:26:54.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:26:54.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:26:54.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:26:54.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:26:54.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:26:54.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:26:54.251 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.252 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.252 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.252 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.252 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:26:54.252 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42843597800001, 2020-11-12T17:26:54.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:26:54.253 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.253 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.253 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.253 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:26:54.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.254 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:26:54.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:26:54.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:26:54.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:26:54.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:26:54.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:26:54.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:26:54.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:26:54.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:26:54.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:26:54.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:26:54.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:26:54.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:26:54.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:26:54.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:26:54.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:26:54.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:26:54.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:26:54.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:26:54.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:26:54.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:26:54.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:26:54.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:26:54.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:26:54.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:26:54.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:26:54.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:26:54.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:26:54.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:26:54.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:26:54.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:26:54.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:26:54.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:26:54.265 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.265 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.265 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.266 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.266 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:26:54.266 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42823901400001, 2020-11-12T17:26:54.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:26:54.267 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.267 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.267 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.267 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.267 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.267 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:26:54.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.267 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:26:54.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:26:54.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:26:54.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:26:54.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:26:54.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:26:54.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:26:54.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:26:54.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:26:54.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:26:54.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:26:54.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:26:54.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:26:54.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:26:54.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:26:54.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:26:54.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:26:54.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:26:54.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:26:54.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:26:54.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:26:54.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:26:54.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:26:54.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:26:54.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:26:54.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:26:54.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:26:54.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:26:54.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:26:54.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:26:54.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:26:54.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:26:54.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:26:54.279 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.279 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.279 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.280 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.280 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:26:54.280 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.428042984, 2020-11-12T17:26:54.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:26:54.280 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.280 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.280 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.280 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.281 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.281 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:26:54.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.281 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:26:54.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:26:54.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:26:54.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:26:54.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:26:54.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:26:54.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:26:54.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:26:54.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:26:54.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:26:54.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:26:54.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:26:54.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:26:54.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:26:54.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:26:54.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:26:54.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:26:54.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:26:54.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:26:54.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:26:54.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:26:54.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:26:54.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:26:54.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:26:54.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:26:54.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:26:54.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:26:54.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:26:54.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:26:54.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:26:54.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:26:54.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:26:54.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:26:54.292 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.292 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.293 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.293 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:26:54.293 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42786218399999, 2020-11-12T17:26:54.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:26:54.293 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.294 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.294 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.294 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.294 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.294 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:26:54.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.294 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:26:54.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:26:54.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:54.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:26:54.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:26:54.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:26:54.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:26:54.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:26:54.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:26:54.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:26:54.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:26:54.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:26:54.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:26:54.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:26:54.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:26:54.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:26:54.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:26:54.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:26:54.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:26:54.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:26:54.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:26:54.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:26:54.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:26:54.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:26:54.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:26:54.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:26:54.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:26:54.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:26:54.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:26:54.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:26:54.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:26:54.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:26:54.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:26:54.306 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.306 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.306 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.307 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.307 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:26:54.307 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42766623099999, 2020-11-12T17:26:54.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:26:54.307 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.307 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.307 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.307 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.308 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.308 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:26:54.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.308 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:26:54.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:26:54.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:26:54.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:26:54.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:26:54.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:26:54.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:26:54.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:26:54.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:54.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:26:54.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:26:54.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:26:54.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:26:54.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:26:54.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:26:54.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:26:54.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:26:54.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:26:54.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:26:54.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:26:54.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:26:54.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:26:54.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:26:54.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:26:54.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:26:54.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:26:54.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:26:54.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:26:54.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:26:54.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:26:54.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:26:54.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:26:54.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:26:54.319 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.319 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.320 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.320 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.320 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:26:54.320 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.427472623, 2020-11-12T17:26:54.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:26:54.320 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.321 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.321 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.321 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.321 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.321 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:26:54.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.321 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:26:54.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:26:54.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:26:54.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:26:54.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:26:54.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:26:54.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:26:54.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:26:54.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:26:54.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:26:54.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:26:54.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:26:54.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:26:54.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:26:54.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:26:54.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:26:54.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:26:54.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:26:54.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:26:54.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:26:54.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:26:54.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:26:54.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:26:54.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:26:54.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:26:54.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:26:54.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:26:54.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:26:54.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:26:54.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:26:54.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:26:54.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:26:54.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:26:54.333 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.333 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.333 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.333 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.334 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:26:54.334 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42716075999999, 2020-11-12T17:26:54.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:26:54.334 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.334 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.334 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.334 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.335 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.335 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:26:54.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.335 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:26:54.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:26:54.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:26:54.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:26:54.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:26:54.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:26:54.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:26:54.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:26:54.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:26:54.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:26:54.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:26:54.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:26:54.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:26:54.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:26:54.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:26:54.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:26:54.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:26:54.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:26:54.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:26:54.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:26:54.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:26:54.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:26:54.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:26:54.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:26:54.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:26:54.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:26:54.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:26:54.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:26:54.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:26:54.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:26:54.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:26:54.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:26:54.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:26:54.347 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.347 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.347 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.347 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.347 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:26:54.347 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.426873263, 2020-11-12T17:26:54.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:26:54.348 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.348 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.348 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.348 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.348 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.348 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:26:54.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.349 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:26:54.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:26:54.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:26:54.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:26:54.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:26:54.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:26:54.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:26:54.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:26:54.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:26:54.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:26:54.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:26:54.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:26:54.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:26:54.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:26:54.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:26:54.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:26:54.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:26:54.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:26:54.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:26:54.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:26:54.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:26:54.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:26:54.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:26:54.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:26:54.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:26:54.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:26:54.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:26:54.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:26:54.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:26:54.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:26:54.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:26:54.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:26:54.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:26:54.360 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.360 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.360 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.360 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:54.361 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:26:54.361 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 214.42665289199999, 2020-11-12T17:26:54.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:26:54.361 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.361 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.361 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:54.361 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:54.361 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:54.362 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:26:54.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.362 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:26:54.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:26:54.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:26:54.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:26:54.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:26:54.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:26:54.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:26:54.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:26:54.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:26:54.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:26:54.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:26:54.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:26:54.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:26:54.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:54.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:26:54.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:26:54.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:26:54.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:26:54.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:54.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:26:54.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:26:54.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:26:54.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:26:54.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:26:54.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:26:54.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:54.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:26:54.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:26:54.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:54.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:26:54.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:26:54.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:54.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:26:54.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:26:54.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:26:54.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:26:54.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:26:54.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:26:54.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.373 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.374 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:40120 4.4 e88/69 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head v 88'2336, mlcod=88'2333)", 2020-11-12T17:26:54.374 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:26:54.374 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 82.191963943000005, 2020-11-12T17:26:54.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001, 2020-11-12T17:26:54.374 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.374 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.375 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:26:54.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:26:54.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:26:54.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907891+0000", 2020-11-12T17:26:54.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1538000000000006e-05 2020-11-12T17:26:54.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907953+0000", 2020-11-12T17:26:54.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56353955600000005 2020-11-12T17:26:54.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471493+0000", 2020-11-12T17:26:54.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1980000000000007e-06 2020-11-12T17:26:54.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471502+0000", 2020-11-12T17:26:54.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5057999999999997e-05 2020-11-12T17:26:54.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471597+0000", 2020-11-12T17:26:54.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4514999999999997e-05 2020-11-12T17:26:54.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471631+0000", 2020-11-12T17:26:54.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026000350000000001 2020-11-12T17:26:54.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474231+0000", 2020-11-12T17:26:54.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7666999999999997e-05 2020-11-12T17:26:54.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474269+0000", 2020-11-12T17:26:54.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001 2020-11-12T17:26:54.381 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.381 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.381 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.382 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44328 4.4 e91/69 4:28df349f:::benchmark_data_smithi036_18856_object5540:head v 91'2624, mlcod=90'2615)", 2020-11-12T17:26:54.382 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:26:54.382 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.305414670000005, 2020-11-12T17:26:54.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002, 2020-11-12T17:26:54.382 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.382 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.383 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:26:54.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:26:54.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:54.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794441+0000", 2020-11-12T17:26:54.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6031000000000005e-05 2020-11-12T17:26:54.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794507+0000", 2020-11-12T17:26:54.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48298932700000002 2020-11-12T17:26:54.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277496+0000", 2020-11-12T17:26:54.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3239999999999999e-06 2020-11-12T17:26:54.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277503+0000", 2020-11-12T17:26:54.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9152000000000001e-05 2020-11-12T17:26:54.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277542+0000", 2020-11-12T17:26:54.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0945999999999999e-05 2020-11-12T17:26:54.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277563+0000", 2020-11-12T17:26:54.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040876100000000002 2020-11-12T17:26:54.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281650+0000", 2020-11-12T17:26:54.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4248e-05 2020-11-12T17:26:54.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281705+0000", 2020-11-12T17:26:54.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002 2020-11-12T17:26:54.389 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.389 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.389 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.390 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:26:54.390 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:26:54.390 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.517073902, 2020-11-12T17:26:54.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:26:54.390 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.390 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:54.390 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:26:54.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:26:54.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:26:54.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:26:54.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:26:54.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:26:54.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:26:54.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:26:54.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:26:54.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:26:54.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:26:54.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:26:54.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:26:54.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:54.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:26:54.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:26:54.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:54.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:26:54.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:26:54.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:26:54.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:26:54.397 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.397 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.397 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.398 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGRecoveryDeleteReply(4.a e125,122 4:5ad6f5f6:::benchmark_data_smithi036_18856_object1787:head,116'4948)", 2020-11-12T17:26:54.398 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:42.255090+0000", 2020-11-12T17:26:54.398 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.844783613000001, 2020-11-12T17:26:54.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52554894299999999, 2020-11-12T17:26:54.398 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:54.398 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:26:54.399 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:54.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:54.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.255090+0000", 2020-11-12T17:26:54.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:54.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:54.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.255090+0000", 2020-11-12T17:26:54.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:26:54.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:54.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.255063+0000", 2020-11-12T17:26:54.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7583999999999995e-05 2020-11-12T17:26:54.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:54.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.255131+0000", 2020-11-12T17:26:54.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52466913000000004 2020-11-12T17:26:54.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:54.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.779800+0000", 2020-11-12T17:26:54.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0517e-05 2020-11-12T17:26:54.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:54.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.779821+0000", 2020-11-12T17:26:54.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012903 2020-11-12T17:26:54.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:54.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.779950+0000", 2020-11-12T17:26:54.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00068949199999999999 2020-11-12T17:26:54.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:54.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:54.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:54.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.780639+0000", 2020-11-12T17:26:54.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52554894299999999 2020-11-12T17:26:54.404 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.404 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.404 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.404 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:54.404 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:54.404 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:54.406 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:54.407 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:54.407 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:54.407 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:54.407 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:54.407 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:54.407 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:54.408 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:54.408 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:54.408 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:54.408 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:54.408 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:54.408 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:54.408 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:54.409 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:54.409 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:54.402+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:54.508 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:54.504+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:54.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 8 15 9308 9293 9.07442 7.92969 0.00477286 0.0136851 2020-11-12T17:26:54.576 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:54.577 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:54.589 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:54.635 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:54.634+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:54.709 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:54.706+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:54.714 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:54.714 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:54.728 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:26:54.816 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:54.814+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:54.909 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:54.910 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:54.913 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:54.910+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:54.922 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:26:55.014 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:55.008+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:55.062 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:55.063 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:55.073 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:26:55.115 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:55.114+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:55.217 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:55.212+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:55.243 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:55.243 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:55.254 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:26:55.339 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:55.336+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:55.416 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:55.416 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:55.419 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:55.414+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:55.427 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:26:55.528 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:55.516+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:55.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 9 16 10558 10542 9.15025 9.75781 0.00998756 0.0136119 2020-11-12T17:26:55.589 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:55.589 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:55.600 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:26:55.630 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:55.626+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:55.638 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:26:55.731 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:55.730+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:55.771 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:55.771 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:55.784 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:26:55.832 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:55.830+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:55.895 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:55.896 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:55.908 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:26:55.960 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:55.956+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:56.034 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:56.030+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:56.035 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:56.035 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:56.045 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:26:56.135 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:56.130+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:56.196 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:56.197 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:56.207 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:26:56.235 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:56.234+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:56.331 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:56.333 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:56.336 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:56.332+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:56.341 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:26:56.409 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:26:56.471 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:56.468+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:56.490 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:56.491 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:56.503 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:26:56.547 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:56.544+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:56.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 10 16 11415 11399 8.9047 6.69531 0.00573088 0.0139531 2020-11-12T17:26:56.562 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:26:56.591 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:56.618 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:56.638 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:56.632+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:56.650 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:56.678 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:56.678 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:56.688 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:56.691 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:26:56.715 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:56.746 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:56.747 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:56.740+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:56.781 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:56.812 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:56.814 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:26:56.814 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:26:56.814 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:26:56.814 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:26:56.814 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:26:56.815 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:26:56.815 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:26:56.815 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:26:56.845 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:56.838+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:56.846 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:26:56.846 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:26:56.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:26:56.846 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:26:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 222.42023298999999, 2020-11-12T17:26:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:26:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:26:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:26:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:26:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:26:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:26:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:26:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:26:56.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:26:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:26:56.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:26:56.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:26:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:26:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:26:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:26:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:26:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:26:56.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:26:56.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:56.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:26:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:26:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:26:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:26:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:26:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:26:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:26:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:26:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:26:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 222.41328892799999, 2020-11-12T17:26:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:26:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.872 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:56.872 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:26:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:26:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:26:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:26:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:26:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:26:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:26:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:26:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:26:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:26:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:26:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:26:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:26:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:26:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:26:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:26:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 186.23945114200001, 2020-11-12T17:26:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:26:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:26:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:26:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:26:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:26:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:26:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:26:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:26:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:26:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:26:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:26:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:26:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:26:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:26:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:26:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:26:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:26:56.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:26:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:26:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:26:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:26:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:26:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:26:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:26:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:26:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:26:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:26:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 181.76791723299999, 2020-11-12T17:26:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:26:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:26:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:26:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:26:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:26:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:26:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:26:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:26:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:26:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:26:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:26:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:26:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:26:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:26:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:26:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:26:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:26:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:26:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:26:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:26:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:26:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:26:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:26:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:26:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:26:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:26:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:26:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 169.97574604900001, 2020-11-12T17:26:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:26:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:26:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:26:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:26:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:26:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:26:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:26:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:26:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:26:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:26:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:26:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:26:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:26:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:26:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:26:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:26:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:26:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:26:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:26:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:26:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:26:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:26:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:26:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:26:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:26:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:26:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 155.01929920699999, 2020-11-12T17:26:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:26:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:26:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:26:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:26:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:26:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:26:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:26:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:26:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:26:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:26:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:26:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:26:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:26:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:26:56.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:26:56.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:56.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:26:56.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:26:56.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:56.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:26:56.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:26:56.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:56.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:26:56.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:26:56.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:26:56.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:26:56.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:26:56.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:26:56.932 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.933 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.933 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.933 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:26:56.933 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:56.933 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 154.890365723, 2020-11-12T17:26:56.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:26:56.934 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.934 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.934 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:56.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:26:56.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:56.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:26:56.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:26:56.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:26:56.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:26:56.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:26:56.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:26:56.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:26:56.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:26:56.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:26:56.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:26:56.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:26:56.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:26:56.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:26:56.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:26:56.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:26:56.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:26:56.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.940 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.941 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.941 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:26:56.941 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:56.941 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 153.19622744899999, 2020-11-12T17:26:56.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:26:56.942 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.942 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.942 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:56.942 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:26:56.942 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:56.942 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:26:56.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.942 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:56.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:26:56.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:26:56.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:26:56.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:26:56.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:26:56.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:26:56.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:26:56.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:26:56.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:26:56.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:26:56.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:26:56.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:26:56.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:26:56.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:26:56.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:56.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:26:56.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:26:56.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:56.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:26:56.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:26:56.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:56.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:26:56.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:26:56.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:26:56.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:26:56.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:26:56.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:26:56.951 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.952 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.952 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:7176 4.0 4:0798add9:::benchmark_data_smithi036_18856_object896:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e73)", 2020-11-12T17:26:56.952 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:56.952 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 118.881673803, 2020-11-12T17:26:56.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002, 2020-11-12T17:26:56.953 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.953 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.953 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:56.953 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:56.953 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:56.953 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7176 2020-11-12T17:26:56.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.954 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:56.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957047+0000", 2020-11-12T17:26:56.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:56.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957018+0000", 2020-11-12T17:26:56.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9140000000000004e-05 2020-11-12T17:26:56.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957107+0000", 2020-11-12T17:26:56.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2519e-05 2020-11-12T17:26:56.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957120+0000", 2020-11-12T17:26:56.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2169999999999999e-06 2020-11-12T17:26:56.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.957126+0000", 2020-11-12T17:26:56.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001637285 2020-11-12T17:26:56.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958763+0000", 2020-11-12T17:26:56.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000159436 2020-11-12T17:26:56.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.958923+0000", 2020-11-12T17:26:56.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000170106 2020-11-12T17:26:56.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:56.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.959093+0000", 2020-11-12T17:26:56.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028542329999999999 2020-11-12T17:26:56.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:56.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:57.961947+0000", 2020-11-12T17:26:56.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32301750099999998 2020-11-12T17:26:56.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:56.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.284965+0000", 2020-11-12T17:26:56.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017739599999999999 2020-11-12T17:26:56.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285142+0000", 2020-11-12T17:26:56.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9545999999999999e-05 2020-11-12T17:26:56.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:58.285242+0000", 2020-11-12T17:26:56.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32819415400000002 2020-11-12T17:26:56.963 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.963 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.963 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.963 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:26:56.964 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:56.964 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.526988727000003, 2020-11-12T17:26:56.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:26:56.964 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.964 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.964 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:56.964 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:56.964 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:56.965 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:26:56.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.965 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:56.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:26:56.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:56.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:26:56.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:26:56.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:26:56.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:26:56.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:26:56.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:26:56.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:26:56.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:26:56.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:26:56.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:26:56.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:26:56.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:26:56.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:56.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:26:56.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:26:56.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:56.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:26:56.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:26:56.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:56.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:26:56.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:26:56.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:26:56.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:26:56.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:26:56.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:26:56.973 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.973 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.974 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.974 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:26:56.974 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:56.974 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.513811967999999, 2020-11-12T17:26:56.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:26:56.975 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.975 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:56.975 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:56.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:26:56.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:26:56.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:26:56.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:26:56.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:26:56.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:26:56.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:26:56.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:26:56.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:26:56.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:26:56.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:26:56.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:26:56.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:26:56.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:26:56.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:26:56.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:26:56.981 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.981 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.981 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.981 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:26:56.982 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:56.982 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.959730519000004, 2020-11-12T17:26:56.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:26:56.982 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.982 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:56.982 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:56.982 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:56.982 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:56.983 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:26:56.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.983 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:56.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:26:56.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:56.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:26:56.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:26:56.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:26:56.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:26:56.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:26:56.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:26:56.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:26:56.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:26:56.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:26:56.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:26:56.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:26:56.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:26:56.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:56.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:26:56.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:26:56.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:56.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:26:56.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:26:56.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:56.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:26:56.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:26:56.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:56.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:26:56.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:26:56.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:26:56.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:26:56.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.991 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:56.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:56.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.992 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:26:56.992 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:56.992 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.950743212999996, 2020-11-12T17:26:56.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:26:56.992 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:56.993 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:56.993 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:56.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:56.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:56.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:56.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:56.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:26:56.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:26:56.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:56.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:26:56.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:26:56.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:56.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:26:56.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:26:56.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:56.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:26:56.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:26:56.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:56.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:26:56.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:26:56.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:56.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:26:56.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:26:56.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:56.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:26:56.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:26:56.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:56.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:56.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:56.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:26:56.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:26:57.000 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.000 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:57.000 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.000 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:26:57.000 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:57.000 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 84.932815899000005, 2020-11-12T17:26:57.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:26:57.001 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:57.001 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:57.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:57.001 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.001 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:26:57.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.002 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:57.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:57.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:57.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:57.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:57.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:26:57.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:26:57.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:57.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:26:57.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:26:57.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:57.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:26:57.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:26:57.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:57.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:26:57.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:26:57.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:26:57.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:26:57.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:57.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:26:57.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:26:57.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:57.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:26:57.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:26:57.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:57.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:26:57.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:26:57.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:57.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:26:57.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:26:57.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:26:57.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:26:57.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:57.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:26:57.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:26:57.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:57.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:26:57.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:26:57.010 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.010 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:57.010 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.011 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:57.011 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:57.011 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.381772501, 2020-11-12T17:26:57.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:26:57.011 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:57.012 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.012 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:57.012 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:57.012 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.012 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:26:57.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.013 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:57.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:57.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:57.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:57.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:57.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:26:57.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:57.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:57.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:26:57.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:26:57.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:57.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:26:57.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:26:57.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:57.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:26:57.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:26:57.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:26:57.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:26:57.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:57.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:26:57.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:26:57.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:57.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:26:57.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:26:57.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:57.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:26:57.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:26:57.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:57.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:26:57.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:26:57.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:26:57.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:26:57.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:57.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:26:57.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:26:57.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:57.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:26:57.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:26:57.022 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.022 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:57.022 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.023 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:57.023 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:57.023 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.130377000999999, 2020-11-12T17:26:57.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:26:57.023 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:57.023 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.023 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:57.023 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:57.024 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.024 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:26:57.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.024 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:57.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:57.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:57.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:57.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:57.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:26:57.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:57.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:57.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:26:57.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:26:57.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:57.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:26:57.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:26:57.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:57.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:26:57.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:26:57.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:26:57.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:26:57.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:57.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:26:57.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:26:57.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:57.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:26:57.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:26:57.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:57.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:26:57.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:26:57.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:57.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:26:57.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:26:57.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:26:57.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:26:57.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:57.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:26:57.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:26:57.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:57.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:26:57.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:26:57.033 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.033 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:57.033 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.034 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:26:57.034 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:57.034 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.051254684, 2020-11-12T17:26:57.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:26:57.034 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:57.034 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.034 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:57.035 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:57.035 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.035 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:26:57.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.035 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:57.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:57.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:57.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:57.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:57.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:26:57.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:26:57.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:57.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:26:57.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:26:57.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:57.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:26:57.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:26:57.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:57.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:26:57.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:26:57.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:26:57.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:26:57.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:57.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:26:57.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:26:57.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:57.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:26:57.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:26:57.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:57.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:26:57.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:26:57.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:57.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:26:57.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:26:57.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:26:57.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:26:57.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:57.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:26:57.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:26:57.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:57.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:26:57.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:26:57.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.049 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:57.049 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.050 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:26:57.050 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:57.050 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.268903717000001, 2020-11-12T17:26:57.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:26:57.050 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:57.051 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.051 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:57.051 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:57.051 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.051 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:26:57.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.051 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:57.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:57.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:57.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:57.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:57.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:26:57.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:26:57.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:57.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:26:57.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:26:57.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:57.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:26:57.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:26:57.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:57.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:26:57.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:26:57.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:26:57.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:26:57.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:57.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:26:57.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:26:57.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:57.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:26:57.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:26:57.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:57.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:26:57.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:26:57.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:57.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:26:57.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:26:57.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:26:57.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:26:57.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:57.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:26:57.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:26:57.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:57.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:26:57.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:26:57.063 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.063 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:57.063 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.063 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:26:57.063 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:57.064 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.805861368000002, 2020-11-12T17:26:57.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:26:57.064 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:57.064 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.064 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:26:57.064 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:26:57.064 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.065 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:26:57.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.065 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:57.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:57.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:57.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:57.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:57.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:26:57.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:26:57.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:57.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:26:57.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:26:57.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:57.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:26:57.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:26:57.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:57.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:26:57.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:26:57.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:26:57.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:26:57.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:57.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:26:57.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:26:57.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:57.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:26:57.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:26:57.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:57.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:26:57.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:26:57.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:26:57.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:26:57.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:26:57.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:26:57.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:26:57.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:26:57.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:26:57.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:26:57.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:57.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:26:57.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:26:57.077 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.077 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:57.077 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.078 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:26:57.078 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:57.078 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.784820834000001, 2020-11-12T17:26:57.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:26:57.078 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:26:57.079 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:26:57.079 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:26:57.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:26:57.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:57.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:26:57.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:26:57.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:26:57.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:26:57.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:26:57.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:26:57.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:26:57.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:26:57.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:26:57.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:26:57.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:26:57.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:26:57.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:26:57.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:26:57.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:26:57.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:26:57.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:26:57.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:26:57.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:26:57.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:26:57.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:26:57.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:26:57.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:26:57.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:26:57.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:26:57.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:26:57.086 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.086 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:57.086 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.086 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:26:57.086 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:26:57.086 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:26:57.088 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:26:57.249 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:57.249 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:57.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.251 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:26:57.251 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:26:57.251 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.285406567, 2020-11-12T17:26:57.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.28545320400000002, 2020-11-12T17:26:57.252 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.252 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.253 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:26:57.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:26:57.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:57.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:26:57.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:26:57.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:26:57.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:26:57.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:26:57.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:26:57.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:26:57.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:26:57.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:26:57.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:26:57.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:26:57.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013773100000000001 2020-11-12T17:26:57.260 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.260 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.260 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.261 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:26:57.262 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:26:57.262 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.314156665, 2020-11-12T17:26:57.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.31433678500000001, 2020-11-12T17:26:57.262 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.262 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:57.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:57.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:57.263 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:26:57.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.264 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:26:57.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:26:57.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:26:57.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:26:57.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:26:57.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:26:57.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:26:57.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:26:57.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:26:57.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:26:57.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:26:57.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:26:57.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:26:57.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:26:57.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:26:57.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:57.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:26:57.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:26:57.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:26:57.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0060735980000000004 2020-11-12T17:26:57.273 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.273 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.273 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.273 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:26:57.274 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:26:57.274 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.30834008099999999, 2020-11-12T17:26:57.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.30867189499999997, 2020-11-12T17:26:57.274 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.274 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:57.274 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.274 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:57.274 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:57.275 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:26:57.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.275 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:26:57.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:26:57.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:57.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:26:57.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:26:57.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:26:57.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:26:57.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:26:57.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:26:57.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:26:57.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:26:57.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:26:57.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:26:57.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:26:57.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:26:57.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:26:57.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:26:57.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:26:57.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:26:57.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0057969279999999998 2020-11-12T17:26:57.284 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.285 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.285 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.285 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.285 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:57.285 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 3 2020-11-12T17:26:57.285 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:57.286 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:26:57.290 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:26:57.284+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:26:57.391 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:57.086+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:57.391 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:57.186+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:57.392 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:57.388+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:57.403 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:57.404 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:57.404 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:57.420 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:26:57.492 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:57.490+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:57.551 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:26:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 226.86392840799999, 2020-11-12T17:26:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:26:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:26:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:26:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:26:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:26:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:26:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:26:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:26:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:26:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:26:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:26:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:26:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:26:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:26:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:26:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:26:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:26:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:26:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:26:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:26:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:26:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:26:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:26:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:26:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:26:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:26:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 226.85844833900001, 2020-11-12T17:26:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:26:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:26:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:26:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:26:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:26:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:26:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:26:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:26:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:26:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:26:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:26:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:26:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:26:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:26:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:26:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:26:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:26:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 218.66832673900001, 2020-11-12T17:26:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:26:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:26:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:26:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:26:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:26:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:26:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:26:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:26:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:26:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:26:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:26:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:26:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:26:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:26:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:26:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:26:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:26:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:26:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:26:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:26:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:26:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:26:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:26:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:26:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:26:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:26:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:26:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:26:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 218.66108302999999, 2020-11-12T17:26:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:26:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:26:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:26:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:26:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:26:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:26:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:26:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:26:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:26:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:26:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:26:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:26:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:26:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:26:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:26:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:26:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:26:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 142.66499365600001, 2020-11-12T17:26:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:26:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:26:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:26:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:26:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:26:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:26:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:26:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:26:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:26:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:26:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:26:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:26:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:26:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:26:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:21488 4.b e78/69 4:d408906b:::benchmark_data_smithi036_18856_object2685:head v 78'1224, mlcod=78'1218)", 2020-11-12T17:26:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 105.63972438899999, 2020-11-12T17:26:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002, 2020-11-12T17:26:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910917+0000", 2020-11-12T17:26:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999838 2020-11-12T17:26:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910900+0000", 2020-11-12T17:26:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5206e-05 2020-11-12T17:26:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:11.910956+0000", 2020-11-12T17:26:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35548860100000002 2020-11-12T17:26:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266444+0000", 2020-11-12T17:26:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.741e-06 2020-11-12T17:26:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266449+0000", 2020-11-12T17:26:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9947000000000002e-05 2020-11-12T17:26:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266489+0000", 2020-11-12T17:26:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8255000000000001e-05 2020-11-12T17:26:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.266507+0000", 2020-11-12T17:26:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030412130000000001 2020-11-12T17:26:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269548+0000", 2020-11-12T17:26:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7810000000000002e-05 2020-11-12T17:26:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:12.269626+0000", 2020-11-12T17:26:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.35870933300000002 2020-11-12T17:26:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44207 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 80.973883373999996, 2020-11-12T17:26:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043, 2020-11-12T17:26:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44207 2020-11-12T17:26:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576758+0000", 2020-11-12T17:26:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576737+0000", 2020-11-12T17:26:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9085000000000001e-05 2020-11-12T17:26:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576796+0000", 2020-11-12T17:26:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3359999999999995e-06 2020-11-12T17:26:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576804+0000", 2020-11-12T17:26:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8489999999999999e-06 2020-11-12T17:26:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.576808+0000", 2020-11-12T17:26:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00113031 2020-11-12T17:26:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.577938+0000", 2020-11-12T17:26:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015145600000000001 2020-11-12T17:26:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578090+0000", 2020-11-12T17:26:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024843599999999999 2020-11-12T17:26:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.578338+0000", 2020-11-12T17:26:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003461492 2020-11-12T17:26:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.581800+0000", 2020-11-12T17:26:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33304859999999997 2020-11-12T17:26:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914848+0000", 2020-11-12T17:26:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1643000000000001e-05 2020-11-12T17:26:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914890+0000", 2020-11-12T17:26:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0725999999999997e-05 2020-11-12T17:26:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.914921+0000", 2020-11-12T17:26:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.338163043 2020-11-12T17:26:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:44208 4.c 4:3c4e72c9:::benchmark_data_smithi036_18856_object5525:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:26:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 80.970642045000005, 2020-11-12T17:26:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002, 2020-11-12T17:26:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.634 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:57.634 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.634 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44208 2020-11-12T17:26:57.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.634 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579999+0000", 2020-11-12T17:26:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:26:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.579975+0000", 2020-11-12T17:26:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3411999999999994e-05 2020-11-12T17:26:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580058+0000", 2020-11-12T17:26:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3160000000000003e-06 2020-11-12T17:26:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580068+0000", 2020-11-12T17:26:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3600000000000004e-06 2020-11-12T17:26:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580073+0000", 2020-11-12T17:26:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0210000000000001e-05 2020-11-12T17:26:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580133+0000", 2020-11-12T17:26:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137331 2020-11-12T17:26:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580271+0000", 2020-11-12T17:26:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026151499999999998 2020-11-12T17:26:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.580532+0000", 2020-11-12T17:26:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019695619999999998 2020-11-12T17:26:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.582502+0000", 2020-11-12T17:26:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33715882800000002 2020-11-12T17:26:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919660+0000", 2020-11-12T17:26:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7831999999999997e-05 2020-11-12T17:26:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919728+0000", 2020-11-12T17:26:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2163999999999997e-05 2020-11-12T17:26:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.919780+0000", 2020-11-12T17:26:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33978132700000002 2020-11-12T17:26:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:26:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.537471143999994, 2020-11-12T17:26:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:26:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.646 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:26:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:26:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:26:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:26:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:26:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:26:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:26:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:26:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:26:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:26:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:26:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:26:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:26:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:26:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:26:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.488404482999997, 2020-11-12T17:26:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:26:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:26:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:26:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:26:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:26:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:26:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:26:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:26:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:26:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:26:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:26:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:26:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:26:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:26:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:26:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:26:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:26:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:26:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:26:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:26:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:26:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:26:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:26:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:26:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:26:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:26:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.486723702999996, 2020-11-12T17:26:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:26:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:26:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:26:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:26:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:26:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:26:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:26:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:26:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:26:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:26:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:26:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:26:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:26:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:26:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:26:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:26:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:26:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:26:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:26:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:26:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:26:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:26:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.486635508000006, 2020-11-12T17:26:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:26:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:26:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:26:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:26:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:26:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:26:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:26:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:26:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:26:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:26:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:26:57.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:26:57.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:26:57.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:26:57.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:26:57.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:57.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:26:57.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:26:57.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:26:57.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:26:57.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:26:57.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:26:57.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:26:57.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:26:57.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:26:57.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:26:57.686 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.686 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.686 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.687 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:57.687 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:57.687 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.468140192999996, 2020-11-12T17:26:57.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:26:57.687 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.688 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.688 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:57.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:26:57.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:26:57.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:26:57.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:26:57.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:26:57.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:26:57.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:26:57.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:26:57.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:26:57.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:26:57.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:26:57.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:26:57.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:26:57.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:26:57.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:26:57.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:26:57.703 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.703 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.703 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.704 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:57.705 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:57.705 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.468007202999999, 2020-11-12T17:26:57.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:26:57.705 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.705 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.706 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:57.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:26:57.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:26:57.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:26:57.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:26:57.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:26:57.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:26:57.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:26:57.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:26:57.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:26:57.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:26:57.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:26:57.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:26:57.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:26:57.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:26:57.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:26:57.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:26:57.712 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.713 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.713 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.713 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:26:57.713 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:57.713 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.467922474999995, 2020-11-12T17:26:57.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:26:57.714 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.714 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.714 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:57.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:26:57.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:26:57.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:26:57.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:26:57.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:26:57.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:26:57.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:26:57.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:26:57.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:26:57.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:26:57.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:26:57.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:26:57.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:26:57.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:26:57.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:26:57.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:26:57.721 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.721 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.721 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.722 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:57.722 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:57.722 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.416309944999995, 2020-11-12T17:26:57.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999, 2020-11-12T17:26:57.723 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.723 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:57.723 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.723 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:57.723 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.723 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:26:57.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.724 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:57.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134331+0000", 2020-11-12T17:26:57.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999614 2020-11-12T17:26:57.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134292+0000", 2020-11-12T17:26:57.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120853 2020-11-12T17:26:57.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134413+0000", 2020-11-12T17:26:57.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9809999999999998e-05 2020-11-12T17:26:57.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134433+0000", 2020-11-12T17:26:57.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7110000000000003e-06 2020-11-12T17:26:57.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134438+0000", 2020-11-12T17:26:57.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7549999999999997e-05 2020-11-12T17:26:57.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134485+0000", 2020-11-12T17:26:57.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000002e-05 2020-11-12T17:26:57.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:57.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134560+0000", 2020-11-12T17:26:57.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.359965019 2020-11-12T17:26:57.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494525+0000", 2020-11-12T17:26:57.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36019403999999999 2020-11-12T17:26:57.730 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.730 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.730 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.731 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:26:57.731 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:57.731 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.416152929000006, 2020-11-12T17:26:57.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:26:57.731 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.731 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:57.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:57.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.732 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:26:57.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.732 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:57.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:26:57.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:26:57.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:26:57.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:26:57.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:26:57.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:26:57.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:26:57.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:26:57.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:26:57.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:26:57.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:26:57.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:26:57.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:57.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:26:57.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:26:57.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:26:57.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:26:57.739 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.739 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.739 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.739 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:57.739 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:57.740 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.717100023999997, 2020-11-12T17:26:57.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:26:57.740 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.740 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.740 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.740 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:57.740 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.740 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:26:57.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.742 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:57.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:26:57.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:26:57.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:26:57.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:26:57.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:26:57.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:26:57.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:26:57.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:26:57.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:26:57.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:26:57.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:26:57.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:26:57.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:26:57.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:26:57.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:57.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:26:57.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:26:57.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:26:57.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:26:57.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:26:57.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:26:57.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:26:57.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:26:57.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:26:57.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:26:57.752 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.752 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.752 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.752 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:57.753 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:57.753 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.630444535999999, 2020-11-12T17:26:57.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:26:57.753 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.753 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:57.753 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.754 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:57.754 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:57.754 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:26:57.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.754 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:57.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:26:57.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:57.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:26:57.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:26:57.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:26:57.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:26:57.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:26:57.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:26:57.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:26:57.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:26:57.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:26:57.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:26:57.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:26:57.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:26:57.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:57.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:26:57.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:26:57.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:26:57.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:26:57.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:57.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:26:57.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:26:57.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:57.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:26:57.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:26:57.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:26:57.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:26:57.764 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.764 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.764 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.764 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:26:57.765 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:57.765 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.616963308999999, 2020-11-12T17:26:57.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:26:57.765 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.765 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.765 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:57.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:26:57.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:57.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:26:57.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:26:57.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:26:57.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:26:57.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:26:57.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:26:57.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:26:57.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:26:57.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:26:57.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:26:57.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:26:57.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:26:57.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:57.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:26:57.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:26:57.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.771 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.772 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.772 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.772 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:57.773 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 11 16 12096 12080 8.57881 5.32031 0.0223604 0.014541 2020-11-12T17:26:57.774 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:26:57.775 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:57.768+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:57.874 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:57.868+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:57.945 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:57.945 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:57.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.945 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:12440 5.2 e134/127 5:46a0d7cb:::benchmark_data_smithi036_24110_object1554:head v 134'824, mlcod=134'815)", 2020-11-12T17:26:57.946 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:57.941165+0000", 2020-11-12T17:26:57.946 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0028707350000000001, 2020-11-12T17:26:57.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028938330000000002, 2020-11-12T17:26:57.946 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.947 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:57.947 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.941165+0000", 2020-11-12T17:26:57.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.941165+0000", 2020-11-12T17:26:57.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:26:57.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.941135+0000", 2020-11-12T17:26:57.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5016000000000002e-05 2020-11-12T17:26:57.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.941200+0000", 2020-11-12T17:26:57.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018762 2020-11-12T17:26:57.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.941388+0000", 2020-11-12T17:26:57.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3390000000000004e-06 2020-11-12T17:26:57.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.941395+0000", 2020-11-12T17:26:57.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7574000000000001e-05 2020-11-12T17:26:57.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.941452+0000", 2020-11-12T17:26:57.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4505e-05 2020-11-12T17:26:57.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.941477+0000", 2020-11-12T17:26:57.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031148699999999999 2020-11-12T17:26:57.954 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.954 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.954 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.954 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:12303 5.7 5:e3a11124:::benchmark_data_smithi036_24110_object1537:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e134)", 2020-11-12T17:26:57.955 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:57.804734+0000", 2020-11-12T17:26:57.955 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.13930177899999999, 2020-11-12T17:26:57.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13939099299999999, 2020-11-12T17:26:57.955 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.956 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:57.956 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.956 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:57.956 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:57.957 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12303 2020-11-12T17:26:57.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.957 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.804734+0000", 2020-11-12T17:26:57.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.804734+0000", 2020-11-12T17:26:57.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:26:57.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.804696+0000", 2020-11-12T17:26:57.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011400600000000001 2020-11-12T17:26:57.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.804810+0000", 2020-11-12T17:26:57.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5136999999999999e-05 2020-11-12T17:26:57.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.804825+0000", 2020-11-12T17:26:57.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5850000000000002e-06 2020-11-12T17:26:57.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.804833+0000", 2020-11-12T17:26:57.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039474009999999997 2020-11-12T17:26:57.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.808780+0000", 2020-11-12T17:26:57.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111444 2020-11-12T17:26:57.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.808892+0000", 2020-11-12T17:26:57.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023206100000000001 2020-11-12T17:26:57.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:57.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.809124+0000", 2020-11-12T17:26:57.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022700340000000002 2020-11-12T17:26:57.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.811394+0000", 2020-11-12T17:26:57.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066595329999999996 2020-11-12T17:26:57.964 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.964 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.964 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.964 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:12304 5.7 5:e3a11124:::benchmark_data_smithi036_24110_object1537:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e134)", 2020-11-12T17:26:57.965 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:57.805377+0000", 2020-11-12T17:26:57.965 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.13865949899999999, 2020-11-12T17:26:57.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.13880325299999999, 2020-11-12T17:26:57.965 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:57.965 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:57.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:57.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:57.966 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:57.966 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12304 2020-11-12T17:26:57.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.966 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:57.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:57.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.805377+0000", 2020-11-12T17:26:57.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:57.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:57.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.805377+0000", 2020-11-12T17:26:57.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:26:57.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:57.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.805335+0000", 2020-11-12T17:26:57.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013285 2020-11-12T17:26:57.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:57.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.805468+0000", 2020-11-12T17:26:57.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.753e-05 2020-11-12T17:26:57.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:57.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.805486+0000", 2020-11-12T17:26:57.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3760000000000008e-06 2020-11-12T17:26:57.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.805494+0000", 2020-11-12T17:26:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049339910000000004 2020-11-12T17:26:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.810428+0000", 2020-11-12T17:26:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9437000000000005e-05 2020-11-12T17:26:57.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.810508+0000", 2020-11-12T17:26:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015178899999999999 2020-11-12T17:26:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.810659+0000", 2020-11-12T17:26:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001925061 2020-11-12T17:26:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.812584+0000", 2020-11-12T17:26:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007207626 2020-11-12T17:26:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 3 2020-11-12T17:26:57.984 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:57.986 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:26:57.987 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:57.982+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:58.089 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:58.084+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:58.160 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:58.161 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:58.161 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:58.162 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:58.162 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:58.172 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:26:58.191 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:26:58.184+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:26:58.291 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:58.286+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:58.307 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:58.307 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:58.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:58.308 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:58.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.308 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:26:58.308 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:58.308 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 223.77738427899999, 2020-11-12T17:26:58.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:26:58.308 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.309 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:58.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:58.309 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:26:58.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.309 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:58.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:26:58.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:26:58.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:26:58.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:26:58.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:26:58.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:26:58.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:26:58.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:26:58.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:26:58.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:26:58.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:26:58.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:26:58.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:26:58.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:26:58.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:58.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:26:58.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:26:58.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:26:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:26:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:26:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:26:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:26:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:26:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:26:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:26:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:26:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 223.773984345, 2020-11-12T17:26:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:26:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:26:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:26:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:26:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:26:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:26:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:26:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:26:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:26:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:26:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:26:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:26:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:26:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:26:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:26:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:26:58.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:26:58.331 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:26:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 188.29809489799999, 2020-11-12T17:26:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:26:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:26:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:26:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:26:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:26:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:26:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:26:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:26:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:26:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:26:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:26:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:26:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:26:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:26:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:26:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:26:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:26:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:26:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:26:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:26:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.358109555, 2020-11-12T17:26:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:26:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:26:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:26:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:26:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:26:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:26:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:26:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:26:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:26:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:26:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:26:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:26:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:26:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:26:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:26:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:26:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:26:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:26:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:26:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:26:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:26:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:26:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:26:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:26:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.88100848100001, 2020-11-12T17:26:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:26:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:26:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:26:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:26:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:26:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:26:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:26:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:26:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:26:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:26:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:26:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:26:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:26:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:26:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:26:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:26:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:26:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.76199809400001, 2020-11-12T17:26:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:26:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:26:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:26:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:26:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:26:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:26:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:26:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:26:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:26:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:26:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:26:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:26:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:26:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:26:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:26:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:26:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:26:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:26:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:26:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:26:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:26:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:26:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:26:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:26:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:26:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:26:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:26:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.74586009000001, 2020-11-12T17:26:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:26:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:26:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:26:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:26:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:26:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:26:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:26:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:26:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:26:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:26:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:26:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:26:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:26:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:26:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:26:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:26:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:26:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:26:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.741132411, 2020-11-12T17:26:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:26:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:26:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:26:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:26:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:26:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:26:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:26:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:26:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:26:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:26:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:26:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:26:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:26:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:26:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:26:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:26:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:26:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:26:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:26:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:26:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:26:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 87.359573343999998, 2020-11-12T17:26:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:26:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:26:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:26:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:26:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:26:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:26:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:26:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:26:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:26:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:26:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:26:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:26:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:26:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:26:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:26:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:26:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:26:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:26:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:26:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:26:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:26:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:26:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:26:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:26:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:26:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:26:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:26:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 87.354019523000005, 2020-11-12T17:26:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:26:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:26:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:26:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:26:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:26:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:26:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:26:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:26:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:26:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:26:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:26:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:26:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:26:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:26:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:26:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:26:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:26:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:73896 4.3 4:cac907c9:::benchmark_data_smithi036_18856_object9236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e111)", 2020-11-12T17:26:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 40.815497567000001, 2020-11-12T17:26:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34147229000000001, 2020-11-12T17:26:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 73896 2020-11-12T17:26:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488125+0000", 2020-11-12T17:26:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488091+0000", 2020-11-12T17:26:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109295 2020-11-12T17:26:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488200+0000", 2020-11-12T17:26:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2892e-05 2020-11-12T17:26:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488213+0000", 2020-11-12T17:26:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2709999999999998e-06 2020-11-12T17:26:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.488219+0000", 2020-11-12T17:26:58.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0085628400000000004 2020-11-12T17:26:58.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.496782+0000", 2020-11-12T17:26:58.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011530499999999999 2020-11-12T17:26:58.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.496897+0000", 2020-11-12T17:26:58.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017658600000000001 2020-11-12T17:26:58.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.497074+0000", 2020-11-12T17:26:58.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018301089999999999 2020-11-12T17:26:58.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.498904+0000", 2020-11-12T17:26:58.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.33056671100000001 2020-11-12T17:26:58.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829471+0000", 2020-11-12T17:26:58.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7509999999999995e-05 2020-11-12T17:26:58.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829548+0000", 2020-11-12T17:26:58.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9070999999999998e-05 2020-11-12T17:26:58.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:17.829597+0000", 2020-11-12T17:26:58.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.34147229000000001 2020-11-12T17:26:58.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.428 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.429 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:58.429 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:58.429 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.697370511999999, 2020-11-12T17:26:58.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:26:58.429 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.429 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.429 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.430 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.430 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.430 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:26:58.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.430 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:58.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:26:58.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:58.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:26:58.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:26:58.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:26:58.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:26:58.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:26:58.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:26:58.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:26:58.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:26:58.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:26:58.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:26:58.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:26:58.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:26:58.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:26:58.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:26:58.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:26:58.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:26:58.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:26:58.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:26:58.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:26:58.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:26:58.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:26:58.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:26:58.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.440 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.440 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.440 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:58.440 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:58.441 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.695476898999999, 2020-11-12T17:26:58.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:26:58.441 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.441 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.441 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.442 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:26:58.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.442 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:58.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:26:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:26:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:26:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:26:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:26:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:26:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:26:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:26:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:26:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:26:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:26:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:26:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:26:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:26:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:26:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:26:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:26:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:26:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:26:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:26:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:26:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:26:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:26:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:26:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.694724250999997, 2020-11-12T17:26:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:26:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:26:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:26:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:26:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:26:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:26:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:26:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:26:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:26:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:26:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:26:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:26:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:26:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:26:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:26:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:26:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:26:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:26:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:26:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:26:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:26:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:26:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:26:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:26:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:26:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.691562734000001, 2020-11-12T17:26:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:26:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:26:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:26:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:26:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:26:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:26:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:26:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:26:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:26:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:26:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:26:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:26:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:26:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:26:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:26:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:26:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:26:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:26:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:26:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:26:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:26:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:26:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:26:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:26:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:26:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:26:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.690481566999999, 2020-11-12T17:26:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:26:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:26:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:26:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:26:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:26:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:26:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:26:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:26:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:26:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:26:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:26:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:26:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:26:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:26:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:26:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:26:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:26:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:26:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:26:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:26:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:26:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:26:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:26:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:26:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:26:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:26:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.690312474000002, 2020-11-12T17:26:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:26:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:26:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:26:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:26:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:26:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:26:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:26:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:26:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:26:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:26:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:26:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:26:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:26:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:26:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:26:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:26:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:26:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:26:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:26:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:26:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:26:58.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:26:58.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:26:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:26:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:26:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:26:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.687693828, 2020-11-12T17:26:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:26:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:26:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:26:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:26:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:26:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:26:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:26:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:26:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:26:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:26:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:26:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:26:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:26:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:26:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:26:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:26:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:26:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:26:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:26:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:26:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:26:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:26:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:26:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:26:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:26:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:26:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.687585745, 2020-11-12T17:26:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:26:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:26:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:26:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:26:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:26:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:26:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:26:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:26:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:26:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:26:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:26:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:26:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:26:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:26:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:26:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:26:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:26:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:26:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:26:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:26:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:26:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:26:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:26:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:26:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:26:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:26:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:26:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:26:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:26:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:26:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.683623062999999, 2020-11-12T17:26:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:26:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:26:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:26:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:26:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:26:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:26:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:26:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:26:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:26:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:26:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:26:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:26:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:26:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:26:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:26:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:26:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:26:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:26:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.528 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:58.530 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:26:58.531 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:58.524+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:58.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 12 16 13116 13100 8.52791 7.96875 0.0110015 0.0146367 2020-11-12T17:26:58.579 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:26:58.631 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:58.628+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:58.712 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:58.712 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:58.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.713 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:13247 5.2 5:40786921:::benchmark_data_smithi036_24110_object1655:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e134)", 2020-11-12T17:26:58.713 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:58.674030+0000", 2020-11-12T17:26:58.713 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.038843444999999997, 2020-11-12T17:26:58.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.038885920999999997, 2020-11-12T17:26:58.714 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.714 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:58.714 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:58.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:58.715 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 13247 2020-11-12T17:26:58.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.716 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674030+0000", 2020-11-12T17:26:58.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674030+0000", 2020-11-12T17:26:58.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:26:58.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674013+0000", 2020-11-12T17:26:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3098999999999999e-05 2020-11-12T17:26:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674086+0000", 2020-11-12T17:26:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1331e-05 2020-11-12T17:26:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674097+0000", 2020-11-12T17:26:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5030000000000002e-06 2020-11-12T17:26:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674104+0000", 2020-11-12T17:26:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013611669999999999 2020-11-12T17:26:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.675465+0000", 2020-11-12T17:26:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011027 2020-11-12T17:26:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.675575+0000", 2020-11-12T17:26:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114712 2020-11-12T17:26:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.675690+0000", 2020-11-12T17:26:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0099558359999999992 2020-11-12T17:26:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.685646+0000", 2020-11-12T17:26:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011615838999999999 2020-11-12T17:26:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.726 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:13248 5.2 5:40786921:::benchmark_data_smithi036_24110_object1655:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e134)", 2020-11-12T17:26:58.726 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:58.674153+0000", 2020-11-12T17:26:58.726 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.038720076999999999, 2020-11-12T17:26:58.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.03889832, 2020-11-12T17:26:58.726 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:58.726 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:26:58.727 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:58.727 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:26:58.727 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:26:58.727 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 13248 2020-11-12T17:26:58.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.727 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:58.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:58.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674153+0000", 2020-11-12T17:26:58.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:58.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:58.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674153+0000", 2020-11-12T17:26:58.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:26:58.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:58.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674128+0000", 2020-11-12T17:26:58.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3905000000000005e-05 2020-11-12T17:26:58.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:58.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674202+0000", 2020-11-12T17:26:58.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4160000000000001e-06 2020-11-12T17:26:58.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:58.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674209+0000", 2020-11-12T17:26:58.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0920000000000002e-06 2020-11-12T17:26:58.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:58.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.674212+0000", 2020-11-12T17:26:58.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002515167 2020-11-12T17:26:58.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:58.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.676727+0000", 2020-11-12T17:26:58.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111748 2020-11-12T17:26:58.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:58.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.676839+0000", 2020-11-12T17:26:58.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018662299999999999 2020-11-12T17:26:58.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:26:58.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.677025+0000", 2020-11-12T17:26:58.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0089869010000000003 2020-11-12T17:26:58.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:58.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:58.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:58.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:58.686012+0000", 2020-11-12T17:26:58.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011858723 2020-11-12T17:26:58.734 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.734 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:58.734 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.735 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:58.735 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:26:58.735 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:26:58.735 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:58.737 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:26:58.737 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:26:58.734+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:26:58.829 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:26:58.897 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:26:58.894+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:26:58.910 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:58.910 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:26:58.910 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:26:58.910 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:26:58.911 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:58.920 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:26:58.991 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2] out_osds: [0, 1] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:26:58.991 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:26:58.991 INFO:tasks.thrashosds.thrasher:Adding osd 1 2020-11-12T17:26:58.992 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd in 1 2020-11-12T17:26:59.035 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:26:59.032+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:26:59.053 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:26:59.086 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:26:59.093 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:26:59.093 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:26:59.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:26:59.094 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:26:59.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.095 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:26:59.095 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:26:59.096 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.42160032300001, 2020-11-12T17:26:59.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:26:59.096 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.097 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:26:59.097 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.097 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.098 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.098 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:26:59.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.099 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:26:59.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:26:59.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:26:59.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:26:59.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:26:59.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:26:59.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:26:59.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:26:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:26:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:26:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:26:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:26:59.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:26:59.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:26:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:26:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:26:59.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:26:59.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:26:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:26:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:26:59.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:26:59.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:26:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:26:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:26:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.42119796200001, 2020-11-12T17:26:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:26:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:26:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:26:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:26:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:26:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:26:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:26:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:26:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:26:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:26:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:26:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:26:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:26:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:26:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:26:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:26:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:26:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:26:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:26:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:26:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:26:59.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:26:59.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:26:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:26:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:26:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:26:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:26:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:26:59.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:26:59.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:26:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:26:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:26:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:26:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:26:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:26:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:26:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.42087396900001, 2020-11-12T17:26:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:26:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:26:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:26:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:26:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:26:59.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:26:59.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:26:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:26:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:26:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:26:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:26:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.162 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.162 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.163 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:26:59.163 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.42063025799999, 2020-11-12T17:26:59.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:26:59.163 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.164 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.164 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.164 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.164 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.165 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:26:59.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.165 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:26:59.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:26:59.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:26:59.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:26:59.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:26:59.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:26:59.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:26:59.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:26:59.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:26:59.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:26:59.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:26:59.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:26:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:26:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:26:59.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:26:59.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:26:59.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:26:59.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:26:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:26:59.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:26:59.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:26:59.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:26:59.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:26:59.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:26:59.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:26:59.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:26:59.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:26:59.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:26:59.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:26:59.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:26:59.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:26:59.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:26:59.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:26:59.188 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.188 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.189 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.218 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.219 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:26:59.219 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.42039211100001, 2020-11-12T17:26:59.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:26:59.220 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.220 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.220 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.221 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.221 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.221 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:26:59.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.222 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:26:59.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:26:59.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:26:59.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:26:59.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:26:59.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:26:59.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:26:59.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:26:59.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:26:59.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:26:59.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:26:59.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:26:59.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:26:59.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:26:59.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:26:59.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:26:59.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:26:59.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:26:59.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:26:59.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:26:59.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:26:59.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:26:59.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:26:59.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:26:59.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:26:59.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:26:59.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:26:59.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:26:59.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:26:59.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:26:59.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:26:59.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:26:59.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:26:59.239 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.239 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.239 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.240 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.240 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:26:59.240 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.42019007100001, 2020-11-12T17:26:59.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:26:59.240 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.240 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.241 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.241 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:26:59.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.241 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:26:59.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:26:59.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:26:59.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:26:59.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:26:59.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:26:59.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:26:59.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:26:59.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:26:59.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:26:59.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:26:59.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:26:59.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:26:59.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:26:59.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:26:59.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:26:59.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:26:59.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:26:59.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:26:59.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:26:59.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:26:59.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:26:59.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:26:59.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:26:59.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:26:59.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:26:59.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:26:59.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:26:59.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:26:59.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:26:59.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:26:59.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:26:59.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:26:59.254 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.254 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.254 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.255 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.255 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:26:59.255 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.419984701, 2020-11-12T17:26:59.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:26:59.255 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.255 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.256 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.256 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.256 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:26:59.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.256 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:26:59.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:26:59.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:26:59.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:26:59.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:26:59.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:26:59.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:26:59.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:26:59.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:26:59.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:26:59.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:26:59.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:26:59.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:26:59.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:26:59.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:26:59.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:26:59.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:26:59.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:26:59.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:26:59.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:26:59.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:26:59.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:26:59.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:26:59.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:26:59.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:26:59.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:26:59.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:26:59.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:26:59.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:26:59.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:26:59.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:26:59.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:26:59.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:26:59.279 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.279 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.279 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.280 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.280 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:26:59.281 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.41979887400001, 2020-11-12T17:26:59.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:26:59.281 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.282 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.282 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.282 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.283 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.283 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:26:59.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.283 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:26:59.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:26:59.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:26:59.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:26:59.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:26:59.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:26:59.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:26:59.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:26:59.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:26:59.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:26:59.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:26:59.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:26:59.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:26:59.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:26:59.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:26:59.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:26:59.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:26:59.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:26:59.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:26:59.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:26:59.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:26:59.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:26:59.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:26:59.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:26:59.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:26:59.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:26:59.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:26:59.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:26:59.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:26:59.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:26:59.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:26:59.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:26:59.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:26:59.308 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.308 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.309 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.310 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:26:59.310 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.41960191000001, 2020-11-12T17:26:59.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:26:59.311 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.311 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.311 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.312 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.312 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.312 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:26:59.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.313 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:26:59.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:26:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:26:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:26:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:26:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:26:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:26:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:26:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:26:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:26:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:26:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:26:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:26:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:26:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:26:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:26:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:26:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:26:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:26:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:26:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:26:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:26:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:26:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:26:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:26:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:26:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:26:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:26:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:26:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:26:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:26:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:26:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:26:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:26:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.41940588, 2020-11-12T17:26:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:26:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:26:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:26:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:26:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:26:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:26:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:26:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:26:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:26:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:26:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:26:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:26:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:26:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:26:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:26:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:26:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:26:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:26:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:26:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:26:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:26:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:26:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:26:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:26:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:26:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:26:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:26:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:26:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:26:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:26:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:26:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:26:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:26:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:26:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:26:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:26:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.41922507999999, 2020-11-12T17:26:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:26:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:26:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:26:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:26:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:26:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:26:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:26:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:26:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:26:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:26:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:26:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:26:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:26:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:26:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:26:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:26:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:26:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:26:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:26:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:26:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:26:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:26:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:26:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:26:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:26:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:26:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:26:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:26:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:26:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:26:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:26:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:26:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:26:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:26:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.41902912699999, 2020-11-12T17:26:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:26:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:26:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:26:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:26:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:26:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:26:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:26:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:26:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:26:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:26:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:26:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:26:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:26:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:26:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:26:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:26:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:26:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:26:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:26:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:26:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:26:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:26:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:26:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:26:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:26:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:26:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:26:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:26:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:26:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:26:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:26:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:26:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:26:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:26:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:26:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:26:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.418835519, 2020-11-12T17:26:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:26:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:26:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:26:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:26:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:26:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:26:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:26:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:26:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:26:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:26:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:26:59.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:26:59.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:26:59.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:26:59.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:26:59.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:26:59.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:26:59.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:26:59.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:26:59.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:26:59.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:26:59.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:26:59.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:26:59.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:26:59.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:26:59.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:26:59.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:26:59.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:26:59.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:26:59.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:26:59.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:26:59.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:26:59.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:26:59.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:26:59.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:26:59.431 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.432 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.432 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.432 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.432 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:26:59.432 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.41852365599999, 2020-11-12T17:26:59.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:26:59.433 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.433 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.433 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.433 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.433 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.433 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:26:59.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.434 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:26:59.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:26:59.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:26:59.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:26:59.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:26:59.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:26:59.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:26:59.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:26:59.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:26:59.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:26:59.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:26:59.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:26:59.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:26:59.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:26:59.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:26:59.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:26:59.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:26:59.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:26:59.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:26:59.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:26:59.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:26:59.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:26:59.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:26:59.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:26:59.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:26:59.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:26:59.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:26:59.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:26:59.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:26:59.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:26:59.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:26:59.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:26:59.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:26:59.445 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.445 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.445 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.446 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.446 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:26:59.446 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.418236159, 2020-11-12T17:26:59.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:26:59.446 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.446 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.446 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.447 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.447 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.447 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:26:59.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.447 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:26:59.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:26:59.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:26:59.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:26:59.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:26:59.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:26:59.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:26:59.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:26:59.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:26:59.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:26:59.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:26:59.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:26:59.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:26:59.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:26:59.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:26:59.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:26:59.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:26:59.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:26:59.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:26:59.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:26:59.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:26:59.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:26:59.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:26:59.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:26:59.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:26:59.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:26:59.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:26:59.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:26:59.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:26:59.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:26:59.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:26:59.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:26:59.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:26:59.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.458 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.459 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.459 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:26:59.459 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:26:59.459 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.41801578799999, 2020-11-12T17:26:59.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:26:59.459 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.460 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.460 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:26:59.460 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:26:59.460 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:26:59.460 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:26:59.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.460 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:26:59.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:26:59.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:26:59.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:26:59.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:26:59.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:26:59.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:26:59.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:26:59.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:26:59.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:26:59.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:26:59.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:26:59.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:26:59.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:26:59.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:26:59.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:26:59.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:26:59.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:26:59.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:26:59.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:26:59.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:26:59.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:26:59.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:26:59.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:26:59.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:26:59.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:26:59.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:26:59.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:26:59.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:26:59.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:26:59.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:26:59.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:26:59.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:26:59.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:26:59.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:26:59.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:26:59.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:26:59.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:26:59.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.472 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.472 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:40120 4.4 e88/69 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head v 88'2336, mlcod=88'2333)", 2020-11-12T17:26:59.473 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:26:59.473 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 87.183326839000003, 2020-11-12T17:26:59.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001, 2020-11-12T17:26:59.473 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.473 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.473 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:26:59.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907910+0000", 2020-11-12T17:26:59.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:26:59.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907891+0000", 2020-11-12T17:26:59.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1538000000000006e-05 2020-11-12T17:26:59.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.907953+0000", 2020-11-12T17:26:59.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56353955600000005 2020-11-12T17:26:59.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471493+0000", 2020-11-12T17:26:59.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1980000000000007e-06 2020-11-12T17:26:59.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471502+0000", 2020-11-12T17:26:59.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5057999999999997e-05 2020-11-12T17:26:59.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471597+0000", 2020-11-12T17:26:59.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4514999999999997e-05 2020-11-12T17:26:59.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.471631+0000", 2020-11-12T17:26:59.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026000350000000001 2020-11-12T17:26:59.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474231+0000", 2020-11-12T17:26:59.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7666999999999997e-05 2020-11-12T17:26:59.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:32.474269+0000", 2020-11-12T17:26:59.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.56635913900000001 2020-11-12T17:26:59.480 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.480 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.480 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.480 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44328 4.4 e91/69 4:28df349f:::benchmark_data_smithi036_18856_object5540:head v 91'2624, mlcod=90'2615)", 2020-11-12T17:26:59.481 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:26:59.481 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 82.296777566000003, 2020-11-12T17:26:59.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002, 2020-11-12T17:26:59.481 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.481 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.481 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:26:59.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794459+0000", 2020-11-12T17:26:59.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:26:59.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794441+0000", 2020-11-12T17:26:59.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6031000000000005e-05 2020-11-12T17:26:59.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.794507+0000", 2020-11-12T17:26:59.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48298932700000002 2020-11-12T17:26:59.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277496+0000", 2020-11-12T17:26:59.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3239999999999999e-06 2020-11-12T17:26:59.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277503+0000", 2020-11-12T17:26:59.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9152000000000001e-05 2020-11-12T17:26:59.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277542+0000", 2020-11-12T17:26:59.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0945999999999999e-05 2020-11-12T17:26:59.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.277563+0000", 2020-11-12T17:26:59.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040876100000000002 2020-11-12T17:26:59.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281650+0000", 2020-11-12T17:26:59.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4248e-05 2020-11-12T17:26:59.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.281705+0000", 2020-11-12T17:26:59.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48724535800000002 2020-11-12T17:26:59.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.488 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.489 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:26:59.489 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:26:59.489 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 57.508436797999998, 2020-11-12T17:26:59.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:26:59.489 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.489 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:26:59.489 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:26:59.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:26:59.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:26:59.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:26:59.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:26:59.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:26:59.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:26:59.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:26:59.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:26:59.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:26:59.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:26:59.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:26:59.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:26:59.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:26:59.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:26:59.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:26:59.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:26:59.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:26:59.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:26:59.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:26:59.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:26:59.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.599 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.600 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGRecoveryDeleteReply(4.a e125,122 4:5ad6f5f6:::benchmark_data_smithi036_18856_object1787:head,116'4948)", 2020-11-12T17:26:59.600 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:42.255090+0000", 2020-11-12T17:26:59.600 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.836146508999999, 2020-11-12T17:26:59.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52554894299999999, 2020-11-12T17:26:59.600 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:26:59.600 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:26:59.601 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:26:59.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:26:59.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.255090+0000", 2020-11-12T17:26:59.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:26:59.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:26:59.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.255090+0000", 2020-11-12T17:26:59.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:26:59.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:26:59.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.255063+0000", 2020-11-12T17:26:59.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7583999999999995e-05 2020-11-12T17:26:59.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:26:59.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.255131+0000", 2020-11-12T17:26:59.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52466913000000004 2020-11-12T17:26:59.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:26:59.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.779800+0000", 2020-11-12T17:26:59.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0517e-05 2020-11-12T17:26:59.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:26:59.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.779821+0000", 2020-11-12T17:26:59.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012903 2020-11-12T17:26:59.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:26:59.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.779950+0000", 2020-11-12T17:26:59.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00068949199999999999 2020-11-12T17:26:59.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:26:59.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:26:59.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:26:59.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:42.780639+0000", 2020-11-12T17:26:59.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52554894299999999 2020-11-12T17:26:59.606 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.606 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.606 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:26:59.607 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:26:59.607 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:26:59.609 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:26:59.609 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:26:59.610 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:26:59.610 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:26:59.610 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:26:59.610 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:26:59.610 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:26:59.611 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:26:59.611 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:26:59.611 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:26:59.611 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:26:59.611 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:26:59.611 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:26:59.612 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:26:59.612 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:26:59.308+0000 7f4952786700 -1 mon.a@0(leader).osd e134 definitely_dead 0 2020-11-12T17:26:59.612 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 13 16 14200 14184 8.52329 8.46875 0.0457674 0.0146234 2020-11-12T17:26:59.612 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:26:59.613 INFO:teuthology.orchestra.run.smithi036.stderr:marked in osd.1. 2020-11-12T17:26:59.613 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:59.586+0000 7f280e6c1700 -1 osd.6 134 handle_osd_map injecting map crc failure 2020-11-12T17:26:59.613 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:26:59.606+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:26:59.614 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:26:59.615 INFO:tasks.thrashosds.thrasher:Added osd 1 2020-11-12T17:26:59.710 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:59.706+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:59.763 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:59.764 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:59.778 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:26:59.811 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:26:59.808+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:26:59.912 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:26:59.910+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:26:59.985 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:26:59.985 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:26:59.986 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:00.013 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:00.008+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:00.115 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:00.108+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:00.138 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:00.139 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:00.148 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:00.216 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:00.212+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:00.269 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:01.036 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:01.038 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:00.594+0000 7f7b4b297700 -1 osd.4 135 handle_osd_map injecting map crc failure 2020-11-12T17:27:01.039 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 14 16 14246 14230 7.94011 0.359375 0.771851 0.0147627 2020-11-12T17:27:01.039 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:01.032+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:01.039 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:01.140 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:01.136+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:01.207 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:01.208 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:01.208 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:01.241 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:01.238+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:01.342 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:01.338+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:01.379 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:01.379 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:01.379 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:01.444 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:01.440+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:01.495 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:01.637 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:01.638 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:01.639 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:27:01.641 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:01.641 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 15 16 14311 14295 7.44462 0.507812 0.00551054 0.0154019 2020-11-12T17:27:01.642 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:01.634+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:01.664 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:01.658+0000 7f9a06aa2700 -1 osd.5 136 handle_osd_map injecting map crc failure 2020-11-12T17:27:01.745 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:01.742+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:01.839 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:01.840 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:01.844 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:01.840+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:01.853 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:01.890 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:01.927 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:01.945 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:01.940+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:01.961 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:01.991 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:02.023 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:02.028 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.6 123/122 [PushOp(4:60824407:::benchmark_data_smithi036_18856_object6950:head, version: 100'3208, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:60824407:::benchmark_data_smithi036_18856_object6950:head@100'3208, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.339255113, 2020-11-12T17:27:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998, 2020-11-12T17:27:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687268+0000", 2020-11-12T17:27:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2052999999999994e-05 2020-11-12T17:27:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687360+0000", 2020-11-12T17:27:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54419334699999999 2020-11-12T17:27:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231553+0000", 2020-11-12T17:27:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.362e-06 2020-11-12T17:27:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231560+0000", 2020-11-12T17:27:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000185682 2020-11-12T17:27:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231746+0000", 2020-11-12T17:27:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0793e-05 2020-11-12T17:27:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231797+0000", 2020-11-12T17:27:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003344549 2020-11-12T17:27:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.235141+0000", 2020-11-12T17:27:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998 2020-11-12T17:27:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:800 5.d 5:b9f6bf26:::benchmark_data_smithi036_24110_object99:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e129)", 2020-11-12T17:27:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:47.239919+0000", 2020-11-12T17:27:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.786619634999999, 2020-11-12T17:27:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.229269315, 2020-11-12T17:27:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 800 2020-11-12T17:27:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.239919+0000", 2020-11-12T17:27:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.239919+0000", 2020-11-12T17:27:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9998703 2020-11-12T17:27:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.239789+0000", 2020-11-12T17:27:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000334366 2020-11-12T17:27:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.240123+0000", 2020-11-12T17:27:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6396999999999997e-05 2020-11-12T17:27:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.240160+0000", 2020-11-12T17:27:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8153000000000001e-05 2020-11-12T17:27:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.240178+0000", 2020-11-12T17:27:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026154780000000001 2020-11-12T17:27:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.242793+0000", 2020-11-12T17:27:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.753e-05 2020-11-12T17:27:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.242851+0000", 2020-11-12T17:27:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103293 2020-11-12T17:27:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.242954+0000", 2020-11-12T17:27:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011932760000000001 2020-11-12T17:27:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.244147+0000", 2020-11-12T17:27:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224886751 2020-11-12T17:27:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469034+0000", 2020-11-12T17:27:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4919999999999993e-05 2020-11-12T17:27:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469119+0000", 2020-11-12T17:27:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8856999999999995e-05 2020-11-12T17:27:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469188+0000", 2020-11-12T17:27:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.229269315 2020-11-12T17:27:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:800 5.d e129/127 ondisk, result = 0)", 2020-11-12T17:27:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:47.245091+0000", 2020-11-12T17:27:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.781446831, 2020-11-12T17:27:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224137471, 2020-11-12T17:27:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.245091+0000", 2020-11-12T17:27:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.245091+0000", 2020-11-12T17:27:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.245042+0000", 2020-11-12T17:27:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103633 2020-11-12T17:27:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.245146+0000", 2020-11-12T17:27:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22191148999999999 2020-11-12T17:27:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.467057+0000", 2020-11-12T17:27:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.467069+0000", 2020-11-12T17:27:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001932937 2020-11-12T17:27:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469002+0000", 2020-11-12T17:27:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6722999999999999e-05 2020-11-12T17:27:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469018+0000", 2020-11-12T17:27:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021032900000000001 2020-11-12T17:27:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469229+0000", 2020-11-12T17:27:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224137471 2020-11-12T17:27:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:1512 5.a 5:56e3a795:::benchmark_data_smithi036_24110_object188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e130)", 2020-11-12T17:27:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.110454540999999, 2020-11-12T17:27:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25162866900000003, 2020-11-12T17:27:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1512 2020-11-12T17:27:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916054+0000", 2020-11-12T17:27:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5012000000000005e-05 2020-11-12T17:27:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916139+0000", 2020-11-12T17:27:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7899999999999994e-06 2020-11-12T17:27:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916148+0000", 2020-11-12T17:27:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5700000000000003e-06 2020-11-12T17:27:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916153+0000", 2020-11-12T17:27:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0071457680000000003 2020-11-12T17:27:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923299+0000", 2020-11-12T17:27:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2009999999999998e-05 2020-11-12T17:27:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923361+0000", 2020-11-12T17:27:02.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106986 2020-11-12T17:27:02.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923468+0000", 2020-11-12T17:27:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094293899999999995 2020-11-12T17:27:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.924411+0000", 2020-11-12T17:27:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24318124399999999 2020-11-12T17:27:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167592+0000", 2020-11-12T17:27:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9159999999999995e-05 2020-11-12T17:27:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167661+0000", 2020-11-12T17:27:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1243999999999999e-05 2020-11-12T17:27:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167712+0000", 2020-11-12T17:27:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25162866900000003 2020-11-12T17:27:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:7055 5.a 5:50218989:::benchmark_data_smithi036_24110_object881:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e131)", 2020-11-12T17:27:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:52.553623+0000", 2020-11-12T17:27:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.4729155909999996, 2020-11-12T17:27:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19921223699999999, 2020-11-12T17:27:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 7055 2020-11-12T17:27:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.553623+0000", 2020-11-12T17:27:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.553623+0000", 2020-11-12T17:27:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999908 2020-11-12T17:27:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.553530+0000", 2020-11-12T17:27:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025538999999999998 2020-11-12T17:27:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.553786+0000", 2020-11-12T17:27:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7920000000000003e-05 2020-11-12T17:27:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.553824+0000", 2020-11-12T17:27:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2989999999999999e-05 2020-11-12T17:27:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.553837+0000", 2020-11-12T17:27:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2410000000000002e-05 2020-11-12T17:27:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.553879+0000", 2020-11-12T17:27:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9861000000000002e-05 2020-11-12T17:27:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.553939+0000", 2020-11-12T17:27:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011291200000000001 2020-11-12T17:27:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.554052+0000", 2020-11-12T17:27:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016566560000000001 2020-11-12T17:27:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.555709+0000", 2020-11-12T17:27:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.196905207 2020-11-12T17:27:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.752614+0000", 2020-11-12T17:27:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1264000000000001e-05 2020-11-12T17:27:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.752685+0000", 2020-11-12T17:27:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014977299999999999 2020-11-12T17:27:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:52.752835+0000", 2020-11-12T17:27:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19921223699999999 2020-11-12T17:27:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:8408 5.a 5:53005b38:::benchmark_data_smithi036_24110_object1050:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e132)", 2020-11-12T17:27:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:53.657473+0000", 2020-11-12T17:27:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.3690648079999992, 2020-11-12T17:27:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22259032200000001, 2020-11-12T17:27:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 8408 2020-11-12T17:27:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.657473+0000", 2020-11-12T17:27:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.657473+0000", 2020-11-12T17:27:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999018 2020-11-12T17:27:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.657375+0000", 2020-11-12T17:27:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000227407 2020-11-12T17:27:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.657602+0000", 2020-11-12T17:27:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9536999999999999e-05 2020-11-12T17:27:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.657632+0000", 2020-11-12T17:27:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6540000000000001e-05 2020-11-12T17:27:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.657648+0000", 2020-11-12T17:27:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0065734649999999997 2020-11-12T17:27:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.664222+0000", 2020-11-12T17:27:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000124542 2020-11-12T17:27:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.664346+0000", 2020-11-12T17:27:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000177622 2020-11-12T17:27:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.664524+0000", 2020-11-12T17:27:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030856049999999999 2020-11-12T17:27:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.667610+0000", 2020-11-12T17:27:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.212312001 2020-11-12T17:27:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.879922+0000", 2020-11-12T17:27:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7692000000000002e-05 2020-11-12T17:27:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.879989+0000", 2020-11-12T17:27:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4355000000000002e-05 2020-11-12T17:27:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.880064+0000", 2020-11-12T17:27:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.22259032200000001 2020-11-12T17:27:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:8408 5.a e132/127 ondisk, result = 0)", 2020-11-12T17:27:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:53.668994+0000", 2020-11-12T17:27:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.3575437089999998, 2020-11-12T17:27:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21111406399999999, 2020-11-12T17:27:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.668994+0000", 2020-11-12T17:27:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.668994+0000", 2020-11-12T17:27:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999881 2020-11-12T17:27:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.668982+0000", 2020-11-12T17:27:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0534999999999998e-05 2020-11-12T17:27:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.669013+0000", 2020-11-12T17:27:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20972217100000001 2020-11-12T17:27:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.878735+0000", 2020-11-12T17:27:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.746e-06 2020-11-12T17:27:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.878743+0000", 2020-11-12T17:27:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001145021 2020-11-12T17:27:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.879888+0000", 2020-11-12T17:27:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6701000000000002e-05 2020-11-12T17:27:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.879905+0000", 2020-11-12T17:27:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020393899999999999 2020-11-12T17:27:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:53.880109+0000", 2020-11-12T17:27:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21111406399999999 2020-11-12T17:27:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11864 5.b 5:d9b62aaf:::benchmark_data_smithi036_24110_object1482:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.916305+0000", 2020-11-12T17:27:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.1102332410000004, 2020-11-12T17:27:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.211992295, 2020-11-12T17:27:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11864 2020-11-12T17:27:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.916305+0000", 2020-11-12T17:27:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.916305+0000", 2020-11-12T17:27:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999375 2020-11-12T17:27:02.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.916243+0000", 2020-11-12T17:27:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017246300000000001 2020-11-12T17:27:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.916415+0000", 2020-11-12T17:27:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3967e-05 2020-11-12T17:27:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.916429+0000", 2020-11-12T17:27:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2439999999999999e-06 2020-11-12T17:27:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.916438+0000", 2020-11-12T17:27:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00190617 2020-11-12T17:27:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.918344+0000", 2020-11-12T17:27:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011676300000000001 2020-11-12T17:27:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.918461+0000", 2020-11-12T17:27:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019174799999999999 2020-11-12T17:27:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.918653+0000", 2020-11-12T17:27:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013699039999999999 2020-11-12T17:27:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.920023+0000", 2020-11-12T17:27:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20792956500000001 2020-11-12T17:27:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.127952+0000", 2020-11-12T17:27:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018315399999999999 2020-11-12T17:27:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128135+0000", 2020-11-12T17:27:02.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016171299999999999 2020-11-12T17:27:02.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128297+0000", 2020-11-12T17:27:02.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.211992295 2020-11-12T17:27:02.157 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.157 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.158 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.158 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11901 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.159 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:02.159 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0763287430000004, 2020-11-12T17:27:02.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29431180699999998, 2020-11-12T17:27:02.159 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.159 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.160 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.160 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.160 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11901 2020-11-12T17:27:02.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.161 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:02.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:02.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:27:02.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950188+0000", 2020-11-12T17:27:02.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2355999999999997e-05 2020-11-12T17:27:02.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950250+0000", 2020-11-12T17:27:02.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3710000000000002e-06 2020-11-12T17:27:02.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950258+0000", 2020-11-12T17:27:02.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.343e-06 2020-11-12T17:27:02.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950261+0000", 2020-11-12T17:27:02.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060384219999999999 2020-11-12T17:27:02.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956299+0000", 2020-11-12T17:27:02.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014742999999999999 2020-11-12T17:27:02.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956447+0000", 2020-11-12T17:27:02.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026288400000000001 2020-11-12T17:27:02.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:02.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956710+0000", 2020-11-12T17:27:02.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047596729999999999 2020-11-12T17:27:02.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961469+0000", 2020-11-12T17:27:02.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28285178999999999 2020-11-12T17:27:02.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244321+0000", 2020-11-12T17:27:02.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120733 2020-11-12T17:27:02.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244442+0000", 2020-11-12T17:27:02.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.941e-05 2020-11-12T17:27:02.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244521+0000", 2020-11-12T17:27:02.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29431180699999998 2020-11-12T17:27:02.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.172 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.173 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11902 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.173 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:02.173 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0754919210000002, 2020-11-12T17:27:02.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002, 2020-11-12T17:27:02.173 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.173 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.174 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.174 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.174 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.174 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11902 2020-11-12T17:27:02.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.174 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:02.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:02.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:02.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950968+0000", 2020-11-12T17:27:02.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022604299999999999 2020-11-12T17:27:02.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951194+0000", 2020-11-12T17:27:02.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1806e-05 2020-11-12T17:27:02.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951226+0000", 2020-11-12T17:27:02.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5761999999999999e-05 2020-11-12T17:27:02.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951241+0000", 2020-11-12T17:27:02.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006854845 2020-11-12T17:27:02.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958096+0000", 2020-11-12T17:27:02.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026652700000000002 2020-11-12T17:27:02.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958363+0000", 2020-11-12T17:27:02.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000368857 2020-11-12T17:27:02.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:02.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958732+0000", 2020-11-12T17:27:02.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027531859999999999 2020-11-12T17:27:02.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961485+0000", 2020-11-12T17:27:02.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43528204399999998 2020-11-12T17:27:02.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396767+0000", 2020-11-12T17:27:02.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015781399999999999 2020-11-12T17:27:02.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396925+0000", 2020-11-12T17:27:02.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109403 2020-11-12T17:27:02.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397034+0000", 2020-11-12T17:27:02.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002 2020-11-12T17:27:02.185 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.185 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.186 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.186 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11903 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.186 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:02.187 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0748943750000004, 2020-11-12T17:27:02.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221, 2020-11-12T17:27:02.187 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.187 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.187 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.187 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.187 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.188 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11903 2020-11-12T17:27:02.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.188 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:02.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:02.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999228 2020-11-12T17:27:02.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951566+0000", 2020-11-12T17:27:02.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024334899999999999 2020-11-12T17:27:02.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951810+0000", 2020-11-12T17:27:02.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9034e-05 2020-11-12T17:27:02.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951839+0000", 2020-11-12T17:27:02.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4151000000000001e-05 2020-11-12T17:27:02.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951853+0000", 2020-11-12T17:27:02.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081211489999999994 2020-11-12T17:27:02.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.959974+0000", 2020-11-12T17:27:02.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013490799999999999 2020-11-12T17:27:02.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960109+0000", 2020-11-12T17:27:02.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000252172 2020-11-12T17:27:02.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:02.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960361+0000", 2020-11-12T17:27:02.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024598829999999999 2020-11-12T17:27:02.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962821+0000", 2020-11-12T17:27:02.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43434482000000002 2020-11-12T17:27:02.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397166+0000", 2020-11-12T17:27:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054200000000001 2020-11-12T17:27:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397296+0000", 2020-11-12T17:27:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5556000000000005e-05 2020-11-12T17:27:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397392+0000", 2020-11-12T17:27:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221 2020-11-12T17:27:02.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11904 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:02.200 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0724312600000001, 2020-11-12T17:27:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003, 2020-11-12T17:27:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.201 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11904 2020-11-12T17:27:02.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.202 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999237 2020-11-12T17:27:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954031+0000", 2020-11-12T17:27:02.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021660900000000001 2020-11-12T17:27:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954247+0000", 2020-11-12T17:27:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4606e-05 2020-11-12T17:27:02.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954282+0000", 2020-11-12T17:27:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.552e-05 2020-11-12T17:27:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954297+0000", 2020-11-12T17:27:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0072408330000000003 2020-11-12T17:27:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961538+0000", 2020-11-12T17:27:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013512800000000001 2020-11-12T17:27:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961673+0000", 2020-11-12T17:27:02.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023430200000000001 2020-11-12T17:27:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961908+0000", 2020-11-12T17:27:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016600740000000001 2020-11-12T17:27:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963568+0000", 2020-11-12T17:27:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43393070099999997 2020-11-12T17:27:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397499+0000", 2020-11-12T17:27:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012872 2020-11-12T17:27:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397627+0000", 2020-11-12T17:27:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4786999999999999e-05 2020-11-12T17:27:02.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397722+0000", 2020-11-12T17:27:02.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003 2020-11-12T17:27:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.213 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:11901 5.d e133/127 ondisk, result = 0)", 2020-11-12T17:27:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0684013119999998, 2020-11-12T17:27:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28640288899999999, 2020-11-12T17:27:02.214 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.222 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:02.243 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:02.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:02.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:02.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958116+0000", 2020-11-12T17:27:02.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1677e-05 2020-11-12T17:27:02.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958167+0000", 2020-11-12T17:27:02.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28596560999999998 2020-11-12T17:27:02.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244133+0000", 2020-11-12T17:27:02.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2449999999999999e-05 2020-11-12T17:27:02.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244146+0000", 2020-11-12T17:27:02.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013661000000000001 2020-11-12T17:27:02.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244282+0000", 2020-11-12T17:27:02.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9877e-05 2020-11-12T17:27:02.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244302+0000", 2020-11-12T17:27:02.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000237693 2020-11-12T17:27:02.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244540+0000", 2020-11-12T17:27:02.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28640288899999999 2020-11-12T17:27:02.258 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.258 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.258 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.260 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11909 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.260 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:02.260 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0646925639999996, 2020-11-12T17:27:02.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999, 2020-11-12T17:27:02.261 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.261 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.261 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.261 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.262 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.262 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11909 2020-11-12T17:27:02.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.262 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:02.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:02.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:27:02.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961803+0000", 2020-11-12T17:27:02.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9606999999999998e-05 2020-11-12T17:27:02.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961893+0000", 2020-11-12T17:27:02.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0258000000000001e-05 2020-11-12T17:27:02.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961903+0000", 2020-11-12T17:27:02.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8450000000000003e-06 2020-11-12T17:27:02.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961911+0000", 2020-11-12T17:27:02.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00090397899999999996 2020-11-12T17:27:02.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962815+0000", 2020-11-12T17:27:02.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106487 2020-11-12T17:27:02.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962921+0000", 2020-11-12T17:27:02.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027479400000000003 2020-11-12T17:27:02.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:02.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963196+0000", 2020-11-12T17:27:02.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002806041 2020-11-12T17:27:02.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966002+0000", 2020-11-12T17:27:02.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42403797700000001 2020-11-12T17:27:02.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390040+0000", 2020-11-12T17:27:02.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017360699999999999 2020-11-12T17:27:02.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390214+0000", 2020-11-12T17:27:02.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012036600000000001 2020-11-12T17:27:02.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390334+0000", 2020-11-12T17:27:02.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999 2020-11-12T17:27:02.291 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.292 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.292 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.293 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11910 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.293 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:02.294 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0634762719999999, 2020-11-12T17:27:02.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002, 2020-11-12T17:27:02.294 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.294 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.294 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.295 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11910 2020-11-12T17:27:02.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.295 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:02.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:02.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999413 2020-11-12T17:27:02.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963003+0000", 2020-11-12T17:27:02.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017848699999999999 2020-11-12T17:27:02.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963182+0000", 2020-11-12T17:27:02.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7229000000000001e-05 2020-11-12T17:27:02.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963199+0000", 2020-11-12T17:27:02.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2609999999999999e-06 2020-11-12T17:27:02.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963208+0000", 2020-11-12T17:27:02.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089699300000000001 2020-11-12T17:27:02.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964105+0000", 2020-11-12T17:27:02.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012321200000000001 2020-11-12T17:27:02.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964228+0000", 2020-11-12T17:27:02.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022185600000000001 2020-11-12T17:27:02.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:02.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964450+0000", 2020-11-12T17:27:02.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001555697 2020-11-12T17:27:02.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966006+0000", 2020-11-12T17:27:02.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42809403299999998 2020-11-12T17:27:02.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394100+0000", 2020-11-12T17:27:02.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012522 2020-11-12T17:27:02.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394225+0000", 2020-11-12T17:27:02.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014087 2020-11-12T17:27:02.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394366+0000", 2020-11-12T17:27:02.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002 2020-11-12T17:27:02.312 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.313 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.314 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11911 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.314 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:02.314 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0632465299999998, 2020-11-12T17:27:02.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998, 2020-11-12T17:27:02.315 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.316 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.316 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.316 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.316 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.316 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11911 2020-11-12T17:27:02.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.318 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:02.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:02.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999547 2020-11-12T17:27:02.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963246+0000", 2020-11-12T17:27:02.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000132867 2020-11-12T17:27:02.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963379+0000", 2020-11-12T17:27:02.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1556000000000002e-05 2020-11-12T17:27:02.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963401+0000", 2020-11-12T17:27:02.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2499999999999997e-05 2020-11-12T17:27:02.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963433+0000", 2020-11-12T17:27:02.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018380040000000001 2020-11-12T17:27:02.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965271+0000", 2020-11-12T17:27:02.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6691000000000002e-05 2020-11-12T17:27:02.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965338+0000", 2020-11-12T17:27:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100777 2020-11-12T17:27:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965439+0000", 2020-11-12T17:27:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001679198 2020-11-12T17:27:02.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967118+0000", 2020-11-12T17:27:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.435251412 2020-11-12T17:27:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402369+0000", 2020-11-12T17:27:02.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6074000000000005e-05 2020-11-12T17:27:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402435+0000", 2020-11-12T17:27:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6678999999999997e-05 2020-11-12T17:27:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402492+0000", 2020-11-12T17:27:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998 2020-11-12T17:27:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.596 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11912 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.597 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0602185799999999, 2020-11-12T17:27:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997, 2020-11-12T17:27:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.598 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11912 2020-11-12T17:27:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966296+0000", 2020-11-12T17:27:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6765000000000002e-05 2020-11-12T17:27:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966363+0000", 2020-11-12T17:27:02.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3097e-05 2020-11-12T17:27:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966376+0000", 2020-11-12T17:27:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0669999999999998e-06 2020-11-12T17:27:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966385+0000", 2020-11-12T17:27:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7963999999999997e-05 2020-11-12T17:27:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966433+0000", 2020-11-12T17:27:02.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0263999999999998e-05 2020-11-12T17:27:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966494+0000", 2020-11-12T17:27:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120279 2020-11-12T17:27:02.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966614+0000", 2020-11-12T17:27:02.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001180424 2020-11-12T17:27:02.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967794+0000", 2020-11-12T17:27:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43476916100000002 2020-11-12T17:27:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402563+0000", 2020-11-12T17:27:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7442999999999998e-05 2020-11-12T17:27:02.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402631+0000", 2020-11-12T17:27:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8424999999999998e-05 2020-11-12T17:27:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402679+0000", 2020-11-12T17:27:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997 2020-11-12T17:27:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11913 5.d 5:b8059c51:::benchmark_data_smithi036_24110_object1489:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.8977885849999998, 2020-11-12T17:27:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26925581300000001, 2020-11-12T17:27:02.642 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11913 2020-11-12T17:27:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.643 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999523 2020-11-12T17:27:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128702+0000", 2020-11-12T17:27:02.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013552400000000001 2020-11-12T17:27:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128837+0000", 2020-11-12T17:27:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6769999999999999e-05 2020-11-12T17:27:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128864+0000", 2020-11-12T17:27:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.261e-05 2020-11-12T17:27:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128877+0000", 2020-11-12T17:27:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125313 2020-11-12T17:27:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129002+0000", 2020-11-12T17:27:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00034839700000000002 2020-11-12T17:27:02.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129350+0000", 2020-11-12T17:27:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030113699999999999 2020-11-12T17:27:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129652+0000", 2020-11-12T17:27:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022631880000000002 2020-11-12T17:27:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.131915+0000", 2020-11-12T17:27:02.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26589388400000002 2020-11-12T17:27:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397809+0000", 2020-11-12T17:27:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114862 2020-11-12T17:27:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397923+0000", 2020-11-12T17:27:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1882e-05 2020-11-12T17:27:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.398005+0000", 2020-11-12T17:27:02.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26925581300000001 2020-11-12T17:27:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.653 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:12696 5.d 5:bedc4739:::benchmark_data_smithi036_24110_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e134)", 2020-11-12T17:27:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:58.141564+0000", 2020-11-12T17:27:02.654 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.8849742389999999, 2020-11-12T17:27:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.240589469, 2020-11-12T17:27:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:02.655 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 12696 2020-11-12T17:27:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141564+0000", 2020-11-12T17:27:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141564+0000", 2020-11-12T17:27:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141516+0000", 2020-11-12T17:27:02.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013753999999999999 2020-11-12T17:27:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141653+0000", 2020-11-12T17:27:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8082999999999999e-05 2020-11-12T17:27:02.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141681+0000", 2020-11-12T17:27:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0944999999999999e-05 2020-11-12T17:27:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141692+0000", 2020-11-12T17:27:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019604420000000002 2020-11-12T17:27:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.143653+0000", 2020-11-12T17:27:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0601999999999998e-05 2020-11-12T17:27:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.143733+0000", 2020-11-12T17:27:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014270299999999999 2020-11-12T17:27:02.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.143876+0000", 2020-11-12T17:27:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020232510000000002 2020-11-12T17:27:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.145899+0000", 2020-11-12T17:27:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.236140883 2020-11-12T17:27:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382040+0000", 2020-11-12T17:27:02.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5817999999999999e-05 2020-11-12T17:27:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382106+0000", 2020-11-12T17:27:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7577999999999997e-05 2020-11-12T17:27:02.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382153+0000", 2020-11-12T17:27:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.240589469 2020-11-12T17:27:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:12696 5.d e134/127 ondisk, result = 0)", 2020-11-12T17:27:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:58.176558+0000", 2020-11-12T17:27:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.8499803539999999, 2020-11-12T17:27:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20560590300000001, 2020-11-12T17:27:02.668 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.176558+0000", 2020-11-12T17:27:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:02.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.176558+0000", 2020-11-12T17:27:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.176533+0000", 2020-11-12T17:27:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0835999999999997e-05 2020-11-12T17:27:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:02.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.176604+0000", 2020-11-12T17:27:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20375881200000001 2020-11-12T17:27:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.380363+0000", 2020-11-12T17:27:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.207e-05 2020-11-12T17:27:02.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.380375+0000", 2020-11-12T17:27:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00164839 2020-11-12T17:27:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382023+0000", 2020-11-12T17:27:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4030000000000007e-06 2020-11-12T17:27:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382032+0000", 2020-11-12T17:27:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000131874 2020-11-12T17:27:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:02.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382164+0000", 2020-11-12T17:27:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20560590300000001 2020-11-12T17:27:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:02.676 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:02.676 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:02.680 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:02.430+0000 7f7b4fea9700 -1 osd.4 137 handle_osd_map injecting map crc failure 2020-11-12T17:27:02.681 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:02.681 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:02.681 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:02.681 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:02.681 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:02.681 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:02.682 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:02.682 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:02.682 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:02.682 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:02.682 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:02.683 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:27:02.683 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 16 16 15075 15059 7.3523 5.96875 0.006407 0.0167691 2020-11-12T17:27:02.683 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:02.604+0000 7f038ead6700 -1 osd.2 137 handle_osd_map injecting map crc failure 2020-11-12T17:27:02.683 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:02.672+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:02.684 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:02.779 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:02.776+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:02.855 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:02.855 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:02.856 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:02.856 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:02.867 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:02.886 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:02.882+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:02.984 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:02.982+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:03.029 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:03.029 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:03.029 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:03.030 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:03.030 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:03.038 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:03.085 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:03.080+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:03.166 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:03.167 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:03.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:03.167 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 238.05538253399999, 2020-11-12T17:27:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 238.04829073799999, 2020-11-12T17:27:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 228.61573124099999, 2020-11-12T17:27:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:03.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:03.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 194.66561114699999, 2020-11-12T17:27:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 192.56000925500001, 2020-11-12T17:27:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 161.21352592100001, 2020-11-12T17:27:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:03.228 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 152.21768411900001, 2020-11-12T17:27:03.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:03.228 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.228 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:03.228 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:03.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:03.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:03.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:03.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:03.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:03.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:03.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:03.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:03.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:03.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:03.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:03.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:03.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:03.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:03.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:03.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:03.234 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.234 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.234 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.235 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:03.235 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:03.235 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 148.28258072, 2020-11-12T17:27:03.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:03.235 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.235 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:03.235 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:03.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:03.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:03.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:03.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:03.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:03.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:03.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:03.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:03.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:03.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:03.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:03.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:03.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:03.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:03.242 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.242 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.242 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.242 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:03.242 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:03.243 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.517940229, 2020-11-12T17:27:03.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:03.243 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.243 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:03.243 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:03.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:03.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:03.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:03.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:03.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:03.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:03.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:03.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:03.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:03.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:03.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:03.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:03.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:03.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:03.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:03.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:03.250 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.250 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.250 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.250 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:03.250 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:03.251 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.26143154499999, 2020-11-12T17:27:03.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:03.251 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.251 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.251 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.251 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:03.251 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:03.251 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:03.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.252 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:03.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:03.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:03.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:03.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:03.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:03.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:03.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:03.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:03.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:03.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:03.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:03.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:03.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:03.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:03.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:03.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:03.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:03.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:03.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:03.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:03.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:03.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:03.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:03.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:03.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:03.260 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.260 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.260 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.261 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:03.261 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:03.261 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.261269175, 2020-11-12T17:27:03.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:03.261 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.261 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.262 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.262 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:03.262 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:03.262 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:03.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.262 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:03.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:03.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:03.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:03.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:03.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:03.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:03.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:03.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:03.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:03.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:03.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:03.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:03.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:03.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:03.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:03.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:03.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:03.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:03.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:03.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:03.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:03.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:03.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:03.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:03.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:03.294 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.294 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.294 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.295 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:03.296 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:03.296 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.25270018800001, 2020-11-12T17:27:03.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:03.296 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.296 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:03.296 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:03.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:03.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:03.305 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.748187737999999, 2020-11-12T17:27:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:03.306 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:03.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:03.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:03.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:03.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.317 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.262639452000002, 2020-11-12T17:27:03.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.319 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:03.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:03.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:03.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 82.189321019999994, 2020-11-12T17:27:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:03.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:03.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:03.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.133676043999998, 2020-11-12T17:27:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.339 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:03.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:03.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:03.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:03.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:03.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:03.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.745471672999997, 2020-11-12T17:27:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 66.539014741000003, 2020-11-12T17:27:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.289809124000001, 2020-11-12T17:27:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:04.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:04.414 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:04.415 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:04.415 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:04.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.415 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:04.415 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:04.416 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.272849675000003, 2020-11-12T17:27:04.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:04.416 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:04.416 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:04.416 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:04.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:04.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:04.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:04.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:04.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:04.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:04.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:04.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:04.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:04.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:04.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:04.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:04.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:04.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:04.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:04.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:04.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:04.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:04.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:04.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:04.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:04.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:04.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:04.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:04.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:04.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:04.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:04.430 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:04.430 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:04.431 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:04.431 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:04.431 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:04.431 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:04.433 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:04.406+0000 7f7b4fea9700 -1 osd.4 139 handle_osd_map injecting map crc failure 2020-11-12T17:27:04.433 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:03.404+0000 7f4dea6fe700 -1 osd.1 138 handle_osd_map injecting map crc failure 2020-11-12T17:27:04.434 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:03.408+0000 7f038ead6700 -1 osd.2 138 handle_osd_map injecting map crc failure 2020-11-12T17:27:04.434 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:04.428+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:04.434 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 17 16 16091 16075 7.38667 7.9375 0.00378673 0.0168302 2020-11-12T17:27:04.435 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:04.535 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:04.530+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:04.557 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 18 16 16327 16311 7.07873 1.84375 0.00667341 0.017636 2020-11-12T17:27:04.606 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:04.606 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:04.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:16264 5.0 5:0cbac428:::benchmark_data_smithi036_24110_object2032:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e140)", 2020-11-12T17:27:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:04.511635+0000", 2020-11-12T17:27:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.093247756000000001, 2020-11-12T17:27:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093282397000000003, 2020-11-12T17:27:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 16264 2020-11-12T17:27:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.511635+0000", 2020-11-12T17:27:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.511635+0000", 2020-11-12T17:27:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:27:04.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.511613+0000", 2020-11-12T17:27:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7130000000000003e-05 2020-11-12T17:27:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.511681+0000", 2020-11-12T17:27:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7980000000000006e-06 2020-11-12T17:27:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.511688+0000", 2020-11-12T17:27:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9879999999999998e-06 2020-11-12T17:27:04.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:04.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.511692+0000", 2020-11-12T17:27:04.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0075353829999999997 2020-11-12T17:27:04.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.519228+0000", 2020-11-12T17:27:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013361300000000001 2020-11-12T17:27:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.519361+0000", 2020-11-12T17:27:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000291243 2020-11-12T17:27:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.519653+0000", 2020-11-12T17:27:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017246710000000001 2020-11-12T17:27:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.521377+0000", 2020-11-12T17:27:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0097424439999999994 2020-11-12T17:27:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:04.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:04.621 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:04.621 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 1 2020-11-12T17:27:04.621 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:04.621 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:04.621 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:04.622 INFO:tasks.thrashosds.thrasher:inject_pause on 6 2020-11-12T17:27:04.630 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-12T17:27:04.631 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-12T17:27:04.631 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2020-11-12T17:27:04.633 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:04.683 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:04.684 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:27:04.685 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:04.682+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:04.737 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:04.734+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:04.746 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:04.746 INFO:teuthology.orchestra.run.smithi205.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2020-11-12T17:27:04.746 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:04.768 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:04.768 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:04.769 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:04.782 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:04.853 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:04.855 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:04.848+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:04.885 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:04.925 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:04.938 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:04.932+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:04.967 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:04.968 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:04.969 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:04.979 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:04.999 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:05.028 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:05.040 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:05.038+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:05.066 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:05.099 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:05.099 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:05.100 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:05.100 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:05.101 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:05.101 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:05.101 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:05.101 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:05.101 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:05.101 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:05.101 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:05.111 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:05.166 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:05.160+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:05.242 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:05.236+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:05.290 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:05.290 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:05.304 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:05.343 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:05.340+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:05.426 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:05.427 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:05.437 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:05.489 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:05.482+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:05.546 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:05.542+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:05.556 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 19 16 17453 17437 7.16911 8.79688 0.00670153 0.0174082 2020-11-12T17:27:05.561 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:05.562 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:05.574 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:05.633 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:27:05.633 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:05.628+0000 7f038ead6700 -1 osd.2 140 handle_osd_map injecting map crc failure 2020-11-12T17:27:05.649 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:05.640+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:05.744 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:05.745 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:05.748 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:05.744+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:05.753 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:05.848 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:05.846+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:05.886 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:05.887 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:05.899 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:05.993 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:05.990+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:06.052 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:06.050+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:06.061 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:06.061 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:06.071 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:06.164 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:06.162+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:06.247 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:06.247 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:06.263 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:06.264 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:06.252+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:06.358 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:06.354+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:06.419 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:06.420 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:06.431 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:06.459 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:06.452+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:06.556 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:27:06.557000+0000 min lat: 0.00209322 max lat: 2.20267 avg lat: 0.0174385 2020-11-12T17:27:06.557 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:27:06.557 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 20 16 18313 18297 7.14657 6.71875 0.0380294 0.0174385 2020-11-12T17:27:06.561 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:06.556+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:06.591 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:06.591 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:06.602 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:06.660 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:06.658+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:06.716 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:06.717 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:06.727 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:06.767 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:06.766+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:06.862 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:06.858+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:06.899 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:06.900 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:06.912 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:06.963 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:06.962+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:07.036 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:07.036 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:07.047 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:07.091 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:07.088+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:07.117 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:07.165 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:07.160+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:07.183 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:07.184 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:07.195 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:07.281 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:07.282 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:07.276+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:07.312 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:07.345 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:07.367 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:07.364+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:07.370 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.7 115/114 [PushOp(4:e3922283:::benchmark_data_smithi036_18856_object1489:head, version: 74'760, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:e3922283:::benchmark_data_smithi036_18856_object1489:head@74'760, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:26.305572+0000", 2020-11-12T17:27:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.061166278000002, 2020-11-12T17:27:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23974263300000001, 2020-11-12T17:27:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.305572+0000", 2020-11-12T17:27:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.305572+0000", 2020-11-12T17:27:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.305548+0000", 2020-11-12T17:27:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109008 2020-11-12T17:27:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.305657+0000", 2020-11-12T17:27:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23570945500000001 2020-11-12T17:27:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.541366+0000", 2020-11-12T17:27:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8312999999999999e-05 2020-11-12T17:27:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.541384+0000", 2020-11-12T17:27:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012287999999999999 2020-11-12T17:27:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.541507+0000", 2020-11-12T17:27:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3642000000000001e-05 2020-11-12T17:27:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.541521+0000", 2020-11-12T17:27:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037936810000000001 2020-11-12T17:27:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.545315+0000", 2020-11-12T17:27:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23974263300000001 2020-11-12T17:27:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79390 4.6 4:6b9a5644:::benchmark_data_smithi036_18856_object3001:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.783961+0000", 2020-11-12T17:27:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.582777401000001, 2020-11-12T17:27:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20911914700000001, 2020-11-12T17:27:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79390 2020-11-12T17:27:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783961+0000", 2020-11-12T17:27:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783961+0000", 2020-11-12T17:27:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783943+0000", 2020-11-12T17:27:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9338000000000002e-05 2020-11-12T17:27:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783982+0000", 2020-11-12T17:27:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8519999999999993e-06 2020-11-12T17:27:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783991+0000", 2020-11-12T17:27:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9230000000000001e-06 2020-11-12T17:27:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783996+0000", 2020-11-12T17:27:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002089259 2020-11-12T17:27:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786085+0000", 2020-11-12T17:27:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8379000000000001e-05 2020-11-12T17:27:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786184+0000", 2020-11-12T17:27:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10086397499999999 2020-11-12T17:27:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.887048+0000", 2020-11-12T17:27:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001011709 2020-11-12T17:27:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.888059+0000", 2020-11-12T17:27:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014209929 2020-11-12T17:27:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.902269+0000", 2020-11-12T17:27:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00093186099999999997 2020-11-12T17:27:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.903201+0000", 2020-11-12T17:27:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.062629629000000006 2020-11-12T17:27:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.965831+0000", 2020-11-12T17:27:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00088726099999999997 2020-11-12T17:27:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.966718+0000", 2020-11-12T17:27:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041800530000000004 2020-11-12T17:27:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.970898+0000", 2020-11-12T17:27:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0074384259999999997 2020-11-12T17:27:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.978337+0000", 2020-11-12T17:27:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01159206 2020-11-12T17:27:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.989929+0000", 2020-11-12T17:27:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000483497 2020-11-12T17:27:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.990412+0000", 2020-11-12T17:27:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026678190000000001 2020-11-12T17:27:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.993080+0000", 2020-11-12T17:27:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20911914700000001 2020-11-12T17:27:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79391 4.6 4:6e7dc729:::benchmark_data_smithi036_18856_object3002:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784034+0000", 2020-11-12T17:27:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.582703752999997, 2020-11-12T17:27:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26640469999999999, 2020-11-12T17:27:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79391 2020-11-12T17:27:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784034+0000", 2020-11-12T17:27:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784034+0000", 2020-11-12T17:27:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999843 2020-11-12T17:27:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784019+0000", 2020-11-12T17:27:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4554999999999997e-05 2020-11-12T17:27:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784053+0000", 2020-11-12T17:27:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7169999999999996e-06 2020-11-12T17:27:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784059+0000", 2020-11-12T17:27:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8339999999999999e-06 2020-11-12T17:27:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784062+0000", 2020-11-12T17:27:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002235192 2020-11-12T17:27:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786297+0000", 2020-11-12T17:27:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4545999999999999e-05 2020-11-12T17:27:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786392+0000", 2020-11-12T17:27:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.109122783 2020-11-12T17:27:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.895515+0000", 2020-11-12T17:27:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010120229999999999 2020-11-12T17:27:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.896527+0000", 2020-11-12T17:27:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014502137 2020-11-12T17:27:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.911029+0000", 2020-11-12T17:27:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058240500000000003 2020-11-12T17:27:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.911611+0000", 2020-11-12T17:27:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.085697619000000003 2020-11-12T17:27:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.997309+0000", 2020-11-12T17:27:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00056207399999999997 2020-11-12T17:27:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.997871+0000", 2020-11-12T17:27:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015531010000000001 2020-11-12T17:27:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.999424+0000", 2020-11-12T17:27:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.018730159 2020-11-12T17:27:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.018154+0000", 2020-11-12T17:27:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.030326388999999999 2020-11-12T17:27:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048480+0000", 2020-11-12T17:27:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000470428 2020-11-12T17:27:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048951+0000", 2020-11-12T17:27:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001488243 2020-11-12T17:27:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.050439+0000", 2020-11-12T17:27:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26640469999999999 2020-11-12T17:27:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79397 4.6 4:6825e0e9:::benchmark_data_smithi036_18856_object3008:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784088+0000", 2020-11-12T17:27:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.582650074, 2020-11-12T17:27:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27021019000000002, 2020-11-12T17:27:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79397 2020-11-12T17:27:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784088+0000", 2020-11-12T17:27:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784088+0000", 2020-11-12T17:27:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784072+0000", 2020-11-12T17:27:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6395e-05 2020-11-12T17:27:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784108+0000", 2020-11-12T17:27:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3360000000000002e-06 2020-11-12T17:27:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784113+0000", 2020-11-12T17:27:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5739999999999998e-06 2020-11-12T17:27:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784116+0000", 2020-11-12T17:27:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023870150000000001 2020-11-12T17:27:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786503+0000", 2020-11-12T17:27:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6372000000000006e-05 2020-11-12T17:27:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786589+0000", 2020-11-12T17:27:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12705815400000001 2020-11-12T17:27:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.913647+0000", 2020-11-12T17:27:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00084020999999999998 2020-11-12T17:27:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.914488+0000", 2020-11-12T17:27:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0073717599999999998 2020-11-12T17:27:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.921859+0000", 2020-11-12T17:27:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00053059299999999999 2020-11-12T17:27:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.922390+0000", 2020-11-12T17:27:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086459424000000007 2020-11-12T17:27:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.008849+0000", 2020-11-12T17:27:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016892280000000001 2020-11-12T17:27:07.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.010539+0000", 2020-11-12T17:27:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014236769999999999 2020-11-12T17:27:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.011962+0000", 2020-11-12T17:27:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015307659 2020-11-12T17:27:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.027270+0000", 2020-11-12T17:27:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.023527362999999999 2020-11-12T17:27:07.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.050797+0000", 2020-11-12T17:27:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00031991399999999997 2020-11-12T17:27:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.051117+0000", 2020-11-12T17:27:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003181105 2020-11-12T17:27:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.054298+0000", 2020-11-12T17:27:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27021019000000002 2020-11-12T17:27:07.424 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79399 4.6 4:68f1ef91:::benchmark_data_smithi036_18856_object3010:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784141+0000", 2020-11-12T17:27:07.425 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.582596952000003, 2020-11-12T17:27:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27249312599999997, 2020-11-12T17:27:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79399 2020-11-12T17:27:07.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784141+0000", 2020-11-12T17:27:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784141+0000", 2020-11-12T17:27:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:27:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784125+0000", 2020-11-12T17:27:07.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4362000000000001e-05 2020-11-12T17:27:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784159+0000", 2020-11-12T17:27:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1970000000000004e-06 2020-11-12T17:27:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784164+0000", 2020-11-12T17:27:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4090000000000001e-06 2020-11-12T17:27:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784167+0000", 2020-11-12T17:27:07.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025213670000000001 2020-11-12T17:27:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786688+0000", 2020-11-12T17:27:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2043e-05 2020-11-12T17:27:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786770+0000", 2020-11-12T17:27:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12782432899999999 2020-11-12T17:27:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.914595+0000", 2020-11-12T17:27:07.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00077399200000000004 2020-11-12T17:27:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.915369+0000", 2020-11-12T17:27:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012468406 2020-11-12T17:27:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.927837+0000", 2020-11-12T17:27:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000573961 2020-11-12T17:27:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.928411+0000", 2020-11-12T17:27:07.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.089901977999999994 2020-11-12T17:27:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.018313+0000", 2020-11-12T17:27:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00084238599999999998 2020-11-12T17:27:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.019155+0000", 2020-11-12T17:27:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001500312 2020-11-12T17:27:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.020656+0000", 2020-11-12T17:27:07.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.019130365 2020-11-12T17:27:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.039786+0000", 2020-11-12T17:27:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014855834 2020-11-12T17:27:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.054642+0000", 2020-11-12T17:27:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000408148 2020-11-12T17:27:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.055050+0000", 2020-11-12T17:27:07.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015843439999999999 2020-11-12T17:27:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.056634+0000", 2020-11-12T17:27:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27249312599999997 2020-11-12T17:27:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.439 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79403 4.6 4:6e007c0e:::benchmark_data_smithi036_18856_object3014:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784192+0000", 2020-11-12T17:27:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.582546004000001, 2020-11-12T17:27:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27453512099999999, 2020-11-12T17:27:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.440 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79403 2020-11-12T17:27:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784192+0000", 2020-11-12T17:27:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784192+0000", 2020-11-12T17:27:07.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:27:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784176+0000", 2020-11-12T17:27:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4178999999999999e-05 2020-11-12T17:27:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784210+0000", 2020-11-12T17:27:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2920000000000003e-06 2020-11-12T17:27:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784215+0000", 2020-11-12T17:27:07.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5140000000000002e-06 2020-11-12T17:27:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784219+0000", 2020-11-12T17:27:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026573870000000002 2020-11-12T17:27:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786876+0000", 2020-11-12T17:27:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9260999999999998e-05 2020-11-12T17:27:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786965+0000", 2020-11-12T17:27:07.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12850199800000001 2020-11-12T17:27:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.915467+0000", 2020-11-12T17:27:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00085655900000000001 2020-11-12T17:27:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.916324+0000", 2020-11-12T17:27:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016789193000000001 2020-11-12T17:27:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.933113+0000", 2020-11-12T17:27:07.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00061463999999999996 2020-11-12T17:27:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.933728+0000", 2020-11-12T17:27:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093685151999999994 2020-11-12T17:27:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.027413+0000", 2020-11-12T17:27:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00082315199999999995 2020-11-12T17:27:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.028236+0000", 2020-11-12T17:27:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001283649 2020-11-12T17:27:07.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.029520+0000", 2020-11-12T17:27:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.018622367000000001 2020-11-12T17:27:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048142+0000", 2020-11-12T17:27:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088035240000000001 2020-11-12T17:27:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.056946+0000", 2020-11-12T17:27:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047613199999999999 2020-11-12T17:27:07.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.057422+0000", 2020-11-12T17:27:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001305481 2020-11-12T17:27:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.058727+0000", 2020-11-12T17:27:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27453512099999999 2020-11-12T17:27:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79413 4.6 4:67cb455f:::benchmark_data_smithi036_18856_object3024:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:27:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.582487858, 2020-11-12T17:27:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27681071899999998, 2020-11-12T17:27:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79413 2020-11-12T17:27:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:27:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:27:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:07.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784228+0000", 2020-11-12T17:27:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3021e-05 2020-11-12T17:27:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784271+0000", 2020-11-12T17:27:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8409999999999995e-06 2020-11-12T17:27:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784280+0000", 2020-11-12T17:27:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6380000000000003e-06 2020-11-12T17:27:07.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784285+0000", 2020-11-12T17:27:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027973920000000001 2020-11-12T17:27:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787083+0000", 2020-11-12T17:27:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7495000000000001e-05 2020-11-12T17:27:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787180+0000", 2020-11-12T17:27:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12926628300000001 2020-11-12T17:27:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.916446+0000", 2020-11-12T17:27:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00093402899999999996 2020-11-12T17:27:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:07.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.917380+0000", 2020-11-12T17:27:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020407538999999999 2020-11-12T17:27:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.937788+0000", 2020-11-12T17:27:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000401386 2020-11-12T17:27:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.938189+0000", 2020-11-12T17:27:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.097742617000000004 2020-11-12T17:27:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.035932+0000", 2020-11-12T17:27:07.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00070456200000000005 2020-11-12T17:27:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.036636+0000", 2020-11-12T17:27:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001004916 2020-11-12T17:27:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.037641+0000", 2020-11-12T17:27:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012882807 2020-11-12T17:27:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.050524+0000", 2020-11-12T17:27:07.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084925529999999999 2020-11-12T17:27:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.059017+0000", 2020-11-12T17:27:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041484399999999999 2020-11-12T17:27:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.059432+0000", 2020-11-12T17:27:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016295210000000001 2020-11-12T17:27:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061061+0000", 2020-11-12T17:27:07.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27681071899999998 2020-11-12T17:27:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79414 4.6 4:60cd86ce:::benchmark_data_smithi036_18856_object3025:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:27:07.469 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.582411393999998, 2020-11-12T17:27:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998, 2020-11-12T17:27:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79414 2020-11-12T17:27:07.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:27:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:27:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:27:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784303+0000", 2020-11-12T17:27:07.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4221999999999997e-05 2020-11-12T17:27:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784358+0000", 2020-11-12T17:27:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8389999999999996e-06 2020-11-12T17:27:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784366+0000", 2020-11-12T17:27:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2040000000000002e-06 2020-11-12T17:27:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784370+0000", 2020-11-12T17:27:07.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029216049999999999 2020-11-12T17:27:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787291+0000", 2020-11-12T17:27:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3842e-05 2020-11-12T17:27:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787385+0000", 2020-11-12T17:27:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15210379399999999 2020-11-12T17:27:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.939489+0000", 2020-11-12T17:27:07.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00095422699999999998 2020-11-12T17:27:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940443+0000", 2020-11-12T17:27:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092951600000000002 2020-11-12T17:27:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.949738+0000", 2020-11-12T17:27:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00060685800000000005 2020-11-12T17:27:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.950345+0000", 2020-11-12T17:27:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093005117999999998 2020-11-12T17:27:07.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.043350+0000", 2020-11-12T17:27:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001029147 2020-11-12T17:27:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.044379+0000", 2020-11-12T17:27:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001543397 2020-11-12T17:27:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045923+0000", 2020-11-12T17:27:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015442345999999999 2020-11-12T17:27:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061365+0000", 2020-11-12T17:27:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0095990889999999999 2020-11-12T17:27:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.070964+0000", 2020-11-12T17:27:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000446744 2020-11-12T17:27:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.071411+0000", 2020-11-12T17:27:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001655534 2020-11-12T17:27:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.073066+0000", 2020-11-12T17:27:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998 2020-11-12T17:27:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79425 4.6 4:6231d6c2:::benchmark_data_smithi036_18856_object3036:head [delete] snapc 0=[] ondisk+write+known_if_redirected e118)", 2020-11-12T17:27:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:27:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.582337897999999, 2020-11-12T17:27:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002, 2020-11-12T17:27:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.484 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79425 2020-11-12T17:27:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:27:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:27:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784379+0000", 2020-11-12T17:27:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6152000000000001e-05 2020-11-12T17:27:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784426+0000", 2020-11-12T17:27:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6860000000000003e-06 2020-11-12T17:27:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784431+0000", 2020-11-12T17:27:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6460000000000002e-06 2020-11-12T17:27:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784434+0000", 2020-11-12T17:27:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030643549999999999 2020-11-12T17:27:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787498+0000", 2020-11-12T17:27:07.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100717 2020-11-12T17:27:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787599+0000", 2020-11-12T17:27:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15298814699999999 2020-11-12T17:27:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940587+0000", 2020-11-12T17:27:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00097205100000000003 2020-11-12T17:27:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.941559+0000", 2020-11-12T17:27:07.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.019466477999999999 2020-11-12T17:27:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961026+0000", 2020-11-12T17:27:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058434100000000005 2020-11-12T17:27:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961610+0000", 2020-11-12T17:27:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13222599700000001 2020-11-12T17:27:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.093836+0000", 2020-11-12T17:27:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089939299999999996 2020-11-12T17:27:07.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.094735+0000", 2020-11-12T17:27:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001382973 2020-11-12T17:27:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.096118+0000", 2020-11-12T17:27:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046953350000000001 2020-11-12T17:27:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100814+0000", 2020-11-12T17:27:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9295000000000006e-05 2020-11-12T17:27:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100893+0000", 2020-11-12T17:27:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00035136400000000001 2020-11-12T17:27:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.101244+0000", 2020-11-12T17:27:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015508290000000001 2020-11-12T17:27:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.102795+0000", 2020-11-12T17:27:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002 2020-11-12T17:27:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79401 4.4 4:25438865:::benchmark_data_smithi036_18856_object3012:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e119)", 2020-11-12T17:27:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.857685+0000", 2020-11-12T17:27:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.509053375000001, 2020-11-12T17:27:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.187629875, 2020-11-12T17:27:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79401 2020-11-12T17:27:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857685+0000", 2020-11-12T17:27:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857685+0000", 2020-11-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857654+0000", 2020-11-12T17:27:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3609999999999995e-05 2020-11-12T17:27:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857728+0000", 2020-11-12T17:27:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3895e-05 2020-11-12T17:27:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857742+0000", 2020-11-12T17:27:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4590000000000003e-06 2020-11-12T17:27:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857748+0000", 2020-11-12T17:27:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013889449999999999 2020-11-12T17:27:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859137+0000", 2020-11-12T17:27:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1497999999999998e-05 2020-11-12T17:27:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859219+0000", 2020-11-12T17:27:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13087527900000001 2020-11-12T17:27:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.990094+0000", 2020-11-12T17:27:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030763769999999999 2020-11-12T17:27:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.993171+0000", 2020-11-12T17:27:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013953699999999999 2020-11-12T17:27:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.007124+0000", 2020-11-12T17:27:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028362610000000001 2020-11-12T17:27:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.009960+0000", 2020-11-12T17:27:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013466579999999999 2020-11-12T17:27:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.011307+0000", 2020-11-12T17:27:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.021019012 2020-11-12T17:27:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.032326+0000", 2020-11-12T17:27:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010007744000000001 2020-11-12T17:27:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.042334+0000", 2020-11-12T17:27:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000521029 2020-11-12T17:27:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.042855+0000", 2020-11-12T17:27:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00245978 2020-11-12T17:27:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045315+0000", 2020-11-12T17:27:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.187629875 2020-11-12T17:27:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79416 4.4 4:22d6f45f:::benchmark_data_smithi036_18856_object3027:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e119)", 2020-11-12T17:27:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.857799+0000", 2020-11-12T17:27:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.508939687000002, 2020-11-12T17:27:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19034758600000001, 2020-11-12T17:27:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79416 2020-11-12T17:27:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857799+0000", 2020-11-12T17:27:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857799+0000", 2020-11-12T17:27:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857769+0000", 2020-11-12T17:27:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4016999999999994e-05 2020-11-12T17:27:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857833+0000", 2020-11-12T17:27:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9969999999999999e-05 2020-11-12T17:27:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857863+0000", 2020-11-12T17:27:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2389999999999996e-06 2020-11-12T17:27:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857871+0000", 2020-11-12T17:27:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014463119999999999 2020-11-12T17:27:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859317+0000", 2020-11-12T17:27:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5130000000000007e-05 2020-11-12T17:27:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859402+0000", 2020-11-12T17:27:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13559057499999999 2020-11-12T17:27:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.994993+0000", 2020-11-12T17:27:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029052150000000001 2020-11-12T17:27:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.997898+0000", 2020-11-12T17:27:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.025284017999999998 2020-11-12T17:27:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.023182+0000", 2020-11-12T17:27:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00081558499999999996 2020-11-12T17:27:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.023997+0000", 2020-11-12T17:27:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001639794 2020-11-12T17:27:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.025637+0000", 2020-11-12T17:27:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016307182999999999 2020-11-12T17:27:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.041944+0000", 2020-11-12T17:27:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036568350000000002 2020-11-12T17:27:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045601+0000", 2020-11-12T17:27:07.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058173000000000003 2020-11-12T17:27:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.046183+0000", 2020-11-12T17:27:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019631929999999998 2020-11-12T17:27:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048146+0000", 2020-11-12T17:27:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19034758600000001 2020-11-12T17:27:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.524 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79418 4.4 4:2df6bf66:::benchmark_data_smithi036_18856_object3029:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e119)", 2020-11-12T17:27:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.857920+0000", 2020-11-12T17:27:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.508818038999998, 2020-11-12T17:27:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19827366399999999, 2020-11-12T17:27:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79418 2020-11-12T17:27:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857920+0000", 2020-11-12T17:27:07.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857920+0000", 2020-11-12T17:27:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857891+0000", 2020-11-12T17:27:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7623e-05 2020-11-12T17:27:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857959+0000", 2020-11-12T17:27:07.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.146e-05 2020-11-12T17:27:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857970+0000", 2020-11-12T17:27:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0939999999999998e-06 2020-11-12T17:27:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857975+0000", 2020-11-12T17:27:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015305290000000001 2020-11-12T17:27:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859506+0000", 2020-11-12T17:27:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102643 2020-11-12T17:27:07.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859608+0000", 2020-11-12T17:27:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13842854099999999 2020-11-12T17:27:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.998037+0000", 2020-11-12T17:27:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003550189 2020-11-12T17:27:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.001587+0000", 2020-11-12T17:27:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.030874755 2020-11-12T17:27:07.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.032462+0000", 2020-11-12T17:27:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055100779999999999 2020-11-12T17:27:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.037972+0000", 2020-11-12T17:27:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001166217 2020-11-12T17:27:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.039138+0000", 2020-11-12T17:27:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0094076539999999997 2020-11-12T17:27:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048546+0000", 2020-11-12T17:27:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028954509999999998 2020-11-12T17:27:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.051441+0000", 2020-11-12T17:27:07.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00040610400000000001 2020-11-12T17:27:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.051847+0000", 2020-11-12T17:27:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0043465910000000003 2020-11-12T17:27:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.056194+0000", 2020-11-12T17:27:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19827366399999999 2020-11-12T17:27:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79428 4.4 4:22bf5a49:::benchmark_data_smithi036_18856_object3039:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858023+0000", 2020-11-12T17:27:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.508715355, 2020-11-12T17:27:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24856752300000001, 2020-11-12T17:27:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.538 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79428 2020-11-12T17:27:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858023+0000", 2020-11-12T17:27:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858023+0000", 2020-11-12T17:27:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857994+0000", 2020-11-12T17:27:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5454e-05 2020-11-12T17:27:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858059+0000", 2020-11-12T17:27:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0309000000000001e-05 2020-11-12T17:27:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858069+0000", 2020-11-12T17:27:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4179999999999999e-06 2020-11-12T17:27:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858074+0000", 2020-11-12T17:27:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00164905 2020-11-12T17:27:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859723+0000", 2020-11-12T17:27:07.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060600000000001 2020-11-12T17:27:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859824+0000", 2020-11-12T17:27:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18886477099999999 2020-11-12T17:27:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048688+0000", 2020-11-12T17:27:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002647969 2020-11-12T17:27:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.051336+0000", 2020-11-12T17:27:07.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013767546 2020-11-12T17:27:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.065104+0000", 2020-11-12T17:27:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00077796699999999996 2020-11-12T17:27:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.065882+0000", 2020-11-12T17:27:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022998379999999998 2020-11-12T17:27:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.068182+0000", 2020-11-12T17:27:07.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010604894 2020-11-12T17:27:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.078787+0000", 2020-11-12T17:27:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.025585614 2020-11-12T17:27:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.104372+0000", 2020-11-12T17:27:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047144999999999999 2020-11-12T17:27:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.104844+0000", 2020-11-12T17:27:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017467990000000001 2020-11-12T17:27:07.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.106590+0000", 2020-11-12T17:27:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24856752300000001 2020-11-12T17:27:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79432 4.4 4:250eda9c:::benchmark_data_smithi036_18856_object3043:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858121+0000", 2020-11-12T17:27:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.508617498, 2020-11-12T17:27:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.261755611, 2020-11-12T17:27:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.551 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79432 2020-11-12T17:27:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858121+0000", 2020-11-12T17:27:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858121+0000", 2020-11-12T17:27:07.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858092+0000", 2020-11-12T17:27:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5640000000000002e-05 2020-11-12T17:27:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858157+0000", 2020-11-12T17:27:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1080999999999999e-05 2020-11-12T17:27:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858169+0000", 2020-11-12T17:27:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3159999999999998e-06 2020-11-12T17:27:07.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858173+0000", 2020-11-12T17:27:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017682209999999999 2020-11-12T17:27:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859941+0000", 2020-11-12T17:27:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010119 2020-11-12T17:27:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860042+0000", 2020-11-12T17:27:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19624609100000001 2020-11-12T17:27:07.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.056288+0000", 2020-11-12T17:27:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022598779999999999 2020-11-12T17:27:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.058548+0000", 2020-11-12T17:27:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020361628999999999 2020-11-12T17:27:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.078910+0000", 2020-11-12T17:27:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034346630000000001 2020-11-12T17:27:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.082345+0000", 2020-11-12T17:27:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001544704 2020-11-12T17:27:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.083889+0000", 2020-11-12T17:27:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.022802319000000001 2020-11-12T17:27:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.106692+0000", 2020-11-12T17:27:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010718955 2020-11-12T17:27:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.117410+0000", 2020-11-12T17:27:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00050719000000000003 2020-11-12T17:27:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.117918+0000", 2020-11-12T17:27:07.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019586249999999999 2020-11-12T17:27:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.119876+0000", 2020-11-12T17:27:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.261755611 2020-11-12T17:27:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.563 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79476 4.4 4:281d6804:::benchmark_data_smithi036_18856_object3087:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858220+0000", 2020-11-12T17:27:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.508518557000002, 2020-11-12T17:27:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26431898999999998, 2020-11-12T17:27:07.564 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79476 2020-11-12T17:27:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858220+0000", 2020-11-12T17:27:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858220+0000", 2020-11-12T17:27:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:27:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858190+0000", 2020-11-12T17:27:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3869999999999997e-05 2020-11-12T17:27:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858254+0000", 2020-11-12T17:27:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6199999999999994e-06 2020-11-12T17:27:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858264+0000", 2020-11-12T17:27:07.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2080000000000002e-06 2020-11-12T17:27:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858268+0000", 2020-11-12T17:27:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001939681 2020-11-12T17:27:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860208+0000", 2020-11-12T17:27:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1810999999999994e-05 2020-11-12T17:27:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860279+0000", 2020-11-12T17:27:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19839869500000001 2020-11-12T17:27:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.058678+0000", 2020-11-12T17:27:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026451830000000002 2020-11-12T17:27:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061323+0000", 2020-11-12T17:27:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.030355449999999999 2020-11-12T17:27:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.091679+0000", 2020-11-12T17:27:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094524599999999996 2020-11-12T17:27:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.092624+0000", 2020-11-12T17:27:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015080009999999999 2020-11-12T17:27:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.094132+0000", 2020-11-12T17:27:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.026341926000000002 2020-11-12T17:27:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.120474+0000", 2020-11-12T17:27:07.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5223999999999995e-05 2020-11-12T17:27:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.120569+0000", 2020-11-12T17:27:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00048331399999999999 2020-11-12T17:27:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.121053+0000", 2020-11-12T17:27:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001486102 2020-11-12T17:27:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.122539+0000", 2020-11-12T17:27:07.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26431898999999998 2020-11-12T17:27:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79478 4.4 4:29d6f2d6:::benchmark_data_smithi036_18856_object3089:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858314+0000", 2020-11-12T17:27:07.577 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.508424046999998, 2020-11-12T17:27:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26647947500000002, 2020-11-12T17:27:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.578 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79478 2020-11-12T17:27:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858314+0000", 2020-11-12T17:27:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858314+0000", 2020-11-12T17:27:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858285+0000", 2020-11-12T17:27:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3604999999999998e-05 2020-11-12T17:27:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858349+0000", 2020-11-12T17:27:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2490000000000007e-06 2020-11-12T17:27:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858358+0000", 2020-11-12T17:27:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6120000000000001e-06 2020-11-12T17:27:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858363+0000", 2020-11-12T17:27:07.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001992359 2020-11-12T17:27:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860355+0000", 2020-11-12T17:27:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2812999999999996e-05 2020-11-12T17:27:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860428+0000", 2020-11-12T17:27:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21104400300000001 2020-11-12T17:27:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.071472+0000", 2020-11-12T17:27:07.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034313009999999999 2020-11-12T17:27:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.074903+0000", 2020-11-12T17:27:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.036768064000000003 2020-11-12T17:27:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.111671+0000", 2020-11-12T17:27:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000935147 2020-11-12T17:27:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.112606+0000", 2020-11-12T17:27:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012937140000000001 2020-11-12T17:27:07.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.113900+0000", 2020-11-12T17:27:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088719909999999992 2020-11-12T17:27:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.122772+0000", 2020-11-12T17:27:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8303e-05 2020-11-12T17:27:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.122841+0000", 2020-11-12T17:27:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00033598699999999999 2020-11-12T17:27:07.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.123176+0000", 2020-11-12T17:27:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016171390000000001 2020-11-12T17:27:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.124794+0000", 2020-11-12T17:27:07.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26647947500000002 2020-11-12T17:27:07.591 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79491 4.4 4:2feb571e:::benchmark_data_smithi036_18856_object3102:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:27:07.592 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.508325972000002, 2020-11-12T17:27:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458, 2020-11-12T17:27:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.593 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79491 2020-11-12T17:27:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:27:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:27:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858382+0000", 2020-11-12T17:27:07.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8493999999999998e-05 2020-11-12T17:27:07.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858450+0000", 2020-11-12T17:27:07.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:27:07.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858460+0000", 2020-11-12T17:27:07.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5260000000000004e-06 2020-11-12T17:27:07.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858465+0000", 2020-11-12T17:27:07.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002042622 2020-11-12T17:27:07.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860507+0000", 2020-11-12T17:27:07.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5987000000000003e-05 2020-11-12T17:27:07.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:07.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860583+0000", 2020-11-12T17:27:07.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.264296631 2020-11-12T17:27:07.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.124880+0000", 2020-11-12T17:27:07.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00260079 2020-11-12T17:27:07.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.127481+0000", 2020-11-12T17:27:07.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015473191000000001 2020-11-12T17:27:07.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.142954+0000", 2020-11-12T17:27:07.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068121100000000003 2020-11-12T17:27:07.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.143635+0000", 2020-11-12T17:27:07.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014373840000000001 2020-11-12T17:27:07.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.145073+0000", 2020-11-12T17:27:07.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020755122000000001 2020-11-12T17:27:07.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.165828+0000", 2020-11-12T17:27:07.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047732520000000004 2020-11-12T17:27:07.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.170601+0000", 2020-11-12T17:27:07.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00046765100000000003 2020-11-12T17:27:07.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.171069+0000", 2020-11-12T17:27:07.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018080010000000001 2020-11-12T17:27:07.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.172877+0000", 2020-11-12T17:27:07.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458 2020-11-12T17:27:07.605 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.605 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.605 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.606 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79752 4.4 4:2d290635:::benchmark_data_smithi036_18856_object3363:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:07.606 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:31.404861+0000", 2020-11-12T17:27:07.606 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 35.961876752000002, 2020-11-12T17:27:07.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18112254999999999, 2020-11-12T17:27:07.606 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.607 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.607 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.607 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:07.607 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:07.607 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79752 2020-11-12T17:27:07.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.607 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.404861+0000", 2020-11-12T17:27:07.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.404861+0000", 2020-11-12T17:27:07.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:27:07.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.404833+0000", 2020-11-12T17:27:07.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2961999999999998e-05 2020-11-12T17:27:07.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.404896+0000", 2020-11-12T17:27:07.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0815000000000001e-05 2020-11-12T17:27:07.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.404907+0000", 2020-11-12T17:27:07.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4530000000000001e-06 2020-11-12T17:27:07.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.404913+0000", 2020-11-12T17:27:07.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.121890463 2020-11-12T17:27:07.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.526803+0000", 2020-11-12T17:27:07.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0058404599999999996 2020-11-12T17:27:07.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:07.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.532644+0000", 2020-11-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.025476233000000001 2020-11-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.558120+0000", 2020-11-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001388254 2020-11-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.559508+0000", 2020-11-12T17:27:07.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014726489999999999 2020-11-12T17:27:07.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:07.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.560981+0000", 2020-11-12T17:27:07.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.022763867 2020-11-12T17:27:07.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.583745+0000", 2020-11-12T17:27:07.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024707100000000002 2020-11-12T17:27:07.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:07.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.583992+0000", 2020-11-12T17:27:07.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00031718099999999998 2020-11-12T17:27:07.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.584309+0000", 2020-11-12T17:27:07.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001675143 2020-11-12T17:27:07.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.585984+0000", 2020-11-12T17:27:07.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18112254999999999 2020-11-12T17:27:07.617 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.617 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.617 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.618 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:14736 5.0 e137/135 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head v 137'896, mlcod=137'891)", 2020-11-12T17:27:07.618 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:27:07.618 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3065234019999998, 2020-11-12T17:27:07.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999, 2020-11-12T17:27:07.618 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.619 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.619 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:27:07.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:27:07.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:27:07.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060202+0000", 2020-11-12T17:27:07.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8984000000000003e-05 2020-11-12T17:27:07.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060261+0000", 2020-11-12T17:27:07.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56005787699999998 2020-11-12T17:27:07.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620318+0000", 2020-11-12T17:27:07.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8369999999999999e-06 2020-11-12T17:27:07.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620325+0000", 2020-11-12T17:27:07.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012664800000000001 2020-11-12T17:27:07.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620452+0000", 2020-11-12T17:27:07.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3432e-05 2020-11-12T17:27:07.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620495+0000", 2020-11-12T17:27:07.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002919905 2020-11-12T17:27:07.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623415+0000", 2020-11-12T17:27:07.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9338999999999995e-05 2020-11-12T17:27:07.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623485+0000", 2020-11-12T17:27:07.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999 2020-11-12T17:27:07.625 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.625 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.626 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:15792 5.5 e138/136 5:a4d2ef9e:::benchmark_data_smithi036_24110_object1973:head v 138'936, mlcod=138'930)", 2020-11-12T17:27:07.626 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:03.229865+0000", 2020-11-12T17:27:07.626 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.1368727180000002, 2020-11-12T17:27:07.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.182325246, 2020-11-12T17:27:07.626 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.627 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:07.627 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.229865+0000", 2020-11-12T17:27:07.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.229865+0000", 2020-11-12T17:27:07.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999738 2020-11-12T17:27:07.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.229839+0000", 2020-11-12T17:27:07.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013531599999999999 2020-11-12T17:27:07.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.229974+0000", 2020-11-12T17:27:07.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17983930400000001 2020-11-12T17:27:07.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.409814+0000", 2020-11-12T17:27:07.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9340000000000003e-06 2020-11-12T17:27:07.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.409820+0000", 2020-11-12T17:27:07.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9249000000000001e-05 2020-11-12T17:27:07.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.409889+0000", 2020-11-12T17:27:07.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9299999999999999e-05 2020-11-12T17:27:07.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.409938+0000", 2020-11-12T17:27:07.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021856179999999998 2020-11-12T17:27:07.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:07.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.412124+0000", 2020-11-12T17:27:07.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6931e-05 2020-11-12T17:27:07.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:07.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.412191+0000", 2020-11-12T17:27:07.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.182325246 2020-11-12T17:27:07.633 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.633 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.634 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.634 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.634 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.634 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:07.636 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:07.402+0000 7f2809aaf700 -1 osd.6 141 handle_osd_map injecting map crc failure 2020-11-12T17:27:07.636 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:07.637 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:07.637 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:07.637 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:07.637 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:07.637 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:07.638 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:07.638 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:07.638 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:07.638 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:07.639 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:07.639 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:07.639 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:07.639 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:07.639 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 21 16 19350 19334 7.192 8.10156 0.00508613 0.0173577 2020-11-12T17:27:07.639 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:07.632+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:07.666 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:27:07.737 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:07.734+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:07.806 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:07.807 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:07.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.807 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:19536 5.6 5:6141c9e3:::benchmark_data_smithi036_24110_object2441:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e142)", 2020-11-12T17:27:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:07.726799+0000", 2020-11-12T17:27:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.079517593999999997, 2020-11-12T17:27:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.079555018000000005, 2020-11-12T17:27:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.808 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19536 2020-11-12T17:27:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.726799+0000", 2020-11-12T17:27:07.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.726799+0000", 2020-11-12T17:27:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.726784+0000", 2020-11-12T17:27:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3545999999999999e-05 2020-11-12T17:27:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.726828+0000", 2020-11-12T17:27:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5280000000000003e-06 2020-11-12T17:27:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.726833+0000", 2020-11-12T17:27:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.543e-06 2020-11-12T17:27:07.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.726836+0000", 2020-11-12T17:27:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031671569999999999 2020-11-12T17:27:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.730003+0000", 2020-11-12T17:27:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1943000000000001e-05 2020-11-12T17:27:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.730055+0000", 2020-11-12T17:27:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00032341599999999998 2020-11-12T17:27:07.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.730378+0000", 2020-11-12T17:27:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003816687 2020-11-12T17:27:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.734195+0000", 2020-11-12T17:27:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0073957290000000002 2020-11-12T17:27:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.816 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:19625 5.a 5:523d9e2a:::benchmark_data_smithi036_24110_object2453:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e142)", 2020-11-12T17:27:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:07.802960+0000", 2020-11-12T17:27:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0033575369999999998, 2020-11-12T17:27:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035363270000000001, 2020-11-12T17:27:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:07.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19625 2020-11-12T17:27:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.802960+0000", 2020-11-12T17:27:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.802960+0000", 2020-11-12T17:27:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:27:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.802919+0000", 2020-11-12T17:27:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5594999999999995e-05 2020-11-12T17:27:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803014+0000", 2020-11-12T17:27:07.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2334000000000001e-05 2020-11-12T17:27:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803027+0000", 2020-11-12T17:27:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1130000000000001e-06 2020-11-12T17:27:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803035+0000", 2020-11-12T17:27:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4209999999999998e-05 2020-11-12T17:27:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803089+0000", 2020-11-12T17:27:07.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019888300000000001 2020-11-12T17:27:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803288+0000", 2020-11-12T17:27:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018744399999999999 2020-11-12T17:27:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803475+0000", 2020-11-12T17:27:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002202865 2020-11-12T17:27:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.805678+0000", 2020-11-12T17:27:07.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027185590000000002 2020-11-12T17:27:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:19626 5.a 5:523d9e2a:::benchmark_data_smithi036_24110_object2453:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e142)", 2020-11-12T17:27:07.826 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:07.803106+0000", 2020-11-12T17:27:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0032110770000000001, 2020-11-12T17:27:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035122510000000001, 2020-11-12T17:27:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:07.827 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19626 2020-11-12T17:27:07.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.828 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803106+0000", 2020-11-12T17:27:07.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803106+0000", 2020-11-12T17:27:07.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:07.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803083+0000", 2020-11-12T17:27:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5483999999999998e-05 2020-11-12T17:27:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803149+0000", 2020-11-12T17:27:07.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2779999999999993e-06 2020-11-12T17:27:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803157+0000", 2020-11-12T17:27:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6619999999999996e-06 2020-11-12T17:27:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803162+0000", 2020-11-12T17:27:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014292969999999999 2020-11-12T17:27:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.804591+0000", 2020-11-12T17:27:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7136000000000001e-05 2020-11-12T17:27:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.804678+0000", 2020-11-12T17:27:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016865200000000001 2020-11-12T17:27:07.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:07.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.804847+0000", 2020-11-12T17:27:07.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017406329999999999 2020-11-12T17:27:07.834 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.834 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:19627 5.a 5:523d9e2a:::benchmark_data_smithi036_24110_object2453:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e142)", 2020-11-12T17:27:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:07.803653+0000", 2020-11-12T17:27:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0026638539999999998, 2020-11-12T17:27:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030883849999999999, 2020-11-12T17:27:07.835 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19627 2020-11-12T17:27:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.836 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803653+0000", 2020-11-12T17:27:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803653+0000", 2020-11-12T17:27:07.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:27:07.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803631+0000", 2020-11-12T17:27:07.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1500000000000004e-05 2020-11-12T17:27:07.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803693+0000", 2020-11-12T17:27:07.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.867e-06 2020-11-12T17:27:07.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803702+0000", 2020-11-12T17:27:07.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0699999999999997e-06 2020-11-12T17:27:07.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.803707+0000", 2020-11-12T17:27:07.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020158889999999999 2020-11-12T17:27:07.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:07.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.805723+0000", 2020-11-12T17:27:07.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015053199999999999 2020-11-12T17:27:07.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:07.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.805873+0000", 2020-11-12T17:27:07.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018997999999999999 2020-11-12T17:27:07.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:07.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.806063+0000", 2020-11-12T17:27:07.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024101080000000002 2020-11-12T17:27:07.842 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.843 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.843 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:19628 5.a 5.5479bc4a (undecoded) ondisk+write+known_if_redirected e142)", 2020-11-12T17:27:07.843 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:07.805919+0000", 2020-11-12T17:27:07.843 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00039772899999999999, 2020-11-12T17:27:07.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00093561299999999996, 2020-11-12T17:27:07.844 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:07.844 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:07.844 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:07.844 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:07.844 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:07.844 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 19628 2020-11-12T17:27:07.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.845 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:07.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:07.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.805919+0000", 2020-11-12T17:27:07.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:07.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:07.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.805919+0000", 2020-11-12T17:27:07.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:07.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:07.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.805897+0000", 2020-11-12T17:27:07.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4057e-05 2020-11-12T17:27:07.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:07.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.805961+0000", 2020-11-12T17:27:07.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0173000000000001e-05 2020-11-12T17:27:07.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:07.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.805971+0000", 2020-11-12T17:27:07.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0939999999999996e-06 2020-11-12T17:27:07.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:07.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:07.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:07.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:07.805977+0000", 2020-11-12T17:27:07.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7867e-05 2020-11-12T17:27:07.849 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.849 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:07.849 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.849 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:07.849 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:07.849 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 5 2020-11-12T17:27:07.849 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:07.851 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:07.852 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:07.848+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:07.952 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:07.948+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:08.117 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:08.118 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:08.118 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:08.119 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:08.119 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:08.120 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:08.121 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:08.112+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:08.219 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:08.216+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:08.301 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:08.301 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:08.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:08.302 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:08.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.302 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.6 123/122 [PushOp(4:60824407:::benchmark_data_smithi036_18856_object6950:head, version: 100'3208, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:60824407:::benchmark_data_smithi036_18856_object6950:head@100'3208, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:08.302 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:08.303 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 31.610028341, 2020-11-12T17:27:08.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998, 2020-11-12T17:27:08.303 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.303 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:08.303 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:08.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:08.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:08.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687268+0000", 2020-11-12T17:27:08.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2052999999999994e-05 2020-11-12T17:27:08.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687360+0000", 2020-11-12T17:27:08.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54419334699999999 2020-11-12T17:27:08.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231553+0000", 2020-11-12T17:27:08.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.362e-06 2020-11-12T17:27:08.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231560+0000", 2020-11-12T17:27:08.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000185682 2020-11-12T17:27:08.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231746+0000", 2020-11-12T17:27:08.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0793e-05 2020-11-12T17:27:08.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231797+0000", 2020-11-12T17:27:08.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003344549 2020-11-12T17:27:08.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.235141+0000", 2020-11-12T17:27:08.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998 2020-11-12T17:27:08.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.310 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.311 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:800 5.d 5:b9f6bf26:::benchmark_data_smithi036_24110_object99:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e129)", 2020-11-12T17:27:08.311 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:47.239919+0000", 2020-11-12T17:27:08.311 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 21.057392863, 2020-11-12T17:27:08.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.229269315, 2020-11-12T17:27:08.311 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.311 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.311 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.312 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.312 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.312 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 800 2020-11-12T17:27:08.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.312 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.239919+0000", 2020-11-12T17:27:08.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.239919+0000", 2020-11-12T17:27:08.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9998703 2020-11-12T17:27:08.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.239789+0000", 2020-11-12T17:27:08.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000334366 2020-11-12T17:27:08.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.240123+0000", 2020-11-12T17:27:08.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6396999999999997e-05 2020-11-12T17:27:08.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.240160+0000", 2020-11-12T17:27:08.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8153000000000001e-05 2020-11-12T17:27:08.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.240178+0000", 2020-11-12T17:27:08.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026154780000000001 2020-11-12T17:27:08.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.242793+0000", 2020-11-12T17:27:08.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.753e-05 2020-11-12T17:27:08.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.242851+0000", 2020-11-12T17:27:08.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103293 2020-11-12T17:27:08.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:08.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.242954+0000", 2020-11-12T17:27:08.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011932760000000001 2020-11-12T17:27:08.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.244147+0000", 2020-11-12T17:27:08.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224886751 2020-11-12T17:27:08.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469034+0000", 2020-11-12T17:27:08.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4919999999999993e-05 2020-11-12T17:27:08.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469119+0000", 2020-11-12T17:27:08.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8856999999999995e-05 2020-11-12T17:27:08.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469188+0000", 2020-11-12T17:27:08.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.229269315 2020-11-12T17:27:08.323 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.323 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.323 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.323 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:1512 5.a 5:56e3a795:::benchmark_data_smithi036_24110_object188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e130)", 2020-11-12T17:27:08.324 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:08.324 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.381227768999999, 2020-11-12T17:27:08.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25162866900000003, 2020-11-12T17:27:08.324 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.324 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.324 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.324 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.325 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.325 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1512 2020-11-12T17:27:08.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.325 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:08.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:08.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:08.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916054+0000", 2020-11-12T17:27:08.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5012000000000005e-05 2020-11-12T17:27:08.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916139+0000", 2020-11-12T17:27:08.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7899999999999994e-06 2020-11-12T17:27:08.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916148+0000", 2020-11-12T17:27:08.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5700000000000003e-06 2020-11-12T17:27:08.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916153+0000", 2020-11-12T17:27:08.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0071457680000000003 2020-11-12T17:27:08.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923299+0000", 2020-11-12T17:27:08.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2009999999999998e-05 2020-11-12T17:27:08.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923361+0000", 2020-11-12T17:27:08.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106986 2020-11-12T17:27:08.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:08.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923468+0000", 2020-11-12T17:27:08.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094293899999999995 2020-11-12T17:27:08.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.924411+0000", 2020-11-12T17:27:08.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24318124399999999 2020-11-12T17:27:08.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167592+0000", 2020-11-12T17:27:08.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9159999999999995e-05 2020-11-12T17:27:08.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167661+0000", 2020-11-12T17:27:08.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1243999999999999e-05 2020-11-12T17:27:08.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167712+0000", 2020-11-12T17:27:08.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25162866900000003 2020-11-12T17:27:08.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.338 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.339 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11901 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:08.339 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:08.339 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.347101971000001, 2020-11-12T17:27:08.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29431180699999998, 2020-11-12T17:27:08.340 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.340 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.340 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.340 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.340 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.341 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11901 2020-11-12T17:27:08.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.341 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:08.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:08.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:27:08.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950188+0000", 2020-11-12T17:27:08.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2355999999999997e-05 2020-11-12T17:27:08.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950250+0000", 2020-11-12T17:27:08.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3710000000000002e-06 2020-11-12T17:27:08.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950258+0000", 2020-11-12T17:27:08.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.343e-06 2020-11-12T17:27:08.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950261+0000", 2020-11-12T17:27:08.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060384219999999999 2020-11-12T17:27:08.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956299+0000", 2020-11-12T17:27:08.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014742999999999999 2020-11-12T17:27:08.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956447+0000", 2020-11-12T17:27:08.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026288400000000001 2020-11-12T17:27:08.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:08.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956710+0000", 2020-11-12T17:27:08.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047596729999999999 2020-11-12T17:27:08.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961469+0000", 2020-11-12T17:27:08.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28285178999999999 2020-11-12T17:27:08.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244321+0000", 2020-11-12T17:27:08.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120733 2020-11-12T17:27:08.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244442+0000", 2020-11-12T17:27:08.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.941e-05 2020-11-12T17:27:08.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244521+0000", 2020-11-12T17:27:08.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29431180699999998 2020-11-12T17:27:08.352 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.352 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.352 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.352 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11902 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:08.353 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:08.353 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.346265149000001, 2020-11-12T17:27:08.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002, 2020-11-12T17:27:08.353 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.353 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.354 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.354 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.354 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.354 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11902 2020-11-12T17:27:08.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.354 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:08.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:08.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:08.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950968+0000", 2020-11-12T17:27:08.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022604299999999999 2020-11-12T17:27:08.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951194+0000", 2020-11-12T17:27:08.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1806e-05 2020-11-12T17:27:08.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951226+0000", 2020-11-12T17:27:08.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5761999999999999e-05 2020-11-12T17:27:08.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951241+0000", 2020-11-12T17:27:08.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006854845 2020-11-12T17:27:08.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958096+0000", 2020-11-12T17:27:08.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026652700000000002 2020-11-12T17:27:08.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958363+0000", 2020-11-12T17:27:08.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000368857 2020-11-12T17:27:08.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:08.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958732+0000", 2020-11-12T17:27:08.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027531859999999999 2020-11-12T17:27:08.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961485+0000", 2020-11-12T17:27:08.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43528204399999998 2020-11-12T17:27:08.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396767+0000", 2020-11-12T17:27:08.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015781399999999999 2020-11-12T17:27:08.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396925+0000", 2020-11-12T17:27:08.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109403 2020-11-12T17:27:08.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397034+0000", 2020-11-12T17:27:08.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002 2020-11-12T17:27:08.364 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.364 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.364 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.365 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11903 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:08.365 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:08.365 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.345667603000001, 2020-11-12T17:27:08.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221, 2020-11-12T17:27:08.365 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.366 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.366 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11903 2020-11-12T17:27:08.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.366 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:08.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:08.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999228 2020-11-12T17:27:08.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951566+0000", 2020-11-12T17:27:08.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024334899999999999 2020-11-12T17:27:08.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951810+0000", 2020-11-12T17:27:08.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9034e-05 2020-11-12T17:27:08.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951839+0000", 2020-11-12T17:27:08.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4151000000000001e-05 2020-11-12T17:27:08.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951853+0000", 2020-11-12T17:27:08.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081211489999999994 2020-11-12T17:27:08.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.959974+0000", 2020-11-12T17:27:08.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013490799999999999 2020-11-12T17:27:08.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960109+0000", 2020-11-12T17:27:08.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000252172 2020-11-12T17:27:08.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:08.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960361+0000", 2020-11-12T17:27:08.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024598829999999999 2020-11-12T17:27:08.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962821+0000", 2020-11-12T17:27:08.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43434482000000002 2020-11-12T17:27:08.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397166+0000", 2020-11-12T17:27:08.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054200000000001 2020-11-12T17:27:08.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397296+0000", 2020-11-12T17:27:08.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5556000000000005e-05 2020-11-12T17:27:08.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397392+0000", 2020-11-12T17:27:08.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221 2020-11-12T17:27:08.377 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.377 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.377 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.378 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11904 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:08.378 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:08.378 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.343204488, 2020-11-12T17:27:08.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003, 2020-11-12T17:27:08.378 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.378 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.378 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.379 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.379 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.379 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11904 2020-11-12T17:27:08.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.379 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:08.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:08.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999237 2020-11-12T17:27:08.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954031+0000", 2020-11-12T17:27:08.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021660900000000001 2020-11-12T17:27:08.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954247+0000", 2020-11-12T17:27:08.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4606e-05 2020-11-12T17:27:08.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954282+0000", 2020-11-12T17:27:08.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.552e-05 2020-11-12T17:27:08.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954297+0000", 2020-11-12T17:27:08.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0072408330000000003 2020-11-12T17:27:08.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961538+0000", 2020-11-12T17:27:08.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013512800000000001 2020-11-12T17:27:08.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961673+0000", 2020-11-12T17:27:08.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023430200000000001 2020-11-12T17:27:08.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:08.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961908+0000", 2020-11-12T17:27:08.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016600740000000001 2020-11-12T17:27:08.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963568+0000", 2020-11-12T17:27:08.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43393070099999997 2020-11-12T17:27:08.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397499+0000", 2020-11-12T17:27:08.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012872 2020-11-12T17:27:08.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397627+0000", 2020-11-12T17:27:08.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4786999999999999e-05 2020-11-12T17:27:08.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397722+0000", 2020-11-12T17:27:08.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003 2020-11-12T17:27:08.389 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.389 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.389 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.389 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:11901 5.d e133/127 ondisk, result = 0)", 2020-11-12T17:27:08.390 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:08.390 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.33917454, 2020-11-12T17:27:08.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28640288899999999, 2020-11-12T17:27:08.390 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.390 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:08.390 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:08.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:08.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:08.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958116+0000", 2020-11-12T17:27:08.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1677e-05 2020-11-12T17:27:08.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958167+0000", 2020-11-12T17:27:08.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28596560999999998 2020-11-12T17:27:08.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244133+0000", 2020-11-12T17:27:08.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2449999999999999e-05 2020-11-12T17:27:08.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244146+0000", 2020-11-12T17:27:08.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013661000000000001 2020-11-12T17:27:08.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244282+0000", 2020-11-12T17:27:08.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9877e-05 2020-11-12T17:27:08.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244302+0000", 2020-11-12T17:27:08.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000237693 2020-11-12T17:27:08.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244540+0000", 2020-11-12T17:27:08.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28640288899999999 2020-11-12T17:27:08.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.397 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.397 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11909 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:08.397 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:08.398 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.335465792000001, 2020-11-12T17:27:08.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999, 2020-11-12T17:27:08.398 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.398 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.398 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.399 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11909 2020-11-12T17:27:08.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.399 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:08.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:08.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:27:08.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961803+0000", 2020-11-12T17:27:08.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9606999999999998e-05 2020-11-12T17:27:08.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961893+0000", 2020-11-12T17:27:08.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0258000000000001e-05 2020-11-12T17:27:08.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961903+0000", 2020-11-12T17:27:08.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8450000000000003e-06 2020-11-12T17:27:08.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961911+0000", 2020-11-12T17:27:08.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00090397899999999996 2020-11-12T17:27:08.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962815+0000", 2020-11-12T17:27:08.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106487 2020-11-12T17:27:08.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962921+0000", 2020-11-12T17:27:08.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027479400000000003 2020-11-12T17:27:08.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:08.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963196+0000", 2020-11-12T17:27:08.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002806041 2020-11-12T17:27:08.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966002+0000", 2020-11-12T17:27:08.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42403797700000001 2020-11-12T17:27:08.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390040+0000", 2020-11-12T17:27:08.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017360699999999999 2020-11-12T17:27:08.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390214+0000", 2020-11-12T17:27:08.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012036600000000001 2020-11-12T17:27:08.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390334+0000", 2020-11-12T17:27:08.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999 2020-11-12T17:27:08.408 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.408 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.409 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.409 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11910 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:08.409 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:08.409 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.3342495, 2020-11-12T17:27:08.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002, 2020-11-12T17:27:08.410 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.410 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.410 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.410 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.410 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.410 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11910 2020-11-12T17:27:08.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.411 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:08.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:08.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999413 2020-11-12T17:27:08.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963003+0000", 2020-11-12T17:27:08.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017848699999999999 2020-11-12T17:27:08.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963182+0000", 2020-11-12T17:27:08.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7229000000000001e-05 2020-11-12T17:27:08.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963199+0000", 2020-11-12T17:27:08.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2609999999999999e-06 2020-11-12T17:27:08.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963208+0000", 2020-11-12T17:27:08.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089699300000000001 2020-11-12T17:27:08.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964105+0000", 2020-11-12T17:27:08.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012321200000000001 2020-11-12T17:27:08.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964228+0000", 2020-11-12T17:27:08.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022185600000000001 2020-11-12T17:27:08.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:08.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964450+0000", 2020-11-12T17:27:08.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001555697 2020-11-12T17:27:08.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966006+0000", 2020-11-12T17:27:08.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42809403299999998 2020-11-12T17:27:08.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394100+0000", 2020-11-12T17:27:08.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012522 2020-11-12T17:27:08.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394225+0000", 2020-11-12T17:27:08.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014087 2020-11-12T17:27:08.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394366+0000", 2020-11-12T17:27:08.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002 2020-11-12T17:27:08.421 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.421 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.421 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.422 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11911 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:08.422 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:08.422 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.334019758, 2020-11-12T17:27:08.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998, 2020-11-12T17:27:08.422 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.422 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.423 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.423 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.423 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.423 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11911 2020-11-12T17:27:08.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.423 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:08.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:08.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999547 2020-11-12T17:27:08.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963246+0000", 2020-11-12T17:27:08.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000132867 2020-11-12T17:27:08.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963379+0000", 2020-11-12T17:27:08.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1556000000000002e-05 2020-11-12T17:27:08.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963401+0000", 2020-11-12T17:27:08.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2499999999999997e-05 2020-11-12T17:27:08.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963433+0000", 2020-11-12T17:27:08.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018380040000000001 2020-11-12T17:27:08.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965271+0000", 2020-11-12T17:27:08.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6691000000000002e-05 2020-11-12T17:27:08.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965338+0000", 2020-11-12T17:27:08.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100777 2020-11-12T17:27:08.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:08.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965439+0000", 2020-11-12T17:27:08.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001679198 2020-11-12T17:27:08.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967118+0000", 2020-11-12T17:27:08.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.435251412 2020-11-12T17:27:08.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402369+0000", 2020-11-12T17:27:08.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6074000000000005e-05 2020-11-12T17:27:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402435+0000", 2020-11-12T17:27:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6678999999999997e-05 2020-11-12T17:27:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402492+0000", 2020-11-12T17:27:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998 2020-11-12T17:27:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11912 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.330991808, 2020-11-12T17:27:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997, 2020-11-12T17:27:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11912 2020-11-12T17:27:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966296+0000", 2020-11-12T17:27:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6765000000000002e-05 2020-11-12T17:27:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966363+0000", 2020-11-12T17:27:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3097e-05 2020-11-12T17:27:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966376+0000", 2020-11-12T17:27:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0669999999999998e-06 2020-11-12T17:27:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966385+0000", 2020-11-12T17:27:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7963999999999997e-05 2020-11-12T17:27:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966433+0000", 2020-11-12T17:27:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0263999999999998e-05 2020-11-12T17:27:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966494+0000", 2020-11-12T17:27:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120279 2020-11-12T17:27:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966614+0000", 2020-11-12T17:27:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001180424 2020-11-12T17:27:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967794+0000", 2020-11-12T17:27:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43476916100000002 2020-11-12T17:27:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402563+0000", 2020-11-12T17:27:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7442999999999998e-05 2020-11-12T17:27:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402631+0000", 2020-11-12T17:27:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8424999999999998e-05 2020-11-12T17:27:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402679+0000", 2020-11-12T17:27:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997 2020-11-12T17:27:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.495 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11913 5.d 5:b8059c51:::benchmark_data_smithi036_24110_object1489:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:08.495 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:08.495 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.168561813, 2020-11-12T17:27:08.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26925581300000001, 2020-11-12T17:27:08.495 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11913 2020-11-12T17:27:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999523 2020-11-12T17:27:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128702+0000", 2020-11-12T17:27:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013552400000000001 2020-11-12T17:27:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128837+0000", 2020-11-12T17:27:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6769999999999999e-05 2020-11-12T17:27:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128864+0000", 2020-11-12T17:27:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.261e-05 2020-11-12T17:27:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128877+0000", 2020-11-12T17:27:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125313 2020-11-12T17:27:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129002+0000", 2020-11-12T17:27:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00034839700000000002 2020-11-12T17:27:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129350+0000", 2020-11-12T17:27:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030113699999999999 2020-11-12T17:27:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129652+0000", 2020-11-12T17:27:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022631880000000002 2020-11-12T17:27:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.131915+0000", 2020-11-12T17:27:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26589388400000002 2020-11-12T17:27:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397809+0000", 2020-11-12T17:27:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114862 2020-11-12T17:27:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397923+0000", 2020-11-12T17:27:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1882e-05 2020-11-12T17:27:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.398005+0000", 2020-11-12T17:27:08.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26925581300000001 2020-11-12T17:27:08.506 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.506 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:12696 5.d 5:bedc4739:::benchmark_data_smithi036_24110_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e134)", 2020-11-12T17:27:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:58.141564+0000", 2020-11-12T17:27:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.155747466999999, 2020-11-12T17:27:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.240589469, 2020-11-12T17:27:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 12696 2020-11-12T17:27:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141564+0000", 2020-11-12T17:27:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141564+0000", 2020-11-12T17:27:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141516+0000", 2020-11-12T17:27:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013753999999999999 2020-11-12T17:27:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141653+0000", 2020-11-12T17:27:08.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8082999999999999e-05 2020-11-12T17:27:08.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141681+0000", 2020-11-12T17:27:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0944999999999999e-05 2020-11-12T17:27:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141692+0000", 2020-11-12T17:27:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019604420000000002 2020-11-12T17:27:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.143653+0000", 2020-11-12T17:27:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0601999999999998e-05 2020-11-12T17:27:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.143733+0000", 2020-11-12T17:27:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014270299999999999 2020-11-12T17:27:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.143876+0000", 2020-11-12T17:27:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020232510000000002 2020-11-12T17:27:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.145899+0000", 2020-11-12T17:27:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.236140883 2020-11-12T17:27:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382040+0000", 2020-11-12T17:27:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5817999999999999e-05 2020-11-12T17:27:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382106+0000", 2020-11-12T17:27:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7577999999999997e-05 2020-11-12T17:27:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382153+0000", 2020-11-12T17:27:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.240589469 2020-11-12T17:27:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14919 5.6 5:6a28bd79:::benchmark_data_smithi036_24110_object1864:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.245278+0000", 2020-11-12T17:27:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.0520333639999997, 2020-11-12T17:27:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37589861299999999, 2020-11-12T17:27:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14919 2020-11-12T17:27:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245278+0000", 2020-11-12T17:27:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245278+0000", 2020-11-12T17:27:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245242+0000", 2020-11-12T17:27:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010559499999999999 2020-11-12T17:27:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245348+0000", 2020-11-12T17:27:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3886999999999999e-05 2020-11-12T17:27:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245361+0000", 2020-11-12T17:27:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1739999999999997e-06 2020-11-12T17:27:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245368+0000", 2020-11-12T17:27:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021369129999999998 2020-11-12T17:27:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.247505+0000", 2020-11-12T17:27:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000167682 2020-11-12T17:27:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.247672+0000", 2020-11-12T17:27:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000248874 2020-11-12T17:27:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.247921+0000", 2020-11-12T17:27:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044640180000000002 2020-11-12T17:27:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.252385+0000", 2020-11-12T17:27:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36865272599999999 2020-11-12T17:27:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621038+0000", 2020-11-12T17:27:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7316000000000003e-05 2020-11-12T17:27:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621115+0000", 2020-11-12T17:27:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1439999999999995e-05 2020-11-12T17:27:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621177+0000", 2020-11-12T17:27:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37589861299999999 2020-11-12T17:27:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14920 5.6 5:6a28bd79:::benchmark_data_smithi036_24110_object1864:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.246843+0000", 2020-11-12T17:27:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.0504682570000003, 2020-11-12T17:27:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37860764600000002, 2020-11-12T17:27:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14920 2020-11-12T17:27:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246843+0000", 2020-11-12T17:27:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246843+0000", 2020-11-12T17:27:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246803+0000", 2020-11-12T17:27:08.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011126200000000001 2020-11-12T17:27:08.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246914+0000", 2020-11-12T17:27:08.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5925000000000001e-05 2020-11-12T17:27:08.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246930+0000", 2020-11-12T17:27:08.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9270000000000005e-06 2020-11-12T17:27:08.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246938+0000", 2020-11-12T17:27:08.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017497649999999999 2020-11-12T17:27:08.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.248688+0000", 2020-11-12T17:27:08.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3158999999999996e-05 2020-11-12T17:27:08.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.248751+0000", 2020-11-12T17:27:08.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116112 2020-11-12T17:27:08.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:08.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.248867+0000", 2020-11-12T17:27:08.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035256179999999999 2020-11-12T17:27:08.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.252392+0000", 2020-11-12T17:27:08.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37298045299999999 2020-11-12T17:27:08.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.625373+0000", 2020-11-12T17:27:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.443e-05 2020-11-12T17:27:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.625417+0000", 2020-11-12T17:27:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3444e-05 2020-11-12T17:27:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.625451+0000", 2020-11-12T17:27:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37860764600000002 2020-11-12T17:27:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:14919 5.6 e137/127 ondisk, result = 0)", 2020-11-12T17:27:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.251548+0000", 2020-11-12T17:27:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.0457635979999997, 2020-11-12T17:27:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36963633000000001, 2020-11-12T17:27:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251548+0000", 2020-11-12T17:27:08.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251548+0000", 2020-11-12T17:27:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251523+0000", 2020-11-12T17:27:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4719000000000003e-05 2020-11-12T17:27:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251568+0000", 2020-11-12T17:27:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36934947400000001 2020-11-12T17:27:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620917+0000", 2020-11-12T17:27:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9519999999999997e-06 2020-11-12T17:27:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620924+0000", 2020-11-12T17:27:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1785000000000003e-05 2020-11-12T17:27:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621016+0000", 2020-11-12T17:27:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0672999999999999e-05 2020-11-12T17:27:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621027+0000", 2020-11-12T17:27:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015729000000000001 2020-11-12T17:27:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621184+0000", 2020-11-12T17:27:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36963633000000001 2020-11-12T17:27:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:15008 5.d 5:bb9506a3:::benchmark_data_smithi036_24110_object1875:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.343191+0000", 2020-11-12T17:27:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.954120004, 2020-11-12T17:27:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27534693300000002, 2020-11-12T17:27:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 15008 2020-11-12T17:27:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343191+0000", 2020-11-12T17:27:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343191+0000", 2020-11-12T17:27:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343154+0000", 2020-11-12T17:27:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010024199999999999 2020-11-12T17:27:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343254+0000", 2020-11-12T17:27:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9607e-05 2020-11-12T17:27:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343274+0000", 2020-11-12T17:27:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0360000000000001e-05 2020-11-12T17:27:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343284+0000", 2020-11-12T17:27:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031873819999999999 2020-11-12T17:27:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.346471+0000", 2020-11-12T17:27:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8413999999999999e-05 2020-11-12T17:27:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.346540+0000", 2020-11-12T17:27:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108972 2020-11-12T17:27:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.346649+0000", 2020-11-12T17:27:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012527529999999999 2020-11-12T17:27:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.347901+0000", 2020-11-12T17:27:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27048926099999998 2020-11-12T17:27:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618391+0000", 2020-11-12T17:27:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9011000000000006e-05 2020-11-12T17:27:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618470+0000", 2020-11-12T17:27:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8559000000000005e-05 2020-11-12T17:27:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618538+0000", 2020-11-12T17:27:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27534693300000002 2020-11-12T17:27:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:15008 5.d e137/127 ondisk, result = 0)", 2020-11-12T17:27:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.348752+0000", 2020-11-12T17:27:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.9485590879999997, 2020-11-12T17:27:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.269797817, 2020-11-12T17:27:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348752+0000", 2020-11-12T17:27:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348752+0000", 2020-11-12T17:27:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348716+0000", 2020-11-12T17:27:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3648999999999997e-05 2020-11-12T17:27:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348810+0000", 2020-11-12T17:27:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26755567299999999 2020-11-12T17:27:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.616365+0000", 2020-11-12T17:27:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5039999999999996e-06 2020-11-12T17:27:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.616373+0000", 2020-11-12T17:27:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019946999999999999 2020-11-12T17:27:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618367+0000", 2020-11-12T17:27:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0929e-05 2020-11-12T17:27:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618378+0000", 2020-11-12T17:27:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017173000000000001 2020-11-12T17:27:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618550+0000", 2020-11-12T17:27:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.269797817 2020-11-12T17:27:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:16064 5.a 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:27:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:27:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.802163234, 2020-11-12T17:27:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999, 2020-11-12T17:27:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 16064 2020-11-12T17:27:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:27:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:27:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495102+0000", 2020-11-12T17:27:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012806100000000001 2020-11-12T17:27:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495230+0000", 2020-11-12T17:27:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1214999999999999e-05 2020-11-12T17:27:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495251+0000", 2020-11-12T17:27:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1668000000000001e-05 2020-11-12T17:27:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495262+0000", 2020-11-12T17:27:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6068999999999994e-05 2020-11-12T17:27:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495329+0000", 2020-11-12T17:27:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011465599999999999 2020-11-12T17:27:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495443+0000", 2020-11-12T17:27:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000230077 2020-11-12T17:27:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495673+0000", 2020-11-12T17:27:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013291710000000001 2020-11-12T17:27:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.497002+0000", 2020-11-12T17:27:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69030446599999995 2020-11-12T17:27:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187307+0000", 2020-11-12T17:27:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011451999999999999 2020-11-12T17:27:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187421+0000", 2020-11-12T17:27:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5153000000000004e-05 2020-11-12T17:27:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187497+0000", 2020-11-12T17:27:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999 2020-11-12T17:27:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:08.586 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:08.586 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:08.587 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 22 16 20535 20519 7.28587 9.25781 0.0336963 0.0171485 2020-11-12T17:27:08.587 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:08.586+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:08.588 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:08.663 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:27:08.686 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:08.680+0000 7fc24d2e3700 -1 osd.3 142 handle_osd_map injecting map crc failure 2020-11-12T17:27:08.693 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:08.688+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:08.772 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:08.879 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:08.880 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:08.880 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:08.884 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:08.886 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:08.878+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:08.985 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:08.982+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:09.050 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:09.051 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:09.051 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:09.052 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:09.052 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:09.061 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:09.113 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:09.108+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:09.191 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:09.184+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:09.207 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:09.208 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:09.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:09.208 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:09.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.209 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:09.209 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:09.209 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 244.08854316599999, 2020-11-12T17:27:09.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:09.219 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.224 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:09.225 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:09.225 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:09.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.225 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:09.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:09.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:09.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:09.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:09.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:09.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:09.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:09.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:09.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:09.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:09.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:09.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:09.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:09.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:09.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:09.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:09.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:09.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:09.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:09.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:09.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:09.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:09.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:09.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:09.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:09.272 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.272 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.272 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.273 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:09.273 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:09.273 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 244.08145137, 2020-11-12T17:27:09.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:09.273 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.273 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:09.273 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:09.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:09.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:09.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:09.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:09.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:09.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:09.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:09.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:09.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:09.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:09.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:09.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:09.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:09.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:09.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:09.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:09.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.282 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.282 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.284 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:09.284 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:09.284 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 234.648891873, 2020-11-12T17:27:09.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:09.285 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.285 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.292 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.292 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:09.293 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:09.293 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:09.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.294 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:09.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:09.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:09.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:09.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:09.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:09.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:09.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:09.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:09.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:09.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:09.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:09.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:09.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:09.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:09.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:09.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:09.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:09.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:09.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:09.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:09.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:09.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:09.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:09.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:09.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:09.319 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.319 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.319 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.320 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:09.320 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:09.320 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 200.698771779, 2020-11-12T17:27:09.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:09.320 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.321 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:09.321 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:09.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:09.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:09.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:09.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:09.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:09.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:09.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:09.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:09.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:09.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:09.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:09.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:09.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:09.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:09.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:09.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:09.329 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.330 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.330 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:09.330 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:09.330 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 198.59316988699999, 2020-11-12T17:27:09.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:09.331 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.331 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.331 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:09.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:09.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:09.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:09.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:09.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:09.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:09.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:09.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:09.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:09.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:09.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:09.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:09.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:09.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:09.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:09.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:09.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:09.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:09.339 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.339 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.340 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.343 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:09.343 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:09.344 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 167.24668655299999, 2020-11-12T17:27:09.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:09.345 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.346 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.346 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.347 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:09.347 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:09.347 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:09.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.348 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:09.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:09.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:09.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:09.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:09.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:09.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:09.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:09.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:09.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:09.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:09.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:09.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:09.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:09.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:09.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:09.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:09.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:09.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:09.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:09.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:09.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:09.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:09.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:09.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:09.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:09.361 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.361 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.361 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.361 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:09.362 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:09.362 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 158.25084475099999, 2020-11-12T17:27:09.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:09.362 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.362 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:09.362 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:09.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:09.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:09.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:09.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:09.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:09.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:09.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:09.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:09.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:09.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:09.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:09.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:09.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:09.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:09.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:09.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:09.368 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.368 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.369 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.369 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:09.369 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:09.369 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 154.315741352, 2020-11-12T17:27:09.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:09.369 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.370 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:09.370 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:09.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:09.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:09.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:09.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:09.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:09.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:09.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:09.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:09.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:09.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:09.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:09.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:09.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:09.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:09.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.375 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.376 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.376 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:09.376 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:09.376 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 123.55110086099999, 2020-11-12T17:27:09.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:09.376 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.377 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:09.377 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:09.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:09.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:09.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:09.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:09.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:09.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:09.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:09.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:09.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:09.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:09.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:09.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:09.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:09.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:09.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:09.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:09.387 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.387 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.388 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.389 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:09.389 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:09.389 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.294592177, 2020-11-12T17:27:09.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:09.393 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.394 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.394 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.394 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:09.395 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:09.395 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:09.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.395 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:09.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:09.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:09.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:09.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:09.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:09.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:09.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:09.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:09.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.294429807, 2020-11-12T17:27:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.28586082, 2020-11-12T17:27:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 92.781348370000003, 2020-11-12T17:27:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:09.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 91.295800084000007, 2020-11-12T17:27:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 88.222481651999999, 2020-11-12T17:27:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:09.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:09.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:09.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:09.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:09.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:09.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:09.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:09.488 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.488 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.488 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.489 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:09.489 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:09.489 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 87.166836676000003, 2020-11-12T17:27:09.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:09.490 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.491 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.491 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.491 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:09.491 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:09.492 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:09.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.492 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:09.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:09.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:09.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:09.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:09.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:09.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:09.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:09.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:09.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:09.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:09.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:09.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:09.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:09.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:09.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:09.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:09.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:09.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:09.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:09.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:09.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:09.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:09.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:09.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:09.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:09.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.508 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.508 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.509 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:09.509 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:09.509 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.778632305000002, 2020-11-12T17:27:09.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:09.510 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.510 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.510 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.510 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:09.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:09.511 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:09.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.511 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:09.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:09.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:09.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:09.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:09.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:09.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:09.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:09.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:09.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:09.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:09.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:09.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:09.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:09.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:09.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:09.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:09.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:09.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:09.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:09.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:09.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:09.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:09.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:09.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:09.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:09.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.521 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.521 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:09.521 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:09.521 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 72.572175372999993, 2020-11-12T17:27:09.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:09.522 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.522 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.522 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:09.522 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:09.522 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:09.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.523 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:09.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:09.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:09.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:09.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:09.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:09.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:09.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:09.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:09.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:09.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:09.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:09.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:09.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:09.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:09.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:09.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:09.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:09.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:09.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:09.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:09.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:09.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:09.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:09.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:09.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:09.531 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.531 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.531 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.532 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:09.532 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:09.532 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 71.322969756000006, 2020-11-12T17:27:09.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:09.532 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.532 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:09.533 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:09.533 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:09.533 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:09.533 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:09.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.533 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:09.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:09.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:09.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:09.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:09.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:09.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:09.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:09.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:09.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:09.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:09.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:09.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:09.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:09.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:09.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:09.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:09.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:09.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:09.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:09.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:09.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:09.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:09.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:09.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:09.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:09.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:09.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:09.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:09.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.543 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:09.543 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:09.544 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 71.306010306999994, 2020-11-12T17:27:09.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:09.544 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:09.544 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:09.544 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:09.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:09.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:09.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:09.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:09.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:09.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:09.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:09.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:09.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:09.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:09.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:09.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:09.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:09.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:09.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:09.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:09.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:09.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:09.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:09.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:09.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:09.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:09.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:09.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:09.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:09.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:09.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:09.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:09.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:09.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.551 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.552 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:09.552 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:09.552 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:09.553 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:09.555 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:09.552+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:09.556 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 23 16 21756 21740 7.3838 9.53906 0.0105773 0.0169107 2020-11-12T17:27:09.641 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:09.656 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:09.654+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:09.716 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:09.717 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:09.717 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:09.717 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:09.721 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:09.761 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:09.761 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:09.765 INFO:tasks.thrashosds.thrasher:inject_pause on 4 2020-11-12T17:27:09.766 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-12T17:27:09.766 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-12T17:27:09.766 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2020-11-12T17:27:09.771 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:09.768+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:09.810 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:09.852 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:09.852 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:09.853 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:09.853 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:09.853 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:09.854 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:09.855 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:09.856 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:09.854+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:09.865 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:09.896 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:09.896 INFO:teuthology.orchestra.run.smithi205.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2020-11-12T17:27:09.896 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:09.897 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:09.939 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:09.958 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:09.954+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:09.975 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:10.004 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:10.004 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:10.004 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:10.015 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:10.038 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:10.040 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:10.040 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:10.040 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:10.040 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:10.041 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:10.041 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:10.041 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:10.041 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:10.069 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:10.066+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:10.146 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:10.147 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:10.155 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:10.200 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:10.198+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:10.261 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:10.258+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:10.318 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:10.318 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:10.329 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:10.372 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:10.370+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:10.463 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:10.458+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:10.491 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:10.492 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:10.503 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:10.556 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 24 16 22659 22643 7.37006 7.05469 0.00832103 0.0169446 2020-11-12T17:27:10.592 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:10.590+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:10.670 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:10.664+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:10.676 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:10.676 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:10.678 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:27:10.693 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:10.771 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:10.768+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:10.861 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:10.861 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:10.872 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:10.868+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:10.873 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:10.974 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:10.968+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:10.996 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:10.997 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:11.007 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:11.075 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:11.070+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:11.120 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:11.120 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:11.130 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:11.174 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:11.172+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:11.276 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:11.274+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:11.299 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:11.299 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:11.311 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:11.376 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:11.372+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:11.473 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:11.474 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:11.478 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:11.472+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:11.483 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:11.557 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 25 16 23761 23745 7.4196 8.60938 0.00776811 0.0168238 2020-11-12T17:27:11.578 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:11.572+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:11.610 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:11.610 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:11.624 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:11.679 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:27:11.680 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:11.678+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:11.740 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:11.740 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:11.753 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:11.796 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:11.794+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:11.881 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:11.878+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:11.929 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:11.929 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:11.942 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:11.987 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:11.984+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:12.052 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:12.078 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:12.078 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:12.083 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:12.080+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:12.091 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:12.184 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:12.182+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:12.225 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:12.258 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:12.268 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:12.269 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:12.269 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:12.281 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:12.289 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:12.289 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:12.284+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:12.322 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:12.350 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:12.386 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:12.382+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:12.387 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:12.407 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:12.408 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:12.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:12.408 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:12.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.408 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.7 115/114 [PushOp(4:e3922283:::benchmark_data_smithi036_18856_object1489:head, version: 74'760, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:e3922283:::benchmark_data_smithi036_18856_object1489:head@74'760, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:12.409 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:26.305572+0000", 2020-11-12T17:27:12.409 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.100011463000001, 2020-11-12T17:27:12.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23974263300000001, 2020-11-12T17:27:12.409 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.409 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:12.409 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.305572+0000", 2020-11-12T17:27:12.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.305572+0000", 2020-11-12T17:27:12.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:12.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.305548+0000", 2020-11-12T17:27:12.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109008 2020-11-12T17:27:12.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.305657+0000", 2020-11-12T17:27:12.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23570945500000001 2020-11-12T17:27:12.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.541366+0000", 2020-11-12T17:27:12.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8312999999999999e-05 2020-11-12T17:27:12.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.541384+0000", 2020-11-12T17:27:12.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012287999999999999 2020-11-12T17:27:12.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.541507+0000", 2020-11-12T17:27:12.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3642000000000001e-05 2020-11-12T17:27:12.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.541521+0000", 2020-11-12T17:27:12.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0037936810000000001 2020-11-12T17:27:12.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:26.545315+0000", 2020-11-12T17:27:12.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.23974263300000001 2020-11-12T17:27:12.417 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.417 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.417 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.417 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79390 4.6 4:6b9a5644:::benchmark_data_smithi036_18856_object3001:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:12.418 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.783961+0000", 2020-11-12T17:27:12.418 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.621622586000001, 2020-11-12T17:27:12.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20911914700000001, 2020-11-12T17:27:12.418 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.418 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.418 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.418 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.419 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.419 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79390 2020-11-12T17:27:12.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.419 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783961+0000", 2020-11-12T17:27:12.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783961+0000", 2020-11-12T17:27:12.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:12.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783943+0000", 2020-11-12T17:27:12.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9338000000000002e-05 2020-11-12T17:27:12.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783982+0000", 2020-11-12T17:27:12.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8519999999999993e-06 2020-11-12T17:27:12.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783991+0000", 2020-11-12T17:27:12.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9230000000000001e-06 2020-11-12T17:27:12.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.783996+0000", 2020-11-12T17:27:12.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002089259 2020-11-12T17:27:12.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786085+0000", 2020-11-12T17:27:12.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8379000000000001e-05 2020-11-12T17:27:12.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786184+0000", 2020-11-12T17:27:12.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.10086397499999999 2020-11-12T17:27:12.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.887048+0000", 2020-11-12T17:27:12.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001011709 2020-11-12T17:27:12.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:12.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.888059+0000", 2020-11-12T17:27:12.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014209929 2020-11-12T17:27:12.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.902269+0000", 2020-11-12T17:27:12.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00093186099999999997 2020-11-12T17:27:12.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.903201+0000", 2020-11-12T17:27:12.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.062629629000000006 2020-11-12T17:27:12.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.965831+0000", 2020-11-12T17:27:12.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00088726099999999997 2020-11-12T17:27:12.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.966718+0000", 2020-11-12T17:27:12.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041800530000000004 2020-11-12T17:27:12.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.970898+0000", 2020-11-12T17:27:12.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0074384259999999997 2020-11-12T17:27:12.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.978337+0000", 2020-11-12T17:27:12.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01159206 2020-11-12T17:27:12.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.989929+0000", 2020-11-12T17:27:12.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000483497 2020-11-12T17:27:12.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.990412+0000", 2020-11-12T17:27:12.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026678190000000001 2020-11-12T17:27:12.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.993080+0000", 2020-11-12T17:27:12.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20911914700000001 2020-11-12T17:27:12.434 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.434 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.434 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.435 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79391 4.6 4:6e7dc729:::benchmark_data_smithi036_18856_object3002:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:12.435 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784034+0000", 2020-11-12T17:27:12.435 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.621548937999997, 2020-11-12T17:27:12.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26640469999999999, 2020-11-12T17:27:12.435 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.435 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.435 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.436 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.436 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79391 2020-11-12T17:27:12.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.436 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784034+0000", 2020-11-12T17:27:12.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784034+0000", 2020-11-12T17:27:12.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999843 2020-11-12T17:27:12.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784019+0000", 2020-11-12T17:27:12.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4554999999999997e-05 2020-11-12T17:27:12.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784053+0000", 2020-11-12T17:27:12.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7169999999999996e-06 2020-11-12T17:27:12.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784059+0000", 2020-11-12T17:27:12.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8339999999999999e-06 2020-11-12T17:27:12.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784062+0000", 2020-11-12T17:27:12.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002235192 2020-11-12T17:27:12.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786297+0000", 2020-11-12T17:27:12.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4545999999999999e-05 2020-11-12T17:27:12.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786392+0000", 2020-11-12T17:27:12.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.109122783 2020-11-12T17:27:12.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.895515+0000", 2020-11-12T17:27:12.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0010120229999999999 2020-11-12T17:27:12.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:12.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.896527+0000", 2020-11-12T17:27:12.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014502137 2020-11-12T17:27:12.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.911029+0000", 2020-11-12T17:27:12.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058240500000000003 2020-11-12T17:27:12.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.911611+0000", 2020-11-12T17:27:12.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.085697619000000003 2020-11-12T17:27:12.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.997309+0000", 2020-11-12T17:27:12.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00056207399999999997 2020-11-12T17:27:12.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.997871+0000", 2020-11-12T17:27:12.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015531010000000001 2020-11-12T17:27:12.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.999424+0000", 2020-11-12T17:27:12.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.018730159 2020-11-12T17:27:12.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.018154+0000", 2020-11-12T17:27:12.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.030326388999999999 2020-11-12T17:27:12.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048480+0000", 2020-11-12T17:27:12.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000470428 2020-11-12T17:27:12.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048951+0000", 2020-11-12T17:27:12.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001488243 2020-11-12T17:27:12.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.050439+0000", 2020-11-12T17:27:12.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26640469999999999 2020-11-12T17:27:12.449 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.449 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.450 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79397 4.6 4:6825e0e9:::benchmark_data_smithi036_18856_object3008:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:12.450 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784088+0000", 2020-11-12T17:27:12.450 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.621495259, 2020-11-12T17:27:12.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27021019000000002, 2020-11-12T17:27:12.451 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.451 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.451 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.451 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.451 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.451 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79397 2020-11-12T17:27:12.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.451 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784088+0000", 2020-11-12T17:27:12.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784088+0000", 2020-11-12T17:27:12.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:12.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784072+0000", 2020-11-12T17:27:12.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6395e-05 2020-11-12T17:27:12.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784108+0000", 2020-11-12T17:27:12.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3360000000000002e-06 2020-11-12T17:27:12.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784113+0000", 2020-11-12T17:27:12.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.5739999999999998e-06 2020-11-12T17:27:12.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784116+0000", 2020-11-12T17:27:12.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023870150000000001 2020-11-12T17:27:12.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786503+0000", 2020-11-12T17:27:12.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6372000000000006e-05 2020-11-12T17:27:12.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786589+0000", 2020-11-12T17:27:12.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12705815400000001 2020-11-12T17:27:12.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.913647+0000", 2020-11-12T17:27:12.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00084020999999999998 2020-11-12T17:27:12.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:12.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.914488+0000", 2020-11-12T17:27:12.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0073717599999999998 2020-11-12T17:27:12.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.921859+0000", 2020-11-12T17:27:12.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00053059299999999999 2020-11-12T17:27:12.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.922390+0000", 2020-11-12T17:27:12.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.086459424000000007 2020-11-12T17:27:12.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.008849+0000", 2020-11-12T17:27:12.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016892280000000001 2020-11-12T17:27:12.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.010539+0000", 2020-11-12T17:27:12.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014236769999999999 2020-11-12T17:27:12.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.011962+0000", 2020-11-12T17:27:12.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015307659 2020-11-12T17:27:12.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.027270+0000", 2020-11-12T17:27:12.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.023527362999999999 2020-11-12T17:27:12.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.050797+0000", 2020-11-12T17:27:12.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00031991399999999997 2020-11-12T17:27:12.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.051117+0000", 2020-11-12T17:27:12.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003181105 2020-11-12T17:27:12.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.054298+0000", 2020-11-12T17:27:12.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27021019000000002 2020-11-12T17:27:12.464 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.465 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.465 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79399 4.6 4:68f1ef91:::benchmark_data_smithi036_18856_object3010:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:12.465 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784141+0000", 2020-11-12T17:27:12.465 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.621442137000003, 2020-11-12T17:27:12.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27249312599999997, 2020-11-12T17:27:12.466 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.466 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.466 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79399 2020-11-12T17:27:12.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.467 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784141+0000", 2020-11-12T17:27:12.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784141+0000", 2020-11-12T17:27:12.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:27:12.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784125+0000", 2020-11-12T17:27:12.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4362000000000001e-05 2020-11-12T17:27:12.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784159+0000", 2020-11-12T17:27:12.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1970000000000004e-06 2020-11-12T17:27:12.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784164+0000", 2020-11-12T17:27:12.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.4090000000000001e-06 2020-11-12T17:27:12.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784167+0000", 2020-11-12T17:27:12.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025213670000000001 2020-11-12T17:27:12.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786688+0000", 2020-11-12T17:27:12.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2043e-05 2020-11-12T17:27:12.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786770+0000", 2020-11-12T17:27:12.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12782432899999999 2020-11-12T17:27:12.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.914595+0000", 2020-11-12T17:27:12.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00077399200000000004 2020-11-12T17:27:12.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:12.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.915369+0000", 2020-11-12T17:27:12.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012468406 2020-11-12T17:27:12.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.927837+0000", 2020-11-12T17:27:12.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000573961 2020-11-12T17:27:12.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.928411+0000", 2020-11-12T17:27:12.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.089901977999999994 2020-11-12T17:27:12.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.018313+0000", 2020-11-12T17:27:12.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00084238599999999998 2020-11-12T17:27:12.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.019155+0000", 2020-11-12T17:27:12.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001500312 2020-11-12T17:27:12.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.020656+0000", 2020-11-12T17:27:12.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.019130365 2020-11-12T17:27:12.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.039786+0000", 2020-11-12T17:27:12.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014855834 2020-11-12T17:27:12.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.054642+0000", 2020-11-12T17:27:12.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000408148 2020-11-12T17:27:12.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.055050+0000", 2020-11-12T17:27:12.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015843439999999999 2020-11-12T17:27:12.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.056634+0000", 2020-11-12T17:27:12.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27249312599999997 2020-11-12T17:27:12.480 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.480 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.480 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.480 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79403 4.6 4:6e007c0e:::benchmark_data_smithi036_18856_object3014:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:12.481 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784192+0000", 2020-11-12T17:27:12.481 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.621391189000001, 2020-11-12T17:27:12.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27453512099999999, 2020-11-12T17:27:12.481 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.481 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.481 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.482 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.482 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.482 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79403 2020-11-12T17:27:12.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.482 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784192+0000", 2020-11-12T17:27:12.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784192+0000", 2020-11-12T17:27:12.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:27:12.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784176+0000", 2020-11-12T17:27:12.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4178999999999999e-05 2020-11-12T17:27:12.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784210+0000", 2020-11-12T17:27:12.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2920000000000003e-06 2020-11-12T17:27:12.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784215+0000", 2020-11-12T17:27:12.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5140000000000002e-06 2020-11-12T17:27:12.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784219+0000", 2020-11-12T17:27:12.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026573870000000002 2020-11-12T17:27:12.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786876+0000", 2020-11-12T17:27:12.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9260999999999998e-05 2020-11-12T17:27:12.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.786965+0000", 2020-11-12T17:27:12.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12850199800000001 2020-11-12T17:27:12.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.915467+0000", 2020-11-12T17:27:12.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00085655900000000001 2020-11-12T17:27:12.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:12.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.916324+0000", 2020-11-12T17:27:12.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016789193000000001 2020-11-12T17:27:12.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.933113+0000", 2020-11-12T17:27:12.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00061463999999999996 2020-11-12T17:27:12.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.933728+0000", 2020-11-12T17:27:12.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093685151999999994 2020-11-12T17:27:12.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.027413+0000", 2020-11-12T17:27:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00082315199999999995 2020-11-12T17:27:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.028236+0000", 2020-11-12T17:27:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001283649 2020-11-12T17:27:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.029520+0000", 2020-11-12T17:27:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.018622367000000001 2020-11-12T17:27:12.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048142+0000", 2020-11-12T17:27:12.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088035240000000001 2020-11-12T17:27:12.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.056946+0000", 2020-11-12T17:27:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047613199999999999 2020-11-12T17:27:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.057422+0000", 2020-11-12T17:27:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001305481 2020-11-12T17:27:12.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.058727+0000", 2020-11-12T17:27:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27453512099999999 2020-11-12T17:27:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.496 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79413 4.6 4:67cb455f:::benchmark_data_smithi036_18856_object3024:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:12.496 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:27:12.496 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.621333043, 2020-11-12T17:27:12.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27681071899999998, 2020-11-12T17:27:12.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.496 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.496 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79413 2020-11-12T17:27:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:27:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:27:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:12.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784228+0000", 2020-11-12T17:27:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3021e-05 2020-11-12T17:27:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784271+0000", 2020-11-12T17:27:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8409999999999995e-06 2020-11-12T17:27:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784280+0000", 2020-11-12T17:27:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6380000000000003e-06 2020-11-12T17:27:12.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784285+0000", 2020-11-12T17:27:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027973920000000001 2020-11-12T17:27:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787083+0000", 2020-11-12T17:27:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7495000000000001e-05 2020-11-12T17:27:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787180+0000", 2020-11-12T17:27:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12926628300000001 2020-11-12T17:27:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.916446+0000", 2020-11-12T17:27:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00093402899999999996 2020-11-12T17:27:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.917380+0000", 2020-11-12T17:27:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020407538999999999 2020-11-12T17:27:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.937788+0000", 2020-11-12T17:27:12.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000401386 2020-11-12T17:27:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.938189+0000", 2020-11-12T17:27:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.097742617000000004 2020-11-12T17:27:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.035932+0000", 2020-11-12T17:27:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00070456200000000005 2020-11-12T17:27:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.036636+0000", 2020-11-12T17:27:12.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001004916 2020-11-12T17:27:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.037641+0000", 2020-11-12T17:27:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012882807 2020-11-12T17:27:12.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.050524+0000", 2020-11-12T17:27:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084925529999999999 2020-11-12T17:27:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.059017+0000", 2020-11-12T17:27:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041484399999999999 2020-11-12T17:27:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.059432+0000", 2020-11-12T17:27:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016295210000000001 2020-11-12T17:27:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061061+0000", 2020-11-12T17:27:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27681071899999998 2020-11-12T17:27:12.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79414 4.6 4:60cd86ce:::benchmark_data_smithi036_18856_object3025:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:27:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:27:12.511 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.621256578999997, 2020-11-12T17:27:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998, 2020-11-12T17:27:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.512 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79414 2020-11-12T17:27:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:27:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:27:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:27:12.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784303+0000", 2020-11-12T17:27:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4221999999999997e-05 2020-11-12T17:27:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784358+0000", 2020-11-12T17:27:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8389999999999996e-06 2020-11-12T17:27:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784366+0000", 2020-11-12T17:27:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2040000000000002e-06 2020-11-12T17:27:12.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784370+0000", 2020-11-12T17:27:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029216049999999999 2020-11-12T17:27:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787291+0000", 2020-11-12T17:27:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3842e-05 2020-11-12T17:27:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787385+0000", 2020-11-12T17:27:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15210379399999999 2020-11-12T17:27:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.939489+0000", 2020-11-12T17:27:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00095422699999999998 2020-11-12T17:27:12.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940443+0000", 2020-11-12T17:27:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092951600000000002 2020-11-12T17:27:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.949738+0000", 2020-11-12T17:27:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00060685800000000005 2020-11-12T17:27:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.950345+0000", 2020-11-12T17:27:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093005117999999998 2020-11-12T17:27:12.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.043350+0000", 2020-11-12T17:27:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001029147 2020-11-12T17:27:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.044379+0000", 2020-11-12T17:27:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001543397 2020-11-12T17:27:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045923+0000", 2020-11-12T17:27:12.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015442345999999999 2020-11-12T17:27:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061365+0000", 2020-11-12T17:27:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0095990889999999999 2020-11-12T17:27:12.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.070964+0000", 2020-11-12T17:27:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000446744 2020-11-12T17:27:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.071411+0000", 2020-11-12T17:27:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001655534 2020-11-12T17:27:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.073066+0000", 2020-11-12T17:27:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998 2020-11-12T17:27:12.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79425 4.6 4:6231d6c2:::benchmark_data_smithi036_18856_object3036:head [delete] snapc 0=[] ondisk+write+known_if_redirected e118)", 2020-11-12T17:27:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:27:12.527 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.621183082999998, 2020-11-12T17:27:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002, 2020-11-12T17:27:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.528 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79425 2020-11-12T17:27:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:27:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:27:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784379+0000", 2020-11-12T17:27:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6152000000000001e-05 2020-11-12T17:27:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784426+0000", 2020-11-12T17:27:12.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6860000000000003e-06 2020-11-12T17:27:12.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784431+0000", 2020-11-12T17:27:12.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6460000000000002e-06 2020-11-12T17:27:12.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784434+0000", 2020-11-12T17:27:12.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030643549999999999 2020-11-12T17:27:12.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787498+0000", 2020-11-12T17:27:12.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100717 2020-11-12T17:27:12.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787599+0000", 2020-11-12T17:27:12.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15298814699999999 2020-11-12T17:27:12.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940587+0000", 2020-11-12T17:27:12.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00097205100000000003 2020-11-12T17:27:12.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:27:12.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.941559+0000", 2020-11-12T17:27:12.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.019466477999999999 2020-11-12T17:27:12.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961026+0000", 2020-11-12T17:27:12.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058434100000000005 2020-11-12T17:27:12.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961610+0000", 2020-11-12T17:27:12.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13222599700000001 2020-11-12T17:27:12.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.093836+0000", 2020-11-12T17:27:12.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089939299999999996 2020-11-12T17:27:12.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.094735+0000", 2020-11-12T17:27:12.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001382973 2020-11-12T17:27:12.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.096118+0000", 2020-11-12T17:27:12.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046953350000000001 2020-11-12T17:27:12.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100814+0000", 2020-11-12T17:27:12.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9295000000000006e-05 2020-11-12T17:27:12.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100893+0000", 2020-11-12T17:27:12.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00035136400000000001 2020-11-12T17:27:12.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.101244+0000", 2020-11-12T17:27:12.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015508290000000001 2020-11-12T17:27:12.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.102795+0000", 2020-11-12T17:27:12.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002 2020-11-12T17:27:12.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.543 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79401 4.4 4:25438865:::benchmark_data_smithi036_18856_object3012:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e119)", 2020-11-12T17:27:12.543 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.857685+0000", 2020-11-12T17:27:12.543 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.54789856, 2020-11-12T17:27:12.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.187629875, 2020-11-12T17:27:12.543 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.543 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.544 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.544 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79401 2020-11-12T17:27:12.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.544 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857685+0000", 2020-11-12T17:27:12.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857685+0000", 2020-11-12T17:27:12.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:12.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857654+0000", 2020-11-12T17:27:12.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3609999999999995e-05 2020-11-12T17:27:12.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857728+0000", 2020-11-12T17:27:12.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3895e-05 2020-11-12T17:27:12.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857742+0000", 2020-11-12T17:27:12.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4590000000000003e-06 2020-11-12T17:27:12.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857748+0000", 2020-11-12T17:27:12.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013889449999999999 2020-11-12T17:27:12.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859137+0000", 2020-11-12T17:27:12.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1497999999999998e-05 2020-11-12T17:27:12.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859219+0000", 2020-11-12T17:27:12.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13087527900000001 2020-11-12T17:27:12.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.990094+0000", 2020-11-12T17:27:12.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030763769999999999 2020-11-12T17:27:12.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.993171+0000", 2020-11-12T17:27:12.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013953699999999999 2020-11-12T17:27:12.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.007124+0000", 2020-11-12T17:27:12.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028362610000000001 2020-11-12T17:27:12.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.009960+0000", 2020-11-12T17:27:12.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013466579999999999 2020-11-12T17:27:12.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.011307+0000", 2020-11-12T17:27:12.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.021019012 2020-11-12T17:27:12.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.032326+0000", 2020-11-12T17:27:12.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010007744000000001 2020-11-12T17:27:12.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.042334+0000", 2020-11-12T17:27:12.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000521029 2020-11-12T17:27:12.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.042855+0000", 2020-11-12T17:27:12.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00245978 2020-11-12T17:27:12.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045315+0000", 2020-11-12T17:27:12.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.187629875 2020-11-12T17:27:12.555 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.555 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.556 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79416 4.4 4:22d6f45f:::benchmark_data_smithi036_18856_object3027:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e119)", 2020-11-12T17:27:12.556 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.857799+0000", 2020-11-12T17:27:12.556 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.547784872000001, 2020-11-12T17:27:12.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19034758600000001, 2020-11-12T17:27:12.556 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.557 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.557 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79416 2020-11-12T17:27:12.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.557 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857799+0000", 2020-11-12T17:27:12.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857799+0000", 2020-11-12T17:27:12.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:12.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857769+0000", 2020-11-12T17:27:12.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4016999999999994e-05 2020-11-12T17:27:12.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857833+0000", 2020-11-12T17:27:12.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9969999999999999e-05 2020-11-12T17:27:12.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857863+0000", 2020-11-12T17:27:12.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2389999999999996e-06 2020-11-12T17:27:12.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857871+0000", 2020-11-12T17:27:12.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014463119999999999 2020-11-12T17:27:12.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859317+0000", 2020-11-12T17:27:12.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5130000000000007e-05 2020-11-12T17:27:12.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859402+0000", 2020-11-12T17:27:12.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13559057499999999 2020-11-12T17:27:12.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.994993+0000", 2020-11-12T17:27:12.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029052150000000001 2020-11-12T17:27:12.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.997898+0000", 2020-11-12T17:27:12.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.025284017999999998 2020-11-12T17:27:12.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.023182+0000", 2020-11-12T17:27:12.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00081558499999999996 2020-11-12T17:27:12.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.023997+0000", 2020-11-12T17:27:12.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001639794 2020-11-12T17:27:12.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.025637+0000", 2020-11-12T17:27:12.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016307182999999999 2020-11-12T17:27:12.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.041944+0000", 2020-11-12T17:27:12.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036568350000000002 2020-11-12T17:27:12.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045601+0000", 2020-11-12T17:27:12.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058173000000000003 2020-11-12T17:27:12.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.046183+0000", 2020-11-12T17:27:12.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019631929999999998 2020-11-12T17:27:12.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048146+0000", 2020-11-12T17:27:12.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19034758600000001 2020-11-12T17:27:12.569 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.569 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.569 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.569 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79418 4.4 4:2df6bf66:::benchmark_data_smithi036_18856_object3029:head [delete] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e119)", 2020-11-12T17:27:12.570 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.857920+0000", 2020-11-12T17:27:12.570 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.547663223999997, 2020-11-12T17:27:12.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19827366399999999, 2020-11-12T17:27:12.570 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.570 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.570 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.570 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.571 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.571 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79418 2020-11-12T17:27:12.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.571 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857920+0000", 2020-11-12T17:27:12.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857920+0000", 2020-11-12T17:27:12.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:12.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857891+0000", 2020-11-12T17:27:12.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7623e-05 2020-11-12T17:27:12.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857959+0000", 2020-11-12T17:27:12.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.146e-05 2020-11-12T17:27:12.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857970+0000", 2020-11-12T17:27:12.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0939999999999998e-06 2020-11-12T17:27:12.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857975+0000", 2020-11-12T17:27:12.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015305290000000001 2020-11-12T17:27:12.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859506+0000", 2020-11-12T17:27:12.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102643 2020-11-12T17:27:12.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859608+0000", 2020-11-12T17:27:12.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13842854099999999 2020-11-12T17:27:12.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.998037+0000", 2020-11-12T17:27:12.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003550189 2020-11-12T17:27:12.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.001587+0000", 2020-11-12T17:27:12.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.030874755 2020-11-12T17:27:12.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.032462+0000", 2020-11-12T17:27:12.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055100779999999999 2020-11-12T17:27:12.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.037972+0000", 2020-11-12T17:27:12.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001166217 2020-11-12T17:27:12.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.039138+0000", 2020-11-12T17:27:12.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0094076539999999997 2020-11-12T17:27:12.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048546+0000", 2020-11-12T17:27:12.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028954509999999998 2020-11-12T17:27:12.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.051441+0000", 2020-11-12T17:27:12.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00040610400000000001 2020-11-12T17:27:12.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.051847+0000", 2020-11-12T17:27:12.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0043465910000000003 2020-11-12T17:27:12.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.056194+0000", 2020-11-12T17:27:12.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19827366399999999 2020-11-12T17:27:12.583 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.583 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.583 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.584 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79428 4.4 4:22bf5a49:::benchmark_data_smithi036_18856_object3039:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:12.584 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858023+0000", 2020-11-12T17:27:12.584 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.547560539999999, 2020-11-12T17:27:12.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24856752300000001, 2020-11-12T17:27:12.584 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.584 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.584 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.585 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.585 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.585 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79428 2020-11-12T17:27:12.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.585 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858023+0000", 2020-11-12T17:27:12.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858023+0000", 2020-11-12T17:27:12.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:12.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.857994+0000", 2020-11-12T17:27:12.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5454e-05 2020-11-12T17:27:12.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858059+0000", 2020-11-12T17:27:12.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0309000000000001e-05 2020-11-12T17:27:12.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858069+0000", 2020-11-12T17:27:12.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4179999999999999e-06 2020-11-12T17:27:12.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858074+0000", 2020-11-12T17:27:12.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00164905 2020-11-12T17:27:12.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859723+0000", 2020-11-12T17:27:12.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060600000000001 2020-11-12T17:27:12.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859824+0000", 2020-11-12T17:27:12.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.18886477099999999 2020-11-12T17:27:12.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.048688+0000", 2020-11-12T17:27:12.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002647969 2020-11-12T17:27:12.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.051336+0000", 2020-11-12T17:27:12.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013767546 2020-11-12T17:27:12.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.065104+0000", 2020-11-12T17:27:12.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00077796699999999996 2020-11-12T17:27:12.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.065882+0000", 2020-11-12T17:27:12.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022998379999999998 2020-11-12T17:27:12.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.068182+0000", 2020-11-12T17:27:12.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010604894 2020-11-12T17:27:12.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.078787+0000", 2020-11-12T17:27:12.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.025585614 2020-11-12T17:27:12.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.104372+0000", 2020-11-12T17:27:12.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047144999999999999 2020-11-12T17:27:12.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.104844+0000", 2020-11-12T17:27:12.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017467990000000001 2020-11-12T17:27:12.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.106590+0000", 2020-11-12T17:27:12.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24856752300000001 2020-11-12T17:27:12.597 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.597 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.597 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.598 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79432 4.4 4:250eda9c:::benchmark_data_smithi036_18856_object3043:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:12.598 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858121+0000", 2020-11-12T17:27:12.598 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.547462682999999, 2020-11-12T17:27:12.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.261755611, 2020-11-12T17:27:12.598 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.598 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.598 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.599 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.599 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.599 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79432 2020-11-12T17:27:12.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.599 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858121+0000", 2020-11-12T17:27:12.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858121+0000", 2020-11-12T17:27:12.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:12.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858092+0000", 2020-11-12T17:27:12.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5640000000000002e-05 2020-11-12T17:27:12.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858157+0000", 2020-11-12T17:27:12.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1080999999999999e-05 2020-11-12T17:27:12.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858169+0000", 2020-11-12T17:27:12.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3159999999999998e-06 2020-11-12T17:27:12.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858173+0000", 2020-11-12T17:27:12.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017682209999999999 2020-11-12T17:27:12.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.859941+0000", 2020-11-12T17:27:12.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010119 2020-11-12T17:27:12.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860042+0000", 2020-11-12T17:27:12.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19624609100000001 2020-11-12T17:27:12.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.056288+0000", 2020-11-12T17:27:12.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022598779999999999 2020-11-12T17:27:12.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.058548+0000", 2020-11-12T17:27:12.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020361628999999999 2020-11-12T17:27:12.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.078910+0000", 2020-11-12T17:27:12.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034346630000000001 2020-11-12T17:27:12.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.082345+0000", 2020-11-12T17:27:12.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001544704 2020-11-12T17:27:12.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.083889+0000", 2020-11-12T17:27:12.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.022802319000000001 2020-11-12T17:27:12.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.106692+0000", 2020-11-12T17:27:12.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010718955 2020-11-12T17:27:12.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.117410+0000", 2020-11-12T17:27:12.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00050719000000000003 2020-11-12T17:27:12.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.117918+0000", 2020-11-12T17:27:12.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019586249999999999 2020-11-12T17:27:12.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.119876+0000", 2020-11-12T17:27:12.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.261755611 2020-11-12T17:27:12.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.611 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.612 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79476 4.4 4:281d6804:::benchmark_data_smithi036_18856_object3087:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:12.612 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858220+0000", 2020-11-12T17:27:12.612 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.547363742000002, 2020-11-12T17:27:12.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26431898999999998, 2020-11-12T17:27:12.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.613 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.613 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.613 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.613 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.613 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79476 2020-11-12T17:27:12.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.614 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858220+0000", 2020-11-12T17:27:12.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858220+0000", 2020-11-12T17:27:12.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:27:12.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858190+0000", 2020-11-12T17:27:12.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3869999999999997e-05 2020-11-12T17:27:12.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858254+0000", 2020-11-12T17:27:12.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6199999999999994e-06 2020-11-12T17:27:12.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858264+0000", 2020-11-12T17:27:12.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2080000000000002e-06 2020-11-12T17:27:12.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858268+0000", 2020-11-12T17:27:12.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001939681 2020-11-12T17:27:12.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860208+0000", 2020-11-12T17:27:12.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1810999999999994e-05 2020-11-12T17:27:12.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860279+0000", 2020-11-12T17:27:12.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19839869500000001 2020-11-12T17:27:12.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.058678+0000", 2020-11-12T17:27:12.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026451830000000002 2020-11-12T17:27:12.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061323+0000", 2020-11-12T17:27:12.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.030355449999999999 2020-11-12T17:27:12.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.091679+0000", 2020-11-12T17:27:12.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094524599999999996 2020-11-12T17:27:12.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.092624+0000", 2020-11-12T17:27:12.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015080009999999999 2020-11-12T17:27:12.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.094132+0000", 2020-11-12T17:27:12.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.026341926000000002 2020-11-12T17:27:12.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.120474+0000", 2020-11-12T17:27:12.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5223999999999995e-05 2020-11-12T17:27:12.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.120569+0000", 2020-11-12T17:27:12.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00048331399999999999 2020-11-12T17:27:12.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.121053+0000", 2020-11-12T17:27:12.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001486102 2020-11-12T17:27:12.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.122539+0000", 2020-11-12T17:27:12.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26431898999999998 2020-11-12T17:27:12.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.626 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.627 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79478 4.4 4:29d6f2d6:::benchmark_data_smithi036_18856_object3089:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:12.627 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858314+0000", 2020-11-12T17:27:12.627 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.547269231999998, 2020-11-12T17:27:12.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26647947500000002, 2020-11-12T17:27:12.627 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.627 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.628 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.628 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.628 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.628 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79478 2020-11-12T17:27:12.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.628 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858314+0000", 2020-11-12T17:27:12.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858314+0000", 2020-11-12T17:27:12.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:12.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858285+0000", 2020-11-12T17:27:12.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3604999999999998e-05 2020-11-12T17:27:12.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858349+0000", 2020-11-12T17:27:12.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2490000000000007e-06 2020-11-12T17:27:12.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858358+0000", 2020-11-12T17:27:12.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6120000000000001e-06 2020-11-12T17:27:12.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858363+0000", 2020-11-12T17:27:12.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001992359 2020-11-12T17:27:12.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860355+0000", 2020-11-12T17:27:12.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2812999999999996e-05 2020-11-12T17:27:12.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860428+0000", 2020-11-12T17:27:12.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.21104400300000001 2020-11-12T17:27:12.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.071472+0000", 2020-11-12T17:27:12.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034313009999999999 2020-11-12T17:27:12.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.074903+0000", 2020-11-12T17:27:12.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.036768064000000003 2020-11-12T17:27:12.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.111671+0000", 2020-11-12T17:27:12.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000935147 2020-11-12T17:27:12.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.112606+0000", 2020-11-12T17:27:12.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012937140000000001 2020-11-12T17:27:12.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.113900+0000", 2020-11-12T17:27:12.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088719909999999992 2020-11-12T17:27:12.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.122772+0000", 2020-11-12T17:27:12.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8303e-05 2020-11-12T17:27:12.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.122841+0000", 2020-11-12T17:27:12.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00033598699999999999 2020-11-12T17:27:12.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.123176+0000", 2020-11-12T17:27:12.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016171390000000001 2020-11-12T17:27:12.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.124794+0000", 2020-11-12T17:27:12.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26647947500000002 2020-11-12T17:27:12.640 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.640 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.640 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.640 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79491 4.4 4:2feb571e:::benchmark_data_smithi036_18856_object3102:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:27:12.641 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:27:12.641 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.547171157000001, 2020-11-12T17:27:12.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458, 2020-11-12T17:27:12.641 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.641 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.641 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.641 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:12.642 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:12.642 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79491 2020-11-12T17:27:12.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.642 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:27:12.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:27:12.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:12.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858382+0000", 2020-11-12T17:27:12.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8493999999999998e-05 2020-11-12T17:27:12.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858450+0000", 2020-11-12T17:27:12.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:27:12.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858460+0000", 2020-11-12T17:27:12.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5260000000000004e-06 2020-11-12T17:27:12.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858465+0000", 2020-11-12T17:27:12.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002042622 2020-11-12T17:27:12.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860507+0000", 2020-11-12T17:27:12.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5987000000000003e-05 2020-11-12T17:27:12.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:27:12.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860583+0000", 2020-11-12T17:27:12.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.264296631 2020-11-12T17:27:12.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.124880+0000", 2020-11-12T17:27:12.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00260079 2020-11-12T17:27:12.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:27:12.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.127481+0000", 2020-11-12T17:27:12.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015473191000000001 2020-11-12T17:27:12.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.142954+0000", 2020-11-12T17:27:12.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068121100000000003 2020-11-12T17:27:12.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.143635+0000", 2020-11-12T17:27:12.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014373840000000001 2020-11-12T17:27:12.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:12.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.145073+0000", 2020-11-12T17:27:12.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020755122000000001 2020-11-12T17:27:12.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.165828+0000", 2020-11-12T17:27:12.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047732520000000004 2020-11-12T17:27:12.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.170601+0000", 2020-11-12T17:27:12.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00046765100000000003 2020-11-12T17:27:12.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.171069+0000", 2020-11-12T17:27:12.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018080010000000001 2020-11-12T17:27:12.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.172877+0000", 2020-11-12T17:27:12.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458 2020-11-12T17:27:12.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.654 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.654 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:14736 5.0 e137/135 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head v 137'896, mlcod=137'891)", 2020-11-12T17:27:12.655 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:27:12.655 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.345368586999999, 2020-11-12T17:27:12.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999, 2020-11-12T17:27:12.655 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.655 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.655 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:27:12.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:27:12.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:27:12.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060202+0000", 2020-11-12T17:27:12.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8984000000000003e-05 2020-11-12T17:27:12.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060261+0000", 2020-11-12T17:27:12.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56005787699999998 2020-11-12T17:27:12.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620318+0000", 2020-11-12T17:27:12.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8369999999999999e-06 2020-11-12T17:27:12.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620325+0000", 2020-11-12T17:27:12.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012664800000000001 2020-11-12T17:27:12.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620452+0000", 2020-11-12T17:27:12.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3432e-05 2020-11-12T17:27:12.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620495+0000", 2020-11-12T17:27:12.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002919905 2020-11-12T17:27:12.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623415+0000", 2020-11-12T17:27:12.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9338999999999995e-05 2020-11-12T17:27:12.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623485+0000", 2020-11-12T17:27:12.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999 2020-11-12T17:27:12.662 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.662 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.662 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.663 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:15792 5.5 e138/136 5:a4d2ef9e:::benchmark_data_smithi036_24110_object1973:head v 138'936, mlcod=138'930)", 2020-11-12T17:27:12.663 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:03.229865+0000", 2020-11-12T17:27:12.663 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.1757179030000007, 2020-11-12T17:27:12.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.182325246, 2020-11-12T17:27:12.663 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.663 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.663 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.229865+0000", 2020-11-12T17:27:12.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.229865+0000", 2020-11-12T17:27:12.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999738 2020-11-12T17:27:12.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.229839+0000", 2020-11-12T17:27:12.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013531599999999999 2020-11-12T17:27:12.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.229974+0000", 2020-11-12T17:27:12.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.17983930400000001 2020-11-12T17:27:12.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.409814+0000", 2020-11-12T17:27:12.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9340000000000003e-06 2020-11-12T17:27:12.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.409820+0000", 2020-11-12T17:27:12.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9249000000000001e-05 2020-11-12T17:27:12.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.409889+0000", 2020-11-12T17:27:12.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9299999999999999e-05 2020-11-12T17:27:12.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.409938+0000", 2020-11-12T17:27:12.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021856179999999998 2020-11-12T17:27:12.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.412124+0000", 2020-11-12T17:27:12.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6931e-05 2020-11-12T17:27:12.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.412191+0000", 2020-11-12T17:27:12.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.182325246 2020-11-12T17:27:12.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.670 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.671 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:20768 5.8 e143/135 5:1bb0bc44:::benchmark_data_smithi036_24110_object2595:head v 143'1296, mlcod=143'1290)", 2020-11-12T17:27:12.671 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:08.743315+0000", 2020-11-12T17:27:12.671 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.6622681350000001, 2020-11-12T17:27:12.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20682036300000001, 2020-11-12T17:27:12.671 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.672 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:12.672 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.743315+0000", 2020-11-12T17:27:12.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.743315+0000", 2020-11-12T17:27:12.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:12.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.743300+0000", 2020-11-12T17:27:12.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2295e-05 2020-11-12T17:27:12.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.743352+0000", 2020-11-12T17:27:12.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.205367724 2020-11-12T17:27:12.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.948720+0000", 2020-11-12T17:27:12.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5299999999999996e-06 2020-11-12T17:27:12.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.948728+0000", 2020-11-12T17:27:12.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0722e-05 2020-11-12T17:27:12.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.948779+0000", 2020-11-12T17:27:12.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.2480000000000002e-05 2020-11-12T17:27:12.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.948802+0000", 2020-11-12T17:27:12.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001257916 2020-11-12T17:27:12.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:12.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.950059+0000", 2020-11-12T17:27:12.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6192999999999994e-05 2020-11-12T17:27:12.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:12.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:08.950136+0000", 2020-11-12T17:27:12.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.20682036300000001 2020-11-12T17:27:12.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.679 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.679 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.679 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:12.681 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:12.681 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:12.683 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:12.684 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:12.684 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:12.685 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:12.685 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:12.685 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:12.686 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:12.686 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:12.686 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 26 16 24838 24822 7.45782 8.41406 0.0105943 0.0167396 2020-11-12T17:27:12.687 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:12.676+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:12.688 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:12.782 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:12.778+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:12.854 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25176 5.6 5:6892afcd:::benchmark_data_smithi036_24110_object3146:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.839273+0000", 2020-11-12T17:27:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.013462576, 2020-11-12T17:27:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013499738000000001, 2020-11-12T17:27:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25176 2020-11-12T17:27:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.839273+0000", 2020-11-12T17:27:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.839273+0000", 2020-11-12T17:27:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.839242+0000", 2020-11-12T17:27:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6719999999999996e-05 2020-11-12T17:27:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.839338+0000", 2020-11-12T17:27:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9215000000000002e-05 2020-11-12T17:27:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.839357+0000", 2020-11-12T17:27:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5509999999999999e-06 2020-11-12T17:27:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.839363+0000", 2020-11-12T17:27:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0053645289999999998 2020-11-12T17:27:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.844728+0000", 2020-11-12T17:27:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014569 2020-11-12T17:27:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.844873+0000", 2020-11-12T17:27:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000250437 2020-11-12T17:27:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.845124+0000", 2020-11-12T17:27:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003618319 2020-11-12T17:27:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.848742+0000", 2020-11-12T17:27:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0094691689999999995 2020-11-12T17:27:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25177 5.8 5:1376063c:::benchmark_data_smithi036_24110_object3147:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.841381+0000", 2020-11-12T17:27:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.011354561000000001, 2020-11-12T17:27:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011547452999999999, 2020-11-12T17:27:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25177 2020-11-12T17:27:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.841381+0000", 2020-11-12T17:27:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.841381+0000", 2020-11-12T17:27:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.841347+0000", 2020-11-12T17:27:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7547000000000006e-05 2020-11-12T17:27:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.841444+0000", 2020-11-12T17:27:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4953000000000001e-05 2020-11-12T17:27:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.841459+0000", 2020-11-12T17:27:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0559999999999999e-06 2020-11-12T17:27:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.841466+0000", 2020-11-12T17:27:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6225999999999999e-05 2020-11-12T17:27:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.841533+0000", 2020-11-12T17:27:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000232804 2020-11-12T17:27:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.841765+0000", 2020-11-12T17:27:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000228142 2020-11-12T17:27:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.841994+0000", 2020-11-12T17:27:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003491423 2020-11-12T17:27:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.845485+0000", 2020-11-12T17:27:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0041041089999999999 2020-11-12T17:27:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25178 5.8 5:1376063c:::benchmark_data_smithi036_24110_object3147:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.842029+0000", 2020-11-12T17:27:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.010706324999999999, 2020-11-12T17:27:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011041504000000001, 2020-11-12T17:27:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25178 2020-11-12T17:27:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.842029+0000", 2020-11-12T17:27:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.842029+0000", 2020-11-12T17:27:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.842004+0000", 2020-11-12T17:27:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0325e-05 2020-11-12T17:27:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.842095+0000", 2020-11-12T17:27:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.66e-05 2020-11-12T17:27:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.842111+0000", 2020-11-12T17:27:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:27:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.842119+0000", 2020-11-12T17:27:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001132624 2020-11-12T17:27:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.843252+0000", 2020-11-12T17:27:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3036999999999999e-05 2020-11-12T17:27:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.843325+0000", 2020-11-12T17:27:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012220899999999999 2020-11-12T17:27:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.843447+0000", 2020-11-12T17:27:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025604899999999999 2020-11-12T17:27:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846008+0000", 2020-11-12T17:27:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0039787540000000001 2020-11-12T17:27:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25179 5.8 5:1376063c:::benchmark_data_smithi036_24110_object3147:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.846544+0000", 2020-11-12T17:27:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0061918939999999999, 2020-11-12T17:27:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066715059999999998, 2020-11-12T17:27:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25179 2020-11-12T17:27:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846544+0000", 2020-11-12T17:27:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846544+0000", 2020-11-12T17:27:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:27:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846500+0000", 2020-11-12T17:27:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013608899999999999 2020-11-12T17:27:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846636+0000", 2020-11-12T17:27:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0176e-05 2020-11-12T17:27:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846646+0000", 2020-11-12T17:27:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5029999999999997e-06 2020-11-12T17:27:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846652+0000", 2020-11-12T17:27:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2883000000000002e-05 2020-11-12T17:27:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846705+0000", 2020-11-12T17:27:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6603999999999999e-05 2020-11-12T17:27:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846801+0000", 2020-11-12T17:27:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014714700000000001 2020-11-12T17:27:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846948+0000", 2020-11-12T17:27:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046808969999999998 2020-11-12T17:27:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.851629+0000", 2020-11-12T17:27:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050858179999999998 2020-11-12T17:27:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25180 5.8 5:1376063c:::benchmark_data_smithi036_24110_object3147:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.846704+0000", 2020-11-12T17:27:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0060316120000000004, 2020-11-12T17:27:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066495790000000001, 2020-11-12T17:27:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25180 2020-11-12T17:27:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846704+0000", 2020-11-12T17:27:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846704+0000", 2020-11-12T17:27:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846680+0000", 2020-11-12T17:27:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6718999999999996e-05 2020-11-12T17:27:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846747+0000", 2020-11-12T17:27:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3210000000000005e-06 2020-11-12T17:27:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846755+0000", 2020-11-12T17:27:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.206e-06 2020-11-12T17:27:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.846759+0000", 2020-11-12T17:27:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023730320000000002 2020-11-12T17:27:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.849132+0000", 2020-11-12T17:27:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0396999999999995e-05 2020-11-12T17:27:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.849223+0000", 2020-11-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192537 2020-11-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.849415+0000", 2020-11-12T17:27:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027112579999999998 2020-11-12T17:27:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25181 5.8 5:1376063c:::benchmark_data_smithi036_24110_object3147:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.847101+0000", 2020-11-12T17:27:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0056344350000000001, 2020-11-12T17:27:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0063862959999999996, 2020-11-12T17:27:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25181 2020-11-12T17:27:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847101+0000", 2020-11-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847101+0000", 2020-11-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847078+0000", 2020-11-12T17:27:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2551000000000003e-05 2020-11-12T17:27:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847160+0000", 2020-11-12T17:27:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6161e-05 2020-11-12T17:27:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847177+0000", 2020-11-12T17:27:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.576e-06 2020-11-12T17:27:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847184+0000", 2020-11-12T17:27:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033448129999999999 2020-11-12T17:27:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.850529+0000", 2020-11-12T17:27:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4797999999999997e-05 2020-11-12T17:27:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.850614+0000", 2020-11-12T17:27:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012509500000000001 2020-11-12T17:27:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.850739+0000", 2020-11-12T17:27:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003637894 2020-11-12T17:27:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25182 5.8 5:1376063c:::benchmark_data_smithi036_24110_object3147:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.847223+0000", 2020-11-12T17:27:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0055128970000000001, 2020-11-12T17:27:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0064144279999999998, 2020-11-12T17:27:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25182 2020-11-12T17:27:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847223+0000", 2020-11-12T17:27:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847223+0000", 2020-11-12T17:27:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847202+0000", 2020-11-12T17:27:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8220999999999996e-05 2020-11-12T17:27:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847270+0000", 2020-11-12T17:27:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9699999999999999e-06 2020-11-12T17:27:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847278+0000", 2020-11-12T17:27:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1400000000000002e-06 2020-11-12T17:27:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847282+0000", 2020-11-12T17:27:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.004401688 2020-11-12T17:27:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.851684+0000", 2020-11-12T17:27:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014077 2020-11-12T17:27:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.851825+0000", 2020-11-12T17:27:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026611000000000001 2020-11-12T17:27:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.852091+0000", 2020-11-12T17:27:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048683049999999999 2020-11-12T17:27:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25183 5.8 5:1376063c:::benchmark_data_smithi036_24110_object3147:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.847316+0000", 2020-11-12T17:27:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.005419877, 2020-11-12T17:27:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0064572880000000003, 2020-11-12T17:27:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25183 2020-11-12T17:27:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847316+0000", 2020-11-12T17:27:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847316+0000", 2020-11-12T17:27:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99998 2020-11-12T17:27:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847295+0000", 2020-11-12T17:27:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7763000000000002e-05 2020-11-12T17:27:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847353+0000", 2020-11-12T17:27:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.99e-06 2020-11-12T17:27:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847360+0000", 2020-11-12T17:27:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2179999999999999e-06 2020-11-12T17:27:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847363+0000", 2020-11-12T17:27:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0062218280000000004 2020-11-12T17:27:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.853585+0000", 2020-11-12T17:27:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4052e-05 2020-11-12T17:27:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.853679+0000", 2020-11-12T17:27:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0063636029999999998 2020-11-12T17:27:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25184 5.8 5.3c606ec8 (undecoded) ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.847817+0000", 2020-11-12T17:27:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0049180949999999999, 2020-11-12T17:27:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060636409999999998, 2020-11-12T17:27:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25184 2020-11-12T17:27:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847817+0000", 2020-11-12T17:27:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847817+0000", 2020-11-12T17:27:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:27:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847775+0000", 2020-11-12T17:27:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120634 2020-11-12T17:27:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847895+0000", 2020-11-12T17:27:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1196999999999999e-05 2020-11-12T17:27:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847937+0000", 2020-11-12T17:27:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9630000000000004e-06 2020-11-12T17:27:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.847946+0000", 2020-11-12T17:27:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012831299999999999 2020-11-12T17:27:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:25180 5.8 e144/135)", 2020-11-12T17:27:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:12.853511+0000", 2020-11-12T17:27:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4294967295.9992242, 2020-11-12T17:27:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044872400000000001, 2020-11-12T17:27:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.853511+0000", 2020-11-12T17:27:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.853511+0000", 2020-11-12T17:27:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999657 2020-11-12T17:27:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.853477+0000", 2020-11-12T17:27:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001004 2020-11-12T17:27:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.853577+0000", 2020-11-12T17:27:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012717800000000001 2020-11-12T17:27:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.853704+0000", 2020-11-12T17:27:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2730000000000002e-06 2020-11-12T17:27:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:12.853712+0000", 2020-11-12T17:27:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020133600000000001 2020-11-12T17:27:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 10 2020-11-12T17:27:12.943 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:12.945 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:12.945 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:12.940+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:13.045 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:13.042+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:13.107 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:13.108 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:13.108 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:13.108 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:13.108 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:13.119 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:13.163 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:13.160+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:13.247 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.6 123/122 [PushOp(4:60824407:::benchmark_data_smithi036_18856_object6950:head, version: 100'3208, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:60824407:::benchmark_data_smithi036_18856_object6950:head@100'3208, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.555511375000002, 2020-11-12T17:27:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998, 2020-11-12T17:27:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687268+0000", 2020-11-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2052999999999994e-05 2020-11-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687360+0000", 2020-11-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54419334699999999 2020-11-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231553+0000", 2020-11-12T17:27:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.362e-06 2020-11-12T17:27:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231560+0000", 2020-11-12T17:27:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000185682 2020-11-12T17:27:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231746+0000", 2020-11-12T17:27:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0793e-05 2020-11-12T17:27:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231797+0000", 2020-11-12T17:27:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003344549 2020-11-12T17:27:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.235141+0000", 2020-11-12T17:27:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998 2020-11-12T17:27:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:800 5.d 5:b9f6bf26:::benchmark_data_smithi036_24110_object99:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e129)", 2020-11-12T17:27:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:47.239919+0000", 2020-11-12T17:27:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.002875896999999, 2020-11-12T17:27:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.229269315, 2020-11-12T17:27:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 800 2020-11-12T17:27:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.239919+0000", 2020-11-12T17:27:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.239919+0000", 2020-11-12T17:27:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9998703 2020-11-12T17:27:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.239789+0000", 2020-11-12T17:27:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000334366 2020-11-12T17:27:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.240123+0000", 2020-11-12T17:27:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6396999999999997e-05 2020-11-12T17:27:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.240160+0000", 2020-11-12T17:27:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8153000000000001e-05 2020-11-12T17:27:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.240178+0000", 2020-11-12T17:27:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026154780000000001 2020-11-12T17:27:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.242793+0000", 2020-11-12T17:27:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.753e-05 2020-11-12T17:27:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.242851+0000", 2020-11-12T17:27:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103293 2020-11-12T17:27:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.242954+0000", 2020-11-12T17:27:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011932760000000001 2020-11-12T17:27:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.244147+0000", 2020-11-12T17:27:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.224886751 2020-11-12T17:27:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469034+0000", 2020-11-12T17:27:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4919999999999993e-05 2020-11-12T17:27:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469119+0000", 2020-11-12T17:27:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8856999999999995e-05 2020-11-12T17:27:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.469188+0000", 2020-11-12T17:27:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.229269315 2020-11-12T17:27:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:1512 5.a 5:56e3a795:::benchmark_data_smithi036_24110_object188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e130)", 2020-11-12T17:27:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.326710803000001, 2020-11-12T17:27:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25162866900000003, 2020-11-12T17:27:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1512 2020-11-12T17:27:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916054+0000", 2020-11-12T17:27:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5012000000000005e-05 2020-11-12T17:27:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916139+0000", 2020-11-12T17:27:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7899999999999994e-06 2020-11-12T17:27:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916148+0000", 2020-11-12T17:27:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5700000000000003e-06 2020-11-12T17:27:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916153+0000", 2020-11-12T17:27:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0071457680000000003 2020-11-12T17:27:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923299+0000", 2020-11-12T17:27:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2009999999999998e-05 2020-11-12T17:27:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923361+0000", 2020-11-12T17:27:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106986 2020-11-12T17:27:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923468+0000", 2020-11-12T17:27:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094293899999999995 2020-11-12T17:27:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.924411+0000", 2020-11-12T17:27:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24318124399999999 2020-11-12T17:27:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167592+0000", 2020-11-12T17:27:13.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9159999999999995e-05 2020-11-12T17:27:13.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167661+0000", 2020-11-12T17:27:13.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1243999999999999e-05 2020-11-12T17:27:13.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167712+0000", 2020-11-12T17:27:13.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25162866900000003 2020-11-12T17:27:13.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.277 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.278 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11901 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:13.278 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:13.278 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.292585004999999, 2020-11-12T17:27:13.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29431180699999998, 2020-11-12T17:27:13.279 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.279 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.279 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.279 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.279 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.279 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11901 2020-11-12T17:27:13.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.279 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:13.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:13.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:27:13.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950188+0000", 2020-11-12T17:27:13.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2355999999999997e-05 2020-11-12T17:27:13.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950250+0000", 2020-11-12T17:27:13.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3710000000000002e-06 2020-11-12T17:27:13.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950258+0000", 2020-11-12T17:27:13.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.343e-06 2020-11-12T17:27:13.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950261+0000", 2020-11-12T17:27:13.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060384219999999999 2020-11-12T17:27:13.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956299+0000", 2020-11-12T17:27:13.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014742999999999999 2020-11-12T17:27:13.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956447+0000", 2020-11-12T17:27:13.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026288400000000001 2020-11-12T17:27:13.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:13.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956710+0000", 2020-11-12T17:27:13.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047596729999999999 2020-11-12T17:27:13.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961469+0000", 2020-11-12T17:27:13.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28285178999999999 2020-11-12T17:27:13.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244321+0000", 2020-11-12T17:27:13.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120733 2020-11-12T17:27:13.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244442+0000", 2020-11-12T17:27:13.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.941e-05 2020-11-12T17:27:13.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244521+0000", 2020-11-12T17:27:13.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29431180699999998 2020-11-12T17:27:13.288 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.288 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.288 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.289 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11902 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:13.289 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:13.289 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.291748182999999, 2020-11-12T17:27:13.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002, 2020-11-12T17:27:13.289 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.289 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.290 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.290 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.290 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.290 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11902 2020-11-12T17:27:13.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.290 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:13.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:13.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:13.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950968+0000", 2020-11-12T17:27:13.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022604299999999999 2020-11-12T17:27:13.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951194+0000", 2020-11-12T17:27:13.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1806e-05 2020-11-12T17:27:13.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951226+0000", 2020-11-12T17:27:13.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5761999999999999e-05 2020-11-12T17:27:13.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951241+0000", 2020-11-12T17:27:13.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006854845 2020-11-12T17:27:13.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958096+0000", 2020-11-12T17:27:13.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026652700000000002 2020-11-12T17:27:13.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958363+0000", 2020-11-12T17:27:13.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000368857 2020-11-12T17:27:13.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:13.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958732+0000", 2020-11-12T17:27:13.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027531859999999999 2020-11-12T17:27:13.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961485+0000", 2020-11-12T17:27:13.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43528204399999998 2020-11-12T17:27:13.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396767+0000", 2020-11-12T17:27:13.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015781399999999999 2020-11-12T17:27:13.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396925+0000", 2020-11-12T17:27:13.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109403 2020-11-12T17:27:13.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397034+0000", 2020-11-12T17:27:13.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002 2020-11-12T17:27:13.301 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.301 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.301 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.301 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11903 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:13.301 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:13.302 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.291150637000001, 2020-11-12T17:27:13.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221, 2020-11-12T17:27:13.302 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.302 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.302 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.302 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.302 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.302 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11903 2020-11-12T17:27:13.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.303 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:13.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:13.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999228 2020-11-12T17:27:13.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951566+0000", 2020-11-12T17:27:13.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024334899999999999 2020-11-12T17:27:13.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951810+0000", 2020-11-12T17:27:13.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9034e-05 2020-11-12T17:27:13.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951839+0000", 2020-11-12T17:27:13.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4151000000000001e-05 2020-11-12T17:27:13.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951853+0000", 2020-11-12T17:27:13.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081211489999999994 2020-11-12T17:27:13.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.959974+0000", 2020-11-12T17:27:13.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013490799999999999 2020-11-12T17:27:13.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960109+0000", 2020-11-12T17:27:13.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000252172 2020-11-12T17:27:13.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:13.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960361+0000", 2020-11-12T17:27:13.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024598829999999999 2020-11-12T17:27:13.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962821+0000", 2020-11-12T17:27:13.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43434482000000002 2020-11-12T17:27:13.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397166+0000", 2020-11-12T17:27:13.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054200000000001 2020-11-12T17:27:13.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397296+0000", 2020-11-12T17:27:13.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5556000000000005e-05 2020-11-12T17:27:13.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397392+0000", 2020-11-12T17:27:13.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221 2020-11-12T17:27:13.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.313 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.314 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11904 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:13.314 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:13.314 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.288687522, 2020-11-12T17:27:13.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003, 2020-11-12T17:27:13.314 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.314 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.315 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.315 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.315 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.315 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11904 2020-11-12T17:27:13.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.317 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:13.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:13.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999237 2020-11-12T17:27:13.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954031+0000", 2020-11-12T17:27:13.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021660900000000001 2020-11-12T17:27:13.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954247+0000", 2020-11-12T17:27:13.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4606e-05 2020-11-12T17:27:13.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954282+0000", 2020-11-12T17:27:13.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.552e-05 2020-11-12T17:27:13.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954297+0000", 2020-11-12T17:27:13.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0072408330000000003 2020-11-12T17:27:13.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961538+0000", 2020-11-12T17:27:13.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013512800000000001 2020-11-12T17:27:13.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961673+0000", 2020-11-12T17:27:13.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023430200000000001 2020-11-12T17:27:13.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:13.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961908+0000", 2020-11-12T17:27:13.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016600740000000001 2020-11-12T17:27:13.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963568+0000", 2020-11-12T17:27:13.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43393070099999997 2020-11-12T17:27:13.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397499+0000", 2020-11-12T17:27:13.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012872 2020-11-12T17:27:13.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397627+0000", 2020-11-12T17:27:13.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4786999999999999e-05 2020-11-12T17:27:13.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397722+0000", 2020-11-12T17:27:13.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003 2020-11-12T17:27:13.326 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.326 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.326 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.327 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:11901 5.d e133/127 ondisk, result = 0)", 2020-11-12T17:27:13.327 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:13.327 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.284657574000001, 2020-11-12T17:27:13.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28640288899999999, 2020-11-12T17:27:13.327 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.328 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:13.328 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:13.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:13.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:13.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958116+0000", 2020-11-12T17:27:13.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1677e-05 2020-11-12T17:27:13.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958167+0000", 2020-11-12T17:27:13.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28596560999999998 2020-11-12T17:27:13.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244133+0000", 2020-11-12T17:27:13.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2449999999999999e-05 2020-11-12T17:27:13.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244146+0000", 2020-11-12T17:27:13.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013661000000000001 2020-11-12T17:27:13.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244282+0000", 2020-11-12T17:27:13.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9877e-05 2020-11-12T17:27:13.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244302+0000", 2020-11-12T17:27:13.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000237693 2020-11-12T17:27:13.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244540+0000", 2020-11-12T17:27:13.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28640288899999999 2020-11-12T17:27:13.334 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.334 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.335 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11909 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:13.335 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:13.335 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.280948825999999, 2020-11-12T17:27:13.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999, 2020-11-12T17:27:13.336 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.336 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.336 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11909 2020-11-12T17:27:13.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.337 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:13.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:13.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:27:13.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961803+0000", 2020-11-12T17:27:13.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9606999999999998e-05 2020-11-12T17:27:13.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961893+0000", 2020-11-12T17:27:13.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0258000000000001e-05 2020-11-12T17:27:13.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961903+0000", 2020-11-12T17:27:13.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8450000000000003e-06 2020-11-12T17:27:13.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961911+0000", 2020-11-12T17:27:13.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00090397899999999996 2020-11-12T17:27:13.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962815+0000", 2020-11-12T17:27:13.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106487 2020-11-12T17:27:13.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962921+0000", 2020-11-12T17:27:13.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027479400000000003 2020-11-12T17:27:13.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:13.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963196+0000", 2020-11-12T17:27:13.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002806041 2020-11-12T17:27:13.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966002+0000", 2020-11-12T17:27:13.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42403797700000001 2020-11-12T17:27:13.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390040+0000", 2020-11-12T17:27:13.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017360699999999999 2020-11-12T17:27:13.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390214+0000", 2020-11-12T17:27:13.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012036600000000001 2020-11-12T17:27:13.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390334+0000", 2020-11-12T17:27:13.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999 2020-11-12T17:27:13.347 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11910 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.279732534000001, 2020-11-12T17:27:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002, 2020-11-12T17:27:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11910 2020-11-12T17:27:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999413 2020-11-12T17:27:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963003+0000", 2020-11-12T17:27:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017848699999999999 2020-11-12T17:27:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963182+0000", 2020-11-12T17:27:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7229000000000001e-05 2020-11-12T17:27:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963199+0000", 2020-11-12T17:27:13.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2609999999999999e-06 2020-11-12T17:27:13.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963208+0000", 2020-11-12T17:27:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089699300000000001 2020-11-12T17:27:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964105+0000", 2020-11-12T17:27:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012321200000000001 2020-11-12T17:27:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964228+0000", 2020-11-12T17:27:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022185600000000001 2020-11-12T17:27:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964450+0000", 2020-11-12T17:27:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001555697 2020-11-12T17:27:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966006+0000", 2020-11-12T17:27:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42809403299999998 2020-11-12T17:27:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394100+0000", 2020-11-12T17:27:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012522 2020-11-12T17:27:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394225+0000", 2020-11-12T17:27:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014087 2020-11-12T17:27:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394366+0000", 2020-11-12T17:27:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002 2020-11-12T17:27:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11911 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.279502791999999, 2020-11-12T17:27:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998, 2020-11-12T17:27:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11911 2020-11-12T17:27:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999547 2020-11-12T17:27:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963246+0000", 2020-11-12T17:27:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000132867 2020-11-12T17:27:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963379+0000", 2020-11-12T17:27:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1556000000000002e-05 2020-11-12T17:27:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963401+0000", 2020-11-12T17:27:13.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2499999999999997e-05 2020-11-12T17:27:13.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963433+0000", 2020-11-12T17:27:13.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018380040000000001 2020-11-12T17:27:13.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965271+0000", 2020-11-12T17:27:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6691000000000002e-05 2020-11-12T17:27:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965338+0000", 2020-11-12T17:27:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100777 2020-11-12T17:27:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965439+0000", 2020-11-12T17:27:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001679198 2020-11-12T17:27:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967118+0000", 2020-11-12T17:27:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.435251412 2020-11-12T17:27:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402369+0000", 2020-11-12T17:27:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6074000000000005e-05 2020-11-12T17:27:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402435+0000", 2020-11-12T17:27:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6678999999999997e-05 2020-11-12T17:27:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402492+0000", 2020-11-12T17:27:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998 2020-11-12T17:27:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11912 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.276474841999999, 2020-11-12T17:27:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997, 2020-11-12T17:27:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11912 2020-11-12T17:27:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966296+0000", 2020-11-12T17:27:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6765000000000002e-05 2020-11-12T17:27:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966363+0000", 2020-11-12T17:27:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3097e-05 2020-11-12T17:27:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966376+0000", 2020-11-12T17:27:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0669999999999998e-06 2020-11-12T17:27:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966385+0000", 2020-11-12T17:27:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7963999999999997e-05 2020-11-12T17:27:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966433+0000", 2020-11-12T17:27:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0263999999999998e-05 2020-11-12T17:27:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966494+0000", 2020-11-12T17:27:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120279 2020-11-12T17:27:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966614+0000", 2020-11-12T17:27:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001180424 2020-11-12T17:27:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967794+0000", 2020-11-12T17:27:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43476916100000002 2020-11-12T17:27:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402563+0000", 2020-11-12T17:27:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7442999999999998e-05 2020-11-12T17:27:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402631+0000", 2020-11-12T17:27:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8424999999999998e-05 2020-11-12T17:27:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402679+0000", 2020-11-12T17:27:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997 2020-11-12T17:27:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11913 5.d 5:b8059c51:::benchmark_data_smithi036_24110_object1489:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.114044846999999, 2020-11-12T17:27:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26925581300000001, 2020-11-12T17:27:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11913 2020-11-12T17:27:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999523 2020-11-12T17:27:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128702+0000", 2020-11-12T17:27:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013552400000000001 2020-11-12T17:27:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128837+0000", 2020-11-12T17:27:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6769999999999999e-05 2020-11-12T17:27:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128864+0000", 2020-11-12T17:27:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.261e-05 2020-11-12T17:27:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128877+0000", 2020-11-12T17:27:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125313 2020-11-12T17:27:13.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129002+0000", 2020-11-12T17:27:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00034839700000000002 2020-11-12T17:27:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129350+0000", 2020-11-12T17:27:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030113699999999999 2020-11-12T17:27:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129652+0000", 2020-11-12T17:27:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022631880000000002 2020-11-12T17:27:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.131915+0000", 2020-11-12T17:27:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26589388400000002 2020-11-12T17:27:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397809+0000", 2020-11-12T17:27:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114862 2020-11-12T17:27:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397923+0000", 2020-11-12T17:27:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1882e-05 2020-11-12T17:27:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.398005+0000", 2020-11-12T17:27:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26925581300000001 2020-11-12T17:27:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:12696 5.d 5:bedc4739:::benchmark_data_smithi036_24110_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e134)", 2020-11-12T17:27:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:58.141564+0000", 2020-11-12T17:27:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.101230501, 2020-11-12T17:27:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.240589469, 2020-11-12T17:27:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 12696 2020-11-12T17:27:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141564+0000", 2020-11-12T17:27:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141564+0000", 2020-11-12T17:27:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141516+0000", 2020-11-12T17:27:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013753999999999999 2020-11-12T17:27:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141653+0000", 2020-11-12T17:27:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8082999999999999e-05 2020-11-12T17:27:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141681+0000", 2020-11-12T17:27:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0944999999999999e-05 2020-11-12T17:27:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.141692+0000", 2020-11-12T17:27:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019604420000000002 2020-11-12T17:27:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.143653+0000", 2020-11-12T17:27:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0601999999999998e-05 2020-11-12T17:27:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.143733+0000", 2020-11-12T17:27:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014270299999999999 2020-11-12T17:27:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.143876+0000", 2020-11-12T17:27:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020232510000000002 2020-11-12T17:27:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.145899+0000", 2020-11-12T17:27:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.236140883 2020-11-12T17:27:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382040+0000", 2020-11-12T17:27:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5817999999999999e-05 2020-11-12T17:27:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382106+0000", 2020-11-12T17:27:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7577999999999997e-05 2020-11-12T17:27:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:58.382153+0000", 2020-11-12T17:27:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.240589469 2020-11-12T17:27:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14919 5.6 5:6a28bd79:::benchmark_data_smithi036_24110_object1864:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.245278+0000", 2020-11-12T17:27:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.997516398, 2020-11-12T17:27:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37589861299999999, 2020-11-12T17:27:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14919 2020-11-12T17:27:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245278+0000", 2020-11-12T17:27:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245278+0000", 2020-11-12T17:27:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245242+0000", 2020-11-12T17:27:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010559499999999999 2020-11-12T17:27:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245348+0000", 2020-11-12T17:27:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3886999999999999e-05 2020-11-12T17:27:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245361+0000", 2020-11-12T17:27:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1739999999999997e-06 2020-11-12T17:27:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245368+0000", 2020-11-12T17:27:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021369129999999998 2020-11-12T17:27:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.247505+0000", 2020-11-12T17:27:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000167682 2020-11-12T17:27:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.247672+0000", 2020-11-12T17:27:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000248874 2020-11-12T17:27:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.247921+0000", 2020-11-12T17:27:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044640180000000002 2020-11-12T17:27:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.252385+0000", 2020-11-12T17:27:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36865272599999999 2020-11-12T17:27:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621038+0000", 2020-11-12T17:27:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7316000000000003e-05 2020-11-12T17:27:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621115+0000", 2020-11-12T17:27:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1439999999999995e-05 2020-11-12T17:27:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621177+0000", 2020-11-12T17:27:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37589861299999999 2020-11-12T17:27:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14920 5.6 5:6a28bd79:::benchmark_data_smithi036_24110_object1864:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.246843+0000", 2020-11-12T17:27:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.995951291000001, 2020-11-12T17:27:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37860764600000002, 2020-11-12T17:27:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14920 2020-11-12T17:27:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246843+0000", 2020-11-12T17:27:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246843+0000", 2020-11-12T17:27:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246803+0000", 2020-11-12T17:27:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011126200000000001 2020-11-12T17:27:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246914+0000", 2020-11-12T17:27:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5925000000000001e-05 2020-11-12T17:27:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246930+0000", 2020-11-12T17:27:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9270000000000005e-06 2020-11-12T17:27:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246938+0000", 2020-11-12T17:27:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017497649999999999 2020-11-12T17:27:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.248688+0000", 2020-11-12T17:27:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3158999999999996e-05 2020-11-12T17:27:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.248751+0000", 2020-11-12T17:27:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116112 2020-11-12T17:27:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.248867+0000", 2020-11-12T17:27:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035256179999999999 2020-11-12T17:27:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.252392+0000", 2020-11-12T17:27:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37298045299999999 2020-11-12T17:27:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.625373+0000", 2020-11-12T17:27:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.443e-05 2020-11-12T17:27:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.625417+0000", 2020-11-12T17:27:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3444e-05 2020-11-12T17:27:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.625451+0000", 2020-11-12T17:27:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37860764600000002 2020-11-12T17:27:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:14919 5.6 e137/127 ondisk, result = 0)", 2020-11-12T17:27:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.251548+0000", 2020-11-12T17:27:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.991246631999999, 2020-11-12T17:27:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36963633000000001, 2020-11-12T17:27:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251548+0000", 2020-11-12T17:27:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251548+0000", 2020-11-12T17:27:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251523+0000", 2020-11-12T17:27:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4719000000000003e-05 2020-11-12T17:27:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251568+0000", 2020-11-12T17:27:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36934947400000001 2020-11-12T17:27:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620917+0000", 2020-11-12T17:27:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9519999999999997e-06 2020-11-12T17:27:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620924+0000", 2020-11-12T17:27:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1785000000000003e-05 2020-11-12T17:27:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621016+0000", 2020-11-12T17:27:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0672999999999999e-05 2020-11-12T17:27:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621027+0000", 2020-11-12T17:27:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015729000000000001 2020-11-12T17:27:13.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621184+0000", 2020-11-12T17:27:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36963633000000001 2020-11-12T17:27:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:15008 5.d 5:bb9506a3:::benchmark_data_smithi036_24110_object1875:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.343191+0000", 2020-11-12T17:27:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.899603038, 2020-11-12T17:27:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27534693300000002, 2020-11-12T17:27:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 15008 2020-11-12T17:27:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343191+0000", 2020-11-12T17:27:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343191+0000", 2020-11-12T17:27:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343154+0000", 2020-11-12T17:27:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010024199999999999 2020-11-12T17:27:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343254+0000", 2020-11-12T17:27:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9607e-05 2020-11-12T17:27:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343274+0000", 2020-11-12T17:27:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0360000000000001e-05 2020-11-12T17:27:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343284+0000", 2020-11-12T17:27:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031873819999999999 2020-11-12T17:27:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.346471+0000", 2020-11-12T17:27:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8413999999999999e-05 2020-11-12T17:27:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.346540+0000", 2020-11-12T17:27:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108972 2020-11-12T17:27:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.346649+0000", 2020-11-12T17:27:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012527529999999999 2020-11-12T17:27:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.347901+0000", 2020-11-12T17:27:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27048926099999998 2020-11-12T17:27:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618391+0000", 2020-11-12T17:27:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9011000000000006e-05 2020-11-12T17:27:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618470+0000", 2020-11-12T17:27:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8559000000000005e-05 2020-11-12T17:27:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618538+0000", 2020-11-12T17:27:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27534693300000002 2020-11-12T17:27:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:15008 5.d e137/127 ondisk, result = 0)", 2020-11-12T17:27:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.348752+0000", 2020-11-12T17:27:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.894042122, 2020-11-12T17:27:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.269797817, 2020-11-12T17:27:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348752+0000", 2020-11-12T17:27:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348752+0000", 2020-11-12T17:27:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348716+0000", 2020-11-12T17:27:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3648999999999997e-05 2020-11-12T17:27:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348810+0000", 2020-11-12T17:27:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26755567299999999 2020-11-12T17:27:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.616365+0000", 2020-11-12T17:27:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5039999999999996e-06 2020-11-12T17:27:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.616373+0000", 2020-11-12T17:27:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019946999999999999 2020-11-12T17:27:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618367+0000", 2020-11-12T17:27:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0929e-05 2020-11-12T17:27:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618378+0000", 2020-11-12T17:27:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017173000000000001 2020-11-12T17:27:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618550+0000", 2020-11-12T17:27:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.269797817 2020-11-12T17:27:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:16064 5.a 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:27:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:27:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.7476462680000004, 2020-11-12T17:27:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999, 2020-11-12T17:27:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 16064 2020-11-12T17:27:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:27:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:27:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495102+0000", 2020-11-12T17:27:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012806100000000001 2020-11-12T17:27:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495230+0000", 2020-11-12T17:27:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1214999999999999e-05 2020-11-12T17:27:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495251+0000", 2020-11-12T17:27:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1668000000000001e-05 2020-11-12T17:27:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495262+0000", 2020-11-12T17:27:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6068999999999994e-05 2020-11-12T17:27:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495329+0000", 2020-11-12T17:27:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011465599999999999 2020-11-12T17:27:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495443+0000", 2020-11-12T17:27:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000230077 2020-11-12T17:27:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495673+0000", 2020-11-12T17:27:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013291710000000001 2020-11-12T17:27:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.497002+0000", 2020-11-12T17:27:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69030446599999995 2020-11-12T17:27:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187307+0000", 2020-11-12T17:27:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011451999999999999 2020-11-12T17:27:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187421+0000", 2020-11-12T17:27:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5153000000000004e-05 2020-11-12T17:27:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187497+0000", 2020-11-12T17:27:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999 2020-11-12T17:27:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:13.470 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:13.471 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:13.246+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:13.471 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:13.472 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:13.466+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:13.557 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 27 16 25924 25908 7.49582 8.48438 0.0205284 0.0166545 2020-11-12T17:27:13.740 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:27:13.742 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:13.742 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:13.743 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:13.743 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:13.743 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:13.744 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:13.738+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:13.841 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:13.836+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:13.917 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:13.918 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:13.918 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:13.918 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:13.918 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:13.929 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:13.971 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:13.968+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:14.043 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:14.042+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:14.085 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 248.97410270099999, 2020-11-12T17:27:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:14.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 248.967010905, 2020-11-12T17:27:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 239.534451408, 2020-11-12T17:27:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 205.584331314, 2020-11-12T17:27:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:14.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:14.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 203.47872942199999, 2020-11-12T17:27:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:14.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:14.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 172.13224608799999, 2020-11-12T17:27:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:14.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:14.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 163.13640428599999, 2020-11-12T17:27:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 159.201300887, 2020-11-12T17:27:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 128.43666039600001, 2020-11-12T17:27:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.180151712, 2020-11-12T17:27:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.179989342, 2020-11-12T17:27:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.171420355, 2020-11-12T17:27:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 97.666907905000002, 2020-11-12T17:27:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 96.181359619000006, 2020-11-12T17:27:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:14.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:14.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:14.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:14.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:14.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:14.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:14.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:14.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:14.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.222 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.223 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.223 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:14.223 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:14.223 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 93.108041186999998, 2020-11-12T17:27:14.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:14.223 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 92.052396211000001, 2020-11-12T17:27:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 91.664191840000001, 2020-11-12T17:27:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.457734908000006, 2020-11-12T17:27:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.208529291000005, 2020-11-12T17:27:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.191569842000007, 2020-11-12T17:27:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.280 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:14.282 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:14.284 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:14.282+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:14.392 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:14.388+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:14.438 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:14.439 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:14.439 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:14.439 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:14.448 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:14.501 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:14.496+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:14.557 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 28 16 26962 26946 7.51771 8.10938 0.0102344 0.0166123 2020-11-12T17:27:14.590 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:14.586+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:14.638 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:14.638 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:14.639 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:14.639 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:14.639 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:14.648 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:14.688 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:14.695 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:14.692+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:14.728 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:27:14.788 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:14.784+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:14.793 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:14.793 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:14.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:14.794 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:14.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.794 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:14.794 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:14.794 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 240.37331734700001, 2020-11-12T17:27:14.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:14.795 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.795 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.795 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.795 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:14.795 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:14.796 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:14.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.796 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:14.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:14.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:14.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:14.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:14.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:14.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:14.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:14.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:14.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:14.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:14.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:14.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:14.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:14.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:14.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:14.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:14.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:14.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:14.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:14.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:14.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:14.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:14.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:14.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:14.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:14.828 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.828 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.828 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.828 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:14.829 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:14.829 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 240.36637328500001, 2020-11-12T17:27:14.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:14.834 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.835 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.835 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:14.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:14.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:14.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:14.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:14.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:14.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:14.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:14.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:14.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:14.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:14.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:14.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:14.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:14.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:14.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:14.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:14.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.847 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.848 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:14.848 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:14.848 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 204.192535499, 2020-11-12T17:27:14.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:14.849 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.849 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.849 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.849 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:14.849 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:14.849 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:14.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.850 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:14.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:14.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:14.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:14.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:14.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:14.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:14.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:14.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:14.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:14.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:14.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:14.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:14.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:14.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:14.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:14.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:14.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:14.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:14.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:14.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:14.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:27:14.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:27:14.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:27:14.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:27:14.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:27:14.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.860 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.861 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:27:14.861 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:27:14.861 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 199.72100158999999, 2020-11-12T17:27:14.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:27:14.861 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.862 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.862 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.862 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:14.862 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:14.862 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:27:14.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.862 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:27:14.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:27:14.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:27:14.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:27:14.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:27:14.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:27:14.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:27:14.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:27:14.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:27:14.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:27:14.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:27:14.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:27:14.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:27:14.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:27:14.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:27:14.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:14.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:27:14.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:27:14.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:27:14.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:27:14.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:27:14.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:27:14.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:27:14.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:27:14.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:27:14.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:27:14.872 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.873 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.873 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.874 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:27:14.875 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:14.875 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 187.928830406, 2020-11-12T17:27:14.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:27:14.875 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.875 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.875 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.875 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:14.876 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:14.876 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:27:14.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.876 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:14.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:14.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:14.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:27:14.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:27:14.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:27:14.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:27:14.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:27:14.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:27:14.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:27:14.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:27:14.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:27:14.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:27:14.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:27:14.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:27:14.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:14.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:27:14.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:27:14.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:27:14.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:27:14.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:27:14.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:27:14.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:27:14.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:27:14.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:27:14.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:27:14.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.888 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.889 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.889 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:14.889 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:27:14.889 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 172.97238356400001, 2020-11-12T17:27:14.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:27:14.890 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.890 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.890 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.890 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:14.890 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:14.890 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:27:14.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.891 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:27:14.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:27:14.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:27:14.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:27:14.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:27:14.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:27:14.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:27:14.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:27:14.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:27:14.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:27:14.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:27:14.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:27:14.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:27:14.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:27:14.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:27:14.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:14.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:27:14.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:27:14.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:27:14.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:27:14.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:27:14.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:27:14.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:27:14.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:27:14.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:27:14.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:27:14.901 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.902 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.902 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.902 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:27:14.903 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:14.903 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 172.84345008, 2020-11-12T17:27:14.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:27:14.903 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.903 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.903 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:14.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:14.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:14.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:27:14.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:27:14.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:27:14.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:27:14.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:27:14.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:27:14.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:27:14.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:27:14.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:27:14.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:27:14.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:27:14.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:27:14.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:27:14.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:27:14.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:27:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 171.14931180599999, 2020-11-12T17:27:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:27:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.914 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:27:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:14.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:27:14.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:27:14.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:27:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:27:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:27:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:27:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:27:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:27:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:27:14.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:27:14.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:27:14.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:27:14.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:14.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:27:14.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:27:14.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:27:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:27:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:27:14.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:27:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:27:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:27:14.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:27:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:27:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.926 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:27:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.480073084, 2020-11-12T17:27:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:27:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.927 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:27:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:14.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:27:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:27:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:27:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:27:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:27:14.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:27:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:27:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:27:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:27:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:27:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:27:14.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:27:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:27:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:27:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:27:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:27:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:27:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:27:14.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:27:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:27:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:27:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:27:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:27:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.46689632499999, 2020-11-12T17:27:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:27:14.938 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:27:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:27:14.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:27:14.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:27:14.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:27:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:27:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:27:14.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:27:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:27:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:27:14.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:27:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:27:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:27:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:27:14.949 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.950 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.950 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:27:14.950 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:14.951 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.912814876, 2020-11-12T17:27:14.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:27:14.951 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.951 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.951 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.951 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.951 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:27:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:14.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:27:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:27:14.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:27:14.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:27:14.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:27:14.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:27:14.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:27:14.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:27:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:27:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:27:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:27:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:27:14.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:27:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:27:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:27:14.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:27:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:27:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:27:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:27:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:27:14.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:27:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:27:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:27:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.961 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:27:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.90382757, 2020-11-12T17:27:14.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:27:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:14.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:27:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:27:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:27:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:27:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:27:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:27:14.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:27:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:27:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:27:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:27:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:27:14.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:27:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:27:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:27:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:27:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.885900256, 2020-11-12T17:27:14.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:27:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:27:14.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:27:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:27:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:27:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:27:14.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:27:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:27:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:27:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:27:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:27:14.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:27:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:27:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:27:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:27:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:27:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:27:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:27:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:27:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:27:14.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:27:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:27:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:27:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:27:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:27:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.334856857999995, 2020-11-12T17:27:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:27:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.982 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:27:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:27:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:27:14.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:27:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:27:14.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:27:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:27:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:27:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:27:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:27:14.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:27:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:27:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:27:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:27:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:27:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:14.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:27:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:27:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:27:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:27:14.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:27:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:27:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:27:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:27:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:27:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:27:14.992 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:14.993 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.083461357999994, 2020-11-12T17:27:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:27:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:14.994 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:27:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:14.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:27:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:27:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:27:14.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:27:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:27:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:27:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:27:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:27:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:14.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:27:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:27:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:27:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:27:15.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:27:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:27:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:27:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:27:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:27:15.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:27:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:27:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:27:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:27:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:27:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.004339040999994, 2020-11-12T17:27:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:27:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:15.005 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:27:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:15.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:27:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:27:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:27:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:27:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:27:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:27:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:27:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:27:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:27:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:27:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:27:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:27:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:27:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:27:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:27:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:27:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:27:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:27:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:27:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:27:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:27:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:27:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:27:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.221988073999995, 2020-11-12T17:27:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:27:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:27:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:27:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:27:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:27:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:27:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:27:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:27:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:27:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:27:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:27:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:27:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:27:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:27:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:27:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:27:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:27:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:27:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:27:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:27:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:27:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:27:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:27:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:27:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:27:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:27:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.758945724999997, 2020-11-12T17:27:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:27:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:27:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:27:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:27:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:27:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:27:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:27:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:27:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:27:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:27:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:27:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:27:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:27:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:27:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:27:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:27:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:27:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:27:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:27:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:27:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:27:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:27:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:27:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:27:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:27:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:27:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:27:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.737905191000003, 2020-11-12T17:27:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:27:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:15.040 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:27:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:27:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:27:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:27:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:27:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:27:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:27:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:15.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:27:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:27:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:27:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:27:15.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:27:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:27:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:27:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:27:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:27:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:27:15.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:15.048 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 12.737186574000001, 2020-11-12T17:27:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:27:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:15.049 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:27:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:15.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:27:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:27:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:27:15.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:27:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:27:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:27:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:27:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:27:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:15.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:27:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:27:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:27:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:27:15.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:27:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:27:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:27:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:27:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:15.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:27:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:27:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:27:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:27:15.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:27:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:27:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:15.059 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:15.060 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:15.060 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:15.060 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:15.061 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:15.061 INFO:tasks.thrashosds.thrasher:inject_pause on 3 2020-11-12T17:27:15.061 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-12T17:27:15.061 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-12T17:27:15.062 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2020-11-12T17:27:15.064 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:14.860+0000 7f6583748700 -1 osd.0 144 handle_osd_map injecting map crc failure 2020-11-12T17:27:15.064 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:15.064 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:15.064 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:15.064 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:15.064 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:15.065 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:15.065 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:15.065 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:15.056+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:15.065 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:15.094 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:15.095 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:15.095 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:15.096 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:15.096 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:15.096 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:15.096 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:15.096 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:15.096 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:15.162 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:15.158+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:15.193 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:15.194 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:15.204 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:15.216 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:15.217 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2020-11-12T17:27:15.217 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:15.263 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:15.260+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:15.360 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:15.360 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:15.365 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:15.360+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:15.371 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:15.465 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:15.460+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:15.489 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:15.490 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:15.500 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:15.557 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 29 16 27889 27873 7.50819 7.24219 0.00841168 0.0166116 2020-11-12T17:27:15.566 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:15.562+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:15.615 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:15.615 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:15.626 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:15.667 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:15.666+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:15.768 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:15.766+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:15.800 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:15.800 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:15.811 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:15.903 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:15.902+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:15.970 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:15.966+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:15.976 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:15.977 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:15.987 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:16.070 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:16.064+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:16.155 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:16.156 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:16.169 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:16.171 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:16.170+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:16.272 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:16.268+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:16.299 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:16.300 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:16.311 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:16.374 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:16.368+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:16.424 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:16.424 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:16.434 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:16.477 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:16.472+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:16.552 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:16.553 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:16.557 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 30 16 28929 28913 7.52872 8.125 0.00476095 0.0165856 2020-11-12T17:27:16.565 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:16.611 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:16.610+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:16.677 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:16.672+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:16.690 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:16.690 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:16.703 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:16.741 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:27:16.787 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:16.784+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:16.867 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:16.868 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:16.878 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:16.881 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:16.878+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:16.983 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:16.978+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:17.011 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:17.011 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:17.023 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:17.083 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:17.080+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:17.108 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:17.155 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:17.155 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:17.170 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:17.215 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:17.212+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:17.286 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:17.282+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:17.292 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:17.311 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:17.311 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:17.325 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:17.326 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:17.354 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:17.387 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:17.386+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:17.392 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:17.418 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:27:17.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:17.459 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29643 5.d 5:bb542ce6:::benchmark_data_smithi036_24110_object3705:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.444346+0000", 2020-11-12T17:27:17.460 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.014067766000000001, 2020-11-12T17:27:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014108699000000001, 2020-11-12T17:27:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.461 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29643 2020-11-12T17:27:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444346+0000", 2020-11-12T17:27:17.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444346+0000", 2020-11-12T17:27:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444308+0000", 2020-11-12T17:27:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104472 2020-11-12T17:27:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444413+0000", 2020-11-12T17:27:17.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3512e-05 2020-11-12T17:27:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444426+0000", 2020-11-12T17:27:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3093e-05 2020-11-12T17:27:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444439+0000", 2020-11-12T17:27:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010264241 2020-11-12T17:27:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.454703+0000", 2020-11-12T17:27:17.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101166 2020-11-12T17:27:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.454805+0000", 2020-11-12T17:27:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000134263 2020-11-12T17:27:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.454939+0000", 2020-11-12T17:27:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010592895999999999 2020-11-12T17:27:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.468 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29644 5.d 5:bb542ce6:::benchmark_data_smithi036_24110_object3705:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.444501+0000", 2020-11-12T17:27:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.013912424, 2020-11-12T17:27:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014114774, 2020-11-12T17:27:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.469 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29644 2020-11-12T17:27:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444501+0000", 2020-11-12T17:27:17.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444501+0000", 2020-11-12T17:27:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444464+0000", 2020-11-12T17:27:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001049 2020-11-12T17:27:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444569+0000", 2020-11-12T17:27:17.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3755e-05 2020-11-12T17:27:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444583+0000", 2020-11-12T17:27:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9439999999999999e-06 2020-11-12T17:27:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444590+0000", 2020-11-12T17:27:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011497095000000001 2020-11-12T17:27:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.456087+0000", 2020-11-12T17:27:17.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000134425 2020-11-12T17:27:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.456221+0000", 2020-11-12T17:27:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023819499999999999 2020-11-12T17:27:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.456459+0000", 2020-11-12T17:27:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011958118 2020-11-12T17:27:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.476 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29645 5.d 5:bb542ce6:::benchmark_data_smithi036_24110_object3705:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.445081+0000", 2020-11-12T17:27:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.013332881, 2020-11-12T17:27:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013680338, 2020-11-12T17:27:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29645 2020-11-12T17:27:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.445081+0000", 2020-11-12T17:27:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.445081+0000", 2020-11-12T17:27:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:27:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.445050+0000", 2020-11-12T17:27:17.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2039000000000006e-05 2020-11-12T17:27:17.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.445122+0000", 2020-11-12T17:27:17.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0875e-05 2020-11-12T17:27:17.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.445133+0000", 2020-11-12T17:27:17.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4650000000000002e-06 2020-11-12T17:27:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.445138+0000", 2020-11-12T17:27:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012315145 2020-11-12T17:27:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457453+0000", 2020-11-12T17:27:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2874000000000006e-05 2020-11-12T17:27:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457536+0000", 2020-11-12T17:27:17.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0002074 2020-11-12T17:27:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457744+0000", 2020-11-12T17:27:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012662714 2020-11-12T17:27:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29646 5.d 5.67342add (undecoded) ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.448496+0000", 2020-11-12T17:27:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0099175789999999993, 2020-11-12T17:27:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010366854999999999, 2020-11-12T17:27:17.485 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29646 2020-11-12T17:27:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.486 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.448496+0000", 2020-11-12T17:27:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.448496+0000", 2020-11-12T17:27:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.448458+0000", 2020-11-12T17:27:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011249899999999999 2020-11-12T17:27:17.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.448570+0000", 2020-11-12T17:27:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6339999999999999e-05 2020-11-12T17:27:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.448587+0000", 2020-11-12T17:27:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2969999999999992e-06 2020-11-12T17:27:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.448596+0000", 2020-11-12T17:27:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9944000000000004e-05 2020-11-12T17:27:17.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.491 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.491 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.491 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:29635 5.d e146/127)", 2020-11-12T17:27:17.491 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.457647+0000", 2020-11-12T17:27:17.491 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00076680699999999999, 2020-11-12T17:27:17.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001264093, 2020-11-12T17:27:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457647+0000", 2020-11-12T17:27:17.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457647+0000", 2020-11-12T17:27:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:27:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457612+0000", 2020-11-12T17:27:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1215e-05 2020-11-12T17:27:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457703+0000", 2020-11-12T17:27:17.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3028999999999995e-05 2020-11-12T17:27:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457776+0000", 2020-11-12T17:27:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0389999999999993e-06 2020-11-12T17:27:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457785+0000", 2020-11-12T17:27:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138348 2020-11-12T17:27:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29624 5.a 5:5ebe556d:::benchmark_data_smithi036_24110_object3702:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.423373+0000", 2020-11-12T17:27:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.035040953, 2020-11-12T17:27:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.035585342999999998, 2020-11-12T17:27:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.497 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29624 2020-11-12T17:27:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.423373+0000", 2020-11-12T17:27:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.423373+0000", 2020-11-12T17:27:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:17.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.423342+0000", 2020-11-12T17:27:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8252999999999997e-05 2020-11-12T17:27:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.423431+0000", 2020-11-12T17:27:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1202999999999999e-05 2020-11-12T17:27:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.423442+0000", 2020-11-12T17:27:17.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1270000000000002e-06 2020-11-12T17:27:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.423447+0000", 2020-11-12T17:27:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0082343929999999996 2020-11-12T17:27:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.431681+0000", 2020-11-12T17:27:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7700000000000006e-05 2020-11-12T17:27:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.431749+0000", 2020-11-12T17:27:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106204 2020-11-12T17:27:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.431855+0000", 2020-11-12T17:27:17.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001431498 2020-11-12T17:27:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.433287+0000", 2020-11-12T17:27:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0099140489999999994 2020-11-12T17:27:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.505 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29635 5.d 5:b394f7be:::benchmark_data_smithi036_24110_object3704:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.437701+0000", 2020-11-12T17:27:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.020713206000000001, 2020-11-12T17:27:17.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.021326942000000002, 2020-11-12T17:27:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29635 2020-11-12T17:27:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.507 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.437701+0000", 2020-11-12T17:27:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.437701+0000", 2020-11-12T17:27:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.437664+0000", 2020-11-12T17:27:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113063 2020-11-12T17:27:17.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.437777+0000", 2020-11-12T17:27:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1708e-05 2020-11-12T17:27:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.437799+0000", 2020-11-12T17:27:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5580000000000002e-06 2020-11-12T17:27:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.437803+0000", 2020-11-12T17:27:17.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033646040000000002 2020-11-12T17:27:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.441168+0000", 2020-11-12T17:27:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1232999999999999e-05 2020-11-12T17:27:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.441259+0000", 2020-11-12T17:27:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013152300000000001 2020-11-12T17:27:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.441391+0000", 2020-11-12T17:27:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0082287190000000007 2020-11-12T17:27:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.449620+0000", 2020-11-12T17:27:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011919030000000001 2020-11-12T17:27:17.514 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29636 5.d 5:b394f7be:::benchmark_data_smithi036_24110_object3704:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.438019+0000", 2020-11-12T17:27:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.020394281, 2020-11-12T17:27:17.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.021078962999999999, 2020-11-12T17:27:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29636 2020-11-12T17:27:17.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438019+0000", 2020-11-12T17:27:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438019+0000", 2020-11-12T17:27:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:27:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438000+0000", 2020-11-12T17:27:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7927000000000003e-05 2020-11-12T17:27:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438058+0000", 2020-11-12T17:27:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8409999999999995e-06 2020-11-12T17:27:17.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438068+0000", 2020-11-12T17:27:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7559999999999999e-06 2020-11-12T17:27:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438073+0000", 2020-11-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046294179999999997 2020-11-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442702+0000", 2020-11-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000150908 2020-11-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442853+0000", 2020-11-12T17:27:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195859 2020-11-12T17:27:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.443049+0000", 2020-11-12T17:27:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010006664 2020-11-12T17:27:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.453055+0000", 2020-11-12T17:27:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015036064 2020-11-12T17:27:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.523 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29637 5.d 5:b394f7be:::benchmark_data_smithi036_24110_object3704:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.438749+0000", 2020-11-12T17:27:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.019664797000000001, 2020-11-12T17:27:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020417283000000001, 2020-11-12T17:27:17.524 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29637 2020-11-12T17:27:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.525 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438749+0000", 2020-11-12T17:27:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438749+0000", 2020-11-12T17:27:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438728+0000", 2020-11-12T17:27:17.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8459999999999999e-05 2020-11-12T17:27:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438787+0000", 2020-11-12T17:27:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0654e-05 2020-11-12T17:27:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438797+0000", 2020-11-12T17:27:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7000000000000002e-06 2020-11-12T17:27:17.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.438804+0000", 2020-11-12T17:27:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060970410000000001 2020-11-12T17:27:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444901+0000", 2020-11-12T17:27:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107781 2020-11-12T17:27:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.445009+0000", 2020-11-12T17:27:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019216099999999999 2020-11-12T17:27:17.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.445201+0000", 2020-11-12T17:27:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010831982 2020-11-12T17:27:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.456033+0000", 2020-11-12T17:27:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017284145000000001 2020-11-12T17:27:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.533 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29638 5.d 5:b394f7be:::benchmark_data_smithi036_24110_object3704:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.441943+0000", 2020-11-12T17:27:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.016470500999999999, 2020-11-12T17:27:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017290740999999998, 2020-11-12T17:27:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.534 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29638 2020-11-12T17:27:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.441943+0000", 2020-11-12T17:27:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.441943+0000", 2020-11-12T17:27:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999647 2020-11-12T17:27:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.441908+0000", 2020-11-12T17:27:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010689800000000001 2020-11-12T17:27:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442015+0000", 2020-11-12T17:27:17.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6906e-05 2020-11-12T17:27:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442032+0000", 2020-11-12T17:27:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0713999999999999e-05 2020-11-12T17:27:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442042+0000", 2020-11-12T17:27:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045850589999999998 2020-11-12T17:27:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.446628+0000", 2020-11-12T17:27:17.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0722000000000003e-05 2020-11-12T17:27:17.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.446718+0000", 2020-11-12T17:27:17.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013288500000000001 2020-11-12T17:27:17.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.446851+0000", 2020-11-12T17:27:17.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0091950550000000006 2020-11-12T17:27:17.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.456046+0000", 2020-11-12T17:27:17.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014102962 2020-11-12T17:27:17.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.542 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29639 5.d 5:b394f7be:::benchmark_data_smithi036_24110_object3704:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.543 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.442095+0000", 2020-11-12T17:27:17.543 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.016318598, 2020-11-12T17:27:17.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017206618, 2020-11-12T17:27:17.543 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.543 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.544 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29639 2020-11-12T17:27:17.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.544 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442095+0000", 2020-11-12T17:27:17.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442095+0000", 2020-11-12T17:27:17.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:17.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442065+0000", 2020-11-12T17:27:17.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4353999999999998e-05 2020-11-12T17:27:17.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442159+0000", 2020-11-12T17:27:17.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3814e-05 2020-11-12T17:27:17.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442173+0000", 2020-11-12T17:27:17.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5179999999999998e-06 2020-11-12T17:27:17.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442180+0000", 2020-11-12T17:27:17.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060129600000000004 2020-11-12T17:27:17.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.448193+0000", 2020-11-12T17:27:17.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8763999999999993e-05 2020-11-12T17:27:17.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.448272+0000", 2020-11-12T17:27:17.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020312499999999999 2020-11-12T17:27:17.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.448475+0000", 2020-11-12T17:27:17.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0089489140000000005 2020-11-12T17:27:17.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.457424+0000", 2020-11-12T17:27:17.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015328962999999999 2020-11-12T17:27:17.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.551 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.551 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29640 5.d 5:b394f7be:::benchmark_data_smithi036_24110_object3704:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.551 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.442230+0000", 2020-11-12T17:27:17.551 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.016183640999999999, 2020-11-12T17:27:17.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01713918, 2020-11-12T17:27:17.552 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.552 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.552 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29640 2020-11-12T17:27:17.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.553 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442230+0000", 2020-11-12T17:27:17.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442230+0000", 2020-11-12T17:27:17.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:17.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442200+0000", 2020-11-12T17:27:17.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9847999999999998e-05 2020-11-12T17:27:17.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442290+0000", 2020-11-12T17:27:17.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3726e-05 2020-11-12T17:27:17.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442303+0000", 2020-11-12T17:27:17.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3520000000000001e-06 2020-11-12T17:27:17.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.442311+0000", 2020-11-12T17:27:17.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0073650900000000004 2020-11-12T17:27:17.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.449676+0000", 2020-11-12T17:27:17.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012513699999999999 2020-11-12T17:27:17.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.449801+0000", 2020-11-12T17:27:17.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020662600000000001 2020-11-12T17:27:17.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.450008+0000", 2020-11-12T17:27:17.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0077774569999999998 2020-11-12T17:27:17.559 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.559 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.559 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.559 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29641 5.d 5:bb542ce6:::benchmark_data_smithi036_24110_object3705:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.559 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.443758+0000", 2020-11-12T17:27:17.559 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.014655629999999999, 2020-11-12T17:27:17.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01567503, 2020-11-12T17:27:17.560 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.560 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.560 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.560 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.560 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.560 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29641 2020-11-12T17:27:17.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.561 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.443758+0000", 2020-11-12T17:27:17.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.443758+0000", 2020-11-12T17:27:17.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:17.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.443721+0000", 2020-11-12T17:27:17.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010694 2020-11-12T17:27:17.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.443828+0000", 2020-11-12T17:27:17.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5081e-05 2020-11-12T17:27:17.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.443843+0000", 2020-11-12T17:27:17.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7589999999999997e-06 2020-11-12T17:27:17.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.443851+0000", 2020-11-12T17:27:17.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0074634569999999997 2020-11-12T17:27:17.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.451315+0000", 2020-11-12T17:27:17.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00028457200000000003 2020-11-12T17:27:17.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.451599+0000", 2020-11-12T17:27:17.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025546 2020-11-12T17:27:17.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.451855+0000", 2020-11-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080966089999999994 2020-11-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:29642 5.d 5:bb542ce6:::benchmark_data_smithi036_24110_object3705:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:17.444187+0000", 2020-11-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.014226733, 2020-11-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015313522, 2020-11-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.568 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.569 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.569 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 29642 2020-11-12T17:27:17.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.569 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444187+0000", 2020-11-12T17:27:17.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444187+0000", 2020-11-12T17:27:17.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:17.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444149+0000", 2020-11-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000115058 2020-11-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444264+0000", 2020-11-12T17:27:17.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4432e-05 2020-11-12T17:27:17.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444278+0000", 2020-11-12T17:27:17.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1620000000000002e-06 2020-11-12T17:27:17.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.444286+0000", 2020-11-12T17:27:17.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088301839999999996 2020-11-12T17:27:17.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.453116+0000", 2020-11-12T17:27:17.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015472000000000001 2020-11-12T17:27:17.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.453271+0000", 2020-11-12T17:27:17.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200201 2020-11-12T17:27:17.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:17.453471+0000", 2020-11-12T17:27:17.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092837639999999999 2020-11-12T17:27:17.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.575 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.575 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:17.576 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 14 2020-11-12T17:27:17.576 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:17.577 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:17.577 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:17.578 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:17.579 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 31 16 29751 29735 7.493 6.42188 0.0124498 0.0166718 2020-11-12T17:27:17.579 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:17.572+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:17.678 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:17.674+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:17.759 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:17.760 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:17.760 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:17.760 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:17.760 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:17.775 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:17.779 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:17.778+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:17.881 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:17.876+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:17.888 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:17.888 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:17.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:17.888 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:17.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.889 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.6 123/122 [PushOp(4:60824407:::benchmark_data_smithi036_18856_object6950:head, version: 100'3208, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:60824407:::benchmark_data_smithi036_18856_object6950:head@100'3208, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:17.889 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:17.889 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.198439934, 2020-11-12T17:27:17.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998, 2020-11-12T17:27:17.889 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.889 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:17.889 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:17.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:27:17.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:17.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687268+0000", 2020-11-12T17:27:17.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2052999999999994e-05 2020-11-12T17:27:17.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687360+0000", 2020-11-12T17:27:17.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54419334699999999 2020-11-12T17:27:17.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231553+0000", 2020-11-12T17:27:17.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.362e-06 2020-11-12T17:27:17.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231560+0000", 2020-11-12T17:27:17.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000185682 2020-11-12T17:27:17.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231746+0000", 2020-11-12T17:27:17.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0793e-05 2020-11-12T17:27:17.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231797+0000", 2020-11-12T17:27:17.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003344549 2020-11-12T17:27:17.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:17.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.235141+0000", 2020-11-12T17:27:17.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998 2020-11-12T17:27:17.896 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.896 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.896 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.897 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:1512 5.a 5:56e3a795:::benchmark_data_smithi036_24110_object188:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e130)", 2020-11-12T17:27:17.897 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:17.897 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.969639361999999, 2020-11-12T17:27:17.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25162866900000003, 2020-11-12T17:27:17.897 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.897 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:17.897 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.898 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.898 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.898 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 1512 2020-11-12T17:27:17.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.898 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:17.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916084+0000", 2020-11-12T17:27:17.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:17.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916054+0000", 2020-11-12T17:27:17.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5012000000000005e-05 2020-11-12T17:27:17.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916139+0000", 2020-11-12T17:27:17.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7899999999999994e-06 2020-11-12T17:27:17.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916148+0000", 2020-11-12T17:27:17.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5700000000000003e-06 2020-11-12T17:27:17.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.916153+0000", 2020-11-12T17:27:17.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0071457680000000003 2020-11-12T17:27:17.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923299+0000", 2020-11-12T17:27:17.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2009999999999998e-05 2020-11-12T17:27:17.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923361+0000", 2020-11-12T17:27:17.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106986 2020-11-12T17:27:17.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:17.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.923468+0000", 2020-11-12T17:27:17.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00094293899999999995 2020-11-12T17:27:17.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:47.924411+0000", 2020-11-12T17:27:17.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24318124399999999 2020-11-12T17:27:17.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:17.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167592+0000", 2020-11-12T17:27:17.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9159999999999995e-05 2020-11-12T17:27:17.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:17.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167661+0000", 2020-11-12T17:27:17.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1243999999999999e-05 2020-11-12T17:27:17.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:17.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:48.167712+0000", 2020-11-12T17:27:17.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25162866900000003 2020-11-12T17:27:17.909 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.909 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.909 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.909 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11901 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:17.910 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:17.910 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.935513564000001, 2020-11-12T17:27:17.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29431180699999998, 2020-11-12T17:27:17.910 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.910 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:17.910 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.911 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.911 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.911 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11901 2020-11-12T17:27:17.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.911 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:17.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950209+0000", 2020-11-12T17:27:17.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999785 2020-11-12T17:27:17.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950188+0000", 2020-11-12T17:27:17.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2355999999999997e-05 2020-11-12T17:27:17.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950250+0000", 2020-11-12T17:27:17.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3710000000000002e-06 2020-11-12T17:27:17.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950258+0000", 2020-11-12T17:27:17.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.343e-06 2020-11-12T17:27:17.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950261+0000", 2020-11-12T17:27:17.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060384219999999999 2020-11-12T17:27:17.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956299+0000", 2020-11-12T17:27:17.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014742999999999999 2020-11-12T17:27:17.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956447+0000", 2020-11-12T17:27:17.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026288400000000001 2020-11-12T17:27:17.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.956710+0000", 2020-11-12T17:27:17.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047596729999999999 2020-11-12T17:27:17.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961469+0000", 2020-11-12T17:27:17.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28285178999999999 2020-11-12T17:27:17.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:17.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244321+0000", 2020-11-12T17:27:17.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120733 2020-11-12T17:27:17.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:17.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244442+0000", 2020-11-12T17:27:17.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.941e-05 2020-11-12T17:27:17.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:17.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244521+0000", 2020-11-12T17:27:17.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29431180699999998 2020-11-12T17:27:17.921 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.921 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.922 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.922 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11902 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:17.922 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:17.922 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.934676742000001, 2020-11-12T17:27:17.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002, 2020-11-12T17:27:17.922 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.923 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:17.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.923 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11902 2020-11-12T17:27:17.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.923 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:17.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:27:17.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:17.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950968+0000", 2020-11-12T17:27:17.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022604299999999999 2020-11-12T17:27:17.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951194+0000", 2020-11-12T17:27:17.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1806e-05 2020-11-12T17:27:17.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951226+0000", 2020-11-12T17:27:17.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5761999999999999e-05 2020-11-12T17:27:17.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951241+0000", 2020-11-12T17:27:17.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006854845 2020-11-12T17:27:17.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958096+0000", 2020-11-12T17:27:17.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026652700000000002 2020-11-12T17:27:17.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958363+0000", 2020-11-12T17:27:17.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000368857 2020-11-12T17:27:17.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958732+0000", 2020-11-12T17:27:17.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027531859999999999 2020-11-12T17:27:17.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961485+0000", 2020-11-12T17:27:17.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43528204399999998 2020-11-12T17:27:17.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:17.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396767+0000", 2020-11-12T17:27:17.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015781399999999999 2020-11-12T17:27:17.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:17.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396925+0000", 2020-11-12T17:27:17.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109403 2020-11-12T17:27:17.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:17.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397034+0000", 2020-11-12T17:27:17.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002 2020-11-12T17:27:17.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.937 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.937 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11903 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:17.937 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:17.938 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.934079195999999, 2020-11-12T17:27:17.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221, 2020-11-12T17:27:17.938 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.938 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:17.938 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.938 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.938 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.939 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11903 2020-11-12T17:27:17.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.939 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:17.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:27:17.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999228 2020-11-12T17:27:17.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951566+0000", 2020-11-12T17:27:17.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024334899999999999 2020-11-12T17:27:17.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951810+0000", 2020-11-12T17:27:17.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9034e-05 2020-11-12T17:27:17.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951839+0000", 2020-11-12T17:27:17.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4151000000000001e-05 2020-11-12T17:27:17.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951853+0000", 2020-11-12T17:27:17.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081211489999999994 2020-11-12T17:27:17.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.959974+0000", 2020-11-12T17:27:17.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013490799999999999 2020-11-12T17:27:17.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960109+0000", 2020-11-12T17:27:17.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000252172 2020-11-12T17:27:17.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960361+0000", 2020-11-12T17:27:17.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024598829999999999 2020-11-12T17:27:17.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962821+0000", 2020-11-12T17:27:17.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43434482000000002 2020-11-12T17:27:17.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:17.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397166+0000", 2020-11-12T17:27:17.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054200000000001 2020-11-12T17:27:17.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:17.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397296+0000", 2020-11-12T17:27:17.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5556000000000005e-05 2020-11-12T17:27:17.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:17.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397392+0000", 2020-11-12T17:27:17.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221 2020-11-12T17:27:17.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.950 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.950 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11904 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:17.950 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:17.951 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.931616081000001, 2020-11-12T17:27:17.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003, 2020-11-12T17:27:17.951 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.951 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:17.951 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.951 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.951 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.951 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11904 2020-11-12T17:27:17.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.952 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:17.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:27:17.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999237 2020-11-12T17:27:17.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954031+0000", 2020-11-12T17:27:17.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021660900000000001 2020-11-12T17:27:17.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954247+0000", 2020-11-12T17:27:17.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4606e-05 2020-11-12T17:27:17.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954282+0000", 2020-11-12T17:27:17.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.552e-05 2020-11-12T17:27:17.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954297+0000", 2020-11-12T17:27:17.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0072408330000000003 2020-11-12T17:27:17.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961538+0000", 2020-11-12T17:27:17.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013512800000000001 2020-11-12T17:27:17.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961673+0000", 2020-11-12T17:27:17.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023430200000000001 2020-11-12T17:27:17.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:17.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961908+0000", 2020-11-12T17:27:17.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016600740000000001 2020-11-12T17:27:17.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963568+0000", 2020-11-12T17:27:17.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43393070099999997 2020-11-12T17:27:17.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:17.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397499+0000", 2020-11-12T17:27:17.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012872 2020-11-12T17:27:17.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:17.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397627+0000", 2020-11-12T17:27:17.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4786999999999999e-05 2020-11-12T17:27:17.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:17.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397722+0000", 2020-11-12T17:27:17.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003 2020-11-12T17:27:17.961 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.961 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.961 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.962 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:11901 5.d e133/127 ondisk, result = 0)", 2020-11-12T17:27:17.962 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:17.962 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.927586132999998, 2020-11-12T17:27:17.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28640288899999999, 2020-11-12T17:27:17.962 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.962 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:17.963 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:17.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958137+0000", 2020-11-12T17:27:17.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:17.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958116+0000", 2020-11-12T17:27:17.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1677e-05 2020-11-12T17:27:17.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958167+0000", 2020-11-12T17:27:17.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28596560999999998 2020-11-12T17:27:17.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244133+0000", 2020-11-12T17:27:17.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2449999999999999e-05 2020-11-12T17:27:17.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244146+0000", 2020-11-12T17:27:17.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013661000000000001 2020-11-12T17:27:17.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244282+0000", 2020-11-12T17:27:17.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9877e-05 2020-11-12T17:27:17.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244302+0000", 2020-11-12T17:27:17.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000237693 2020-11-12T17:27:17.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:17.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.244540+0000", 2020-11-12T17:27:17.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28640288899999999 2020-11-12T17:27:17.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.970 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11909 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:17.970 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:17.970 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.923877385000001, 2020-11-12T17:27:17.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999, 2020-11-12T17:27:17.970 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.970 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:17.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.971 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.971 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11909 2020-11-12T17:27:17.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.971 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:17.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:27:17.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:27:17.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961803+0000", 2020-11-12T17:27:17.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9606999999999998e-05 2020-11-12T17:27:17.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961893+0000", 2020-11-12T17:27:17.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0258000000000001e-05 2020-11-12T17:27:17.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961903+0000", 2020-11-12T17:27:17.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8450000000000003e-06 2020-11-12T17:27:17.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961911+0000", 2020-11-12T17:27:17.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00090397899999999996 2020-11-12T17:27:17.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962815+0000", 2020-11-12T17:27:17.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106487 2020-11-12T17:27:17.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962921+0000", 2020-11-12T17:27:17.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027479400000000003 2020-11-12T17:27:17.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:17.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963196+0000", 2020-11-12T17:27:17.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002806041 2020-11-12T17:27:17.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966002+0000", 2020-11-12T17:27:17.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42403797700000001 2020-11-12T17:27:17.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:17.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390040+0000", 2020-11-12T17:27:17.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017360699999999999 2020-11-12T17:27:17.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:17.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390214+0000", 2020-11-12T17:27:17.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012036600000000001 2020-11-12T17:27:17.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:17.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390334+0000", 2020-11-12T17:27:17.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999 2020-11-12T17:27:17.983 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.983 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.983 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.983 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11910 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:17.984 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:17.984 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.922661092999999, 2020-11-12T17:27:17.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002, 2020-11-12T17:27:17.984 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.984 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:17.984 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.985 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.985 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.985 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11910 2020-11-12T17:27:17.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.985 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:17.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:17.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:17.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:27:17.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999413 2020-11-12T17:27:17.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:17.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963003+0000", 2020-11-12T17:27:17.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017848699999999999 2020-11-12T17:27:17.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:17.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963182+0000", 2020-11-12T17:27:17.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7229000000000001e-05 2020-11-12T17:27:17.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:17.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963199+0000", 2020-11-12T17:27:17.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2609999999999999e-06 2020-11-12T17:27:17.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:17.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963208+0000", 2020-11-12T17:27:17.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089699300000000001 2020-11-12T17:27:17.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:17.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964105+0000", 2020-11-12T17:27:17.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012321200000000001 2020-11-12T17:27:17.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:17.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964228+0000", 2020-11-12T17:27:17.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022185600000000001 2020-11-12T17:27:17.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:17.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964450+0000", 2020-11-12T17:27:17.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001555697 2020-11-12T17:27:17.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:17.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966006+0000", 2020-11-12T17:27:17.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42809403299999998 2020-11-12T17:27:17.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:17.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394100+0000", 2020-11-12T17:27:17.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012522 2020-11-12T17:27:17.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:17.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394225+0000", 2020-11-12T17:27:17.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014087 2020-11-12T17:27:17.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:17.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394366+0000", 2020-11-12T17:27:17.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002 2020-11-12T17:27:17.996 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.996 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:17.997 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:17.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.997 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11911 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:17.997 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:17.997 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.922431351, 2020-11-12T17:27:17.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998, 2020-11-12T17:27:17.998 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:17.998 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:17.998 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:17.998 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:17.998 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:17.999 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11911 2020-11-12T17:27:17.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:17.999 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:17.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:17.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:17.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:18.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:27:18.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999547 2020-11-12T17:27:18.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963246+0000", 2020-11-12T17:27:18.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000132867 2020-11-12T17:27:18.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963379+0000", 2020-11-12T17:27:18.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1556000000000002e-05 2020-11-12T17:27:18.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963401+0000", 2020-11-12T17:27:18.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2499999999999997e-05 2020-11-12T17:27:18.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963433+0000", 2020-11-12T17:27:18.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018380040000000001 2020-11-12T17:27:18.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965271+0000", 2020-11-12T17:27:18.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6691000000000002e-05 2020-11-12T17:27:18.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965338+0000", 2020-11-12T17:27:18.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100777 2020-11-12T17:27:18.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:18.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965439+0000", 2020-11-12T17:27:18.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001679198 2020-11-12T17:27:18.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967118+0000", 2020-11-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.435251412 2020-11-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402369+0000", 2020-11-12T17:27:18.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6074000000000005e-05 2020-11-12T17:27:18.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402435+0000", 2020-11-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6678999999999997e-05 2020-11-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402492+0000", 2020-11-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998 2020-11-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.012 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.013 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11912 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:18.013 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:18.013 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.919403401, 2020-11-12T17:27:18.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997, 2020-11-12T17:27:18.014 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.014 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.014 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.014 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:18.014 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:18.015 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11912 2020-11-12T17:27:18.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.015 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:18.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:27:18.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:18.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966296+0000", 2020-11-12T17:27:18.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6765000000000002e-05 2020-11-12T17:27:18.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966363+0000", 2020-11-12T17:27:18.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3097e-05 2020-11-12T17:27:18.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966376+0000", 2020-11-12T17:27:18.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0669999999999998e-06 2020-11-12T17:27:18.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966385+0000", 2020-11-12T17:27:18.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7963999999999997e-05 2020-11-12T17:27:18.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966433+0000", 2020-11-12T17:27:18.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0263999999999998e-05 2020-11-12T17:27:18.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966494+0000", 2020-11-12T17:27:18.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120279 2020-11-12T17:27:18.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:18.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966614+0000", 2020-11-12T17:27:18.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001180424 2020-11-12T17:27:18.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967794+0000", 2020-11-12T17:27:18.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43476916100000002 2020-11-12T17:27:18.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402563+0000", 2020-11-12T17:27:18.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7442999999999998e-05 2020-11-12T17:27:18.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402631+0000", 2020-11-12T17:27:18.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8424999999999998e-05 2020-11-12T17:27:18.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402679+0000", 2020-11-12T17:27:18.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997 2020-11-12T17:27:18.026 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.026 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.026 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.027 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11913 5.d 5:b8059c51:::benchmark_data_smithi036_24110_object1489:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:18.027 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:18.027 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.756973406, 2020-11-12T17:27:18.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26925581300000001, 2020-11-12T17:27:18.028 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.028 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.028 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.028 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:18.028 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:18.029 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11913 2020-11-12T17:27:18.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.029 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:18.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128750+0000", 2020-11-12T17:27:18.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999523 2020-11-12T17:27:18.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128702+0000", 2020-11-12T17:27:18.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013552400000000001 2020-11-12T17:27:18.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128837+0000", 2020-11-12T17:27:18.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6769999999999999e-05 2020-11-12T17:27:18.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128864+0000", 2020-11-12T17:27:18.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.261e-05 2020-11-12T17:27:18.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.128877+0000", 2020-11-12T17:27:18.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125313 2020-11-12T17:27:18.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129002+0000", 2020-11-12T17:27:18.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00034839700000000002 2020-11-12T17:27:18.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129350+0000", 2020-11-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030113699999999999 2020-11-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.129652+0000", 2020-11-12T17:27:18.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022631880000000002 2020-11-12T17:27:18.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.131915+0000", 2020-11-12T17:27:18.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26589388400000002 2020-11-12T17:27:18.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397809+0000", 2020-11-12T17:27:18.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000114862 2020-11-12T17:27:18.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397923+0000", 2020-11-12T17:27:18.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1882e-05 2020-11-12T17:27:18.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.398005+0000", 2020-11-12T17:27:18.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26925581300000001 2020-11-12T17:27:18.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.040 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.041 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14919 5.6 5:6a28bd79:::benchmark_data_smithi036_24110_object1864:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:18.041 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.245278+0000", 2020-11-12T17:27:18.041 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.640444957, 2020-11-12T17:27:18.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37589861299999999, 2020-11-12T17:27:18.042 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.042 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:18.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14919 2020-11-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245278+0000", 2020-11-12T17:27:18.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245278+0000", 2020-11-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245242+0000", 2020-11-12T17:27:18.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010559499999999999 2020-11-12T17:27:18.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245348+0000", 2020-11-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3886999999999999e-05 2020-11-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245361+0000", 2020-11-12T17:27:18.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1739999999999997e-06 2020-11-12T17:27:18.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.245368+0000", 2020-11-12T17:27:18.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021369129999999998 2020-11-12T17:27:18.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.247505+0000", 2020-11-12T17:27:18.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000167682 2020-11-12T17:27:18.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.247672+0000", 2020-11-12T17:27:18.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000248874 2020-11-12T17:27:18.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:18.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.247921+0000", 2020-11-12T17:27:18.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044640180000000002 2020-11-12T17:27:18.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.252385+0000", 2020-11-12T17:27:18.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36865272599999999 2020-11-12T17:27:18.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621038+0000", 2020-11-12T17:27:18.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7316000000000003e-05 2020-11-12T17:27:18.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621115+0000", 2020-11-12T17:27:18.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1439999999999995e-05 2020-11-12T17:27:18.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621177+0000", 2020-11-12T17:27:18.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37589861299999999 2020-11-12T17:27:18.055 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.055 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.055 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.055 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14920 5.6 5:6a28bd79:::benchmark_data_smithi036_24110_object1864:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:18.056 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.246843+0000", 2020-11-12T17:27:18.056 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.63887985, 2020-11-12T17:27:18.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37860764600000002, 2020-11-12T17:27:18.056 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.056 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.056 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.057 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:18.057 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:18.057 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14920 2020-11-12T17:27:18.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.057 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246843+0000", 2020-11-12T17:27:18.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246843+0000", 2020-11-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246803+0000", 2020-11-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011126200000000001 2020-11-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246914+0000", 2020-11-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5925000000000001e-05 2020-11-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246930+0000", 2020-11-12T17:27:18.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9270000000000005e-06 2020-11-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.246938+0000", 2020-11-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017497649999999999 2020-11-12T17:27:18.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.248688+0000", 2020-11-12T17:27:18.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3158999999999996e-05 2020-11-12T17:27:18.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.248751+0000", 2020-11-12T17:27:18.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116112 2020-11-12T17:27:18.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:18.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.248867+0000", 2020-11-12T17:27:18.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0035256179999999999 2020-11-12T17:27:18.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.252392+0000", 2020-11-12T17:27:18.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37298045299999999 2020-11-12T17:27:18.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.625373+0000", 2020-11-12T17:27:18.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.443e-05 2020-11-12T17:27:18.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.625417+0000", 2020-11-12T17:27:18.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3444e-05 2020-11-12T17:27:18.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.625451+0000", 2020-11-12T17:27:18.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37860764600000002 2020-11-12T17:27:18.069 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.069 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.069 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.069 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:14919 5.6 e137/127 ondisk, result = 0)", 2020-11-12T17:27:18.069 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.251548+0000", 2020-11-12T17:27:18.070 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.634175191000001, 2020-11-12T17:27:18.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36963633000000001, 2020-11-12T17:27:18.070 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.070 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:18.070 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251548+0000", 2020-11-12T17:27:18.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251548+0000", 2020-11-12T17:27:18.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:18.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251523+0000", 2020-11-12T17:27:18.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4719000000000003e-05 2020-11-12T17:27:18.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.251568+0000", 2020-11-12T17:27:18.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36934947400000001 2020-11-12T17:27:18.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620917+0000", 2020-11-12T17:27:18.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9519999999999997e-06 2020-11-12T17:27:18.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620924+0000", 2020-11-12T17:27:18.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1785000000000003e-05 2020-11-12T17:27:18.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621016+0000", 2020-11-12T17:27:18.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0672999999999999e-05 2020-11-12T17:27:18.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621027+0000", 2020-11-12T17:27:18.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015729000000000001 2020-11-12T17:27:18.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.621184+0000", 2020-11-12T17:27:18.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36963633000000001 2020-11-12T17:27:18.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.078 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.079 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:15008 5.d 5:bb9506a3:::benchmark_data_smithi036_24110_object1875:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:18.079 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.343191+0000", 2020-11-12T17:27:18.079 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.542531597, 2020-11-12T17:27:18.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27534693300000002, 2020-11-12T17:27:18.079 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.080 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:18.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:18.080 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 15008 2020-11-12T17:27:18.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.081 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343191+0000", 2020-11-12T17:27:18.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343191+0000", 2020-11-12T17:27:18.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:18.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343154+0000", 2020-11-12T17:27:18.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010024199999999999 2020-11-12T17:27:18.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343254+0000", 2020-11-12T17:27:18.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9607e-05 2020-11-12T17:27:18.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343274+0000", 2020-11-12T17:27:18.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0360000000000001e-05 2020-11-12T17:27:18.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.343284+0000", 2020-11-12T17:27:18.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031873819999999999 2020-11-12T17:27:18.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.346471+0000", 2020-11-12T17:27:18.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8413999999999999e-05 2020-11-12T17:27:18.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.346540+0000", 2020-11-12T17:27:18.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108972 2020-11-12T17:27:18.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:18.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.346649+0000", 2020-11-12T17:27:18.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0012527529999999999 2020-11-12T17:27:18.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.347901+0000", 2020-11-12T17:27:18.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27048926099999998 2020-11-12T17:27:18.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618391+0000", 2020-11-12T17:27:18.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9011000000000006e-05 2020-11-12T17:27:18.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618470+0000", 2020-11-12T17:27:18.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8559000000000005e-05 2020-11-12T17:27:18.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618538+0000", 2020-11-12T17:27:18.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27534693300000002 2020-11-12T17:27:18.092 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.092 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.092 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.093 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:15008 5.d e137/127 ondisk, result = 0)", 2020-11-12T17:27:18.093 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.348752+0000", 2020-11-12T17:27:18.093 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.536970681, 2020-11-12T17:27:18.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.269797817, 2020-11-12T17:27:18.094 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.094 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:18.094 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348752+0000", 2020-11-12T17:27:18.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348752+0000", 2020-11-12T17:27:18.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:18.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348716+0000", 2020-11-12T17:27:18.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3648999999999997e-05 2020-11-12T17:27:18.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.348810+0000", 2020-11-12T17:27:18.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26755567299999999 2020-11-12T17:27:18.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.616365+0000", 2020-11-12T17:27:18.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5039999999999996e-06 2020-11-12T17:27:18.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.616373+0000", 2020-11-12T17:27:18.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019946999999999999 2020-11-12T17:27:18.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618367+0000", 2020-11-12T17:27:18.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0929e-05 2020-11-12T17:27:18.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618378+0000", 2020-11-12T17:27:18.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017173000000000001 2020-11-12T17:27:18.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.618550+0000", 2020-11-12T17:27:18.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.269797817 2020-11-12T17:27:18.102 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.102 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.103 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.104 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:16064 5.a 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:27:18.104 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:27:18.104 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.390574827, 2020-11-12T17:27:18.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999, 2020-11-12T17:27:18.105 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.105 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.105 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.105 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:18.105 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:18.105 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 16064 2020-11-12T17:27:18.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.106 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:27:18.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:27:18.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:18.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495102+0000", 2020-11-12T17:27:18.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012806100000000001 2020-11-12T17:27:18.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495230+0000", 2020-11-12T17:27:18.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1214999999999999e-05 2020-11-12T17:27:18.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495251+0000", 2020-11-12T17:27:18.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1668000000000001e-05 2020-11-12T17:27:18.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495262+0000", 2020-11-12T17:27:18.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6068999999999994e-05 2020-11-12T17:27:18.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495329+0000", 2020-11-12T17:27:18.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011465599999999999 2020-11-12T17:27:18.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495443+0000", 2020-11-12T17:27:18.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000230077 2020-11-12T17:27:18.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:18.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495673+0000", 2020-11-12T17:27:18.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013291710000000001 2020-11-12T17:27:18.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.497002+0000", 2020-11-12T17:27:18.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69030446599999995 2020-11-12T17:27:18.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187307+0000", 2020-11-12T17:27:18.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011451999999999999 2020-11-12T17:27:18.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187421+0000", 2020-11-12T17:27:18.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5153000000000004e-05 2020-11-12T17:27:18.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187497+0000", 2020-11-12T17:27:18.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999 2020-11-12T17:27:18.115 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.116 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.116 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.116 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:25504 5.8 5:1e684974:::benchmark_data_smithi036_24110_object3187:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:27:18.116 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.134048+0000", 2020-11-12T17:27:18.116 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.7516749740000002, 2020-11-12T17:27:18.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25341378199999998, 2020-11-12T17:27:18.117 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.117 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.117 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.117 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:18.117 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:18.117 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 25504 2020-11-12T17:27:18.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.118 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.134048+0000", 2020-11-12T17:27:18.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.134048+0000", 2020-11-12T17:27:18.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999404 2020-11-12T17:27:18.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.133988+0000", 2020-11-12T17:27:18.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015082600000000001 2020-11-12T17:27:18.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.134139+0000", 2020-11-12T17:27:18.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3716e-05 2020-11-12T17:27:18.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.134153+0000", 2020-11-12T17:27:18.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.348e-06 2020-11-12T17:27:18.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.134159+0000", 2020-11-12T17:27:18.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0063775979999999999 2020-11-12T17:27:18.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.140537+0000", 2020-11-12T17:27:18.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4251000000000003e-05 2020-11-12T17:27:18.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.140631+0000", 2020-11-12T17:27:18.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000155508 2020-11-12T17:27:18.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:18.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.140787+0000", 2020-11-12T17:27:18.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019019690000000001 2020-11-12T17:27:18.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.142689+0000", 2020-11-12T17:27:18.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24459969100000001 2020-11-12T17:27:18.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.387288+0000", 2020-11-12T17:27:18.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000115048 2020-11-12T17:27:18.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.387403+0000", 2020-11-12T17:27:18.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8359000000000001e-05 2020-11-12T17:27:18.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.387462+0000", 2020-11-12T17:27:18.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.25341378199999998 2020-11-12T17:27:18.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.127 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.128 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:25504 5.8 e144/135 ondisk, result = 0)", 2020-11-12T17:27:18.128 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.143210+0000", 2020-11-12T17:27:18.128 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.7425132269999999, 2020-11-12T17:27:18.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.244280782, 2020-11-12T17:27:18.128 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.128 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:18.129 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.143210+0000", 2020-11-12T17:27:18.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.143210+0000", 2020-11-12T17:27:18.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:27:18.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.143186+0000", 2020-11-12T17:27:18.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3069000000000002e-05 2020-11-12T17:27:18.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.143249+0000", 2020-11-12T17:27:18.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.24143334999999999 2020-11-12T17:27:18.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.384683+0000", 2020-11-12T17:27:18.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8230000000000001e-06 2020-11-12T17:27:18.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.384691+0000", 2020-11-12T17:27:18.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002572183 2020-11-12T17:27:18.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.387264+0000", 2020-11-12T17:27:18.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4216000000000001e-05 2020-11-12T17:27:18.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.387278+0000", 2020-11-12T17:27:18.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021262399999999999 2020-11-12T17:27:18.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.387491+0000", 2020-11-12T17:27:18.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.244280782 2020-11-12T17:27:18.136 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.136 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.136 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.136 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.136 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.136 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:18.138 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:18.139 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:18.134+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:18.239 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:18.236+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:18.356 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:18.356 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:18.356 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:18.357 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:18.357 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:18.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:18.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:18.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:18.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:18.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:18.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:18.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:18.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:18.358 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:18.354+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:18.359 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:18.457 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:18.452+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:18.563 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:18.564 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:18.564 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:18.564 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:18.565 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:18.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 32 16 30763 30747 7.50588 7.90625 0.00612697 0.0165888 2020-11-12T17:27:18.567 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:18.556+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:18.567 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:18.663 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:18.660+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:18.753 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:18.775 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:18.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:18.775 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:18.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.776 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:18.776 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:18.776 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 253.64181902499999, 2020-11-12T17:27:18.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:18.776 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.776 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.776 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.777 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:18.777 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:18.777 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:18.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.777 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:18.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:18.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:18.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:18.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:18.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:18.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:18.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:18.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:18.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:18.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:18.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:18.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:18.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:18.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:18.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:18.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:18.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:18.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:18.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:18.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:18.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:18.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:18.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:18.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:18.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:18.793 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.793 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.793 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.794 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:18.794 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:18.794 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 253.63472722899999, 2020-11-12T17:27:18.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:18.795 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.795 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:18.795 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:18.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:18.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:18.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:18.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:18.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:18.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:18.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:18.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:18.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:18.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:18.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:18.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:18.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:18.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:18.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:18.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:18.803 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.803 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.803 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.804 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:18.804 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:18.804 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 244.20216773199999, 2020-11-12T17:27:18.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:18.805 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.805 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.805 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.805 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:18.805 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:18.806 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:18.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.806 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:18.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:18.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:18.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:18.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:18.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:18.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:18.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:18.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:18.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:18.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:18.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:18.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:18.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:18.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:18.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:18.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:18.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:18.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:18.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:18.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:18.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:18.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:18.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:18.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:18.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:18.817 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.818 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.818 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.818 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:18.819 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:18.819 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 210.25204763799999, 2020-11-12T17:27:18.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:18.819 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.819 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:18.819 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:18.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:18.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:18.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:18.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:18.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:18.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:18.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:18.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:18.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:18.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:18.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:18.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:18.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:18.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:18.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:18.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:18.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.828 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.828 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.828 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:18.828 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:18.829 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 208.14644574600001, 2020-11-12T17:27:18.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:18.829 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.829 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.829 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:18.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:18.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:18.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:18.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:18.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:18.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:18.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:18.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:18.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:18.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:18.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:18.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:18.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:18.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:18.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:18.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:18.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:18.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:18.839 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.839 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.839 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.839 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:18.840 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:18.840 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 176.79996241200001, 2020-11-12T17:27:18.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:18.840 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.840 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.840 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.841 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:18.841 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:18.841 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:18.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.841 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:18.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:18.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:18.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:18.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:18.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:18.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:18.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:18.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:18.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:18.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:18.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:18.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:18.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:18.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:18.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:18.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:18.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:18.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:18.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:18.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:18.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:18.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:18.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:18.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:18.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:18.852 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.853 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.853 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:18.853 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:18.853 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 167.80412061000001, 2020-11-12T17:27:18.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:18.854 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.854 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:18.854 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:18.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:18.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:18.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:18.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:18.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:18.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:18.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:18.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:18.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:18.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:18.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:18.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:18.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:18.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:18.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:18.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:18.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.860 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.861 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:18.861 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:18.861 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 163.869017211, 2020-11-12T17:27:18.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:18.861 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.861 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:18.862 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:18.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:18.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:18.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:18.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:18.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:18.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:18.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:18.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 133.10437672, 2020-11-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:18.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:18.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:18.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:18.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:18.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:18.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:18.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:18.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:18.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:18.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:18.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:18.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:18.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:18.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:18.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:18.875 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.875 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.875 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.875 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:18.875 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:18.875 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.84786803599999, 2020-11-12T17:27:18.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:18.876 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.876 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.876 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.876 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:18.876 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:18.876 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:18.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.877 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.877 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.877 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:18.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:18.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:18.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:18.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:18.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:18.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:18.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:18.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:18.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:18.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:18.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:18.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:18.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:18.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:18.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:18.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:18.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:18.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:18.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:18.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:18.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:18.885 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.885 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.886 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.886 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:18.886 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:18.886 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.847705666, 2020-11-12T17:27:18.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:18.887 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.887 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.887 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.887 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:18.888 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:18.888 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:18.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.888 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:18.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:18.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:18.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:18.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:18.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:18.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:18.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:18.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:18.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:18.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:18.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:18.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:18.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:18.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:18.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:18.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.897 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.898 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:18.898 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:18.898 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.83913667900001, 2020-11-12T17:27:18.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:18.898 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:18.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:18.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:18.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:18.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:18.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:18.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:18.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:18.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:18.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:18.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:18.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:18.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:18.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:18.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:18.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:18.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:18.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.927 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.928 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:18.928 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:18.928 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.334624229, 2020-11-12T17:27:18.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:18.928 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.928 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.928 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.929 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:18.929 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:18.929 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:18.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.929 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:18.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:18.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:18.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:18.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:18.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:18.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:18.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:18.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:18.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:18.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:18.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:18.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:18.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:18.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:18.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:18.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:18.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:18.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:18.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:18.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:18.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:18.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:18.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:18.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:18.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:18.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.939 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.939 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.939 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:18.939 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:18.939 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 100.849075943, 2020-11-12T17:27:18.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:18.940 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.940 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:18.940 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:18.940 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:18.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.941 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:18.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:18.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:18.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:18.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:18.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:18.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:18.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:18.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:18.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:18.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:18.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:18.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:18.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:18.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:18.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:18.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:18.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:18.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:18.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:18.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 97.775757510999995, 2020-11-12T17:27:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:18.952 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:18.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:18.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:18.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:18.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:18.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:18.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:18.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:18.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:18.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:18.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:18.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:18.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:18.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:18.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:18.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:18.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:18.958 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.958 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.958 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.958 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:18.958 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:18.958 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 96.720112534999998, 2020-11-12T17:27:18.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:18.959 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.959 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.959 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.959 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:18.959 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:18.959 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:18.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.960 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:18.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:18.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:18.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:18.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:18.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:18.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:18.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:18.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:18.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:18.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:18.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:18.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:18.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:18.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:18.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:18.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:18.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:18.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:18.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:18.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:18.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:18.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:18.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:18.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:18.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:18.968 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.968 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.968 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.969 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:18.969 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:18.969 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 96.331908163999998, 2020-11-12T17:27:18.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:18.969 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.969 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:18.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:18.970 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:18.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.970 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:18.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:18.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:18.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:18.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:18.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:18.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:18.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:18.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:18.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:18.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:18.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:18.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:18.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:18.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:18.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:18.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:18.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:18.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:18.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:18.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:18.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:18.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:18.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:18.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:18.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:18.979 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.979 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.979 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.980 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:18.980 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:18.980 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 82.125451232000003, 2020-11-12T17:27:18.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:18.980 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.980 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.980 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:18.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:18.981 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:18.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.981 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:18.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:18.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:18.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:18.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:18.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:18.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:18.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:18.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:18.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:18.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:18.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:18.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:18.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:18.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:18.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:18.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:18.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:18.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:18.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:18.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:18.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:18.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:18.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:18.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:18.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:18.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:18.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:18.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:18.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.991 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:18.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:18.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.991 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:18.991 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:18.991 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.876245615000002, 2020-11-12T17:27:18.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:18.992 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:18.992 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:18.992 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:18.992 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:18.992 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:18.992 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:18.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.993 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:18.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:18.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:18.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:18.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:18.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:18.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:18.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:18.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:18.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:18.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:18.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:18.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:18.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:18.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:18.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:18.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:18.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:18.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:18.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:18.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:18.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:18.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:18.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:18.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:18.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:18.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:18.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:18.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:18.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:18.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:18.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:18.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:19.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:19.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:19.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:19.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:19.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:19.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:19.002 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.002 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.002 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.002 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:19.002 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:19.003 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 80.859286166000004, 2020-11-12T17:27:19.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:19.003 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.003 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:19.003 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:19.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:19.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:19.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:19.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:19.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:19.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:19.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:19.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:19.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:19.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:19.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:19.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:19.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:19.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:19.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:19.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:19.010 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.010 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.010 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.010 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.010 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.010 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:19.011 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:19.012 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:18.896+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:19.013 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:19.010+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:19.114 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:19.110+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:19.133 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:19.133 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:19.133 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:19.133 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:19.144 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:19.216 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:19.214+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:19.262 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:19.263 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:19.278 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:19.323 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:19.318+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:19.419 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:19.416+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:19.423 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:19.423 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:19.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:19.426 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:19.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.426 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:19.427 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:19.427 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 245.00078128300001, 2020-11-12T17:27:19.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:19.427 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.428 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.428 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.428 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:19.429 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:19.429 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:19.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.429 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:19.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:19.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:19.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:19.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:19.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:19.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:19.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:19.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:19.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:19.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:19.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:19.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:19.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:19.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:19.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:19.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:19.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:19.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:19.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:19.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:19.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:19.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 244.99383722100001, 2020-11-12T17:27:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:19.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.465 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.465 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:19.465 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:19.465 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 208.819999435, 2020-11-12T17:27:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:27:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:27:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:27:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:27:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:27:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:34864 3.8 3:1b55d37a:::benchmark_data_smithi036_14212_object4357:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e49)", 2020-11-12T17:27:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:27:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 204.34846552600001, 2020-11-12T17:27:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997, 2020-11-12T17:27:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34864 2020-11-12T17:27:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.478 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:27:19.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070804+0000", 2020-11-12T17:27:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999352 2020-11-12T17:27:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070739+0000", 2020-11-12T17:27:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012362000000000001 2020-11-12T17:27:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070863+0000", 2020-11-12T17:27:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.331e-05 2020-11-12T17:27:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070876+0000", 2020-11-12T17:27:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6820000000000003e-06 2020-11-12T17:27:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.070884+0000", 2020-11-12T17:27:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088685659999999996 2020-11-12T17:27:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079752+0000", 2020-11-12T17:27:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103204 2020-11-12T17:27:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.079856+0000", 2020-11-12T17:27:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153571 2020-11-12T17:27:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.080009+0000", 2020-11-12T17:27:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0060913429999999999 2020-11-12T17:27:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.086101+0000", 2020-11-12T17:27:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32157758400000003 2020-11-12T17:27:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407678+0000", 2020-11-12T17:27:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3380000000000006e-05 2020-11-12T17:27:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407752+0000", 2020-11-12T17:27:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8573000000000003e-05 2020-11-12T17:27:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:55.407810+0000", 2020-11-12T17:27:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33700604899999997 2020-11-12T17:27:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:27:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 192.556294342, 2020-11-12T17:27:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:27:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:27:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:19.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:27:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:27:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:27:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:27:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:27:19.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:27:19.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:27:19.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:27:19.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:27:19.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:27:19.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:27:19.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:27:19.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:19.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:27:19.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:27:19.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:27:19.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:27:19.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:27:19.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:27:19.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:27:19.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:27:19.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:27:19.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:27:19.513 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.513 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.513 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.514 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57704 3.7 3:e81d491a:::benchmark_data_smithi036_14212_object7212:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:19.515 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:27:19.515 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 177.59984750000001, 2020-11-12T17:27:19.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003, 2020-11-12T17:27:19.516 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.516 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.516 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:19.517 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:19.517 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57704 2020-11-12T17:27:19.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.517 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:27:19.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819422+0000", 2020-11-12T17:27:19.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999561 2020-11-12T17:27:19.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819378+0000", 2020-11-12T17:27:19.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013618199999999999 2020-11-12T17:27:19.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819515+0000", 2020-11-12T17:27:19.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3877000000000001e-05 2020-11-12T17:27:19.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819548+0000", 2020-11-12T17:27:19.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7329999999999992e-06 2020-11-12T17:27:19.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.819557+0000", 2020-11-12T17:27:19.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003751519 2020-11-12T17:27:19.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823309+0000", 2020-11-12T17:27:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118619 2020-11-12T17:27:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823427+0000", 2020-11-12T17:27:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017978199999999999 2020-11-12T17:27:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.823607+0000", 2020-11-12T17:27:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036470890000000001 2020-11-12T17:27:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.827254+0000", 2020-11-12T17:27:19.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32178017799999997 2020-11-12T17:27:19.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149034+0000", 2020-11-12T17:27:19.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012986599999999999 2020-11-12T17:27:19.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149164+0000", 2020-11-12T17:27:19.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107624 2020-11-12T17:27:19.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.149272+0000", 2020-11-12T17:27:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32984974700000003 2020-11-12T17:27:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:27:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 177.47091401599999, 2020-11-12T17:27:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:27:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:19.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:27:19.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:27:19.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:27:19.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:27:19.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:27:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:27:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:27:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:27:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:27:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:27:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:27:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:27:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:27:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:27:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:27:19.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:27:19.546 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.546 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.546 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:27:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 175.77677574200001, 2020-11-12T17:27:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:27:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:27:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:27:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:27:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:27:19.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:27:19.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:27:19.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:27:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:27:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:27:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:27:19.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:27:19.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:27:19.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:27:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:27:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:27:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:27:19.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:27:19.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.557 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.558 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:27:19.558 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:19.558 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 118.10753702, 2020-11-12T17:27:19.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:27:19.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.558 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:27:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:19.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:19.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:19.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:27:19.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:27:19.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:27:19.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:27:19.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:27:19.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:27:19.568 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.568 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.568 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.568 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 118.09436026100001, 2020-11-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:19.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:27:19.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:27:19.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:27:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:27:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:27:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:27:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:27:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:27:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:27:19.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:27:19.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.575 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.576 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:27:19.576 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:19.576 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.540278812, 2020-11-12T17:27:19.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:27:19.576 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.576 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.576 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:27:19.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:27:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:27:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:27:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:27:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:27:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:27:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:27:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:27:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:27:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:27:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:27:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 113.531291506, 2020-11-12T17:27:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:27:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:19.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:19.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:19.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:27:19.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:27:19.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:27:19.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:27:19.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:27:19.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:27:19.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:27:19.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:27:19.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:27:19.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:27:19.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:27:19.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:27:19.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:27:19.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:27:19.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.593 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.594 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:27:19.594 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:19.594 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.513364192, 2020-11-12T17:27:19.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:27:19.595 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.595 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.595 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.595 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:19.595 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:19.595 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:27:19.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.596 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:19.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:19.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:19.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:27:19.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:27:19.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:27:19.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:27:19.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:27:19.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:27:19.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:27:19.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:27:19.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:27:19.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:27:19.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:27:19.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:27:19.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:19.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:27:19.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:27:19.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:27:19.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:27:19.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:27:19.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:27:19.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:27:19.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:27:19.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:27:19.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:27:19.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.604 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.605 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44136 4.4 4:2506405f:::benchmark_data_smithi036_18856_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:19.605 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:27:19.605 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.96232079399999, 2020-11-12T17:27:19.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997, 2020-11-12T17:27:19.605 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.605 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.606 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.606 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:19.606 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:19.606 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44136 2020-11-12T17:27:19.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.606 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:27:19.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456949+0000", 2020-11-12T17:27:19.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.456918+0000", 2020-11-12T17:27:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4563999999999999e-05 2020-11-12T17:27:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457003+0000", 2020-11-12T17:27:19.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3329999999999999e-05 2020-11-12T17:27:19.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457016+0000", 2020-11-12T17:27:19.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7219999999999999e-06 2020-11-12T17:27:19.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.457021+0000", 2020-11-12T17:27:19.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083135780000000003 2020-11-12T17:27:19.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465335+0000", 2020-11-12T17:27:19.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3723999999999999e-05 2020-11-12T17:27:19.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465428+0000", 2020-11-12T17:27:19.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017205700000000001 2020-11-12T17:27:19.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:19.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.465600+0000", 2020-11-12T17:27:19.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029916890000000001 2020-11-12T17:27:19.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.468592+0000", 2020-11-12T17:27:19.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31837306799999998 2020-11-12T17:27:19.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.786965+0000", 2020-11-12T17:27:19.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7212000000000005e-05 2020-11-12T17:27:19.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787052+0000", 2020-11-12T17:27:19.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011055799999999999 2020-11-12T17:27:19.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787163+0000", 2020-11-12T17:27:19.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33021406599999997 2020-11-12T17:27:19.615 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.615 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.615 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.615 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:19.616 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:19.616 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.71092529400001, 2020-11-12T17:27:19.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:27:19.616 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.616 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.616 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.616 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:19.617 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:19.617 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:27:19.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.617 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:19.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:19.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:19.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:27:19.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:27:19.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:27:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:27:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:27:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:27:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:27:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:27:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:27:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:27:19.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:27:19.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:27:19.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:27:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:27:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:27:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:27:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:27:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:27:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:27:19.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:27:19.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:27:19.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:27:19.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.626 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.626 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:19.626 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:19.627 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.63180297700001, 2020-11-12T17:27:19.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:27:19.627 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.627 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.627 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.627 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:19.627 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:19.627 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:27:19.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.628 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:19.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:19.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:19.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:27:19.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:27:19.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:27:19.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:27:19.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:27:19.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:27:19.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:27:19.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:27:19.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:27:19.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:27:19.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:27:19.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:27:19.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:19.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:27:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:27:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:27:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:27:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:27:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:27:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:27:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:27:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:27:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:27:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:27:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.849452009999993, 2020-11-12T17:27:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:27:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:27:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:27:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:27:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:27:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:27:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:27:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:27:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:27:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:27:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:27:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:27:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:27:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:27:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:27:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:27:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:27:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:27:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:27:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:27:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:27:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:27:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:27:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:27:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:27:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:27:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 62.386409661000002, 2020-11-12T17:27:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:27:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:27:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:27:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:27:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:27:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:27:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:27:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:27:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:27:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:27:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:27:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:27:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:27:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:27:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:27:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:27:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:27:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:27:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:27:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:27:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:27:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:27:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:27:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:27:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:27:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:27:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:27:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 62.365369127000001, 2020-11-12T17:27:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:27:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:27:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:27:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:27:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:27:19.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:27:19.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:27:19.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:27:19.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:27:19.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:27:19.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:27:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:27:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:27:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:27:19.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:27:19.666 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.666 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.666 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.666 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:19.666 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:19.667 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 17.364650510000001, 2020-11-12T17:27:19.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:27:19.667 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:19.667 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:19.667 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:19.667 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:19.667 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:19.668 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:27:19.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.668 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:19.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:19.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:19.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:19.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:19.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:19.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:19.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:19.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:27:19.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:27:19.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:19.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:27:19.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:27:19.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:19.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:27:19.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:27:19.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:27:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:27:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:27:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:27:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:19.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:27:19.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:27:19.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:19.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:27:19.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:27:19.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:19.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:27:19.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:27:19.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:19.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:27:19.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:27:19.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:19.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:27:19.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:27:19.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:19.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:19.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:19.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:27:19.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:27:19.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.676 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:19.677 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:19.677 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:19.677 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:27:19.679 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:19.679 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 33 16 31623 31607 7.48201 6.71875 0.0101754 0.0166719 2020-11-12T17:27:19.680 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:19.676+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:19.780 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:19.776+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:19.804 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:19.804 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:19.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.805 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:31851 5.a e146/127 5:5edbafca:::benchmark_data_smithi036_24110_object3981:head v 146'1923, mlcod=146'1919)", 2020-11-12T17:27:19.805 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.800159+0000", 2020-11-12T17:27:19.805 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0051850799999999999, 2020-11-12T17:27:19.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005213947, 2020-11-12T17:27:19.805 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:19.805 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:19.806 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:19.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:19.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.800159+0000", 2020-11-12T17:27:19.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:19.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:19.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.800159+0000", 2020-11-12T17:27:19.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:19.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:19.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.800143+0000", 2020-11-12T17:27:19.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3442000000000001e-05 2020-11-12T17:27:19.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:19.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.800197+0000", 2020-11-12T17:27:19.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2567999999999997e-05 2020-11-12T17:27:19.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:19.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.800229+0000", 2020-11-12T17:27:19.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7049999999999998e-06 2020-11-12T17:27:19.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.800234+0000", 2020-11-12T17:27:19.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0871000000000002e-05 2020-11-12T17:27:19.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:19.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.800275+0000", 2020-11-12T17:27:19.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6509000000000001e-05 2020-11-12T17:27:19.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:19.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.800291+0000", 2020-11-12T17:27:19.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013270099999999999 2020-11-12T17:27:19.830 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:19.830 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:19.831 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:19.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.831 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:31852 5.a e146/127 5:5edbafca:::benchmark_data_smithi036_24110_object3981:head v 146'1924, mlcod=146'1919)", 2020-11-12T17:27:19.831 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.801588+0000", 2020-11-12T17:27:19.831 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0037558579999999999, 2020-11-12T17:27:19.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038843179999999999, 2020-11-12T17:27:19.831 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:19.832 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:19.832 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:19.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:19.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.801588+0000", 2020-11-12T17:27:19.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:19.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:19.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.801588+0000", 2020-11-12T17:27:19.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:19.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:19.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.801573+0000", 2020-11-12T17:27:19.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2808e-05 2020-11-12T17:27:19.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:19.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.801625+0000", 2020-11-12T17:27:19.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2879999999999997e-05 2020-11-12T17:27:19.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:19.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.801658+0000", 2020-11-12T17:27:19.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6310000000000002e-06 2020-11-12T17:27:19.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.801663+0000", 2020-11-12T17:27:19.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9344999999999997e-05 2020-11-12T17:27:19.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:19.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.801702+0000", 2020-11-12T17:27:19.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6898e-05 2020-11-12T17:27:19.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:19.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.801719+0000", 2020-11-12T17:27:19.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013135999999999999 2020-11-12T17:27:19.838 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:19.838 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:19.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:19.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.839 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:31853 5.a e146/127 5:5edbafca:::benchmark_data_smithi036_24110_object3981:head v 146'1925, mlcod=146'1919)", 2020-11-12T17:27:19.839 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.803117+0000", 2020-11-12T17:27:19.839 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0022272149999999998, 2020-11-12T17:27:19.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024607280000000001, 2020-11-12T17:27:19.840 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:19.840 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:19.840 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:19.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:19.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.803117+0000", 2020-11-12T17:27:19.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:19.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:19.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.803117+0000", 2020-11-12T17:27:19.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:27:19.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:19.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.803089+0000", 2020-11-12T17:27:19.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0501000000000006e-05 2020-11-12T17:27:19.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:19.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.803179+0000", 2020-11-12T17:27:19.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6730000000000005e-05 2020-11-12T17:27:19.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:19.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.803266+0000", 2020-11-12T17:27:19.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2499999999999995e-06 2020-11-12T17:27:19.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.803275+0000", 2020-11-12T17:27:19.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9820000000000001e-05 2020-11-12T17:27:19.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:19.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.803325+0000", 2020-11-12T17:27:19.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3425999999999999e-05 2020-11-12T17:27:19.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:19.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.803349+0000", 2020-11-12T17:27:19.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023213300000000001 2020-11-12T17:27:19.846 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:19.846 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:19.846 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:19.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.847 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:31854 5.a e146/127 5:5edbafca:::benchmark_data_smithi036_24110_object3981:head v 146'1926, mlcod=146'1919)", 2020-11-12T17:27:19.847 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.804290+0000", 2020-11-12T17:27:19.847 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0010540790000000001, 2020-11-12T17:27:19.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001363555, 2020-11-12T17:27:19.847 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:19.847 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:19.847 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.804290+0000", 2020-11-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.804290+0000", 2020-11-12T17:27:19.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:27:19.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:19.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.804262+0000", 2020-11-12T17:27:19.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8102000000000004e-05 2020-11-12T17:27:19.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:19.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.804360+0000", 2020-11-12T17:27:19.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4220000000000005e-05 2020-11-12T17:27:19.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:19.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.804424+0000", 2020-11-12T17:27:19.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2710000000000003e-06 2020-11-12T17:27:19.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:19.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.804431+0000", 2020-11-12T17:27:19.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2714999999999999e-05 2020-11-12T17:27:19.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:19.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.804484+0000", 2020-11-12T17:27:19.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9324e-05 2020-11-12T17:27:19.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:19.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:19.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:19.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.804503+0000", 2020-11-12T17:27:19.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021355899999999999 2020-11-12T17:27:19.853 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:19.854 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:19.854 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:19.854 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:19.854 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:19.855 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 4 2020-11-12T17:27:19.855 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:19.856 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:19.904 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:19.902+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:19.975 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:19.975 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:19.975 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:19.976 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:19.976 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:19.982 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:19.978+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:19.987 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:20.083 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:20.078+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:20.158 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:20.158 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:20.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:20.159 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:20.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.159 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:27:20.159 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:20.160 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 249.469964186, 2020-11-12T17:27:20.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:27:20.160 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.160 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.160 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.160 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:20.161 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:20.161 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:27:20.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.161 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:20.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:20.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:20.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:27:20.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:27:20.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:27:20.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:27:20.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:27:20.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:27:20.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:27:20.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:27:20.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:27:20.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:27:20.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:27:20.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:27:20.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:20.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:27:20.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:27:20.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:20.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:27:20.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:27:20.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:20.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:27:20.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:27:20.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:27:20.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:27:20.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:27:20.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:27:20.173 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.173 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.173 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.174 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:27:20.174 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:20.174 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 249.46448411700001, 2020-11-12T17:27:20.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:27:20.174 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.174 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:20.174 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:20.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:20.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:20.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:27:20.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:27:20.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:27:20.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:27:20.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:27:20.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:27:20.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:27:20.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:27:20.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:27:20.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:27:20.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:27:20.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:27:20.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:27:20.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:27:20.181 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.181 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.181 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.182 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:27:20.182 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:20.182 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 241.27436251699999, 2020-11-12T17:27:20.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:27:20.182 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.182 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.183 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.183 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:20.183 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:20.183 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:27:20.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.183 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:20.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:20.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:27:20.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:27:20.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:27:20.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:27:20.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:27:20.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:27:20.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:27:20.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:27:20.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:27:20.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:27:20.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:27:20.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:27:20.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:27:20.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:20.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:27:20.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:27:20.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:20.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:27:20.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:27:20.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:20.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:27:20.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:27:20.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:27:20.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:27:20.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:27:20.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:27:20.194 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.194 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.194 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.195 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:27:20.195 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:20.195 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 241.26711880799999, 2020-11-12T17:27:20.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:27:20.196 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.196 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:20.196 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:20.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:27:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:27:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:27:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:27:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:27:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:27:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:27:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:27:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:27:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:27:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:27:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:27:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:27:20.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:27:20.204 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.204 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.204 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.204 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:20.205 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:20.205 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 165.27102943400001, 2020-11-12T17:27:20.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:27:20.206 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.206 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:20.207 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:27:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:27:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:27:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:27:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:27:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:27:20.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:27:20.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:27:20.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:27:20.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:27:20.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:27:20.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:27:20.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:27:20.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:27:20.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:27:20.215 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.215 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.215 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.215 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:27:20.216 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:20.216 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 99.143506922, 2020-11-12T17:27:20.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:27:20.216 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.216 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:20.216 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:20.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:20.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:20.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:27:20.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:27:20.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:27:20.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:27:20.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:27:20.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:27:20.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:27:20.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:27:20.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:27:20.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:27:20.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:27:20.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:27:20.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:27:20.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:27:20.225 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.225 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.225 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.226 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:20.226 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:20.226 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.094440261000003, 2020-11-12T17:27:20.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:27:20.226 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.226 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.227 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.227 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:20.227 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:20.228 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:27:20.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.228 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:20.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:20.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:27:20.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:27:20.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:27:20.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:27:20.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:27:20.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:27:20.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:27:20.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:27:20.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:27:20.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:27:20.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:27:20.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:27:20.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:27:20.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:20.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:27:20.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:27:20.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:20.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:27:20.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:27:20.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:20.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:27:20.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:27:20.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:27:20.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:27:20.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:27:20.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:27:20.239 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.239 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.239 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.239 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:20.240 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:20.240 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.092759481000002, 2020-11-12T17:27:20.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:27:20.240 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.240 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:20.241 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:20.241 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:27:20.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.241 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:20.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:20.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:20.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:27:20.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:27:20.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:27:20.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:27:20.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:27:20.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:27:20.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:27:20.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:27:20.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:27:20.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:27:20.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:27:20.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:27:20.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:20.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:27:20.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:27:20.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:20.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:27:20.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:27:20.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:20.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:27:20.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:27:20.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:27:20.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:27:20.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:27:20.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:27:20.252 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.252 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.254 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:20.254 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:20.254 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.092671285999998, 2020-11-12T17:27:20.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:27:20.255 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.255 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:20.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:20.255 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:27:20.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.256 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:20.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:20.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:20.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:27:20.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:27:20.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:27:20.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:27:20.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:27:20.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:27:20.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:27:20.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:27:20.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:27:20.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:27:20.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:27:20.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:27:20.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:20.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:27:20.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:27:20.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:20.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:27:20.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:27:20.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:20.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:27:20.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:27:20.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:27:20.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:27:20.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:27:20.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:27:20.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.267 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.268 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:20.268 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:20.269 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.074175971000003, 2020-11-12T17:27:20.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:27:20.269 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.269 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:20.269 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:20.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:20.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:20.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:27:20.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:27:20.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:27:20.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:27:20.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:27:20.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:27:20.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:27:20.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:27:20.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:27:20.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:27:20.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:27:20.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:27:20.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:27:20.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:27:20.275 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.275 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.276 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.276 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:20.276 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:20.276 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.074042981000005, 2020-11-12T17:27:20.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:27:20.277 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.277 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:20.277 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:20.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:20.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:20.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:27:20.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:27:20.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:27:20.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:27:20.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:27:20.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:27:20.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:27:20.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:27:20.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:27:20.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:27:20.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:27:20.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:27:20.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:27:20.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:27:20.284 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.284 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.284 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.284 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:20.285 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:20.285 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.073958253000001, 2020-11-12T17:27:20.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:27:20.285 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.285 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:20.285 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:20.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:20.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:20.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:27:20.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:27:20.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:27:20.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:27:20.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:27:20.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:27:20.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:27:20.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:27:20.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:27:20.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:27:20.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:27:20.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:27:20.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:27:20.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:27:20.292 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.292 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.292 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.292 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e98)", 2020-11-12T17:27:20.292 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:27:20.292 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.022188706999998, 2020-11-12T17:27:20.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387, 2020-11-12T17:27:20.293 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.293 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:27:20.293 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.293 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:20.293 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:20.293 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:27:20.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.294 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:27:20.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134488+0000", 2020-11-12T17:27:20.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:20.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134459+0000", 2020-11-12T17:27:20.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7610999999999999e-05 2020-11-12T17:27:20.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134537+0000", 2020-11-12T17:27:20.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0860000000000002e-06 2020-11-12T17:27:20.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134545+0000", 2020-11-12T17:27:20.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2069999999999997e-06 2020-11-12T17:27:20.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134549+0000", 2020-11-12T17:27:20.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4542999999999997e-05 2020-11-12T17:27:20.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134593+0000", 2020-11-12T17:27:20.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010097199999999999 2020-11-12T17:27:20.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:27:20.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.134694+0000", 2020-11-12T17:27:20.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36337014400000001 2020-11-12T17:27:20.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498065+0000", 2020-11-12T17:27:20.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363576387 2020-11-12T17:27:20.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.300 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.300 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:20.301 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:20.301 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.323135802000003, 2020-11-12T17:27:20.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:27:20.301 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.301 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.301 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.301 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:20.302 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:20.302 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:27:20.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.302 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:20.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:20.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:20.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:27:20.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:27:20.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:27:20.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:27:20.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:27:20.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:27:20.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:27:20.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:27:20.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:27:20.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:27:20.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:27:20.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:27:20.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:20.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:27:20.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:27:20.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:20.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:27:20.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:27:20.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:20.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:27:20.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:27:20.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:27:20.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:27:20.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:27:20.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:27:20.311 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.311 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.311 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.312 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:20.312 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:20.312 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.236480313999998, 2020-11-12T17:27:20.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:27:20.312 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.312 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.312 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.313 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:20.313 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:20.313 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:27:20.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.313 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:20.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:20.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:20.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:27:20.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:27:20.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:27:20.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:27:20.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:27:20.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:27:20.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:27:20.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:27:20.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:27:20.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:27:20.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:27:20.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:27:20.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:20.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:27:20.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:27:20.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:20.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:27:20.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:27:20.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:20.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:27:20.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:27:20.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:27:20.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:27:20.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:27:20.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:27:20.322 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.322 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.322 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.323 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:27:20.323 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:20.323 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.222999086999998, 2020-11-12T17:27:20.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:27:20.323 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.324 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:20.324 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:20.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:20.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:20.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:27:20.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:27:20.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:27:20.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:27:20.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:27:20.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:27:20.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:27:20.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:27:20.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:27:20.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:27:20.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:27:20.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:27:20.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:27:20.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:27:20.330 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.330 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.330 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.330 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:20.330 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:20.331 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 23.220710884999999, 2020-11-12T17:27:20.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:27:20.331 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.331 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.331 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.331 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:20.331 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:20.332 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:27:20.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.332 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:20.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:20.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:20.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:27:20.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:27:20.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:27:20.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:27:20.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:27:20.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:27:20.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:27:20.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:27:20.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:27:20.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:27:20.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:27:20.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:27:20.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:20.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:27:20.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:27:20.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:20.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:27:20.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:27:20.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:20.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:27:20.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:27:20.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:27:20.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:27:20.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:27:20.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:27:20.341 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.341 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.341 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.341 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:20.342 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:20.342 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 23.214894301000001, 2020-11-12T17:27:20.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:27:20.342 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.342 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.342 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.342 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:20.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:20.343 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:27:20.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.343 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:20.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:20.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:20.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:27:20.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:27:20.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:27:20.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:27:20.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:27:20.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:27:20.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:27:20.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:27:20.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:27:20.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:27:20.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:27:20.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:27:20.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:20.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:27:20.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:27:20.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:20.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:27:20.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:27:20.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:20.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:27:20.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:27:20.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:27:20.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:27:20.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:27:20.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:27:20.352 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.352 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.352 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.352 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:27:20.352 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:20.353 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 23.191960786999999, 2020-11-12T17:27:20.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:27:20.353 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.353 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.353 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:20.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:20.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:20.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:27:20.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:27:20.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:27:20.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:27:20.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:27:20.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:27:20.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:27:20.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:27:20.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:27:20.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:27:20.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:27:20.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:27:20.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:27:20.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:27:20.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:27:20.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:27:20.360 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.360 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.360 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.360 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:27:20.361 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:20.361 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.65948276, 2020-11-12T17:27:20.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:27:20.361 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.361 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:20.361 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:20.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:20.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:20.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:27:20.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:27:20.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:27:20.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:27:20.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:27:20.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:27:20.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:27:20.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:27:20.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:27:20.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:27:20.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:27:20.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:27:20.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:20.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:27:20.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:27:20.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:20.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:27:20.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:27:20.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.368 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.369 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.369 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.369 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.369 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:20.370 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:20.370 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:20.371 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-11-12T17:27:20.371 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:20.373 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:20.373 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:20.366+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:20.472 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:20.470+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:20.537 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:20.540 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:20.541 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:20.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.541 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:32563 5.7 5.ecc3feb7 (undecoded) ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:20.541 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:20.540643+0000", 2020-11-12T17:27:20.541 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00068398999999999999, 2020-11-12T17:27:20.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00073631300000000005, 2020-11-12T17:27:20.541 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.542 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:20.542 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.542 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:20.542 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:20.542 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 32563 2020-11-12T17:27:20.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.542 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.540643+0000", 2020-11-12T17:27:20.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.540643+0000", 2020-11-12T17:27:20.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:20.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.540606+0000", 2020-11-12T17:27:20.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:27:20.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.540718+0000", 2020-11-12T17:27:20.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6305e-05 2020-11-12T17:27:20.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.540744+0000", 2020-11-12T17:27:20.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2293000000000001e-05 2020-11-12T17:27:20.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.540757+0000", 2020-11-12T17:27:20.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011377700000000001 2020-11-12T17:27:20.550 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.550 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.550 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.551 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:32561 5.7 5:ed7fc337:::benchmark_data_smithi036_24110_object4070:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:20.551 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:20.538694+0000", 2020-11-12T17:27:20.551 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.002633294, 2020-11-12T17:27:20.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002864999, 2020-11-12T17:27:20.551 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.551 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:20.552 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.552 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:20.552 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:20.552 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 32561 2020-11-12T17:27:20.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.552 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.538694+0000", 2020-11-12T17:27:20.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.538694+0000", 2020-11-12T17:27:20.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999542 2020-11-12T17:27:20.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.538648+0000", 2020-11-12T17:27:20.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000130097 2020-11-12T17:27:20.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.538778+0000", 2020-11-12T17:27:20.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0948999999999999e-05 2020-11-12T17:27:20.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.538799+0000", 2020-11-12T17:27:20.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0463e-05 2020-11-12T17:27:20.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.538809+0000", 2020-11-12T17:27:20.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3237000000000005e-05 2020-11-12T17:27:20.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.538873+0000", 2020-11-12T17:27:20.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024425100000000002 2020-11-12T17:27:20.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539117+0000", 2020-11-12T17:27:20.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000201762 2020-11-12T17:27:20.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:20.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539319+0000", 2020-11-12T17:27:20.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00062520499999999999 2020-11-12T17:27:20.561 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.561 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.561 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.562 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:32562 5.7 5:ed7fc337:::benchmark_data_smithi036_24110_object4070:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:27:20.562 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:20.539113+0000", 2020-11-12T17:27:20.563 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0022137179999999999, 2020-11-12T17:27:20.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026041409999999999, 2020-11-12T17:27:20.563 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.563 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:20.563 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:20.563 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:20.564 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:20.564 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 32562 2020-11-12T17:27:20.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.564 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539113+0000", 2020-11-12T17:27:20.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539113+0000", 2020-11-12T17:27:20.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:27:20.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539074+0000", 2020-11-12T17:27:20.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000113241 2020-11-12T17:27:20.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539187+0000", 2020-11-12T17:27:20.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6994e-05 2020-11-12T17:27:20.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539204+0000", 2020-11-12T17:27:20.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.168e-05 2020-11-12T17:27:20.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539216+0000", 2020-11-12T17:27:20.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001541164 2020-11-12T17:27:20.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.540757+0000", 2020-11-12T17:27:20.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015506 2020-11-12T17:27:20.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.540912+0000", 2020-11-12T17:27:20.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029384300000000001 2020-11-12T17:27:20.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:20.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.541206+0000", 2020-11-12T17:27:20.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002092507 2020-11-12T17:27:20.571 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.571 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.571 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.571 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:32560 5.6 e146/127 5:68cb8d5d:::benchmark_data_smithi036_24110_object4069:head v 146'2048, mlcod=146'2044)", 2020-11-12T17:27:20.571 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:20.539305+0000", 2020-11-12T17:27:20.571 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0020217870000000001, 2020-11-12T17:27:20.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025228579999999998, 2020-11-12T17:27:20.572 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:20.572 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:20.572 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:20.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:20.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539305+0000", 2020-11-12T17:27:20.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:20.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:20.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539305+0000", 2020-11-12T17:27:20.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999647 2020-11-12T17:27:20.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:20.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539270+0000", 2020-11-12T17:27:20.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125461 2020-11-12T17:27:20.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:20.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539395+0000", 2020-11-12T17:27:20.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1365000000000005e-05 2020-11-12T17:27:20.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:20.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539467+0000", 2020-11-12T17:27:20.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2e-06 2020-11-12T17:27:20.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:20.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539476+0000", 2020-11-12T17:27:20.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0162999999999997e-05 2020-11-12T17:27:20.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:20.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539566+0000", 2020-11-12T17:27:20.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5226000000000003e-05 2020-11-12T17:27:20.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:20.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:20.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:20.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:20.539621+0000", 2020-11-12T17:27:20.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031633399999999998 2020-11-12T17:27:20.578 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.578 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:20.579 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.579 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:20.579 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:20.579 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 4 2020-11-12T17:27:20.579 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:20.582 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 34 16 32575 32559 7.48068 7.4375 0.0058453 0.0166794 2020-11-12T17:27:20.583 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:20.583 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:20.578+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:20.584 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:20.591 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:20.622 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:20.653 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:20.686 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:20.688 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:20.682+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:20.689 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:27:20.689 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:20.689 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 146, 2020-11-12T17:27:20.690 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:27:20.690 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2020-11-12T17:22:37.581394+0000", 2020-11-12T17:27:20.690 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2020-11-12T17:27:17.396540+0000", 2020-11-12T17:27:20.690 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2020-11-12T17:25:55.942493+0000", 2020-11-12T17:27:20.690 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2020-11-12T17:26:59.574280+0000", 2020-11-12T17:27:20.690 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-12T17:27:20.691 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5801984, 2020-11-12T17:27:20.691 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2020-11-12T17:27:20.691 INFO:teuthology.orchestra.run.smithi036.stdout: "noscrub", 2020-11-12T17:27:20.691 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2020-11-12T17:27:20.691 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2020-11-12T17:27:20.691 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2020-11-12T17:27:20.692 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2020-11-12T17:27:20.692 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:20.692 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 4, 2020-11-12T17:27:20.692 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2020-11-12T17:27:20.692 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-12T17:27:20.692 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-12T17:27:20.693 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2020-11-12T17:27:20.693 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 5, 2020-11-12T17:27:20.693 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2020-11-12T17:27:20.693 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2020-11-12T17:27:20.693 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2020-11-12T17:27:20.693 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2020-11-12T17:27:20.693 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2020-11-12T17:27:20.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.694 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2020-11-12T17:27:20.694 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2020-11-12T17:27:20.694 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:41.596657+0000", 2020-11-12T17:27:20.694 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:27:20.694 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:27:20.695 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:27:20.695 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:27:20.695 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:27:20.695 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:27:20.695 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:27:20.695 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:27:20.695 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2020-11-12T17:27:20.696 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2020-11-12T17:27:20.696 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2020-11-12T17:27:20.696 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2020-11-12T17:27:20.696 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2020-11-12T17:27:20.696 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:27:20.696 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:27:20.697 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:27:20.697 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:27:20.697 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:27:20.697 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:27:20.697 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:27:20.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.698 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "16", 2020-11-12T17:27:20.698 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:27:20.698 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:27:20.698 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:27:20.698 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:27:20.698 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:27:20.698 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:27:20.699 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:27:20.699 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:27:20.699 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:27:20.699 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:27:20.699 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:27:20.699 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:27:20.700 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:27:20.700 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:27:20.700 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:27:20.700 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:27:20.700 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:27:20.700 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:27:20.700 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:27:20.701 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:27:20.701 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:27:20.701 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:27:20.701 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:27:20.701 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:27:20.701 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:27:20.701 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:27:20.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.702 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:27:20.702 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:27:20.702 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:27:20.702 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:27:20.702 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:27:20.703 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:27:20.703 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:27:20.703 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:27:20.703 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:27:20.703 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:27:20.703 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:27:20.703 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2020-11-12T17:27:20.704 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2020-11-12T17:27:20.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.704 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:27:20.704 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2020-11-12T17:27:20.704 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.705 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2020-11-12T17:27:20.705 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2020-11-12T17:27:20.705 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:49.905816+0000", 2020-11-12T17:27:20.705 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:27:20.705 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:27:20.705 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:27:20.705 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:27:20.706 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:27:20.706 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:27:20.706 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:27:20.706 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:27:20.706 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2020-11-12T17:27:20.706 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2020-11-12T17:27:20.706 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2020-11-12T17:27:20.707 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2020-11-12T17:27:20.707 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2020-11-12T17:27:20.707 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:27:20.707 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:27:20.707 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:27:20.707 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:27:20.707 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:27:20.708 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:27:20.708 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:27:20.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.709 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "19", 2020-11-12T17:27:20.709 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:27:20.709 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:27:20.709 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:27:20.709 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:27:20.710 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:27:20.710 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:27:20.710 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:27:20.710 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:27:20.710 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:27:20.710 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:27:20.710 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:27:20.711 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:27:20.711 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:27:20.711 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:27:20.711 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:27:20.711 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:27:20.711 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:27:20.711 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:27:20.712 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:27:20.712 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:27:20.712 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:27:20.712 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:27:20.712 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:27:20.712 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:27:20.712 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:27:20.713 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:27:20.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.713 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:27:20.713 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:27:20.713 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:27:20.713 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:27:20.713 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:27:20.714 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:27:20.714 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:27:20.714 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:27:20.714 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:27:20.714 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:27:20.715 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:27:20.715 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:27:20.716 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:27:20.716 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2020-11-12T17:27:20.716 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.716 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 5, 2020-11-12T17:27:20.717 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "unique_pool_2", 2020-11-12T17:27:20.717 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:26:43.854598+0000", 2020-11-12T17:27:20.717 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:27:20.718 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:27:20.718 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:27:20.718 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:27:20.718 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:27:20.718 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:27:20.718 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:27:20.718 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:27:20.719 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 16, 2020-11-12T17:27:20.719 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 16, 2020-11-12T17:27:20.719 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 16, 2020-11-12T17:27:20.719 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 16, 2020-11-12T17:27:20.719 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 16, 2020-11-12T17:27:20.719 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:27:20.719 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:27:20.720 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:27:20.720 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:27:20.720 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:27:20.720 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:27:20.720 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:27:20.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.720 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "129", 2020-11-12T17:27:20.721 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:27:20.721 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:27:20.721 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:27:20.721 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:27:20.721 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:27:20.721 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:27:20.721 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:27:20.722 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:27:20.722 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:27:20.722 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:27:20.722 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:27:20.722 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:27:20.722 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:27:20.722 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:27:20.723 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:27:20.723 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:27:20.723 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:27:20.723 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:27:20.723 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:27:20.723 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:27:20.723 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:27:20.724 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:27:20.724 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:27:20.724 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:27:20.724 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:27:20.724 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:27:20.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.724 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:27:20.724 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:27:20.725 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:27:20.725 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:27:20.725 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:27:20.725 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:27:20.725 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:27:20.725 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:27:20.725 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:27:20.726 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:27:20.726 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:27:20.726 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:27:20.726 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:27:20.726 INFO:teuthology.orchestra.run.smithi036.stdout: "rados": {} 2020-11-12T17:27:20.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.727 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.727 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:20.727 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2020-11-12T17:27:20.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.728 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:27:20.728 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "bd1d5457-5d54-4074-b378-9da417f42976", 2020-11-12T17:27:20.728 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:20.728 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 0, 2020-11-12T17:27:20.728 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 0, 2020-11-12T17:27:20.728 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:20.729 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:20.729 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:20.729 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:20.729 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:27:20.729 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:20.729 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:20.729 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:20.730 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.730 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.730 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6801", 2020-11-12T17:27:20.730 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:27:20.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.730 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.731 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:20.731 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.731 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.731 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2020-11-12T17:27:20.731 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:27:20.732 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.732 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.732 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:20.732 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.732 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.733 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2020-11-12T17:27:20.733 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:27:20.733 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.733 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.733 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:20.733 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.734 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.734 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2020-11-12T17:27:20.734 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:27:20.734 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.734 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.734 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6801/12304", 2020-11-12T17:27:20.735 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6802/12304", 2020-11-12T17:27:20.735 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6806/12304", 2020-11-12T17:27:20.735 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6804/12304", 2020-11-12T17:27:20.735 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:20.735 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:20.735 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:20.735 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.736 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:27:20.736 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "37152eee-a8d8-40f1-8e27-2899e7b94c98", 2020-11-12T17:27:20.736 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:20.736 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:20.736 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:20.737 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:20.737 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:27:20.737 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 57, 2020-11-12T17:27:20.737 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 88, 2020-11-12T17:27:20.737 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 139, 2020-11-12T17:27:20.737 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 58, 2020-11-12T17:27:20.738 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:20.738 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:20.738 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.739 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.739 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2020-11-12T17:27:20.739 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:27:20.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.739 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.739 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:20.740 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.740 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.740 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2020-11-12T17:27:20.740 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:27:20.740 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.740 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.741 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:20.741 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.741 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.741 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2020-11-12T17:27:20.741 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:27:20.742 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.742 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.742 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:20.742 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.742 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.743 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2020-11-12T17:27:20.743 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:27:20.743 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.743 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.743 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/20274", 2020-11-12T17:27:20.743 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6814/20274", 2020-11-12T17:27:20.744 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6816/20274", 2020-11-12T17:27:20.744 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6815/20274", 2020-11-12T17:27:20.744 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:20.744 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:20.744 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:20.744 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.745 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:27:20.745 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "d8ec2abb-38bf-4863-969a-482c4fa44f41", 2020-11-12T17:27:20.745 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:20.745 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:20.745 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:20.745 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:20.745 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:27:20.746 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 93, 2020-11-12T17:27:20.746 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 102, 2020-11-12T17:27:20.746 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:27:20.746 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 94, 2020-11-12T17:27:20.746 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:20.746 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:20.746 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.747 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.747 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2020-11-12T17:27:20.747 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:27:20.747 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.747 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.748 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:20.748 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.749 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.749 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2020-11-12T17:27:20.749 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:27:20.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.749 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.749 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:20.750 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.750 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.750 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2020-11-12T17:27:20.750 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:27:20.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.750 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.751 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:20.751 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.751 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.751 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2020-11-12T17:27:20.751 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:27:20.752 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.752 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.752 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/21493", 2020-11-12T17:27:20.752 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/21493", 2020-11-12T17:27:20.752 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6808/21493", 2020-11-12T17:27:20.752 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/21493", 2020-11-12T17:27:20.753 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:20.753 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:20.753 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:20.753 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.753 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:27:20.754 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "799d3499-577c-4510-a00c-9b2e126fc449", 2020-11-12T17:27:20.754 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:20.754 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:20.754 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:20.754 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:20.754 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:20.754 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:20.755 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:20.755 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:27:20.755 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:20.755 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:20.755 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:20.755 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.755 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.756 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2020-11-12T17:27:20.756 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:27:20.756 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.756 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.756 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:20.756 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.757 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.757 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2020-11-12T17:27:20.757 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:27:20.757 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.757 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.758 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:20.758 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.758 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.758 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2020-11-12T17:27:20.759 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:27:20.759 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.759 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.760 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:20.760 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.760 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.760 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2020-11-12T17:27:20.760 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:27:20.760 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.761 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.761 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6809/12305", 2020-11-12T17:27:20.761 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6810/12305", 2020-11-12T17:27:20.761 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6813/12305", 2020-11-12T17:27:20.761 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6811/12305", 2020-11-12T17:27:20.761 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:20.762 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:20.762 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:20.762 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.762 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:27:20.762 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "c36e3100-aadc-4117-b495-24fb08a34148", 2020-11-12T17:27:20.763 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:20.763 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:20.763 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:20.763 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:20.763 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:20.763 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:20.763 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:20.763 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 138, 2020-11-12T17:27:20.764 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:20.764 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:20.764 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:20.764 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.764 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.765 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6804", 2020-11-12T17:27:20.765 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:27:20.765 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.765 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.765 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:20.765 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.766 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.766 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6805", 2020-11-12T17:27:20.766 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:27:20.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.766 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.767 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:20.767 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.767 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.767 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6807", 2020-11-12T17:27:20.767 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:27:20.767 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.768 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.768 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:20.768 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.768 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.768 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6806", 2020-11-12T17:27:20.769 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:27:20.769 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.769 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.769 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6804/12499", 2020-11-12T17:27:20.769 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6805/12499", 2020-11-12T17:27:20.769 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6807/12499", 2020-11-12T17:27:20.770 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6806/12499", 2020-11-12T17:27:20.770 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:20.770 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:20.770 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:20.770 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.771 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:27:20.771 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "b152141f-b530-448e-8dff-fe200559eff0", 2020-11-12T17:27:20.771 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:20.771 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:20.771 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:20.771 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:20.771 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:20.772 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:20.772 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:20.772 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:27:20.772 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:20.772 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:20.772 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:20.772 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.773 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.773 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6808", 2020-11-12T17:27:20.773 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:27:20.773 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.773 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.774 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:20.774 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.774 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.774 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6810", 2020-11-12T17:27:20.774 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:27:20.774 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.775 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.775 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:20.775 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.775 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.775 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6814", 2020-11-12T17:27:20.776 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:27:20.776 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.776 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.776 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:20.776 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.777 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.777 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6812", 2020-11-12T17:27:20.777 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:27:20.777 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.777 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.777 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6808/12525", 2020-11-12T17:27:20.777 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6810/12525", 2020-11-12T17:27:20.778 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6814/12525", 2020-11-12T17:27:20.778 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6812/12525", 2020-11-12T17:27:20.778 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:20.778 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:20.778 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:20.778 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.779 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:27:20.779 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "62a140ba-7f94-4bb6-8a62-fda077f81354", 2020-11-12T17:27:20.779 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:20.779 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:20.779 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:20.779 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:20.780 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:20.780 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:20.780 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:20.780 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 127, 2020-11-12T17:27:20.780 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:20.780 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:20.780 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:20.781 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.781 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.781 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6809", 2020-11-12T17:27:20.781 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:27:20.781 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.781 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.782 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:20.782 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.782 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.782 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6811", 2020-11-12T17:27:20.782 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:27:20.782 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.783 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6815", 2020-11-12T17:27:20.784 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:27:20.784 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.784 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.784 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:20.784 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.785 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.785 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6813", 2020-11-12T17:27:20.785 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:27:20.785 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.785 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.785 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6809/12524", 2020-11-12T17:27:20.786 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6811/12524", 2020-11-12T17:27:20.786 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6815/12524", 2020-11-12T17:27:20.786 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6813/12524", 2020-11-12T17:27:20.786 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:20.786 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:20.786 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:20.786 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.787 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:27:20.787 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "32879bd7-780c-4da6-9838-5850b6277902", 2020-11-12T17:27:20.787 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:20.787 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:20.787 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:20.788 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:20.788 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:20.788 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:20.788 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:20.788 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:27:20.788 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:20.788 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:20.789 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:20.789 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.789 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.789 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6800", 2020-11-12T17:27:20.789 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:27:20.789 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.790 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.790 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:20.790 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.790 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.790 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6801", 2020-11-12T17:27:20.791 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:27:20.791 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.791 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.791 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:20.791 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.792 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.792 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6803", 2020-11-12T17:27:20.792 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:27:20.792 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.792 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.792 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:20.792 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:20.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.793 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:20.793 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6802", 2020-11-12T17:27:20.793 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:27:20.794 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.794 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.794 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6800/12522", 2020-11-12T17:27:20.794 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6801/12522", 2020-11-12T17:27:20.794 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6803/12522", 2020-11-12T17:27:20.794 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6802/12522", 2020-11-12T17:27:20.795 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:20.795 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:20.795 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:20.795 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:20.795 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.795 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:20.795 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2020-11-12T17:27:20.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.796 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:27:20.796 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:20.796 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:20.796 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:20.796 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:20.796 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 65536, 2020-11-12T17:27:20.796 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:44.321824+0000", 2020-11-12T17:27:20.797 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:20.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.797 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:27:20.797 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:20.797 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:20.797 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:20.798 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:20.798 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:20.798 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:32.526486+0000", 2020-11-12T17:27:20.798 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 58 2020-11-12T17:27:20.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.798 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:27:20.799 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:20.799 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:20.799 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:20.799 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:20.799 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:20.799 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:56.979234+0000", 2020-11-12T17:27:20.799 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 94 2020-11-12T17:27:20.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.800 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:27:20.800 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:20.800 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:20.800 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:20.800 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:20.800 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:20.801 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:46.505759+0000", 2020-11-12T17:27:20.801 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:20.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.801 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:27:20.801 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:20.801 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:20.802 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:20.802 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:20.802 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:20.802 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:45.395865+0000", 2020-11-12T17:27:20.802 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:20.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.803 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:27:20.803 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:20.803 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:20.803 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:20.803 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:20.803 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:20.803 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:47.060879+0000", 2020-11-12T17:27:20.804 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:20.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.804 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:27:20.804 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:20.804 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:20.804 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:20.805 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:20.805 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:20.805 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:44.435814+0000", 2020-11-12T17:27:20.805 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:20.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:20.805 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:27:20.806 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:20.806 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:20.806 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:20.806 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:20.806 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:20.806 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:45.631568+0000", 2020-11-12T17:27:20.806 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:20.807 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.807 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:20.807 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2020-11-12T17:27:20.807 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2020-11-12T17:27:20.807 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2020-11-12T17:27:20.807 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2020-11-12T17:27:20.807 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2020-11-12T17:27:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2020-11-12T17:27:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2020-11-12T17:27:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2020-11-12T17:27:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2020-11-12T17:27:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2020-11-12T17:27:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2020-11-12T17:27:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2020-11-12T17:27:20.808 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2020-11-12T17:27:20.809 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:20.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:20.809 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2020-11-12T17:27:20.809 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2020-11-12T17:27:20.809 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2020-11-12T17:27:20.809 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2020-11-12T17:27:20.809 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2020-11-12T17:27:20.810 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:20.812 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:20.734+0000 7f7b4b297700 -1 osd.4 146 handle_osd_map injecting map crc failure 2020-11-12T17:27:20.812 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:20.738+0000 7f9a06aa2700 -1 osd.5 146 handle_osd_map injecting map crc failure 2020-11-12T17:27:20.813 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:20.813 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:20.813 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:20.814 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:20.810+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:20.815 INFO:tasks.thrashosds.thrasher:j is {'epoch': 146, 'fsid': '8c8a6bcc-49d4-47d1-904f-e20798ef8e1f', 'created': '2020-11-12T17:22:37.581394+0000', 'modified': '2020-11-12T17:27:17.396540+0000', 'last_up_change': '2020-11-12T17:25:55.942493+0000', 'last_in_change': '2020-11-12T17:26:59.574280+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'unique_pool_2', 'create_time': '2020-11-12T17:26:43.854598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'bd1d5457-5d54-4074-b378-9da417f42976', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6801', 'nonce': 12304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6802', 'nonce': 12304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6806', 'nonce': 12304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6804', 'nonce': 12304}]}, 'public_addr': '172.21.15.36:6801/12304', 'cluster_addr': '172.21.15.36:6802/12304', 'heartbeat_back_addr': '172.21.15.36:6806/12304', 'heartbeat_front_addr': '172.21.15.36:6804/12304', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '37152eee-a8d8-40f1-8e27-2899e7b94c98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 57, 'up_from': 88, 'up_thru': 139, 'down_at': 58, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6812', 'nonce': 20274}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6814', 'nonce': 20274}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6816', 'nonce': 20274}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6815', 'nonce': 20274}]}, 'public_addr': '172.21.15.36:6812/20274', 'cluster_addr': '172.21.15.36:6814/20274', 'heartbeat_back_addr': '172.21.15.36:6816/20274', 'heartbeat_front_addr': '172.21.15.36:6815/20274', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd8ec2abb-38bf-4863-969a-482c4fa44f41', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 93, 'up_from': 102, 'up_thru': 135, 'down_at': 94, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6803', 'nonce': 21493}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6805', 'nonce': 21493}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6808', 'nonce': 21493}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6807', 'nonce': 21493}]}, 'public_addr': '172.21.15.36:6803/21493', 'cluster_addr': '172.21.15.36:6805/21493', 'heartbeat_back_addr': '172.21.15.36:6808/21493', 'heartbeat_front_addr': '172.21.15.36:6807/21493', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '799d3499-577c-4510-a00c-9b2e126fc449', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6809', 'nonce': 12305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6810', 'nonce': 12305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6813', 'nonce': 12305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6811', 'nonce': 12305}]}, 'public_addr': '172.21.15.36:6809/12305', 'cluster_addr': '172.21.15.36:6810/12305', 'heartbeat_back_addr': '172.21.15.36:6813/12305', 'heartbeat_front_addr': '172.21.15.36:6811/12305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c36e3100-aadc-4117-b495-24fb08a34148', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 138, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6804', 'nonce': 12499}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6805', 'nonce': 12499}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6807', 'nonce': 12499}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6806', 'nonce': 12499}]}, 'public_addr': '172.21.15.205:6804/12499', 'cluster_addr': '172.21.15.205:6805/12499', 'heartbeat_back_addr': '172.21.15.205:6807/12499', 'heartbeat_front_addr': '172.21.15.205:6806/12499', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b152141f-b530-448e-8dff-fe200559eff0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6808', 'nonce': 12525}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6810', 'nonce': 12525}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6814', 'nonce': 12525}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6812', 'nonce': 12525}]}, 'public_addr': '172.21.15.205:6808/12525', 'cluster_addr': '172.21.15.205:6810/12525', 'heartbeat_back_addr': '172.21.15.205:6814/12525', 'heartbeat_front_addr': '172.21.15.205:6812/12525', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '62a140ba-7f94-4bb6-8a62-fda077f81354', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 127, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6809', 'nonce': 12524}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6811', 'nonce': 12524}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6815', 'nonce': 12524}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6813', 'nonce': 12524}]}, 'public_addr': '172.21.15.205:6809/12524', 'cluster_addr': '172.21.15.205:6811/12524', 'heartbeat_back_addr': '172.21.15.205:6815/12524', 'heartbeat_front_addr': '172.21.15.205:6813/12524', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '32879bd7-780c-4da6-9838-5850b6277902', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6800', 'nonce': 12522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6801', 'nonce': 12522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6803', 'nonce': 12522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6802', 'nonce': 12522}]}, 'public_addr': '172.21.15.205:6800/12522', 'cluster_addr': '172.21.15.205:6801/12522', 'heartbeat_back_addr': '172.21.15.205:6803/12522', 'heartbeat_front_addr': '172.21.15.205:6802/12522', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-12T17:26:44.321824+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:32.526486+0000', 'dead_epoch': 58}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:56.979234+0000', 'dead_epoch': 94}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:46.505759+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:45.395865+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:47.060879+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:44.435814+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:45.631568+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-11-12T17:27:20.815 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:27:20.816 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:20.816 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:20.816 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:27:20.817 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:20.817 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:20.817 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:20.817 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:20.817 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:20.817 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:20.818 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:20.818 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:20.912 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:20.908+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:20.983 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:20.983 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:20.993 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:21.013 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:21.008+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:21.113 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:21.108+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:21.125 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:21.126 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:21.136 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:27:21.138 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:21.139 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:27:21.150 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2020-11-12T17:27:20.728317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":248872960,"num_objects":3800,"num_object_clones":0,"num_object_copies":7600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3800,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30382,"num_write_kb":243042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":34627584,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30382,"ondisk_log_size":30382,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7564664,"kb_used_data":224576,"kb_used_omap":118,"kb_used_meta":7339913,"kb_avail":653038216,"statfs":{"total":676457349120,"available":668711133184,"internally_reserved":7516192768,"allocated":229965824,"data_stored":479877815,"data_compressed":3000595,"data_compressed_allocated":223498240,"data_compressed_original":477290496,"omap_allocated":121799,"internal_metadata":7516070969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,7,1,1,6,2,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":59015168,"num_objects":901,"num_object_clones":0,"num_object_copies":1802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7204,"num_write_kb":57632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.130760"},"pg_stats":[{"pgid":"5.f","version":"145'1800","reported_seq":"1825","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:16.342674+0000","last_change":"2020-11-12T17:26:45.503348+0000","last_active":"2020-11-12T17:27:16.342674+0000","last_peered":"2020-11-12T17:27:16.342674+0000","last_clean":"2020-11-12T17:27:16.342674+0000","last_became_active":"2020-11-12T17:26:45.502940+0000","last_became_peered":"2020-11-12T17:26:45.502940+0000","last_unstale":"2020-11-12T17:27:16.342674+0000","last_undegraded":"2020-11-12T17:27:16.342674+0000","last_fullsized":"2020-11-12T17:27:16.342674+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1800,"ondisk_log_size":1800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1800,"num_write_kb":14400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"145'1872","reported_seq":"1897","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:15.889767+0000","last_change":"2020-11-12T17:26:45.491058+0000","last_active":"2020-11-12T17:27:15.889767+0000","last_peered":"2020-11-12T17:27:15.889767+0000","last_clean":"2020-11-12T17:27:15.889767+0000","last_became_active":"2020-11-12T17:26:45.490308+0000","last_became_peered":"2020-11-12T17:26:45.490308+0000","last_unstale":"2020-11-12T17:27:15.889767+0000","last_undegraded":"2020-11-12T17:27:15.889767+0000","last_fullsized":"2020-11-12T17:27:15.889767+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1872,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15335424,"num_objects":234,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":234,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1872,"num_write_kb":14976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"146'2104","reported_seq":"2130","reported_epoch":"146","state":"active+clean","last_fresh":"2020-11-12T17:27:20.068122+0000","last_change":"2020-11-12T17:26:45.490550+0000","last_active":"2020-11-12T17:27:20.068122+0000","last_peered":"2020-11-12T17:27:20.068122+0000","last_clean":"2020-11-12T17:27:20.068122+0000","last_became_active":"2020-11-12T17:26:45.490025+0000","last_became_peered":"2020-11-12T17:26:45.490025+0000","last_unstale":"2020-11-12T17:27:20.068122+0000","last_undegraded":"2020-11-12T17:27:20.068122+0000","last_fullsized":"2020-11-12T17:27:20.068122+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2104,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2104,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"145'1840","reported_seq":"2103","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:16.317351+0000","last_change":"2020-11-12T17:27:04.424601+0000","last_active":"2020-11-12T17:27:16.317351+0000","last_peered":"2020-11-12T17:27:16.317351+0000","last_clean":"2020-11-12T17:27:16.317351+0000","last_became_active":"2020-11-12T17:27:04.422158+0000","last_became_peered":"2020-11-12T17:27:04.422158+0000","last_unstale":"2020-11-12T17:27:16.317351+0000","last_undegraded":"2020-11-12T17:27:16.317351+0000","last_fullsized":"2020-11-12T17:27:16.317351+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1840,"ondisk_log_size":1840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":230,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1840,"num_write_kb":14720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":7471104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"146'2184","reported_seq":"2210","reported_epoch":"146","state":"active+clean","last_fresh":"2020-11-12T17:27:19.700056+0000","last_change":"2020-11-12T17:26:45.484541+0000","last_active":"2020-11-12T17:27:19.700056+0000","last_peered":"2020-11-12T17:27:19.700056+0000","last_clean":"2020-11-12T17:27:19.700056+0000","last_became_active":"2020-11-12T17:26:45.484017+0000","last_became_peered":"2020-11-12T17:26:45.484017+0000","last_unstale":"2020-11-12T17:27:19.700056+0000","last_undegraded":"2020-11-12T17:27:19.700056+0000","last_fullsized":"2020-11-12T17:27:19.700056+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2184,"ondisk_log_size":2184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":273,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2184,"num_write_kb":17472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"146'1936","reported_seq":"1962","reported_epoch":"146","state":"active+clean","last_fresh":"2020-11-12T17:27:19.866191+0000","last_change":"2020-11-12T17:26:45.490968+0000","last_active":"2020-11-12T17:27:19.866191+0000","last_peered":"2020-11-12T17:27:19.866191+0000","last_clean":"2020-11-12T17:27:19.866191+0000","last_became_active":"2020-11-12T17:26:45.490602+0000","last_became_peered":"2020-11-12T17:26:45.490602+0000","last_unstale":"2020-11-12T17:27:19.866191+0000","last_undegraded":"2020-11-12T17:27:19.866191+0000","last_fullsized":"2020-11-12T17:27:19.866191+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1936,"ondisk_log_size":1936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":242,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1936,"num_write_kb":15488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"145'1832","reported_seq":"1857","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:16.542601+0000","last_change":"2020-11-12T17:26:45.490076+0000","last_active":"2020-11-12T17:27:16.542601+0000","last_peered":"2020-11-12T17:27:16.542601+0000","last_clean":"2020-11-12T17:27:16.542601+0000","last_became_active":"2020-11-12T17:26:45.489832+0000","last_became_peered":"2020-11-12T17:26:45.489832+0000","last_unstale":"2020-11-12T17:27:16.542601+0000","last_undegraded":"2020-11-12T17:27:16.542601+0000","last_fullsized":"2020-11-12T17:27:16.542601+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1832,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15007744,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1832,"num_write_kb":14656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"146'2015","reported_seq":"2255","reported_epoch":"146","state":"active+clean","last_fresh":"2020-11-12T17:27:20.096800+0000","last_change":"2020-11-12T17:27:01.083305+0000","last_active":"2020-11-12T17:27:20.096800+0000","last_peered":"2020-11-12T17:27:20.096800+0000","last_clean":"2020-11-12T17:27:20.096800+0000","last_became_active":"2020-11-12T17:27:00.642804+0000","last_became_peered":"2020-11-12T17:27:00.642804+0000","last_unstale":"2020-11-12T17:27:20.096800+0000","last_undegraded":"2020-11-12T17:27:20.096800+0000","last_fullsized":"2020-11-12T17:27:20.096800+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2015,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16506880,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2015,"num_write_kb":16120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":6840320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"146'2133","reported_seq":"2154","reported_epoch":"146","state":"active+clean","last_fresh":"2020-11-12T17:27:20.655612+0000","last_change":"2020-11-12T17:26:45.485794+0000","last_active":"2020-11-12T17:27:20.655612+0000","last_peered":"2020-11-12T17:27:20.655612+0000","last_clean":"2020-11-12T17:27:20.655612+0000","last_became_active":"2020-11-12T17:26:45.485374+0000","last_became_peered":"2020-11-12T17:26:45.485374+0000","last_unstale":"2020-11-12T17:27:20.655612+0000","last_undegraded":"2020-11-12T17:27:20.655612+0000","last_fullsized":"2020-11-12T17:27:20.655612+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2133,"ondisk_log_size":2133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17473536,"num_objects":267,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2133,"num_write_kb":17064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"21","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:15.924189+0000","last_change":"2020-11-12T17:27:15.924323+0000","last_active":"2020-11-12T17:27:15.924189+0000","last_peered":"2020-11-12T17:27:15.924189+0000","last_clean":"2020-11-12T17:27:15.924189+0000","last_became_active":"2020-11-12T17:27:00.607146+0000","last_became_peered":"2020-11-12T17:27:00.607146+0000","last_unstale":"2020-11-12T17:27:15.924189+0000","last_undegraded":"2020-11-12T17:27:15.924189+0000","last_fullsized":"2020-11-12T17:27:15.924189+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_clean_scrub_stamp":"2020-11-12T17:27:15.924179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"145'1704","reported_seq":"1956","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:16.202320+0000","last_change":"2020-11-12T17:27:04.421599+0000","last_active":"2020-11-12T17:27:16.202320+0000","last_peered":"2020-11-12T17:27:16.202320+0000","last_clean":"2020-11-12T17:27:16.202320+0000","last_became_active":"2020-11-12T17:27:04.420130+0000","last_became_peered":"2020-11-12T17:27:04.420130+0000","last_unstale":"2020-11-12T17:27:16.202320+0000","last_undegraded":"2020-11-12T17:27:16.202320+0000","last_fullsized":"2020-11-12T17:27:16.202320+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1704,"ondisk_log_size":1704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13959168,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1704,"num_write_kb":13632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":7077888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"177","reported_epoch":"144","state":"active+clean","last_fresh":"2020-11-12T17:27:11.681545+0000","last_change":"2020-11-12T17:27:05.616615+0000","last_active":"2020-11-12T17:27:11.681545+0000","last_peered":"2020-11-12T17:27:11.681545+0000","last_clean":"2020-11-12T17:27:11.681545+0000","last_became_active":"2020-11-12T17:27:00.609586+0000","last_became_peered":"2020-11-12T17:27:00.609586+0000","last_unstale":"2020-11-12T17:27:11.681545+0000","last_undegraded":"2020-11-12T17:27:11.681545+0000","last_fullsized":"2020-11-12T17:27:11.681545+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:05.616420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:05.616420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"146'2008","reported_seq":"2034","reported_epoch":"146","state":"active+clean","last_fresh":"2020-11-12T17:27:20.089276+0000","last_change":"2020-11-12T17:26:45.480866+0000","last_active":"2020-11-12T17:27:20.089276+0000","last_peered":"2020-11-12T17:27:20.089276+0000","last_clean":"2020-11-12T17:27:20.089276+0000","last_became_active":"2020-11-12T17:26:45.480445+0000","last_became_peered":"2020-11-12T17:26:45.480445+0000","last_unstale":"2020-11-12T17:27:20.089276+0000","last_undegraded":"2020-11-12T17:27:20.089276+0000","last_fullsized":"2020-11-12T17:27:20.089276+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2008,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2008,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"40","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:14.714172+0000","last_change":"2020-11-12T17:26:48.417978+0000","last_active":"2020-11-12T17:27:14.714172+0000","last_peered":"2020-11-12T17:27:14.714172+0000","last_clean":"2020-11-12T17:27:14.714172+0000","last_became_active":"2020-11-12T17:26:29.669260+0000","last_became_peered":"2020-11-12T17:26:29.669260+0000","last_unstale":"2020-11-12T17:27:14.714172+0000","last_undegraded":"2020-11-12T17:27:14.714172+0000","last_fullsized":"2020-11-12T17:27:14.714172+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"145'1624","reported_seq":"1649","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:16.149047+0000","last_change":"2020-11-12T17:26:45.489798+0000","last_active":"2020-11-12T17:27:16.149047+0000","last_peered":"2020-11-12T17:27:16.149047+0000","last_clean":"2020-11-12T17:27:16.149047+0000","last_became_active":"2020-11-12T17:26:45.489407+0000","last_became_peered":"2020-11-12T17:26:45.489407+0000","last_unstale":"2020-11-12T17:27:16.149047+0000","last_undegraded":"2020-11-12T17:27:16.149047+0000","last_fullsized":"2020-11-12T17:27:16.149047+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1624,"ondisk_log_size":1624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1624,"num_write_kb":12992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"157","reported_epoch":"144","state":"active+clean","last_fresh":"2020-11-12T17:27:11.681705+0000","last_change":"2020-11-12T17:26:29.681207+0000","last_active":"2020-11-12T17:27:11.681705+0000","last_peered":"2020-11-12T17:27:11.681705+0000","last_clean":"2020-11-12T17:27:11.681705+0000","last_became_active":"2020-11-12T17:26:29.680644+0000","last_became_peered":"2020-11-12T17:26:29.680644+0000","last_unstale":"2020-11-12T17:27:11.681705+0000","last_undegraded":"2020-11-12T17:27:11.681705+0000","last_fullsized":"2020-11-12T17:27:11.681705+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:25:46.581637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:25:46.581637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"163","reported_epoch":"144","state":"active+clean","last_fresh":"2020-11-12T17:27:11.670550+0000","last_change":"2020-11-12T17:26:23.752402+0000","last_active":"2020-11-12T17:27:11.670550+0000","last_peered":"2020-11-12T17:27:11.670550+0000","last_clean":"2020-11-12T17:27:11.670550+0000","last_became_active":"2020-11-12T17:26:06.057282+0000","last_became_peered":"2020-11-12T17:26:06.057282+0000","last_unstale":"2020-11-12T17:27:11.670550+0000","last_undegraded":"2020-11-12T17:27:11.670550+0000","last_fullsized":"2020-11-12T17:27:11.670550+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:26:23.752291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:26:23.752291+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"145'1632","reported_seq":"1854","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:16.527028+0000","last_change":"2020-11-12T17:27:01.968627+0000","last_active":"2020-11-12T17:27:16.527028+0000","last_peered":"2020-11-12T17:27:16.527028+0000","last_clean":"2020-11-12T17:27:16.527028+0000","last_became_active":"2020-11-12T17:27:00.629289+0000","last_became_peered":"2020-11-12T17:27:00.629289+0000","last_unstale":"2020-11-12T17:27:16.527028+0000","last_undegraded":"2020-11-12T17:27:16.527028+0000","last_fullsized":"2020-11-12T17:27:16.527028+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1632,"ondisk_log_size":1632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":204,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1632,"num_write_kb":13056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"185","reported_epoch":"144","state":"active+clean","last_fresh":"2020-11-12T17:27:11.670559+0000","last_change":"2020-11-12T17:27:00.610662+0000","last_active":"2020-11-12T17:27:11.670559+0000","last_peered":"2020-11-12T17:27:11.670559+0000","last_clean":"2020-11-12T17:27:11.670559+0000","last_became_active":"2020-11-12T17:27:00.610189+0000","last_became_peered":"2020-11-12T17:27:00.610189+0000","last_unstale":"2020-11-12T17:27:11.670559+0000","last_undegraded":"2020-11-12T17:27:11.670559+0000","last_fullsized":"2020-11-12T17:27:11.670559+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:51.816592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:51.816592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"146'2112","reported_seq":"2138","reported_epoch":"146","state":"active+clean","last_fresh":"2020-11-12T17:27:20.384791+0000","last_change":"2020-11-12T17:26:45.488276+0000","last_active":"2020-11-12T17:27:20.384791+0000","last_peered":"2020-11-12T17:27:20.384791+0000","last_clean":"2020-11-12T17:27:20.384791+0000","last_became_active":"2020-11-12T17:26:45.487913+0000","last_became_peered":"2020-11-12T17:26:45.487913+0000","last_unstale":"2020-11-12T17:27:20.384791+0000","last_undegraded":"2020-11-12T17:27:20.384791+0000","last_fullsized":"2020-11-12T17:27:20.384791+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2112,"ondisk_log_size":2112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2112,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"152","reported_epoch":"144","state":"active+clean","last_fresh":"2020-11-12T17:27:11.671877+0000","last_change":"2020-11-12T17:27:04.765080+0000","last_active":"2020-11-12T17:27:11.671877+0000","last_peered":"2020-11-12T17:27:11.671877+0000","last_clean":"2020-11-12T17:27:11.671877+0000","last_became_active":"2020-11-12T17:26:06.058701+0000","last_became_peered":"2020-11-12T17:26:06.058701+0000","last_unstale":"2020-11-12T17:27:11.671877+0000","last_undegraded":"2020-11-12T17:27:11.671877+0000","last_fullsized":"2020-11-12T17:27:11.671877+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:04.764948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:27:04.764948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"145'1824","reported_seq":"1849","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:15.796667+0000","last_change":"2020-11-12T17:26:45.490394+0000","last_active":"2020-11-12T17:27:15.796667+0000","last_peered":"2020-11-12T17:27:15.796667+0000","last_clean":"2020-11-12T17:27:15.796667+0000","last_became_active":"2020-11-12T17:26:45.489929+0000","last_became_peered":"2020-11-12T17:26:45.489929+0000","last_unstale":"2020-11-12T17:27:15.796667+0000","last_undegraded":"2020-11-12T17:27:15.796667+0000","last_fullsized":"2020-11-12T17:27:15.796667+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1824,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14942208,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1824,"num_write_kb":14592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"144","state":"active+clean","last_fresh":"2020-11-12T17:27:11.681347+0000","last_change":"2020-11-12T17:27:00.607817+0000","last_active":"2020-11-12T17:27:11.681347+0000","last_peered":"2020-11-12T17:27:11.681347+0000","last_clean":"2020-11-12T17:27:11.681347+0000","last_became_active":"2020-11-12T17:27:00.607358+0000","last_became_peered":"2020-11-12T17:27:00.607358+0000","last_unstale":"2020-11-12T17:27:11.681347+0000","last_undegraded":"2020-11-12T17:27:11.681347+0000","last_fullsized":"2020-11-12T17:27:11.681347+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:52.317257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:52.317257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"145'1760","reported_seq":"2011","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:16.606345+0000","last_change":"2020-11-12T17:27:01.959937+0000","last_active":"2020-11-12T17:27:16.606345+0000","last_peered":"2020-11-12T17:27:16.606345+0000","last_clean":"2020-11-12T17:27:16.606345+0000","last_became_active":"2020-11-12T17:27:00.648415+0000","last_became_peered":"2020-11-12T17:27:00.648415+0000","last_unstale":"2020-11-12T17:27:16.606345+0000","last_undegraded":"2020-11-12T17:27:16.606345+0000","last_fullsized":"2020-11-12T17:27:16.606345+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":1760,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1760,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":7077888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"136","reported_epoch":"145","state":"active+clean","last_fresh":"2020-11-12T17:27:14.727795+0000","last_change":"2020-11-12T17:26:53.490926+0000","last_active":"2020-11-12T17:27:14.727795+0000","last_peered":"2020-11-12T17:27:14.727795+0000","last_clean":"2020-11-12T17:27:14.727795+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:27:14.727795+0000","last_undegraded":"2020-11-12T17:27:14.727795+0000","last_fullsized":"2020-11-12T17:27:14.727795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:53.490814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:26:53.490814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":248872960,"num_objects":3798,"num_object_clones":0,"num_object_copies":7596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3798,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30380,"num_write_kb":243040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":529,"num_bytes_recovered":34627584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228458496,"data_stored":487211008,"data_compressed":3067200,"data_compressed_allocated":228458496,"data_compressed_original":487211008,"omap_allocated":0,"internal_metadata":0},"log_size":30380,"ondisk_log_size":30380,"up":32,"acting":32,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542200,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1070520,"kb_used_data":21936,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93301320,"statfs":{"total":96636764160,"available":95540551680,"internally_reserved":1073741824,"allocated":22462464,"data_stored":43426368,"data_compressed":287016,"data_compressed_allocated":21528576,"data_compressed_original":43057152,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":41.594000000000001,"5min":9.4710000000000001,"15min":4.2030000000000003},"min":{"1min":0.72499999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":727.43499999999995,"5min":727.43499999999995,"15min":727.43499999999995},"last":1.855},{"interface":"front","average":{"1min":6.6319999999999997,"5min":2.7429999999999999,"15min":2.3450000000000002},"min":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":101.371,"5min":101.371,"15min":101.371},"last":0.85499999999999998}]},{"osd":1,"last update":"Thu Nov 12 17:26:34 2020","interfaces":[{"interface":"back","average":{"1min":7.226,"5min":7.226,"15min":7.226},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":102.354,"5min":102.354,"15min":102.354},"last":0.625},{"interface":"front","average":{"1min":6.8630000000000004,"5min":6.8630000000000004,"15min":6.8630000000000004},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":102.08199999999999,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.401}]},{"osd":2,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":6.431,"5min":6.431,"15min":6.431},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":102.038,"5min":102.038,"15min":102.038},"last":1.6819999999999999},{"interface":"front","average":{"1min":6.7130000000000001,"5min":6.7130000000000001,"15min":6.7130000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":102.92,"5min":102.92,"15min":102.92},"last":1.881}]},{"osd":3,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":6.9459999999999997,"5min":2.8100000000000001,"15min":2.411},"min":{"1min":0.86499999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":102.443,"5min":102.443,"15min":102.443},"last":1.718},{"interface":"front","average":{"1min":6.7709999999999999,"5min":9.452,"15min":4.8230000000000004},"min":{"1min":0.91900000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":102.29600000000001,"5min":871.76700000000005,"15min":871.76700000000005},"last":1.9670000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":47.259,"5min":33.906999999999996,"15min":47.140999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":849.06500000000005,"5min":849.06500000000005,"15min":849.06500000000005},"last":1.4450000000000001},{"interface":"front","average":{"1min":6.5780000000000003,"5min":4.0199999999999996,"15min":2.6760000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":103.053,"5min":108.14,"15min":108.14},"last":1.8979999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":21.847999999999999,"5min":6.1970000000000001,"15min":3.8929999999999998},"min":{"1min":0.84899999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":311.077,"5min":311.077,"15min":311.077},"last":0.88900000000000001},{"interface":"front","average":{"1min":7.2149999999999999,"5min":3.3599999999999999,"15min":3.032},"min":{"1min":1.018,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":104.02,"5min":104.02,"15min":104.02},"last":1.032}]},{"osd":6,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":6.8049999999999997,"5min":7.7839999999999998,"15min":4.468},"min":{"1min":0.96499999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":103.56699999999999,"5min":375.04199999999997,"15min":375.04199999999997},"last":1.6950000000000001},{"interface":"front","average":{"1min":6.9450000000000003,"5min":29.754000000000001,"15min":45.545000000000002},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":102.8,"5min":975.20899999999995,"15min":975.20899999999995},"last":1.619}]}]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1098476,"kb_used_data":49892,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93273364,"statfs":{"total":96636764160,"available":95511924736,"internally_reserved":1073741824,"allocated":51089408,"data_stored":100711638,"data_compressed":668913,"data_compressed_allocated":50171904,"data_compressed_original":100343808,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.526,"15min":1.7250000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":5.0309999999999997,"5min":5.0309999999999997,"15min":5.0309999999999997},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.736,"15min":2},"min":{"1min":0.59199999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.5810000000000004,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":1.292}]},{"osd":1,"last update":"Thu Nov 12 17:26:32 2020","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":4.6959999999999997,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.6000000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":2.4009999999999998},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":2.3279999999999998}]},{"osd":3,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":2.7210000000000001,"15min":2.7349999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":3.8530000000000002,"5min":49.442999999999998,"15min":49.442999999999998},"last":2.3660000000000001},{"interface":"front","average":{"1min":1.786,"5min":2.089,"15min":2.3530000000000002},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":4.7359999999999998,"5min":8.202,"15min":8.202},"last":1.4219999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":6.2610000000000001,"15min":3.5710000000000002},"min":{"1min":0.73099999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":5.0789999999999997,"5min":459.15499999999997,"15min":459.15499999999997},"last":2.0059999999999998},{"interface":"front","average":{"1min":15.962,"5min":5.0789999999999997,"15min":3.7269999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":324.95600000000002,"5min":324.95600000000002,"15min":324.95600000000002},"last":1.387}]},{"osd":6,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":2.0569999999999999,"15min":2.2469999999999999},"min":{"1min":0.76600000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.4660000000000002,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":2.3479999999999999},{"interface":"front","average":{"1min":1.802,"5min":2.0150000000000001,"15min":2.254},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.228}]},{"osd":7,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":2.7570000000000001,"15min":2.9870000000000001},"min":{"1min":0.97099999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":4.9939999999999998,"5min":40.268000000000001,"15min":40.268000000000001},"last":1.4490000000000001},{"interface":"front","average":{"1min":32.020000000000003,"5min":8.3439999999999994,"15min":4.718},"min":{"1min":0.72599999999999998,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":693.23000000000002,"5min":693.23000000000002,"15min":693.23000000000002},"last":2.3849999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1091964,"kb_used_data":43380,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93279876,"statfs":{"total":96636764160,"available":95518593024,"internally_reserved":1073741824,"allocated":44421120,"data_stored":87367426,"data_compressed":579774,"data_compressed_allocated":43499520,"data_compressed_original":86999040,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,7],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":38.109999999999999,"5min":12.779,"15min":5.3150000000000004},"min":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":765.13099999999997,"5min":765.13099999999997,"15min":765.13099999999997},"last":1.238},{"interface":"front","average":{"1min":1.3500000000000001,"5min":23.634,"15min":39.231999999999999},"min":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":3.3799999999999999,"5min":948.30899999999997,"15min":948.30899999999997},"last":2.3239999999999998}]},{"osd":1,"last update":"Thu Nov 12 17:26:32 2020","interfaces":[{"interface":"back","average":{"1min":19.036000000000001,"5min":19.036000000000001,"15min":19.036000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":356.46699999999998,"5min":356.46699999999998,"15min":356.46699999999998},"last":6.3929999999999998},{"interface":"front","average":{"1min":18.934000000000001,"5min":18.934000000000001,"15min":18.934000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":356.18599999999998,"5min":356.18599999999998,"15min":356.18599999999998},"last":2.4140000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:27:00 2020","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":6.9630000000000001,"5min":6.9630000000000001,"15min":6.9630000000000001},"last":1.304},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":4.056,"5min":4.056,"15min":4.056},"last":2.4950000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":5.8079999999999998,"15min":3.2949999999999999},"min":{"1min":0.83999999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":7.5629999999999997,"5min":356.02300000000002,"15min":356.02300000000002},"last":6.4649999999999999},{"interface":"front","average":{"1min":18.704000000000001,"5min":9.2430000000000003,"15min":4.5250000000000004},"min":{"1min":0.83599999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":357.476,"5min":357.79000000000002,"15min":357.79000000000002},"last":2.5699999999999998}]},{"osd":5,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":2.5760000000000001,"5min":12.289,"15min":5.4649999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":6.9089999999999998,"5min":575.16800000000001,"15min":575.16800000000001},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.7430000000000001,"5min":15.927,"15min":6.8159999999999998},"min":{"1min":0.81499999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":4.2539999999999996,"5min":908.52700000000004,"15min":908.52700000000004},"last":2.8359999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":1.833,"5min":18.399999999999999,"15min":28.564},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":7.3940000000000001,"5min":665.13999999999999,"15min":665.13999999999999},"last":7.0030000000000001},{"interface":"front","average":{"1min":22.359999999999999,"5min":10.012,"15min":4.8319999999999999},"min":{"1min":0.77000000000000002,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":426.197,"5min":426.197,"15min":426.197},"last":1.792}]},{"osd":7,"last update":"Thu Nov 12 17:26:49 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":14.317,"15min":6.367},"min":{"1min":0.90100000000000002,"5min":0.87,"15min":0.87},"max":{"1min":3.5310000000000001,"5min":584.00300000000004,"15min":584.00300000000004},"last":3.548},{"interface":"front","average":{"1min":47.753,"5min":15.167,"15min":6.5149999999999997},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":915.22900000000004,"5min":915.22900000000004,"15min":915.22900000000004},"last":6.5250000000000004}]}]},{"osd":1,"up_from":88,"seq":377957122070,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1069196,"kb_used_data":20612,"kb_used_omap":114,"kb_used_meta":1048461,"kb_avail":93302644,"statfs":{"total":96636764160,"available":95541907456,"internally_reserved":1073741824,"allocated":21106688,"data_stored":71040878,"data_compressed":289515,"data_compressed_allocated":20189184,"data_compressed_original":70672384,"omap_allocated":117414,"internal_metadata":1073624410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":4.202,"5min":4.202,"15min":4.202},"last":1.4219999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:27:00 2020","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":1.601},{"interface":"front","average":{"1min":1.72,"5min":1.72,"15min":1.72},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":2.008}]},{"osd":3,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":1.5169999999999999},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":6.056,"5min":6.056,"15min":6.056},"last":1.2250000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":2.2930000000000001},{"interface":"front","average":{"1min":2.077,"5min":2.077,"15min":2.077},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":1.671}]},{"osd":5,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":2.024,"5min":2.024,"15min":2.024},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":6.1159999999999997,"5min":6.1159999999999997,"15min":6.1159999999999997},"last":1.966},{"interface":"front","average":{"1min":2.427,"5min":2.427,"15min":2.427},"min":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":6.7859999999999996,"5min":6.7859999999999996,"15min":6.7859999999999996},"last":2.2080000000000002}]},{"osd":6,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":2.343,"5min":2.343,"15min":2.343},"min":{"1min":1.115,"5min":1.115,"15min":1.115},"max":{"1min":6.1689999999999996,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.776},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.161,"5min":1.161,"15min":1.161},"max":{"1min":6.5469999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":1.9019999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":6.577,"5min":6.577,"15min":6.577},"last":2.0619999999999998},{"interface":"front","average":{"1min":2.496,"5min":2.496,"15min":2.496},"min":{"1min":1.319,"5min":1.319,"15min":1.319},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":2.3460000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1074012,"kb_used_data":25428,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93297828,"statfs":{"total":96636764160,"available":95536975872,"internally_reserved":1073741824,"allocated":26038272,"data_stored":50573399,"data_compressed":335016,"data_compressed_allocated":25100288,"data_compressed_original":50200576,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,6,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.6060000000000001,"15min":1.714},"min":{"1min":0.77600000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.744},{"interface":"front","average":{"1min":1.526,"5min":1.6930000000000001,"15min":1.9379999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.5310000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.639}]},{"osd":1,"last update":"Thu Nov 12 17:26:32 2020","interfaces":[{"interface":"back","average":{"1min":42.832999999999998,"5min":42.832999999999998,"15min":42.832999999999998},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":665.476,"5min":665.476,"15min":665.476},"last":1.24},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.286}]},{"osd":2,"last update":"Thu Nov 12 17:26:58 2020","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":1.655},{"interface":"front","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.6819999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":3.4390000000000001,"5min":2.2050000000000001,"15min":2.141},"min":{"1min":1.0049999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":27.997,"5min":27.997,"15min":27.997},"last":1.1899999999999999},{"interface":"front","average":{"1min":3.3799999999999999,"5min":2.3159999999999998,"15min":2.4119999999999999},"min":{"1min":0.90200000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":26.927,"5min":26.927,"15min":26.927},"last":1.7050000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":28.529,"5min":7.2400000000000002,"15min":3.8999999999999999},"min":{"1min":0.70299999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":489.149,"5min":489.149,"15min":489.149},"last":0.70899999999999996},{"interface":"front","average":{"1min":28.414000000000001,"5min":9.2590000000000003,"15min":4.867},"min":{"1min":0.69299999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":480.79599999999999,"5min":480.79599999999999,"15min":480.79599999999999},"last":1.0700000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":20.465,"15min":8.3409999999999993},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.6120000000000001,"5min":804.62199999999996,"15min":804.62199999999996},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.7110000000000001,"5min":15.547000000000001,"15min":20.343},"min":{"1min":0.88800000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.242,"5min":494.78399999999999,"15min":494.78399999999999},"last":0.998}]},{"osd":7,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":17.628,"15min":7.7300000000000004},"min":{"1min":0.71999999999999997,"5min":0.626,"15min":0.626},"max":{"1min":6.4790000000000001,"5min":1002.347,"15min":1002.347},"last":1.782},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.2690000000000001,"15min":2.4390000000000001},"min":{"1min":0.99399999999999999,"5min":0.878,"15min":0.878},"max":{"1min":3.8690000000000002,"5min":10.271000000000001,"15min":10.271000000000001},"last":1.5900000000000001}]}]},{"osd":0,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":102,"seq":438086664210,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1096724,"kb_used_data":48140,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93275116,"statfs":{"total":96636764160,"available":95513718784,"internally_reserved":1073741824,"allocated":49295360,"data_stored":97159242,"data_compressed":645641,"data_compressed_allocated":48394240,"data_compressed_original":96788480,"omap_allocated":4385,"internal_metadata":1073737439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":34.381999999999998,"5min":34.381999999999998,"15min":34.381999999999998},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":524.55600000000004,"5min":524.55600000000004,"15min":524.55600000000004},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.3180000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":2.004,"15min":2.004},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":1.538},{"interface":"front","average":{"1min":1.694,"5min":1.694,"15min":1.694},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.371}]},{"osd":3,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.873,"15min":1.873},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":1.724},{"interface":"front","average":{"1min":58.247,"5min":58.247,"15min":58.247},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":902.96299999999997,"5min":902.96299999999997,"15min":902.96299999999997},"last":1.403}]},{"osd":4,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.234},{"interface":"front","average":{"1min":1.929,"5min":1.929,"15min":1.929},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":3.4279999999999999,"5min":3.4279999999999999,"15min":3.4279999999999999},"last":2.419}]},{"osd":5,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":10.308,"5min":10.308,"15min":10.308},"last":1.9339999999999999},{"interface":"front","average":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":3.774,"5min":3.774,"15min":3.774},"last":3.1920000000000002}]},{"osd":6,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":2.145,"15min":2.145},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":3.7090000000000001,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":2.1059999999999999},{"interface":"front","average":{"1min":12.640000000000001,"5min":12.640000000000001,"15min":12.640000000000001},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":168.64599999999999,"5min":168.64599999999999,"15min":168.64599999999999},"last":1.9910000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":2.528,"15min":2.528},"min":{"1min":1.502,"5min":1.502,"15min":1.502},"max":{"1min":6.1790000000000003,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":3.2719999999999998},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"min":{"1min":1.153,"5min":1.153,"15min":1.153},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":1.823}]}]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1063772,"kb_used_data":15188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93308068,"statfs":{"total":96636764160,"available":95547461632,"internally_reserved":1073741824,"allocated":15552512,"data_stored":29598864,"data_compressed":194720,"data_compressed_allocated":14614528,"data_compressed_original":29229056,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":3.6829999999999998,"15min":2.4260000000000002},"min":{"1min":0.748,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.2559999999999998,"5min":178.36699999999999,"15min":178.36699999999999},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.825,"5min":1.8879999999999999,"15min":1.9339999999999999},"min":{"1min":0.64900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":6.7610000000000001,"5min":16.902000000000001,"15min":16.902000000000001},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Nov 12 17:26:34 2020","interfaces":[{"interface":"back","average":{"1min":38.305999999999997,"5min":38.305999999999997,"15min":38.305999999999997},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":501.91199999999998,"5min":501.91199999999998,"15min":501.91199999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":26.684000000000001,"5min":26.684000000000001,"15min":26.684000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":501.774,"5min":501.774,"15min":501.774},"last":113.923}]},{"osd":2,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":51.488999999999997,"5min":51.488999999999997,"15min":51.488999999999997},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":942.58500000000004,"5min":942.58500000000004,"15min":942.58500000000004},"last":0.81699999999999995},{"interface":"front","average":{"1min":26.448,"5min":26.448,"15min":26.448},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":461.721,"5min":461.721,"15min":461.721},"last":1.651}]},{"osd":4,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":2.1150000000000002,"5min":2.161,"15min":2.4140000000000001},"min":{"1min":0.79600000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.0499999999999998,"5min":10.318,"15min":10.318},"last":1.399},{"interface":"front","average":{"1min":1.972,"5min":2.0350000000000001,"15min":2.343},"min":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.589,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":1.252}]},{"osd":5,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":2.3170000000000002,"5min":14.132999999999999,"15min":26.184000000000001},"min":{"1min":1.016,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":6.8719999999999999,"5min":622.07799999999997,"15min":622.07799999999997},"last":1.0569999999999999},{"interface":"front","average":{"1min":2.1349999999999998,"5min":2.3799999999999999,"15min":2.698},"min":{"1min":1.173,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":4.2839999999999998,"5min":10.436,"15min":10.436},"last":1.5940000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":26.582999999999998,"5min":7.2679999999999998,"15min":4.1719999999999997},"min":{"1min":0.92200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":466.58199999999999,"5min":466.58199999999999,"15min":466.58199999999999},"last":1.524},{"interface":"front","average":{"1min":2.7269999999999999,"5min":2.395,"15min":2.6309999999999998},"min":{"1min":1.722,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":6.9160000000000004,"5min":11.497999999999999,"15min":11.497999999999999},"last":1.083}]},{"osd":7,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":17.262,"5min":5.415,"15min":3.758},"min":{"1min":1.204,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":287.43099999999998,"5min":287.43099999999998,"15min":287.43099999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":33.877000000000002,"5min":19.629999999999999,"15min":26.670000000000002},"min":{"1min":1.1080000000000001,"5min":1.016,"15min":1.016},"max":{"1min":606.49099999999999,"5min":606.49099999999999,"15min":606.49099999999999},"last":2.1819999999999999}]}]}]}} 2020-11-12T17:27:21.155 INFO:tasks.thrashosds.thrasher:Setting 1.0 to [2, 1] 2020-11-12T17:27:21.156 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '1.0', '2', '1'] 2020-11-12T17:27:21.156 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap 1.0 2 1 2020-11-12T17:27:21.246 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:21.240+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:21.258 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:21.258 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:21.272 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:21.315 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:21.312+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:21.399 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:21.399 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:21.413 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:21.415 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:21.412+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:21.517 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:21.514+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:21.533 INFO:teuthology.orchestra.run.smithi036.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-11-12T17:27:21.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:27:21.535 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap, ignoring 2020-11-12T17:27:21.540 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:21.541 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:21.555 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:21.557 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 35 16 33552 33536 7.48499 7.63281 0.00833348 0.0166847 2020-11-12T17:27:21.617 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:21.612+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:21.710 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:21.711 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:21.718 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:21.716+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:21.721 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:21.820 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:21.818+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:21.838 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:21.838 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:21.847 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:21.921 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:21.918+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:21.970 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:21.971 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:21.981 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:22.024 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:22.022+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:22.103 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:22.103 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:22.117 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:22.163 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:22.160+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:22.225 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:22.222+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:22.237 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:22.238 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:22.250 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:22.335 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:22.332+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:22.415 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:22.415 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:22.415 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:22.412+0000 7fc2486d1700 -1 osd.3 147 handle_osd_map injecting map crc failure 2020-11-12T17:27:22.424 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:22.467 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:22.464+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:22.577 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 36 15 34338 34323 7.44785 6.14844 0.012721 0.0167728 2020-11-12T17:27:22.577 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:22.572+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:22.588 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:22.588 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:22.604 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:22.691 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:22.688+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:22.770 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:22.793 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:22.795 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:22.792+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:22.796 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:22.818 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:27:22.820 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:22.896 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:22.892+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:22.997 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:22.994+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:23.000 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:23.000 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:23.012 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:23.021 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:23.059 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:23.094 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:23.098 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:23.092+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:23.126 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:23.161 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:23.195 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:23.199 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:23.196+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:23.200 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:23.201 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:23.201 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:23.201 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:23.201 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:23.216 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:23.232 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:23.263 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:23.265 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:23.265 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:23.265 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:23.265 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:23.265 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:23.265 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:23.266 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:23.266 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:23.300 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:23.298+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:23.366 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:23.366 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:23.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:23.367 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:23.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.367 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:23.367 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:23.367 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 258.25463012199998, 2020-11-12T17:27:23.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:23.367 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.368 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.368 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.368 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:23.368 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:23.368 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:23.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.368 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:23.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:23.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:23.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:23.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:23.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:23.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:23.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:23.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:23.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:23.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:23.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:23.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:23.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:23.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:23.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:23.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:23.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:23.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:23.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:23.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:23.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:23.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:23.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:23.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:23.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:23.377 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.378 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.378 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:23.378 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:23.378 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 258.24753832599998, 2020-11-12T17:27:23.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:23.379 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.379 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:23.379 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:23.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:23.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:23.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:23.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:23.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:23.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:23.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:23.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:23.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:23.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:23.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:23.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:23.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:23.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:23.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:23.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:23.386 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.386 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.387 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.387 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:23.387 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:23.387 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 248.81497882900001, 2020-11-12T17:27:23.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:23.388 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.388 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:23.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:23.388 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:23.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.388 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:23.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:23.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:23.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:23.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:23.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:23.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:23.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:23.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:23.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:23.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:23.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:23.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:23.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:23.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:23.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:23.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:23.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:23.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:23.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:23.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:23.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:23.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:23.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:23.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:23.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:23.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.399 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:23.399 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:23.399 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 214.86485873500001, 2020-11-12T17:27:23.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:23.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:23.399 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:23.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:23.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:23.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:23.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:23.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:23.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:23.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:23.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:23.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:23.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:23.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:23.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:23.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:23.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:23.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:23.406 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.406 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.406 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.407 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:23.407 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:23.407 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 212.759256843, 2020-11-12T17:27:23.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:23.407 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.407 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.407 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:23.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:23.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:23.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:23.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:23.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:23.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:23.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:23.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:23.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:23.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:23.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:23.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:23.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:23.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:23.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:23.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:23.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:23.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:23.415 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.416 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.416 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.417 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:23.417 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:23.417 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 181.412773509, 2020-11-12T17:27:23.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:23.418 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.418 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.418 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.418 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:23.418 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:23.418 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:23.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.419 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:23.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:23.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:23.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:23.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:23.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:23.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:23.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:23.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:23.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:23.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:23.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:23.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:23.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:23.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:23.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:23.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:23.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:23.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:23.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:23.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:23.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:23.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:23.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:23.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:23.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:23.428 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.429 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.429 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.429 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:23.429 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:23.429 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 172.416931707, 2020-11-12T17:27:23.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:23.430 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.430 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:23.430 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:23.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:23.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:23.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:23.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:23.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:23.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:23.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:23.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:23.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:23.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:23.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:23.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:23.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:23.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:23.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:23.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:23.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.437 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.437 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:23.437 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:23.438 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 168.48182830799999, 2020-11-12T17:27:23.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:23.438 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.438 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:23.438 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:23.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:23.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:23.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:23.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:23.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:23.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:23.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:23.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:23.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:23.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:23.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:23.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:23.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:23.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:23.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.445 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.445 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:23.446 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:23.446 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.717187817, 2020-11-12T17:27:23.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:23.446 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.446 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:23.446 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:23.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:23.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:23.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:23.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:23.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:23.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:23.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:23.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:23.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:23.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:23.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:23.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:23.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:23.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:23.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:23.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:23.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.453 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.454 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:23.454 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:23.454 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 131.46067913300001, 2020-11-12T17:27:23.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:23.454 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.454 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:23.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:23.455 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:23.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.455 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:23.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:23.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:23.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:23.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:23.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:23.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:23.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:23.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:23.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:23.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:23.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:23.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:23.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:23.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:23.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:23.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:23.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:23.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:23.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:23.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:23.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:23.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:23.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:23.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:23.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:23.466 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.466 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.466 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 131.46051676299999, 2020-11-12T17:27:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:23.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:23.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:23.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:23.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:23.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:23.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.501 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.502 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:23.502 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:23.502 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 131.451947776, 2020-11-12T17:27:23.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:23.503 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.503 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:23.503 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:23.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:23.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:23.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:23.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:23.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:23.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:23.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:23.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:23.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:23.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:23.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:23.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:23.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.510 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 106.947435326, 2020-11-12T17:27:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.512 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.512 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.512 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:23.512 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:23.512 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:23.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.512 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:23.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:23.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:23.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:23.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:23.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:23.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:23.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:23.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:23.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:23.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:23.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:23.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:23.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:23.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:23.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:23.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:23.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:23.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:23.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:23.523 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.523 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.523 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.524 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:23.524 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:23.524 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.46188703999999, 2020-11-12T17:27:23.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.526 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:23.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:23.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:23.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:23.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:23.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:23.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:23.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:23.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:23.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.388568608, 2020-11-12T17:27:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:23.545 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 101.332923632, 2020-11-12T17:27:23.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:23.545 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.545 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 100.944719261, 2020-11-12T17:27:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:23.557 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.557 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:23.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:23.557 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:23.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.558 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:23.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:23.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:23.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:23.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:23.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:23.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:23.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:23.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:23.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:23.567 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.567 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.567 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.567 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:23.567 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:23.568 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.738262328999994, 2020-11-12T17:27:23.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:23.568 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.568 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.568 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.568 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:23.568 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:23.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:23.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.489056711999993, 2020-11-12T17:27:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:23.581 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.581 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:23.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:23.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.472097262999995, 2020-11-12T17:27:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:23.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.602 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.602 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.602 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.602 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.602 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:23.605 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 37 16 35135 35119 7.41451 6.21875 0.0516747 0.0167922 2020-11-12T17:27:23.605 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:23.602+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:23.606 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:23.705 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:23.700+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:23.724 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:23.724 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:23.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.724 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35143 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:23.725 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.566152+0000", 2020-11-12T17:27:23.725 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.15822362600000001, 2020-11-12T17:27:23.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15824495899999999, 2020-11-12T17:27:23.725 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.725 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:23.725 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.725 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:23.726 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:23.726 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35143 2020-11-12T17:27:23.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.726 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566152+0000", 2020-11-12T17:27:23.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566152+0000", 2020-11-12T17:27:23.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999528 2020-11-12T17:27:23.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566105+0000", 2020-11-12T17:27:23.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013494000000000001 2020-11-12T17:27:23.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566240+0000", 2020-11-12T17:27:23.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0642999999999999e-05 2020-11-12T17:27:23.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566260+0000", 2020-11-12T17:27:23.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.173e-05 2020-11-12T17:27:23.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566272+0000", 2020-11-12T17:27:23.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14236621799999999 2020-11-12T17:27:23.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708638+0000", 2020-11-12T17:27:23.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3500999999999998e-05 2020-11-12T17:27:23.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708732+0000", 2020-11-12T17:27:23.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000171514 2020-11-12T17:27:23.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:23.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708903+0000", 2020-11-12T17:27:23.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002969359 2020-11-12T17:27:23.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.711873+0000", 2020-11-12T17:27:23.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14572083199999999 2020-11-12T17:27:23.733 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.733 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.733 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.734 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35144 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:23.734 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:23.734 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.157211559, 2020-11-12T17:27:23.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15729247599999999, 2020-11-12T17:27:23.734 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:23.734 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:23.735 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:23.735 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:23.735 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:23.735 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35144 2020-11-12T17:27:23.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.735 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:23.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:23.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:23.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:23.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:23.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:23.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:23.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:23.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567086+0000", 2020-11-12T17:27:23.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017142700000000001 2020-11-12T17:27:23.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:23.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567257+0000", 2020-11-12T17:27:23.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1043000000000002e-05 2020-11-12T17:27:23.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:23.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567278+0000", 2020-11-12T17:27:23.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1214e-05 2020-11-12T17:27:23.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:23.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567289+0000", 2020-11-12T17:27:23.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142698779 2020-11-12T17:27:23.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:23.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.709988+0000", 2020-11-12T17:27:23.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4704999999999995e-05 2020-11-12T17:27:23.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:23.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710083+0000", 2020-11-12T17:27:23.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016350300000000001 2020-11-12T17:27:23.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:23.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710246+0000", 2020-11-12T17:27:23.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002268946 2020-11-12T17:27:23.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:23.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:23.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:23.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.712515+0000", 2020-11-12T17:27:23.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14535150399999999 2020-11-12T17:27:23.743 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.743 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:23.743 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.743 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:23.743 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:23.744 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 2 2020-11-12T17:27:23.744 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:23.745 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:23.769 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:23.764+0000 7f4dea6fe700 -1 osd.1 148 handle_osd_map injecting map crc failure 2020-11-12T17:27:23.769 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:27:23.827 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:23.824+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:23.896 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:23.897 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:23.897 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:23.908 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:23.909 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:23.906+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:24.009 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:24.004+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:24.060 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:24.056+0000 7f6583748700 -1 osd.0 148 handle_osd_map injecting map crc failure 2020-11-12T17:27:24.259 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:24.259 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:24.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:24.260 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:24.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.260 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:24.261 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:24.261 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 249.66793957799999, 2020-11-12T17:27:24.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:24.261 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.261 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.262 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.262 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:24.262 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:24.263 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:24.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.263 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:24.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:24.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:24.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:24.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:24.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:24.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:24.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:24.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:24.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:24.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:24.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:24.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:24.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:24.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:24.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:24.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:24.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:24.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:24.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:24.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:24.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:24.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:24.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:24.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:24.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.280 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:24.280 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:24.280 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 249.66099551600001, 2020-11-12T17:27:24.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:24.281 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.281 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:24.281 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:24.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:24.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:24.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:24.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:24.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:24.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:24.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:24.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:24.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:24.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:24.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:24.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:24.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.293 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.294 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:24.294 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:24.294 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 213.48715773000001, 2020-11-12T17:27:24.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:24.294 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.295 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:24.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:24.295 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:24.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.296 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:24.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:24.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:24.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:24.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:24.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:24.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:24.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:24.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:24.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:24.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:24.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:24.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:24.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:24.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:24.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:24.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:24.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:24.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:24.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:27:24.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:27:24.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:27:24.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 197.22345263700001, 2020-11-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.308 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:24.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:24.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:27:24.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:27:24.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:27:24.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:27:24.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:27:24.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:27:24.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:27:24.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:27:24.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:27:24.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:27:24.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:27:24.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:27:24.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:24.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:27:24.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:27:24.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:27:24.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:27:24.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:27:24.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:27:24.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:27:24.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:27:24.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:27:24.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:27:24.321 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.321 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.321 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.322 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:27:24.322 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:24.322 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 182.138072311, 2020-11-12T17:27:24.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:27:24.322 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.323 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.323 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:24.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:24.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:24.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:27:24.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:27:24.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:27:24.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:27:24.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:27:24.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:27:24.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:27:24.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:27:24.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:27:24.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:27:24.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:27:24.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:27:24.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:27:24.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:27:24.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:27:24.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:27:24.333 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.333 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.333 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.333 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:27:24.334 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:24.334 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 180.44393403699999, 2020-11-12T17:27:24.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:27:24.334 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.335 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:24.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:24.336 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:27:24.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.336 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:24.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:24.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:24.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:27:24.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:27:24.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:27:24.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:27:24.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:27:24.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:27:24.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:27:24.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:27:24.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:27:24.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:27:24.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:27:24.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:27:24.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:24.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:27:24.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:27:24.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:27:24.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:27:24.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:27:24.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:27:24.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:27:24.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:27:24.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:27:24.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:27:24.348 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.349 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.349 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.349 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:27:24.350 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:24.350 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.774695315, 2020-11-12T17:27:24.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:27:24.350 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.350 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.350 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:24.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:24.351 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:27:24.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.351 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:24.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:24.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:24.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:27:24.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:27:24.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:27:24.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:27:24.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:27:24.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:27:24.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:27:24.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:27:24.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:27:24.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:27:24.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:27:24.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:27:24.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:24.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:27:24.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:27:24.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:27:24.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:27:24.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:27:24.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:27:24.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:27:24.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:27:24.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:27:24.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:27:24.366 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.366 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.367 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.367 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:27:24.367 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:24.368 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.761518556, 2020-11-12T17:27:24.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:27:24.368 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.368 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:24.368 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:24.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:24.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:24.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:27:24.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:27:24.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:27:24.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:27:24.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:27:24.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:27:24.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:27:24.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:27:24.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:27:24.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:27:24.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:27:24.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:27:24.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:27:24.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:27:24.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.378 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.379 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:27:24.379 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:24.379 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 118.207437107, 2020-11-12T17:27:24.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:27:24.379 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.380 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.380 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.381 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:24.381 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:24.381 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:27:24.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.381 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:24.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:24.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:27:24.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:27:24.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:27:24.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:27:24.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:27:24.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:27:24.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:27:24.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:27:24.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:27:24.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:27:24.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:27:24.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:27:24.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:27:24.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:24.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:27:24.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:27:24.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:27:24.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:27:24.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:27:24.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:27:24.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:27:24.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:27:24.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:27:24.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:27:24.396 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.396 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.396 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.397 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:27:24.397 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:24.397 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 118.198449801, 2020-11-12T17:27:24.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:27:24.398 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.398 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:24.398 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:24.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:24.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:24.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:27:24.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:27:24.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:27:24.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:27:24.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:27:24.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:27:24.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:27:24.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:27:24.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:27:24.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:27:24.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:27:24.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:27:24.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:27:24.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:27:24.409 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.409 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.410 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.411 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:27:24.411 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:24.411 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.180522487, 2020-11-12T17:27:24.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:27:24.411 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.412 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.412 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.412 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:24.412 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:24.412 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:27:24.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.413 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:24.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:24.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:24.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:27:24.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:27:24.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:27:24.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:27:24.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:27:24.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:27:24.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:27:24.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:27:24.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:27:24.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:27:24.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:27:24.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:27:24.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:24.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:27:24.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:27:24.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:27:24.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:27:24.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:27:24.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:27:24.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:27:24.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:27:24.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:27:24.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:27:24.426 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.427 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.427 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.428 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:24.428 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:24.428 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.378083589, 2020-11-12T17:27:24.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:27:24.428 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.429 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.429 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.429 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:24.429 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:24.429 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:27:24.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.430 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:24.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:24.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:24.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:27:24.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:27:24.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:27:24.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:27:24.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:27:24.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:27:24.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:27:24.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:27:24.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:27:24.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:27:24.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:27:24.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:27:24.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:24.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:27:24.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:27:24.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:27:24.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:27:24.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:27:24.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:27:24.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:27:24.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:27:24.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:27:24.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:27:24.443 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.443 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.443 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.444 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:24.444 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:24.444 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.298961272, 2020-11-12T17:27:24.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:27:24.445 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.445 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.445 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.445 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:24.445 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:24.445 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:27:24.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.446 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:24.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:24.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:24.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:27:24.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:27:24.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:27:24.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:27:24.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:27:24.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:27:24.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:27:24.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:27:24.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:27:24.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:27:24.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:27:24.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:27:24.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:24.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:27:24.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:27:24.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:27:24.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:27:24.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:27:24.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:27:24.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:27:24.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:27:24.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:27:24.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:27:24.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.473 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.473 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:27:24.473 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:24.474 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 82.516610305, 2020-11-12T17:27:24.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:27:24.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.474 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.474 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.474 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:24.475 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:24.475 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:27:24.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.475 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:24.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:24.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:27:24.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:27:24.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:27:24.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:27:24.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:27:24.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:27:24.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:27:24.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:27:24.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:27:24.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:27:24.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:27:24.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:27:24.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:27:24.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:24.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:27:24.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:27:24.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:27:24.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:27:24.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:27:24.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:27:24.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:27:24.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:27:24.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:27:24.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:27:24.485 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.486 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.486 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:27:24.486 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:24.487 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.053567955999995, 2020-11-12T17:27:24.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:27:24.487 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.487 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.487 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.487 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:24.488 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:24.488 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:27:24.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.488 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:24.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:24.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:27:24.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:27:24.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:27:24.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:27:24.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:27:24.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:27:24.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:27:24.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:27:24.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:27:24.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:27:24.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:27:24.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:27:24.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:27:24.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:24.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:27:24.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:27:24.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:27:24.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:27:24.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:27:24.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:27:24.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:27:24.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:27:24.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:27:24.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:27:24.498 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.498 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.499 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.499 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:73552 4.0 e110/69 ondisk, result = 0)", 2020-11-12T17:27:24.499 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:27:24.499 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.032527422000001, 2020-11-12T17:27:24.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002, 2020-11-12T17:27:24.500 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.500 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:24.500 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:27:24.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053900+0000", 2020-11-12T17:27:24.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:27:24.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053887+0000", 2020-11-12T17:27:24.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5978e-05 2020-11-12T17:27:24.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.053923+0000", 2020-11-12T17:27:24.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.333340201 2020-11-12T17:27:24.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387263+0000", 2020-11-12T17:27:24.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8240000000000002e-06 2020-11-12T17:27:24.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.387270+0000", 2020-11-12T17:27:24.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093156890000000003 2020-11-12T17:27:24.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396585+0000", 2020-11-12T17:27:24.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2136e-05 2020-11-12T17:27:24.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396597+0000", 2020-11-12T17:27:24.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018843399999999999 2020-11-12T17:27:24.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396786+0000", 2020-11-12T17:27:24.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34288537200000002 2020-11-12T17:27:24.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.507 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.508 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:24.508 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:24.508 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 22.031808805000001, 2020-11-12T17:27:24.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:27:24.509 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.509 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.509 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.509 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:24.509 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:24.509 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:27:24.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.510 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:24.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:24.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:24.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:27:24.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:27:24.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:27:24.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:27:24.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:27:24.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:27:24.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:27:24.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:27:24.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:27:24.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:27:24.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:27:24.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:27:24.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:24.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:27:24.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:27:24.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:27:24.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:27:24.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:27:24.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:27:24.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:27:24.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:27:24.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:27:24.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:27:24.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.520 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.521 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35048 5.1 e148/127 5:8e34dcfa:::benchmark_data_smithi036_24110_object4380:head v 148'2280, mlcod=148'2275)", 2020-11-12T17:27:24.521 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:24.521 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.72686998599999997, 2020-11-12T17:27:24.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002, 2020-11-12T17:27:24.521 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.522 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:24.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:24.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:24.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359524+0000", 2020-11-12T17:27:24.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.064e-05 2020-11-12T17:27:24.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359605+0000", 2020-11-12T17:27:24.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34493079599999998 2020-11-12T17:27:24.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704536+0000", 2020-11-12T17:27:24.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2110000000000001e-06 2020-11-12T17:27:24.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704543+0000", 2020-11-12T17:27:24.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1071999999999998e-05 2020-11-12T17:27:24.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704634+0000", 2020-11-12T17:27:24.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2281999999999998e-05 2020-11-12T17:27:24.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704696+0000", 2020-11-12T17:27:24.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034977459999999999 2020-11-12T17:27:24.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708194+0000", 2020-11-12T17:27:24.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1390000000000006e-05 2020-11-12T17:27:24.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708265+0000", 2020-11-12T17:27:24.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002 2020-11-12T17:27:24.530 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.530 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.530 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.530 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35143 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:24.531 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.566152+0000", 2020-11-12T17:27:24.531 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.52027615500000002, 2020-11-12T17:27:24.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34210834000000001, 2020-11-12T17:27:24.531 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.531 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.531 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.532 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:24.532 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:24.532 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35143 2020-11-12T17:27:24.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.532 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566152+0000", 2020-11-12T17:27:24.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566152+0000", 2020-11-12T17:27:24.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999528 2020-11-12T17:27:24.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566105+0000", 2020-11-12T17:27:24.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013494000000000001 2020-11-12T17:27:24.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566240+0000", 2020-11-12T17:27:24.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0642999999999999e-05 2020-11-12T17:27:24.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566260+0000", 2020-11-12T17:27:24.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.173e-05 2020-11-12T17:27:24.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.566272+0000", 2020-11-12T17:27:24.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.14236621799999999 2020-11-12T17:27:24.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708638+0000", 2020-11-12T17:27:24.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3500999999999998e-05 2020-11-12T17:27:24.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708732+0000", 2020-11-12T17:27:24.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000171514 2020-11-12T17:27:24.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:24.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708903+0000", 2020-11-12T17:27:24.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002969359 2020-11-12T17:27:24.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.711873+0000", 2020-11-12T17:27:24.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.19624713599999999 2020-11-12T17:27:24.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.908120+0000", 2020-11-12T17:27:24.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5021000000000001e-05 2020-11-12T17:27:24.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.908175+0000", 2020-11-12T17:27:24.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5351000000000003e-05 2020-11-12T17:27:24.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.908260+0000", 2020-11-12T17:27:24.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34210834000000001 2020-11-12T17:27:24.543 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.543 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.543 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.544 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35144 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:24.544 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:24.544 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.51926408800000001, 2020-11-12T17:27:24.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998, 2020-11-12T17:27:24.544 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:24.544 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:24.544 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:24.545 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:24.545 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:24.545 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35144 2020-11-12T17:27:24.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.545 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:24.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:24.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:24.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:24.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:24.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:24.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:24.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:24.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567086+0000", 2020-11-12T17:27:24.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017142700000000001 2020-11-12T17:27:24.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:24.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567257+0000", 2020-11-12T17:27:24.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1043000000000002e-05 2020-11-12T17:27:24.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:24.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567278+0000", 2020-11-12T17:27:24.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1214e-05 2020-11-12T17:27:24.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:24.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567289+0000", 2020-11-12T17:27:24.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142698779 2020-11-12T17:27:24.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:24.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.709988+0000", 2020-11-12T17:27:24.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4704999999999995e-05 2020-11-12T17:27:24.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:24.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710083+0000", 2020-11-12T17:27:24.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016350300000000001 2020-11-12T17:27:24.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:24.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710246+0000", 2020-11-12T17:27:24.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002268946 2020-11-12T17:27:24.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:24.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.712515+0000", 2020-11-12T17:27:24.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199261574 2020-11-12T17:27:24.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:24.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911777+0000", 2020-11-12T17:27:24.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0816999999999996e-05 2020-11-12T17:27:24.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:24.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911858+0000", 2020-11-12T17:27:24.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2182000000000003e-05 2020-11-12T17:27:24.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:24.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:24.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:24.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911910+0000", 2020-11-12T17:27:24.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998 2020-11-12T17:27:24.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.556 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:24.556 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:24.556 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:24.557 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:24.558 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:24.252+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:24.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 38 16 36063 36047 7.41016 7.25 0.010213 0.0168477 2020-11-12T17:27:24.563 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:24.560+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:24.660 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:24.658+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:24.684 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:24.684 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:24.684 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:27:24.684 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:24.695 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:24.787 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:24.786+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:24.860 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:24.860 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:24.861 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:24.861 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:24.861 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:24.863 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:24.860+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:24.870 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:24.968 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:24.966+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:25.047 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:25.048 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:25.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:25.048 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:25.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.049 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:27:25.049 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:25.049 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 254.35966183100001, 2020-11-12T17:27:25.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:27:25.050 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.050 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.050 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:25.051 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:25.051 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:25.051 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:27:25.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.052 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:25.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:25.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:25.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:27:25.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:27:25.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:27:25.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:27:25.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:27:25.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:27:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:27:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:27:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:27:25.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:27:25.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:27:25.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:27:25.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:25.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:27:25.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:27:25.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:25.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:27:25.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:27:25.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:25.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:27:25.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:27:25.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:27:25.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:27:25.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:27:25.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:27:25.072 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.072 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.073 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:27:25.074 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:25.074 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 254.354181762, 2020-11-12T17:27:25.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:27:25.074 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.075 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.075 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:25.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:25.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:25.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:27:25.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:27:25.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:27:25.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:27:25.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:27:25.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:27:25.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:27:25.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:27:25.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:27:25.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:27:25.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:27:25.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:27:25.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:27:25.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:27:25.083 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.084 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.084 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:27:25.084 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:25.084 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 246.164060162, 2020-11-12T17:27:25.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:27:25.085 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.085 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.085 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:25.085 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:25.085 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:25.085 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:27:25.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.086 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:25.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:25.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:27:25.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:27:25.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:27:25.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:27:25.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:27:25.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:27:25.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:27:25.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:27:25.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:27:25.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:27:25.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:27:25.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:27:25.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:27:25.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:25.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:27:25.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:27:25.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:25.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:27:25.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:27:25.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:25.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:27:25.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:27:25.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:27:25.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:27:25.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:27:25.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:27:25.095 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.095 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.096 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.096 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:27:25.096 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:25.096 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 246.156816453, 2020-11-12T17:27:25.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:27:25.097 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.097 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.097 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:25.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:25.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:25.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:27:25.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:27:25.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:27:25.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:27:25.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:27:25.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:27:25.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:27:25.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:27:25.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:27:25.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:27:25.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:27:25.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:27:25.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:27:25.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:27:25.103 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.103 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.104 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.104 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:25.104 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:25.104 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 170.160727079, 2020-11-12T17:27:25.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:27:25.105 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.105 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.105 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:25.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:25.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:27:25.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:27:25.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:27:25.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:27:25.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:27:25.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:27:25.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:27:25.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:27:25.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:27:25.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:27:25.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:27:25.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:27:25.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:27:25.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:27:25.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:27:25.111 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.111 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.111 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.112 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:27:25.112 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:25.112 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 104.033204567, 2020-11-12T17:27:25.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:27:25.112 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.112 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.112 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:25.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:25.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:25.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:27:25.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:27:25.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:27:25.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:27:25.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:27:25.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:27:25.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:27:25.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:27:25.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:27:25.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:27:25.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:27:25.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:27:25.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:27:25.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:27:25.119 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.119 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.119 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.119 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:25.120 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:25.120 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.984137906000001, 2020-11-12T17:27:25.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:27:25.120 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.120 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:25.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:25.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:25.121 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:27:25.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.121 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:25.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:25.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:27:25.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:27:25.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:27:25.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:27:25.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:27:25.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:27:25.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:27:25.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:27:25.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:27:25.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:27:25.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:27:25.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:27:25.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:27:25.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:25.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:27:25.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:27:25.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:25.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:27:25.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:27:25.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:25.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:27:25.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:27:25.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:27:25.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:27:25.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:27:25.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:27:25.130 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.130 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.131 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.131 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:25.131 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:25.131 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.982457126, 2020-11-12T17:27:25.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:27:25.131 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.132 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.132 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:25.132 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:25.132 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:25.132 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:27:25.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.132 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:25.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:25.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:25.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:27:25.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:27:25.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:27:25.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:27:25.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:27:25.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:27:25.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:27:25.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:27:25.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:27:25.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:27:25.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:27:25.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:27:25.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:25.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:27:25.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:27:25.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:25.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:27:25.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:27:25.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:25.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:27:25.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:27:25.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:27:25.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:27:25.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:27:25.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:27:25.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.141 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.142 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:25.142 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:25.142 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.982368930999996, 2020-11-12T17:27:25.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:27:25.142 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.142 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.142 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:25.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:25.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:25.143 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:27:25.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.143 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:25.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:25.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:25.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:27:25.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:27:25.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:27:25.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:27:25.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:27:25.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:27:25.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:27:25.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:27:25.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:27:25.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:27:25.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:27:25.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:27:25.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:25.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:27:25.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:27:25.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:25.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:27:25.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:27:25.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:25.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:27:25.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:27:25.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:27:25.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:27:25.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:27:25.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:27:25.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.152 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.153 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:25.153 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:25.153 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.963873616000001, 2020-11-12T17:27:25.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:27:25.153 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.153 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.153 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:25.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:25.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:25.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:27:25.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:27:25.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:27:25.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:27:25.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:27:25.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:27:25.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:27:25.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:27:25.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:27:25.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:27:25.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:27:25.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:27:25.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:27:25.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:27:25.159 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.160 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.160 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.160 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:25.160 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:25.160 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.963740626000003, 2020-11-12T17:27:25.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:27:25.161 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.161 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.161 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:25.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:25.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:25.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:27:25.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:27:25.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:27:25.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:27:25.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:27:25.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:27:25.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:27:25.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:27:25.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:27:25.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:27:25.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:27:25.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:27:25.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:27:25.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:27:25.168 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.168 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.168 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.169 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:25.169 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:25.169 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 96.963655897999999, 2020-11-12T17:27:25.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:27:25.169 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.169 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.170 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:25.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:25.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:25.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:27:25.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:27:25.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:27:25.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:27:25.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:27:25.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:27:25.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:27:25.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:27:25.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:27:25.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:27:25.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:27:25.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:27:25.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:27:25.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:27:25.176 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.176 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.177 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.177 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:25.177 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:25.177 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.212833446999994, 2020-11-12T17:27:25.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:27:25.177 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.178 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.178 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:25.178 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:25.178 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:25.178 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:27:25.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.178 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:25.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:25.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:25.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:27:25.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:27:25.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:27:25.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:27:25.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:27:25.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:27:25.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:27:25.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:27:25.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:27:25.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:27:25.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:27:25.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:27:25.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:25.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:27:25.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:27:25.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:25.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:27:25.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:27:25.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:25.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:27:25.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:27:25.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:27:25.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:27:25.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:27:25.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:27:25.187 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.187 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.187 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.188 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:25.188 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:25.188 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.126177959000003, 2020-11-12T17:27:25.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:27:25.188 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.188 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:25.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:25.189 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:25.189 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:27:25.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.189 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:25.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:25.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:25.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:27:25.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:27:25.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:27:25.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:27:25.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:27:25.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:27:25.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:27:25.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:27:25.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:27:25.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:27:25.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:27:25.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:27:25.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:25.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:27:25.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:27:25.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:25.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:27:25.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:27:25.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:25.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:27:25.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:27:25.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:27:25.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:27:25.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:27:25.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:27:25.198 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.198 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.198 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.199 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:27:25.199 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:25.199 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.112696732000003, 2020-11-12T17:27:25.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:27:25.199 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.199 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.200 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:25.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:25.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:25.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:27:25.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:27:25.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:27:25.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:27:25.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:27:25.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:27:25.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:27:25.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:27:25.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:27:25.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:27:25.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:27:25.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:27:25.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:27:25.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:27:25.206 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.206 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.206 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.207 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:25.207 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:25.207 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.110408530000001, 2020-11-12T17:27:25.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:27:25.207 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.207 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.207 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:25.207 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:25.208 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:25.208 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:27:25.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.208 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:25.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:25.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:25.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:27:25.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:27:25.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:27:25.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:27:25.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:27:25.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:27:25.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:27:25.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:27:25.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:27:25.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:27:25.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:27:25.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:27:25.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:25.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:27:25.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:27:25.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:25.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:27:25.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:27:25.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:25.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:27:25.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:27:25.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:27:25.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:27:25.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:27:25.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:27:25.217 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.217 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.217 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.217 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:25.218 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:25.218 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.104591945999999, 2020-11-12T17:27:25.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:27:25.218 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.218 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.218 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:25.218 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:25.219 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:25.219 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:27:25.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.219 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:25.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:25.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:25.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:27:25.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:27:25.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:27:25.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:27:25.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:27:25.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:27:25.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:27:25.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:27:25.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:27:25.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:27:25.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:27:25.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:27:25.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:25.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:27:25.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:27:25.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:25.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:27:25.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:27:25.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:25.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:27:25.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:27:25.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:27:25.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:27:25.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:27:25.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:27:25.228 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.228 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.228 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.229 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:27:25.229 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:25.229 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.081658432000001, 2020-11-12T17:27:25.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:27:25.229 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.230 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.230 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:25.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:25.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:25.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:27:25.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:27:25.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:27:25.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:27:25.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:27:25.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:27:25.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:27:25.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:27:25.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:27:25.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:27:25.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:27:25.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:27:25.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:27:25.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:27:25.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:27:25.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:27:25.236 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.237 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.237 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.237 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:27:25.237 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:25.237 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.549180405000001, 2020-11-12T17:27:25.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:27:25.238 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.238 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.238 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:25.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:25.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:25.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:27:25.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:27:25.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:27:25.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:27:25.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:27:25.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:27:25.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:27:25.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:27:25.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:27:25.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:27:25.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:27:25.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:27:25.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:27:25.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:27:25.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:27:25.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:27:25.245 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.245 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.245 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.245 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36040 5.a e149/127 5:5a4d50fb:::benchmark_data_smithi036_24110_object4504:head v 149'2328, mlcod=149'2321)", 2020-11-12T17:27:25.245 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:25.246 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.51033150400000005, 2020-11-12T17:27:25.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001, 2020-11-12T17:27:25.246 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.246 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:25.246 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:25.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:25.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:25.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536010+0000", 2020-11-12T17:27:25.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111983 2020-11-12T17:27:25.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536122+0000", 2020-11-12T17:27:25.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40432243400000001 2020-11-12T17:27:25.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940444+0000", 2020-11-12T17:27:25.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2870000000000001e-06 2020-11-12T17:27:25.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940450+0000", 2020-11-12T17:27:25.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4161999999999999e-05 2020-11-12T17:27:25.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940524+0000", 2020-11-12T17:27:25.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4454e-05 2020-11-12T17:27:25.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940549+0000", 2020-11-12T17:27:25.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021055879999999998 2020-11-12T17:27:25.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:25.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942654+0000", 2020-11-12T17:27:25.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5819000000000002e-05 2020-11-12T17:27:25.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:25.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942710+0000", 2020-11-12T17:27:25.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001 2020-11-12T17:27:25.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.253 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.253 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.253 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:25.255 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:25.256 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:25.250+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:25.280 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:25.356 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:25.352+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:25.435 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:25.436 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:25.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.436 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36810 5.2 e149/127 5:41bffcca:::benchmark_data_smithi036_24110_object4601:head v 149'2362, mlcod=149'2357)", 2020-11-12T17:27:25.436 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:25.429776+0000", 2020-11-12T17:27:25.436 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0070718839999999996, 2020-11-12T17:27:25.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0070902159999999999, 2020-11-12T17:27:25.436 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.437 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.437 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.429776+0000", 2020-11-12T17:27:25.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.429776+0000", 2020-11-12T17:27:25.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:25.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.429751+0000", 2020-11-12T17:27:25.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4028000000000003e-05 2020-11-12T17:27:25.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.429835+0000", 2020-11-12T17:27:25.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029348159999999998 2020-11-12T17:27:25.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.432770+0000", 2020-11-12T17:27:25.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4190000000000001e-06 2020-11-12T17:27:25.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.432776+0000", 2020-11-12T17:27:25.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8501999999999999e-05 2020-11-12T17:27:25.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.432804+0000", 2020-11-12T17:27:25.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0460000000000001e-05 2020-11-12T17:27:25.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.432825+0000", 2020-11-12T17:27:25.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030489340000000001 2020-11-12T17:27:25.447 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.448 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.449 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36811 5.2 e149/127 5:41bffcca:::benchmark_data_smithi036_24110_object4601:head v 149'2363, mlcod=149'2357)", 2020-11-12T17:27:25.450 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:25.431425+0000", 2020-11-12T17:27:25.450 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0054228669999999996, 2020-11-12T17:27:25.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054934459999999999, 2020-11-12T17:27:25.450 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.450 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.451 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.431425+0000", 2020-11-12T17:27:25.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.431425+0000", 2020-11-12T17:27:25.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:25.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.431400+0000", 2020-11-12T17:27:25.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5597e-05 2020-11-12T17:27:25.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.431496+0000", 2020-11-12T17:27:25.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002242604 2020-11-12T17:27:25.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.433738+0000", 2020-11-12T17:27:25.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0779999999999997e-06 2020-11-12T17:27:25.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.433742+0000", 2020-11-12T17:27:25.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5287000000000003e-05 2020-11-12T17:27:25.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.433777+0000", 2020-11-12T17:27:25.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4199e-05 2020-11-12T17:27:25.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.433802+0000", 2020-11-12T17:27:25.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023769970000000001 2020-11-12T17:27:25.458 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.459 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.459 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.460 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36812 5.2 e149/127 5:41bffcca:::benchmark_data_smithi036_24110_object4601:head v 149'2364, mlcod=149'2357)", 2020-11-12T17:27:25.460 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:25.432707+0000", 2020-11-12T17:27:25.460 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0041403380000000004, 2020-11-12T17:27:25.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042690619999999997, 2020-11-12T17:27:25.461 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.461 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.461 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.432707+0000", 2020-11-12T17:27:25.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.432707+0000", 2020-11-12T17:27:25.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:27:25.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.432694+0000", 2020-11-12T17:27:25.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7148999999999998e-05 2020-11-12T17:27:25.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.432751+0000", 2020-11-12T17:27:25.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002835176 2020-11-12T17:27:25.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435586+0000", 2020-11-12T17:27:25.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3669999999999999e-06 2020-11-12T17:27:25.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435590+0000", 2020-11-12T17:27:25.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7265999999999999e-05 2020-11-12T17:27:25.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435628+0000", 2020-11-12T17:27:25.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3233e-05 2020-11-12T17:27:25.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435641+0000", 2020-11-12T17:27:25.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029336399999999999 2020-11-12T17:27:25.469 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.470 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.470 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.471 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36813 5.2 e149/127 5:41bffcca:::benchmark_data_smithi036_24110_object4601:head v 149'2365, mlcod=149'2357)", 2020-11-12T17:27:25.471 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:25.433694+0000", 2020-11-12T17:27:25.471 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0031535040000000001, 2020-11-12T17:27:25.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003349968, 2020-11-12T17:27:25.472 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.472 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.472 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.433694+0000", 2020-11-12T17:27:25.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.433694+0000", 2020-11-12T17:27:25.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999876 2020-11-12T17:27:25.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.433681+0000", 2020-11-12T17:27:25.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3551999999999999e-05 2020-11-12T17:27:25.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.433725+0000", 2020-11-12T17:27:25.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002039646 2020-11-12T17:27:25.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435765+0000", 2020-11-12T17:27:25.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5389999999999999e-06 2020-11-12T17:27:25.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435768+0000", 2020-11-12T17:27:25.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00051122099999999996 2020-11-12T17:27:25.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.436279+0000", 2020-11-12T17:27:25.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6609999999999999e-05 2020-11-12T17:27:25.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.436296+0000", 2020-11-12T17:27:25.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002601987 2020-11-12T17:27:25.481 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.481 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.482 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.482 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36814 5.2 e149/127)", 2020-11-12T17:27:25.483 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:25.435518+0000", 2020-11-12T17:27:25.483 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0013294509999999999, 2020-11-12T17:27:25.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015628619999999999, 2020-11-12T17:27:25.484 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.484 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:25.485 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435518+0000", 2020-11-12T17:27:25.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435518+0000", 2020-11-12T17:27:25.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:27:25.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435495+0000", 2020-11-12T17:27:25.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0615000000000002e-05 2020-11-12T17:27:25.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.435555+0000", 2020-11-12T17:27:25.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013720119999999999 2020-11-12T17:27:25.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.436927+0000", 2020-11-12T17:27:25.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4139999999999996e-06 2020-11-12T17:27:25.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.436932+0000", 2020-11-12T17:27:25.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014137570000000001 2020-11-12T17:27:25.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.493 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.495 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36809 5.2 e149/127 5:41bffcca:::benchmark_data_smithi036_24110_object4601:head v 149'2361, mlcod=149'2357)", 2020-11-12T17:27:25.495 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:25.428624+0000", 2020-11-12T17:27:25.495 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0082240330000000004, 2020-11-12T17:27:25.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084903510000000001, 2020-11-12T17:27:25.496 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:25.496 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:25.496 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:25.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:25.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.428624+0000", 2020-11-12T17:27:25.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:25.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:25.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.428624+0000", 2020-11-12T17:27:25.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:25.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:25.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.428596+0000", 2020-11-12T17:27:25.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5958000000000005e-05 2020-11-12T17:27:25.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:25.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.428692+0000", 2020-11-12T17:27:25.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028323810000000001 2020-11-12T17:27:25.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:25.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.431525+0000", 2020-11-12T17:27:25.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2169999999999994e-06 2020-11-12T17:27:25.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:25.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.431533+0000", 2020-11-12T17:27:25.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1247e-05 2020-11-12T17:27:25.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:25.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.431574+0000", 2020-11-12T17:27:25.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6171000000000002e-05 2020-11-12T17:27:25.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:25.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:25.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:25.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:25.431590+0000", 2020-11-12T17:27:25.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029667119999999998 2020-11-12T17:27:25.507 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.507 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:25.508 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.508 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:25.508 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:25.509 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 6 2020-11-12T17:27:25.509 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:25.511 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:25.511 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:25.512 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:25.508+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:25.512 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:25.516 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:25.546 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:25.558 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 39 16 36940 36924 7.39583 6.85156 0.0412255 0.0168865 2020-11-12T17:27:25.578 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:25.612 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:25.612 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:25.608+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:25.634 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:25.634 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:25.637 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:25.648 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:25.668 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:25.671 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:25.671 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:25.672 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:25.672 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:25.672 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:25.672 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:25.672 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:25.672 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:25.712 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:25.710+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:25.771 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:25.771 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:25.782 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:25.785 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:27:25.828 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:25.826+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:25.914 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:25.910+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:25.956 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:25.957 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:25.970 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:26.015 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:26.012+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:26.116 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:26.114+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:26.144 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:26.144 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:26.156 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:26.243 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:26.242+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:26.318 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:26.314+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:26.322 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:26.322 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:26.335 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:26.424 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:26.422+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:26.514 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:26.515 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:26.519 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:26.518+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:26.528 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:26.537 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:26.538 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:26.538 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.000000 2020-11-12T17:27:26.539 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd primary-affinity 7 0 2020-11-12T17:27:26.558 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:27:26.559385+0000 min lat: 0.00209322 max lat: 2.20267 avg lat: 0.0168722 2020-11-12T17:27:26.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:27:26.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 40 16 37933 37917 7.40486 7.75781 0.0163073 0.0168722 2020-11-12T17:27:26.620 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:26.616+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:26.690 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:26.691 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:26.701 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:26.747 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:26.746+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:26.792 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:27:26.822 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:26.818+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:26.825 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:26.825 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:26.839 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:26.924 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:26.918+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:26.960 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:26.960 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:26.973 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:27.023 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:27.022+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:27.096 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:27.097 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:27.107 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:27.151 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:27.148+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:27.225 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:27.220+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:27.235 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:27.236 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:27.245 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:27.325 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:27.322+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:27.415 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:27.416 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:27.427 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:27.427 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:27.420+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:27.527 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:27.526+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:27.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 41 16 38867 38851 7.40221 7.29688 0.0150051 0.0168696 2020-11-12T17:27:27.589 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:27.590 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:27.600 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:27.629 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:27.626+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:27.685 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:27.731 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:27.728+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:27.784 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:27.785 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:27.785 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:27.798 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:27.794+0000 7f2809aaf700 -1 osd.6 150 handle_osd_map injecting map crc failure 2020-11-12T17:27:27.802 INFO:teuthology.orchestra.run.smithi036.stderr:set osd.7 primary-affinity to 0 (802) 2020-11-12T17:27:27.860 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:27.861 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:27.856+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:27.887 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:27.913 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:27.917 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:27.917 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:27.917 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:27.918 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:27.927 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:27.938 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:27.938 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:27.932+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:27.968 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:27.998 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:28.033 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:28.034 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:28.030+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:28.040 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:28.041 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:28.041 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:28.041 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:28.041 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:28.057 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:28.064 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:28.066 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:28.067 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:28.067 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:28.067 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:28.067 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:28.068 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:28.068 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:28.069 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:28.134 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:28.130+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:28.177 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:28.177 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:28.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:28.178 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:28.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.178 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:28.179 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:28.179 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 263.06472830600001, 2020-11-12T17:27:28.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:28.179 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.179 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.180 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.180 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:28.180 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:28.180 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:28.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.181 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:28.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:28.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:28.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:28.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:28.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:28.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:28.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:28.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:28.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:28.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:28.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:28.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:28.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:28.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:28.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:28.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:28.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:28.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:28.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:28.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:28.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:28.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:28.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:28.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:28.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:28.190 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.190 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.191 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.191 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:28.191 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:28.191 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 263.05763651000001, 2020-11-12T17:27:28.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:28.192 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.192 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.192 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:28.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:28.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:28.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:28.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:28.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:28.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:28.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:28.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:28.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:28.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:28.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:28.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:28.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:28.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:28.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:28.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:28.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.199 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.199 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:28.199 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:28.199 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 253.62507701300001, 2020-11-12T17:27:28.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:28.200 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.200 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:28.200 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:28.200 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:28.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.201 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:28.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:28.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:28.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:28.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:28.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:28.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:28.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:28.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:28.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:28.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:28.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:28.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:28.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:28.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:28.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:28.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:28.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:28.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:28.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:28.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:28.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:28.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:28.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:28.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:28.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:28.219 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.219 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.219 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.220 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:28.220 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:28.220 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 219.67495691900001, 2020-11-12T17:27:28.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:28.220 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.220 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.221 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:28.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:28.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:28.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:28.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:28.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:28.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:28.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:28.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:28.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:28.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:28.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:28.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:28.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:28.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:28.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:28.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:28.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.227 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.228 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:28.228 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:28.228 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 217.569355027, 2020-11-12T17:27:28.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:28.228 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.228 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.228 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:28.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:28.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:28.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:28.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:28.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:28.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:28.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:28.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:28.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:28.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:28.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:28.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:28.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:28.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:28.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:28.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:28.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:28.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:28.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.235 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.236 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:28.236 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:28.236 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 186.222871693, 2020-11-12T17:27:28.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:28.236 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.237 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.237 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.237 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:28.237 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:28.237 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:28.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.237 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:28.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:28.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:28.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:28.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:28.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:28.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:28.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:28.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:28.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:28.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:28.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:28.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:28.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:28.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:28.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:28.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:28.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:28.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:28.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:28.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:28.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:28.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:28.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:28.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:28.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:28.247 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.247 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.247 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.247 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:28.248 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:28.248 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 177.227029891, 2020-11-12T17:27:28.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:28.248 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.248 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.248 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:28.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:28.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:28.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:28.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:28.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:28.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:28.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:28.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:28.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:28.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:28.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:28.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:28.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:28.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:28.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:28.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:28.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.254 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.255 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:28.255 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:28.255 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 173.29192649199999, 2020-11-12T17:27:28.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:28.255 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.256 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:28.256 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:28.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:28.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:28.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:28.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:28.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:28.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:28.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:28.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:28.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:28.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:28.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:28.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:28.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:28.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:28.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.261 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.262 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:28.262 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:28.262 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.52728600099999, 2020-11-12T17:27:28.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:28.262 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.262 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.262 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:28.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:28.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:28.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:28.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:28.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:28.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:28.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:28.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:28.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:28.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:28.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:28.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:28.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:28.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:28.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:28.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:28.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.269 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.269 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:28.269 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:28.269 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 136.27077731700001, 2020-11-12T17:27:28.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:28.270 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.270 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.270 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.270 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.270 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.270 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:28.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.271 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:28.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:28.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:28.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:28.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:28.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:28.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:28.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:28.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:28.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:28.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:28.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:28.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:28.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:28.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:28.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:28.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:28.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:28.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:28.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:28.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:28.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:28.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:28.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:28.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:28.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:28.279 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.279 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.280 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:28.280 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:28.280 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 136.27061494700001, 2020-11-12T17:27:28.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:28.280 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.281 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.281 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.281 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.281 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.281 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:28.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.281 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:28.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:28.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:28.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:28.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:28.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:28.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:28.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:28.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:28.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:28.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:28.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:28.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:28.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:28.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:28.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:28.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:28.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:28.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:28.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:28.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:28.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:28.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:28.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:28.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:28.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:28.290 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.290 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.290 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.291 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:28.291 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:28.291 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 136.26204595999999, 2020-11-12T17:27:28.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:28.291 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.291 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.292 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:28.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:28.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:28.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:28.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:28.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:28.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:28.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:28.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:28.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:28.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:28.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:28.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:28.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:28.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:28.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:28.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:28.298 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.298 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.298 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.298 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:28.298 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:28.299 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.75753351, 2020-11-12T17:27:28.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:28.299 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.299 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.299 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.299 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.299 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.300 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:28.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.300 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:28.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:28.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:28.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:28.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:28.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:28.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:28.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:28.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:28.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:28.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:28.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:28.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:28.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:28.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:28.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:28.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:28.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:28.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:28.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:28.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:28.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:28.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:28.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:28.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:28.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:28.308 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.309 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.309 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.309 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:28.309 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:28.309 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.27198522400001, 2020-11-12T17:27:28.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:28.310 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.310 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.310 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.310 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.310 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.310 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:28.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.311 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:28.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.198666792, 2020-11-12T17:27:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 106.143021816, 2020-11-12T17:27:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.754817445, 2020-11-12T17:27:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 91.548360513000006, 2020-11-12T17:27:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.299154896000005, 2020-11-12T17:27:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.282195447000007, 2020-11-12T17:27:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.379 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:28.381 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:28.381 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:28.376+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:28.483 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:28.480+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:28.496 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:28.497 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:28.497 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:28.497 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:28.507 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:28.558 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 42 16 39207 39191 7.28921 2.65625 0.152899 0.0168613 2020-11-12T17:27:28.584 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:28.580+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:28.657 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:28.691 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:28.692 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:28.692 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:28.692 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:28.693 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:28.694 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:28.690+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:28.795 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:28.790+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:28.805 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:27:28.889 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:28.889 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:28.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:28.890 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:28.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.890 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:28.890 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:28.890 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 254.46864881400001, 2020-11-12T17:27:28.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:28.891 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.891 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.891 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.891 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:28.891 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:28.891 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:28.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.892 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:28.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:28.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:28.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:28.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:28.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:28.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:28.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:28.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:28.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:28.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:28.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:28.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:28.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:28.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:28.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:28.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:28.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:28.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:28.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:28.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.901 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.901 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:28.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:28.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:28.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:28.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:28.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:28.903 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.903 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.903 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.903 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:28.903 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:28.904 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 254.461704752, 2020-11-12T17:27:28.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:28.904 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.904 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.904 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:28.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:28.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:28.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:28.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:28.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:28.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:28.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:28.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:28.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:28.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:28.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:28.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:28.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:28.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:28.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:28.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:28.911 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.911 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.912 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.912 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:28.912 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:28.912 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 218.287866966, 2020-11-12T17:27:28.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:28.913 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.913 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:28.913 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:28.913 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:28.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.913 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:28.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:28.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:28.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:28.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:28.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:28.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:28.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:28.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:28.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:28.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:28.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:28.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:28.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:28.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:28.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:28.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:28.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:28.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:28.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:28.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:28.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:27:28.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:27:28.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:27:28.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:27:28.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:27:28.923 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.923 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.923 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.924 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:27:28.924 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:28.924 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 202.024161873, 2020-11-12T17:27:28.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:27:28.924 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.924 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.924 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.925 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:28.925 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:28.925 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:27:28.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.925 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:28.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:28.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:28.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:27:28.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:27:28.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:27:28.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:27:28.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:27:28.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:27:28.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.929 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:27:28.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:27:28.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.930 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:27:28.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:27:28.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:27:28.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:27:28.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:28.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:27:28.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:27:28.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:27:28.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:27:28.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:27:28.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:27:28.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:27:28.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:27:28.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:27:28.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:27:28.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.938 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.938 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:27:28.938 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:28.939 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 186.93878154699999, 2020-11-12T17:27:28.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:27:28.939 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.939 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.939 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:28.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:28.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:28.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:27:28.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:27:28.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:27:28.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:27:28.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:27:28.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:27:28.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:27:28.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:27:28.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:27:28.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:27:28.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:27:28.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:27:28.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:27:28.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:27:28.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:27:28.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:27:28.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.948 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.948 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:27:28.948 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:28.949 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 185.24464327300001, 2020-11-12T17:27:28.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:27:28.949 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.949 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:28.949 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:28.950 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:27:28.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.950 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:28.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:28.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:28.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:27:28.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:27:28.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:27:28.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:27:28.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:27:28.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:27:28.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:27:28.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:27:28.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:27:28.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:27:28.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:27:28.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:27:28.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:28.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:27:28.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:27:28.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:27:28.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:27:28.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:27:28.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:27:28.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:27:28.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:27:28.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:27:28.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:27:28.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.959 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.960 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.960 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:27:28.960 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:28.960 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 127.57540455100001, 2020-11-12T17:27:28.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:27:28.961 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.961 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.961 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.961 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.961 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.961 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:27:28.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.961 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:28.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:28.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:28.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:27:28.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:27:28.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:27:28.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:27:28.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:27:28.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:27:28.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:27:28.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:27:28.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:27:28.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:27:28.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:27:28.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:27:28.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:28.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:27:28.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:27:28.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:27:28.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:27:28.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:27:28.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:27:28.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:27:28.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:27:28.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:27:28.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:27:28.971 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.971 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.971 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.972 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:27:28.972 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:28.972 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 127.562227792, 2020-11-12T17:27:28.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:27:28.972 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.973 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.973 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:28.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:28.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:28.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:27:28.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:27:28.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:27:28.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:27:28.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:27:28.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:27:28.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:27:28.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:27:28.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:27:28.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:27:28.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:27:28.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:27:28.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:27:28.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:27:28.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.980 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.980 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:27:28.980 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:28.981 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 123.00814634300001, 2020-11-12T17:27:28.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:27:28.981 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.981 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:28.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:28.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:28.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:28.981 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:27:28.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.982 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:28.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:28.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:27:28.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:27:28.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:27:28.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:28.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:27:28.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:27:28.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:28.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:27:28.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:27:28.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:28.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:27:28.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:27:28.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:28.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:27:28.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:27:28.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:28.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:27:28.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:27:28.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:28.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:27:28.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:27:28.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:28.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:27:28.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:27:28.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:28.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:27:28.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:27:28.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:28.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:27:28.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:27:28.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:28.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:27:28.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:27:28.995 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.995 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:28.996 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:28.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.996 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:27:28.996 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:28.996 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.999159037, 2020-11-12T17:27:28.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:27:28.997 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:28.997 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:28.997 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:28.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:28.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:28.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:28.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:28.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:28.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:28.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:28.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:28.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:28.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:27:28.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:27:28.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:27:29.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:27:29.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:27:29.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:27:29.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:27:29.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:27:29.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:27:29.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:27:29.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:27:29.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:27:29.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:27:29.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:27:29.003 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.004 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.004 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:27:29.004 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:29.004 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.98123172299999, 2020-11-12T17:27:29.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:27:29.005 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.005 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.005 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:29.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:29.006 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.006 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:27:29.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.006 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:29.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:29.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:29.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:27:29.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:27:29.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:27:29.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:27:29.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:27:29.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:27:29.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:27:29.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:27:29.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:27:29.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:27:29.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:27:29.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:27:29.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:29.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:27:29.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:27:29.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:29.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:27:29.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:27:29.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:27:29.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:27:29.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:27:29.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:27:29.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:27:29.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:27:29.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.041 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.041 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.041 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:29.041 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:29.041 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.178792825, 2020-11-12T17:27:29.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:27:29.042 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.042 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:29.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:29.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.042 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:27:29.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.043 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:29.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:29.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:29.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:27:29.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:27:29.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:27:29.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:27:29.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:27:29.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:27:29.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:27:29.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:27:29.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:27:29.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:27:29.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:27:29.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:27:29.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:29.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:27:29.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:27:29.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:29.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:27:29.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:27:29.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:27:29.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:27:29.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:27:29.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:27:29.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:27:29.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:27:29.051 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.051 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.052 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.052 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:29.052 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:29.052 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.099670508, 2020-11-12T17:27:29.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:27:29.052 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.053 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.053 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:29.053 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:29.053 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.053 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:27:29.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.053 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:29.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:29.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:29.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:27:29.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:27:29.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:27:29.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:27:29.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:27:29.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:27:29.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:27:29.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:27:29.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:27:29.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:27:29.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:27:29.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:27:29.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:29.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:27:29.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:27:29.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:29.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:27:29.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:27:29.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:27:29.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:27:29.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:27:29.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:27:29.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:27:29.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:27:29.062 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.062 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.062 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.063 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:27:29.063 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:29.063 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 87.317319541000003, 2020-11-12T17:27:29.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:27:29.063 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.063 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.064 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:29.064 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:29.064 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.064 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:27:29.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.064 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:29.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:29.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:27:29.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:27:29.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:27:29.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:27:29.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:27:29.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:27:29.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:27:29.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:27:29.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:27:29.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:27:29.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:27:29.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:27:29.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:27:29.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:29.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:27:29.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:27:29.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:29.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:27:29.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:27:29.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:27:29.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:27:29.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:27:29.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:27:29.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:27:29.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:27:29.073 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.073 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.073 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.073 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:27:29.074 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:29.074 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 71.854277191999998, 2020-11-12T17:27:29.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:27:29.074 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.074 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.074 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:29.074 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:29.075 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.075 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:27:29.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.075 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:29.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:29.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:27:29.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:27:29.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:27:29.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:27:29.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:27:29.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:27:29.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:27:29.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:27:29.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:27:29.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:27:29.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:27:29.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:27:29.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:27:29.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:29.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:27:29.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:27:29.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:29.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:27:29.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:27:29.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:27:29.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:27:29.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:27:29.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:27:29.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:27:29.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:27:29.088 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.088 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.088 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.089 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:29.089 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:29.089 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.832518041, 2020-11-12T17:27:29.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:27:29.090 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.090 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:29.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:29.090 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:29.090 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:27:29.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.091 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:29.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:29.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:29.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:27:29.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:27:29.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:27:29.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:27:29.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:27:29.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:27:29.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:27:29.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:27:29.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:27:29.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:27:29.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:27:29.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:27:29.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:29.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:27:29.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:27:29.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:29.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:27:29.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:27:29.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:27:29.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:27:29.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:27:29.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:27:29.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:27:29.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:27:29.100 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.100 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.100 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.101 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35048 5.1 e148/127 5:8e34dcfa:::benchmark_data_smithi036_24110_object4380:head v 148'2280, mlcod=148'2275)", 2020-11-12T17:27:29.101 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:29.101 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.527579222, 2020-11-12T17:27:29.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002, 2020-11-12T17:27:29.101 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.101 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.101 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:29.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:29.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:29.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359524+0000", 2020-11-12T17:27:29.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.064e-05 2020-11-12T17:27:29.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359605+0000", 2020-11-12T17:27:29.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34493079599999998 2020-11-12T17:27:29.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704536+0000", 2020-11-12T17:27:29.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2110000000000001e-06 2020-11-12T17:27:29.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704543+0000", 2020-11-12T17:27:29.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1071999999999998e-05 2020-11-12T17:27:29.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704634+0000", 2020-11-12T17:27:29.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2281999999999998e-05 2020-11-12T17:27:29.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704696+0000", 2020-11-12T17:27:29.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034977459999999999 2020-11-12T17:27:29.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708194+0000", 2020-11-12T17:27:29.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1390000000000006e-05 2020-11-12T17:27:29.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708265+0000", 2020-11-12T17:27:29.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002 2020-11-12T17:27:29.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.108 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.109 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35144 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:29.109 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:29.109 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.3199733240000002, 2020-11-12T17:27:29.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998, 2020-11-12T17:27:29.109 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.109 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.110 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:29.110 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:29.110 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:29.110 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35144 2020-11-12T17:27:29.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.110 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:29.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:29.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:29.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567086+0000", 2020-11-12T17:27:29.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017142700000000001 2020-11-12T17:27:29.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567257+0000", 2020-11-12T17:27:29.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1043000000000002e-05 2020-11-12T17:27:29.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567278+0000", 2020-11-12T17:27:29.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1214e-05 2020-11-12T17:27:29.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567289+0000", 2020-11-12T17:27:29.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142698779 2020-11-12T17:27:29.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.709988+0000", 2020-11-12T17:27:29.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4704999999999995e-05 2020-11-12T17:27:29.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710083+0000", 2020-11-12T17:27:29.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016350300000000001 2020-11-12T17:27:29.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:29.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710246+0000", 2020-11-12T17:27:29.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002268946 2020-11-12T17:27:29.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:29.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.712515+0000", 2020-11-12T17:27:29.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199261574 2020-11-12T17:27:29.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911777+0000", 2020-11-12T17:27:29.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0816999999999996e-05 2020-11-12T17:27:29.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911858+0000", 2020-11-12T17:27:29.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2182000000000003e-05 2020-11-12T17:27:29.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911910+0000", 2020-11-12T17:27:29.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998 2020-11-12T17:27:29.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.119 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.120 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:29.120 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:29.120 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.7711583710000003, 2020-11-12T17:27:29.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:27:29.120 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.120 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.120 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:29.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:29.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:29.121 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:27:29.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.121 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:29.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:29.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:29.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:27:29.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:27:29.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:27:29.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:27:29.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:27:29.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:27:29.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:27:29.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:27:29.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:27:29.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:27:29.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:27:29.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:27:29.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:29.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:27:29.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:27:29.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:29.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:27:29.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:27:29.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:27:29.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:27:29.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:27:29.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:27:29.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:27:29.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:27:29.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.130 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.131 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36416 5.0 5:05125f34:::benchmark_data_smithi036_24110_object4551:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:29.131 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:29.131 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.9134303460000002, 2020-11-12T17:27:29.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002, 2020-11-12T17:27:29.131 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:29.131 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.131 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:29.132 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:29.132 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:29.132 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36416 2020-11-12T17:27:29.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.132 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:29.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:29.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:29.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:29.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:29.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:29.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:27:29.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:29.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973666+0000", 2020-11-12T17:27:29.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117633 2020-11-12T17:27:29.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:29.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973783+0000", 2020-11-12T17:27:29.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6325999999999999e-05 2020-11-12T17:27:29.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:29.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973800+0000", 2020-11-12T17:27:29.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:27:29.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973807+0000", 2020-11-12T17:27:29.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054509620000000002 2020-11-12T17:27:29.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:29.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979258+0000", 2020-11-12T17:27:29.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1768999999999996e-05 2020-11-12T17:27:29.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:29.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979340+0000", 2020-11-12T17:27:29.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107278 2020-11-12T17:27:29.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:29.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979447+0000", 2020-11-12T17:27:29.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005025753 2020-11-12T17:27:29.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:29.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.984473+0000", 2020-11-12T17:27:29.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35634463199999999 2020-11-12T17:27:29.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340818+0000", 2020-11-12T17:27:29.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3640000000000001e-05 2020-11-12T17:27:29.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:29.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340871+0000", 2020-11-12T17:27:29.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2222999999999998e-05 2020-11-12T17:27:29.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:29.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:29.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:29.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340924+0000", 2020-11-12T17:27:29.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002 2020-11-12T17:27:29.141 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.141 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.141 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.141 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:29.141 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:29.141 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:29.143 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:29.143 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:29.140+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:29.243 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:29.242+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:29.259 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:29.259 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:29.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.259 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:39632 5.1 5:893aa491:::benchmark_data_smithi036_24110_object4953:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e152)", 2020-11-12T17:27:29.260 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:29.193181+0000", 2020-11-12T17:27:29.260 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.066623208000000003, 2020-11-12T17:27:29.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.066668403000000001, 2020-11-12T17:27:29.260 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.260 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:29.260 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.260 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:29.261 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:29.261 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39632 2020-11-12T17:27:29.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.262 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.193181+0000", 2020-11-12T17:27:29.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.193181+0000", 2020-11-12T17:27:29.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:29.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.193147+0000", 2020-11-12T17:27:29.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7108999999999995e-05 2020-11-12T17:27:29.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.193244+0000", 2020-11-12T17:27:29.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3093e-05 2020-11-12T17:27:29.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.193258+0000", 2020-11-12T17:27:29.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5349999999999999e-06 2020-11-12T17:27:29.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.193265+0000", 2020-11-12T17:27:29.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064287989999999998 2020-11-12T17:27:29.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.199694+0000", 2020-11-12T17:27:29.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000102872 2020-11-12T17:27:29.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.199797+0000", 2020-11-12T17:27:29.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016146199999999999 2020-11-12T17:27:29.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:29.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.199958+0000", 2020-11-12T17:27:29.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016915910000000001 2020-11-12T17:27:29.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.201650+0000", 2020-11-12T17:27:29.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084687749999999996 2020-11-12T17:27:29.268 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.268 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.269 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.269 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:39691 5.5 e152/139 5:a2b3a2ce:::benchmark_data_smithi036_24110_object4961:head v 152'2355, mlcod=152'2351)", 2020-11-12T17:27:29.269 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:29.254996+0000", 2020-11-12T17:27:29.269 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0048081039999999997, 2020-11-12T17:27:29.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0049856659999999997, 2020-11-12T17:27:29.269 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.270 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.270 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.254996+0000", 2020-11-12T17:27:29.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.254996+0000", 2020-11-12T17:27:29.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:29.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.254973+0000", 2020-11-12T17:27:29.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5819000000000001e-05 2020-11-12T17:27:29.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.255039+0000", 2020-11-12T17:27:29.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5741000000000001e-05 2020-11-12T17:27:29.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.255085+0000", 2020-11-12T17:27:29.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1630000000000004e-06 2020-11-12T17:27:29.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.255090+0000", 2020-11-12T17:27:29.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9116000000000001e-05 2020-11-12T17:27:29.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.255149+0000", 2020-11-12T17:27:29.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6747999999999999e-05 2020-11-12T17:27:29.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.255176+0000", 2020-11-12T17:27:29.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000179748 2020-11-12T17:27:29.275 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.275 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.275 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.276 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:39692 5.5 e152/139 5:a2b3a2ce:::benchmark_data_smithi036_24110_object4961:head v 152'2356, mlcod=152'2351)", 2020-11-12T17:27:29.276 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:29.256579+0000", 2020-11-12T17:27:29.276 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0032250109999999999, 2020-11-12T17:27:29.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034649070000000001, 2020-11-12T17:27:29.276 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.276 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.277 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.256579+0000", 2020-11-12T17:27:29.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.256579+0000", 2020-11-12T17:27:29.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:29.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.256562+0000", 2020-11-12T17:27:29.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9459000000000001e-05 2020-11-12T17:27:29.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.256621+0000", 2020-11-12T17:27:29.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7251000000000001e-05 2020-11-12T17:27:29.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.256639+0000", 2020-11-12T17:27:29.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9612000000000001e-05 2020-11-12T17:27:29.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.256658+0000", 2020-11-12T17:27:29.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1888999999999998e-05 2020-11-12T17:27:29.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.256700+0000", 2020-11-12T17:27:29.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0931999999999999e-05 2020-11-12T17:27:29.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.256721+0000", 2020-11-12T17:27:29.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014183699999999999 2020-11-12T17:27:29.282 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.282 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.282 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.283 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:39693 5.5 e152/139)", 2020-11-12T17:27:29.283 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:29.258177+0000", 2020-11-12T17:27:29.283 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0016268630000000001, 2020-11-12T17:27:29.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019374889999999999, 2020-11-12T17:27:29.283 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.283 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:29.283 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.258177+0000", 2020-11-12T17:27:29.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.258177+0000", 2020-11-12T17:27:29.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:29.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.258153+0000", 2020-11-12T17:27:29.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7232999999999996e-05 2020-11-12T17:27:29.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.258241+0000", 2020-11-12T17:27:29.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0041999999999999e-05 2020-11-12T17:27:29.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.258261+0000", 2020-11-12T17:27:29.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8359999999999997e-06 2020-11-12T17:27:29.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.258266+0000", 2020-11-12T17:27:29.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9059000000000002e-05 2020-11-12T17:27:29.287 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.287 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.288 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:39694 5.5 e152/139)", 2020-11-12T17:27:29.288 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:29.259374+0000", 2020-11-12T17:27:29.288 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00043057799999999998, 2020-11-12T17:27:29.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00083196599999999996, 2020-11-12T17:27:29.289 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.289 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:29.289 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.259374+0000", 2020-11-12T17:27:29.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.259374+0000", 2020-11-12T17:27:29.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:29.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.259356+0000", 2020-11-12T17:27:29.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1766999999999993e-05 2020-11-12T17:27:29.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.259418+0000", 2020-11-12T17:27:29.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9202e-05 2020-11-12T17:27:29.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.259437+0000", 2020-11-12T17:27:29.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1999999999999997e-06 2020-11-12T17:27:29.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.259444+0000", 2020-11-12T17:27:29.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0291999999999997e-05 2020-11-12T17:27:29.294 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.294 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.294 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.294 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.294 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:29.294 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 5 2020-11-12T17:27:29.294 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:29.296 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:29.346 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:29.342+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:29.447 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:29.442+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:29.481 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:29.481 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:29.482 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:29.482 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:29.482 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:29.495 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:29.551 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:29.548+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:29.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 43 16 40024 40008 7.26811 6.38281 0.0111757 0.0171863 2020-11-12T17:27:29.649 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:29.646+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:29.675 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:29.676 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:29.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:29.677 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:27:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 258.985149885, 2020-11-12T17:27:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:27:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:27:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:27:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:27:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:27:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:27:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:27:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:27:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:27:29.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:27:29.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:27:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:27:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:27:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:27:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:27:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:27:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:27:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:27:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:27:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:27:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:27:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:27:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:27:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:27:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:27:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 258.97966981600001, 2020-11-12T17:27:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:27:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:27:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:27:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:27:29.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:27:29.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:27:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:27:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:27:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:27:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:27:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:27:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:27:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:27:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:27:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:27:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:27:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 250.78954821599999, 2020-11-12T17:27:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:27:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:27:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:29.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:27:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:27:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:27:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:27:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:27:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:27:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:27:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:27:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:27:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:27:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:27:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:27:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:27:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:27:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:27:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:27:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:27:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:27:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:27:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:27:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:27:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:27:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:27:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:27:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 250.78230450699999, 2020-11-12T17:27:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:27:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:27:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:27:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:27:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:27:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:27:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:27:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:27:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:27:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:27:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:27:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:27:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:27:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:27:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:27:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 174.78621513300001, 2020-11-12T17:27:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:27:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:27:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:27:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:27:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:27:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:27:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:27:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:27:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:27:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:27:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:27:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:27:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:27:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:27:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:27:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:27:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:27:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 108.658692621, 2020-11-12T17:27:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:27:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:27:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:27:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:27:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:27:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:27:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:27:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:27:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:27:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:27:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:27:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:27:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:27:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:27:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:27:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.60962596, 2020-11-12T17:27:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:27:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:27:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:27:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:27:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:27:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:27:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:27:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:27:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:27:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:27:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:27:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:27:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:27:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:27:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:27:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:27:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:27:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:27:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:27:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:27:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:27:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:27:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:27:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:27:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:27:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.60794518, 2020-11-12T17:27:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:27:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:27:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:27:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:27:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:27:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:27:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:27:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:27:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:27:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:27:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:27:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:27:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:27:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:27:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:27:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:27:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:27:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:27:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:27:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:27:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:27:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:27:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:27:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:27:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.607856985, 2020-11-12T17:27:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:27:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:27:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:27:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:27:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:27:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:27:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:27:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:27:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:27:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:27:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:27:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:27:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:27:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:27:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:27:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:27:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:27:29.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:27:29.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:27:29.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:27:29.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:27:29.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:27:29.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:27:29.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:27:29.795 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.795 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.795 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.796 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:29.796 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:29.796 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.58936167, 2020-11-12T17:27:29.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:27:29.796 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.796 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.796 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:29.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:29.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:29.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:27:29.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:27:29.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:27:29.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:27:29.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:27:29.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:27:29.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:27:29.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:27:29.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:27:29.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:27:29.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:27:29.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:27:29.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:27:29.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:27:29.803 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.803 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.803 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.803 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:29.803 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:29.803 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.58922868000001, 2020-11-12T17:27:29.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:27:29.804 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.804 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.804 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:29.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:29.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:29.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:27:29.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:27:29.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:27:29.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:27:29.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:27:29.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:27:29.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:27:29.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:27:29.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:27:29.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:27:29.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:27:29.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:27:29.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:27:29.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:27:29.811 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.811 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.811 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.811 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:29.811 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:29.812 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.589143952, 2020-11-12T17:27:29.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:27:29.812 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.812 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.812 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:29.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:29.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:29.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:27:29.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:27:29.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:27:29.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:27:29.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:27:29.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:27:29.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:27:29.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:27:29.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:27:29.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:27:29.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:27:29.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:27:29.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:27:29.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:27:29.818 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.818 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.818 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.819 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:29.819 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:29.819 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.838321500999996, 2020-11-12T17:27:29.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:27:29.819 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.820 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:29.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.820 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:27:29.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.820 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:29.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:29.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:29.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:27:29.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:27:29.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:27:29.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:27:29.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:27:29.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:27:29.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:27:29.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:27:29.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:27:29.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:27:29.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:27:29.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:27:29.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:29.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:27:29.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:27:29.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:27:29.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:27:29.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:27:29.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:27:29.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:27:29.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:27:29.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:27:29.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:27:29.830 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.830 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.830 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.831 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:29.831 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:29.831 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.751666013000005, 2020-11-12T17:27:29.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:27:29.831 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.831 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:29.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:29.832 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:27:29.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.832 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:29.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:29.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:29.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:27:29.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:27:29.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:27:29.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:27:29.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:27:29.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:27:29.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:27:29.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:27:29.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:27:29.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:27:29.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:27:29.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:27:29.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:29.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:27:29.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:27:29.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:27:29.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:27:29.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:27:29.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:27:29.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:27:29.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:27:29.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:27:29.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:27:29.841 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.841 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.841 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.842 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:27:29.842 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:29.842 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.738184786000005, 2020-11-12T17:27:29.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:27:29.842 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.842 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:29.843 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:29.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:29.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:29.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:27:29.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:27:29.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:27:29.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:27:29.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:27:29.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:27:29.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:27:29.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:27:29.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:27:29.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:27:29.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:27:29.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:27:29.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:27:29.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:27:29.849 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.849 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.849 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.849 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:29.849 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:29.850 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.735896584000002, 2020-11-12T17:27:29.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:27:29.850 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.850 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:29.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:29.850 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:27:29.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.851 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:29.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:29.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:29.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:27:29.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:27:29.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:27:29.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:27:29.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:27:29.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:27:29.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:27:29.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:27:29.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:27:29.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:27:29.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:27:29.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:27:29.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:29.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:27:29.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:27:29.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:27:29.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:27:29.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:27:29.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:27:29.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:27:29.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:27:29.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:27:29.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:27:29.860 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.860 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.860 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.860 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:29.860 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:29.861 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.730080000000001, 2020-11-12T17:27:29.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:27:29.861 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.861 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.861 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:29.861 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:29.861 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:29.862 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:27:29.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.862 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:29.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:29.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:29.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:27:29.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:27:29.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:27:29.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:27:29.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:27:29.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:27:29.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:27:29.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:27:29.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:27:29.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:27:29.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:27:29.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:27:29.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:29.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:27:29.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:27:29.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:29.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:27:29.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:27:29.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:29.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:27:29.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:27:29.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:27:29.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:27:29.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:27:29.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:27:29.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.871 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.872 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:27:29.872 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:29.872 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.707146485999999, 2020-11-12T17:27:29.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:27:29.872 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.872 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.873 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:29.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:29.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:29.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:27:29.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:27:29.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:27:29.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:27:29.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:27:29.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:27:29.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:27:29.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:27:29.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:27:29.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:27:29.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:27:29.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:27:29.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:27:29.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:27:29.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:27:29.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:27:29.880 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.880 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.880 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.880 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:27:29.880 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:29.880 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.174668458999999, 2020-11-12T17:27:29.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:27:29.881 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.881 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.881 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:29.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:29.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:29.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:27:29.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:27:29.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:27:29.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:27:29.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:27:29.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:27:29.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:27:29.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:27:29.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:27:29.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:27:29.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:27:29.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:27:29.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:27:29.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:27:29.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:27:29.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:27:29.888 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.888 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.888 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.889 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36040 5.a e149/127 5:5a4d50fb:::benchmark_data_smithi036_24110_object4504:head v 149'2328, mlcod=149'2321)", 2020-11-12T17:27:29.889 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:29.889 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.1358195579999997, 2020-11-12T17:27:29.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001, 2020-11-12T17:27:29.889 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:29.889 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:29.889 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:29.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:29.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:29.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:29.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:29.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:29.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:29.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:29.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536010+0000", 2020-11-12T17:27:29.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111983 2020-11-12T17:27:29.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:29.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536122+0000", 2020-11-12T17:27:29.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40432243400000001 2020-11-12T17:27:29.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:29.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940444+0000", 2020-11-12T17:27:29.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2870000000000001e-06 2020-11-12T17:27:29.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:29.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940450+0000", 2020-11-12T17:27:29.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4161999999999999e-05 2020-11-12T17:27:29.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:29.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940524+0000", 2020-11-12T17:27:29.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4454e-05 2020-11-12T17:27:29.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:29.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940549+0000", 2020-11-12T17:27:29.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021055879999999998 2020-11-12T17:27:29.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:29.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942654+0000", 2020-11-12T17:27:29.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5819000000000002e-05 2020-11-12T17:27:29.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:29.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:29.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:29.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942710+0000", 2020-11-12T17:27:29.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001 2020-11-12T17:27:29.901 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.901 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.901 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.901 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:29.901 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:29.901 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:29.903 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:27:29.904 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:29.904 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:29.846+0000 7f7b4fea9700 -1 osd.4 152 handle_osd_map injecting map crc failure 2020-11-12T17:27:29.905 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:29.900+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:30.004 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:30.002+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:30.073 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:30.073 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:30.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.074 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:40392 5.f 5:ffaafbdb:::benchmark_data_smithi036_24110_object5048:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e153)", 2020-11-12T17:27:30.074 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:29.949876+0000", 2020-11-12T17:27:30.074 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.124789161, 2020-11-12T17:27:30.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.124816628, 2020-11-12T17:27:30.074 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.075 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:30.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:30.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:30.075 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 40392 2020-11-12T17:27:30.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.075 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.949876+0000", 2020-11-12T17:27:30.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.949876+0000", 2020-11-12T17:27:30.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:30.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.949830+0000", 2020-11-12T17:27:30.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000128238 2020-11-12T17:27:30.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.949958+0000", 2020-11-12T17:27:30.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5786000000000001e-05 2020-11-12T17:27:30.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.949974+0000", 2020-11-12T17:27:30.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4800000000000004e-06 2020-11-12T17:27:30.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.949981+0000", 2020-11-12T17:27:30.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0099983620000000002 2020-11-12T17:27:30.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.959980+0000", 2020-11-12T17:27:30.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001126 2020-11-12T17:27:30.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.960092+0000", 2020-11-12T17:27:30.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018815800000000001 2020-11-12T17:27:30.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:30.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.960280+0000", 2020-11-12T17:27:30.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023410359999999999 2020-11-12T17:27:30.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:29.962621+0000", 2020-11-12T17:27:30.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012744991000000001 2020-11-12T17:27:30.083 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.084 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.084 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:30.084 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:27:30.085 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:30.086 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:30.088 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:30.134 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:30.132+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:30.207 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:30.200+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:30.249 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:30.250 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:30.250 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:30.250 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:30.250 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:30.257 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:30.262 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:30.289 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:30.307 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:30.306+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:30.316 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:30.350 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:30.379 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:30.394 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:30.395 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:30.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:30.396 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:30.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.396 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:30.397 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:27:30.397 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 255.867309651, 2020-11-12T17:27:30.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:27:30.397 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.398 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.398 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:30.399 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:30.399 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:27:30.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.400 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:27:30.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:27:30.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:30.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:27:30.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:27:30.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:27:30.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:27:30.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:27:30.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:27:30.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:27:30.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:27:30.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:27:30.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:27:30.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:27:30.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:27:30.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:30.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:27:30.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:27:30.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:27:30.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:27:30.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:27:30.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:27:30.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:27:30.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:27:30.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:27:30.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:27:30.413 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.413 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.413 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.414 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:27:30.414 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:27:30.414 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 255.86390971700001, 2020-11-12T17:27:30.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:27:30.414 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.414 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:30.414 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:27:30.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:27:30.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:30.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:27:30.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:27:30.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:27:30.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:27:30.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:27:30.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:27:30.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:27:30.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:27:30.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:27:30.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:27:30.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:27:30.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:27:30.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:27:30.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:27:30.422 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.422 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.422 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.423 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:27:30.423 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:27:30.423 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 220.38802027, 2020-11-12T17:27:30.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:27:30.423 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.423 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.423 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:27:30.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:27:30.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:30.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:27:30.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:27:30.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:27:30.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:27:30.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:27:30.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:27:30.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:27:30.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:27:30.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:27:30.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:27:30.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:27:30.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:27:30.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:27:30.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:27:30.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:27:30.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:27:30.431 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.431 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.431 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.431 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:30.432 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:27:30.432 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 188.44803492700001, 2020-11-12T17:27:30.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:27:30.432 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.432 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.432 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.433 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:30.433 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:30.433 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:27:30.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.433 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:27:30.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:27:30.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:27:30.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:27:30.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:27:30.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:27:30.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:27:30.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:27:30.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:27:30.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:27:30.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:27:30.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:27:30.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:27:30.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:27:30.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:27:30.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:30.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:27:30.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:27:30.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:27:30.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:27:30.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:27:30.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:27:30.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:27:30.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:27:30.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:27:30.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:27:30.445 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.445 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.446 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.446 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:27:30.447 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:27:30.447 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 176.97093385299999, 2020-11-12T17:27:30.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:27:30.447 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.447 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:27:30.447 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:27:30.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:27:30.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:27:30.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:27:30.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:27:30.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:27:30.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:27:30.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:27:30.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:27:30.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:27:30.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:27:30.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:27:30.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:27:30.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:27:30.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:27:30.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.453 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.453 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:27:30.454 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:27:30.454 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 175.85192346599999, 2020-11-12T17:27:30.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:27:30.454 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.454 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.454 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.454 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:30.455 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:30.455 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:27:30.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.455 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:27:30.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:27:30.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:27:30.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:27:30.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:27:30.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:27:30.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:27:30.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:27:30.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:27:30.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:27:30.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:27:30.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:27:30.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:27:30.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:27:30.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:27:30.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:30.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:27:30.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:27:30.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:27:30.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:27:30.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:27:30.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:27:30.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:27:30.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:27:30.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:27:30.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:27:30.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.465 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.466 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:27:30.466 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:27:30.466 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 175.83578546199999, 2020-11-12T17:27:30.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:27:30.466 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.466 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:30.466 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:27:30.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:27:30.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:30.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:27:30.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:27:30.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:27:30.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:27:30.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:27:30.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:27:30.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:27:30.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:27:30.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:27:30.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:27:30.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:27:30.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:27:30.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:27:30.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:27:30.473 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.473 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.473 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.473 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:27:30.473 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:27:30.473 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 175.83105778300001, 2020-11-12T17:27:30.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:27:30.474 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.474 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:27:30.474 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.474 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:30.474 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:30.474 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:27:30.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.475 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:27:30.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:27:30.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:30.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:27:30.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:27:30.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:27:30.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:27:30.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:27:30.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:27:30.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:27:30.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:27:30.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:27:30.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:27:30.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:27:30.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:27:30.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:27:30.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:27:30.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:27:30.481 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.481 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.481 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.481 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:27:30.482 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:27:30.482 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 119.44949871599999, 2020-11-12T17:27:30.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:27:30.482 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.482 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.482 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.482 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:30.482 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:30.483 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:27:30.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.483 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:27:30.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:27:30.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:27:30.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:27:30.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:27:30.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:27:30.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:27:30.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:27:30.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:27:30.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:27:30.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:27:30.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:27:30.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:27:30.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:27:30.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:27:30.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:30.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:27:30.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:27:30.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:27:30.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:27:30.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:27:30.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:27:30.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:27:30.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:27:30.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:27:30.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:27:30.492 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.492 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.492 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.493 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:27:30.493 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:27:30.493 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 119.443944895, 2020-11-12T17:27:30.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:27:30.493 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.493 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:30.493 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:27:30.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:27:30.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:30.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:27:30.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:27:30.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:27:30.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:27:30.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:27:30.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:27:30.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:27:30.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:27:30.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:27:30.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:27:30.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:27:30.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:27:30.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:27:30.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:27:30.499 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.500 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.500 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.500 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:30.500 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:27:30.500 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.787295884000002, 2020-11-12T17:27:30.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:27:30.501 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.501 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.501 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.501 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:30.501 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:30.501 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:27:30.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.502 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:27:30.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:27:30.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:30.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:27:30.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:27:30.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:27:30.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:27:30.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:27:30.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:27:30.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:27:30.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:27:30.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:27:30.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:27:30.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:27:30.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:27:30.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:30.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:27:30.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:27:30.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:27:30.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:27:30.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:27:30.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:27:30.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:27:30.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:27:30.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:27:30.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:27:30.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.510 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.511 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:30.511 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:27:30.511 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.785402270999995, 2020-11-12T17:27:30.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:27:30.511 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.512 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.512 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.512 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:30.512 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:30.512 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:27:30.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.512 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:27:30.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:27:30.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:30.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:27:30.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:27:30.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:27:30.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:27:30.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:27:30.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:27:30.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:27:30.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:27:30.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:27:30.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:27:30.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:27:30.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:27:30.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:30.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:27:30.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:27:30.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:27:30.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:27:30.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:27:30.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:27:30.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:27:30.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:27:30.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:27:30.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:27:30.521 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.521 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.521 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.522 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:30.522 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:27:30.522 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.784649623000007, 2020-11-12T17:27:30.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:27:30.523 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.524 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.524 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.524 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:30.524 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:30.524 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:27:30.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.525 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:27:30.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:27:30.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:27:30.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:27:30.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:27:30.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:27:30.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:27:30.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:27:30.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:27:30.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:27:30.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:27:30.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:27:30.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:27:30.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:27:30.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:27:30.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:30.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:27:30.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:27:30.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:27:30.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:27:30.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:27:30.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:27:30.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:27:30.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:27:30.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:27:30.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:27:30.534 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.534 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.534 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.535 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:30.535 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:27:30.535 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.781488105999998, 2020-11-12T17:27:30.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:27:30.535 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.535 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.536 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.536 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:30.536 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:30.536 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:27:30.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.536 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:27:30.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:27:30.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:27:30.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:27:30.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:27:30.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:27:30.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:27:30.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:27:30.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:27:30.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:27:30.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:27:30.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:27:30.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:27:30.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:27:30.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:27:30.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:30.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:27:30.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:27:30.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:27:30.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:27:30.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:27:30.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:27:30.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:27:30.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:27:30.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:27:30.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:27:30.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.546 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.546 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:30.546 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:27:30.547 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.780406939000002, 2020-11-12T17:27:30.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:27:30.547 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.547 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.547 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.547 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:30.547 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:30.548 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:27:30.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.548 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:27:30.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:27:30.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:30.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:27:30.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:27:30.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:27:30.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:27:30.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:27:30.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:27:30.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:27:30.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:27:30.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:27:30.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:27:30.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:27:30.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:27:30.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:30.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:27:30.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:27:30.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:27:30.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:27:30.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:27:30.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:27:30.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:27:30.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:27:30.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:27:30.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:27:30.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.557 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.558 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:30.558 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:27:30.558 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.780237846000006, 2020-11-12T17:27:30.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:27:30.558 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.558 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.559 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.559 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:30.559 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:30.559 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:27:30.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.559 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:27:30.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:27:30.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:27:30.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:27:30.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:27:30.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:27:30.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:27:30.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:27:30.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:27:30.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:27:30.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:27:30.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:27:30.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:27:30.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:27:30.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:27:30.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:30.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:27:30.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:27:30.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:27:30.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:27:30.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:27:30.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:27:30.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:27:30.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:27:30.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:27:30.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:27:30.568 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.569 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.569 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:30.569 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:27:30.569 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.777619200000004, 2020-11-12T17:27:30.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:27:30.570 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.570 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.570 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.570 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:30.570 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:30.570 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:27:30.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.571 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:27:30.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:27:30.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:27:30.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:27:30.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:27:30.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:27:30.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:27:30.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:27:30.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:27:30.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:27:30.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:27:30.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:27:30.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:27:30.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:27:30.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:27:30.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:30.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:27:30.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:27:30.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:27:30.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:27:30.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:27:30.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:27:30.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:27:30.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:27:30.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:27:30.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:27:30.580 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.580 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.580 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.580 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:30.581 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:27:30.581 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.777511117000003, 2020-11-12T17:27:30.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:27:30.581 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.581 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.581 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:30.581 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:30.582 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:30.582 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:27:30.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.582 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:27:30.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:27:30.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:27:30.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:27:30.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:27:30.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:27:30.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:27:30.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:27:30.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:27:30.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:27:30.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:27:30.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:27:30.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:27:30.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:27:30.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:27:30.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:30.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:27:30.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:27:30.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:30.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:27:30.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:27:30.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:30.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:27:30.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:27:30.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:27:30.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:27:30.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:27:30.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:27:30.591 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.591 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.591 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.592 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:27:30.592 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:27:30.592 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.773548434999995, 2020-11-12T17:27:30.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:27:30.592 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.593 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:30.593 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:27:30.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:27:30.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:27:30.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:27:30.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:27:30.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:27:30.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:27:30.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:27:30.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:27:30.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:27:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:27:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:27:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:27:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:27:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:27:30.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:27:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:27:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.600 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:27:30.600 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:27:30.600 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.735818693999999, 2020-11-12T17:27:30.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:27:30.600 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:30.601 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:30.601 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:30.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:30.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:27:30.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:30.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:30.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:27:30.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:30.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:30.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:27:30.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:27:30.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:30.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:27:30.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:27:30.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:30.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:27:30.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:27:30.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:30.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:27:30.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:27:30.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:27:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:27:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:27:30.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:27:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:27:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:27:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:30.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:27:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:27:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.608 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:30.609 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:30.609 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:30.611 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:30.611 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:30.611 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:30.611 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:30.611 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:30.612 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:30.612 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:30.612 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:30.612 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:30.612 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:30.612 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:30.613 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 44 16 40929 40913 7.2636 7.07031 0.0127861 0.0171906 2020-11-12T17:27:30.613 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:30.606+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:30.613 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:30.710 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:30.708+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:30.781 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:30.781 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:30.793 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:30.840 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:30.838+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:30.912 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:30.910+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:30.916 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:30.916 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:30.929 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:31.013 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:31.008+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:31.105 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:31.106 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:31.114 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:31.108+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:31.118 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:31.214 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:31.210+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:31.242 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:31.242 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:31.254 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:31.339 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:31.338+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:31.413 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:31.414 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:31.416 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:31.412+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:31.424 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:31.518 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:31.514+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:31.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 45 16 41784 41768 7.25062 6.67969 0.00996356 0.0172178 2020-11-12T17:27:31.587 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:31.588 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:31.600 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:31.647 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:31.644+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:31.720 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:31.716+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:31.732 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:31.732 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:31.744 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:31.821 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:31.818+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:31.911 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:27:31.922 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:31.918+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:31.925 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:31.925 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:31.937 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:32.022 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:32.018+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:32.111 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:32.112 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:32.124 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:32.124 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:32.120+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:32.223 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:32.220+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:32.287 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:32.288 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:32.299 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:32.343 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:32.340+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:32.410 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:32.406+0000 7f9289d6e700 -1 osd.7 153 handle_osd_map injecting map crc failure 2020-11-12T17:27:32.414 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:27:32.425 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:32.420+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:32.469 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:32.469 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:32.478 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:32.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 46 16 42624 42608 7.23564 6.5625 0.347471 0.017224 2020-11-12T17:27:32.613 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:32.641 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:32.641 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:32.657 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:32.773 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:32.800 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:32.804 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:32.804 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:32.805 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:32.805 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:32.814 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:32.822 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:32.822 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:32.823 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.000000 2020-11-12T17:27:32.823 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd primary-affinity 7 0 2020-11-12T17:27:32.831 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:32.831 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:32.828+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:32.850 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:32.844+0000 7f4dea6fe700 -1 osd.1 153 handle_osd_map injecting map crc failure 2020-11-12T17:27:32.860 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:32.895 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:32.726+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:32.901 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:32.522+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:32.901 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:32.882+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:32.918 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:32.930 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:32.924+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:32.935 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:32.935 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:32.935 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:32.935 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:32.936 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:32.952 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:32.955 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:32.992 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:33.031 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:33.028+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:33.034 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:33.039 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:33.040 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:33.040 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:33.040 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:33.040 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:33.040 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:33.041 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:33.041 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:33.114 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:33.156 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:33.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:33.157 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:33.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.157 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:33.157 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:33.157 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 268.00393257000002, 2020-11-12T17:27:33.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:33.158 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.158 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.158 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.158 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:33.158 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:33.159 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:33.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.159 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:33.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:33.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:33.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:33.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:33.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:33.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:33.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:33.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:33.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:33.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:33.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:33.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:33.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:33.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:33.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:33.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:33.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:33.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:33.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:33.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:33.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:33.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:33.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:33.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:33.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:33.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.172 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.172 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:33.172 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:33.173 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 267.99684077400002, 2020-11-12T17:27:33.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:33.173 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.173 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:33.173 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:33.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:33.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:33.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:33.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:33.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:33.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:33.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:33.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:33.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:33.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:33.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:33.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:33.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:33.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:33.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:33.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:33.185 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.185 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.185 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.186 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:33.186 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:33.186 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 258.56428127700002, 2020-11-12T17:27:33.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:33.187 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.187 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.188 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.188 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:33.188 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:33.189 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:33.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.189 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:33.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:33.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:33.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:33.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:33.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:33.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:33.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:33.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:33.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:33.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:33.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:33.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:33.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:33.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:33.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:33.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:33.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:33.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:33.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:33.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:33.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:33.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:33.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:33.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:33.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:33.260 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.260 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.260 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.260 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:33.261 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:33.261 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 224.61416118299999, 2020-11-12T17:27:33.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:33.261 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.261 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:33.261 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:33.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:33.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:33.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:33.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:33.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:33.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:33.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:33.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:33.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:33.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:33.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:33.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:33.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:33.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:33.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:33.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:33.267 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.268 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.268 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.268 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:33.268 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:33.268 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 222.50855929100001, 2020-11-12T17:27:33.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:33.269 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.269 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.269 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:33.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:33.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:33.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:33.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:33.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:33.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:33.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:33.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:33.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:33.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:33.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:33.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:33.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:33.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:33.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:33.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:33.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:33.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:33.276 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.277 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.277 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:33.277 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:33.278 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 191.16207595700001, 2020-11-12T17:27:33.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:33.278 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.278 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.278 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.278 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:33.278 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:33.279 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:33.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.279 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:33.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:33.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:33.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:33.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:33.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:33.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:33.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:33.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:33.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:33.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:33.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:33.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:33.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:33.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:33.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:33.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:33.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:33.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:33.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:33.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:33.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:33.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:33.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:33.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:33.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:33.289 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.290 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.290 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.290 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:33.290 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:33.291 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 182.16623415500001, 2020-11-12T17:27:33.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:33.291 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.291 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:33.291 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:33.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:33.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:33.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:33.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:33.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:33.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:33.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:33.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:33.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:33.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:33.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:33.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:33.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:33.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:33.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:33.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:33.298 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.299 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.299 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.299 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:33.299 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:33.299 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 178.231130756, 2020-11-12T17:27:33.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:33.300 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.300 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:33.300 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:33.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:33.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:33.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:33.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:33.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:33.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:33.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:33.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:33.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:33.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:33.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:33.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:33.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:33.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:33.307 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.307 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.307 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.308 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:33.308 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:33.308 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.466490265, 2020-11-12T17:27:33.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:33.308 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.308 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:33.309 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:33.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:33.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:33.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:33.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:33.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:33.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:33.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:33.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:33.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:33.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:33.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:33.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:33.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:33.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:33.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:33.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:33.315 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.316 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.316 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.316 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:33.316 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:33.317 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 141.20998158099999, 2020-11-12T17:27:33.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:33.317 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.317 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.317 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.317 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:33.318 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:33.318 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:33.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.318 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:33.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:33.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:33.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:33.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:33.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:33.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:33.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:33.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:33.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:33.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:33.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:33.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:33.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:33.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:33.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:33.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:33.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:33.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:33.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:33.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:33.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:33.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:33.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:33.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:33.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:33.329 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.329 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.329 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.329 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:33.330 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:33.330 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 141.209819211, 2020-11-12T17:27:33.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:33.330 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.330 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.330 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.331 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:33.331 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:33.331 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:33.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.331 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:33.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:33.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:33.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:33.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:33.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:33.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:33.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:33.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:33.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:33.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:33.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:33.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:33.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:33.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:33.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:33.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:33.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:33.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:33.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:33.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:33.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:33.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:33.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:33.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:33.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:33.341 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.342 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.342 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.342 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:33.342 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:33.343 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 141.20125022400001, 2020-11-12T17:27:33.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:33.343 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.343 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:33.343 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:33.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:33.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:33.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:33.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:33.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:33.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:33.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:33.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:33.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:33.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:33.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:33.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:33.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:33.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:33.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:33.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:33.350 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.350 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.351 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.351 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:33.351 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:33.351 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.696737774, 2020-11-12T17:27:33.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:33.352 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.352 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.352 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.352 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:33.352 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:33.352 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:33.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.353 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:33.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:33.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:33.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:33.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:33.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:33.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:33.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:33.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:33.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:33.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:33.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:33.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:33.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:33.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:33.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:33.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:33.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:33.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:33.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:33.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:33.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:33.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:33.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:33.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:33.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:33.363 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.363 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.363 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.364 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:33.364 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:33.364 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.211189488, 2020-11-12T17:27:33.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:33.364 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.365 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.365 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.365 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:33.365 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:33.365 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:33.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.366 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:33.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:33.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:33.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:33.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:33.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:33.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:33.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:33.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:33.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:33.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:33.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:33.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:33.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:33.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:33.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:33.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:33.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:33.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:33.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:33.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:33.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:33.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:33.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:33.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:33.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:33.376 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.376 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.376 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.376 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:33.377 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:33.377 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.13787105599999, 2020-11-12T17:27:33.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:33.377 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.377 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:33.377 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:33.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:33.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:33.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:33.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:33.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:33.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:33.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:33.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:33.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:33.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:33.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:33.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:33.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:33.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:33.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:33.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:33.414 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.414 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.414 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.415 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:33.415 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:33.415 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.08222608, 2020-11-12T17:27:33.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:33.415 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.415 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.415 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.416 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:33.416 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:33.416 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:33.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.416 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:33.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:33.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:33.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:33.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:33.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:33.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:33.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:33.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:33.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:33.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:33.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:33.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:33.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:33.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:33.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:33.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:33.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:33.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:33.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:33.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:33.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:33.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:33.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:33.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:33.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:33.425 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.425 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.425 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.426 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:33.426 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:33.426 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.694021709, 2020-11-12T17:27:33.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:33.427 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.427 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.427 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.427 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:33.427 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:33.427 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:33.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.428 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:33.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:33.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:33.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:33.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:33.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:33.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:33.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:33.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:33.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:33.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:33.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:33.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:33.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:33.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:33.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:33.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:33.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:33.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:33.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:33.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:33.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:33.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:33.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:33.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:33.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:33.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.437 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.438 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:33.438 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:33.438 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 96.487564777000003, 2020-11-12T17:27:33.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:33.438 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.438 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.438 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:33.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:33.439 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:33.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.439 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:33.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:33.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:33.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:33.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:33.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:33.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:33.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:33.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:33.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:33.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:33.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:33.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:33.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:33.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:33.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:33.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:33.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:33.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:33.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:33.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:33.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:33.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:33.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:33.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:33.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:33.449 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.449 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.449 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.449 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:33.449 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:33.450 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.238359160000002, 2020-11-12T17:27:33.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:33.450 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.450 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:33.450 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.450 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:33.450 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:33.451 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:33.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.451 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:33.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:33.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:33.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:33.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:33.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:33.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:33.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:33.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:33.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:33.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:33.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:33.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:33.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:33.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:33.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:33.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:33.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:33.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:33.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:33.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:33.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:33.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:33.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:33.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:33.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:33.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:33.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:33.460 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.461 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.461 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.461 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:33.461 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:33.461 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.221399711000004, 2020-11-12T17:27:33.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:33.462 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.462 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:33.463 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:33.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:33.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:33.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:33.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:33.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:33.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:33.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:33.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:33.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:33.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:33.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:33.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:33.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:33.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:33.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:33.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:33.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:33.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.469 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.470 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.470 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:33.471 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:33.472 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:33.470+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:33.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 47 16 43310 43294 7.19571 5.35938 0.0183778 0.017363 2020-11-12T17:27:33.580 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:33.576+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:33.610 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:33.610 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:33.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.611 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:43328 5.0 5:09bfcf4a:::benchmark_data_smithi036_24110_object5415:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e154)", 2020-11-12T17:27:33.611 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:33.577147+0000", 2020-11-12T17:27:33.611 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.032890044, 2020-11-12T17:27:33.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.032924127999999997, 2020-11-12T17:27:33.611 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.612 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:33.612 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.612 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:33.612 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:33.612 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43328 2020-11-12T17:27:33.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.612 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.577147+0000", 2020-11-12T17:27:33.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.577147+0000", 2020-11-12T17:27:33.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:33.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.577116+0000", 2020-11-12T17:27:33.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9561000000000005e-05 2020-11-12T17:27:33.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.577206+0000", 2020-11-12T17:27:33.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1627999999999999e-05 2020-11-12T17:27:33.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.577218+0000", 2020-11-12T17:27:33.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0399999999999998e-06 2020-11-12T17:27:33.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.577224+0000", 2020-11-12T17:27:33.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0074327079999999997 2020-11-12T17:27:33.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.584656+0000", 2020-11-12T17:27:33.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000123888 2020-11-12T17:27:33.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.584780+0000", 2020-11-12T17:27:33.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017449699999999999 2020-11-12T17:27:33.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:33.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.584955+0000", 2020-11-12T17:27:33.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042488680000000003 2020-11-12T17:27:33.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:33.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.589204+0000", 2020-11-12T17:27:33.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012056456 2020-11-12T17:27:33.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.619 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.620 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:43361 5.0 5:0bf4ea61:::benchmark_data_smithi036_24110_object5420:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e154)", 2020-11-12T17:27:33.620 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:33.606883+0000", 2020-11-12T17:27:33.620 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0031539239999999998, 2020-11-12T17:27:33.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00329941, 2020-11-12T17:27:33.620 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.621 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:33.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:33.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:33.621 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43361 2020-11-12T17:27:33.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.621 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.606883+0000", 2020-11-12T17:27:33.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.606883+0000", 2020-11-12T17:27:33.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999652 2020-11-12T17:27:33.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.606848+0000", 2020-11-12T17:27:33.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010877100000000001 2020-11-12T17:27:33.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.606957+0000", 2020-11-12T17:27:33.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4871999999999999e-05 2020-11-12T17:27:33.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.606972+0000", 2020-11-12T17:27:33.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5259999999999993e-06 2020-11-12T17:27:33.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.606981+0000", 2020-11-12T17:27:33.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4438999999999997e-05 2020-11-12T17:27:33.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607045+0000", 2020-11-12T17:27:33.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00031874399999999998 2020-11-12T17:27:33.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607364+0000", 2020-11-12T17:27:33.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000206911 2020-11-12T17:27:33.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:33.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607571+0000", 2020-11-12T17:27:33.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068737799999999999 2020-11-12T17:27:33.629 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.629 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.629 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.629 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:43362 5.0 5:0bf4ea61:::benchmark_data_smithi036_24110_object5420:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e154)", 2020-11-12T17:27:33.629 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:33.607052+0000", 2020-11-12T17:27:33.630 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0029852070000000001, 2020-11-12T17:27:33.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031863389999999998, 2020-11-12T17:27:33.630 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.630 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:33.630 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.630 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:33.630 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:33.631 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43362 2020-11-12T17:27:33.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.631 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607052+0000", 2020-11-12T17:27:33.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607052+0000", 2020-11-12T17:27:33.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:33.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607016+0000", 2020-11-12T17:27:33.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0834000000000005e-05 2020-11-12T17:27:33.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607107+0000", 2020-11-12T17:27:33.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0570000000000004e-06 2020-11-12T17:27:33.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607114+0000", 2020-11-12T17:27:33.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0080000000000004e-06 2020-11-12T17:27:33.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607118+0000", 2020-11-12T17:27:33.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002370703 2020-11-12T17:27:33.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:33.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609489+0000", 2020-11-12T17:27:33.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014355300000000001 2020-11-12T17:27:33.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:33.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609632+0000", 2020-11-12T17:27:33.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020771799999999999 2020-11-12T17:27:33.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:33.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609840+0000", 2020-11-12T17:27:33.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027879100000000002 2020-11-12T17:27:33.637 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.637 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.637 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.638 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:43363 5.0 5.86572fd0 (undecoded) ondisk+write+known_if_redirected e154)", 2020-11-12T17:27:33.638 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:33.607146+0000", 2020-11-12T17:27:33.638 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0028909560000000001, 2020-11-12T17:27:33.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0031405859999999999, 2020-11-12T17:27:33.638 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.638 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:33.638 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.639 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:33.639 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:33.639 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43363 2020-11-12T17:27:33.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.639 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607146+0000", 2020-11-12T17:27:33.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607146+0000", 2020-11-12T17:27:33.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:33.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607129+0000", 2020-11-12T17:27:33.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9023999999999995e-05 2020-11-12T17:27:33.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607198+0000", 2020-11-12T17:27:33.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1188e-05 2020-11-12T17:27:33.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607210+0000", 2020-11-12T17:27:33.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5400000000000003e-06 2020-11-12T17:27:33.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607215+0000", 2020-11-12T17:27:33.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8919999999999997e-05 2020-11-12T17:27:33.643 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.643 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.643 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.644 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:43364 5.0 5.86572fd0 (undecoded) ondisk+write+known_if_redirected e154)", 2020-11-12T17:27:33.644 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:33.607357+0000", 2020-11-12T17:27:33.644 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.002680235, 2020-11-12T17:27:33.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029653850000000001, 2020-11-12T17:27:33.644 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.645 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:33.645 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.645 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:33.645 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:33.645 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43364 2020-11-12T17:27:33.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.645 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607357+0000", 2020-11-12T17:27:33.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607357+0000", 2020-11-12T17:27:33.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999585 2020-11-12T17:27:33.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607316+0000", 2020-11-12T17:27:33.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0476999999999994e-05 2020-11-12T17:27:33.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607406+0000", 2020-11-12T17:27:33.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0097e-05 2020-11-12T17:27:33.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607416+0000", 2020-11-12T17:27:33.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7400000000000001e-06 2020-11-12T17:27:33.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607422+0000", 2020-11-12T17:27:33.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5018000000000007e-05 2020-11-12T17:27:33.649 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.649 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.650 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.650 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:43365 5.0 5.86572fd0 (undecoded) ondisk+write+known_if_redirected e154)", 2020-11-12T17:27:33.650 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:33.607498+0000", 2020-11-12T17:27:33.650 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0025394100000000002, 2020-11-12T17:27:33.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00285965, 2020-11-12T17:27:33.651 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.651 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:33.651 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.651 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:33.651 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:33.651 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43365 2020-11-12T17:27:33.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.652 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607498+0000", 2020-11-12T17:27:33.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607498+0000", 2020-11-12T17:27:33.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99998 2020-11-12T17:27:33.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607478+0000", 2020-11-12T17:27:33.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7322000000000004e-05 2020-11-12T17:27:33.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607545+0000", 2020-11-12T17:27:33.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3140000000000004e-06 2020-11-12T17:27:33.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607553+0000", 2020-11-12T17:27:33.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4469999999999999e-06 2020-11-12T17:27:33.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.607558+0000", 2020-11-12T17:27:33.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9939000000000003e-05 2020-11-12T17:27:33.656 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.656 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.656 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.656 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:43366 5.0 5.86572fd0 (undecoded) ondisk+write+known_if_redirected e154)", 2020-11-12T17:27:33.656 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:33.609205+0000", 2020-11-12T17:27:33.657 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00083183699999999998, 2020-11-12T17:27:33.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0011895639999999999, 2020-11-12T17:27:33.657 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.657 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:33.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:33.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:33.658 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43366 2020-11-12T17:27:33.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.658 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609205+0000", 2020-11-12T17:27:33.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609205+0000", 2020-11-12T17:27:33.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99998 2020-11-12T17:27:33.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609185+0000", 2020-11-12T17:27:33.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8977e-05 2020-11-12T17:27:33.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609254+0000", 2020-11-12T17:27:33.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5237e-05 2020-11-12T17:27:33.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609270+0000", 2020-11-12T17:27:33.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6490000000000008e-06 2020-11-12T17:27:33.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609277+0000", 2020-11-12T17:27:33.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1785999999999993e-05 2020-11-12T17:27:33.662 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.662 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.663 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:43367 5.0 5.86572fd0 (undecoded) ondisk+write+known_if_redirected e154)", 2020-11-12T17:27:33.663 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:33.609444+0000", 2020-11-12T17:27:33.663 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00059299699999999995, 2020-11-12T17:27:33.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00098580400000000006, 2020-11-12T17:27:33.667 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.667 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:33.667 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:33.668 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:33.668 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:33.668 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 43367 2020-11-12T17:27:33.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.670 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609444+0000", 2020-11-12T17:27:33.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609444+0000", 2020-11-12T17:27:33.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:33.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609408+0000", 2020-11-12T17:27:33.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109663 2020-11-12T17:27:33.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609518+0000", 2020-11-12T17:27:33.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7846000000000001e-05 2020-11-12T17:27:33.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609546+0000", 2020-11-12T17:27:33.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6480000000000003e-06 2020-11-12T17:27:33.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609553+0000", 2020-11-12T17:27:33.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010928 2020-11-12T17:27:33.678 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.678 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.679 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:43328 5.0 e154/135)", 2020-11-12T17:27:33.679 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:33.609605+0000", 2020-11-12T17:27:33.679 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00043184700000000001, 2020-11-12T17:27:33.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00086183400000000002, 2020-11-12T17:27:33.679 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:33.680 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:33.680 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:33.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:33.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609605+0000", 2020-11-12T17:27:33.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:33.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:33.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609605+0000", 2020-11-12T17:27:33.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:33.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:33.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609588+0000", 2020-11-12T17:27:33.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3695000000000001e-05 2020-11-12T17:27:33.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:33.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609631+0000", 2020-11-12T17:27:33.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0238000000000002e-05 2020-11-12T17:27:33.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:33.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609682+0000", 2020-11-12T17:27:33.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3219999999999993e-06 2020-11-12T17:27:33.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:33.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:33.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:33.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:33.609690+0000", 2020-11-12T17:27:33.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4485000000000002e-05 2020-11-12T17:27:33.684 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.684 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:33.684 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.684 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:33.685 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:33.685 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 9 2020-11-12T17:27:33.685 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:33.686 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:33.687 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:33.680+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:33.787 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:33.786+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:33.843 INFO:teuthology.orchestra.run.smithi036.stderr:set osd.7 primary-affinity to 0 (802) 2020-11-12T17:27:33.866 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:33.931 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:33.932 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:33.932 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:33.932 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:33.936 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:33.930+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:33.936 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:34.036 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:34.032+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:34.116 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:34.116 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:34.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:34.117 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:34.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.117 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:34.118 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:34.118 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 259.69519888500002, 2020-11-12T17:27:34.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:34.119 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.119 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:34.120 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:34.120 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:34.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.120 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:34.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:34.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:34.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:34.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:34.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:34.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:34.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:34.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:34.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:34.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:34.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:34.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:34.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:34.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:34.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:34.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:34.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:34.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:34.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:34.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:34.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:34.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:34.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:34.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:34.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:34.133 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.133 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.133 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.133 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:34.133 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:34.134 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 259.68825482300002, 2020-11-12T17:27:34.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:34.134 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.134 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:34.134 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:34.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:34.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:34.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:34.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:34.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:34.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:34.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:34.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:34.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:34.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:34.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:34.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:34.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:34.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:34.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:34.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:34.141 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.141 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.142 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.142 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:34.142 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:34.142 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 223.51441703699999, 2020-11-12T17:27:34.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:34.143 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.143 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.143 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.143 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:34.143 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:34.144 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:34.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.144 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:34.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:34.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:34.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:34.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:34.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:34.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:34.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:34.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:34.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:34.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:34.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:34.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:34.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:34.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:34.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:34.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:34.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:34.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:34.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:34.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:34.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:27:34.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:27:34.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:27:34.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:27:34.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:27:34.153 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.153 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.153 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.154 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:27:34.154 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:34.154 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 207.25071194399999, 2020-11-12T17:27:34.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:27:34.154 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.154 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.155 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.155 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:34.155 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:34.155 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:27:34.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.155 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:34.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:34.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:34.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:27:34.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:27:34.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:27:34.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:27:34.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:27:34.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:27:34.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:27:34.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:27:34.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:27:34.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:27:34.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:27:34.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:27:34.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:34.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:27:34.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:27:34.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:27:34.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:27:34.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:27:34.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:27:34.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:27:34.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:27:34.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:27:34.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:27:34.165 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.165 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.165 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.166 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:27:34.166 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:34.166 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 192.16533161800001, 2020-11-12T17:27:34.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:27:34.167 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.167 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.167 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:34.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:34.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:34.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:27:34.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:27:34.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:27:34.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:27:34.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:27:34.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:27:34.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:27:34.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:27:34.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:27:34.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:27:34.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:27:34.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:27:34.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:27:34.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:27:34.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:27:34.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:27:34.174 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.174 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.174 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.175 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:27:34.175 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:34.175 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 190.471193344, 2020-11-12T17:27:34.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:27:34.175 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.175 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.176 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.176 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:34.176 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:34.176 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:27:34.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.176 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:34.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:34.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:34.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:27:34.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:27:34.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:27:34.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:27:34.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:27:34.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:27:34.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:27:34.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:27:34.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:27:34.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:27:34.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:27:34.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:27:34.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:34.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:27:34.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:27:34.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:27:34.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:27:34.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:27:34.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:27:34.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:27:34.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:27:34.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:27:34.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:27:34.185 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.185 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.186 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.186 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:27:34.186 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:34.186 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.80195462200001, 2020-11-12T17:27:34.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:27:34.187 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.187 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.187 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.187 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:34.187 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:34.187 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:27:34.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.188 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:34.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:34.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:34.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:27:34.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:27:34.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:27:34.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:27:34.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:27:34.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:27:34.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:27:34.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:27:34.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:27:34.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:27:34.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:27:34.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:27:34.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:34.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:27:34.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:27:34.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:27:34.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:27:34.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:27:34.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:27:34.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:27:34.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:27:34.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:27:34.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:27:34.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.198 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:27:34.198 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:34.199 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.78877786300001, 2020-11-12T17:27:34.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:27:34.199 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.199 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:34.199 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:34.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:34.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:34.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:27:34.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:27:34.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:27:34.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:27:34.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:27:34.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:27:34.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:27:34.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:27:34.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:27:34.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:27:34.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:27:34.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:27:34.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:27:34.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:27:34.205 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.206 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.206 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:27:34.206 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:34.206 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 128.23469641400001, 2020-11-12T17:27:34.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:27:34.207 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.207 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.207 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.207 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:34.207 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:34.207 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:27:34.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.208 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:34.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:34.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:27:34.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:27:34.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:27:34.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:27:34.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:27:34.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:27:34.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:27:34.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:27:34.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:27:34.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:27:34.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:27:34.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:27:34.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:27:34.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:34.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:27:34.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:27:34.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:27:34.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:27:34.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:27:34.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:27:34.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:27:34.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:27:34.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:27:34.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:27:34.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.217 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.217 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:27:34.218 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:34.218 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 128.22570910799999, 2020-11-12T17:27:34.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:27:34.218 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.218 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:34.218 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:34.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:34.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:34.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:27:34.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:27:34.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:27:34.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:27:34.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:27:34.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:27:34.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:27:34.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:27:34.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:27:34.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:27:34.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:27:34.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:27:34.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:27:34.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:27:34.224 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.225 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.225 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.225 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:27:34.225 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:34.225 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.207781794, 2020-11-12T17:27:34.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:27:34.226 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.226 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:34.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:34.226 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:27:34.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.227 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:34.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:34.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:34.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:27:34.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:27:34.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:27:34.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:27:34.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:27:34.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:27:34.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:27:34.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:27:34.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:27:34.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:27:34.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:27:34.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:27:34.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:34.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:27:34.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:27:34.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:27:34.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:27:34.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:27:34.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:27:34.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:27:34.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:27:34.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:27:34.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:27:34.236 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.236 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.237 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.237 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:34.237 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:34.237 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.40534289599999, 2020-11-12T17:27:34.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:27:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:27:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.238 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:27:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:27:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:27:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:27:34.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:27:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:27:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:27:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:27:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:27:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:27:34.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:27:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:27:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:34.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:27:34.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:27:34.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:27:34.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:27:34.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:27:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:27:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:27:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:27:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:27:34.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:27:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:34.248 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.32622057899999, 2020-11-12T17:27:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:27:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:34.249 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:27:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:27:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:27:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:27:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:27:34.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:27:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:27:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:27:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:27:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:27:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:27:34.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:27:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:27:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:27:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:27:34.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:27:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:27:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:27:34.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:27:34.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:27:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:27:34.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:27:34.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:27:34.289 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.289 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.290 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.290 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:27:34.291 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:34.291 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 92.543869611999995, 2020-11-12T17:27:34.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:27:34.292 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.292 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.292 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.293 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:34.293 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:34.293 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:27:34.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.294 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:34.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:34.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:27:34.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:27:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:27:34.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:27:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:27:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:27:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:27:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:27:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:27:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:27:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:27:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:27:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:27:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:27:34.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:27:34.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:27:34.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:27:34.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:27:34.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:27:34.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:27:34.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:27:34.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:27:34.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:27:34.325 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.325 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.325 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.326 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:27:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.080827263000003, 2020-11-12T17:27:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:27:34.327 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:34.328 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:27:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:34.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:34.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:27:34.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:27:34.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:27:34.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:27:34.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:27:34.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:27:34.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:27:34.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:27:34.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:27:34.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:27:34.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:27:34.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:27:34.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:27:34.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:34.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:27:34.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:27:34.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:27:34.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:27:34.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:27:34.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:27:34.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:27:34.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:27:34.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:27:34.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:27:34.346 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.346 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.346 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.347 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:34.348 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:34.349 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 32.059068111999999, 2020-11-12T17:27:34.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:27:34.350 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.350 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:34.351 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:27:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:34.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:27:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:27:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:27:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:27:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:27:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:27:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:27:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:27:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:27:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:27:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:27:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:27:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:27:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:27:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:27:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:27:34.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:27:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:27:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:27:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:27:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:27:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:27:34.366 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.367 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35048 5.1 e148/127 5:8e34dcfa:::benchmark_data_smithi036_24110_object4380:head v 148'2280, mlcod=148'2275)", 2020-11-12T17:27:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.754129293, 2020-11-12T17:27:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002, 2020-11-12T17:27:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:34.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359524+0000", 2020-11-12T17:27:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.064e-05 2020-11-12T17:27:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359605+0000", 2020-11-12T17:27:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34493079599999998 2020-11-12T17:27:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704536+0000", 2020-11-12T17:27:34.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2110000000000001e-06 2020-11-12T17:27:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704543+0000", 2020-11-12T17:27:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1071999999999998e-05 2020-11-12T17:27:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704634+0000", 2020-11-12T17:27:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2281999999999998e-05 2020-11-12T17:27:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704696+0000", 2020-11-12T17:27:34.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034977459999999999 2020-11-12T17:27:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708194+0000", 2020-11-12T17:27:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1390000000000006e-05 2020-11-12T17:27:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708265+0000", 2020-11-12T17:27:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002 2020-11-12T17:27:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35144 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.546523394999999, 2020-11-12T17:27:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998, 2020-11-12T17:27:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.376 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35144 2020-11-12T17:27:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:34.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567086+0000", 2020-11-12T17:27:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017142700000000001 2020-11-12T17:27:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567257+0000", 2020-11-12T17:27:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1043000000000002e-05 2020-11-12T17:27:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567278+0000", 2020-11-12T17:27:34.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1214e-05 2020-11-12T17:27:34.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567289+0000", 2020-11-12T17:27:34.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142698779 2020-11-12T17:27:34.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.709988+0000", 2020-11-12T17:27:34.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4704999999999995e-05 2020-11-12T17:27:34.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710083+0000", 2020-11-12T17:27:34.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016350300000000001 2020-11-12T17:27:34.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:34.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710246+0000", 2020-11-12T17:27:34.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002268946 2020-11-12T17:27:34.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.712515+0000", 2020-11-12T17:27:34.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199261574 2020-11-12T17:27:34.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911777+0000", 2020-11-12T17:27:34.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0816999999999996e-05 2020-11-12T17:27:34.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911858+0000", 2020-11-12T17:27:34.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2182000000000003e-05 2020-11-12T17:27:34.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911910+0000", 2020-11-12T17:27:34.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998 2020-11-12T17:27:34.386 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.386 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.387 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.387 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:34.387 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:34.387 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.9977084420000004, 2020-11-12T17:27:34.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:27:34.388 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.388 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:34.388 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:34.388 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:27:34.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.388 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:34.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:34.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:34.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:27:34.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:27:34.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:27:34.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:27:34.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:27:34.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:27:34.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:27:34.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:27:34.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:27:34.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:27:34.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:27:34.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:27:34.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:34.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:27:34.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:27:34.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:27:34.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:27:34.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:27:34.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:27:34.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:27:34.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:27:34.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:27:34.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:27:34.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.398 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36416 5.0 5:05125f34:::benchmark_data_smithi036_24110_object4551:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:34.398 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:34.398 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.1399804170000003, 2020-11-12T17:27:34.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002, 2020-11-12T17:27:34.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:34.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:34.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:34.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:34.399 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36416 2020-11-12T17:27:34.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.400 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:34.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:34.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:34.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:34.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:34.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:34.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:27:34.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:34.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973666+0000", 2020-11-12T17:27:34.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117633 2020-11-12T17:27:34.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:34.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973783+0000", 2020-11-12T17:27:34.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6325999999999999e-05 2020-11-12T17:27:34.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:34.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973800+0000", 2020-11-12T17:27:34.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:27:34.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973807+0000", 2020-11-12T17:27:34.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054509620000000002 2020-11-12T17:27:34.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:34.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979258+0000", 2020-11-12T17:27:34.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1768999999999996e-05 2020-11-12T17:27:34.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:34.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979340+0000", 2020-11-12T17:27:34.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107278 2020-11-12T17:27:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979447+0000", 2020-11-12T17:27:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005025753 2020-11-12T17:27:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.984473+0000", 2020-11-12T17:27:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35634463199999999 2020-11-12T17:27:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340818+0000", 2020-11-12T17:27:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3640000000000001e-05 2020-11-12T17:27:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340871+0000", 2020-11-12T17:27:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2222999999999998e-05 2020-11-12T17:27:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340924+0000", 2020-11-12T17:27:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002 2020-11-12T17:27:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:34.410 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:34.411 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:34.408+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:34.412 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:34.430 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:27:34.517 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:34.514+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:34.535 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:44200 5.f e155/127 5:f01ecab4:::benchmark_data_smithi036_24110_object5524:head v 155'2696, mlcod=155'2689)", 2020-11-12T17:27:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.528229+0000", 2020-11-12T17:27:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0087874359999999992, 2020-11-12T17:27:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0088136299999999994, 2020-11-12T17:27:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.528229+0000", 2020-11-12T17:27:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.528229+0000", 2020-11-12T17:27:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.528215+0000", 2020-11-12T17:27:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0880000000000001e-05 2020-11-12T17:27:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.528266+0000", 2020-11-12T17:27:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5083999999999998e-05 2020-11-12T17:27:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.528301+0000", 2020-11-12T17:27:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4069999999999998e-06 2020-11-12T17:27:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.528307+0000", 2020-11-12T17:27:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6057000000000002e-05 2020-11-12T17:27:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.528363+0000", 2020-11-12T17:27:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.586e-05 2020-11-12T17:27:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.528389+0000", 2020-11-12T17:27:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084605070000000008 2020-11-12T17:27:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.536850+0000", 2020-11-12T17:27:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0086201049999999994 2020-11-12T17:27:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:44209 5.f e155/127 5:f3322ed0:::benchmark_data_smithi036_24110_object5526:head v 155'2697, mlcod=155'2692)", 2020-11-12T17:27:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.533524+0000", 2020-11-12T17:27:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0034930809999999999, 2020-11-12T17:27:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035651120000000001, 2020-11-12T17:27:34.554 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.533524+0000", 2020-11-12T17:27:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:34.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.533524+0000", 2020-11-12T17:27:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:27:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.533510+0000", 2020-11-12T17:27:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7450999999999997e-05 2020-11-12T17:27:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.533558+0000", 2020-11-12T17:27:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6916000000000003e-05 2020-11-12T17:27:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.533605+0000", 2020-11-12T17:27:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6299999999999997e-06 2020-11-12T17:27:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.533609+0000", 2020-11-12T17:27:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8105000000000002e-05 2020-11-12T17:27:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.533647+0000", 2020-11-12T17:27:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.086e-05 2020-11-12T17:27:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.533668+0000", 2020-11-12T17:27:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144525 2020-11-12T17:27:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:34.566 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:44210 5.f e155/127)", 2020-11-12T17:27:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.535688+0000", 2020-11-12T17:27:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0013288250000000001, 2020-11-12T17:27:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0014383600000000001, 2020-11-12T17:27:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.535688+0000", 2020-11-12T17:27:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:34.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.535688+0000", 2020-11-12T17:27:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.535663+0000", 2020-11-12T17:27:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4833000000000006e-05 2020-11-12T17:27:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.535748+0000", 2020-11-12T17:27:34.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0127999999999998e-05 2020-11-12T17:27:34.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.535798+0000", 2020-11-12T17:27:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3419999999999998e-06 2020-11-12T17:27:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.535803+0000", 2020-11-12T17:27:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011512500000000001 2020-11-12T17:27:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44128 5.1 5:8114cdb6:::benchmark_data_smithi036_24110_object5515:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:27:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.417317+0000", 2020-11-12T17:27:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.119699615, 2020-11-12T17:27:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.119867785, 2020-11-12T17:27:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44128 2020-11-12T17:27:34.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.584 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:34.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.417317+0000", 2020-11-12T17:27:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.417317+0000", 2020-11-12T17:27:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:27:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:34.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.417266+0000", 2020-11-12T17:27:34.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013636200000000001 2020-11-12T17:27:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.417403+0000", 2020-11-12T17:27:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0925e-05 2020-11-12T17:27:34.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:34.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.417434+0000", 2020-11-12T17:27:34.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1379999999999996e-06 2020-11-12T17:27:34.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.417443+0000", 2020-11-12T17:27:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043135700000000001 2020-11-12T17:27:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:34.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.421756+0000", 2020-11-12T17:27:34.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000173828 2020-11-12T17:27:34.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:34.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.421930+0000", 2020-11-12T17:27:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023421499999999999 2020-11-12T17:27:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:34.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.422164+0000", 2020-11-12T17:27:34.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004598141 2020-11-12T17:27:34.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:34.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.426763+0000", 2020-11-12T17:27:34.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0094454010000000008 2020-11-12T17:27:34.622 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.622 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:34.622 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.623 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:34.623 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 4 2020-11-12T17:27:34.623 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:34.625 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 48 16 44233 44217 7.19601 7.21094 0.00776217 0.0173462 2020-11-12T17:27:34.626 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:34.640 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:34.638+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:34.734 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:34.724+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:34.788 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:34.789 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:34.789 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:34.789 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:34.790 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:34.801 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:34.855 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:27:34.857 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:34.854+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:34.930 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:34.924+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:34.944 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:34.945 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:34.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:34.945 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:34.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.946 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:27:34.946 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:34.946 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 264.25753324999999, 2020-11-12T17:27:34.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:27:34.947 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.947 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.947 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:34.948 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:34.948 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:34.948 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:27:34.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.950 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:34.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:34.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:34.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:34.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:34.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:34.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:34.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:27:34.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:27:34.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:34.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:27:34.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:27:34.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:34.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:27:34.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:27:34.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:27:34.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:27:34.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:34.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:27:34.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:27:34.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:34.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:27:34.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:27:34.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:34.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:27:34.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:27:34.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:34.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:27:34.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:27:34.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:27:34.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:27:34.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:34.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:27:34.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:27:34.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:34.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:27:34.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:27:34.960 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.960 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:34.961 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.961 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:27:34.961 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:34.961 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 264.25205318100001, 2020-11-12T17:27:34.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:27:34.961 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.962 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:34.962 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:34.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:34.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:34.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:34.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:34.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:34.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:34.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:27:34.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:27:34.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:34.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:27:34.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:27:34.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:34.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:27:34.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:27:34.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:27:34.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:27:34.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:34.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:27:34.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:27:34.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:34.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:27:34.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:27:34.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:34.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:27:34.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:27:34.968 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.968 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:34.968 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.969 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:27:34.969 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:34.969 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 256.06193158100001, 2020-11-12T17:27:34.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:27:34.969 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.970 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:34.970 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:34.970 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:34.970 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:34.970 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:27:34.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.971 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:34.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:34.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:34.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:34.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:34.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:27:34.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:34.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:27:34.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:27:34.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:34.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:27:34.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:27:34.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:34.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:27:34.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:27:34.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:27:34.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:27:34.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:34.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:27:34.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:27:34.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:34.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:27:34.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:27:34.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:34.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:27:34.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:27:34.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:34.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:27:34.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:27:34.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:34.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:27:34.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:27:34.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:34.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:27:34.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:27:34.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:34.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:27:34.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:27:34.981 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.981 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:34.981 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.981 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:27:34.982 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:34.982 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 256.05468787199999, 2020-11-12T17:27:34.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:27:34.982 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.982 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:34.982 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:34.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:34.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:34.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:34.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:34.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:34.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:34.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:27:34.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:27:34.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:34.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:27:34.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:27:34.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:34.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:27:34.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:27:34.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:27:34.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:27:34.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:34.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:27:34.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:27:34.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:34.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:27:34.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:27:34.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:34.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:27:34.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:27:34.989 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.989 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:34.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.990 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:34.990 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:34.990 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 180.05859849800001, 2020-11-12T17:27:34.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:27:34.991 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.991 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:34.991 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:34.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:34.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:34.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:34.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:34.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:27:34.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:34.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:27:34.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:27:34.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:34.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:27:34.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:27:34.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:34.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:27:34.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:27:34.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:34.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:27:34.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:27:34.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:34.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:27:34.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:27:34.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:34.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:27:34.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:27:34.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:34.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:27:34.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:27:34.997 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.998 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:34.998 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:34.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:34.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.998 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:27:34.998 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:34.998 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 113.931075986, 2020-11-12T17:27:34.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:27:34.999 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:34.999 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:34.999 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:34.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:34.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:35.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:35.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:35.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:27:35.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:27:35.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:27:35.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:27:35.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:27:35.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:27:35.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:27:35.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:27:35.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:27:35.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:27:35.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:27:35.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:27:35.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:27:35.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:27:35.007 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.008 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.008 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.008 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:35.008 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:35.008 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.882009325, 2020-11-12T17:27:35.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:27:35.009 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.009 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:35.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:35.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:35.009 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:27:35.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.010 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:35.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:35.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:27:35.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:27:35.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:27:35.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:27:35.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:27:35.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:27:35.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:27:35.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:27:35.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:27:35.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:27:35.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:27:35.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:27:35.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:27:35.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:35.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:27:35.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:27:35.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:35.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:27:35.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:27:35.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:35.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:27:35.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:27:35.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:27:35.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:27:35.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:27:35.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:27:35.020 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.021 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.021 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.021 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:35.021 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:35.021 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.880328545, 2020-11-12T17:27:35.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:27:35.022 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.022 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.022 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:35.023 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:35.023 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:35.023 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:27:35.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.023 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:35.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:35.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:35.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:27:35.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:27:35.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:27:35.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:27:35.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:27:35.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:27:35.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:27:35.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:27:35.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:27:35.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:27:35.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:27:35.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:27:35.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:35.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:27:35.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:27:35.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:35.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:27:35.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:27:35.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:35.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:27:35.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:27:35.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:27:35.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:27:35.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:27:35.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:27:35.032 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.032 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.033 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.033 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:35.033 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:35.033 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.88024034999999, 2020-11-12T17:27:35.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:27:35.034 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.034 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.034 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:35.034 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:35.034 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:35.034 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:27:35.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.035 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:35.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:35.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:35.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:27:35.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:27:35.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:27:35.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:27:35.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:27:35.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:27:35.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:27:35.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:27:35.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:27:35.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:27:35.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:27:35.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:27:35.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:35.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:27:35.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:27:35.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:35.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:27:35.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:27:35.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:35.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:27:35.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:27:35.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:27:35.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:27:35.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:27:35.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:27:35.045 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.045 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.045 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.046 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53718 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:35.046 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:35.046 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.861745035, 2020-11-12T17:27:35.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002, 2020-11-12T17:27:35.046 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.046 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:35.047 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:35.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082501+0000", 2020-11-12T17:27:35.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:35.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082465+0000", 2020-11-12T17:27:35.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0159000000000002e-05 2020-11-12T17:27:35.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082555+0000", 2020-11-12T17:27:35.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.363291855 2020-11-12T17:27:35.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445847+0000", 2020-11-12T17:27:35.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6769999999999998e-06 2020-11-12T17:27:35.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445854+0000", 2020-11-12T17:27:35.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013382199999999999 2020-11-12T17:27:35.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.445987+0000", 2020-11-12T17:27:35.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5585000000000001e-05 2020-11-12T17:27:35.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446003+0000", 2020-11-12T17:27:35.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000166346 2020-11-12T17:27:35.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446169+0000", 2020-11-12T17:27:35.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36366846800000002 2020-11-12T17:27:35.053 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.053 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.053 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.054 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:35.054 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:35.054 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.861612045, 2020-11-12T17:27:35.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:27:35.055 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.055 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:35.055 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:35.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:35.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:35.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:27:35.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:27:35.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:27:35.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:27:35.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:27:35.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:27:35.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:27:35.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:27:35.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:27:35.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:27:35.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:27:35.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:27:35.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:27:35.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:27:35.062 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.062 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.062 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.062 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:35.063 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:35.063 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.861527317, 2020-11-12T17:27:35.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:27:35.063 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.063 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:35.063 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:35.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:35.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:35.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:27:35.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:27:35.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:27:35.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:27:35.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:27:35.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:27:35.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:27:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:27:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:27:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:27:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:27:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:27:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:27:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:27:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 74.110704866000006, 2020-11-12T17:27:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:27:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:27:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:27:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:27:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:27:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:27:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:27:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:27:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:27:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:27:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:27:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:27:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:27:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:27:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:27:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:27:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:27:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:27:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:27:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:27:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:27:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:27:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:27:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:27:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 73.024049378000001, 2020-11-12T17:27:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:27:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:27:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:27:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:27:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:27:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:27:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:27:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:27:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:27:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:27:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:27:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:27:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:27:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:27:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:27:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:27:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:27:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:27:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:27:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:27:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 73.010568151000001, 2020-11-12T17:27:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:27:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:27:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:27:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:27:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:27:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:27:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:27:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:27:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:27:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:27:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:27:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:27:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:27:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:27:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:27:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 38.008279948999999, 2020-11-12T17:27:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:27:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:27:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:27:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:27:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:27:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:27:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:27:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:27:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:27:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:27:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:27:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:27:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:27:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:27:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:27:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:27:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:27:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:27:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:27:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:27:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:27:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:27:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:27:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:27:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 38.002463364999997, 2020-11-12T17:27:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:27:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:27:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:27:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:27:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:27:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:27:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:27:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:27:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:27:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:27:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:27:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:27:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:27:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:27:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:27:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:27:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:27:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:27:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:27:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:27:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:27:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:27:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:27:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:27:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:27:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 37.979529851000002, 2020-11-12T17:27:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:27:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:27:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:27:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:27:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:27:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:27:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:27:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:27:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:27:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:27:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:27:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:27:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:27:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:27:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:27:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:27:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:27:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:27:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 31.447051823999999, 2020-11-12T17:27:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:27:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:27:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:27:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:27:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:27:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:27:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:27:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:27:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:27:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:27:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:27:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:27:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:27:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:27:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:27:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:27:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:27:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36040 5.a e149/127 5:5a4d50fb:::benchmark_data_smithi036_24110_object4504:head v 149'2328, mlcod=149'2321)", 2020-11-12T17:27:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 10.408202922999999, 2020-11-12T17:27:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001, 2020-11-12T17:27:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536010+0000", 2020-11-12T17:27:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111983 2020-11-12T17:27:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536122+0000", 2020-11-12T17:27:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40432243400000001 2020-11-12T17:27:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940444+0000", 2020-11-12T17:27:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2870000000000001e-06 2020-11-12T17:27:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940450+0000", 2020-11-12T17:27:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4161999999999999e-05 2020-11-12T17:27:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940524+0000", 2020-11-12T17:27:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4454e-05 2020-11-12T17:27:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940549+0000", 2020-11-12T17:27:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021055879999999998 2020-11-12T17:27:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942654+0000", 2020-11-12T17:27:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5819000000000002e-05 2020-11-12T17:27:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942710+0000", 2020-11-12T17:27:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001 2020-11-12T17:27:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:35.150 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:35.151 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:35.152 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:35.153 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:35.148+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:35.254 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:35.248+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:35.280 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:35.281 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:35.281 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:27:35.281 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:35.293 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:35.319 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:35.355 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:35.350+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:35.355 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:35.383 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:35.416 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:35.423 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:35.423 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:35.424 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:35.424 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:35.424 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:35.437 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:35.446 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:35.456 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:35.452+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:35.480 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:35.508 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:35.542 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:35.545 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:35.546 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:35.546 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:35.546 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:35.546 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:35.546 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:35.547 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:35.547 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:35.557 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:35.552+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:35.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 49 16 45181 45165 7.20029 7.40625 0.0130693 0.0173496 2020-11-12T17:27:35.606 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:35.607 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:35.616 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:35.658 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:35.652+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:35.745 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:35.745 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:35.755 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:35.759 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:35.756+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:35.867 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:35.858+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:35.886 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:35.887 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:35.896 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:35.960 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:35.956+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:36.063 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:36.062+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:36.066 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:36.066 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:36.077 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:36.164 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:36.162+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:36.241 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:36.241 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:36.251 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:36.265 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:36.260+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:36.366 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:36.360+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:36.423 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:36.423 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:36.436 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:36.467 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:36.464+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:36.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 50 16 46146 46130 7.20705 7.53906 0.0175222 0.0173377 2020-11-12T17:27:36.560 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:36.560 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:36.567 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:36.566+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:36.571 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:36.668 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:36.666+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:36.703 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:36.703 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:36.716 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:36.770 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:36.764+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:36.843 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:36.844 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:36.856 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:36.869 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:27:36.899 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:36.896+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:36.971 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:36.968+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:37.035 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:37.036 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:37.046 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:37.087 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:37.084+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:37.174 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:37.168+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:37.224 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:37.224 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:37.235 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:37.283 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:37.280+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:37.375 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:37.370+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:37.411 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:37.411 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:37.422 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:37.476 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:37.472+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:37.549 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:37.550 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:37.558 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:37.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 51 16 47039 47023 7.20252 6.97656 0.0103419 0.0173394 2020-11-12T17:27:37.560 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:37.577 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:37.574+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:37.678 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:37.672+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:37.728 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:37.735 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:37.735 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:37.736 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:37.736 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:37.747 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:37.761 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:37.779 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:37.778+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:37.791 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:37.826 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:37.869 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:37.880 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:37.876+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:37.884 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:27:37.985 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:37.986 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:37.986 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:37.986 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:37.986 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:37.987 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:37.980+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:37.987 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:38.147 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:38.148 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:38.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:38.148 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:38.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.148 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:38.149 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:38.149 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 273.03555336199997, 2020-11-12T17:27:38.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:38.149 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.149 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.149 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.149 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:38.150 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:38.150 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:38.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.150 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:38.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:38.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:38.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:38.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:38.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:38.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:38.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:38.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:38.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:38.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:38.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:38.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:38.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:38.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:38.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:38.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:38.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:38.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:38.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:38.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:38.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:38.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:38.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:38.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:38.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:38.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.159 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.159 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:38.159 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:38.160 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 273.02846156599998, 2020-11-12T17:27:38.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:38.160 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.160 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.160 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:38.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:38.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:38.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:38.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:38.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:38.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:38.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:38.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:38.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:38.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:38.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:38.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:38.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:38.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:38.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:38.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:38.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.166 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.167 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:38.167 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:38.167 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 263.59590206899998, 2020-11-12T17:27:38.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:38.167 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.167 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.168 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.168 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:38.168 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:38.168 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:38.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.168 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:38.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:38.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:38.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:38.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:38.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:38.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:38.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:38.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:38.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:38.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:38.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:38.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:38.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:38.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:38.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:38.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:38.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:38.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:38.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:38.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:38.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:38.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:38.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:38.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:38.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:38.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.177 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.178 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:38.178 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:38.178 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 229.64578197500001, 2020-11-12T17:27:38.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:38.178 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.178 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.178 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:38.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:38.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:38.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:38.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:38.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:38.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:38.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:38.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:38.184 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.184 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.184 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.185 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:38.185 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:38.185 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 227.540180083, 2020-11-12T17:27:38.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:38.185 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.186 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.186 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:38.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:38.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:38.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:38.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:38.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:38.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:38.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:38.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:38.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.193 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 196.193696749, 2020-11-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:38.194 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.195 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.195 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.195 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:38.195 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:38.195 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:38.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.195 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:38.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:38.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:38.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:38.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:38.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:38.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:38.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:38.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:38.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:38.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:38.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:38.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:38.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:38.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:38.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:38.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:38.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:38.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:38.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:38.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:38.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:38.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:38.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:38.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:38.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:38.204 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.204 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.204 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.205 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:38.205 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:38.205 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 187.197854947, 2020-11-12T17:27:38.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:38.205 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.205 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.205 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:38.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:38.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:38.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:38.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:38.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:38.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:38.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:38.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:38.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:38.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:38.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:38.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:38.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:38.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:38.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:38.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:38.211 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.211 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.212 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.212 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:38.212 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:38.212 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 183.26275154800001, 2020-11-12T17:27:38.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:38.212 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.213 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:38.213 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:38.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:38.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:38.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:38.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:38.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:38.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:38.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:38.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:38.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:38.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:38.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:38.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:38.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:38.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:38.218 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.221 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.221 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.222 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:38.222 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:38.222 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 152.49811105699999, 2020-11-12T17:27:38.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:38.222 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.222 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.223 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:38.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:38.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:38.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:38.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:38.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:38.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:38.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:38.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:38.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:38.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:38.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:38.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:38.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:38.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:38.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:38.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:38.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.229 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.230 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:38.230 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:38.230 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 146.24160237300001, 2020-11-12T17:27:38.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:38.230 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.230 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.230 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.230 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:38.231 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:38.231 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:38.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.231 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:38.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:38.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:38.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:38.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:38.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:38.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:38.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:38.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:38.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:38.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:38.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:38.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:38.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:38.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:38.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:38.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:38.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:38.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:38.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:38.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:38.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:38.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:38.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:38.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:38.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:38.240 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.240 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.240 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.240 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:38.240 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:38.241 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 146.24144000300001, 2020-11-12T17:27:38.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:38.241 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.241 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.241 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.241 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:38.241 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:38.242 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:38.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.242 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:38.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:38.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:38.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:38.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:38.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:38.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:38.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:38.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:38.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:38.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:38.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:38.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:38.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:38.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:38.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:38.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:38.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:38.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:38.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:38.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:38.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:38.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:38.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:38.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:38.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:38.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.255 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.255 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:38.256 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:38.256 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 146.23287101599999, 2020-11-12T17:27:38.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:38.256 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.256 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.256 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:38.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:38.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:38.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:38.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:38.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:38.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:38.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:38.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:38.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:38.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:38.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:38.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:38.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:38.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:38.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:38.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:38.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.262 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.263 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.263 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:38.263 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:38.263 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 121.728358566, 2020-11-12T17:27:38.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:38.264 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.264 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.264 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.264 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:38.264 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:38.264 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:38.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.264 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:38.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:38.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:38.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:38.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:38.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:38.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:38.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:38.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:38.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:38.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:38.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:38.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:38.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:38.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:38.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:38.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:38.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:38.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:38.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:38.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:38.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:38.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:38.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:38.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:38.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:38.274 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.274 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.274 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.274 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:38.274 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:38.274 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.24281028, 2020-11-12T17:27:38.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:38.275 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.275 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.275 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.275 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:38.275 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:38.275 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:38.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.276 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:38.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:38.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:38.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:38.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:38.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:38.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:38.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:38.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:38.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:38.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:38.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:38.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:38.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:38.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:38.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:38.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:38.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:38.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:38.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:38.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:38.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:38.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:38.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:38.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:38.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:38.284 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.284 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.284 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.285 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:38.285 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:38.285 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 117.16949184800001, 2020-11-12T17:27:38.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:38.285 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.286 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.286 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:38.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:38.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:38.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:38.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:38.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:38.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:38.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:38.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:38.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:38.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:38.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:38.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:38.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:38.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:38.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:38.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:38.332 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.332 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.332 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.333 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:38.333 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:38.333 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.113846872, 2020-11-12T17:27:38.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:38.333 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.333 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.334 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.334 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:38.334 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:38.334 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:38.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.334 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:38.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:38.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:38.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:38.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:38.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:38.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:38.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:38.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:38.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:38.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:38.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:38.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:38.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:38.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:38.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:38.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:38.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:38.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:38.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:38.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:38.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:38.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:38.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:38.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:38.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:38.343 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.344 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.344 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.344 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:38.344 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:38.344 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.725642501, 2020-11-12T17:27:38.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:38.345 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.345 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:38.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:38.345 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:38.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.346 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:38.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:38.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:38.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:38.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:38.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:38.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:38.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:38.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:38.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:38.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:38.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:38.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:38.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:38.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:38.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:38.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:38.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:38.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:38.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:38.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:38.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:38.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:38.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:38.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:38.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:38.354 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.354 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.354 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.355 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:38.355 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:38.355 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 101.519185569, 2020-11-12T17:27:38.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:38.355 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.356 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.356 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.356 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:38.356 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:38.356 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:38.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.356 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:38.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:38.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:38.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:38.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:38.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:38.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:38.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:38.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:38.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:38.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:38.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:38.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:38.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:38.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:38.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:38.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:38.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:38.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:38.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:38.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:38.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:38.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:38.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:38.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:38.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:38.365 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.365 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.365 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.365 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:38.366 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:38.366 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 100.269979952, 2020-11-12T17:27:38.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:38.366 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.366 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:38.367 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:38.367 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:38.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.367 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:38.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:38.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:38.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:38.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:38.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:38.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:38.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:38.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:38.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:38.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:38.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:38.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 100.253020503, 2020-11-12T17:27:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.384 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:38.385 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:37.882+0000 7f7b4fea9700 -1 osd.4 156 handle_osd_map injecting map crc failure 2020-11-12T17:27:38.386 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:38.086+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:38.386 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:38.386 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:38.386 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:38.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:38.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:38.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:38.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:38.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:38.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:38.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:38.388 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:38.388 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:38.380+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:38.388 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:38.486 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:38.484+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:38.556 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:38.556 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:47679 5.1 e157/127 5:8825ff14:::benchmark_data_smithi036_24110_object5959:head v 157'2967, mlcod=157'2965)", 2020-11-12T17:27:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:38.551907+0000", 2020-11-12T17:27:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0047269599999999997, 2020-11-12T17:27:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047460089999999998, 2020-11-12T17:27:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.551907+0000", 2020-11-12T17:27:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.551907+0000", 2020-11-12T17:27:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.551882+0000", 2020-11-12T17:27:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5710000000000004e-05 2020-11-12T17:27:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.551978+0000", 2020-11-12T17:27:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2026999999999994e-05 2020-11-12T17:27:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.552040+0000", 2020-11-12T17:27:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8170000000000001e-06 2020-11-12T17:27:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.552047+0000", 2020-11-12T17:27:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8545999999999999e-05 2020-11-12T17:27:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.552095+0000", 2020-11-12T17:27:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.349e-05 2020-11-12T17:27:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.552119+0000", 2020-11-12T17:27:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021137200000000001 2020-11-12T17:27:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:47680 5.1 e157/127 5:8825ff14:::benchmark_data_smithi036_24110_object5959:head v 157'2968, mlcod=157'2965)", 2020-11-12T17:27:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:38.553646+0000", 2020-11-12T17:27:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0029885749999999998, 2020-11-12T17:27:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030798750000000001, 2020-11-12T17:27:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.553646+0000", 2020-11-12T17:27:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.553646+0000", 2020-11-12T17:27:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:27:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.553622+0000", 2020-11-12T17:27:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8215999999999997e-05 2020-11-12T17:27:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.553711+0000", 2020-11-12T17:27:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7819000000000003e-05 2020-11-12T17:27:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.553768+0000", 2020-11-12T17:27:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.456e-06 2020-11-12T17:27:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.553777+0000", 2020-11-12T17:27:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1641000000000003e-05 2020-11-12T17:27:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.553819+0000", 2020-11-12T17:27:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2032000000000001e-05 2020-11-12T17:27:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.553851+0000", 2020-11-12T17:27:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020471399999999999 2020-11-12T17:27:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:38.571 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 2 2020-11-12T17:27:38.571 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:38.572 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 52 16 47703 47687 7.16376 5.1875 0.0166864 0.0174375 2020-11-12T17:27:38.572 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:38.615 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:38.612+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:38.688 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:38.686+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:38.739 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:38.739 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:38.740 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:38.740 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:38.740 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:38.750 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:38.789 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:38.786+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:38.857 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:38.940 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:38.941 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-11-12T17:27:38.943 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:38.943 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:38.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:38.943 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:38.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.944 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:38.944 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:38.944 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 264.462295595, 2020-11-12T17:27:38.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:38.944 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.944 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.944 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.945 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:38.945 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:38.945 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:38.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.945 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:38.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:38.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:38.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:38.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:38.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:38.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:38.954 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:38.955 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 264.455351533, 2020-11-12T17:27:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:38.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:38.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:38.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 228.28151374699999, 2020-11-12T17:27:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.963 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.964 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.964 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:38.964 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:38.964 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:38.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.964 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:38.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:38.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:38.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:38.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:38.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:38.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:38.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:38.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:38.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:38.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:38.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:38.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:38.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:38.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:38.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:38.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:38.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:38.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:38.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:38.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:38.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:38.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:38.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:38.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:27:38.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:38.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:27:38.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:27:38.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:38.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:27:38.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:27:38.973 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.973 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:38.973 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:38.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.974 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:27:38.974 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:38.974 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 212.01780865399999, 2020-11-12T17:27:38.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:27:38.974 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:38.975 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:38.975 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:38.975 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:38.975 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:38.975 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:27:38.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.975 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:38.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:38.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:38.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:38.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:38.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:38.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:38.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:38.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:27:38.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:27:38.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:38.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:27:38.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:27:38.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:38.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:27:38.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:27:38.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:38.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:27:38.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:27:38.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:38.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:38.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:38.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:27:39.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:27:39.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:27:39.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:27:39.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:39.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:27:39.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:27:39.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:27:39.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:27:39.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:27:39.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:27:39.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:27:39.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:27:39.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:27:39.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:27:39.010 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.010 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.010 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.011 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:27:39.011 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:39.011 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 196.93242832799999, 2020-11-12T17:27:39.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:27:39.011 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.011 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.012 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:39.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:39.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:39.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:27:39.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:27:39.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:27:39.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:27:39.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:27:39.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:27:39.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:27:39.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:27:39.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:27:39.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:27:39.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:27:39.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:27:39.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:27:39.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:27:39.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:27:39.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:27:39.018 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.018 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.019 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.019 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:27:39.019 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:39.019 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 195.238290054, 2020-11-12T17:27:39.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:27:39.019 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.020 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.020 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.020 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:39.020 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:39.020 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:27:39.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.020 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:39.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:39.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:39.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:27:39.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:27:39.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:27:39.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:27:39.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:27:39.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:27:39.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:27:39.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:27:39.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:27:39.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:27:39.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:27:39.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:27:39.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:39.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:27:39.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:27:39.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:27:39.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:27:39.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:27:39.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:27:39.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:27:39.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.029 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.030 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:27:39.030 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:39.030 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.56905133199999, 2020-11-12T17:27:39.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:27:39.030 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:39.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:39.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:27:39.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:27:39.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:27:39.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:27:39.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:27:39.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:27:39.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:27:39.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:27:39.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:27:39.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:27:39.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:27:39.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:27:39.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:39.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:27:39.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:27:39.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:27:39.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:27:39.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:27:39.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:27:39.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:27:39.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:27:39.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:27:39.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:27:39.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.040 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.041 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:27:39.041 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:39.041 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.55587457300001, 2020-11-12T17:27:39.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:27:39.041 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.041 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:39.041 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:39.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:39.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:39.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:27:39.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:27:39.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:27:39.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:27:39.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:27:39.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:27:39.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:27:39.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:27:39.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:27:39.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:27:39.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:27:39.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:27:39.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:27:39.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:27:39.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.048 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.048 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.048 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:27:39.048 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:39.048 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 133.00179312399999, 2020-11-12T17:27:39.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:27:39.049 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.049 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.049 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.049 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:39.049 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.049 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:27:39.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.050 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:39.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:39.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:27:39.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:27:39.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:27:39.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:27:39.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:27:39.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:27:39.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:27:39.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:27:39.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:27:39.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:27:39.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:27:39.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:27:39.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:27:39.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:39.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:27:39.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:27:39.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:27:39.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:27:39.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:27:39.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:27:39.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:27:39.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:27:39.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:27:39.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:27:39.058 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.058 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.058 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.059 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:27:39.059 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:39.059 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.99280581799999, 2020-11-12T17:27:39.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:27:39.059 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.059 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:39.060 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:39.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:39.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:39.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:27:39.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:27:39.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:27:39.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:27:39.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:27:39.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:27:39.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:27:39.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:27:39.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:27:39.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:27:39.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:27:39.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:27:39.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:27:39.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:27:39.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.066 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.066 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.066 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:27:39.066 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:39.066 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.974878504, 2020-11-12T17:27:39.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:27:39.067 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.067 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.067 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.067 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:39.067 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.067 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:27:39.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.068 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:39.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:39.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:39.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:27:39.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:27:39.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:27:39.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:27:39.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:27:39.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:27:39.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:27:39.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:27:39.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:27:39.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:27:39.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:27:39.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:27:39.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:39.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:27:39.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:27:39.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:27:39.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:27:39.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:27:39.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:27:39.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:27:39.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:27:39.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:27:39.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:27:39.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.079 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.079 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.079 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:39.079 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:39.079 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.172439606, 2020-11-12T17:27:39.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:27:39.080 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.080 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:39.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.080 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:27:39.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.081 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:39.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:39.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:39.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:27:39.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:27:39.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:27:39.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:27:39.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:27:39.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:27:39.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:27:39.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:27:39.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:27:39.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:27:39.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:27:39.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:27:39.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:39.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:27:39.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:27:39.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:27:39.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:27:39.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:27:39.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:27:39.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:27:39.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:27:39.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:27:39.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:27:39.089 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.089 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.090 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.090 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:39.090 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:39.090 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.093317289, 2020-11-12T17:27:39.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:27:39.090 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.091 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:39.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.091 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:27:39.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.091 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:39.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:39.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:39.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:27:39.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:27:39.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:27:39.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:27:39.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:27:39.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:27:39.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:27:39.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:27:39.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:27:39.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:27:39.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:27:39.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:27:39.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:39.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:27:39.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:27:39.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:27:39.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:27:39.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:27:39.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:27:39.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:27:39.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:27:39.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:27:39.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:27:39.101 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.101 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.101 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.102 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:27:39.102 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:39.102 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 97.310966321999999, 2020-11-12T17:27:39.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:27:39.102 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.103 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:39.103 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.103 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:27:39.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.103 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:39.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:39.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:27:39.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:27:39.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:27:39.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:27:39.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:27:39.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:27:39.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:27:39.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:27:39.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:27:39.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:27:39.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:27:39.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:27:39.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:27:39.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:39.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:27:39.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:27:39.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:27:39.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:27:39.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:27:39.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:27:39.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:27:39.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:27:39.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:27:39.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:27:39.114 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.114 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.114 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.114 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:27:39.114 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:39.115 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.847923972999993, 2020-11-12T17:27:39.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:27:39.115 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.115 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.115 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.115 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:39.115 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.116 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:27:39.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.116 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:39.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:39.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:27:39.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:27:39.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:27:39.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:27:39.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:27:39.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:27:39.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:27:39.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:27:39.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:27:39.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:27:39.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:27:39.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:27:39.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:27:39.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:39.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:27:39.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:27:39.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:27:39.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:27:39.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:27:39.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:27:39.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:27:39.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:27:39.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:27:39.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:27:39.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.168 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.168 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:39.168 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:39.169 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 36.826164822000003, 2020-11-12T17:27:39.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:27:39.169 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.169 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.169 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.169 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:39.169 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:39.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:39.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:39.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:27:39.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:27:39.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:27:39.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:27:39.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:27:39.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:27:39.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:27:39.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:27:39.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:27:39.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:27:39.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:27:39.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:27:39.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:27:39.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:27:39.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:27:39.179 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.179 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.179 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.179 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35048 5.1 e148/127 5:8e34dcfa:::benchmark_data_smithi036_24110_object4380:head v 148'2280, mlcod=148'2275)", 2020-11-12T17:27:39.179 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:39.180 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.521226003000001, 2020-11-12T17:27:39.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002, 2020-11-12T17:27:39.180 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.180 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.180 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:39.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:39.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:39.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359524+0000", 2020-11-12T17:27:39.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.064e-05 2020-11-12T17:27:39.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359605+0000", 2020-11-12T17:27:39.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34493079599999998 2020-11-12T17:27:39.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704536+0000", 2020-11-12T17:27:39.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2110000000000001e-06 2020-11-12T17:27:39.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704543+0000", 2020-11-12T17:27:39.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1071999999999998e-05 2020-11-12T17:27:39.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704634+0000", 2020-11-12T17:27:39.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2281999999999998e-05 2020-11-12T17:27:39.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704696+0000", 2020-11-12T17:27:39.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034977459999999999 2020-11-12T17:27:39.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708194+0000", 2020-11-12T17:27:39.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1390000000000006e-05 2020-11-12T17:27:39.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708265+0000", 2020-11-12T17:27:39.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002 2020-11-12T17:27:39.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.189 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.189 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.189 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35144 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:39.190 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:39.190 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 15.313620105, 2020-11-12T17:27:39.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998, 2020-11-12T17:27:39.190 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.190 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.190 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.190 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:39.191 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:39.191 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35144 2020-11-12T17:27:39.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.191 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:39.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:39.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:39.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567086+0000", 2020-11-12T17:27:39.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017142700000000001 2020-11-12T17:27:39.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567257+0000", 2020-11-12T17:27:39.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1043000000000002e-05 2020-11-12T17:27:39.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567278+0000", 2020-11-12T17:27:39.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1214e-05 2020-11-12T17:27:39.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567289+0000", 2020-11-12T17:27:39.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142698779 2020-11-12T17:27:39.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.709988+0000", 2020-11-12T17:27:39.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4704999999999995e-05 2020-11-12T17:27:39.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710083+0000", 2020-11-12T17:27:39.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016350300000000001 2020-11-12T17:27:39.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:39.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710246+0000", 2020-11-12T17:27:39.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002268946 2020-11-12T17:27:39.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.712515+0000", 2020-11-12T17:27:39.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199261574 2020-11-12T17:27:39.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911777+0000", 2020-11-12T17:27:39.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0816999999999996e-05 2020-11-12T17:27:39.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911858+0000", 2020-11-12T17:27:39.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2182000000000003e-05 2020-11-12T17:27:39.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911910+0000", 2020-11-12T17:27:39.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998 2020-11-12T17:27:39.200 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.200 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.200 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.201 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:39.201 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:39.201 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.764805151999999, 2020-11-12T17:27:39.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:27:39.201 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.201 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.202 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.202 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:39.202 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:39.202 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:27:39.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.202 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:39.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:39.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:39.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:27:39.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:27:39.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:27:39.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:27:39.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:27:39.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:27:39.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:27:39.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:27:39.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:27:39.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:27:39.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:27:39.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:27:39.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:39.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:27:39.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:27:39.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:27:39.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:27:39.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:27:39.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:27:39.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:27:39.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:27:39.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.211 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:27:39.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:27:39.211 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.211 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.211 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.212 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36416 5.0 5:05125f34:::benchmark_data_smithi036_24110_object4551:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:39.212 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:39.212 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.907077127000001, 2020-11-12T17:27:39.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002, 2020-11-12T17:27:39.212 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:39.212 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:39.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:39.213 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:39.213 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36416 2020-11-12T17:27:39.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.213 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:39.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:39.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:39.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:39.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:39.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:39.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:27:39.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:39.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973666+0000", 2020-11-12T17:27:39.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117633 2020-11-12T17:27:39.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:39.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973783+0000", 2020-11-12T17:27:39.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6325999999999999e-05 2020-11-12T17:27:39.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:39.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973800+0000", 2020-11-12T17:27:39.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:27:39.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973807+0000", 2020-11-12T17:27:39.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054509620000000002 2020-11-12T17:27:39.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:39.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979258+0000", 2020-11-12T17:27:39.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1768999999999996e-05 2020-11-12T17:27:39.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:39.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979340+0000", 2020-11-12T17:27:39.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107278 2020-11-12T17:27:39.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:39.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979447+0000", 2020-11-12T17:27:39.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005025753 2020-11-12T17:27:39.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:39.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.984473+0000", 2020-11-12T17:27:39.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35634463199999999 2020-11-12T17:27:39.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340818+0000", 2020-11-12T17:27:39.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3640000000000001e-05 2020-11-12T17:27:39.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:39.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340871+0000", 2020-11-12T17:27:39.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2222999999999998e-05 2020-11-12T17:27:39.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:39.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340924+0000", 2020-11-12T17:27:39.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002 2020-11-12T17:27:39.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.222 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.222 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.223 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:39.223 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:39.224 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:38.936+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:39.225 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:39.222+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:39.326 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:39.324+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:39.356 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:39.356 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:39.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.356 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:48392 5.a e157/127 5:5a85539a:::benchmark_data_smithi036_24110_object6048:head v 157'3128, mlcod=157'3123)", 2020-11-12T17:27:39.357 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:39.356730+0000", 2020-11-12T17:27:39.357 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00119235, 2020-11-12T17:27:39.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001214538, 2020-11-12T17:27:39.357 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.357 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:39.357 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.356730+0000", 2020-11-12T17:27:39.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.356730+0000", 2020-11-12T17:27:39.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:39.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.356715+0000", 2020-11-12T17:27:39.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4289000000000001e-05 2020-11-12T17:27:39.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.356769+0000", 2020-11-12T17:27:39.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2194999999999999e-05 2020-11-12T17:27:39.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.356801+0000", 2020-11-12T17:27:39.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5029999999999997e-06 2020-11-12T17:27:39.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.356807+0000", 2020-11-12T17:27:39.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9845999999999997e-05 2020-11-12T17:27:39.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.356856+0000", 2020-11-12T17:27:39.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6829999999999999e-05 2020-11-12T17:27:39.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.356883+0000", 2020-11-12T17:27:39.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000153559 2020-11-12T17:27:39.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.364 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.364 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.364 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.364 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:39.365 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:27:39.365 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:39.368 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:39.428 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:39.426+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:39.497 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:39.498 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:39.498 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:39.498 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:39.498 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:39.510 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:39.529 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:39.524+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:27:39.547 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 157, 2020-11-12T17:27:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:27:39.547 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2020-11-12T17:22:37.581394+0000", 2020-11-12T17:27:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2020-11-12T17:27:37.863386+0000", 2020-11-12T17:27:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2020-11-12T17:25:55.942493+0000", 2020-11-12T17:27:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2020-11-12T17:26:59.574280+0000", 2020-11-12T17:27:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-12T17:27:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2020-11-12T17:27:39.548 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2020-11-12T17:27:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2020-11-12T17:27:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2020-11-12T17:27:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2020-11-12T17:27:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2020-11-12T17:27:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 4, 2020-11-12T17:27:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2020-11-12T17:27:39.549 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-12T17:27:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-12T17:27:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2020-11-12T17:27:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 5, 2020-11-12T17:27:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2020-11-12T17:27:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2020-11-12T17:27:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2020-11-12T17:27:39.550 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2020-11-12T17:27:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2020-11-12T17:27:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2020-11-12T17:27:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2020-11-12T17:27:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:41.596657+0000", 2020-11-12T17:27:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:27:39.551 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:27:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:27:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:27:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:27:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:27:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:27:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:27:39.552 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2020-11-12T17:27:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2020-11-12T17:27:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2020-11-12T17:27:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2020-11-12T17:27:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2020-11-12T17:27:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:27:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:27:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:27:39.553 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:27:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:27:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:27:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:27:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "16", 2020-11-12T17:27:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:27:39.554 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:27:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:27:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:27:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:27:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:27:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:27:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:27:39.555 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:27:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:27:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:27:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:27:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:27:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:27:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:27:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:27:39.556 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:27:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:27:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:27:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:27:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:27:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:27:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:27:39.557 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:27:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:27:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:27:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:27:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:27:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:27:39.558 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:27:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:27:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:27:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:27:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:27:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:27:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:27:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:27:39.559 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2020-11-12T17:27:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2020-11-12T17:27:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:27:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2020-11-12T17:27:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2020-11-12T17:27:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2020-11-12T17:27:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:49.905816+0000", 2020-11-12T17:27:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:27:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:27:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:27:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:27:39.561 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:27:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:27:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:27:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:27:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2020-11-12T17:27:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2020-11-12T17:27:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2020-11-12T17:27:39.562 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2020-11-12T17:27:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2020-11-12T17:27:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:27:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:27:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:27:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:27:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:27:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:27:39.563 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:27:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "19", 2020-11-12T17:27:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:27:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:27:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:27:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:27:39.564 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:27:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:27:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:27:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:27:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:27:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:27:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:27:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:27:39.565 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:27:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:27:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:27:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:27:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:27:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:27:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:27:39.566 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:27:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:27:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:27:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:27:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:27:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:27:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:27:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.567 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:27:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:27:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:27:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:27:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:27:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:27:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:27:39.568 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:27:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:27:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:27:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:27:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:27:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:27:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2020-11-12T17:27:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 5, 2020-11-12T17:27:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "unique_pool_2", 2020-11-12T17:27:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:26:43.854598+0000", 2020-11-12T17:27:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:27:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:27:39.570 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:27:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:27:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:27:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:27:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:27:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:27:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 16, 2020-11-12T17:27:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 16, 2020-11-12T17:27:39.571 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 16, 2020-11-12T17:27:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 16, 2020-11-12T17:27:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 16, 2020-11-12T17:27:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:27:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:27:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:27:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:27:39.572 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:27:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:27:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:27:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "129", 2020-11-12T17:27:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:27:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:27:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:27:39.573 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:27:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:27:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:27:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:27:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:27:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:27:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:27:39.574 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:27:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:27:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:27:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:27:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:27:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:27:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:27:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:27:39.575 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:27:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:27:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:27:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:27:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:27:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:27:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:27:39.576 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:27:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:27:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:27:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:27:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:27:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:27:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:27:39.577 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:27:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:27:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:27:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:27:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:27:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:27:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:27:39.578 INFO:teuthology.orchestra.run.smithi036.stdout: "rados": {} 2020-11-12T17:27:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2020-11-12T17:27:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:27:39.579 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "bd1d5457-5d54-4074-b378-9da417f42976", 2020-11-12T17:27:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 0, 2020-11-12T17:27:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 0, 2020-11-12T17:27:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:39.580 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 69, 2020-11-12T17:27:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.581 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6801", 2020-11-12T17:27:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:27:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2020-11-12T17:27:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:27:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:39.583 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2020-11-12T17:27:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:27:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2020-11-12T17:27:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:27:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.585 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6801/12304", 2020-11-12T17:27:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6802/12304", 2020-11-12T17:27:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6806/12304", 2020-11-12T17:27:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6804/12304", 2020-11-12T17:27:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:39.586 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:27:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "37152eee-a8d8-40f1-8e27-2899e7b94c98", 2020-11-12T17:27:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:39.587 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:27:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 57, 2020-11-12T17:27:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 88, 2020-11-12T17:27:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 151, 2020-11-12T17:27:39.588 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 58, 2020-11-12T17:27:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2020-11-12T17:27:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:27:39.589 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.590 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2020-11-12T17:27:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:27:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2020-11-12T17:27:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:27:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.592 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2020-11-12T17:27:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:27:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/20274", 2020-11-12T17:27:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6814/20274", 2020-11-12T17:27:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6816/20274", 2020-11-12T17:27:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6815/20274", 2020-11-12T17:27:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:39.594 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:27:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "d8ec2abb-38bf-4863-969a-482c4fa44f41", 2020-11-12T17:27:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:39.595 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:27:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 93, 2020-11-12T17:27:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 102, 2020-11-12T17:27:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 151, 2020-11-12T17:27:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 94, 2020-11-12T17:27:39.596 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2020-11-12T17:27:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:27:39.597 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2020-11-12T17:27:39.598 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:27:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.599 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2020-11-12T17:27:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:27:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2020-11-12T17:27:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:27:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.601 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/21493", 2020-11-12T17:27:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/21493", 2020-11-12T17:27:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6808/21493", 2020-11-12T17:27:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/21493", 2020-11-12T17:27:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:27:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "799d3499-577c-4510-a00c-9b2e126fc449", 2020-11-12T17:27:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:39.603 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:27:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:39.604 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2020-11-12T17:27:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:27:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2020-11-12T17:27:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:27:39.606 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.607 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2020-11-12T17:27:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:27:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.608 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2020-11-12T17:27:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:27:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6809/12305", 2020-11-12T17:27:39.609 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6810/12305", 2020-11-12T17:27:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6813/12305", 2020-11-12T17:27:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6811/12305", 2020-11-12T17:27:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:27:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "c36e3100-aadc-4117-b495-24fb08a34148", 2020-11-12T17:27:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:39.611 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 151, 2020-11-12T17:27:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:39.612 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6804", 2020-11-12T17:27:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:27:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.613 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6805", 2020-11-12T17:27:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:27:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.614 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6807", 2020-11-12T17:27:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:27:39.615 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.616 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6806", 2020-11-12T17:27:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:27:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6804/12499", 2020-11-12T17:27:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6805/12499", 2020-11-12T17:27:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6807/12499", 2020-11-12T17:27:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6806/12499", 2020-11-12T17:27:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.618 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:27:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "b152141f-b530-448e-8dff-fe200559eff0", 2020-11-12T17:27:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:39.619 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:27:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.620 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6808", 2020-11-12T17:27:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:27:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:39.621 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6810", 2020-11-12T17:27:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:27:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.622 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6814", 2020-11-12T17:27:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:27:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.623 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6812", 2020-11-12T17:27:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:27:39.624 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6808/12525", 2020-11-12T17:27:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6810/12525", 2020-11-12T17:27:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6814/12525", 2020-11-12T17:27:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6812/12525", 2020-11-12T17:27:39.625 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:27:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "62a140ba-7f94-4bb6-8a62-fda077f81354", 2020-11-12T17:27:39.626 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:27:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:39.627 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 151, 2020-11-12T17:27:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6809", 2020-11-12T17:27:39.628 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:27:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.629 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6811", 2020-11-12T17:27:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:27:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6815", 2020-11-12T17:27:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:27:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.631 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6813", 2020-11-12T17:27:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:27:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6809/12524", 2020-11-12T17:27:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6811/12524", 2020-11-12T17:27:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6815/12524", 2020-11-12T17:27:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6813/12524", 2020-11-12T17:27:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:39.633 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:27:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "32879bd7-780c-4da6-9838-5850b6277902", 2020-11-12T17:27:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:27:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:27:39.634 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:27:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 0, 2020-11-12T17:27:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:27:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:27:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:27:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:27:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:27:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:27:39.635 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:27:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6800", 2020-11-12T17:27:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:27:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.636 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:27:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6801", 2020-11-12T17:27:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:27:39.637 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:27:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.638 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6803", 2020-11-12T17:27:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:27:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:27:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:27:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.639 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:27:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6802", 2020-11-12T17:27:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:27:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6800/12522", 2020-11-12T17:27:39.640 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6801/12522", 2020-11-12T17:27:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6803/12522", 2020-11-12T17:27:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6802/12522", 2020-11-12T17:27:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:27:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:27:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:27:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.641 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2020-11-12T17:27:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:27:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:39.642 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 65536, 2020-11-12T17:27:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:44.321824+0000", 2020-11-12T17:27:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:27:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:39.643 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:33.512821+0000", 2020-11-12T17:27:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 58 2020-11-12T17:27:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:27:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:56.979234+0000", 2020-11-12T17:27:39.645 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 94 2020-11-12T17:27:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:27:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:39.646 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:46.505759+0000", 2020-11-12T17:27:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:27:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:39.647 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:45.395865+0000", 2020-11-12T17:27:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.648 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:27:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:47.060879+0000", 2020-11-12T17:27:39.649 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:27:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:39.650 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:44.435814+0000", 2020-11-12T17:27:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:27:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:27:39.651 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:27:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:27:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:27:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:27:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:26:45.631568+0000", 2020-11-12T17:27:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:27:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.652 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2020-11-12T17:27:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2020-11-12T17:27:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2020-11-12T17:27:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2020-11-12T17:27:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2020-11-12T17:27:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2020-11-12T17:27:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2020-11-12T17:27:39.653 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2020-11-12T17:27:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2020-11-12T17:27:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2020-11-12T17:27:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2020-11-12T17:27:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2020-11-12T17:27:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2020-11-12T17:27:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:39.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2020-11-12T17:27:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2020-11-12T17:27:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2020-11-12T17:27:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2020-11-12T17:27:39.655 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2020-11-12T17:27:39.655 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:39.657 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 53 16 48607 48591 7.16184 7.0625 0.0146511 0.0174444 2020-11-12T17:27:39.658 INFO:tasks.thrashosds.thrasher:j is {'epoch': 157, 'fsid': '8c8a6bcc-49d4-47d1-904f-e20798ef8e1f', 'created': '2020-11-12T17:22:37.581394+0000', 'modified': '2020-11-12T17:27:37.863386+0000', 'last_up_change': '2020-11-12T17:25:55.942493+0000', 'last_in_change': '2020-11-12T17:26:59.574280+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'unique_pool_2', 'create_time': '2020-11-12T17:26:43.854598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'bd1d5457-5d54-4074-b378-9da417f42976', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6801', 'nonce': 12304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6802', 'nonce': 12304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6806', 'nonce': 12304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6804', 'nonce': 12304}]}, 'public_addr': '172.21.15.36:6801/12304', 'cluster_addr': '172.21.15.36:6802/12304', 'heartbeat_back_addr': '172.21.15.36:6806/12304', 'heartbeat_front_addr': '172.21.15.36:6804/12304', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '37152eee-a8d8-40f1-8e27-2899e7b94c98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 57, 'up_from': 88, 'up_thru': 151, 'down_at': 58, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6812', 'nonce': 20274}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6814', 'nonce': 20274}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6816', 'nonce': 20274}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6815', 'nonce': 20274}]}, 'public_addr': '172.21.15.36:6812/20274', 'cluster_addr': '172.21.15.36:6814/20274', 'heartbeat_back_addr': '172.21.15.36:6816/20274', 'heartbeat_front_addr': '172.21.15.36:6815/20274', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd8ec2abb-38bf-4863-969a-482c4fa44f41', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 93, 'up_from': 102, 'up_thru': 151, 'down_at': 94, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6803', 'nonce': 21493}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6805', 'nonce': 21493}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6808', 'nonce': 21493}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6807', 'nonce': 21493}]}, 'public_addr': '172.21.15.36:6803/21493', 'cluster_addr': '172.21.15.36:6805/21493', 'heartbeat_back_addr': '172.21.15.36:6808/21493', 'heartbeat_front_addr': '172.21.15.36:6807/21493', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '799d3499-577c-4510-a00c-9b2e126fc449', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6809', 'nonce': 12305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6810', 'nonce': 12305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6813', 'nonce': 12305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6811', 'nonce': 12305}]}, 'public_addr': '172.21.15.36:6809/12305', 'cluster_addr': '172.21.15.36:6810/12305', 'heartbeat_back_addr': '172.21.15.36:6813/12305', 'heartbeat_front_addr': '172.21.15.36:6811/12305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c36e3100-aadc-4117-b495-24fb08a34148', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 151, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6804', 'nonce': 12499}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6805', 'nonce': 12499}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6807', 'nonce': 12499}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6806', 'nonce': 12499}]}, 'public_addr': '172.21.15.205:6804/12499', 'cluster_addr': '172.21.15.205:6805/12499', 'heartbeat_back_addr': '172.21.15.205:6807/12499', 'heartbeat_front_addr': '172.21.15.205:6806/12499', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b152141f-b530-448e-8dff-fe200559eff0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6808', 'nonce': 12525}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6810', 'nonce': 12525}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6814', 'nonce': 12525}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6812', 'nonce': 12525}]}, 'public_addr': '172.21.15.205:6808/12525', 'cluster_addr': '172.21.15.205:6810/12525', 'heartbeat_back_addr': '172.21.15.205:6814/12525', 'heartbeat_front_addr': '172.21.15.205:6812/12525', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '62a140ba-7f94-4bb6-8a62-fda077f81354', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 151, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6809', 'nonce': 12524}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6811', 'nonce': 12524}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6815', 'nonce': 12524}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6813', 'nonce': 12524}]}, 'public_addr': '172.21.15.205:6809/12524', 'cluster_addr': '172.21.15.205:6811/12524', 'heartbeat_back_addr': '172.21.15.205:6815/12524', 'heartbeat_front_addr': '172.21.15.205:6813/12524', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '32879bd7-780c-4da6-9838-5850b6277902', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6800', 'nonce': 12522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6801', 'nonce': 12522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6803', 'nonce': 12522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6802', 'nonce': 12522}]}, 'public_addr': '172.21.15.205:6800/12522', 'cluster_addr': '172.21.15.205:6801/12522', 'heartbeat_back_addr': '172.21.15.205:6803/12522', 'heartbeat_front_addr': '172.21.15.205:6802/12522', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 65536, 'last_purged_snaps_scrub': '2020-11-12T17:26:44.321824+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:33.512821+0000', 'dead_epoch': 58}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:56.979234+0000', 'dead_epoch': 94}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:46.505759+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:45.395865+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:47.060879+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:44.435814+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:26:45.631568+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-11-12T17:27:39.658 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:27:39.659 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:39.654+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:39.768 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:39.766+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:39.801 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:39.801 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:39.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:27:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 269.10092179200001, 2020-11-12T17:27:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:27:39.802 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:27:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.803 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:27:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:27:39.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:27:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:27:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:27:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:27:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:27:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:27:39.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:27:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:27:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:27:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:27:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:27:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:27:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:27:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:27:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:27:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:27:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:27:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:27:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:27:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:27:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:27:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 269.09544172300002, 2020-11-12T17:27:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:27:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:39.813 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:27:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:27:39.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:27:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:27:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:27:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:27:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:27:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:27:39.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:27:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:27:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:27:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:27:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:27:39.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:27:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:27:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:39.820 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 260.90532012300002, 2020-11-12T17:27:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:27:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:27:39.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:27:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:27:39.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:27:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:27:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:27:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:27:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:27:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:27:39.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:27:39.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:27:39.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:27:39.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:27:39.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:27:39.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:39.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:27:39.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:27:39.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:27:39.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:27:39.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:27:39.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:27:39.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:27:39.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:27:39.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:27:39.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:27:39.830 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.830 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.831 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.831 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:27:39.831 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:39.831 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 260.898076414, 2020-11-12T17:27:39.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:27:39.832 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.832 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:39.832 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:39.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:39.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:39.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:27:39.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:27:39.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:27:39.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:27:39.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:27:39.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:27:39.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:27:39.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:27:39.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:27:39.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:27:39.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:27:39.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:27:39.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:27:39.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:27:39.838 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.838 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.838 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.838 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:39.839 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:39.839 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 184.90198703999999, 2020-11-12T17:27:39.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:27:39.839 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.839 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:39.839 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:39.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:39.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:27:39.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:27:39.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:27:39.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:27:39.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:27:39.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:27:39.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:27:39.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:27:39.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:27:39.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:27:39.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:27:39.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:27:39.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:27:39.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:27:39.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:27:39.845 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.845 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.845 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.846 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:27:39.846 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:39.846 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 118.774464528, 2020-11-12T17:27:39.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:27:39.846 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.846 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:39.847 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:39.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:39.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:39.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:27:39.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:27:39.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:27:39.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:27:39.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:27:39.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:27:39.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:27:39.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:27:39.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:27:39.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:27:39.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:27:39.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:27:39.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:27:39.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:27:39.853 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.853 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.853 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.853 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:39.853 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:39.853 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 111.725397867, 2020-11-12T17:27:39.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:27:39.854 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.854 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.854 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.854 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:39.854 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.854 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:27:39.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.855 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:39.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:39.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:27:39.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:27:39.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:27:39.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:27:39.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:27:39.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:27:39.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:27:39.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:27:39.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:27:39.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:27:39.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:27:39.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:27:39.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:27:39.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:39.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:27:39.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:27:39.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:27:39.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:27:39.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:27:39.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:27:39.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:27:39.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:27:39.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:27:39.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:27:39.863 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.863 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.863 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.864 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:39.864 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:39.864 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 111.723717087, 2020-11-12T17:27:39.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:27:39.864 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.864 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.865 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.865 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:39.865 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.865 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:27:39.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.865 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:39.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:39.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:39.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:27:39.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:27:39.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:27:39.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:27:39.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:27:39.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:27:39.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:27:39.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:27:39.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:27:39.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:27:39.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:27:39.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:27:39.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:39.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:27:39.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:27:39.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:27:39.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:27:39.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:27:39.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:27:39.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:27:39.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:27:39.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:27:39.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:27:39.874 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.874 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.874 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.874 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:39.875 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:39.875 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 111.72362889199999, 2020-11-12T17:27:39.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:27:39.875 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.875 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.875 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.875 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:39.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.876 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:27:39.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.876 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:39.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:39.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:39.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:27:39.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:27:39.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:27:39.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:27:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:27:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:27:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:27:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:27:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:27:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:27:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:27:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:27:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:27:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:27:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:27:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:27:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:27:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:27:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:27:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:27:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:27:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:27:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 111.705000587, 2020-11-12T17:27:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:27:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:27:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:27:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:27:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:27:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:27:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:27:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:27:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:27:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:27:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:27:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:27:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:27:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:27:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:27:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 111.704915859, 2020-11-12T17:27:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:27:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:27:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:27:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:27:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 78.954093408000006, 2020-11-12T17:27:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:27:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:27:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:27:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:27:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:27:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:27:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:27:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:27:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:27:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:27:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:27:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:27:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:27:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:27:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:27:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:27:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:27:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:27:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:27:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:27:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:27:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:27:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:27:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:27:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.86743792, 2020-11-12T17:27:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:27:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:27:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:27:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:27:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:27:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:27:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:27:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:27:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:27:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:27:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:27:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:27:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:27:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:27:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:27:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:27:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:27:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:27:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:27:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:27:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:27:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:27:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:27:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:27:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:27:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 77.853956693000001, 2020-11-12T17:27:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:27:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:27:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:27:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:27:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:27:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:27:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:27:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:27:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:27:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:27:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:27:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:27:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:27:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:27:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:27:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 42.851668490999998, 2020-11-12T17:27:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:27:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:27:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:27:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:27:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:27:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:27:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:27:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:27:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:27:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:27:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:27:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:27:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:27:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:27:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:27:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:27:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:27:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:27:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:27:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:27:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:27:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:27:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:27:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:27:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 42.845851906999997, 2020-11-12T17:27:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:27:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:27:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:27:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:27:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:27:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:27:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:27:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:27:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:27:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:27:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:27:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:27:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:27:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:27:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:27:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:27:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:27:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:27:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:27:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:27:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:27:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:27:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:27:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:27:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:27:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 42.822918393000002, 2020-11-12T17:27:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:27:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:27:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:27:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:27:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:27:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:27:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:27:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:27:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:27:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:27:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:27:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:27:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:27:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:27:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:27:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:27:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:27:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:27:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.290440365999999, 2020-11-12T17:27:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:27:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:27:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:27:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:27:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:27:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:27:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:27:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:27:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:27:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:27:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:27:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:27:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:27:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:27:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:27:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:27:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:27:39.969 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36040 5.a e149/127 5:5a4d50fb:::benchmark_data_smithi036_24110_object4504:head v 149'2328, mlcod=149'2321)", 2020-11-12T17:27:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:39.977 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 15.251591465000001, 2020-11-12T17:27:39.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001, 2020-11-12T17:27:39.977 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.977 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.977 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536010+0000", 2020-11-12T17:27:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111983 2020-11-12T17:27:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536122+0000", 2020-11-12T17:27:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40432243400000001 2020-11-12T17:27:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940444+0000", 2020-11-12T17:27:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2870000000000001e-06 2020-11-12T17:27:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940450+0000", 2020-11-12T17:27:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4161999999999999e-05 2020-11-12T17:27:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940524+0000", 2020-11-12T17:27:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4454e-05 2020-11-12T17:27:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940549+0000", 2020-11-12T17:27:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021055879999999998 2020-11-12T17:27:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942654+0000", 2020-11-12T17:27:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5819000000000002e-05 2020-11-12T17:27:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942710+0000", 2020-11-12T17:27:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001 2020-11-12T17:27:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:47376 5.1 5:83c83455:::benchmark_data_smithi036_24110_object5921:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e157)", 2020-11-12T17:27:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.9072066560000001, 2020-11-12T17:27:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37640681799999998, 2020-11-12T17:27:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 47376 2020-11-12T17:27:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999275 2020-11-12T17:27:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880356+0000", 2020-11-12T17:27:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017950299999999999 2020-11-12T17:27:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880535+0000", 2020-11-12T17:27:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9902e-05 2020-11-12T17:27:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880555+0000", 2020-11-12T17:27:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8499999999999994e-06 2020-11-12T17:27:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880563+0000", 2020-11-12T17:27:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054088549999999997 2020-11-12T17:27:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.885972+0000", 2020-11-12T17:27:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0757999999999999e-05 2020-11-12T17:27:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:27:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.885982+0000", 2020-11-12T17:27:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36075470199999998 2020-11-12T17:27:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.246737+0000", 2020-11-12T17:27:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000118664 2020-11-12T17:27:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.246856+0000", 2020-11-12T17:27:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020966600000000001 2020-11-12T17:27:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.247065+0000", 2020-11-12T17:27:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005823791 2020-11-12T17:27:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.252889+0000", 2020-11-12T17:27:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038221399999999999 2020-11-12T17:27:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256711+0000", 2020-11-12T17:27:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5609000000000001e-05 2020-11-12T17:27:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256787+0000", 2020-11-12T17:27:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7657999999999997e-05 2020-11-12T17:27:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256835+0000", 2020-11-12T17:27:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37640681799999998 2020-11-12T17:27:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.997 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:39.997 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:39.997 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:39.997 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:39.998 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:27:39.999 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:39.906+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:40.004 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:40.000+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:40.043 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:27:40.045 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:27:40.059 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2020-11-12T17:27:39.603237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":371531776,"num_objects":5672,"num_object_clones":0,"num_object_copies":11344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5672,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45355,"num_write_kb":362826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":529,"num_bytes_recovered":34627584,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45355,"ondisk_log_size":45355,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7692940,"kb_used_data":352852,"kb_used_omap":118,"kb_used_meta":7339913,"kb_avail":652909940,"statfs":{"total":676457349120,"available":668579778560,"internally_reserved":7516192768,"allocated":361320448,"data_stored":741221965,"data_compressed":4752895,"data_compressed_allocated":353996800,"data_compressed_original":738287616,"omap_allocated":121799,"internal_metadata":7516070969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2,5,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35201024,"num_objects":538,"num_object_clones":0,"num_object_copies":1076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4297,"num_write_kb":34376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001564"},"pg_stats":[{"pgid":"5.f","version":"156'2832","reported_seq":"2868","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:36.511282+0000","last_change":"2020-11-12T17:26:45.503348+0000","last_active":"2020-11-12T17:27:36.511282+0000","last_peered":"2020-11-12T17:27:36.511282+0000","last_clean":"2020-11-12T17:27:36.511282+0000","last_became_active":"2020-11-12T17:26:45.502940+0000","last_became_peered":"2020-11-12T17:26:45.502940+0000","last_unstale":"2020-11-12T17:27:36.511282+0000","last_undegraded":"2020-11-12T17:27:36.511282+0000","last_fullsized":"2020-11-12T17:27:36.511282+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2832,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":354,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2832,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"156'2904","reported_seq":"2939","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:35.850673+0000","last_change":"2020-11-12T17:26:45.491058+0000","last_active":"2020-11-12T17:27:35.850673+0000","last_peered":"2020-11-12T17:27:35.850673+0000","last_clean":"2020-11-12T17:27:35.850673+0000","last_became_active":"2020-11-12T17:26:45.490308+0000","last_became_peered":"2020-11-12T17:26:45.490308+0000","last_unstale":"2020-11-12T17:27:35.850673+0000","last_undegraded":"2020-11-12T17:27:35.850673+0000","last_fullsized":"2020-11-12T17:27:35.850673+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2904,"ondisk_log_size":2904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23789568,"num_objects":363,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2904,"num_write_kb":23232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"156'2752","reported_seq":"2783","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:35.095920+0000","last_change":"2020-11-12T17:26:45.490550+0000","last_active":"2020-11-12T17:27:35.095920+0000","last_peered":"2020-11-12T17:27:35.095920+0000","last_clean":"2020-11-12T17:27:35.095920+0000","last_became_active":"2020-11-12T17:26:45.490025+0000","last_became_peered":"2020-11-12T17:26:45.490025+0000","last_unstale":"2020-11-12T17:27:35.095920+0000","last_undegraded":"2020-11-12T17:27:35.095920+0000","last_fullsized":"2020-11-12T17:27:35.095920+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2752,"ondisk_log_size":2752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2752,"num_write_kb":22016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"156'2864","reported_seq":"3138","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:36.272859+0000","last_change":"2020-11-12T17:27:04.424601+0000","last_active":"2020-11-12T17:27:36.272859+0000","last_peered":"2020-11-12T17:27:36.272859+0000","last_clean":"2020-11-12T17:27:36.272859+0000","last_became_active":"2020-11-12T17:27:04.422158+0000","last_became_peered":"2020-11-12T17:27:04.422158+0000","last_unstale":"2020-11-12T17:27:36.272859+0000","last_undegraded":"2020-11-12T17:27:36.272859+0000","last_fullsized":"2020-11-12T17:27:36.272859+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2864,"ondisk_log_size":2864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2864,"num_write_kb":22912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":7471104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"156'2960","reported_seq":"2996","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:35.040310+0000","last_change":"2020-11-12T17:26:45.484541+0000","last_active":"2020-11-12T17:27:35.040310+0000","last_peered":"2020-11-12T17:27:35.040310+0000","last_clean":"2020-11-12T17:27:35.040310+0000","last_became_active":"2020-11-12T17:26:45.484017+0000","last_became_peered":"2020-11-12T17:26:45.484017+0000","last_unstale":"2020-11-12T17:27:35.040310+0000","last_undegraded":"2020-11-12T17:27:35.040310+0000","last_fullsized":"2020-11-12T17:27:35.040310+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2960,"ondisk_log_size":2960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":370,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":23680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"156'2912","reported_seq":"2948","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:34.864562+0000","last_change":"2020-11-12T17:26:45.490968+0000","last_active":"2020-11-12T17:27:34.864562+0000","last_peered":"2020-11-12T17:27:34.864562+0000","last_clean":"2020-11-12T17:27:34.864562+0000","last_became_active":"2020-11-12T17:26:45.490602+0000","last_became_peered":"2020-11-12T17:26:45.490602+0000","last_unstale":"2020-11-12T17:27:34.864562+0000","last_undegraded":"2020-11-12T17:27:34.864562+0000","last_fullsized":"2020-11-12T17:27:34.864562+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2912,"ondisk_log_size":2912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2912,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"156'2661","reported_seq":"2697","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:35.665484+0000","last_change":"2020-11-12T17:27:28.815974+0000","last_active":"2020-11-12T17:27:35.665484+0000","last_peered":"2020-11-12T17:27:35.665484+0000","last_clean":"2020-11-12T17:27:35.665484+0000","last_became_active":"2020-11-12T17:27:28.811530+0000","last_became_peered":"2020-11-12T17:27:28.811530+0000","last_unstale":"2020-11-12T17:27:35.665484+0000","last_undegraded":"2020-11-12T17:27:35.665484+0000","last_fullsized":"2020-11-12T17:27:35.665484+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2661,"ondisk_log_size":2661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21798912,"num_objects":333,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2661,"num_write_kb":21288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"155'2752","reported_seq":"3005","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:34.647600+0000","last_change":"2020-11-12T17:27:01.083305+0000","last_active":"2020-11-12T17:27:34.647600+0000","last_peered":"2020-11-12T17:27:34.647600+0000","last_clean":"2020-11-12T17:27:34.647600+0000","last_became_active":"2020-11-12T17:27:00.642804+0000","last_became_peered":"2020-11-12T17:27:00.642804+0000","last_unstale":"2020-11-12T17:27:34.647600+0000","last_undegraded":"2020-11-12T17:27:34.647600+0000","last_fullsized":"2020-11-12T17:27:34.647600+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2752,"ondisk_log_size":2752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2752,"num_write_kb":22016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":6840320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"156'2934","reported_seq":"2969","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:35.660817+0000","last_change":"2020-11-12T17:26:45.485794+0000","last_active":"2020-11-12T17:27:35.660817+0000","last_peered":"2020-11-12T17:27:35.660817+0000","last_clean":"2020-11-12T17:27:35.660817+0000","last_became_active":"2020-11-12T17:26:45.485374+0000","last_became_peered":"2020-11-12T17:26:45.485374+0000","last_unstale":"2020-11-12T17:27:35.660817+0000","last_undegraded":"2020-11-12T17:27:35.660817+0000","last_fullsized":"2020-11-12T17:27:35.660817+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2934,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24035328,"num_objects":367,"num_object_clones":0,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2934,"num_write_kb":23472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"32","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:33.845760+0000","last_change":"2020-11-12T17:27:15.924323+0000","last_active":"2020-11-12T17:27:33.845760+0000","last_peered":"2020-11-12T17:27:33.845760+0000","last_clean":"2020-11-12T17:27:33.845760+0000","last_became_active":"2020-11-12T17:27:00.607146+0000","last_became_peered":"2020-11-12T17:27:00.607146+0000","last_unstale":"2020-11-12T17:27:33.845760+0000","last_undegraded":"2020-11-12T17:27:33.845760+0000","last_fullsized":"2020-11-12T17:27:33.845760+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_clean_scrub_stamp":"2020-11-12T17:27:15.924179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"156'2838","reported_seq":"3096","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:36.234873+0000","last_change":"2020-11-12T17:27:04.421599+0000","last_active":"2020-11-12T17:27:36.234873+0000","last_peered":"2020-11-12T17:27:36.234873+0000","last_clean":"2020-11-12T17:27:36.234873+0000","last_became_active":"2020-11-12T17:27:04.420130+0000","last_became_peered":"2020-11-12T17:27:04.420130+0000","last_unstale":"2020-11-12T17:27:36.234873+0000","last_undegraded":"2020-11-12T17:27:36.234873+0000","last_fullsized":"2020-11-12T17:27:36.234873+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2838,"ondisk_log_size":2838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23248896,"num_objects":355,"num_object_clones":0,"num_object_copies":710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2838,"num_write_kb":22704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":7077888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"188","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:33.840560+0000","last_change":"2020-11-12T17:27:05.616615+0000","last_active":"2020-11-12T17:27:33.840560+0000","last_peered":"2020-11-12T17:27:33.840560+0000","last_clean":"2020-11-12T17:27:33.840560+0000","last_became_active":"2020-11-12T17:27:00.609586+0000","last_became_peered":"2020-11-12T17:27:00.609586+0000","last_unstale":"2020-11-12T17:27:33.840560+0000","last_undegraded":"2020-11-12T17:27:33.840560+0000","last_fullsized":"2020-11-12T17:27:33.840560+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:05.616420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:05.616420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"156'2856","reported_seq":"2892","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:35.063103+0000","last_change":"2020-11-12T17:26:45.480866+0000","last_active":"2020-11-12T17:27:35.063103+0000","last_peered":"2020-11-12T17:27:35.063103+0000","last_clean":"2020-11-12T17:27:35.063103+0000","last_became_active":"2020-11-12T17:26:45.480445+0000","last_became_peered":"2020-11-12T17:26:45.480445+0000","last_unstale":"2020-11-12T17:27:35.063103+0000","last_undegraded":"2020-11-12T17:27:35.063103+0000","last_fullsized":"2020-11-12T17:27:35.063103+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2856,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2856,"num_write_kb":22848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"50","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:33.843716+0000","last_change":"2020-11-12T17:26:48.417978+0000","last_active":"2020-11-12T17:27:33.843716+0000","last_peered":"2020-11-12T17:27:33.843716+0000","last_clean":"2020-11-12T17:27:33.843716+0000","last_became_active":"2020-11-12T17:26:29.669260+0000","last_became_peered":"2020-11-12T17:26:29.669260+0000","last_unstale":"2020-11-12T17:27:33.843716+0000","last_undegraded":"2020-11-12T17:27:33.843716+0000","last_fullsized":"2020-11-12T17:27:33.843716+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"156'2616","reported_seq":"2653","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:35.080946+0000","last_change":"2020-11-12T17:27:28.813298+0000","last_active":"2020-11-12T17:27:35.080946+0000","last_peered":"2020-11-12T17:27:35.080946+0000","last_clean":"2020-11-12T17:27:35.080946+0000","last_became_active":"2020-11-12T17:27:28.808532+0000","last_became_peered":"2020-11-12T17:27:28.808532+0000","last_unstale":"2020-11-12T17:27:35.080946+0000","last_undegraded":"2020-11-12T17:27:35.080946+0000","last_fullsized":"2020-11-12T17:27:35.080946+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2616,"ondisk_log_size":2616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2616,"num_write_kb":20928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"171","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:33.840390+0000","last_change":"2020-11-12T17:27:23.933824+0000","last_active":"2020-11-12T17:27:33.840390+0000","last_peered":"2020-11-12T17:27:33.840390+0000","last_clean":"2020-11-12T17:27:33.840390+0000","last_became_active":"2020-11-12T17:26:29.680644+0000","last_became_peered":"2020-11-12T17:26:29.680644+0000","last_unstale":"2020-11-12T17:27:33.840390+0000","last_undegraded":"2020-11-12T17:27:33.840390+0000","last_fullsized":"2020-11-12T17:27:33.840390+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:23.933684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:23.933684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"123","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:33.854466+0000","last_change":"2020-11-12T17:27:28.810294+0000","last_active":"2020-11-12T17:27:33.854466+0000","last_peered":"2020-11-12T17:27:33.854466+0000","last_clean":"2020-11-12T17:27:33.854466+0000","last_became_active":"2020-11-12T17:27:28.809879+0000","last_became_peered":"2020-11-12T17:27:28.809879+0000","last_unstale":"2020-11-12T17:27:33.854466+0000","last_undegraded":"2020-11-12T17:27:33.854466+0000","last_fullsized":"2020-11-12T17:27:33.854466+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:26:23.752291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:26:23.752291+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"156'2816","reported_seq":"3049","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:36.626646+0000","last_change":"2020-11-12T17:27:01.968627+0000","last_active":"2020-11-12T17:27:36.626646+0000","last_peered":"2020-11-12T17:27:36.626646+0000","last_clean":"2020-11-12T17:27:36.626646+0000","last_became_active":"2020-11-12T17:27:00.629289+0000","last_became_peered":"2020-11-12T17:27:00.629289+0000","last_unstale":"2020-11-12T17:27:36.626646+0000","last_undegraded":"2020-11-12T17:27:36.626646+0000","last_fullsized":"2020-11-12T17:27:36.626646+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2816,"ondisk_log_size":2816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":352,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2816,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"183","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:33.845824+0000","last_change":"2020-11-12T17:27:28.932910+0000","last_active":"2020-11-12T17:27:33.845824+0000","last_peered":"2020-11-12T17:27:33.845824+0000","last_clean":"2020-11-12T17:27:33.845824+0000","last_became_active":"2020-11-12T17:27:28.932340+0000","last_became_peered":"2020-11-12T17:27:28.932340+0000","last_unstale":"2020-11-12T17:27:33.845824+0000","last_undegraded":"2020-11-12T17:27:33.845824+0000","last_fullsized":"2020-11-12T17:27:33.845824+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:51.816592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:51.816592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"156'3000","reported_seq":"3036","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:35.656694+0000","last_change":"2020-11-12T17:26:45.488276+0000","last_active":"2020-11-12T17:27:35.656694+0000","last_peered":"2020-11-12T17:27:35.656694+0000","last_clean":"2020-11-12T17:27:35.656694+0000","last_became_active":"2020-11-12T17:26:45.487913+0000","last_became_peered":"2020-11-12T17:26:45.487913+0000","last_unstale":"2020-11-12T17:27:35.656694+0000","last_undegraded":"2020-11-12T17:27:35.656694+0000","last_fullsized":"2020-11-12T17:27:35.656694+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3000,"ondisk_log_size":3000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24576000,"num_objects":375,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":375,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3000,"num_write_kb":24000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"118","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:33.853534+0000","last_change":"2020-11-12T17:27:28.812744+0000","last_active":"2020-11-12T17:27:33.853534+0000","last_peered":"2020-11-12T17:27:33.853534+0000","last_clean":"2020-11-12T17:27:33.853534+0000","last_became_active":"2020-11-12T17:27:28.812355+0000","last_became_peered":"2020-11-12T17:27:28.812355+0000","last_unstale":"2020-11-12T17:27:33.853534+0000","last_undegraded":"2020-11-12T17:27:33.853534+0000","last_fullsized":"2020-11-12T17:27:33.853534+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:04.764948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:27:04.764948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"156'2848","reported_seq":"2884","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:35.758405+0000","last_change":"2020-11-12T17:26:45.490394+0000","last_active":"2020-11-12T17:27:35.758405+0000","last_peered":"2020-11-12T17:27:35.758405+0000","last_clean":"2020-11-12T17:27:35.758405+0000","last_became_active":"2020-11-12T17:26:45.489929+0000","last_became_peered":"2020-11-12T17:26:45.489929+0000","last_unstale":"2020-11-12T17:27:35.758405+0000","last_undegraded":"2020-11-12T17:27:35.758405+0000","last_fullsized":"2020-11-12T17:27:35.758405+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2848,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":356,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2848,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"29","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:33.845735+0000","last_change":"2020-11-12T17:27:00.607817+0000","last_active":"2020-11-12T17:27:33.845735+0000","last_peered":"2020-11-12T17:27:33.845735+0000","last_clean":"2020-11-12T17:27:33.845735+0000","last_became_active":"2020-11-12T17:27:00.607358+0000","last_became_peered":"2020-11-12T17:27:00.607358+0000","last_unstale":"2020-11-12T17:27:33.845735+0000","last_undegraded":"2020-11-12T17:27:33.845735+0000","last_fullsized":"2020-11-12T17:27:33.845735+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:52.317257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:52.317257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"156'2808","reported_seq":"3070","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:36.608084+0000","last_change":"2020-11-12T17:27:01.959937+0000","last_active":"2020-11-12T17:27:36.608084+0000","last_peered":"2020-11-12T17:27:36.608084+0000","last_clean":"2020-11-12T17:27:36.608084+0000","last_became_active":"2020-11-12T17:27:00.648415+0000","last_became_peered":"2020-11-12T17:27:00.648415+0000","last_unstale":"2020-11-12T17:27:36.608084+0000","last_undegraded":"2020-11-12T17:27:36.608084+0000","last_fullsized":"2020-11-12T17:27:36.608084+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2808,"ondisk_log_size":2808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2808,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":7077888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"146","reported_epoch":"155","state":"active+clean","last_fresh":"2020-11-12T17:27:33.854547+0000","last_change":"2020-11-12T17:26:53.490926+0000","last_active":"2020-11-12T17:27:33.854547+0000","last_peered":"2020-11-12T17:27:33.854547+0000","last_clean":"2020-11-12T17:27:33.854547+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:27:33.854547+0000","last_undegraded":"2020-11-12T17:27:33.854547+0000","last_fullsized":"2020-11-12T17:27:33.854547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:53.490814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:26:53.490814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":371531776,"num_objects":5670,"num_object_clones":0,"num_object_copies":11340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5670,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45353,"num_write_kb":362824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":529,"num_bytes_recovered":34627584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":359047168,"data_stored":748388352,"data_compressed":4820710,"data_compressed_allocated":359047168,"data_compressed_original":748388352,"omap_allocated":0,"internal_metadata":0},"log_size":45353,"ondisk_log_size":45353,"up":32,"acting":32,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542204,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1082380,"kb_used_data":33796,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93289460,"statfs":{"total":96636764160,"available":95528407040,"internally_reserved":1073741824,"allocated":34607104,"data_stored":67505308,"data_compressed":448331,"data_compressed_allocated":33542144,"data_compressed_original":67084288,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":41.594000000000001,"5min":9.4710000000000001,"15min":4.2030000000000003},"min":{"1min":0.72499999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":727.43499999999995,"5min":727.43499999999995,"15min":727.43499999999995},"last":0.89800000000000002},{"interface":"front","average":{"1min":6.6319999999999997,"5min":2.7429999999999999,"15min":2.3450000000000002},"min":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":101.371,"5min":101.371,"15min":101.371},"last":3.0609999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:27:36 2020","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":6.1219999999999999,"15min":6.8579999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":3.5449999999999999,"5min":102.354,"15min":102.354},"last":3.1520000000000001},{"interface":"front","average":{"1min":1.718,"5min":5.8339999999999996,"15min":6.5199999999999996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":5.399,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.139}]},{"osd":2,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":6.431,"5min":6.431,"15min":6.431},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":102.038,"5min":102.038,"15min":102.038},"last":1.601},{"interface":"front","average":{"1min":6.7130000000000001,"5min":6.7130000000000001,"15min":6.7130000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":102.92,"5min":102.92,"15min":102.92},"last":3.1040000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":6.9459999999999997,"5min":2.8100000000000001,"15min":2.411},"min":{"1min":0.86499999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":102.443,"5min":102.443,"15min":102.443},"last":1.2030000000000001},{"interface":"front","average":{"1min":6.7709999999999999,"5min":9.452,"15min":4.8230000000000004},"min":{"1min":0.91900000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":102.29600000000001,"5min":871.76700000000005,"15min":871.76700000000005},"last":1.232}]},{"osd":4,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":47.259,"5min":33.906999999999996,"15min":47.140999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":849.06500000000005,"5min":849.06500000000005,"15min":849.06500000000005},"last":1.1739999999999999},{"interface":"front","average":{"1min":6.5780000000000003,"5min":4.0199999999999996,"15min":2.6760000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":103.053,"5min":108.14,"15min":108.14},"last":2.956}]},{"osd":5,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":21.847999999999999,"5min":6.1970000000000001,"15min":3.8929999999999998},"min":{"1min":0.84899999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":311.077,"5min":311.077,"15min":311.077},"last":3.444},{"interface":"front","average":{"1min":7.2149999999999999,"5min":3.3599999999999999,"15min":3.032},"min":{"1min":1.018,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":104.02,"5min":104.02,"15min":104.02},"last":3.488}]},{"osd":6,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":6.8049999999999997,"5min":7.7839999999999998,"15min":4.468},"min":{"1min":0.96499999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":103.56699999999999,"5min":375.04199999999997,"15min":375.04199999999997},"last":3.2029999999999998},{"interface":"front","average":{"1min":6.9450000000000003,"5min":29.754000000000001,"15min":45.545000000000002},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":102.8,"5min":975.20899999999995,"15min":975.20899999999995},"last":1.482}]}]},{"osd":5,"up_from":14,"seq":60129542205,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1131004,"kb_used_data":82420,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93240836,"statfs":{"total":96636764160,"available":95478616064,"internally_reserved":1073741824,"allocated":84398080,"data_stored":167126590,"data_compressed":1114468,"data_compressed_allocated":83353600,"data_compressed_original":166707200,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.526,"15min":1.7250000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":5.0309999999999997,"5min":5.0309999999999997,"15min":5.0309999999999997},"last":1.034},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.736,"15min":2},"min":{"1min":0.59199999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.5810000000000004,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":1.3180000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:27:34 2020","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.5980000000000001,"15min":1.5920000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":4.327,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.778,"15min":1.802},"min":{"1min":1.0669999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.024,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.4370000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.4770000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":2.7210000000000001,"15min":2.7349999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":3.8530000000000002,"5min":49.442999999999998,"15min":49.442999999999998},"last":1.528},{"interface":"front","average":{"1min":1.786,"5min":2.089,"15min":2.3530000000000002},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":4.7359999999999998,"5min":8.202,"15min":8.202},"last":1.7929999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":6.2610000000000001,"15min":3.5710000000000002},"min":{"1min":0.73099999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":5.0789999999999997,"5min":459.15499999999997,"15min":459.15499999999997},"last":1.23},{"interface":"front","average":{"1min":15.962,"5min":5.0789999999999997,"15min":3.7269999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":324.95600000000002,"5min":324.95600000000002,"15min":324.95600000000002},"last":1.375}]},{"osd":6,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":2.0569999999999999,"15min":2.2469999999999999},"min":{"1min":0.76600000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.4660000000000002,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.802,"5min":2.0150000000000001,"15min":2.254},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.6499999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":2.7570000000000001,"15min":2.9870000000000001},"min":{"1min":0.97099999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":4.9939999999999998,"5min":40.268000000000001,"15min":40.268000000000001},"last":1.8700000000000001},{"interface":"front","average":{"1min":32.020000000000003,"5min":8.3439999999999994,"15min":4.718},"min":{"1min":0.72599999999999998,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":693.23000000000002,"5min":693.23000000000002,"15min":693.23000000000002},"last":1.9159999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542204,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1116868,"kb_used_data":68284,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93254972,"statfs":{"total":96636764160,"available":95493091328,"internally_reserved":1073741824,"allocated":69922816,"data_stored":138176390,"data_compressed":920554,"data_compressed_allocated":68878336,"data_compressed_original":137756672,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":38.109999999999999,"5min":12.779,"15min":5.3150000000000004},"min":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":765.13099999999997,"5min":765.13099999999997,"15min":765.13099999999997},"last":13.298},{"interface":"front","average":{"1min":1.3500000000000001,"5min":23.634,"15min":39.231999999999999},"min":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":3.3799999999999999,"5min":948.30899999999997,"15min":948.30899999999997},"last":2.5609999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":2.3849999999999998,"5min":15.705,"15min":17.925000000000001},"min":{"1min":0.79900000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":7.4329999999999998,"5min":356.46699999999998,"15min":356.46699999999998},"last":6.1379999999999999},{"interface":"front","average":{"1min":1.911,"5min":15.529,"15min":17.798999999999999},"min":{"1min":0.92800000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.8799999999999999,"5min":356.18599999999998,"15min":356.18599999999998},"last":2.895}]},{"osd":2,"last update":"Thu Nov 12 17:27:00 2020","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":6.9630000000000001,"5min":6.9630000000000001,"15min":6.9630000000000001},"last":13.382999999999999},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":4.056,"5min":4.056,"15min":4.056},"last":2.8090000000000002}]},{"osd":3,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":5.8079999999999998,"15min":3.2949999999999999},"min":{"1min":0.83999999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":7.5629999999999997,"5min":356.02300000000002,"15min":356.02300000000002},"last":11.282},{"interface":"front","average":{"1min":18.704000000000001,"5min":9.2430000000000003,"15min":4.5250000000000004},"min":{"1min":0.83599999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":357.476,"5min":357.79000000000002,"15min":357.79000000000002},"last":2.9689999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":2.5760000000000001,"5min":12.289,"15min":5.4649999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":6.9089999999999998,"5min":575.16800000000001,"15min":575.16800000000001},"last":13.417999999999999},{"interface":"front","average":{"1min":1.7430000000000001,"5min":15.927,"15min":6.8159999999999998},"min":{"1min":0.81499999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":4.2539999999999996,"5min":908.52700000000004,"15min":908.52700000000004},"last":5.6609999999999996}]},{"osd":6,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":1.833,"5min":18.399999999999999,"15min":28.564},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":7.3940000000000001,"5min":665.13999999999999,"15min":665.13999999999999},"last":11.757},{"interface":"front","average":{"1min":22.359999999999999,"5min":10.012,"15min":4.8319999999999999},"min":{"1min":0.77000000000000002,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":426.197,"5min":426.197,"15min":426.197},"last":13.446}]},{"osd":7,"last update":"Thu Nov 12 17:26:49 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":14.317,"15min":6.367},"min":{"1min":0.90100000000000002,"5min":0.87,"15min":0.87},"max":{"1min":3.5310000000000001,"5min":584.00300000000004,"15min":584.00300000000004},"last":3.3540000000000001},{"interface":"front","average":{"1min":47.753,"5min":15.167,"15min":6.5149999999999997},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":915.22900000000004,"5min":915.22900000000004,"15min":915.22900000000004},"last":11.363}]}]},{"osd":1,"up_from":88,"seq":377957122074,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1090712,"kb_used_data":42128,"kb_used_omap":114,"kb_used_meta":1048461,"kb_avail":93281128,"statfs":{"total":96636764160,"available":95519875072,"internally_reserved":1073741824,"allocated":43139072,"data_stored":114911218,"data_compressed":583710,"data_compressed_allocated":42098688,"data_compressed_original":114491392,"omap_allocated":117414,"internal_metadata":1073624410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":1.071},{"interface":"front","average":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":4.202,"5min":4.202,"15min":4.202},"last":1.167}]},{"osd":2,"last update":"Thu Nov 12 17:27:00 2020","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":1.756},{"interface":"front","average":{"1min":1.72,"5min":1.72,"15min":1.72},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.782}]},{"osd":3,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.5110000000000001,"5min":3.5110000000000001,"15min":3.5110000000000001},"last":3.1669999999999998},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":6.056,"5min":6.056,"15min":6.056},"last":1.8460000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":2.6400000000000001},{"interface":"front","average":{"1min":2.077,"5min":2.077,"15min":2.077},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":4.5730000000000004,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":3.2879999999999998}]},{"osd":5,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":2.024,"5min":2.024,"15min":2.024},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":6.1159999999999997,"5min":6.1159999999999997,"15min":6.1159999999999997},"last":2.4790000000000001},{"interface":"front","average":{"1min":2.427,"5min":2.427,"15min":2.427},"min":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":6.7859999999999996,"5min":6.7859999999999996,"15min":6.7859999999999996},"last":3.073}]},{"osd":6,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":2.343,"5min":2.343,"15min":2.343},"min":{"1min":1.115,"5min":1.115,"15min":1.115},"max":{"1min":6.1689999999999996,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":3.3479999999999999},{"interface":"front","average":{"1min":2.319,"5min":2.319,"15min":2.319},"min":{"1min":1.161,"5min":1.161,"15min":1.161},"max":{"1min":6.5469999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":2.524}]},{"osd":7,"last update":"Thu Nov 12 17:26:35 2020","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":6.577,"5min":6.577,"15min":6.577},"last":2.5880000000000001},{"interface":"front","average":{"1min":2.496,"5min":2.496,"15min":2.496},"min":{"1min":1.319,"5min":1.319,"15min":1.319},"max":{"1min":6.6950000000000003,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":3.0339999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542204,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1083596,"kb_used_data":35012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93288244,"statfs":{"total":96636764160,"available":95527161856,"internally_reserved":1073741824,"allocated":35852288,"data_stored":70018893,"data_compressed":465256,"data_compressed_allocated":34799616,"data_compressed_original":69599232,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.6060000000000001,"15min":1.714},"min":{"1min":0.77600000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.514},{"interface":"front","average":{"1min":1.526,"5min":1.6930000000000001,"15min":1.9379999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.5310000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.2190000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":4.6139999999999999,"5min":35.189,"15min":40.284999999999997},"min":{"1min":1.0069999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":49.276000000000003,"5min":665.476,"15min":665.476},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.929,"5min":1.3779999999999999,"15min":1.286},"min":{"1min":0.82899999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":4.5549999999999997,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:26:58 2020","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.355}]},{"osd":3,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":3.4390000000000001,"5min":2.2050000000000001,"15min":2.141},"min":{"1min":1.0049999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":27.997,"5min":27.997,"15min":27.997},"last":1.3999999999999999},{"interface":"front","average":{"1min":3.3799999999999999,"5min":2.3159999999999998,"15min":2.4119999999999999},"min":{"1min":0.90200000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":26.927,"5min":26.927,"15min":26.927},"last":1.238}]},{"osd":4,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":28.529,"5min":7.2400000000000002,"15min":3.8999999999999999},"min":{"1min":0.70299999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":489.149,"5min":489.149,"15min":489.149},"last":0.73499999999999999},{"interface":"front","average":{"1min":28.414000000000001,"5min":9.2590000000000003,"15min":4.867},"min":{"1min":0.69299999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":480.79599999999999,"5min":480.79599999999999,"15min":480.79599999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":20.465,"15min":8.3409999999999993},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.6120000000000001,"5min":804.62199999999996,"15min":804.62199999999996},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.7110000000000001,"5min":15.547000000000001,"15min":20.343},"min":{"1min":0.88800000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.242,"5min":494.78399999999999,"15min":494.78399999999999},"last":1.022}]},{"osd":7,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":17.628,"15min":7.7300000000000004},"min":{"1min":0.71999999999999997,"5min":0.626,"15min":0.626},"max":{"1min":6.4790000000000001,"5min":1002.347,"15min":1002.347},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.2690000000000001,"15min":2.4390000000000001},"min":{"1min":0.99399999999999999,"5min":0.878,"15min":0.878},"max":{"1min":3.8690000000000002,"5min":10.271000000000001,"15min":10.271000000000001},"last":1.2629999999999999}]}]},{"osd":0,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":102,"seq":438086664213,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1116196,"kb_used_data":67612,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93255644,"statfs":{"total":96636764160,"available":95493779456,"internally_reserved":1073741824,"allocated":69234688,"data_stored":136859310,"data_compressed":911896,"data_compressed_allocated":68222976,"data_compressed_original":136445952,"omap_allocated":4385,"internal_metadata":1073737439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":34.381999999999998,"5min":34.381999999999998,"15min":34.381999999999998},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":524.55600000000004,"5min":524.55600000000004,"15min":524.55600000000004},"last":1.046},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.3260000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":2.004,"15min":2.004},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":1.825},{"interface":"front","average":{"1min":1.694,"5min":1.694,"15min":1.694},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.8680000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.873,"15min":1.873},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":1.921},{"interface":"front","average":{"1min":58.247,"5min":58.247,"15min":58.247},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":902.96299999999997,"5min":902.96299999999997,"15min":902.96299999999997},"last":1.002}]},{"osd":4,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.929,"5min":1.929,"15min":1.929},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":3.4279999999999999,"5min":3.4279999999999999,"15min":3.4279999999999999},"last":1.673}]},{"osd":5,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":10.308,"5min":10.308,"15min":10.308},"last":1.625},{"interface":"front","average":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":3.774,"5min":3.774,"15min":3.774},"last":5.3970000000000002}]},{"osd":6,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":2.145,"15min":2.145},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":3.7090000000000001,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":1.4890000000000001},{"interface":"front","average":{"1min":12.640000000000001,"5min":12.640000000000001,"15min":12.640000000000001},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":168.64599999999999,"5min":168.64599999999999,"15min":168.64599999999999},"last":1.726}]},{"osd":7,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":2.528,"15min":2.528},"min":{"1min":1.502,"5min":1.502,"15min":1.502},"max":{"1min":6.1790000000000003,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":1.7709999999999999},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"min":{"1min":1.153,"5min":1.153,"15min":1.153},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":1.583}]}]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1072184,"kb_used_data":23600,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93299656,"statfs":{"total":96636764160,"available":95538847744,"internally_reserved":1073741824,"allocated":24166400,"data_stored":46624256,"data_compressed":308680,"data_compressed_allocated":23101440,"data_compressed_original":46202880,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":3.6829999999999998,"15min":2.4260000000000002},"min":{"1min":0.748,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.2559999999999998,"5min":178.36699999999999,"15min":178.36699999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.825,"5min":1.8879999999999999,"15min":1.9339999999999999},"min":{"1min":0.64900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":6.7610000000000001,"5min":16.902000000000001,"15min":16.902000000000001},"last":1.4379999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:26:34 2020","interfaces":[{"interface":"back","average":{"1min":38.305999999999997,"5min":38.305999999999997,"15min":38.305999999999997},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":501.91199999999998,"5min":501.91199999999998,"15min":501.91199999999998},"last":1.359},{"interface":"front","average":{"1min":26.684000000000001,"5min":26.684000000000001,"15min":26.684000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":501.774,"5min":501.774,"15min":501.774},"last":2.2530000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":51.488999999999997,"5min":51.488999999999997,"15min":51.488999999999997},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":942.58500000000004,"5min":942.58500000000004,"15min":942.58500000000004},"last":1.7589999999999999},{"interface":"front","average":{"1min":26.448,"5min":26.448,"15min":26.448},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":461.721,"5min":461.721,"15min":461.721},"last":0.88200000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":2.1150000000000002,"5min":2.161,"15min":2.4140000000000001},"min":{"1min":0.79600000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.0499999999999998,"5min":10.318,"15min":10.318},"last":1.198},{"interface":"front","average":{"1min":1.972,"5min":2.0350000000000001,"15min":2.343},"min":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.589,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":2.2829999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":2.3170000000000002,"5min":14.132999999999999,"15min":26.184000000000001},"min":{"1min":1.016,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":6.8719999999999999,"5min":622.07799999999997,"15min":622.07799999999997},"last":1.8500000000000001},{"interface":"front","average":{"1min":2.1349999999999998,"5min":2.3799999999999999,"15min":2.698},"min":{"1min":1.173,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":4.2839999999999998,"5min":10.436,"15min":10.436},"last":1.9059999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":26.582999999999998,"5min":7.2679999999999998,"15min":4.1719999999999997},"min":{"1min":0.92200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":466.58199999999999,"5min":466.58199999999999,"15min":466.58199999999999},"last":2.5640000000000001},{"interface":"front","average":{"1min":2.7269999999999999,"5min":2.395,"15min":2.6309999999999998},"min":{"1min":1.722,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":6.9160000000000004,"5min":11.497999999999999,"15min":11.497999999999999},"last":2.0289999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":17.262,"5min":5.415,"15min":3.758},"min":{"1min":1.204,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":287.43099999999998,"5min":287.43099999999998,"15min":287.43099999999998},"last":1.804},{"interface":"front","average":{"1min":33.877000000000002,"5min":19.629999999999999,"15min":26.670000000000002},"min":{"1min":1.1080000000000001,"5min":1.016,"15min":1.016},"max":{"1min":606.49099999999999,"5min":606.49099999999999,"15min":606.49099999999999},"last":2.589}]}]}]}} 2020-11-12T17:27:40.062 INFO:tasks.thrashosds.thrasher:Setting 5.1 to [7, 1, 5, 4] 2020-11-12T17:27:40.062 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '5.1', '7', '1', '5', '4'] 2020-11-12T17:27:40.062 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap-items 5.1 7 1 5 4 2020-11-12T17:27:40.105 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:40.102+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:40.131 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:40.132 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:40.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.132 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:49072 5.f 5:f8bfca51:::benchmark_data_smithi036_24110_object6133:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e157)", 2020-11-12T17:27:40.132 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:40.101184+0000", 2020-11-12T17:27:40.133 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.031833769999999997, 2020-11-12T17:27:40.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.031887619999999998, 2020-11-12T17:27:40.133 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.133 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:40.133 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.133 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:40.134 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:40.134 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 49072 2020-11-12T17:27:40.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.135 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.101184+0000", 2020-11-12T17:27:40.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.101184+0000", 2020-11-12T17:27:40.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:40.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.101165+0000", 2020-11-12T17:27:40.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3107000000000003e-05 2020-11-12T17:27:40.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.101238+0000", 2020-11-12T17:27:40.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1715999999999999e-05 2020-11-12T17:27:40.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.101250+0000", 2020-11-12T17:27:40.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6659999999999996e-06 2020-11-12T17:27:40.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.101255+0000", 2020-11-12T17:27:40.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038677440000000002 2020-11-12T17:27:40.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.105123+0000", 2020-11-12T17:27:40.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000138579 2020-11-12T17:27:40.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.105262+0000", 2020-11-12T17:27:40.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023789199999999999 2020-11-12T17:27:40.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:40.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.105499+0000", 2020-11-12T17:27:40.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025724929999999999 2020-11-12T17:27:40.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:40.108072+0000", 2020-11-12T17:27:40.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068883779999999997 2020-11-12T17:27:40.147 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.147 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.147 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.148 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:48936 5.7 5:ebe6a5f2:::benchmark_data_smithi036_24110_object6116:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e157)", 2020-11-12T17:27:40.148 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:39.948550+0000", 2020-11-12T17:27:40.149 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.18446718300000001, 2020-11-12T17:27:40.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18471269700000001, 2020-11-12T17:27:40.149 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.149 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:40.150 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.150 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:40.150 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:40.150 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 48936 2020-11-12T17:27:40.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.151 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.948550+0000", 2020-11-12T17:27:40.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.948550+0000", 2020-11-12T17:27:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999347 2020-11-12T17:27:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.948485+0000", 2020-11-12T17:27:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018086 2020-11-12T17:27:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.948666+0000", 2020-11-12T17:27:40.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4437999999999999e-05 2020-11-12T17:27:40.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.948690+0000", 2020-11-12T17:27:40.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1455e-05 2020-11-12T17:27:40.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.948702+0000", 2020-11-12T17:27:40.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063301950000000003 2020-11-12T17:27:40.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.955032+0000", 2020-11-12T17:27:40.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:40.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.955117+0000", 2020-11-12T17:27:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000145165 2020-11-12T17:27:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.955262+0000", 2020-11-12T17:27:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024889589999999998 2020-11-12T17:27:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:39.957751+0000", 2020-11-12T17:27:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0092005820000000006 2020-11-12T17:27:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:27:40.165 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:40.167 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:40.206 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:40.200+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:40.307 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:40.306+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:40.336 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:40.336 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:40.336 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:40.337 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:40.337 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:40.347 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:40.390 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:40.435 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:40.432+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:40.450 INFO:teuthology.orchestra.run.smithi036.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-11-12T17:27:40.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:27:40.453 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2020-11-12T17:27:40.511 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:40.511 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:40.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:40.512 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:40.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.512 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:40.512 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:27:40.512 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 265.98385866400002, 2020-11-12T17:27:40.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:27:40.513 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.513 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.513 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.513 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:40.513 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:40.513 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:27:40.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.514 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:27:40.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:27:40.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:40.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:27:40.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:27:40.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:27:40.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:27:40.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:27:40.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:27:40.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:27:40.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:27:40.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:27:40.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:27:40.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:27:40.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:27:40.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:40.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:27:40.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:27:40.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:27:40.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:27:40.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:27:40.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:27:40.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:27:40.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:27:40.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:27:40.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:27:40.528 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.528 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.528 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.529 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:27:40.529 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:27:40.529 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 265.98045873000001, 2020-11-12T17:27:40.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:27:40.529 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.530 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:40.530 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:27:40.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:27:40.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:40.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:27:40.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:27:40.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:27:40.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:27:40.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:27:40.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:27:40.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:27:40.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:27:40.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:27:40.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.537 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:27:40.537 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:27:40.537 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 230.504569283, 2020-11-12T17:27:40.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:27:40.537 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.537 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.538 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:27:40.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:27:40.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:27:40.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:27:40.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:27:40.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:27:40.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:27:40.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:27:40.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:27:40.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:27:40.545 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.545 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.545 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.545 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:40.546 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:27:40.546 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 198.56458394000001, 2020-11-12T17:27:40.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:27:40.546 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.546 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.546 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.546 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:40.547 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:40.547 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:27:40.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.547 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:27:40.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:27:40.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:27:40.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:27:40.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:27:40.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:27:40.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:27:40.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:27:40.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:27:40.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:27:40.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:27:40.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:27:40.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:27:40.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:27:40.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:27:40.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:40.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:27:40.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:27:40.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:27:40.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:27:40.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:27:40.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:27:40.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:27:40.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:27:40.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:27:40.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:27:40.556 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.556 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.556 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.557 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:27:40.557 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:27:40.557 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 187.08748286599999, 2020-11-12T17:27:40.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:27:40.557 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.558 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:27:40.558 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:27:40.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:27:40.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:27:40.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:27:40.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:27:40.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:27:40.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:27:40.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:27:40.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:27:40.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:27:40.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:27:40.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:27:40.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:27:40.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:27:40.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:27:40.564 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.564 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.564 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.564 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:27:40.565 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:27:40.565 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 185.96847247900001, 2020-11-12T17:27:40.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:27:40.565 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.565 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.565 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.565 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:40.566 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:40.566 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:27:40.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.566 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:27:40.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:27:40.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:27:40.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:27:40.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:27:40.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:27:40.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:27:40.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:27:40.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:27:40.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:27:40.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:27:40.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:27:40.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:27:40.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:27:40.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:27:40.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:40.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:27:40.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:27:40.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:27:40.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:27:40.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:27:40.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:27:40.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:27:40.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:27:40.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:27:40.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:27:40.575 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.576 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.576 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.576 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:27:40.576 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:27:40.576 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 185.95233447499999, 2020-11-12T17:27:40.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:27:40.577 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.577 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:40.577 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:27:40.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:27:40.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:40.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:27:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:27:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:27:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:27:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:27:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:27:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:27:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:27:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:27:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:27:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:27:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:27:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:27:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:27:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:27:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:27:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 185.947606796, 2020-11-12T17:27:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:27:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:27:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:27:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:27:40.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:27:40.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:40.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:27:40.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:27:40.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:27:40.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:27:40.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:27:40.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:27:40.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:27:40.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:27:40.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:27:40.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:27:40.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:27:40.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:27:40.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:27:40.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:27:40.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:27:40.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.593 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.594 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:27:40.594 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:27:40.594 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 129.56604772899999, 2020-11-12T17:27:40.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:27:40.594 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.595 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:40.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:40.595 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:27:40.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.596 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:27:40.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:27:40.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:27:40.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:27:40.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:27:40.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:27:40.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:27:40.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:27:40.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:27:40.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:27:40.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:27:40.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:27:40.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:27:40.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:27:40.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:27:40.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:40.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:27:40.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:27:40.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:27:40.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:27:40.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:27:40.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:27:40.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:27:40.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:27:40.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:27:40.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:27:40.606 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.606 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.606 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.607 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:27:40.607 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:27:40.607 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 129.56049390800001, 2020-11-12T17:27:40.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:27:40.607 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.607 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:40.608 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:27:40.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:27:40.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:40.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:27:40.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:27:40.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:27:40.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:27:40.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:27:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:27:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:27:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:27:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:27:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:27:40.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:27:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:27:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:27:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:27:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.614 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:27:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.903844896999999, 2020-11-12T17:27:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:27:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:40.615 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:27:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:27:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:27:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:27:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:27:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:27:40.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:27:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:27:40.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:27:40.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:27:40.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:27:40.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:27:40.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:27:40.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:27:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:27:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:27:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:27:40.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:27:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:27:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:27:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:27:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:27:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:27:40.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:27:40.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:27:40.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.625 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:27:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.901951284000006, 2020-11-12T17:27:40.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:27:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:27:40.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:27:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:27:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:27:40.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:27:40.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:27:40.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:27:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:27:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:27:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:27:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:27:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:27:40.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:27:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:27:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:27:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:27:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:27:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:27:40.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:27:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:27:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:27:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:27:40.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:27:40.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:27:40.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:27:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:27:40.637 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.901198636000004, 2020-11-12T17:27:40.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:27:40.638 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.638 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.638 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.638 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:40.638 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:40.639 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:27:40.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.639 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:27:40.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:27:40.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:27:40.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:27:40.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:27:40.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:27:40.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:27:40.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:27:40.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:27:40.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:27:40.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:27:40.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:27:40.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:27:40.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:27:40.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:27:40.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:40.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:27:40.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:27:40.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:27:40.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:27:40.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:27:40.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:27:40.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:27:40.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:27:40.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:27:40.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:27:40.648 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.648 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.648 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.648 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:40.648 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:27:40.649 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.898037118999994, 2020-11-12T17:27:40.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:27:40.649 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.649 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:40.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:40.649 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:27:40.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.650 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:27:40.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:27:40.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:27:40.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:27:40.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:27:40.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:27:40.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:27:40.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:27:40.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:27:40.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:27:40.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:27:40.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:27:40.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:27:40.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:27:40.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:27:40.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:40.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:27:40.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:27:40.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:27:40.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:27:40.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:27:40.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:27:40.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:27:40.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:27:40.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:27:40.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:27:40.659 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.659 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.659 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.660 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:40.660 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:27:40.660 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.896955951999999, 2020-11-12T17:27:40.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:27:40.660 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.661 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:40.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:40.661 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:27:40.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.661 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:27:40.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:27:40.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:40.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:27:40.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:27:40.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:27:40.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:27:40.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:27:40.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:27:40.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:27:40.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:27:40.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:27:40.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:27:40.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:27:40.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:27:40.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:40.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:27:40.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:27:40.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:27:40.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:27:40.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:27:40.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:27:40.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:27:40.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:27:40.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:27:40.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:27:40.670 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.670 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.670 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.671 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:40.671 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:27:40.671 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.896786859000002, 2020-11-12T17:27:40.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:27:40.671 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.671 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.671 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.672 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:40.672 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:40.672 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:27:40.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.672 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:27:40.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:27:40.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:27:40.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:27:40.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:27:40.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:27:40.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:27:40.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:27:40.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:27:40.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:27:40.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:27:40.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:27:40.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:27:40.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:27:40.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:27:40.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:40.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:27:40.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:27:40.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:27:40.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:27:40.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:27:40.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:27:40.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:27:40.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:27:40.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:27:40.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:27:40.681 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.681 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.681 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.682 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:40.682 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:27:40.682 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.894168213, 2020-11-12T17:27:40.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:27:40.682 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.683 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.683 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.683 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:40.683 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:40.683 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:27:40.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.683 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:27:40.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:27:40.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:27:40.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:27:40.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:27:40.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:27:40.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:27:40.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:27:40.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:27:40.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:27:40.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:27:40.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:27:40.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:27:40.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:27:40.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:27:40.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:40.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:27:40.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:27:40.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:27:40.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:27:40.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:27:40.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:27:40.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:27:40.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:27:40.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:27:40.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:27:40.693 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.693 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.693 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.694 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:40.694 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:27:40.694 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.89406013, 2020-11-12T17:27:40.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:27:40.694 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.694 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.695 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:40.695 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:40.695 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:40.695 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:27:40.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.695 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:27:40.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:27:40.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:27:40.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:27:40.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:27:40.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:27:40.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:27:40.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:27:40.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:27:40.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:27:40.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:27:40.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:27:40.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:27:40.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:27:40.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:27:40.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:40.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:27:40.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:27:40.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:40.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:27:40.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:27:40.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:40.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:27:40.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:27:40.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:27:40.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:27:40.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:27:40.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:27:40.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.704 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.705 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:27:40.705 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:27:40.705 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.890097448000006, 2020-11-12T17:27:40.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:27:40.706 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.706 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:40.706 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:27:40.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:27:40.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:27:40.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:27:40.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:27:40.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:27:40.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:27:40.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:27:40.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:27:40.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:27:40.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:27:40.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:27:40.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:27:40.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:27:40.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:27:40.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:27:40.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:27:40.712 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.712 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.713 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.713 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:27:40.713 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:27:40.713 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 36.852367706999999, 2020-11-12T17:27:40.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:27:40.714 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:40.714 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:40.714 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:40.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:40.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:27:40.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:40.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:40.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:27:40.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:40.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:40.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:27:40.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:27:40.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:40.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:27:40.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:27:40.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:40.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:27:40.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:27:40.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:40.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:27:40.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:27:40.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:40.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:27:40.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:27:40.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:40.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:27:40.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:27:40.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:40.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:27:40.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:27:40.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:40.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:40.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:40.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:27:40.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:27:40.725 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.725 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.726 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.726 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:40.726 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:40.727 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:40.727 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:40.504+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:40.730 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:40.731 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:40.726+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:40.732 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:40.732 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:40.732 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:40.732 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:40.733 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:40.733 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:40.733 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 54 16 49467 49451 7.15362 6.71875 0.0103591 0.0174571 2020-11-12T17:27:40.751 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:40.778 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:40.780 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:40.781 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:40.781 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:40.781 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:40.782 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:40.782 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:40.782 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:40.782 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:40.847 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:40.844+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:40.901 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:40.901 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:40.908 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:27:40.915 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:40.967 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:40.964+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:41.032 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:41.030+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:41.042 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:41.043 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:41.053 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:41.139 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:41.138+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:41.217 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:41.217 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:41.228 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:41.235 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:41.232+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:41.336 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:41.334+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:41.399 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:41.399 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:41.411 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:41.437 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:41.432+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:41.538 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:41.532+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:41.559 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 55 16 50271 50255 7.13775 6.28125 0.0137957 0.0174956 2020-11-12T17:27:41.574 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:41.575 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:41.586 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:41.639 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:41.638+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:41.707 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:41.708 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:41.720 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:41.763 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:41.762+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:41.841 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:41.836+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:41.848 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:41.848 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:41.863 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:41.943 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:41.942+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:42.013 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:42.013 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:42.025 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:42.045 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:42.042+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:42.141 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:42.142 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:42.145 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:42.142+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:42.153 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:42.247 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:42.244+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:42.276 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:42.277 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:42.287 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:42.379 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:42.376+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:42.449 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:42.444+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:42.500 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:42.500 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:42.501 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:42.560 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 56 16 50998 50982 7.1117 5.67969 0.0136378 0.0175548 2020-11-12T17:27:42.569 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:42.556+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:42.653 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:42.650+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:42.664 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:42.664 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:42.674 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:42.762 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:42.760+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:42.800 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:42.835 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:42.836 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:42.845 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:42.855 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:42.854+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:42.924 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:27:42.958 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:42.954+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:42.959 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:42.987 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:43.011 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:43.037 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:43.038 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:43.038 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:43.049 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:43.081 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:43.082 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:43.076+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:43.129 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:43.158 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:43.154+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:43.173 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:43.188 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:43.188 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:43.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:43.189 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:43.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.189 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:43.189 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:43.189 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 278.07765818600001, 2020-11-12T17:27:43.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:43.190 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.190 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.190 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.190 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:43.190 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:43.190 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:43.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.191 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:43.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:43.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:43.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:43.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:43.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:43.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:43.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:43.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:43.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:43.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:43.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:43.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:43.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:43.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:43.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:43.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:43.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:43.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:43.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:43.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:43.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:43.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.201 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:43.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:43.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:43.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:43.202 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.202 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.202 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.203 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:43.203 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:43.203 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 278.07056639000001, 2020-11-12T17:27:43.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:43.203 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.203 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:43.203 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:43.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:43.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:43.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:43.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:43.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:43.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:43.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:43.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:43.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:43.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:43.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:43.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:43.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:43.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:43.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:43.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:43.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.210 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.211 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:43.211 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:43.211 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 268.63800689300001, 2020-11-12T17:27:43.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:43.211 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.211 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:43.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:43.212 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:43.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.212 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.212 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:43.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:43.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:43.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:43.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:43.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:43.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:43.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:43.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:43.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:43.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:43.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:43.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:43.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:43.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:43.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:43.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:43.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:43.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:43.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:43.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:43.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:43.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:43.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:43.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:43.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:43.221 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.221 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.221 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.222 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:43.222 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:43.222 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 234.68788679900001, 2020-11-12T17:27:43.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:43.222 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.222 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:43.222 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:43.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:43.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:43.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:43.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:43.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:43.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:43.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:43.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:43.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:43.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:43.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:43.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:43.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:43.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:43.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:43.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:43.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.229 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.230 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:43.230 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:43.230 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 232.582284907, 2020-11-12T17:27:43.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:43.231 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.231 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.231 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:43.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:43.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:43.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:43.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:43.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:43.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:43.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:43.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:43.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:43.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:43.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:43.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:43.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:43.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:43.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:43.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:43.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:43.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:43.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.238 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.239 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:43.239 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:43.239 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 201.235801573, 2020-11-12T17:27:43.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:43.239 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.239 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.240 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.240 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:43.240 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:43.240 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:43.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.240 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:43.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:43.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:43.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:43.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:43.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:43.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:43.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:43.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:43.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:43.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:43.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:43.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:43.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:43.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:43.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:43.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:43.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:43.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:43.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:43.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:43.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:43.249 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.249 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.249 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.249 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:43.250 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:43.250 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 192.239959771, 2020-11-12T17:27:43.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:43.250 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.250 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:43.250 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:43.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:43.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:43.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:43.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:43.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:43.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:43.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:43.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:43.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:43.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:43.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:43.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:43.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:43.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:43.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:43.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:43.256 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.256 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.256 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.257 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:43.257 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:43.257 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 188.30485637199999, 2020-11-12T17:27:43.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:43.257 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.257 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:43.258 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:43.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:43.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:43.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:43.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:43.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:43.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:43.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:43.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:43.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:43.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:43.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:43.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:43.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:43.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:43.263 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.263 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.263 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.263 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:43.263 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:43.264 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 157.54021588099999, 2020-11-12T17:27:43.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:43.264 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.264 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:43.264 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:43.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:43.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:43.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:43.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:43.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:43.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:43.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:43.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:43.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:43.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:43.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:43.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:43.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:43.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:43.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:43.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:43.270 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.270 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.271 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.271 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:43.271 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:43.271 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 151.28370719700001, 2020-11-12T17:27:43.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:43.271 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.272 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.272 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.272 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:43.272 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:43.272 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:43.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.272 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:43.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:43.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:43.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:43.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:43.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:43.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:43.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:43.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:43.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:43.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:43.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:43.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:43.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:43.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:43.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:43.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:43.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:43.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:43.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:43.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:43.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:43.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:43.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:43.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:43.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:43.281 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.281 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.281 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.282 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:43.282 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:43.282 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 151.28354482699999, 2020-11-12T17:27:43.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:43.282 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.282 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.282 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.283 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:43.283 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:43.283 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:43.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.283 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:43.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:43.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:43.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:43.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:43.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:43.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:43.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:43.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:43.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:43.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:43.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:43.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:43.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:43.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:43.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:43.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:43.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:43.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:43.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:43.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:43.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:43.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:43.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:43.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:43.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:43.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.313 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.314 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:43.314 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:43.314 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 151.27497584, 2020-11-12T17:27:43.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:43.314 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.314 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:43.314 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:43.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:43.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:43.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:43.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:43.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:43.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:43.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:43.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:43.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:43.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:43.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:43.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:43.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:43.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:43.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:43.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:43.321 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.321 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.321 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.322 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:43.322 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:43.322 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.77046339, 2020-11-12T17:27:43.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:43.322 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.323 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.323 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.323 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:43.323 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:43.323 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:43.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.323 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:43.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:43.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:43.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:43.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:43.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:43.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:43.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:43.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:43.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:43.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:43.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:43.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:43.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:43.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:43.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:43.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:43.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:43.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:43.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:43.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:43.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:43.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:43.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:43.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:43.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:43.334 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.334 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.334 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.334 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:43.335 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:43.335 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 125.28491510400001, 2020-11-12T17:27:43.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:43.335 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.335 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.335 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:43.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:43.336 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:43.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.336 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:43.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:43.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:43.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:43.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:43.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:43.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:43.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:43.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:43.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:43.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:43.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:43.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:43.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:43.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:43.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:43.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:43.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:43.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:43.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:43.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:43.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:43.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:43.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:43.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:43.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:43.345 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.345 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.345 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.346 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:43.346 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:43.346 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.211596672, 2020-11-12T17:27:43.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:43.346 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.346 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:43.346 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:43.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:43.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:43.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:43.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:43.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:43.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:43.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:43.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:43.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:43.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:43.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:43.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:43.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:43.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:43.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:43.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:43.352 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.352 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.353 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.353 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:43.353 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:43.353 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 121.155951696, 2020-11-12T17:27:43.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:43.353 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.354 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.354 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.354 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:43.354 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:43.354 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:43.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.354 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:43.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:43.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:43.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:43.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:43.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:43.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:43.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:43.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:43.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:43.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:43.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:43.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:43.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:43.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:43.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:43.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:43.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:43.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:43.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:43.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:43.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:43.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:43.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:43.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:43.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:43.364 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.364 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.364 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.365 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:43.365 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:43.365 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.767747325, 2020-11-12T17:27:43.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:43.365 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.365 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.365 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:43.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:43.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:43.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:43.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:43.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:43.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:43.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:43.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:43.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:43.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:43.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:43.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:43.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:43.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:43.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:43.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:43.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:43.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:43.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:43.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:43.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:43.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:43.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:43.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:43.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:43.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.375 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.375 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:43.375 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:43.376 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 106.56129039299999, 2020-11-12T17:27:43.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:43.376 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.376 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.376 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.376 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:43.376 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:43.376 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:43.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.377 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:43.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:43.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:43.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:43.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:43.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:43.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:43.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:43.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:43.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:43.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:43.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:43.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:43.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:43.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:43.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:43.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:43.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:43.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:43.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:43.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:43.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:43.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:43.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:43.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:43.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:43.385 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.385 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.385 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.386 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:43.386 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:43.386 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.31208477600001, 2020-11-12T17:27:43.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:43.386 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.387 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.387 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.387 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:43.387 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:43.387 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:43.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.388 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:43.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:43.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:43.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:43.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:43.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:43.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:43.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:43.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:43.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:43.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:43.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:43.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:43.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:43.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:43.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:43.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:43.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:43.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:43.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:43.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:43.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:43.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:43.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:43.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:43.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:43.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:43.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:43.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.397 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.397 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:43.398 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:43.398 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.29512532699999, 2020-11-12T17:27:43.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:43.398 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.398 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:43.398 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:43.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:43.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:43.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:43.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:43.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:43.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:43.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:43.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:43.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:43.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:43.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:43.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:43.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:43.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:43.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:43.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:43.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:43.404 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.404 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.405 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.405 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.405 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.405 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:43.407 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:43.428 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:43.428 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:43.428 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:43.428 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:43.428 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:43.429 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:43.429 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:43.429 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:43.429 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:43.429 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:43.402+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:43.507 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:43.504+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:43.560 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 57 16 51765 51749 7.09205 5.99219 0.0154755 0.0176133 2020-11-12T17:27:43.584 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:51777 5.0 5:0a86957a:::benchmark_data_smithi036_24110_object6472:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e158)", 2020-11-12T17:27:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:43.578648+0000", 2020-11-12T17:27:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0057429270000000001, 2020-11-12T17:27:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057785670000000001, 2020-11-12T17:27:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 51777 2020-11-12T17:27:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578648+0000", 2020-11-12T17:27:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578648+0000", 2020-11-12T17:27:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999442 2020-11-12T17:27:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578592+0000", 2020-11-12T17:27:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000150657 2020-11-12T17:27:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578743+0000", 2020-11-12T17:27:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1787999999999999e-05 2020-11-12T17:27:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578765+0000", 2020-11-12T17:27:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0576e-05 2020-11-12T17:27:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578775+0000", 2020-11-12T17:27:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0167000000000002e-05 2020-11-12T17:27:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578835+0000", 2020-11-12T17:27:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020701699999999999 2020-11-12T17:27:43.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.579042+0000", 2020-11-12T17:27:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015208600000000001 2020-11-12T17:27:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.579194+0000", 2020-11-12T17:27:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054644899999999996 2020-11-12T17:27:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:51778 5.0 5:0a86957a:::benchmark_data_smithi036_24110_object6472:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e158)", 2020-11-12T17:27:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:43.578827+0000", 2020-11-12T17:27:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.005563793, 2020-11-12T17:27:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056988309999999997, 2020-11-12T17:27:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 51778 2020-11-12T17:27:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578827+0000", 2020-11-12T17:27:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578827+0000", 2020-11-12T17:27:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578802+0000", 2020-11-12T17:27:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1704000000000003e-05 2020-11-12T17:27:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578873+0000", 2020-11-12T17:27:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7949999999999996e-06 2020-11-12T17:27:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578882+0000", 2020-11-12T17:27:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3769999999999998e-06 2020-11-12T17:27:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.578887+0000", 2020-11-12T17:27:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023409920000000001 2020-11-12T17:27:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.581228+0000", 2020-11-12T17:27:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9352999999999996e-05 2020-11-12T17:27:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.581317+0000", 2020-11-12T17:27:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013900199999999999 2020-11-12T17:27:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.581456+0000", 2020-11-12T17:27:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026287429999999998 2020-11-12T17:27:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:51779 5.0 5:0a86957a:::benchmark_data_smithi036_24110_object6472:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e158)", 2020-11-12T17:27:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:43.582786+0000", 2020-11-12T17:27:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.001605378, 2020-11-12T17:27:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018455940000000001, 2020-11-12T17:27:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:43.609 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 51779 2020-11-12T17:27:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.582786+0000", 2020-11-12T17:27:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.582786+0000", 2020-11-12T17:27:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.582753+0000", 2020-11-12T17:27:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3386000000000003e-05 2020-11-12T17:27:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.582846+0000", 2020-11-12T17:27:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7484000000000001e-05 2020-11-12T17:27:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.582864+0000", 2020-11-12T17:27:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.582873+0000", 2020-11-12T17:27:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054468099999999998 2020-11-12T17:27:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583417+0000", 2020-11-12T17:27:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000132798 2020-11-12T17:27:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583550+0000", 2020-11-12T17:27:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000198378 2020-11-12T17:27:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:43.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583749+0000", 2020-11-12T17:27:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00096302099999999999 2020-11-12T17:27:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:51780 5.0 5.5ea96150 (undecoded) ondisk+write+known_if_redirected e158)", 2020-11-12T17:27:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:43.583052+0000", 2020-11-12T17:27:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.001338466, 2020-11-12T17:27:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001635254, 2020-11-12T17:27:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 51780 2020-11-12T17:27:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583052+0000", 2020-11-12T17:27:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583052+0000", 2020-11-12T17:27:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999676 2020-11-12T17:27:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583020+0000", 2020-11-12T17:27:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4622000000000003e-05 2020-11-12T17:27:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583115+0000", 2020-11-12T17:27:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2517000000000001e-05 2020-11-12T17:27:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583127+0000", 2020-11-12T17:27:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5520000000000001e-06 2020-11-12T17:27:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583134+0000", 2020-11-12T17:27:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1377000000000004e-05 2020-11-12T17:27:43.651 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.651 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.651 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.652 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:51781 5.0 5.5ea96150 (undecoded) ondisk+write+known_if_redirected e158)", 2020-11-12T17:27:43.652 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:43.583374+0000", 2020-11-12T17:27:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0010173739999999999, 2020-11-12T17:27:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001355242, 2020-11-12T17:27:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 51781 2020-11-12T17:27:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583374+0000", 2020-11-12T17:27:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583374+0000", 2020-11-12T17:27:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583340+0000", 2020-11-12T17:27:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2893000000000007e-05 2020-11-12T17:27:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583433+0000", 2020-11-12T17:27:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7685000000000001e-05 2020-11-12T17:27:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583451+0000", 2020-11-12T17:27:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4688000000000001e-05 2020-11-12T17:27:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.583465+0000", 2020-11-12T17:27:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1872000000000004e-05 2020-11-12T17:27:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:51777 5.0 e158/135)", 2020-11-12T17:27:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:43.584478+0000", 2020-11-12T17:27:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4294967295.9999132, 2020-11-12T17:27:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00029111300000000002, 2020-11-12T17:27:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.584478+0000", 2020-11-12T17:27:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.584478+0000", 2020-11-12T17:27:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:27:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.584464+0000", 2020-11-12T17:27:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6893000000000001e-05 2020-11-12T17:27:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.584501+0000", 2020-11-12T17:27:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8296000000000001e-05 2020-11-12T17:27:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.584540+0000", 2020-11-12T17:27:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5709999999999999e-06 2020-11-12T17:27:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.584544+0000", 2020-11-12T17:27:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6310999999999996e-05 2020-11-12T17:27:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 6 2020-11-12T17:27:43.669 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:43.670 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:43.672 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:43.666+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:43.771 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:43.770+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:43.839 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:43.839 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:43.840 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:43.840 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:43.840 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:43.851 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:43.899 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:43.896+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:43.917 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:27:43.973 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:43.970+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:43.977 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:43.978 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:43.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:43.978 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:43.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.979 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:43.979 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:43.979 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 269.55710172800002, 2020-11-12T17:27:43.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:43.979 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:43.980 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:43.980 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:43.980 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:43.980 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:43.980 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:43.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.980 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:43.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:43.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:43.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:43.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:43.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:43.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:43.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:43.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:43.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:43.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:43.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:43.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:43.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:43.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:43.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:43.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:43.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:43.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:43.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:43.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:43.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:43.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:43.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:43.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:43.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:43.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:43.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:43.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:43.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:43.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:43.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:43.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:44.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.074 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.075 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 269.55015766600002, 2020-11-12T17:27:44.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:44.077 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:44.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:44.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:44.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:44.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:44.088 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.089 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 233.37631988000001, 2020-11-12T17:27:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:44.090 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:44.091 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:44.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:44.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:44.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:44.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:44.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:44.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:27:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:27:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:27:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:27:44.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:27:44.132 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.132 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.132 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:27:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 217.11261478700001, 2020-11-12T17:27:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:27:44.133 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.134 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.134 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.134 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:44.134 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:44.134 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:27:44.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.135 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:44.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:27:44.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:27:44.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:27:44.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:27:44.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:27:44.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:27:44.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:27:44.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:27:44.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:27:44.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:27:44.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:27:44.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:27:44.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:44.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:27:44.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:27:44.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:27:44.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:27:44.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:27:44.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:27:44.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:27:44.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:27:44.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:27:44.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:27:44.145 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.145 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.145 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.145 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:27:44.146 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:44.146 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 202.02723446100001, 2020-11-12T17:27:44.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:27:44.146 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.146 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.146 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:44.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:44.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:44.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:27:44.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:27:44.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:27:44.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:27:44.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:27:44.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:27:44.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:27:44.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:27:44.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:27:44.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:27:44.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:27:44.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:27:44.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:27:44.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:27:44.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:27:44.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:27:44.154 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.154 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.154 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.155 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:27:44.155 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:44.155 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 200.333096187, 2020-11-12T17:27:44.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:27:44.155 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.155 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.156 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.156 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:44.156 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:44.156 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:27:44.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.156 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:44.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:44.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:44.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:27:44.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:27:44.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:27:44.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:27:44.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:27:44.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:27:44.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:27:44.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:27:44.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:27:44.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:27:44.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:27:44.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:27:44.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:44.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:27:44.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:27:44.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:27:44.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:27:44.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:27:44.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:27:44.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:27:44.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:27:44.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:27:44.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:27:44.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.166 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.166 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:27:44.167 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:44.167 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.66385746500001, 2020-11-12T17:27:44.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:27:44.167 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.167 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.167 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.167 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:44.167 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:44.168 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:27:44.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.168 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:44.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:44.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:44.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:27:44.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:27:44.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:27:44.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:27:44.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:27:44.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:27:44.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:27:44.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:27:44.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:27:44.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:27:44.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:27:44.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:27:44.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:44.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:27:44.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:27:44.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:27:44.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:27:44.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:27:44.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:27:44.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:27:44.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:27:44.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:27:44.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:27:44.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.178 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.179 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:27:44.180 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:44.180 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.650680706, 2020-11-12T17:27:44.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:27:44.181 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.181 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:44.181 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:44.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:44.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:44.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:27:44.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:27:44.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:27:44.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:27:44.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:27:44.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:27:44.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:27:44.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:27:44.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:27:44.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:27:44.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:27:44.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:27:44.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:27:44.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:27:44.194 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.195 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.195 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.196 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:27:44.196 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:44.197 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.09659925700001, 2020-11-12T17:27:44.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:27:44.197 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.198 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.198 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.198 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:44.198 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:44.199 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:27:44.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.199 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.200 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.200 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:44.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.201 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:44.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:27:44.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:27:44.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:27:44.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:27:44.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:27:44.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:27:44.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:27:44.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:27:44.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:27:44.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:27:44.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:27:44.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:27:44.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:27:44.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.211 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:44.212 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:27:44.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:27:44.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:27:44.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:27:44.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:27:44.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:27:44.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:27:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:27:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:27:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:27:44.216 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:27:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:44.217 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 138.08761195100001, 2020-11-12T17:27:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:27:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:44.218 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:27:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:27:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:27:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:27:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:27:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:27:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:27:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:27:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:27:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:27:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:27:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:27:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:27:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:27:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:27:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.06968463699999, 2020-11-12T17:27:44.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:27:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.233 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:27:44.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:44.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:27:44.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:27:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:27:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:27:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:27:44.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:27:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:27:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:27:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:27:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:27:44.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:27:44.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:27:44.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:27:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:27:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:27:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:27:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:27:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:27:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:27:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:27:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:27:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:27:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 127.267245739, 2020-11-12T17:27:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:27:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.252 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:27:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:44.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:27:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:27:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:27:44.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:27:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:27:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:27:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:27:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:27:44.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:27:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:27:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:27:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:27:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:27:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:27:44.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:27:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:27:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:27:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:27:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:27:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:27:44.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:27:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:27:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.265 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 127.188123422, 2020-11-12T17:27:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:27:44.266 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:27:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:27:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:27:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:27:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:27:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:27:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:27:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:27:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:27:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:27:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:27:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:27:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:27:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:27:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:27:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:27:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:27:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:27:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:27:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:27:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:27:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:27:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:27:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:27:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.405772455, 2020-11-12T17:27:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:27:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.277 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:27:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:27:44.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:27:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:27:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:27:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:27:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:27:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:27:44.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:27:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:27:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:27:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:27:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:27:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:27:44.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:27:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:27:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:27:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:27:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:27:44.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:27:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:27:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:27:44.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:27:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:27:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.327 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:27:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:44.328 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.942730105999999, 2020-11-12T17:27:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:27:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:44.329 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:27:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:44.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:27:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:27:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:27:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:27:44.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:27:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:27:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:27:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:27:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:27:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:27:44.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:27:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:27:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:27:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:27:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:27:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:27:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:27:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:27:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:27:44.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:27:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:27:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:27:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:27:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.342 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.920970955000001, 2020-11-12T17:27:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:27:44.343 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.344 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:27:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.345 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:27:44.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:27:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:27:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:27:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:27:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:27:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:27:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:27:44.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:27:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:27:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:27:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:27:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:27:44.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:27:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:27:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:27:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:27:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:27:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:27:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:27:44.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:27:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:27:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.354 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35048 5.1 e148/127 5:8e34dcfa:::benchmark_data_smithi036_24110_object4380:head v 148'2280, mlcod=148'2275)", 2020-11-12T17:27:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.616032136000001, 2020-11-12T17:27:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002, 2020-11-12T17:27:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.355 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359524+0000", 2020-11-12T17:27:44.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.064e-05 2020-11-12T17:27:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359605+0000", 2020-11-12T17:27:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34493079599999998 2020-11-12T17:27:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704536+0000", 2020-11-12T17:27:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2110000000000001e-06 2020-11-12T17:27:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704543+0000", 2020-11-12T17:27:44.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1071999999999998e-05 2020-11-12T17:27:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704634+0000", 2020-11-12T17:27:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2281999999999998e-05 2020-11-12T17:27:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704696+0000", 2020-11-12T17:27:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034977459999999999 2020-11-12T17:27:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708194+0000", 2020-11-12T17:27:44.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1390000000000006e-05 2020-11-12T17:27:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708265+0000", 2020-11-12T17:27:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002 2020-11-12T17:27:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.362 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35144 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.408426238000001, 2020-11-12T17:27:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998, 2020-11-12T17:27:44.363 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35144 2020-11-12T17:27:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:44.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567086+0000", 2020-11-12T17:27:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017142700000000001 2020-11-12T17:27:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567257+0000", 2020-11-12T17:27:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1043000000000002e-05 2020-11-12T17:27:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567278+0000", 2020-11-12T17:27:44.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1214e-05 2020-11-12T17:27:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567289+0000", 2020-11-12T17:27:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142698779 2020-11-12T17:27:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.709988+0000", 2020-11-12T17:27:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4704999999999995e-05 2020-11-12T17:27:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710083+0000", 2020-11-12T17:27:44.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016350300000000001 2020-11-12T17:27:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710246+0000", 2020-11-12T17:27:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002268946 2020-11-12T17:27:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.712515+0000", 2020-11-12T17:27:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199261574 2020-11-12T17:27:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911777+0000", 2020-11-12T17:27:44.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0816999999999996e-05 2020-11-12T17:27:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911858+0000", 2020-11-12T17:27:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2182000000000003e-05 2020-11-12T17:27:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911910+0000", 2020-11-12T17:27:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998 2020-11-12T17:27:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.859611285, 2020-11-12T17:27:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:27:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.374 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:27:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:27:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:27:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:27:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:27:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:27:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:27:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:27:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:27:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:27:44.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:27:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:27:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:27:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:27:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:27:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:27:44.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:27:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:27:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:27:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:27:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:27:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:27:44.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:27:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36416 5.0 5:05125f34:::benchmark_data_smithi036_24110_object4551:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:44.384 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.00188326, 2020-11-12T17:27:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002, 2020-11-12T17:27:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36416 2020-11-12T17:27:44.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:27:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973666+0000", 2020-11-12T17:27:44.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117633 2020-11-12T17:27:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973783+0000", 2020-11-12T17:27:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6325999999999999e-05 2020-11-12T17:27:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973800+0000", 2020-11-12T17:27:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:27:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973807+0000", 2020-11-12T17:27:44.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054509620000000002 2020-11-12T17:27:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979258+0000", 2020-11-12T17:27:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1768999999999996e-05 2020-11-12T17:27:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979340+0000", 2020-11-12T17:27:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107278 2020-11-12T17:27:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979447+0000", 2020-11-12T17:27:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005025753 2020-11-12T17:27:44.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.984473+0000", 2020-11-12T17:27:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35634463199999999 2020-11-12T17:27:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340818+0000", 2020-11-12T17:27:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3640000000000001e-05 2020-11-12T17:27:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340871+0000", 2020-11-12T17:27:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2222999999999998e-05 2020-11-12T17:27:44.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340924+0000", 2020-11-12T17:27:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002 2020-11-12T17:27:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.394 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:44.395 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:44.395 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:44.396 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:44.064+0000 7fc24d2e3700 -1 osd.3 158 handle_osd_map injecting map crc failure 2020-11-12T17:27:44.396 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:44.394+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:44.397 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:44.497 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:44.494+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:44.525 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:44.526 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:44.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.526 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:52515 5.5 e159/139 5:a0cf8ae3:::benchmark_data_smithi036_24110_object6564:head v 159'3283, mlcod=159'3276)", 2020-11-12T17:27:44.526 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:44.520538+0000", 2020-11-12T17:27:44.526 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0048190730000000001, 2020-11-12T17:27:44.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048392909999999999, 2020-11-12T17:27:44.527 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:44.527 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:44.527 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:44.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:44.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.520538+0000", 2020-11-12T17:27:44.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:44.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:44.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.520538+0000", 2020-11-12T17:27:44.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:27:44.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:44.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.520511+0000", 2020-11-12T17:27:44.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0384999999999996e-05 2020-11-12T17:27:44.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:44.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.520601+0000", 2020-11-12T17:27:44.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027274220000000002 2020-11-12T17:27:44.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:44.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.523328+0000", 2020-11-12T17:27:44.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5460000000000003e-06 2020-11-12T17:27:44.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.523336+0000", 2020-11-12T17:27:44.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8947000000000003e-05 2020-11-12T17:27:44.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:44.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.523395+0000", 2020-11-12T17:27:44.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0212000000000001e-05 2020-11-12T17:27:44.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:44.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.523425+0000", 2020-11-12T17:27:44.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002886684 2020-11-12T17:27:44.533 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:44.533 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:44.533 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:44.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.534 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:52516 5.5 e159/139 5:a0cf8ae3:::benchmark_data_smithi036_24110_object6564:head v 159'3284, mlcod=159'3279)", 2020-11-12T17:27:44.534 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:44.523190+0000", 2020-11-12T17:27:44.534 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.002167478, 2020-11-12T17:27:44.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002243451, 2020-11-12T17:27:44.534 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:44.534 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:44.534 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:44.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:44.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.523190+0000", 2020-11-12T17:27:44.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:44.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:44.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.523190+0000", 2020-11-12T17:27:44.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:44.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.523160+0000", 2020-11-12T17:27:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010425900000000001 2020-11-12T17:27:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:44.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.523264+0000", 2020-11-12T17:27:44.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013408529999999999 2020-11-12T17:27:44.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:44.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.524605+0000", 2020-11-12T17:27:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5169999999999996e-06 2020-11-12T17:27:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.524611+0000", 2020-11-12T17:27:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1570999999999997e-05 2020-11-12T17:27:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.524673+0000", 2020-11-12T17:27:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2011999999999999e-05 2020-11-12T17:27:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:44.524695+0000", 2020-11-12T17:27:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015047389999999999 2020-11-12T17:27:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:27:44.577 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:44.578 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 58 16 52559 52543 7.07672 6.20312 0.00998564 0.0176535 2020-11-12T17:27:44.578 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:44.599 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:44.592+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:44.710 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:44.702+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:44.755 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:44.756 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:44.756 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:44.757 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:44.757 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:44.770 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:44.829 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:44.826+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:44.905 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:44.900+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:44.922 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:44.916+0000 7f0389ec4700 -1 osd.2 159 handle_osd_map injecting map crc failure 2020-11-12T17:27:44.923 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:44.914+0000 7f9289d6e700 -1 osd.7 159 handle_osd_map injecting map crc failure 2020-11-12T17:27:44.986 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:44.986 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.987 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:27:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 274.28957354599999, 2020-11-12T17:27:44.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:27:44.989 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:44.989 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:44.989 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:44.989 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:44.990 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:44.990 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:27:44.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.990 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:44.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:44.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:44.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:44.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:44.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:44.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:44.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:44.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:27:44.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:27:44.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:44.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:27:44.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:27:44.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:44.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:27:44.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:27:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:44.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:27:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:27:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:44.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:27:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:27:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:27:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:27:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:27:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:27:45.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:27:45.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:27:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:27:45.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:27:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:27:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:27:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:27:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:27:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.008 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.009 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:27:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 274.284093477, 2020-11-12T17:27:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:27:45.010 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:27:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:27:45.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:27:45.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:27:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:27:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:27:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:27:45.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:27:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:27:45.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:27:45.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:27:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:27:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:27:45.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:27:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.026 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:27:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:45.027 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 266.093971877, 2020-11-12T17:27:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:27:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:45.028 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:27:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:27:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:27:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:27:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:27:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:27:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:27:45.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:27:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:27:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:27:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:27:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:27:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:27:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:27:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:27:45.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:27:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:27:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:27:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:27:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:27:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:27:45.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:27:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:27:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:27:45.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:27:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:45.039 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 266.08672816799998, 2020-11-12T17:27:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:27:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:27:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:27:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:27:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:27:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:27:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:27:45.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:27:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:27:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:27:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:27:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:27:45.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:27:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:27:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:27:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.046 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 190.090638794, 2020-11-12T17:27:45.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:27:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:45.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:27:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:27:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:27:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:27:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:27:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:27:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:27:45.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:27:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:27:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:27:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:27:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:27:45.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:27:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:27:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:27:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.054 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:27:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 123.963116282, 2020-11-12T17:27:45.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:27:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:27:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:27:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:27:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:27:45.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:27:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:27:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:27:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:27:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:27:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:27:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:27:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:27:45.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:27:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:27:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 116.914049621, 2020-11-12T17:27:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:27:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.063 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:27:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:45.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:27:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:27:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:27:45.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:27:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:27:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:27:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:27:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:27:45.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:27:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:27:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:27:45.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:27:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:27:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:45.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:27:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:27:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:27:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:27:45.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:27:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:27:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:27:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:27:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:27:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:27:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.073 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 116.912368841, 2020-11-12T17:27:45.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:27:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:27:45.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:27:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:27:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:27:45.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:27:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:27:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:27:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:27:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:27:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:27:45.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:27:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:27:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:27:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:27:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:27:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:27:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:27:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:27:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:27:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:27:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:27:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:27:45.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:27:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:45.085 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 116.912280646, 2020-11-12T17:27:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:27:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.086 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:27:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:27:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:27:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:27:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:27:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:27:45.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:27:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:27:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:27:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:27:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:27:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:27:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:27:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:27:45.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:27:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:27:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:27:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:27:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:27:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:27:45.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:27:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:27:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:27:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 116.89365234100001, 2020-11-12T17:27:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:27:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:27:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:27:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:27:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:27:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:27:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:27:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:27:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:27:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:27:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:27:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:27:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:27:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:27:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:27:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 116.893567613, 2020-11-12T17:27:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:27:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:27:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:27:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:27:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:27:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:27:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:27:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:27:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:27:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:27:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:27:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:27:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:27:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:27:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:27:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 84.142745161999997, 2020-11-12T17:27:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:27:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.116 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.117 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:27:45.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.117 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:27:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:27:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:27:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:27:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:27:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:27:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:27:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:27:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:27:45.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:27:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:27:45.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:27:45.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:27:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:27:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:27:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:27:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:27:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:27:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:27:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:27:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:27:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:27:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 83.056089674000006, 2020-11-12T17:27:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:27:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:27:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:27:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:27:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:27:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:27:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:27:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:27:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:27:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:27:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:27:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:27:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:27:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:27:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:27:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:27:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:27:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:27:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:27:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:27:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:27:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:27:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:27:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:27:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:27:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 83.042608447000006, 2020-11-12T17:27:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:27:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:27:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:27:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:27:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:27:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:27:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:27:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:27:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:27:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:27:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:27:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:27:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:27:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:27:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:27:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 48.040320244999997, 2020-11-12T17:27:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:27:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:27:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:27:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:27:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:27:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:27:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:27:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:27:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:27:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:27:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:27:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:27:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:27:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:27:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:27:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:27:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:27:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:27:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:27:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:27:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:27:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:27:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:27:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:27:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 48.034503661000002, 2020-11-12T17:27:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:27:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:27:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:27:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:27:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:27:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:27:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:27:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:27:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:27:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:27:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:27:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:27:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:27:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:27:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:27:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:27:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:27:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:27:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:27:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:27:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:27:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:27:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:27:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:27:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:27:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 48.011570147, 2020-11-12T17:27:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:27:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:27:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:27:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:27:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:27:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:27:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:27:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:27:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:27:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:27:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:27:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:27:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:27:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:27:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:27:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:27:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:27:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:27:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 41.479092119999997, 2020-11-12T17:27:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:27:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:27:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:27:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:27:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:27:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:27:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:27:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:27:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:27:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:27:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:27:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:27:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:27:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:27:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:27:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:27:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:27:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36040 5.a e149/127 5:5a4d50fb:::benchmark_data_smithi036_24110_object4504:head v 149'2328, mlcod=149'2321)", 2020-11-12T17:27:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 20.440243218999999, 2020-11-12T17:27:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001, 2020-11-12T17:27:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536010+0000", 2020-11-12T17:27:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111983 2020-11-12T17:27:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536122+0000", 2020-11-12T17:27:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40432243400000001 2020-11-12T17:27:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940444+0000", 2020-11-12T17:27:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2870000000000001e-06 2020-11-12T17:27:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940450+0000", 2020-11-12T17:27:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4161999999999999e-05 2020-11-12T17:27:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940524+0000", 2020-11-12T17:27:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4454e-05 2020-11-12T17:27:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940549+0000", 2020-11-12T17:27:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021055879999999998 2020-11-12T17:27:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942654+0000", 2020-11-12T17:27:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5819000000000002e-05 2020-11-12T17:27:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942710+0000", 2020-11-12T17:27:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001 2020-11-12T17:27:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:47376 5.1 5:83c83455:::benchmark_data_smithi036_24110_object5921:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e157)", 2020-11-12T17:27:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 7.0958584099999999, 2020-11-12T17:27:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37640681799999998, 2020-11-12T17:27:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 47376 2020-11-12T17:27:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999275 2020-11-12T17:27:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880356+0000", 2020-11-12T17:27:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017950299999999999 2020-11-12T17:27:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880535+0000", 2020-11-12T17:27:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9902e-05 2020-11-12T17:27:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880555+0000", 2020-11-12T17:27:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8499999999999994e-06 2020-11-12T17:27:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880563+0000", 2020-11-12T17:27:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054088549999999997 2020-11-12T17:27:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.885972+0000", 2020-11-12T17:27:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0757999999999999e-05 2020-11-12T17:27:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:27:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.885982+0000", 2020-11-12T17:27:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36075470199999998 2020-11-12T17:27:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.246737+0000", 2020-11-12T17:27:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000118664 2020-11-12T17:27:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.246856+0000", 2020-11-12T17:27:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020966600000000001 2020-11-12T17:27:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.247065+0000", 2020-11-12T17:27:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005823791 2020-11-12T17:27:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.252889+0000", 2020-11-12T17:27:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038221399999999999 2020-11-12T17:27:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256711+0000", 2020-11-12T17:27:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5609000000000001e-05 2020-11-12T17:27:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256787+0000", 2020-11-12T17:27:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7657999999999997e-05 2020-11-12T17:27:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256835+0000", 2020-11-12T17:27:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37640681799999998 2020-11-12T17:27:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.218 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:45.218 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:45.219 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:45.112+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:45.220 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:45.218+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:45.322 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:45.318+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:45.349 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:45.349 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:45.349 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:27:45.350 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:45.361 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:45.430 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:45.447 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:45.446+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:45.455 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:45.455 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:45.456 INFO:tasks.thrashosds.thrasher:Growing pool rbd 2020-11-12T17:27:45.456 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:27:45.524 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:45.520+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:45.536 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:45.537 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:45.537 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:45.537 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:45.537 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:45.548 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:45.560 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 59 16 53416 53400 7.07024 6.69531 0.160621 0.0176699 2020-11-12T17:27:45.600 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:45.624 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:45.620+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:45.634 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:45.671 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:45.702 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:45.713 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:45.714 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:27:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 271.18756298300002, 2020-11-12T17:27:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:27:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:45.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:27:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:27:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:27:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:27:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:27:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:27:45.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:27:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:27:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:27:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:27:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:27:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:27:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:27:45.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:27:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:27:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:27:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:27:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:27:45.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:27:45.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:27:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:27:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:27:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:27:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:27:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:27:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9976 3.c e26/20 ondisk, result = 0)", 2020-11-12T17:27:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:27:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 271.18416304900001, 2020-11-12T17:27:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344, 2020-11-12T17:27:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.734 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:27:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529638+0000", 2020-11-12T17:27:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529613+0000", 2020-11-12T17:27:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4759999999999997e-05 2020-11-12T17:27:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.529678+0000", 2020-11-12T17:27:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40301231500000001 2020-11-12T17:27:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932690+0000", 2020-11-12T17:27:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1929999999999999e-05 2020-11-12T17:27:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932702+0000", 2020-11-12T17:27:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000268764 2020-11-12T17:27:45.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.932971+0000", 2020-11-12T17:27:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4686e-05 2020-11-12T17:27:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933006+0000", 2020-11-12T17:27:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00036964700000000002 2020-11-12T17:27:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933375+0000", 2020-11-12T17:27:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.403737344 2020-11-12T17:27:45.740 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:27:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:27:45.741 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 235.70827360199999, 2020-11-12T17:27:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:27:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:27:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:27:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:45.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:27:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:27:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:27:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:27:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:27:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:27:45.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:27:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:27:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:27:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:27:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:27:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:27:45.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:27:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:27:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:27:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:27:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:27:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 203.768288259, 2020-11-12T17:27:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:27:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:27:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:27:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:27:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:27:45.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:27:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:27:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:27:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:27:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:27:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:27:45.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:27:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:27:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:27:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:27:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:27:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:27:45.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:27:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:27:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:27:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:27:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:27:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:27:45.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:27:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:27:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:27:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:27:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.760 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:27:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:27:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 192.29118718500001, 2020-11-12T17:27:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:27:45.761 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.762 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:27:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:27:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:27:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:27:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:27:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:27:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:27:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:27:45.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:27:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:27:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:27:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:27:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:27:45.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:27:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:27:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:27:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.768 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:27:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:27:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 191.17217679800001, 2020-11-12T17:27:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:27:45.769 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:27:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.770 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:27:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:27:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:27:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:27:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:27:45.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:27:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:27:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:27:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:27:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:27:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:27:45.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:27:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:27:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:27:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:27:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:27:45.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:27:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:27:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:27:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:27:45.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:27:45.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:27:45.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:27:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:27:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:27:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.779 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:27:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:27:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 191.15603879400001, 2020-11-12T17:27:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:27:45.780 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:27:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:27:45.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:45.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:27:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:27:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:27:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:27:45.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:27:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:27:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:27:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:27:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:27:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:27:45.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:27:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:27:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:27:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:27:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.787 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:27:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:27:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 191.151311115, 2020-11-12T17:27:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:27:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:27:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.788 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:27:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:27:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:27:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:27:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:27:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:27:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:27:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:27:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:27:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:27:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:27:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:27:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:27:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:27:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:27:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:27:45.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:27:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:27:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:39352 4.8 4:11b7b1a2:::benchmark_data_smithi036_18856_object4918:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e87)", 2020-11-12T17:27:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:27:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 134.76975204799999, 2020-11-12T17:27:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999, 2020-11-12T17:27:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.796 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 39352 2020-11-12T17:27:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:27:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944049+0000", 2020-11-12T17:27:45.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999733 2020-11-12T17:27:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944022+0000", 2020-11-12T17:27:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1796e-05 2020-11-12T17:27:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944114+0000", 2020-11-12T17:27:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0191999999999999e-05 2020-11-12T17:27:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944134+0000", 2020-11-12T17:27:45.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2740000000000007e-06 2020-11-12T17:27:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.944143+0000", 2020-11-12T17:27:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033210919999999999 2020-11-12T17:27:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947464+0000", 2020-11-12T17:27:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1347999999999994e-05 2020-11-12T17:27:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947545+0000", 2020-11-12T17:27:45.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015396100000000001 2020-11-12T17:27:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.947699+0000", 2020-11-12T17:27:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0016961960000000001 2020-11-12T17:27:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949395+0000", 2020-11-12T17:27:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.390914337 2020-11-12T17:27:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340310+0000", 2020-11-12T17:27:45.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013346399999999999 2020-11-12T17:27:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340443+0000", 2020-11-12T17:27:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3907999999999998e-05 2020-11-12T17:27:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340517+0000", 2020-11-12T17:27:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39646788199999999 2020-11-12T17:27:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:39352 4.8 e87/69 ondisk, result = 0)", 2020-11-12T17:27:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:27:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 134.76419822700001, 2020-11-12T17:27:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999, 2020-11-12T17:27:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.807 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:27:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949603+0000", 2020-11-12T17:27:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949571+0000", 2020-11-12T17:27:45.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6647000000000001e-05 2020-11-12T17:27:45.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:30.949638+0000", 2020-11-12T17:27:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38768476400000002 2020-11-12T17:27:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337323+0000", 2020-11-12T17:27:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7830000000000001e-06 2020-11-12T17:27:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.337330+0000", 2020-11-12T17:27:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002945806 2020-11-12T17:27:45.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340275+0000", 2020-11-12T17:27:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5809999999999999e-05 2020-11-12T17:27:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340291+0000", 2020-11-12T17:27:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023659000000000001 2020-11-12T17:27:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:31.340528+0000", 2020-11-12T17:27:45.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.39092489699999999 2020-11-12T17:27:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:27:45.816 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.107549215999995, 2020-11-12T17:27:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:27:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.817 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:27:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:27:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:27:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:27:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:27:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:27:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:27:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:27:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:27:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:27:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:27:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:27:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:27:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:27:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:27:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:45.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:27:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:27:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:27:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:27:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:27:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:27:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:27:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:27:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:27:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:27:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.826 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:27:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.105655603000002, 2020-11-12T17:27:45.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:27:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:27:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.828 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:27:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:27:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:27:45.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:27:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:27:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:27:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:27:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:27:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:27:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:27:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:27:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:27:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:27:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:27:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:27:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:27:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:27:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:27:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:27:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:27:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:27:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:27:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:27:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:27:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:27:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.104902955, 2020-11-12T17:27:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:27:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:27:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:27:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:27:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:27:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:27:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:27:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:27:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:27:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:27:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:27:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:27:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:27:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:27:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:27:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:27:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:27:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:27:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:27:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:27:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:27:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:27:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:27:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:27:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:27:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:27:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:27:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:27:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.101741438000005, 2020-11-12T17:27:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:27:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:27:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:27:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:27:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:27:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:27:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:27:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:27:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:27:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:27:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:27:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:27:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:27:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:27:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:27:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:27:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:27:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:27:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:27:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:27:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:27:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:27:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:27:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:27:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:27:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:27:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:27:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:27:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.100660270999995, 2020-11-12T17:27:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:27:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:27:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:27:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:27:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:27:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:27:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:27:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:27:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:27:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:27:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:27:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:27:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:27:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:27:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:27:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:27:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:27:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:27:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:27:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:27:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:27:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:27:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:27:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:27:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:27:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:27:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:27:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.100491177999999, 2020-11-12T17:27:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:27:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:27:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:27:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:27:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:27:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:27:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:27:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:27:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:27:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:27:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:27:45.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:27:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:27:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:27:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:27:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:27:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:27:45.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:27:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:27:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:27:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:27:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:27:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:27:45.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:27:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:27:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:27:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:27:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.881 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:27:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.097872531999997, 2020-11-12T17:27:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:27:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.882 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:27:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:27:45.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:27:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:27:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:27:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:27:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:27:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:27:45.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:27:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:27:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:27:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:27:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:27:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:27:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:27:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:27:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:27:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:27:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:27:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:27:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:27:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:27:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:27:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:27:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:27:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:27:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:27:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.097764448999996, 2020-11-12T17:27:45.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:27:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:27:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.893 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:27:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:27:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:27:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:27:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:27:45.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:27:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:27:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:27:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:27:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:27:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:27:45.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:27:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:27:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:27:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:27:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:27:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:27:45.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:27:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:27:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:45.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:27:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:27:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:27:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:27:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:27:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:27:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:27:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:27:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.093801767000002, 2020-11-12T17:27:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:27:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:45.903 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:27:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:27:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:27:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:27:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:27:45.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:27:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:27:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:27:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:27:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:27:45.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:27:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:27:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:27:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:27:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:27:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:27:45.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:27:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:27:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:27:45.910 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 42.056072026000002, 2020-11-12T17:27:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:27:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:45.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:27:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:27:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:27:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:27:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:27:45.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:27:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:27:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:27:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:27:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:27:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:27:45.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:27:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:27:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:27:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:27:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:27:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:27:45.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:27:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:45.918 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:45.918 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:45.921 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:45.921 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:45.922 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:45.922 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:45.922 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:27:45.922 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2020-11-12T17:27:45.604627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":418578432,"num_objects":6389,"num_object_clones":0,"num_object_copies":12778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51098,"num_write_kb":408770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":529,"num_bytes_recovered":34627584,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51098,"ondisk_log_size":51098,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7733364,"kb_used_data":393276,"kb_used_omap":118,"kb_used_meta":7339913,"kb_avail":652869516,"statfs":{"total":676457349120,"available":668538384384,"internally_reserved":7516192768,"allocated":402714624,"data_stored":823768127,"data_compressed":5306690,"data_compressed_allocated":395239424,"data_compressed_original":820772864,"omap_allocated":121799,"internal_metadata":7516070969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,3,2,0,0,0,0,6],"upper_bound":1024},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47046656,"num_objects":717,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5743,"num_write_kb":45944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001390"},"pg_stats":[{"pgid":"5.f","version":"158'3104","reported_seq":"3142","reported_epoch":"158","state":"active+clean","last_fresh":"2020-11-12T17:27:41.501750+0000","last_change":"2020-11-12T17:26:45.503348+0000","last_active":"2020-11-12T17:27:41.501750+0000","last_peered":"2020-11-12T17:27:41.501750+0000","last_clean":"2020-11-12T17:27:41.501750+0000","last_became_active":"2020-11-12T17:26:45.502940+0000","last_became_peered":"2020-11-12T17:26:45.502940+0000","last_unstale":"2020-11-12T17:27:41.501750+0000","last_undegraded":"2020-11-12T17:27:41.501750+0000","last_fullsized":"2020-11-12T17:27:41.501750+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3104,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":388,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3104,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"157'3232","reported_seq":"3266","reported_epoch":"158","state":"active+clean","last_fresh":"2020-11-12T17:27:40.916306+0000","last_change":"2020-11-12T17:26:45.491058+0000","last_active":"2020-11-12T17:27:40.916306+0000","last_peered":"2020-11-12T17:27:40.916306+0000","last_clean":"2020-11-12T17:27:40.916306+0000","last_became_active":"2020-11-12T17:26:45.490308+0000","last_became_peered":"2020-11-12T17:26:45.490308+0000","last_unstale":"2020-11-12T17:27:40.916306+0000","last_undegraded":"2020-11-12T17:27:40.916306+0000","last_fullsized":"2020-11-12T17:27:40.916306+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3232,"ondisk_log_size":3232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26476544,"num_objects":404,"num_object_clones":0,"num_object_copies":808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":404,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3232,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"160'3216","reported_seq":"3256","reported_epoch":"160","state":"active+clean","last_fresh":"2020-11-12T17:27:45.041301+0000","last_change":"2020-11-12T17:26:45.490550+0000","last_active":"2020-11-12T17:27:45.041301+0000","last_peered":"2020-11-12T17:27:45.041301+0000","last_clean":"2020-11-12T17:27:45.041301+0000","last_became_active":"2020-11-12T17:26:45.490025+0000","last_became_peered":"2020-11-12T17:26:45.490025+0000","last_unstale":"2020-11-12T17:27:45.041301+0000","last_undegraded":"2020-11-12T17:27:45.041301+0000","last_fullsized":"2020-11-12T17:27:45.041301+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3216,"ondisk_log_size":3216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26345472,"num_objects":402,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":402,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3216,"num_write_kb":25728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"158'3104","reported_seq":"3379","reported_epoch":"158","state":"active+clean","last_fresh":"2020-11-12T17:27:41.336360+0000","last_change":"2020-11-12T17:27:04.424601+0000","last_active":"2020-11-12T17:27:41.336360+0000","last_peered":"2020-11-12T17:27:41.336360+0000","last_clean":"2020-11-12T17:27:41.336360+0000","last_became_active":"2020-11-12T17:27:04.422158+0000","last_became_peered":"2020-11-12T17:27:04.422158+0000","last_unstale":"2020-11-12T17:27:41.336360+0000","last_undegraded":"2020-11-12T17:27:41.336360+0000","last_fullsized":"2020-11-12T17:27:41.336360+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3104,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":388,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3104,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":7471104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"160'3456","reported_seq":"3496","reported_epoch":"160","state":"active+clean","last_fresh":"2020-11-12T17:27:45.045391+0000","last_change":"2020-11-12T17:26:45.484541+0000","last_active":"2020-11-12T17:27:45.045391+0000","last_peered":"2020-11-12T17:27:45.045391+0000","last_clean":"2020-11-12T17:27:45.045391+0000","last_became_active":"2020-11-12T17:26:45.484017+0000","last_became_peered":"2020-11-12T17:26:45.484017+0000","last_unstale":"2020-11-12T17:27:45.045391+0000","last_undegraded":"2020-11-12T17:27:45.045391+0000","last_fullsized":"2020-11-12T17:27:45.045391+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3456,"ondisk_log_size":3456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3456,"num_write_kb":27648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"159'3352","reported_seq":"3391","reported_epoch":"159","state":"active+clean","last_fresh":"2020-11-12T17:27:44.621361+0000","last_change":"2020-11-12T17:26:45.490968+0000","last_active":"2020-11-12T17:27:44.621361+0000","last_peered":"2020-11-12T17:27:44.621361+0000","last_clean":"2020-11-12T17:27:44.621361+0000","last_became_active":"2020-11-12T17:26:45.490602+0000","last_became_peered":"2020-11-12T17:26:45.490602+0000","last_unstale":"2020-11-12T17:27:44.621361+0000","last_undegraded":"2020-11-12T17:27:44.621361+0000","last_fullsized":"2020-11-12T17:27:44.621361+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3352,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27459584,"num_objects":419,"num_object_clones":0,"num_object_copies":838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3352,"num_write_kb":26816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"157'2936","reported_seq":"2976","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:40.620311+0000","last_change":"2020-11-12T17:27:28.815974+0000","last_active":"2020-11-12T17:27:40.620311+0000","last_peered":"2020-11-12T17:27:40.620311+0000","last_clean":"2020-11-12T17:27:40.620311+0000","last_became_active":"2020-11-12T17:27:28.811530+0000","last_became_peered":"2020-11-12T17:27:28.811530+0000","last_unstale":"2020-11-12T17:27:40.620311+0000","last_undegraded":"2020-11-12T17:27:40.620311+0000","last_fullsized":"2020-11-12T17:27:40.620311+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":2936,"ondisk_log_size":2936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2936,"num_write_kb":23488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"159'3312","reported_seq":"3568","reported_epoch":"159","state":"active+clean","last_fresh":"2020-11-12T17:27:44.878443+0000","last_change":"2020-11-12T17:27:01.083305+0000","last_active":"2020-11-12T17:27:44.878443+0000","last_peered":"2020-11-12T17:27:44.878443+0000","last_clean":"2020-11-12T17:27:44.878443+0000","last_became_active":"2020-11-12T17:27:00.642804+0000","last_became_peered":"2020-11-12T17:27:00.642804+0000","last_unstale":"2020-11-12T17:27:44.878443+0000","last_undegraded":"2020-11-12T17:27:44.878443+0000","last_fullsized":"2020-11-12T17:27:44.878443+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3312,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27131904,"num_objects":414,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":414,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3312,"num_write_kb":26496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":6840320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"157'3168","reported_seq":"3205","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:40.443613+0000","last_change":"2020-11-12T17:26:45.485794+0000","last_active":"2020-11-12T17:27:40.443613+0000","last_peered":"2020-11-12T17:27:40.443613+0000","last_clean":"2020-11-12T17:27:40.443613+0000","last_became_active":"2020-11-12T17:26:45.485374+0000","last_became_peered":"2020-11-12T17:26:45.485374+0000","last_unstale":"2020-11-12T17:27:40.443613+0000","last_undegraded":"2020-11-12T17:27:40.443613+0000","last_fullsized":"2020-11-12T17:27:40.443613+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3168,"ondisk_log_size":3168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3168,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"34","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:38.244084+0000","last_change":"2020-11-12T17:27:15.924323+0000","last_active":"2020-11-12T17:27:38.244084+0000","last_peered":"2020-11-12T17:27:38.244084+0000","last_clean":"2020-11-12T17:27:38.244084+0000","last_became_active":"2020-11-12T17:27:00.607146+0000","last_became_peered":"2020-11-12T17:27:00.607146+0000","last_unstale":"2020-11-12T17:27:38.244084+0000","last_undegraded":"2020-11-12T17:27:38.244084+0000","last_fullsized":"2020-11-12T17:27:38.244084+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_clean_scrub_stamp":"2020-11-12T17:27:15.924179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"158'3144","reported_seq":"3409","reported_epoch":"158","state":"active+clean","last_fresh":"2020-11-12T17:27:41.224442+0000","last_change":"2020-11-12T17:27:04.421599+0000","last_active":"2020-11-12T17:27:41.224442+0000","last_peered":"2020-11-12T17:27:41.224442+0000","last_clean":"2020-11-12T17:27:41.224442+0000","last_became_active":"2020-11-12T17:27:04.420130+0000","last_became_peered":"2020-11-12T17:27:04.420130+0000","last_unstale":"2020-11-12T17:27:41.224442+0000","last_undegraded":"2020-11-12T17:27:41.224442+0000","last_fullsized":"2020-11-12T17:27:41.224442+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3144,"ondisk_log_size":3144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3144,"num_write_kb":25152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":7077888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"190","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:37.893537+0000","last_change":"2020-11-12T17:27:05.616615+0000","last_active":"2020-11-12T17:27:37.893537+0000","last_peered":"2020-11-12T17:27:37.893537+0000","last_clean":"2020-11-12T17:27:37.893537+0000","last_became_active":"2020-11-12T17:27:00.609586+0000","last_became_peered":"2020-11-12T17:27:00.609586+0000","last_unstale":"2020-11-12T17:27:37.893537+0000","last_undegraded":"2020-11-12T17:27:37.893537+0000","last_fullsized":"2020-11-12T17:27:37.893537+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:05.616420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:05.616420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"160'3384","reported_seq":"3424","reported_epoch":"160","state":"active+clean","last_fresh":"2020-11-12T17:27:45.014192+0000","last_change":"2020-11-12T17:26:45.480866+0000","last_active":"2020-11-12T17:27:45.014192+0000","last_peered":"2020-11-12T17:27:45.014192+0000","last_clean":"2020-11-12T17:27:45.014192+0000","last_became_active":"2020-11-12T17:26:45.480445+0000","last_became_peered":"2020-11-12T17:26:45.480445+0000","last_unstale":"2020-11-12T17:27:45.014192+0000","last_undegraded":"2020-11-12T17:27:45.014192+0000","last_fullsized":"2020-11-12T17:27:45.014192+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3384,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27721728,"num_objects":423,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":423,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3384,"num_write_kb":27072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"54","reported_epoch":"159","state":"active+clean","last_fresh":"2020-11-12T17:27:43.915844+0000","last_change":"2020-11-12T17:26:48.417978+0000","last_active":"2020-11-12T17:27:43.915844+0000","last_peered":"2020-11-12T17:27:43.915844+0000","last_clean":"2020-11-12T17:27:43.915844+0000","last_became_active":"2020-11-12T17:26:29.669260+0000","last_became_peered":"2020-11-12T17:26:29.669260+0000","last_unstale":"2020-11-12T17:27:43.915844+0000","last_undegraded":"2020-11-12T17:27:43.915844+0000","last_fullsized":"2020-11-12T17:27:43.915844+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"160'3168","reported_seq":"3209","reported_epoch":"160","state":"active+clean","last_fresh":"2020-11-12T17:27:44.957159+0000","last_change":"2020-11-12T17:27:28.813298+0000","last_active":"2020-11-12T17:27:44.957159+0000","last_peered":"2020-11-12T17:27:44.957159+0000","last_clean":"2020-11-12T17:27:44.957159+0000","last_became_active":"2020-11-12T17:27:28.808532+0000","last_became_peered":"2020-11-12T17:27:28.808532+0000","last_unstale":"2020-11-12T17:27:44.957159+0000","last_undegraded":"2020-11-12T17:27:44.957159+0000","last_fullsized":"2020-11-12T17:27:44.957159+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3168,"ondisk_log_size":3168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3168,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"173","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:37.893619+0000","last_change":"2020-11-12T17:27:23.933824+0000","last_active":"2020-11-12T17:27:37.893619+0000","last_peered":"2020-11-12T17:27:37.893619+0000","last_clean":"2020-11-12T17:27:37.893619+0000","last_became_active":"2020-11-12T17:26:29.680644+0000","last_became_peered":"2020-11-12T17:26:29.680644+0000","last_unstale":"2020-11-12T17:27:37.893619+0000","last_undegraded":"2020-11-12T17:27:37.893619+0000","last_fullsized":"2020-11-12T17:27:37.893619+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:23.933684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:23.933684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"124","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:34.850188+0000","last_change":"2020-11-12T17:27:28.810294+0000","last_active":"2020-11-12T17:27:34.850188+0000","last_peered":"2020-11-12T17:27:34.850188+0000","last_clean":"2020-11-12T17:27:34.850188+0000","last_became_active":"2020-11-12T17:27:28.809879+0000","last_became_peered":"2020-11-12T17:27:28.809879+0000","last_unstale":"2020-11-12T17:27:34.850188+0000","last_undegraded":"2020-11-12T17:27:34.850188+0000","last_fullsized":"2020-11-12T17:27:34.850188+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:26:23.752291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:26:23.752291+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"158'3032","reported_seq":"3266","reported_epoch":"158","state":"active+clean","last_fresh":"2020-11-12T17:27:41.563109+0000","last_change":"2020-11-12T17:27:01.968627+0000","last_active":"2020-11-12T17:27:41.563109+0000","last_peered":"2020-11-12T17:27:41.563109+0000","last_clean":"2020-11-12T17:27:41.563109+0000","last_became_active":"2020-11-12T17:27:00.629289+0000","last_became_peered":"2020-11-12T17:27:00.629289+0000","last_unstale":"2020-11-12T17:27:41.563109+0000","last_undegraded":"2020-11-12T17:27:41.563109+0000","last_fullsized":"2020-11-12T17:27:41.563109+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3032,"ondisk_log_size":3032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3032,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"185","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:38.244336+0000","last_change":"2020-11-12T17:27:28.932910+0000","last_active":"2020-11-12T17:27:38.244336+0000","last_peered":"2020-11-12T17:27:38.244336+0000","last_clean":"2020-11-12T17:27:38.244336+0000","last_became_active":"2020-11-12T17:27:28.932340+0000","last_became_peered":"2020-11-12T17:27:28.932340+0000","last_unstale":"2020-11-12T17:27:38.244336+0000","last_undegraded":"2020-11-12T17:27:38.244336+0000","last_fullsized":"2020-11-12T17:27:38.244336+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:51.816592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:51.816592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"157'3304","reported_seq":"3341","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:40.631057+0000","last_change":"2020-11-12T17:26:45.488276+0000","last_active":"2020-11-12T17:27:40.631057+0000","last_peered":"2020-11-12T17:27:40.631057+0000","last_clean":"2020-11-12T17:27:40.631057+0000","last_became_active":"2020-11-12T17:26:45.487913+0000","last_became_peered":"2020-11-12T17:26:45.487913+0000","last_unstale":"2020-11-12T17:27:40.631057+0000","last_undegraded":"2020-11-12T17:27:40.631057+0000","last_fullsized":"2020-11-12T17:27:40.631057+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3304,"ondisk_log_size":3304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3304,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"120","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:37.888681+0000","last_change":"2020-11-12T17:27:28.812744+0000","last_active":"2020-11-12T17:27:37.888681+0000","last_peered":"2020-11-12T17:27:37.888681+0000","last_clean":"2020-11-12T17:27:37.888681+0000","last_became_active":"2020-11-12T17:27:28.812355+0000","last_became_peered":"2020-11-12T17:27:28.812355+0000","last_unstale":"2020-11-12T17:27:37.888681+0000","last_undegraded":"2020-11-12T17:27:37.888681+0000","last_fullsized":"2020-11-12T17:27:37.888681+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:04.764948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:27:04.764948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"157'3120","reported_seq":"3156","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:40.908362+0000","last_change":"2020-11-12T17:26:45.490394+0000","last_active":"2020-11-12T17:27:40.908362+0000","last_peered":"2020-11-12T17:27:40.908362+0000","last_clean":"2020-11-12T17:27:40.908362+0000","last_became_active":"2020-11-12T17:26:45.489929+0000","last_became_peered":"2020-11-12T17:26:45.489929+0000","last_unstale":"2020-11-12T17:27:40.908362+0000","last_undegraded":"2020-11-12T17:27:40.908362+0000","last_fullsized":"2020-11-12T17:27:40.908362+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3120,"ondisk_log_size":3120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25559040,"num_objects":390,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":390,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3120,"num_write_kb":24960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"31","reported_epoch":"157","state":"active+clean","last_fresh":"2020-11-12T17:27:38.243931+0000","last_change":"2020-11-12T17:27:00.607817+0000","last_active":"2020-11-12T17:27:38.243931+0000","last_peered":"2020-11-12T17:27:38.243931+0000","last_clean":"2020-11-12T17:27:38.243931+0000","last_became_active":"2020-11-12T17:27:00.607358+0000","last_became_peered":"2020-11-12T17:27:00.607358+0000","last_unstale":"2020-11-12T17:27:38.243931+0000","last_undegraded":"2020-11-12T17:27:38.243931+0000","last_fullsized":"2020-11-12T17:27:38.243931+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:52.317257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:52.317257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"158'3064","reported_seq":"3328","reported_epoch":"158","state":"active+clean","last_fresh":"2020-11-12T17:27:41.524274+0000","last_change":"2020-11-12T17:27:01.959937+0000","last_active":"2020-11-12T17:27:41.524274+0000","last_peered":"2020-11-12T17:27:41.524274+0000","last_clean":"2020-11-12T17:27:41.524274+0000","last_became_active":"2020-11-12T17:27:00.648415+0000","last_became_peered":"2020-11-12T17:27:00.648415+0000","last_unstale":"2020-11-12T17:27:41.524274+0000","last_undegraded":"2020-11-12T17:27:41.524274+0000","last_fullsized":"2020-11-12T17:27:41.524274+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3064,"ondisk_log_size":3064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25100288,"num_objects":383,"num_object_clones":0,"num_object_copies":766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":383,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3064,"num_write_kb":24512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":7077888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"147","reported_epoch":"156","state":"active+clean","last_fresh":"2020-11-12T17:27:34.850307+0000","last_change":"2020-11-12T17:26:53.490926+0000","last_active":"2020-11-12T17:27:34.850307+0000","last_peered":"2020-11-12T17:27:34.850307+0000","last_clean":"2020-11-12T17:27:34.850307+0000","last_became_active":"2020-11-12T17:23:15.758665+0000","last_became_peered":"2020-11-12T17:23:15.758665+0000","last_unstale":"2020-11-12T17:27:34.850307+0000","last_undegraded":"2020-11-12T17:27:34.850307+0000","last_fullsized":"2020-11-12T17:27:34.850307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:53.490814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:26:53.490814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":418578432,"num_objects":6387,"num_object_clones":0,"num_object_copies":12774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6387,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51096,"num_write_kb":408768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":529,"num_bytes_recovered":34627584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":399609856,"data_stored":829513728,"data_compressed":5365375,"data_compressed_allocated":399609856,"data_compressed_original":829513728,"omap_allocated":0,"internal_metadata":0},"log_size":51096,"ondisk_log_size":51096,"up":32,"acting":32,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542205,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1085456,"kb_used_data":36872,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93286384,"statfs":{"total":96636764160,"available":95525257216,"internally_reserved":1073741824,"allocated":37756928,"data_stored":73765248,"data_compressed":490296,"data_compressed_allocated":36667392,"data_compressed_original":73334784,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":41.594000000000001,"5min":9.4710000000000001,"15min":4.2030000000000003},"min":{"1min":0.72499999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":727.43499999999995,"5min":727.43499999999995,"15min":727.43499999999995},"last":1.054},{"interface":"front","average":{"1min":6.6319999999999997,"5min":2.7429999999999999,"15min":2.3450000000000002},"min":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":101.371,"5min":101.371,"15min":101.371},"last":0.89900000000000002}]},{"osd":1,"last update":"Thu Nov 12 17:27:36 2020","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":6.1219999999999999,"15min":6.8579999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":3.5449999999999999,"5min":102.354,"15min":102.354},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.718,"5min":5.8339999999999996,"15min":6.5199999999999996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":5.399,"5min":102.08199999999999,"15min":102.08199999999999},"last":2.0659999999999998}]},{"osd":2,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":6.431,"5min":6.431,"15min":6.431},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":102.038,"5min":102.038,"15min":102.038},"last":1.3859999999999999},{"interface":"front","average":{"1min":6.7130000000000001,"5min":6.7130000000000001,"15min":6.7130000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":102.92,"5min":102.92,"15min":102.92},"last":2.629}]},{"osd":3,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":6.9459999999999997,"5min":2.8100000000000001,"15min":2.411},"min":{"1min":0.86499999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":102.443,"5min":102.443,"15min":102.443},"last":2.0150000000000001},{"interface":"front","average":{"1min":6.7709999999999999,"5min":9.452,"15min":4.8230000000000004},"min":{"1min":0.91900000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":102.29600000000001,"5min":871.76700000000005,"15min":871.76700000000005},"last":2.1120000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":47.259,"5min":33.906999999999996,"15min":47.140999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":849.06500000000005,"5min":849.06500000000005,"15min":849.06500000000005},"last":0.83999999999999997},{"interface":"front","average":{"1min":6.5780000000000003,"5min":4.0199999999999996,"15min":2.6760000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":103.053,"5min":108.14,"15min":108.14},"last":1.1240000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":21.847999999999999,"5min":6.1970000000000001,"15min":3.8929999999999998},"min":{"1min":0.84899999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":311.077,"5min":311.077,"15min":311.077},"last":1.341},{"interface":"front","average":{"1min":7.2149999999999999,"5min":3.3599999999999999,"15min":3.032},"min":{"1min":1.018,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":104.02,"5min":104.02,"15min":104.02},"last":1.421}]},{"osd":6,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":6.8049999999999997,"5min":7.7839999999999998,"15min":4.468},"min":{"1min":0.96499999999999997,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":103.56699999999999,"5min":375.04199999999997,"15min":375.04199999999997},"last":10.422000000000001},{"interface":"front","average":{"1min":6.9450000000000003,"5min":29.754000000000001,"15min":45.545000000000002},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":102.8,"5min":975.20899999999995,"15min":975.20899999999995},"last":10.356}]}]},{"osd":5,"up_from":14,"seq":60129542206,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1138320,"kb_used_data":89736,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93233520,"statfs":{"total":96636764160,"available":95471124480,"internally_reserved":1073741824,"allocated":91889664,"data_stored":182089904,"data_compressed":1214898,"data_compressed_allocated":90832896,"data_compressed_original":181665792,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.526,"15min":1.7250000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":5.0309999999999997,"5min":5.0309999999999997,"15min":5.0309999999999997},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.736,"15min":2},"min":{"1min":0.59199999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.5810000000000004,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":1.764}]},{"osd":1,"last update":"Thu Nov 12 17:27:34 2020","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.5980000000000001,"15min":1.5920000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":4.327,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.778,"15min":1.802},"min":{"1min":1.0669999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.024,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.7130000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":1.8080000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":2.7210000000000001,"15min":2.7349999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":3.8530000000000002,"5min":49.442999999999998,"15min":49.442999999999998},"last":4.4790000000000001},{"interface":"front","average":{"1min":1.786,"5min":2.089,"15min":2.3530000000000002},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":4.7359999999999998,"5min":8.202,"15min":8.202},"last":1.633}]},{"osd":4,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":6.2610000000000001,"15min":3.5710000000000002},"min":{"1min":0.73099999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":5.0789999999999997,"5min":459.15499999999997,"15min":459.15499999999997},"last":1.5980000000000001},{"interface":"front","average":{"1min":15.962,"5min":5.0789999999999997,"15min":3.7269999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":324.95600000000002,"5min":324.95600000000002,"15min":324.95600000000002},"last":1.8440000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9359999999999999,"5min":2.0569999999999999,"15min":2.2469999999999999},"min":{"1min":0.76600000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.4660000000000002,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":4.984},{"interface":"front","average":{"1min":1.802,"5min":2.0150000000000001,"15min":2.254},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":5.1210000000000004,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.8959999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8819999999999999,"5min":2.7570000000000001,"15min":2.9870000000000001},"min":{"1min":0.97099999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":4.9939999999999998,"5min":40.268000000000001,"15min":40.268000000000001},"last":2.3399999999999999},{"interface":"front","average":{"1min":32.020000000000003,"5min":8.3439999999999994,"15min":4.718},"min":{"1min":0.72599999999999998,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":693.23000000000002,"5min":693.23000000000002,"15min":693.23000000000002},"last":2.2999999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542205,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1123820,"kb_used_data":75236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93248020,"statfs":{"total":96636764160,"available":95485972480,"internally_reserved":1073741824,"allocated":77041664,"data_stored":152402188,"data_compressed":1016034,"data_compressed_allocated":75988992,"data_compressed_original":151977984,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,6],"upper_bound":1024},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":38.109999999999999,"5min":12.779,"15min":5.3150000000000004},"min":{"1min":0.57499999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":765.13099999999997,"5min":765.13099999999997,"15min":765.13099999999997},"last":3.427},{"interface":"front","average":{"1min":1.3500000000000001,"5min":23.634,"15min":39.231999999999999},"min":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":3.3799999999999999,"5min":948.30899999999997,"15min":948.30899999999997},"last":1.5669999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":2.3849999999999998,"5min":15.705,"15min":17.925000000000001},"min":{"1min":0.79900000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":7.4329999999999998,"5min":356.46699999999998,"15min":356.46699999999998},"last":6.3840000000000003},{"interface":"front","average":{"1min":1.911,"5min":15.529,"15min":17.798999999999999},"min":{"1min":0.92800000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.8799999999999999,"5min":356.18599999999998,"15min":356.18599999999998},"last":2.9510000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:27:00 2020","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":6.9630000000000001,"5min":6.9630000000000001,"15min":6.9630000000000001},"last":5.2800000000000002},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":4.056,"5min":4.056,"15min":4.056},"last":1.897}]},{"osd":3,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":5.8079999999999998,"15min":3.2949999999999999},"min":{"1min":0.83999999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":7.5629999999999997,"5min":356.02300000000002,"15min":356.02300000000002},"last":6.4450000000000003},{"interface":"front","average":{"1min":18.704000000000001,"5min":9.2430000000000003,"15min":4.5250000000000004},"min":{"1min":0.83599999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":357.476,"5min":357.79000000000002,"15min":357.79000000000002},"last":2.8050000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":2.5760000000000001,"5min":12.289,"15min":5.4649999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":6.9089999999999998,"5min":575.16800000000001,"15min":575.16800000000001},"last":5.1890000000000001},{"interface":"front","average":{"1min":1.7430000000000001,"5min":15.927,"15min":6.8159999999999998},"min":{"1min":0.81499999999999995,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":4.2539999999999996,"5min":908.52700000000004,"15min":908.52700000000004},"last":5.569}]},{"osd":6,"last update":"Thu Nov 12 17:26:54 2020","interfaces":[{"interface":"back","average":{"1min":1.833,"5min":18.399999999999999,"15min":28.564},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":7.3940000000000001,"5min":665.13999999999999,"15min":665.13999999999999},"last":9.9770000000000003},{"interface":"front","average":{"1min":22.359999999999999,"5min":10.012,"15min":4.8319999999999999},"min":{"1min":0.77000000000000002,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":426.197,"5min":426.197,"15min":426.197},"last":4.226}]},{"osd":7,"last update":"Thu Nov 12 17:26:49 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":14.317,"15min":6.367},"min":{"1min":0.90100000000000002,"5min":0.87,"15min":0.87},"max":{"1min":3.5310000000000001,"5min":584.00300000000004,"15min":584.00300000000004},"last":2.8820000000000001},{"interface":"front","average":{"1min":47.753,"5min":15.167,"15min":6.5149999999999997},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":915.22900000000004,"5min":915.22900000000004,"15min":915.22900000000004},"last":9.9329999999999998}]}]},{"osd":1,"up_from":88,"seq":377957122075,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1096016,"kb_used_data":47432,"kb_used_omap":114,"kb_used_meta":1048461,"kb_avail":93275824,"statfs":{"total":96636764160,"available":95514443776,"internally_reserved":1073741824,"allocated":48570368,"data_stored":125734102,"data_compressed":656310,"data_compressed_allocated":47505408,"data_compressed_original":125304832,"omap_allocated":117414,"internal_metadata":1073624410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":32.381,"5min":7.7869999999999999,"15min":3.6880000000000002},"min":{"1min":0.86499999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":503.14299999999997,"5min":503.14299999999997,"15min":503.14299999999997},"last":2.1829999999999998},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.7030000000000001,"15min":1.752},"min":{"1min":0.81200000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.3650000000000002,"5min":4.202,"15min":4.202},"last":1.2030000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:27:00 2020","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":1.8580000000000001},{"interface":"front","average":{"1min":1.72,"5min":1.72,"15min":1.72},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.0700000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:27:39 2020","interfaces":[{"interface":"back","average":{"1min":91.236000000000004,"5min":19.588000000000001,"15min":7.6459999999999999},"min":{"1min":0.96299999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":958.71600000000001,"5min":958.71600000000001,"15min":958.71600000000001},"last":958.71600000000001},{"interface":"front","average":{"1min":1.95,"5min":2.1389999999999998,"15min":2.1709999999999998},"min":{"1min":1.107,"5min":0.872,"15min":0.872},"max":{"1min":3.7309999999999999,"5min":6.056,"15min":6.056},"last":3.2250000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.8919999999999999,"15min":1.9219999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":0.66100000000000003},{"interface":"front","average":{"1min":2.0800000000000001,"5min":2.077,"15min":2.077},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":3.2879999999999998,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0800000000000001,"5min":2.0350000000000001,"15min":2.0270000000000001},"min":{"1min":1.1479999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.7559999999999998,"5min":6.1159999999999997,"15min":6.1159999999999997},"last":3.2480000000000002},{"interface":"front","average":{"1min":2.077,"5min":2.3570000000000002,"15min":2.403},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":3.1669999999999998,"5min":6.7859999999999996,"15min":6.7859999999999996},"last":1.123}]},{"osd":6,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":2.2909999999999999,"15min":2.3250000000000002},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.4529999999999998,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":0.97999999999999998},{"interface":"front","average":{"1min":2.2839999999999998,"5min":2.3119999999999998,"15min":2.3159999999999998},"min":{"1min":1.5349999999999999,"5min":1.161,"15min":1.161},"max":{"1min":3.774,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":3.282}]},{"osd":7,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":2.294,"5min":2.4660000000000002,"15min":2.4940000000000002},"min":{"1min":1.502,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":3.79,"5min":6.577,"15min":6.577},"last":3.3130000000000002},{"interface":"front","average":{"1min":2.0990000000000002,"5min":2.4159999999999999,"15min":2.4689999999999999},"min":{"1min":1.056,"5min":1.056,"15min":1.056},"max":{"1min":3.3130000000000002,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":1.169}]}]},{"osd":6,"up_from":14,"seq":60129542205,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1086936,"kb_used_data":38352,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93284904,"statfs":{"total":96636764160,"available":95523741696,"internally_reserved":1073741824,"allocated":39272448,"data_stored":76839359,"data_compressed":511016,"data_compressed_allocated":38207488,"data_compressed_original":76414976,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.6060000000000001,"15min":1.714},"min":{"1min":0.77600000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.526,"5min":1.6930000000000001,"15min":1.9379999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.5310000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.276}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":4.6139999999999999,"5min":35.189,"15min":40.284999999999997},"min":{"1min":1.0069999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":49.276000000000003,"5min":665.476,"15min":665.476},"last":1.583},{"interface":"front","average":{"1min":1.929,"5min":1.3779999999999999,"15min":1.286},"min":{"1min":0.82899999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":4.5549999999999997,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":1.421}]},{"osd":2,"last update":"Thu Nov 12 17:26:58 2020","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.4419999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":3.4390000000000001,"5min":2.2050000000000001,"15min":2.141},"min":{"1min":1.0049999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":27.997,"5min":27.997,"15min":27.997},"last":1.25},{"interface":"front","average":{"1min":3.3799999999999999,"5min":2.3159999999999998,"15min":2.4119999999999999},"min":{"1min":0.90200000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":26.927,"5min":26.927,"15min":26.927},"last":1.607}]},{"osd":4,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":28.529,"5min":7.2400000000000002,"15min":3.8999999999999999},"min":{"1min":0.70299999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":489.149,"5min":489.149,"15min":489.149},"last":1.3640000000000001},{"interface":"front","average":{"1min":28.414000000000001,"5min":9.2590000000000003,"15min":4.867},"min":{"1min":0.69299999999999995,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":480.79599999999999,"5min":480.79599999999999,"15min":480.79599999999999},"last":0.879}]},{"osd":5,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.6870000000000001,"5min":20.465,"15min":8.3409999999999993},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":3.6120000000000001,"5min":804.62199999999996,"15min":804.62199999999996},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.7110000000000001,"5min":15.547000000000001,"15min":20.343},"min":{"1min":0.88800000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.242,"5min":494.78399999999999,"15min":494.78399999999999},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:26:50 2020","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":17.628,"15min":7.7300000000000004},"min":{"1min":0.71999999999999997,"5min":0.626,"15min":0.626},"max":{"1min":6.4790000000000001,"5min":1002.347,"15min":1002.347},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.2690000000000001,"15min":2.4390000000000001},"min":{"1min":0.99399999999999999,"5min":0.878,"15min":0.878},"max":{"1min":3.8690000000000002,"5min":10.271000000000001,"15min":10.271000000000001},"last":1.4630000000000001}]}]},{"osd":0,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":102,"seq":438086664215,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1128408,"kb_used_data":79824,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93243432,"statfs":{"total":96636764160,"available":95481274368,"internally_reserved":1073741824,"allocated":81739776,"data_stored":161790070,"data_compressed":1079151,"data_compressed_allocated":80678912,"data_compressed_original":161357824,"omap_allocated":4385,"internal_metadata":1073737439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":34.381999999999998,"5min":34.381999999999998,"15min":34.381999999999998},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":524.55600000000004,"5min":524.55600000000004,"15min":524.55600000000004},"last":1.982},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":1.538}]},{"osd":1,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":2.004,"15min":2.004},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":3.1659999999999999,"5min":3.1659999999999999,"15min":3.1659999999999999},"last":2.3620000000000001},{"interface":"front","average":{"1min":1.694,"5min":1.694,"15min":1.694},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.6279999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.873,"15min":1.873},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":2.1059999999999999},{"interface":"front","average":{"1min":58.247,"5min":58.247,"15min":58.247},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":902.96299999999997,"5min":902.96299999999997,"15min":902.96299999999997},"last":1.8380000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.802,"15min":1.802},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.929,"5min":1.929,"15min":1.929},"min":{"1min":1.107,"5min":1.107,"15min":1.107},"max":{"1min":3.4279999999999999,"5min":3.4279999999999999,"15min":3.4279999999999999},"last":2.298}]},{"osd":5,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":10.308,"5min":10.308,"15min":10.308},"last":1.7569999999999999},{"interface":"front","average":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"min":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":3.774,"5min":3.774,"15min":3.774},"last":2.6480000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":2.145,"15min":2.145},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":3.7090000000000001,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":2.2200000000000002},{"interface":"front","average":{"1min":12.640000000000001,"5min":12.640000000000001,"15min":12.640000000000001},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":168.64599999999999,"5min":168.64599999999999,"15min":168.64599999999999},"last":1.9059999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:26:56 2020","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":2.528,"15min":2.528},"min":{"1min":1.502,"5min":1.502,"15min":1.502},"max":{"1min":6.1790000000000003,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":1.0389999999999999},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"min":{"1min":1.153,"5min":1.153,"15min":1.153},"max":{"1min":6.2249999999999996,"5min":6.2249999999999996,"15min":6.2249999999999996},"last":2.5489999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542205,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1074408,"kb_used_data":25824,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93297432,"statfs":{"total":96636764160,"available":95536570368,"internally_reserved":1073741824,"allocated":26443776,"data_stored":51147256,"data_compressed":338985,"data_compressed_allocated":25358336,"data_compressed_original":50716672,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":3.6829999999999998,"15min":2.4260000000000002},"min":{"1min":0.748,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.2559999999999998,"5min":178.36699999999999,"15min":178.36699999999999},"last":3.3980000000000001},{"interface":"front","average":{"1min":1.825,"5min":1.8879999999999999,"15min":1.9339999999999999},"min":{"1min":0.64900000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":6.7610000000000001,"5min":16.902000000000001,"15min":16.902000000000001},"last":3.222}]},{"osd":1,"last update":"Thu Nov 12 17:27:36 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":30.931000000000001,"15min":35.847000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.7040000000000002,"5min":501.91199999999998,"15min":501.91199999999998},"last":2.625},{"interface":"front","average":{"1min":29.451000000000001,"5min":27.236999999999998,"15min":26.867999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":501.91399999999999,"5min":501.91399999999999,"15min":501.91399999999999},"last":4.6790000000000003}]},{"osd":2,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":51.488999999999997,"5min":51.488999999999997,"15min":51.488999999999997},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":942.58500000000004,"5min":942.58500000000004,"15min":942.58500000000004},"last":1.2250000000000001},{"interface":"front","average":{"1min":26.448,"5min":26.448,"15min":26.448},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":461.721,"5min":461.721,"15min":461.721},"last":1.9019999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":2.1150000000000002,"5min":2.161,"15min":2.4140000000000001},"min":{"1min":0.79600000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.0499999999999998,"5min":10.318,"15min":10.318},"last":2.556},{"interface":"front","average":{"1min":1.972,"5min":2.0350000000000001,"15min":2.343},"min":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.589,"5min":5.1029999999999998,"15min":5.1029999999999998},"last":4.585}]},{"osd":5,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":2.3170000000000002,"5min":14.132999999999999,"15min":26.184000000000001},"min":{"1min":1.016,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":6.8719999999999999,"5min":622.07799999999997,"15min":622.07799999999997},"last":4.7629999999999999},{"interface":"front","average":{"1min":2.1349999999999998,"5min":2.3799999999999999,"15min":2.698},"min":{"1min":1.173,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":4.2839999999999998,"5min":10.436,"15min":10.436},"last":1.306}]},{"osd":6,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":26.582999999999998,"5min":7.2679999999999998,"15min":4.1719999999999997},"min":{"1min":0.92200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":466.58199999999999,"5min":466.58199999999999,"15min":466.58199999999999},"last":4.9059999999999997},{"interface":"front","average":{"1min":2.7269999999999999,"5min":2.395,"15min":2.6309999999999998},"min":{"1min":1.722,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":6.9160000000000004,"5min":11.497999999999999,"15min":11.497999999999999},"last":1.827}]},{"osd":7,"last update":"Thu Nov 12 17:26:59 2020","interfaces":[{"interface":"back","average":{"1min":17.262,"5min":5.415,"15min":3.758},"min":{"1min":1.204,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":287.43099999999998,"5min":287.43099999999998,"15min":287.43099999999998},"last":3.0569999999999999},{"interface":"front","average":{"1min":33.877000000000002,"5min":19.629999999999999,"15min":26.670000000000002},"min":{"1min":1.1080000000000001,"5min":1.016,"15min":1.016},"max":{"1min":606.49099999999999,"5min":606.49099999999999,"15min":606.49099999999999},"last":4.8440000000000003}]}]}]}} 2020-11-12T17:27:45.923 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:27:45.926 INFO:tasks.ceph.ceph_manager.ceph:increase pool size by 10 2020-11-12T17:27:45.926 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set rbd pg_num 18 2020-11-12T17:27:45.927 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:45.927 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:45.927 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:45.927 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:45.927 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:45.927 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:45.927 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:45.928 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:45.928 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:45.928 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:45.918+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:45.931 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:27:46.025 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:46.020+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:46.093 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:46.093 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:46.106 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:46.125 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:46.120+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:46.225 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:46.225 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:46.227 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:46.226+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:46.237 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:46.328 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:46.326+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:46.407 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:46.408 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:46.420 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:46.428 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:46.424+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:46.529 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:46.524+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:46.560 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:27:46.561221+0000 min lat: 0.00209322 max lat: 2.20267 avg lat: 0.0176799 2020-11-12T17:27:46.560 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:27:46.560 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 60 16 54287 54271 7.06581 6.80469 0.0179898 0.0176799 2020-11-12T17:27:46.596 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:46.596 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:46.613 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:46.630 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:46.628+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:46.731 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:46.730+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:46.738 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:46.738 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:46.751 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:46.832 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:46.828+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:46.918 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:46.960 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:46.962 INFO:teuthology.orchestra.run.smithi036.stderr:set pool 2 pg_num to 18 2020-11-12T17:27:46.962 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:27:46.963 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:46.964 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:46.958+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:46.974 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:46.968+0000 7f6583748700 -1 osd.0 160 handle_osd_map injecting map crc failure 2020-11-12T17:27:47.062 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:47.060+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:47.102 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:47.102 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:47.114 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:47.163 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:47.162+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:47.267 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:47.260+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:47.282 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:47.404 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:47.405 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:47.400+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:47.406 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:47.420 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:47.418+0000 7f7b4b297700 -1 osd.4 161 handle_osd_map injecting map crc failure 2020-11-12T17:27:47.506 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:47.504+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:47.562 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 61 16 55143 55127 7.0596 6.6875 0.0114269 0.0176908 2020-11-12T17:27:47.596 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:47.596 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:47.608 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:47.604+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:47.609 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:47.709 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:47.706+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:47.785 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:47.785 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:47.796 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:47.809 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:47.806+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:47.912 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:47.908+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:47.924 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:47.925 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:47.930 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:47.936 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:48.023 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:48.020+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:48.086 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:48.092 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:48.093 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:48.104 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:48.114 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:48.110+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:48.116 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:48.148 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:48.194 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:48.215 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:48.210+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:48.225 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:48.260 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:48.306 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:48.306 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:48.307 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:48.308 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:48.308 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:48.308 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:48.315 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:48.314+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:48.322 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:48.324 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:48.324 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:48.324 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:48.325 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:48.325 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:48.325 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:48.325 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:48.325 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:48.417 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:48.412+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:48.449 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:48.449 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:48.450 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:48.450 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:48.450 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:48.461 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:48.547 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:48.544+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:48.560 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 62 16 55935 55919 7.04552 6.1875 0.0149888 0.0177297 2020-11-12T17:27:48.617 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:48.617 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:48.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:48.618 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:48.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.618 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:48.618 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:48.618 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 283.50725107599999, 2020-11-12T17:27:48.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:48.619 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.619 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.619 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.619 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:48.619 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:48.619 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:48.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.620 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:48.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:48.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:48.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:48.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:48.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:48.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:48.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:48.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:48.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:48.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:48.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:48.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:48.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:48.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:48.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:48.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:48.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:48.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:48.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:48.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:48.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:48.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:48.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:48.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:48.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:48.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.631 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.632 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:48.632 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:48.632 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 283.50015927999999, 2020-11-12T17:27:48.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:48.633 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.633 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:48.633 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:48.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:48.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:48.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:48.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:48.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:48.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:48.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:48.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:48.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:48.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:48.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:48.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:48.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:48.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:48.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:48.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:48.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.641 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.642 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:48.642 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:48.642 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 274.06759978299999, 2020-11-12T17:27:48.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:48.642 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.642 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:48.643 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:48.643 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:48.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.643 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:48.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:48.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:48.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:48.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:48.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:48.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:48.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:48.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:48.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:48.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:48.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:48.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:48.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:48.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:48.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:48.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:48.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:48.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:48.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:48.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:48.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:48.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:48.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:48.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:48.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:48.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.654 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.654 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:48.655 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:48.655 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 240.11747968899999, 2020-11-12T17:27:48.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:48.655 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.655 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:48.655 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:48.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:48.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:48.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:48.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:48.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:48.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:48.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:48.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:48.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:48.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:48.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:48.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:48.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:48.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:48.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:48.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:48.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.663 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.663 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:48.664 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:48.664 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 238.01187779700001, 2020-11-12T17:27:48.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:48.664 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.664 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.664 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:48.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:48.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:48.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:48.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:48.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:48.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:48.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:48.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:48.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:48.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:48.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:48.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:48.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:48.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:48.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:48.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:48.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:48.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:48.675 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.675 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.677 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:48.677 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:48.677 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 206.66539446300001, 2020-11-12T17:27:48.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:48.678 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.678 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.679 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.679 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:48.680 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:48.680 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:48.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.680 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:48.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:48.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:48.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:48.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:48.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:48.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:48.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:48.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:48.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:48.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:48.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:48.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:48.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:48.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:48.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:48.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:48.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:48.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:48.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:48.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:48.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:48.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:48.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:48.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:48.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:48.693 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.693 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.693 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.693 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:48.694 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:48.694 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 197.66955266100001, 2020-11-12T17:27:48.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:48.694 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.694 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:48.694 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:48.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:48.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:48.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:48.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:48.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:48.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:48.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:48.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:48.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:48.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:48.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:48.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:48.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:48.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:48.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:48.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:48.701 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.701 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.701 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.702 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:48.702 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:48.702 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 193.734449262, 2020-11-12T17:27:48.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:48.702 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.703 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:48.703 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:48.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.722 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:48.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:48.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:48.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:48.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:48.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:48.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:48.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:48.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:48.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:48.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:48.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:48.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:48.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:48.735 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.735 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.735 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.735 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:48.736 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:48.736 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 162.969808771, 2020-11-12T17:27:48.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:48.736 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.736 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:48.736 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:48.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:48.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:48.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:48.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:48.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:48.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:48.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:48.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:48.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:48.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:48.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:48.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:48.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:48.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:48.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:48.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:48.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.744 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.745 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:48.745 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:48.745 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 156.71330008699999, 2020-11-12T17:27:48.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:48.745 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.745 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.745 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.746 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:48.746 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:48.746 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:48.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.746 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:48.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:48.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:48.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:48.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:48.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:48.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:48.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:48.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:48.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:48.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:48.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:48.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:48.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:48.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:48.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:48.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:48.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:48.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:48.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:48.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:48.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:48.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:48.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:48.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:48.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:48.757 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.757 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.757 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.758 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:48.758 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:48.758 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 156.713137717, 2020-11-12T17:27:48.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:48.758 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.759 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.759 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.759 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:48.759 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:48.759 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:48.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.760 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:48.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:48.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:48.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:48.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:48.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:48.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:48.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:48.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:48.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:48.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:48.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:48.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:48.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:48.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:48.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:48.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:48.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:48.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:48.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:48.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:48.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:48.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:48.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:48.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:48.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:48.771 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.771 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.771 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.772 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:48.772 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:48.772 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 156.70456873000001, 2020-11-12T17:27:48.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:48.773 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.773 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:48.773 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:48.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:48.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:48.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:48.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:48.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:48.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:48.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:48.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:48.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:48.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:48.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:48.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:48.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:48.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:48.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:48.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:48.780 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.780 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.780 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.781 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:48.781 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:48.781 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.20005628000001, 2020-11-12T17:27:48.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:48.781 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.781 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.782 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.782 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:48.782 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:48.782 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:48.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.782 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:48.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:48.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:48.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:48.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:48.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:48.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:48.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:48.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:48.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:48.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:48.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:48.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:48.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:48.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:48.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:48.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:48.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:48.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:48.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:48.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:48.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:48.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:48.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:48.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:48.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:48.793 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.793 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.793 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.793 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:48.794 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:48.794 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 130.714507994, 2020-11-12T17:27:48.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:48.794 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.794 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.794 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.795 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:48.795 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:48.795 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:48.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.795 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:48.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:48.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:48.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:48.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:48.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:48.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:48.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:48.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:48.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:48.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:48.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:48.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:48.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:48.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:48.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:48.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:48.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:48.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:48.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:48.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:48.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:48.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:48.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:48.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:48.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:48.806 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.806 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.806 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.807 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:48.807 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:48.807 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 127.64118956199999, 2020-11-12T17:27:48.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:48.807 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.807 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:48.807 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:48.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:48.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:48.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:48.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:48.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:48.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:48.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:48.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:48.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:48.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:48.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:48.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:48.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:48.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:48.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:48.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:48.814 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.814 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.815 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.815 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:48.815 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:48.815 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.585544586, 2020-11-12T17:27:48.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:48.816 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.816 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.816 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.816 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:48.816 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:48.816 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:48.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.817 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:48.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:48.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:48.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:48.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:48.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:48.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:48.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:48.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:48.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:48.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:48.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:48.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:48.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:48.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:48.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:48.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:48.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:48.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:48.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:48.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:48.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:48.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:48.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:48.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:48.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:48.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.826 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.827 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:48.827 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:48.827 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.197340215, 2020-11-12T17:27:48.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:48.827 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.828 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:48.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:48.828 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:48.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.829 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:48.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:48.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:48.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:48.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:48.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:48.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:48.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:48.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:48.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:48.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:48.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:48.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:48.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:48.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:48.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:48.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:48.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:48.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:48.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:48.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:48.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:48.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:48.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:48.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:48.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:48.838 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.838 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.839 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.839 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:48.839 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:48.840 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.990883283, 2020-11-12T17:27:48.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:48.840 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.840 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.841 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.841 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:48.841 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:48.841 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:48.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.842 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:48.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:48.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:48.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:48.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:48.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:48.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:48.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:48.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:48.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:48.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:48.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:48.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:48.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:48.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:48.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:48.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:48.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:48.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:48.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:48.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:48.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:48.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:48.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:48.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:48.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:48.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.853 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.854 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:48.854 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:48.854 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.741677666, 2020-11-12T17:27:48.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:48.854 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.855 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:48.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:48.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:48.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:48.855 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:48.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.855 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:48.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:48.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:48.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:48.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:48.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:48.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:48.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:48.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:48.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:48.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:48.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:48.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:48.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:48.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:48.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:48.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:48.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:48.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:48.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:48.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:48.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:48.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:48.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:48.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:48.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:48.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:48.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:48.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:48.908 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.908 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.908 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.909 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:48.909 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:48.913 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.724718217, 2020-11-12T17:27:48.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:48.914 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:48.914 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:48.914 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:48.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:48.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:48.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:48.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:48.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:48.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:48.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:48.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:48.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:48.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:48.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:48.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:48.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:48.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:48.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:48.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:48.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:48.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:48.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:48.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:48.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:48.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:48.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:48.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:48.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:48.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:48.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:48.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:48.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:48.923 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.924 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.924 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.924 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:48.924 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:48.924 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:48.926 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:48.920+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:48.926 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:48.964 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:27:49.027 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:49.026+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:49.106 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:56378 5.0 5:0cf2cca0:::benchmark_data_smithi036_24110_object7047:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e163)", 2020-11-12T17:27:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:49.096021+0000", 2020-11-12T17:27:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.010309937999999999, 2020-11-12T17:27:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010336824, 2020-11-12T17:27:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 56378 2020-11-12T17:27:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.112 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096021+0000", 2020-11-12T17:27:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096021+0000", 2020-11-12T17:27:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.095984+0000", 2020-11-12T17:27:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102458 2020-11-12T17:27:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096087+0000", 2020-11-12T17:27:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4087000000000001e-05 2020-11-12T17:27:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096101+0000", 2020-11-12T17:27:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0480000000000001e-06 2020-11-12T17:27:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096108+0000", 2020-11-12T17:27:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024047840000000001 2020-11-12T17:27:49.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.098513+0000", 2020-11-12T17:27:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013100500000000001 2020-11-12T17:27:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.098644+0000", 2020-11-12T17:27:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020849200000000001 2020-11-12T17:27:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.098852+0000", 2020-11-12T17:27:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.004656978 2020-11-12T17:27:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103509+0000", 2020-11-12T17:27:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0074880379999999998 2020-11-12T17:27:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:56379 5.0 5:0cf2cca0:::benchmark_data_smithi036_24110_object7047:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e163)", 2020-11-12T17:27:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:49.096447+0000", 2020-11-12T17:27:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0098840070000000002, 2020-11-12T17:27:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0099766539999999997, 2020-11-12T17:27:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 56379 2020-11-12T17:27:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096447+0000", 2020-11-12T17:27:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096447+0000", 2020-11-12T17:27:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096428+0000", 2020-11-12T17:27:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3981999999999999e-05 2020-11-12T17:27:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096482+0000", 2020-11-12T17:27:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.371e-06 2020-11-12T17:27:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096491+0000", 2020-11-12T17:27:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8770000000000001e-06 2020-11-12T17:27:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.096496+0000", 2020-11-12T17:27:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045837489999999998 2020-11-12T17:27:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.101079+0000", 2020-11-12T17:27:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2565999999999994e-05 2020-11-12T17:27:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.101172+0000", 2020-11-12T17:27:49.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000184305 2020-11-12T17:27:49.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:49.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.101356+0000", 2020-11-12T17:27:49.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049094159999999998 2020-11-12T17:27:49.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.159 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:56380 5.0 5:0cf2cca0:::benchmark_data_smithi036_24110_object7047:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e163)", 2020-11-12T17:27:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:49.103514+0000", 2020-11-12T17:27:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.002816959, 2020-11-12T17:27:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002963093, 2020-11-12T17:27:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 56380 2020-11-12T17:27:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103514+0000", 2020-11-12T17:27:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103514+0000", 2020-11-12T17:27:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103481+0000", 2020-11-12T17:27:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6069999999999993e-05 2020-11-12T17:27:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103577+0000", 2020-11-12T17:27:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2037e-05 2020-11-12T17:27:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103589+0000", 2020-11-12T17:27:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4069999999999998e-06 2020-11-12T17:27:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103596+0000", 2020-11-12T17:27:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2367999999999998e-05 2020-11-12T17:27:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103638+0000", 2020-11-12T17:27:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101121 2020-11-12T17:27:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103739+0000", 2020-11-12T17:27:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024953600000000002 2020-11-12T17:27:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103989+0000", 2020-11-12T17:27:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047464399999999998 2020-11-12T17:27:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:56381 5.0 5.5334f30 (undecoded) ondisk+write+known_if_redirected e163)", 2020-11-12T17:27:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:49.103942+0000", 2020-11-12T17:27:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0023887869999999999, 2020-11-12T17:27:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0025859049999999999, 2020-11-12T17:27:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 56381 2020-11-12T17:27:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103942+0000", 2020-11-12T17:27:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103942+0000", 2020-11-12T17:27:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:27:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103913+0000", 2020-11-12T17:27:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0890000000000006e-05 2020-11-12T17:27:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.103994+0000", 2020-11-12T17:27:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1272e-05 2020-11-12T17:27:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.104005+0000", 2020-11-12T17:27:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0530000000000003e-06 2020-11-12T17:27:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.104011+0000", 2020-11-12T17:27:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8726999999999994e-05 2020-11-12T17:27:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:56382 5.0 5.5334f30 (undecoded) ondisk+write+known_if_redirected e163)", 2020-11-12T17:27:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:49.106124+0000", 2020-11-12T17:27:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.00020698099999999999, 2020-11-12T17:27:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00044119299999999999, 2020-11-12T17:27:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 56382 2020-11-12T17:27:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106124+0000", 2020-11-12T17:27:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106124+0000", 2020-11-12T17:27:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:27:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106094+0000", 2020-11-12T17:27:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5978999999999998e-05 2020-11-12T17:27:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106180+0000", 2020-11-12T17:27:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2918000000000001e-05 2020-11-12T17:27:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106193+0000", 2020-11-12T17:27:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1520000000000003e-06 2020-11-12T17:27:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106200+0000", 2020-11-12T17:27:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6359000000000005e-05 2020-11-12T17:27:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:56383 5.0 5.5334f30 (undecoded) ondisk+write+known_if_redirected e163)", 2020-11-12T17:27:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:49.106251+0000", 2020-11-12T17:27:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.0395999999999994e-05, 2020-11-12T17:27:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00038108700000000001, 2020-11-12T17:27:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 56383 2020-11-12T17:27:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106251+0000", 2020-11-12T17:27:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106251+0000", 2020-11-12T17:27:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106220+0000", 2020-11-12T17:27:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6409999999999994e-05 2020-11-12T17:27:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106307+0000", 2020-11-12T17:27:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1263e-05 2020-11-12T17:27:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106318+0000", 2020-11-12T17:27:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8529999999999997e-06 2020-11-12T17:27:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106324+0000", 2020-11-12T17:27:49.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3203999999999999e-05 2020-11-12T17:27:49.215 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.215 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.216 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.217 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:56384 5.0 5.5334f30 (undecoded) ondisk+write+known_if_redirected e163)", 2020-11-12T17:27:49.217 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:49.106374+0000", 2020-11-12T17:27:49.217 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4294967295.9999576, 2020-11-12T17:27:49.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000295316, 2020-11-12T17:27:49.221 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.221 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:49.221 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.221 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.221 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.221 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 56384 2020-11-12T17:27:49.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.222 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106374+0000", 2020-11-12T17:27:49.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106374+0000", 2020-11-12T17:27:49.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:49.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106345+0000", 2020-11-12T17:27:49.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2093000000000002e-05 2020-11-12T17:27:49.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106417+0000", 2020-11-12T17:27:49.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9689999999999997e-06 2020-11-12T17:27:49.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106424+0000", 2020-11-12T17:27:49.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2549999999999999e-06 2020-11-12T17:27:49.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106428+0000", 2020-11-12T17:27:49.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4549999999999998e-05 2020-11-12T17:27:49.226 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.226 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.226 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.227 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:56378 5.0 e163/135)", 2020-11-12T17:27:49.227 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:49.106471+0000", 2020-11-12T17:27:49.227 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4294967295.9998593, 2020-11-12T17:27:49.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000232162, 2020-11-12T17:27:49.227 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.227 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:49.227 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106471+0000", 2020-11-12T17:27:49.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106471+0000", 2020-11-12T17:27:49.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:27:49.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106456+0000", 2020-11-12T17:27:49.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.5564e-05 2020-11-12T17:27:49.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106492+0000", 2020-11-12T17:27:49.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5779000000000007e-05 2020-11-12T17:27:49.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106577+0000", 2020-11-12T17:27:49.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.587e-06 2020-11-12T17:27:49.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106583+0000", 2020-11-12T17:27:49.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111458 2020-11-12T17:27:49.231 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.232 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.232 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.232 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:56379 5.0 e163/135)", 2020-11-12T17:27:49.232 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:49.106514+0000", 2020-11-12T17:27:49.232 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4294967295.9998169, 2020-11-12T17:27:49.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022053700000000001, 2020-11-12T17:27:49.233 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.233 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:49.233 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106514+0000", 2020-11-12T17:27:49.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106514+0000", 2020-11-12T17:27:49.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999886 2020-11-12T17:27:49.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106502+0000", 2020-11-12T17:27:49.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9306e-05 2020-11-12T17:27:49.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106532+0000", 2020-11-12T17:27:49.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3687000000000002e-05 2020-11-12T17:27:49.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106595+0000", 2020-11-12T17:27:49.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0470000000000004e-06 2020-11-12T17:27:49.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:49.106599+0000", 2020-11-12T17:27:49.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5556999999999994e-05 2020-11-12T17:27:49.237 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.237 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.237 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.237 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.237 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:49.238 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 9 2020-11-12T17:27:49.238 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:49.239 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:49.238+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:49.240 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:49.340 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:49.338+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:49.370 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:49.370 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:49.370 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:49.370 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:49.370 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:49.381 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:49.445 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:49.436+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:49.454 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:27:49.520 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:49.521 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:49.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:49.522 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:49.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.523 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:49.523 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:49.524 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 275.09854144600001, 2020-11-12T17:27:49.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:49.524 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.525 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:49.526 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:49.526 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:49.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.527 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:49.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:49.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:49.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:49.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:49.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:49.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:49.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:49.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:49.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:49.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:49.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:49.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:49.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:49.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:49.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:49.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:49.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:49.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:49.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:49.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:49.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:49.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:49.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:49.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:49.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:49.541 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.542 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:49.543 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:49.543 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 275.09159738400001, 2020-11-12T17:27:49.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:49.544 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.544 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:49.544 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:49.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:49.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:49.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:49.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:49.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:49.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:49.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:49.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:49.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:49.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:49.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:49.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:49.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:49.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:49.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:49.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:49.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.557 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.562 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:49.563 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:49.563 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 238.917759598, 2020-11-12T17:27:49.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:49.563 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.563 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.563 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.563 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:49.564 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:49.564 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:49.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.564 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:49.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:49.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:49.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:49.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:49.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:49.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:49.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:49.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:49.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:49.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:49.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:49.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:49.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:49.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:49.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:49.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:49.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:49.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:49.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:49.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:49.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:27:49.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:27:49.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:27:49.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:27:49.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:27:49.574 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.575 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.575 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:27:49.575 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:49.576 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 222.654054505, 2020-11-12T17:27:49.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:27:49.576 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.576 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.576 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:49.577 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:49.577 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:27:49.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.577 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:49.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:49.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:49.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:27:49.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:27:49.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:27:49.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:27:49.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:27:49.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:27:49.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:27:49.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:27:49.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:27:49.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:27:49.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:27:49.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:27:49.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:49.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:27:49.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:27:49.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.594 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:27:49.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:27:49.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:27:49.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:27:49.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:27:49.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:27:49.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:27:49.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:27:49.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 207.568674179, 2020-11-12T17:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 205.87453590499999, 2020-11-12T17:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 148.205297183, 2020-11-12T17:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:49.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:27:49.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:27:49.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:27:49.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:27:49.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:27:49.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:27:49.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:27:49.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 148.192120424, 2020-11-12T17:27:49.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:27:49.633 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.633 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:49.633 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:49.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:49.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:49.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:27:49.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:27:49.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:27:49.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:27:49.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:27:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:27:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:27:49.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:27:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:27:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:27:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:27:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:27:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:27:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:27:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.689 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:27:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.638038975, 2020-11-12T17:27:49.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:27:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:27:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.691 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:27:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:27:49.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:27:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:27:49.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:27:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:27:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:27:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:27:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:27:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:27:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:27:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:27:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:27:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:27:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:27:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:27:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:27:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:27:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:27:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:27:49.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:27:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:27:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:27:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.701 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:27:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.62905166900001, 2020-11-12T17:27:49.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:27:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:27:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:27:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:27:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:27:49.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:27:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:27:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:27:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:27:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:27:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:27:49.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:27:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:27:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:27:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:27:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.709 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:27:49.710 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:49.710 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.61112435499999, 2020-11-12T17:27:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:27:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.713 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:27:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:49.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:27:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:27:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:27:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:27:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:27:49.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:27:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:27:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:27:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:27:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:27:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:27:49.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:27:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:27:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:27:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:27:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:27:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:27:49.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:27:49.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:27:49.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:27:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:27:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:27:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.729 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.808685457, 2020-11-12T17:27:49.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:27:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:27:49.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:27:49.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:27:49.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:27:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:27:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:27:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:27:49.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:27:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:27:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:27:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:27:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:27:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:27:49.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:27:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:27:49.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:27:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:27:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:27:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:27:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:27:49.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:27:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:27:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:27:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.72956314000001, 2020-11-12T17:27:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:27:49.745 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.746 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.746 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:27:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.747 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:27:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:27:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:27:49.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:27:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:27:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:27:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:27:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:27:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:27:49.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:27:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:27:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:27:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:27:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:27:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:27:49.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:27:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:27:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:27:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:27:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:27:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:27:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:27:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.758 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:27:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 107.947212173, 2020-11-12T17:27:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:27:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.759 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:27:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:49.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:27:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:27:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:27:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:27:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:27:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:27:49.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:27:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:27:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:27:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:27:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:27:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:27:49.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:27:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:27:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:27:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:27:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:27:49.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:27:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:27:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:27:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:27:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:27:49.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:27:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:27:49.770 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 92.484169824000006, 2020-11-12T17:27:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:27:49.771 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:49.772 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:27:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:27:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:27:49.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:27:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:27:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:27:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:27:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:27:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:27:49.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:27:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:27:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:27:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:27:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:27:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:27:49.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:27:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:27:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:27:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:27:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:27:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:27:49.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:27:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:27:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:27:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.784 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 47.462410673000001, 2020-11-12T17:27:49.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:27:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:27:49.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:27:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:27:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:27:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:27:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:27:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:27:49.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:27:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:27:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:27:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:27:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:27:49.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:27:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:27:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:27:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:27:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:27:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:27:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:27:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:27:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:27:49.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:27:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:27:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35048 5.1 e148/127 5:8e34dcfa:::benchmark_data_smithi036_24110_object4380:head v 148'2280, mlcod=148'2275)", 2020-11-12T17:27:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.157471854000001, 2020-11-12T17:27:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002, 2020-11-12T17:27:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.797 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359524+0000", 2020-11-12T17:27:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.064e-05 2020-11-12T17:27:49.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359605+0000", 2020-11-12T17:27:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34493079599999998 2020-11-12T17:27:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704536+0000", 2020-11-12T17:27:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2110000000000001e-06 2020-11-12T17:27:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704543+0000", 2020-11-12T17:27:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1071999999999998e-05 2020-11-12T17:27:49.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704634+0000", 2020-11-12T17:27:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2281999999999998e-05 2020-11-12T17:27:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704696+0000", 2020-11-12T17:27:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034977459999999999 2020-11-12T17:27:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708194+0000", 2020-11-12T17:27:49.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1390000000000006e-05 2020-11-12T17:27:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708265+0000", 2020-11-12T17:27:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002 2020-11-12T17:27:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.804 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35144 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.949865956, 2020-11-12T17:27:49.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998, 2020-11-12T17:27:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35144 2020-11-12T17:27:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567086+0000", 2020-11-12T17:27:49.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017142700000000001 2020-11-12T17:27:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567257+0000", 2020-11-12T17:27:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1043000000000002e-05 2020-11-12T17:27:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567278+0000", 2020-11-12T17:27:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1214e-05 2020-11-12T17:27:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567289+0000", 2020-11-12T17:27:49.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142698779 2020-11-12T17:27:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.709988+0000", 2020-11-12T17:27:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4704999999999995e-05 2020-11-12T17:27:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.811 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710083+0000", 2020-11-12T17:27:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016350300000000001 2020-11-12T17:27:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710246+0000", 2020-11-12T17:27:49.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002268946 2020-11-12T17:27:49.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.712515+0000", 2020-11-12T17:27:49.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199261574 2020-11-12T17:27:49.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911777+0000", 2020-11-12T17:27:49.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0816999999999996e-05 2020-11-12T17:27:49.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911858+0000", 2020-11-12T17:27:49.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2182000000000003e-05 2020-11-12T17:27:49.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911910+0000", 2020-11-12T17:27:49.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998 2020-11-12T17:27:49.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.816 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.816 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.816 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:49.816 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:49.817 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.401051002999999, 2020-11-12T17:27:49.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:27:49.817 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.817 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.817 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.818 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:27:49.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.818 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:49.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:49.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:49.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:27:49.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:27:49.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:27:49.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:27:49.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:27:49.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:27:49.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:27:49.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:27:49.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.822 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.822 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:27:49.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:27:49.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.823 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:27:49.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:27:49.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.823 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:49.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:27:49.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:27:49.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:27:49.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:27:49.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:27:49.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:27:49.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:27:49.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:27:49.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:27:49.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:27:49.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.827 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.827 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.827 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36416 5.0 5:05125f34:::benchmark_data_smithi036_24110_object4551:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:49.827 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:49.827 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 24.543322977999999, 2020-11-12T17:27:49.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002, 2020-11-12T17:27:49.828 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:49.828 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:49.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:49.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:49.828 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:49.828 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36416 2020-11-12T17:27:49.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.829 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:49.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:49.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:49.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:49.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:49.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:49.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:27:49.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:49.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973666+0000", 2020-11-12T17:27:49.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117633 2020-11-12T17:27:49.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:49.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973783+0000", 2020-11-12T17:27:49.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6325999999999999e-05 2020-11-12T17:27:49.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:49.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973800+0000", 2020-11-12T17:27:49.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:27:49.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:49.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973807+0000", 2020-11-12T17:27:49.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054509620000000002 2020-11-12T17:27:49.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:49.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979258+0000", 2020-11-12T17:27:49.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1768999999999996e-05 2020-11-12T17:27:49.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:49.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979340+0000", 2020-11-12T17:27:49.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107278 2020-11-12T17:27:49.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:49.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979447+0000", 2020-11-12T17:27:49.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005025753 2020-11-12T17:27:49.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:49.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.984473+0000", 2020-11-12T17:27:49.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35634463199999999 2020-11-12T17:27:49.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:49.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340818+0000", 2020-11-12T17:27:49.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3640000000000001e-05 2020-11-12T17:27:49.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:49.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340871+0000", 2020-11-12T17:27:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2222999999999998e-05 2020-11-12T17:27:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340924+0000", 2020-11-12T17:27:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002 2020-11-12T17:27:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.837 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:49.838 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:49.838 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:49.839 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 63 16 56762 56746 7.03624 6.46094 0.0147128 0.0177539 2020-11-12T17:27:49.840 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:49.853 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:49.850+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:49.941 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:49.936+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:49.992 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:49.993 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:49.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:49.993 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:57116 5.c e164/139 5:360df823:::benchmark_data_smithi036_24110_object7139:head v 164'3596, mlcod=164'3592)", 2020-11-12T17:27:49.994 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:49.992627+0000", 2020-11-12T17:27:49.994 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.001388298, 2020-11-12T17:27:49.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001406348, 2020-11-12T17:27:49.995 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:49.995 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:49.996 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:49.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:49.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:49.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:49.992627+0000", 2020-11-12T17:27:49.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:49.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:49.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:49.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:49.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:49.992627+0000", 2020-11-12T17:27:49.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:49.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:49.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:49.992613+0000", 2020-11-12T17:27:50.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7472999999999998e-05 2020-11-12T17:27:50.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:49.992660+0000", 2020-11-12T17:27:50.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3566999999999997e-05 2020-11-12T17:27:50.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:49.992714+0000", 2020-11-12T17:27:50.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0040000000000001e-06 2020-11-12T17:27:50.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:49.992718+0000", 2020-11-12T17:27:50.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7391000000000001e-05 2020-11-12T17:27:50.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:49.992765+0000", 2020-11-12T17:27:50.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.6193000000000001e-05 2020-11-12T17:27:50.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:49.992792+0000", 2020-11-12T17:27:50.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016403300000000001 2020-11-12T17:27:50.009 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.010 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.010 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.010 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.011 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:50.012 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:27:50.012 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:50.014 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:50.042 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:50.036+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:50.142 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:50.138+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:50.152 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:50.152 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:50.154 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:50.154 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:50.156 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:50.168 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:50.243 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:50.240+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:50.341 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:50.343 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:50.340+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:50.344 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:50.345 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:50.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:50.345 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:50.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.345 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:27:50.345 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:50.346 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 279.65702634199999, 2020-11-12T17:27:50.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:27:50.346 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.346 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.346 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.346 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:50.347 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:50.347 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:27:50.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.347 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:50.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:50.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:50.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:27:50.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:27:50.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:27:50.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:27:50.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:27:50.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:27:50.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:27:50.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:27:50.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:27:50.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:27:50.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:27:50.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:27:50.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:50.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:27:50.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:27:50.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:27:50.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:27:50.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:27:50.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:27:50.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:27:50.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:27:50.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:27:50.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:27:50.356 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.356 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.356 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.357 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:27:50.357 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:50.357 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 279.65154627300001, 2020-11-12T17:27:50.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:27:50.357 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.358 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:50.358 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:50.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:50.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:50.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:27:50.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:27:50.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:27:50.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:27:50.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:27:50.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:27:50.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:27:50.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:27:50.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:27:50.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:27:50.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:27:50.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:27:50.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:27:50.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:27:50.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.365 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.366 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:27:50.366 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:50.366 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 271.46142467300001, 2020-11-12T17:27:50.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:27:50.366 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.366 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.366 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:27:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:27:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:27:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:27:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:27:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:27:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:27:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:27:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:27:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:27:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:27:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:27:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:27:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:27:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:27:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:27:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:27:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:27:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:27:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:27:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:27:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:27:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:27:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:27:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:27:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 271.45418096399999, 2020-11-12T17:27:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:27:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:27:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:27:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:27:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:27:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:27:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:27:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:27:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:27:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:27:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:27:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:27:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:27:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:27:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:27:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 195.45809159000001, 2020-11-12T17:27:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:27:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:27:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:27:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:27:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:27:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:27:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:27:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:27:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:27:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:27:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:27:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:27:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:27:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:27:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:27:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:27:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:27:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 129.330569078, 2020-11-12T17:27:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:27:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:27:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:27:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:27:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:27:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:27:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:27:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:27:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:27:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:27:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:27:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:27:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:27:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:27:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:27:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.281502417, 2020-11-12T17:27:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:27:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:27:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:27:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:27:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:27:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:27:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:27:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:27:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:27:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:27:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:27:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:27:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:27:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:27:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:27:50.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:27:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:27:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:27:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:27:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:27:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:27:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:27:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:27:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:27:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:27:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.279821637, 2020-11-12T17:27:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:27:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:27:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:27:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:27:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:27:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:27:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:27:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:27:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:27:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:27:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:27:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:27:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:27:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:27:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:27:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:27:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:27:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:27:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:27:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:27:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:27:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:27:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:27:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:27:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.27973344199999, 2020-11-12T17:27:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:27:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:27:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:27:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:27:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:27:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:27:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:27:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:27:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:27:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:27:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:27:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:27:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:27:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:27:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:27:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:27:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:27:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:27:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:27:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:27:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:27:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:27:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:27:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:27:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.261105137, 2020-11-12T17:27:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:27:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:27:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:27:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:27:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:27:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:27:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:27:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:27:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:27:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:27:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:27:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:27:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:27:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:27:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:27:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.261020409, 2020-11-12T17:27:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:27:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:27:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:27:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:27:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:27:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:27:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:27:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:27:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:27:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:27:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:27:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:27:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:27:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:27:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:27:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 89.510197958000006, 2020-11-12T17:27:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:27:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:27:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:27:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:27:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:27:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:27:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:27:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:27:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:27:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:27:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:27:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:27:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:27:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:27:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:27:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:27:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:27:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:27:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:27:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:27:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:27:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:27:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:27:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:27:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 88.423542470000001, 2020-11-12T17:27:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:27:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:27:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:27:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:27:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:27:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:27:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:27:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:27:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:27:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:27:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:27:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:27:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:27:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:27:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:27:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:27:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:27:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:27:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:27:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:27:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:27:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:27:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:27:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:27:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:27:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 88.410061243000001, 2020-11-12T17:27:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:27:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:27:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:27:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:27:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:27:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:27:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:27:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:27:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:27:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:27:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:27:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:27:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:27:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:27:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:27:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 53.407773040999999, 2020-11-12T17:27:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:27:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:27:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:27:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:27:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:27:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:27:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:27:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:27:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:27:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:27:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:27:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:27:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:27:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:27:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:27:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:27:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:27:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:27:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:27:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:27:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:27:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:27:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:27:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:27:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 53.401956456999997, 2020-11-12T17:27:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:27:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:27:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:27:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:27:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:27:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:27:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:27:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:27:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:27:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:27:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:27:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:27:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:27:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:27:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:27:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:27:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:27:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:27:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:27:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:27:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:27:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:27:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:27:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:27:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:27:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 53.379022943000002, 2020-11-12T17:27:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:27:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:27:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:27:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:27:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:27:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:27:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:27:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:27:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:27:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:27:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:27:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:27:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:27:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:27:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:27:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:27:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:27:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:27:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.846544915999999, 2020-11-12T17:27:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:27:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:27:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:27:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:27:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:27:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:27:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:27:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:27:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:27:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:27:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:27:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:27:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:27:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:27:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:27:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:27:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:27:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36040 5.a e149/127 5:5a4d50fb:::benchmark_data_smithi036_24110_object4504:head v 149'2328, mlcod=149'2321)", 2020-11-12T17:27:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.807696015000001, 2020-11-12T17:27:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001, 2020-11-12T17:27:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536010+0000", 2020-11-12T17:27:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111983 2020-11-12T17:27:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536122+0000", 2020-11-12T17:27:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40432243400000001 2020-11-12T17:27:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940444+0000", 2020-11-12T17:27:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2870000000000001e-06 2020-11-12T17:27:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940450+0000", 2020-11-12T17:27:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4161999999999999e-05 2020-11-12T17:27:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940524+0000", 2020-11-12T17:27:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4454e-05 2020-11-12T17:27:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940549+0000", 2020-11-12T17:27:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021055879999999998 2020-11-12T17:27:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942654+0000", 2020-11-12T17:27:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5819000000000002e-05 2020-11-12T17:27:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942710+0000", 2020-11-12T17:27:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001 2020-11-12T17:27:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:47376 5.1 5:83c83455:::benchmark_data_smithi036_24110_object5921:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e157)", 2020-11-12T17:27:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 12.463311206, 2020-11-12T17:27:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37640681799999998, 2020-11-12T17:27:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 47376 2020-11-12T17:27:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999275 2020-11-12T17:27:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880356+0000", 2020-11-12T17:27:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017950299999999999 2020-11-12T17:27:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880535+0000", 2020-11-12T17:27:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9902e-05 2020-11-12T17:27:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880555+0000", 2020-11-12T17:27:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8499999999999994e-06 2020-11-12T17:27:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880563+0000", 2020-11-12T17:27:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054088549999999997 2020-11-12T17:27:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.885972+0000", 2020-11-12T17:27:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0757999999999999e-05 2020-11-12T17:27:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:27:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.885982+0000", 2020-11-12T17:27:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36075470199999998 2020-11-12T17:27:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.246737+0000", 2020-11-12T17:27:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000118664 2020-11-12T17:27:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.246856+0000", 2020-11-12T17:27:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020966600000000001 2020-11-12T17:27:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.247065+0000", 2020-11-12T17:27:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005823791 2020-11-12T17:27:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.252889+0000", 2020-11-12T17:27:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038221399999999999 2020-11-12T17:27:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256711+0000", 2020-11-12T17:27:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5609000000000001e-05 2020-11-12T17:27:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256787+0000", 2020-11-12T17:27:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7657999999999997e-05 2020-11-12T17:27:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256835+0000", 2020-11-12T17:27:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37640681799999998 2020-11-12T17:27:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:50.565 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:50.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 64 16 57593 57577 7.02773 6.49219 0.0152112 0.0177794 2020-11-12T17:27:50.568 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:50.564+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:50.568 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:50.442+0000 7f9289d6e700 -1 osd.7 164 handle_osd_map injecting map crc failure 2020-11-12T17:27:50.568 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:50.569 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:50.569 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:50.576 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:50.607 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:50.639 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:50.668 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:50.664+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:50.670 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:50.699 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:50.700 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:50.710 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:50.712 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:50.747 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:50.747 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:50.747 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:50.748 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:50.748 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:50.748 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:50.748 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:50.748 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:50.748 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:50.771 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:50.766+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:50.834 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:50.835 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:50.845 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:50.887 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:50.886+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:50.973 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:50.968+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:51.007 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:51.054 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:51.056 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:51.075 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:51.072+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:51.176 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:51.174+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:51.185 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:51.185 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:51.198 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:51.277 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:51.272+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:51.362 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:51.363 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:51.372 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:51.378 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:51.372+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:51.470 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:27:51.543 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:51.543 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:51.544 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:51.545 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:51.542+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:51.560 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 65 16 58356 58340 7.01131 5.96094 0.120512 0.0178142 2020-11-12T17:27:51.644 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:51.640+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:51.703 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:51.703 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:51.714 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:51.745 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:51.740+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:51.845 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:51.845 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:51.846 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:51.840+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:51.858 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:51.948 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:51.944+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:51.965 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1] out_osds: [0] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:51.965 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:51.966 INFO:tasks.thrashosds.thrasher:Adding osd 0 2020-11-12T17:27:51.966 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd in 0 2020-11-12T17:27:51.990 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:51.990 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:52.001 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:52.049 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:52.046+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:52.150 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:52.144+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:52.158 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:52.158 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:52.171 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:52.251 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:52.250+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:52.340 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:27:52.336+0000 7f4952786700 -1 mon.a@0(leader).osd e166 definitely_dead 0 2020-11-12T17:27:52.343 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:52.343 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:52.352 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:52.348+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:52.353 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:52.455 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:52.450+0000 7f9a06aa2700 -1 osd.5 166 handle_osd_map injecting map crc failure 2020-11-12T17:27:52.497 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:52.450+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:52.499 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:27:52.499 INFO:teuthology.orchestra.run.smithi036.stderr:marked in osd.0. 2020-11-12T17:27:52.500 INFO:tasks.thrashosds.thrasher:Added osd 0 2020-11-12T17:27:52.514 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:52.514 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:52.524 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:52.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 66 16 59075 59059 6.99018 5.61719 0.0169058 0.017848 2020-11-12T17:27:52.561 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:52.556+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:52.655 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:52.650+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:52.677 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:52.677 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:52.683 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:52.756 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:52.758+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:52.763 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:52.798 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:52.799 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:52.813 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:52.857 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:52.854+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:52.918 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:52.945 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:52.958 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:52.954+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:52.968 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:52.969 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:52.972 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:52.978 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:53.001 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:53.031 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:53.059 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:53.058+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:53.066 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:53.087 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:53.088 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:53.088 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:53.088 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:53.092 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:53.097 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:53.122 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:53.124 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:53.124 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:53.125 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:53.125 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:53.125 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:53.125 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:53.126 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:53.126 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:53.183 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:53.180+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:53.230 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:53.273 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:53.273 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:53.273 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:53.273 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:53.275 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:53.276 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:53.272+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:53.376 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:53.372+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:53.433 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:53.434 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:53.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:53.509 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:53.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.510 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:53.510 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:53.510 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 288.321603337, 2020-11-12T17:27:53.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:53.511 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.511 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:53.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:53.511 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:53.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.512 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:53.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:53.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:53.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:53.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:53.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:53.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:53.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:53.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:53.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:53.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:53.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:53.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:53.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:53.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:53.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:53.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:53.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:53.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:53.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:53.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:53.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:53.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:53.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:53.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:53.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:53.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.526 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.527 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:53.527 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:53.527 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 288.314511541, 2020-11-12T17:27:53.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:53.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.528 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:53.528 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:53.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:53.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:53.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:53.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:53.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:53.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:53.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:53.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:53.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:53.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:53.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:53.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:53.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:53.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:53.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:53.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:53.536 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.536 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.537 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:53.537 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:53.537 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 278.881952044, 2020-11-12T17:27:53.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:53.538 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.538 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.538 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.538 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:53.538 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:53.538 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:53.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.539 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:53.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:53.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:53.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:53.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:53.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:53.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:53.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:53.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:53.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:53.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:53.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:53.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:53.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:53.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:53.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:53.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:53.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:53.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:53.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:53.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:53.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:53.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:53.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:53.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:53.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:53.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.550 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.550 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:53.550 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:53.551 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 244.93183195, 2020-11-12T17:27:53.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:53.551 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.551 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:53.551 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:53.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:53.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:53.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:53.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:53.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:53.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:53.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:53.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:53.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:53.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:53.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:53.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:53.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:53.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:53.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:53.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:53.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.558 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.558 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:53.559 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:53.559 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 242.82623005799999, 2020-11-12T17:27:53.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:53.559 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.559 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.559 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:53.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:53.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:53.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:53.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:53.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:53.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:53.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:53.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:53.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:53.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:53.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:53.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:53.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:53.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:53.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:53.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:53.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:53.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:53.568 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.568 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.568 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.569 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:53.569 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:53.569 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 211.47974672399999, 2020-11-12T17:27:53.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:53.569 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.569 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.569 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.569 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:53.570 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:53.570 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:53.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.570 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:53.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:53.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:53.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:53.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:53.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:53.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:53.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:53.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:53.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:53.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:53.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:53.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:53.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:53.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:53.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:53.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:53.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:53.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:53.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:53.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:53.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:53.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:53.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:53.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:53.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:53.673 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.673 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.673 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.673 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:53.673 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:53.674 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 202.48390492199999, 2020-11-12T17:27:53.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:53.674 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.674 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:53.674 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:53.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:53.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:53.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:53.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:53.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:53.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:53.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:53.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:53.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:53.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:53.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:53.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:53.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:53.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:53.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:53.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:53.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.730 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.731 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:53.731 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:53.731 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 198.54880152300001, 2020-11-12T17:27:53.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:53.731 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.732 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:53.732 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:53.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:53.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:53.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:53.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:53.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:53.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:53.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:53.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:53.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:53.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:53.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:53.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:53.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:53.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:53.738 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.738 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.738 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.738 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:53.738 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:53.738 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 167.78416103199999, 2020-11-12T17:27:53.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:53.739 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.739 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:53.739 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:53.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:53.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:53.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:53.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:53.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:53.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:53.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:53.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:53.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:53.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:53.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:53.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:53.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:53.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:53.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:53.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:53.745 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.745 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.745 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.746 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:53.746 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:53.746 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 161.527652348, 2020-11-12T17:27:53.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:53.746 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.746 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.746 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.747 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:53.747 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:53.747 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:53.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.747 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:53.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:53.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:53.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:53.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:53.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:53.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:53.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:53.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:53.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:53.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:53.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:53.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:53.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:53.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:53.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:53.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:53.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:53.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:53.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:53.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:53.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:53.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:53.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:53.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:53.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:53.756 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.756 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.756 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.757 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:53.757 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:53.757 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 161.52748997800001, 2020-11-12T17:27:53.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:53.757 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.758 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.758 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.758 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:53.758 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:53.758 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:53.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.759 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:53.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:53.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:53.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:53.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:53.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:53.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:53.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:53.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:53.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:53.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:53.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:53.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:53.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:53.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:53.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:53.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:53.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:53.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:53.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:53.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:53.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:53.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:53.766 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:53.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:53.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:53.767 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.767 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.768 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.768 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:53.768 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:53.768 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 161.51892099099999, 2020-11-12T17:27:53.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:53.768 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.769 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:53.769 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:53.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:53.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:53.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:53.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:53.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:53.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:53.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:53.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:53.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:53.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:53.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:53.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:53.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:53.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:53.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:53.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:53.775 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.775 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.775 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.775 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44096 4.6 4:6e3b4d63:::benchmark_data_smithi036_18856_object5511:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e90)", 2020-11-12T17:27:53.776 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:53.776 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.01440854099999, 2020-11-12T17:27:53.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002, 2020-11-12T17:27:53.776 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.776 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.776 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.776 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:53.776 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:53.777 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44096 2020-11-12T17:27:53.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.777 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:53.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416072+0000", 2020-11-12T17:27:53.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:53.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416041+0000", 2020-11-12T17:27:53.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7198000000000001e-05 2020-11-12T17:27:53.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416129+0000", 2020-11-12T17:27:53.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0946e-05 2020-11-12T17:27:53.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416140+0000", 2020-11-12T17:27:53.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.967e-06 2020-11-12T17:27:53.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.416145+0000", 2020-11-12T17:27:53.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087936609999999995 2020-11-12T17:27:53.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.424938+0000", 2020-11-12T17:27:53.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1188999999999999e-05 2020-11-12T17:27:53.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425009+0000", 2020-11-12T17:27:53.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116119 2020-11-12T17:27:53.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:53.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.425126+0000", 2020-11-12T17:27:53.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048398210000000002 2020-11-12T17:27:53.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.429965+0000", 2020-11-12T17:27:53.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.29642543900000001 2020-11-12T17:27:53.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726391+0000", 2020-11-12T17:27:53.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1853000000000003e-05 2020-11-12T17:27:53.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726483+0000", 2020-11-12T17:27:53.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3175000000000003e-05 2020-11-12T17:27:53.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.726556+0000", 2020-11-12T17:27:53.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31048386900000002 2020-11-12T17:27:53.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.787 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.787 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.787 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:53.787 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:53.787 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 135.52886025500001, 2020-11-12T17:27:53.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:53.788 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.788 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.788 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.788 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:53.788 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:53.788 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:53.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.788 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:53.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:53.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:53.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:53.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:53.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:53.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:53.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:53.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:53.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:53.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:53.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:53.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:53.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:53.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:53.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:53.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:53.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:53.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:53.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:53.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:53.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:53.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:53.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:53.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:53.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:53.797 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.797 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.797 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.798 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:53.798 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:53.798 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 132.455541823, 2020-11-12T17:27:53.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:53.798 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.798 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:53.799 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:53.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:53.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:53.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:53.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:53.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:53.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:53.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:53.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:53.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:53.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:53.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:53.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:53.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:53.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:53.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:53.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:53.842 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.842 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.843 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:53.843 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:53.843 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 131.39989684700001, 2020-11-12T17:27:53.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:53.844 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.844 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.844 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.844 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:53.844 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:53.844 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:53.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.844 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:53.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:53.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:53.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:53.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:53.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:53.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:53.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:53.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:53.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:53.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:53.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:53.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:53.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:53.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:53.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:53.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:53.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:53.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:53.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:53.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:53.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:53.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:53.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:53.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:53.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:53.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.853 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.853 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.854 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:53.854 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:53.854 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 131.01169247600001, 2020-11-12T17:27:53.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:53.854 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.854 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.854 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:53.855 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:53.855 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:53.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.855 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:53.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:53.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:53.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:53.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:53.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:53.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:53.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:53.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:53.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:53.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:53.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:53.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:53.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:53.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:53.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:53.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:53.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:53.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:53.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:53.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:53.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:53.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:53.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:53.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:53.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:53.864 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.864 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.864 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.865 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:53.865 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:53.865 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.805235544, 2020-11-12T17:27:53.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:53.865 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.865 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.866 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.866 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:53.866 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:53.866 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:53.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.866 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:53.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:53.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:53.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:53.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:53.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:53.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:53.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:53.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:53.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:53.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:53.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:53.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:53.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:53.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:53.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:53.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:53.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:53.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:53.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:53.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.875 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.556029927, 2020-11-12T17:27:53.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.877 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:53.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:53.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:53.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:53.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:53.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:53.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:53.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:53.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.887 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.539070478, 2020-11-12T17:27:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:53.888 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:53.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:53.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:53.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:53.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:53.894 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:53.895 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:53.895 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:53.897 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:53.458+0000 7f9a06aa2700 -1 osd.5 167 handle_osd_map injecting map crc failure 2020-11-12T17:27:53.897 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 67 16 59078 59062 6.8862 0.0234375 0.814516 0.0178739 2020-11-12T17:27:53.897 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:53.892+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:53.898 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:53.998 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:53.994+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:54.064 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:54.064 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.065 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:59192 5.0 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e168)", 2020-11-12T17:27:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:27:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.26136585600000001, 2020-11-12T17:27:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.26142685799999998, 2020-11-12T17:27:54.066 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 59192 2020-11-12T17:27:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.067 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:27:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:27:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802660+0000", 2020-11-12T17:27:54.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9094000000000001e-05 2020-11-12T17:27:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802709+0000", 2020-11-12T17:27:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9580000000000004e-06 2020-11-12T17:27:54.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802715+0000", 2020-11-12T17:27:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0690000000000002e-06 2020-11-12T17:27:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802719+0000", 2020-11-12T17:27:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010962786 2020-11-12T17:27:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813681+0000", 2020-11-12T17:27:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011702 2020-11-12T17:27:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813798+0000", 2020-11-12T17:27:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187436 2020-11-12T17:27:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813986+0000", 2020-11-12T17:27:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020009369999999999 2020-11-12T17:27:54.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.815987+0000", 2020-11-12T17:27:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013309178 2020-11-12T17:27:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.075 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:27:54.076 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 1 2020-11-12T17:27:54.076 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:54.078 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:54.109 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:54.098+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:54.190 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:54.191 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:54.191 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:54.191 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:54.191 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:54.201 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:54.267 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:54.264+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:54.368 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:54.364+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:54.398 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:54.398 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:54.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:54.399 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:54.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.399 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:54.399 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:54.399 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 279.97822477900002, 2020-11-12T17:27:54.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:54.400 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.400 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:54.400 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:54.400 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:54.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.401 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:54.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:54.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:54.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:54.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:54.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:54.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:54.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:54.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:54.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:54.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:54.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:54.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:54.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.437 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:54.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:54.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.437 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:54.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:54.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:54.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.438 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.438 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:54.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:54.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:54.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:54.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:54.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:54.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:54.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:54.441 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.441 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.441 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.441 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:54.441 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:54.441 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 279.97128071700001, 2020-11-12T17:27:54.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:54.442 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.442 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:54.442 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:54.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:54.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:54.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:54.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:54.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:54.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:54.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:54.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:54.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:54.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:54.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:54.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:54.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:54.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:54.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:54.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:54.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.453 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.454 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:54.454 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:54.454 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 243.79744293100001, 2020-11-12T17:27:54.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:54.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.455 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:54.455 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:54.455 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:54.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.455 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:54.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:54.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:54.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:54.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:54.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:54.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:54.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:54.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:54.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:54.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:54.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:54.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:54.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:54.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:54.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:54.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:54.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:54.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:54.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:54.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:54.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:27:54.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:27:54.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:27:54.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:27:54.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:27:54.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.466 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.466 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.466 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:27:54.466 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:54.466 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 227.53373783800001, 2020-11-12T17:27:54.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:27:54.467 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.467 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.467 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.467 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:54.467 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:54.467 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:27:54.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.468 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:54.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:27:54.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:27:54.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:27:54.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:27:54.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:27:54.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:27:54.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:27:54.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:27:54.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:27:54.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:27:54.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:27:54.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:27:54.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:27:54.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:27:54.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:54.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:27:54.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:27:54.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:27:54.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:27:54.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:27:54.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:27:54.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:27:54.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:27:54.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:27:54.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:27:54.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.476 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.477 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.477 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:27:54.477 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:54.477 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 212.448357512, 2020-11-12T17:27:54.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:27:54.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.478 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.478 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:54.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:27:54.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:27:54.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:27:54.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:27:54.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:27:54.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:27:54.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:27:54.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:27:54.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:27:54.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:27:54.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:27:54.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:27:54.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:27:54.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:27:54.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:27:54.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:27:54.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:27:54.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:27:54.485 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.485 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.485 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.485 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:27:54.485 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:54.486 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 210.75421923799999, 2020-11-12T17:27:54.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:27:54.486 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.486 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:54.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:54.487 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:27:54.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.487 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:54.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:27:54.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:27:54.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:27:54.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:27:54.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:27:54.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:27:54.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:27:54.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:27:54.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:27:54.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:27:54.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:27:54.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:27:54.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:27:54.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:27:54.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:54.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:27:54.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:27:54.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:27:54.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:27:54.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:27:54.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:27:54.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:27:54.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:27:54.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:27:54.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:27:54.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.496 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.497 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:27:54.497 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:54.497 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 153.084980516, 2020-11-12T17:27:54.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:27:54.497 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.497 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.497 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.497 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:54.498 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:54.498 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:27:54.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.498 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:54.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:27:54.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:27:54.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:27:54.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:27:54.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:27:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:27:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:27:54.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:27:54.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:27:54.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:27:54.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:27:54.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:27:54.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:27:54.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:27:54.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:54.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:27:54.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:27:54.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:27:54.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:27:54.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:27:54.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:27:54.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:27:54.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:27:54.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:27:54.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:27:54.509 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.509 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.509 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.510 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:27:54.510 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:54.510 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 153.071803757, 2020-11-12T17:27:54.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:27:54.510 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.511 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:54.511 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:54.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:27:54.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:27:54.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:27:54.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:27:54.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:27:54.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:27:54.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:27:54.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:27:54.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:27:54.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:27:54.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:27:54.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:27:54.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:27:54.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:27:54.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:27:54.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:27:54.541 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.541 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.541 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.542 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:27:54.542 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:54.542 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 148.517722308, 2020-11-12T17:27:54.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:27:54.542 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.542 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:54.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:54.543 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:27:54.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.544 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:54.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:27:54.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:27:54.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:27:54.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:27:54.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:27:54.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:27:54.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:27:54.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:27:54.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:27:54.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:27:54.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:27:54.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:27:54.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:27:54.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:27:54.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:54.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:27:54.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:27:54.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:27:54.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:27:54.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:27:54.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:27:54.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:27:54.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:27:54.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:27:54.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:27:54.563 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.564 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.564 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.565 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:34936 4.0 e85/69 ondisk, result = 0)", 2020-11-12T17:27:54.565 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:54.565 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 148.50873500200001, 2020-11-12T17:27:54.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998, 2020-11-12T17:27:54.566 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.566 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:54.567 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:54.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887978+0000", 2020-11-12T17:27:54.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:54.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.887927+0000", 2020-11-12T17:27:54.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106111 2020-11-12T17:27:54.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888033+0000", 2020-11-12T17:27:54.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34744653199999997 2020-11-12T17:27:54.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235480+0000", 2020-11-12T17:27:54.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3899999999999993e-06 2020-11-12T17:27:54.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.235488+0000", 2020-11-12T17:27:54.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028244210000000001 2020-11-12T17:27:54.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238313+0000", 2020-11-12T17:27:54.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6570000000000003e-06 2020-11-12T17:27:54.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238321+0000", 2020-11-12T17:27:54.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015637600000000001 2020-11-12T17:27:54.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.594 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238478+0000", 2020-11-12T17:27:54.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35049952699999998 2020-11-12T17:27:54.595 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.595 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.597 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:27:54.597 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:54.597 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.49080768799999, 2020-11-12T17:27:54.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:27:54.597 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.597 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.597 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.598 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:54.598 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:54.598 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:27:54.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.598 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:54.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:27:54.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:54.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:27:54.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:27:54.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:27:54.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:27:54.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:27:54.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:27:54.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:27:54.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:27:54.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:27:54.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:27:54.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:27:54.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:27:54.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:54.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:27:54.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:27:54.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:27:54.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:27:54.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:27:54.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:27:54.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:27:54.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:27:54.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:27:54.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:27:54.607 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.607 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.607 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.608 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:54.608 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:54.608 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.68836879, 2020-11-12T17:27:54.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:27:54.608 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.609 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.609 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.609 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:54.609 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:54.610 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:27:54.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.611 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:54.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:27:54.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:27:54.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:27:54.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:27:54.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:27:54.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:27:54.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:27:54.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:27:54.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:27:54.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:27:54.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:27:54.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:27:54.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:27:54.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:27:54.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:54.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:27:54.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:27:54.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:27:54.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:27:54.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:27:54.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:27:54.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:27:54.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:27:54.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:27:54.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:27:54.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.619 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.620 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:27:54.620 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:54.620 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.60924647300001, 2020-11-12T17:27:54.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:27:54.621 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.621 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:54.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:54.621 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:27:54.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.621 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:54.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:27:54.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:27:54.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:27:54.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:27:54.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:27:54.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:27:54.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:27:54.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:27:54.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:27:54.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:27:54.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:27:54.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:27:54.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:27:54.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:27:54.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:54.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:27:54.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:27:54.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:27:54.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:27:54.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:27:54.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:27:54.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:27:54.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:27:54.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:27:54.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:27:54.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.642 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.643 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:27:54.656 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 112.826895506, 2020-11-12T17:27:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:27:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.657 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:27:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:27:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:27:54.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:27:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:27:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:27:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:27:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:27:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:27:54.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:27:54.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:27:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:27:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:27:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:27:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:27:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:27:54.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:27:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:27:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:27:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:27:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:27:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:27:54.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:27:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:27:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:27:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.667 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:27:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 97.363853156999994, 2020-11-12T17:27:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:27:54.668 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:27:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:27:54.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:27:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:27:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:27:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:27:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:27:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:27:54.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:27:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:27:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:27:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:27:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:27:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:27:54.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:27:54.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:27:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:27:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:27:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:27:54.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:27:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:27:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:27:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:27:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:27:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:27:54.678 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:27:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 52.342094006000004, 2020-11-12T17:27:54.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:27:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:54.680 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:27:54.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.681 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:54.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:27:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:27:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:27:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:27:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:27:54.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:27:54.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:27:54.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:27:54.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:27:54.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:27:54.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:27:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:27:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:27:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:27:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:54.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:27:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:27:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:27:54.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:27:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:27:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:27:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:27:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:27:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:27:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:27:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35048 5.1 e148/127 5:8e34dcfa:::benchmark_data_smithi036_24110_object4380:head v 148'2280, mlcod=148'2275)", 2020-11-12T17:27:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 31.037155187, 2020-11-12T17:27:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002, 2020-11-12T17:27:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.696 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359558+0000", 2020-11-12T17:27:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359524+0000", 2020-11-12T17:27:54.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.064e-05 2020-11-12T17:27:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.359605+0000", 2020-11-12T17:27:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34493079599999998 2020-11-12T17:27:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704536+0000", 2020-11-12T17:27:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2110000000000001e-06 2020-11-12T17:27:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704543+0000", 2020-11-12T17:27:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1071999999999998e-05 2020-11-12T17:27:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704634+0000", 2020-11-12T17:27:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2281999999999998e-05 2020-11-12T17:27:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.704696+0000", 2020-11-12T17:27:54.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034977459999999999 2020-11-12T17:27:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708194+0000", 2020-11-12T17:27:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1390000000000006e-05 2020-11-12T17:27:54.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.708265+0000", 2020-11-12T17:27:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34870762100000002 2020-11-12T17:27:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.706 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35144 5.0 5:0d4814aa:::benchmark_data_smithi036_24110_object4392:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e148)", 2020-11-12T17:27:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:54.707 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.829549288999999, 2020-11-12T17:27:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998, 2020-11-12T17:27:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:54.708 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35144 2020-11-12T17:27:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:54.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567164+0000", 2020-11-12T17:27:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:27:54.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567086+0000", 2020-11-12T17:27:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017142700000000001 2020-11-12T17:27:54.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567257+0000", 2020-11-12T17:27:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1043000000000002e-05 2020-11-12T17:27:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567278+0000", 2020-11-12T17:27:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1214e-05 2020-11-12T17:27:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.567289+0000", 2020-11-12T17:27:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.142698779 2020-11-12T17:27:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.709988+0000", 2020-11-12T17:27:54.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4704999999999995e-05 2020-11-12T17:27:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710083+0000", 2020-11-12T17:27:54.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016350300000000001 2020-11-12T17:27:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.710246+0000", 2020-11-12T17:27:54.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002268946 2020-11-12T17:27:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.712515+0000", 2020-11-12T17:27:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.199261574 2020-11-12T17:27:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911777+0000", 2020-11-12T17:27:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0816999999999996e-05 2020-11-12T17:27:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911858+0000", 2020-11-12T17:27:54.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2182000000000003e-05 2020-11-12T17:27:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:23.911910+0000", 2020-11-12T17:27:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34474607699999998 2020-11-12T17:27:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.720 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:54.721 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.280734335999998, 2020-11-12T17:27:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:27:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:27:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:54.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:27:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:54.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:27:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:27:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:27:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:27:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:27:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:27:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:27:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:27:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:27:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:27:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:27:54.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:27:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:54.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:27:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:27:54.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:27:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:27:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:27:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:27:54.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:27:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:27:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:27:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:27:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36416 5.0 5:05125f34:::benchmark_data_smithi036_24110_object4551:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:27:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 29.423006311000002, 2020-11-12T17:27:54.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002, 2020-11-12T17:27:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:27:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:54.737 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36416 2020-11-12T17:27:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:54.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:27:54.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:27:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973666+0000", 2020-11-12T17:27:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117633 2020-11-12T17:27:54.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973783+0000", 2020-11-12T17:27:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6325999999999999e-05 2020-11-12T17:27:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973800+0000", 2020-11-12T17:27:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:27:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973807+0000", 2020-11-12T17:27:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054509620000000002 2020-11-12T17:27:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979258+0000", 2020-11-12T17:27:54.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1768999999999996e-05 2020-11-12T17:27:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979340+0000", 2020-11-12T17:27:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107278 2020-11-12T17:27:54.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979447+0000", 2020-11-12T17:27:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005025753 2020-11-12T17:27:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:54.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.984473+0000", 2020-11-12T17:27:54.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35634463199999999 2020-11-12T17:27:54.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340818+0000", 2020-11-12T17:27:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3640000000000001e-05 2020-11-12T17:27:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340871+0000", 2020-11-12T17:27:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2222999999999998e-05 2020-11-12T17:27:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340924+0000", 2020-11-12T17:27:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002 2020-11-12T17:27:54.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.750 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:54.750 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:54.750 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:54.751 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:27:54.752 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:27:54.753 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 68 16 59303 59287 6.81078 1.75781 0.481641 0.0181599 2020-11-12T17:27:54.755 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:54.748+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:54.855 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:54.850+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:54.882 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:54.882 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:54.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.883 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e169)", 2020-11-12T17:27:54.883 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:27:54.883 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.191857469, 2020-11-12T17:27:54.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.191879202, 2020-11-12T17:27:54.883 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:54.884 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:27:54.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:54.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:54.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:54.884 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:27:54.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.884 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:54.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:54.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:27:54.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:54.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:54.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:27:54.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:54.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:54.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691863+0000", 2020-11-12T17:27:54.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103144 2020-11-12T17:27:54.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:54.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691966+0000", 2020-11-12T17:27:54.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8453000000000001e-05 2020-11-12T17:27:54.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:54.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691985+0000", 2020-11-12T17:27:54.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0385e-05 2020-11-12T17:27:54.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691995+0000", 2020-11-12T17:27:54.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0098187989999999996 2020-11-12T17:27:54.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:54.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701814+0000", 2020-11-12T17:27:54.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000135065 2020-11-12T17:27:54.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:54.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701949+0000", 2020-11-12T17:27:54.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025538399999999999 2020-11-12T17:27:54.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:54.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.702205+0000", 2020-11-12T17:27:54.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034246620000000002 2020-11-12T17:27:54.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:54.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.705629+0000", 2020-11-12T17:27:54.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013728974 2020-11-12T17:27:54.898 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.899 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:54.899 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.899 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:59501 5.f e169/127 5:fcda2723:::benchmark_data_smithi036_24110_object7437:head v 169'3765, mlcod=169'3761)", 2020-11-12T17:27:54.899 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.880184+0000", 2020-11-12T17:27:54.900 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0035740450000000001, 2020-11-12T17:27:54.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0036544440000000002, 2020-11-12T17:27:54.900 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:54.900 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:54.900 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:54.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:54.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.880184+0000", 2020-11-12T17:27:54.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:54.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:54.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.880184+0000", 2020-11-12T17:27:54.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:27:54.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:54.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.880170+0000", 2020-11-12T17:27:54.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4713000000000003e-05 2020-11-12T17:27:54.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:54.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.880225+0000", 2020-11-12T17:27:54.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4689000000000003e-05 2020-11-12T17:27:54.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:54.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.880300+0000", 2020-11-12T17:27:54.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1890000000000004e-06 2020-11-12T17:27:54.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.880306+0000", 2020-11-12T17:27:54.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1808999999999998e-05 2020-11-12T17:27:54.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:54.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.880358+0000", 2020-11-12T17:27:54.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9356000000000002e-05 2020-11-12T17:27:54.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:54.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.880387+0000", 2020-11-12T17:27:54.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000203363 2020-11-12T17:27:54.906 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.906 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:54.907 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.907 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:59502 5.f e169/127 5:fcda2723:::benchmark_data_smithi036_24110_object7437:head v 169'3766, mlcod=169'3761)", 2020-11-12T17:27:54.907 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.881577+0000", 2020-11-12T17:27:54.907 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0021810369999999998, 2020-11-12T17:27:54.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023031169999999999, 2020-11-12T17:27:54.908 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:54.908 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:54.908 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:54.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:54.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.881577+0000", 2020-11-12T17:27:54.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:54.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:54.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.881577+0000", 2020-11-12T17:27:54.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:27:54.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:54.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.881563+0000", 2020-11-12T17:27:54.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6780000000000003e-05 2020-11-12T17:27:54.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:54.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.881610+0000", 2020-11-12T17:27:54.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9332000000000002e-05 2020-11-12T17:27:54.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:54.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.881649+0000", 2020-11-12T17:27:54.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.617e-06 2020-11-12T17:27:54.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.881654+0000", 2020-11-12T17:27:54.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049406799999999996 2020-11-12T17:27:54.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:54.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.882148+0000", 2020-11-12T17:27:54.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6851999999999999e-05 2020-11-12T17:27:54.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:54.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.882185+0000", 2020-11-12T17:27:54.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060825699999999996 2020-11-12T17:27:54.914 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.914 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:54.915 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.915 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:59503 5.f e169/127)", 2020-11-12T17:27:54.915 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.882985+0000", 2020-11-12T17:27:54.915 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00077242399999999996, 2020-11-12T17:27:54.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00093058699999999997, 2020-11-12T17:27:54.916 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:54.916 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:27:54.916 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:54.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:54.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.882985+0000", 2020-11-12T17:27:54.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:54.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:54.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.882985+0000", 2020-11-12T17:27:54.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:27:54.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:54.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.882959+0000", 2020-11-12T17:27:54.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6595999999999996e-05 2020-11-12T17:27:54.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:54.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.883045+0000", 2020-11-12T17:27:54.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6641000000000002e-05 2020-11-12T17:27:54.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:54.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.883102+0000", 2020-11-12T17:27:54.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1669999999999999e-06 2020-11-12T17:27:54.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.883110+0000", 2020-11-12T17:27:54.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012500099999999999 2020-11-12T17:27:54.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.921 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:54.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.922 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e169)", 2020-11-12T17:27:54.922 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:27:54.922 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.17023885499999999, 2020-11-12T17:27:54.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.17043192300000001, 2020-11-12T17:27:54.922 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:54.922 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:27:54.922 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:54.923 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:54.923 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:54.923 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:27:54.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.923 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:54.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:54.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:27:54.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:54.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:54.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:27:54.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:54.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:54.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713485+0000", 2020-11-12T17:27:54.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7021000000000005e-05 2020-11-12T17:27:54.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:54.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713582+0000", 2020-11-12T17:27:54.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2103000000000001e-05 2020-11-12T17:27:54.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:54.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713595+0000", 2020-11-12T17:27:54.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0129999999999999e-06 2020-11-12T17:27:54.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:54.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713601+0000", 2020-11-12T17:27:54.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001321727 2020-11-12T17:27:54.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:54.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.714922+0000", 2020-11-12T17:27:54.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011930300000000001 2020-11-12T17:27:54.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:54.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:54.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:27:54.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.715042+0000", 2020-11-12T17:27:54.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015228310000000001 2020-11-12T17:27:54.929 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.929 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:54.929 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.930 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:54.930 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:27:54.930 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 5 2020-11-12T17:27:54.930 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:54.932 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:27:54.975 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:54.974+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:55.057 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:55.052+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:55.096 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:55.097 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:27:55.097 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:27:55.097 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:27:55.097 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:55.111 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:27:55.136 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:27:55.163 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:55.162+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:55.238 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:55.238 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:27:55.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:27:55.239 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:27:55.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.239 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:27:55.239 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:55.239 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 284.55032261399998, 2020-11-12T17:27:55.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:27:55.240 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.240 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:55.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:55.240 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:27:55.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.241 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:55.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:27:55.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:27:55.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:27:55.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:27:55.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:27:55.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:27:55.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:27:55.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:27:55.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:27:55.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:27:55.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:27:55.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:27:55.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:27:55.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:27:55.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:55.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:27:55.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:27:55.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:27:55.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:27:55.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:27:55.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:27:55.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:27:55.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:27:55.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:27:55.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:27:55.256 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.257 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.257 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.257 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:27:55.257 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:55.257 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 284.54484254499999, 2020-11-12T17:27:55.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:27:55.258 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.258 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:55.258 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:55.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:27:55.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:27:55.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:27:55.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:27:55.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:27:55.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:27:55.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:27:55.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:27:55.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:27:55.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:27:55.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:27:55.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:27:55.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:27:55.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:27:55.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:27:55.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:27:55.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.267 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.267 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.268 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:27:55.268 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:55.268 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 276.354720945, 2020-11-12T17:27:55.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:27:55.268 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.268 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.269 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.269 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:27:55.269 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:55.269 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:27:55.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.270 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:55.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:27:55.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:27:55.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:27:55.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:27:55.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:27:55.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:27:55.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:27:55.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:27:55.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:27:55.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:27:55.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:27:55.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:27:55.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:27:55.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:27:55.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:27:55.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:27:55.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:27:55.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:27:55.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:27:55.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:27:55.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:27:55.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:27:55.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:27:55.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:27:55.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:27:55.279 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.279 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.279 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.280 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:27:55.280 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:55.280 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 276.34747723599997, 2020-11-12T17:27:55.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:27:55.280 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.281 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:55.281 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:55.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:27:55.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:55.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:27:55.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:27:55.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:27:55.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:27:55.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:27:55.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:27:55.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:27:55.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:27:55.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:27:55.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:27:55.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:27:55.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:27:55.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:27:55.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:27:55.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.288 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.289 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.289 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:55.289 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:55.289 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 200.351387862, 2020-11-12T17:27:55.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:27:55.290 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.290 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:55.290 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:55.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:27:55.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:27:55.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:27:55.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:27:55.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:27:55.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:27:55.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:27:55.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:27:55.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:27:55.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:27:55.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:27:55.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:27:55.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:27:55.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:27:55.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:27:55.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:27:55.297 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.297 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.297 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.298 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:27:55.298 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:55.298 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 134.22386535000001, 2020-11-12T17:27:55.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:27:55.298 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.299 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:55.299 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:55.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:27:55.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:55.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:27:55.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:27:55.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:27:55.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:27:55.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:27:55.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:27:55.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:27:55.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:27:55.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:27:55.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:27:55.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:27:55.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:27:55.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:27:55.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:27:55.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.307 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.308 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.308 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53718 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:55.308 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:55.308 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.174798689, 2020-11-12T17:27:55.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002, 2020-11-12T17:27:55.309 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.309 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:55.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:55.309 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53718 2020-11-12T17:27:55.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.310 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:55.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062237+0000", 2020-11-12T17:27:55.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999979 2020-11-12T17:27:55.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062216+0000", 2020-11-12T17:27:55.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7568999999999997e-05 2020-11-12T17:27:55.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062273+0000", 2020-11-12T17:27:55.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7509999999999997e-06 2020-11-12T17:27:55.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062282+0000", 2020-11-12T17:27:55.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7369999999999997e-06 2020-11-12T17:27:55.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.062287+0000", 2020-11-12T17:27:55.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.01236016 2020-11-12T17:27:55.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074647+0000", 2020-11-12T17:27:55.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019197499999999999 2020-11-12T17:27:55.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.074839+0000", 2020-11-12T17:27:55.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027435399999999998 2020-11-12T17:27:55.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:55.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.075113+0000", 2020-11-12T17:27:55.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045169019999999997 2020-11-12T17:27:55.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079630+0000", 2020-11-12T17:27:55.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.366383079 2020-11-12T17:27:55.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446013+0000", 2020-11-12T17:27:55.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1933999999999994e-05 2020-11-12T17:27:55.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446075+0000", 2020-11-12T17:27:55.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8484000000000002e-05 2020-11-12T17:27:55.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.446164+0000", 2020-11-12T17:27:55.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38392711000000002 2020-11-12T17:27:55.319 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.319 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.319 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.320 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:55.320 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:55.320 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.173117909, 2020-11-12T17:27:55.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:27:55.321 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.321 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.321 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.321 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:55.321 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:55.322 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:27:55.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.322 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:55.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:27:55.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:27:55.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:27:55.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:27:55.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:27:55.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:27:55.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:27:55.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:27:55.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:27:55.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:27:55.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:27:55.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:27:55.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:27:55.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:27:55.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:55.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:27:55.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:27:55.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:27:55.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:27:55.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:27:55.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:27:55.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:27:55.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:27:55.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:27:55.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:27:55.334 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.334 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.335 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.335 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:27:55.335 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:55.335 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.17302971399999, 2020-11-12T17:27:55.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:27:55.336 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.336 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.336 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.338 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:55.338 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:55.338 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:27:55.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.338 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:55.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:27:55.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:55.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:27:55.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:27:55.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:27:55.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:27:55.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:27:55.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:27:55.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:27:55.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:27:55.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:27:55.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:27:55.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:27:55.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:27:55.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:55.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:27:55.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:27:55.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:27:55.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:27:55.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:27:55.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:27:55.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:27:55.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:27:55.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:27:55.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:27:55.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.349 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.349 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:55.350 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:55.350 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.154401409, 2020-11-12T17:27:55.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:27:55.350 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.350 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:55.350 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:55.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:27:55.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:27:55.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:27:55.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:27:55.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:27:55.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:27:55.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:27:55.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:27:55.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:27:55.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:27:55.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:27:55.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:27:55.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:27:55.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:27:55.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:27:55.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:27:55.358 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.358 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.358 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.360 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:27:55.360 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:55.360 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.154316681, 2020-11-12T17:27:55.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:27:55.360 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.361 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:55.361 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:55.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:27:55.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:27:55.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:27:55.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:27:55.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:27:55.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:27:55.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:27:55.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:27:55.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:27:55.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:27:55.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:27:55.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:27:55.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:27:55.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:27:55.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:27:55.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:27:55.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.368 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.369 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.369 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:55.369 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:55.369 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 94.403494230000007, 2020-11-12T17:27:55.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:27:55.370 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.370 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.370 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.370 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:55.370 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:55.371 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:27:55.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.371 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:55.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:27:55.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:27:55.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:27:55.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:27:55.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:27:55.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:27:55.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:27:55.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:27:55.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:27:55.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:27:55.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:27:55.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:27:55.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:27:55.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:27:55.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:55.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:27:55.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:27:55.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:27:55.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:27:55.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:27:55.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:27:55.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:27:55.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:27:55.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:27:55.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:27:55.382 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.382 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.382 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.382 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:27:55.383 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:55.383 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 93.316838742000002, 2020-11-12T17:27:55.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:27:55.383 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.383 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.383 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.383 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:27:55.384 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:55.384 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:27:55.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.384 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:27:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:55.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:27:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:27:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:27:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:27:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:27:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:27:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:27:55.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:27:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:27:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:27:55.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:27:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:27:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:27:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:27:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:27:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:27:55.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:27:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:27:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:27:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:27:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:27:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:27:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:27:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.394 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:27:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 93.303357515000002, 2020-11-12T17:27:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:27:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:27:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:55.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:27:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:27:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:27:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:27:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:27:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:27:55.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:27:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:27:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:27:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:27:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:27:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:27:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:27:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:27:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:27:55.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:27:55.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.406 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.407 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.301069312999999, 2020-11-12T17:27:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:27:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.408 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:27:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:27:55.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:27:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:27:55.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:27:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:27:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:27:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:27:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:27:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:27:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:27:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:27:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:27:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:27:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:27:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:55.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:27:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:27:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:27:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:27:55.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:27:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:27:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:27:55.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:27:55.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:27:55.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:27:55.420 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.420 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.420 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:27:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.295252728999998, 2020-11-12T17:27:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:27:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.421 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:27:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.422 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:27:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:27:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:27:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:27:55.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:27:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:27:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:27:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:27:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:27:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:27:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:27:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:27:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:27:55.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:27:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:27:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:27:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:27:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:27:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:27:55.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:27:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:27:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:27:55.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:27:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:27:55.432 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.433 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:27:55.434 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:55.434 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.272319215000003, 2020-11-12T17:27:55.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:27:55.434 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.434 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.434 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:27:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:55.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:27:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:27:55.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:27:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:27:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:27:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:27:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:27:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:27:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:27:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:27:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:27:55.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:27:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:27:55.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:27:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:27:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:27:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.444 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:27:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 51.739841188, 2020-11-12T17:27:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:27:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:55.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:27:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:27:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:27:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:27:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:27:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:27:55.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:27:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:27:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:27:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:27:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:27:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:27:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:27:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:27:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:27:55.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:27:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:27:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:27:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.454 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:36040 5.a e149/127 5:5a4d50fb:::benchmark_data_smithi036_24110_object4504:head v 149'2328, mlcod=149'2321)", 2020-11-12T17:27:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.700992286999998, 2020-11-12T17:27:55.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001, 2020-11-12T17:27:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:55.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536043+0000", 2020-11-12T17:27:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:27:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536010+0000", 2020-11-12T17:27:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111983 2020-11-12T17:27:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.536122+0000", 2020-11-12T17:27:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40432243400000001 2020-11-12T17:27:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940444+0000", 2020-11-12T17:27:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2870000000000001e-06 2020-11-12T17:27:55.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940450+0000", 2020-11-12T17:27:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4161999999999999e-05 2020-11-12T17:27:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940524+0000", 2020-11-12T17:27:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4454e-05 2020-11-12T17:27:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.940549+0000", 2020-11-12T17:27:55.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021055879999999998 2020-11-12T17:27:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942654+0000", 2020-11-12T17:27:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5819000000000002e-05 2020-11-12T17:27:55.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:24.942710+0000", 2020-11-12T17:27:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40666724100000001 2020-11-12T17:27:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.463 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:47376 5.1 5:83c83455:::benchmark_data_smithi036_24110_object5921:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e157)", 2020-11-12T17:27:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 17.356607478000001, 2020-11-12T17:27:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37640681799999998, 2020-11-12T17:27:55.464 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:27:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:27:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:27:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:27:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 47376 2020-11-12T17:27:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.465 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:27:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:27:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:27:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:27:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880428+0000", 2020-11-12T17:27:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999275 2020-11-12T17:27:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:27:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880356+0000", 2020-11-12T17:27:55.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017950299999999999 2020-11-12T17:27:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:27:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880535+0000", 2020-11-12T17:27:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9902e-05 2020-11-12T17:27:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:27:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880555+0000", 2020-11-12T17:27:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8499999999999994e-06 2020-11-12T17:27:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:27:55.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.880563+0000", 2020-11-12T17:27:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054088549999999997 2020-11-12T17:27:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.885972+0000", 2020-11-12T17:27:55.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0757999999999999e-05 2020-11-12T17:27:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting_for_map not empty", 2020-11-12T17:27:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:37.885982+0000", 2020-11-12T17:27:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36075470199999998 2020-11-12T17:27:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:27:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.246737+0000", 2020-11-12T17:27:55.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000118664 2020-11-12T17:27:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:27:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.246856+0000", 2020-11-12T17:27:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020966600000000001 2020-11-12T17:27:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:27:55.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.247065+0000", 2020-11-12T17:27:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005823791 2020-11-12T17:27:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.252889+0000", 2020-11-12T17:27:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038221399999999999 2020-11-12T17:27:55.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:27:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256711+0000", 2020-11-12T17:27:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5609000000000001e-05 2020-11-12T17:27:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:27:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256787+0000", 2020-11-12T17:27:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7657999999999997e-05 2020-11-12T17:27:55.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:27:55.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:27:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:27:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:38.256835+0000", 2020-11-12T17:27:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37640681799999998 2020-11-12T17:27:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.479 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:27:55.480 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:27:55.480 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:55.481 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:55.482 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:55.482 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:55.482 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:55.482 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:55.482 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:55.478+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:55.483 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:27:55.511 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:55.546 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:55.582 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 69 16 59956 59940 6.786 5.10156 0.0171354 0.018404 2020-11-12T17:27:55.583 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:55.580+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:55.646 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:55.646 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:55.655 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:27:55.700 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:55.698+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:55.781 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:55.782 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:55.786 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:55.782+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:55.795 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:27:55.888 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:55.884+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:55.970 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:55.971 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:55.982 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:27:55.988 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:55.984+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:55.995 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:27:56.088 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:56.084+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:56.101 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:56.101 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:56.115 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:27:56.189 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:56.186+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:27:56.228 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:56.228 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:56.238 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:27:56.289 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:56.284+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:56.384 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:56.386 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:27:56.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:27:56.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:27:56.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:27:56.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:27:56.387 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:27:56.388 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:27:56.388 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:27:56.401 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:56.386+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:56.410 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:56.411 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:56.420 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:27:56.494 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:56.488+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:56.561 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 70 16 60662 60646 6.76784 5.51562 0.0180175 0.018454 2020-11-12T17:27:56.592 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:56.590+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:56.594 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:56.594 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:56.606 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:27:56.693 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:56.690+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:56.778 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:56.778 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:56.790 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:27:56.799 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:56.792+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:56.895 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:56.894+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:56.967 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:56.968 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:56.980 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:27:57.030 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:57.024+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:57.102 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:57.096+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:57.136 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:57.137 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:57.151 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:27:57.238 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:57.236+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:57.301 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:57.296+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:57.368 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:57.368 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:57.369 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:27:57.403 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:57.398+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:57.501 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1, 0] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:27:57.502 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:27:57.502 INFO:tasks.thrashosds.thrasher:inject_pause on 6 2020-11-12T17:27:57.502 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-12T17:27:57.502 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-12T17:27:57.503 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2020-11-12T17:27:57.507 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:57.504+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:57.563 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 71 16 61353 61337 6.74838 5.39844 0.0153697 0.0185114 2020-11-12T17:27:57.608 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:57.606+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:57.615 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:57.616 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:57.631 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:27:57.643 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:27:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: "success": "" 2020-11-12T17:27:57.644 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:27:57.720 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:57.716+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:57.810 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:57.808+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:57.832 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:57.833 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:57.846 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:27:57.918 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:57.914+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:58.013 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:27:58.018 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:27:58.012+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:27:58.043 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:58.043 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:58.058 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:27:58.118 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:58.114+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:58.220 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:58.216+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:58.272 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:58.327 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:58.329 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:27:58.330 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:27:58.326+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:27:58.402 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:27:58.459 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:58.456+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:58.504 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:27:58.504 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:27:58.517 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:27:58.559 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:58.556+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:58.582 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 72 16 62006 61990 6.72551 5.10156 0.0123422 0.0185637 2020-11-12T17:27:58.596 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:27:58.633 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:58.628+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:58.635 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:27:58.691 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:58.701 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:58.702 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:58.702 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:58.702 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:58.715 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:27:58.730 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:27:58.763 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:27:58.763 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:27:58.760+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:27:58.817 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:27:58.835 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:27:58.834+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:27:58.839 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:27:58.871 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:58.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:27:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 293.76008225099997, 2020-11-12T17:27:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:27:58.888 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:27:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.889 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:27:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:27:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:58.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:27:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:27:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:27:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:27:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:58.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:58.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:27:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:27:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:27:58.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:27:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:27:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:27:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:27:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:27:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:58.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:27:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:27:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:27:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:27:58.907 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:27:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:58.908 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 293.75299045499997, 2020-11-12T17:27:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:27:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:58.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:58.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:27:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:27:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:27:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:58.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:27:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:27:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:27:58.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:27:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:27:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:27:58.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:27:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:27:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:27:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:27:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:58.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:27:58.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:27:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.921 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:58.922 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 284.32043095799997, 2020-11-12T17:27:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:27:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:58.923 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:27:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:27:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:27:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:58.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:27:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:27:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:27:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:27:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:27:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:27:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:27:58.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:27:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:27:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:27:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:27:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:27:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:58.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:27:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:27:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:27:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:27:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:58.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:27:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:27:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:27:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:27:58.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:27:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 250.370310864, 2020-11-12T17:27:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:27:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:58.945 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:27:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:27:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:27:58.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:27:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:27:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:27:58.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:27:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:27:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:27:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:27:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:27:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:27:58.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:27:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 248.26470897199999, 2020-11-12T17:27:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:27:58.953 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:27:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:27:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:27:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:27:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:27:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:27:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:27:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:27:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:27:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:27:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:27:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:27:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:27:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:27:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:27:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:27:58.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:58.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:27:58.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:27:58.960 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.960 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:58.961 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.961 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:27:58.961 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:58.961 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 216.918225638, 2020-11-12T17:27:58.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:27:58.961 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:58.962 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:58.962 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:58.962 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:58.962 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:58.962 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:27:58.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.962 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:58.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:27:58.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:58.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:27:58.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:27:58.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:58.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:27:58.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:27:58.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:58.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:27:58.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:27:58.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:58.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:27:58.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:27:58.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:58.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:27:58.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:27:58.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:27:58.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:27:58.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:27:58.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:58.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:27:58.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:27:58.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:58.972 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 207.92238383599999, 2020-11-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:27:58.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:27:58.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:58.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:27:58.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:27:58.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:58.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:27:59.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:27:59.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:27:59.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:27:59.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:27:59.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:27:59.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:27:59.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:27:59.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:27:59.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:27:59.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.004 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.004 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:27:59.005 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:59.005 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 203.98728043700001, 2020-11-12T17:27:59.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:27:59.005 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.005 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:27:59.005 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:59.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:27:59.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:27:59.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:27:59.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:27:59.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:27:59.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:27:59.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:27:59.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:27:59.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:27:59.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:27:59.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:27:59.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:27:59.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.011 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 173.22263994599999, 2020-11-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:27:59.012 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:27:59.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:27:59.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:27:59.019 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:59.020 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 166.966131262, 2020-11-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:59.021 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:27:59.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:59.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:27:59.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.049 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:27:59.050 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:59.051 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 166.96596889200001, 2020-11-12T17:27:59.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:27:59.052 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.052 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:59.052 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:59.052 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:59.052 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:59.052 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:27:59.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.053 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:59.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:27:59.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:27:59.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:27:59.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:27:59.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:27:59.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:27:59.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:27:59.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:27:59.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:59.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:27:59.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:27:59.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:59.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:27:59.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:27:59.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:59.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:27:59.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:27:59.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:59.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:27:59.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:27:59.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:27:59.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:27:59.072 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.072 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.072 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.072 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:27:59.073 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:59.073 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 166.95739990499999, 2020-11-12T17:27:59.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:27:59.073 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.073 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:59.073 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:59.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:27:59.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:27:59.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:27:59.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:27:59.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:27:59.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:27:59.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:27:59.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:27:59.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:27:59.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:27:59.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:27:59.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:27:59.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:27:59.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:27:59.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:27:59.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:27:59.080 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.080 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.080 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.081 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:27:59.081 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:59.081 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 140.96733916900001, 2020-11-12T17:27:59.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:27:59.081 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.081 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:59.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:59.082 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:59.082 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:59.082 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:27:59.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.085 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:59.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:27:59.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:27:59.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:27:59.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:27:59.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:27:59.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:27:59.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:27:59.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:27:59.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:27:59.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:27:59.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:27:59.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:27:59.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:27:59.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:27:59.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:59.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:27:59.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:27:59.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:59.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:27:59.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:27:59.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:59.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:27:59.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:27:59.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:59.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:27:59.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:27:59.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:27:59.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:27:59.096 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.097 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.097 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.098 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:27:59.098 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:59.098 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.89402073700001, 2020-11-12T17:27:59.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:27:59.098 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.099 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:59.099 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:59.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:27:59.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:59.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:27:59.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:27:59.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:27:59.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:27:59.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:27:59.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:27:59.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:27:59.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:27:59.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:27:59.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:27:59.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:27:59.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:27:59.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:27:59.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:27:59.107 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.107 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.107 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.108 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:59.108 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:59.108 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 136.83837576100001, 2020-11-12T17:27:59.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:27:59.109 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.109 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:59.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:59.110 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:59.110 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:59.110 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:27:59.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.111 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:59.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:27:59.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:27:59.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:27:59.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:27:59.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:27:59.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:27:59.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:27:59.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:27:59.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:27:59.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:27:59.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:27:59.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:27:59.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:27:59.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:27:59.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:59.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:27:59.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:27:59.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:59.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:27:59.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:27:59.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:59.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:27:59.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:27:59.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:59.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:27:59.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:27:59.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:27:59.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:27:59.126 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.127 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.127 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:27:59.127 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:59.127 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 136.45017139000001, 2020-11-12T17:27:59.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:27:59.128 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.129 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:59.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:59.130 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:59.130 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:59.130 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:27:59.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.130 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:59.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:27:59.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:27:59.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:27:59.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:27:59.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:27:59.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:59.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:27:59.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:27:59.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:59.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:27:59.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:27:59.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:59.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:27:59.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:27:59.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:59.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:27:59.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:27:59.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:27:59.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:27:59.334 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.334 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.334 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.335 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:27:59.335 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:59.335 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 122.243714458, 2020-11-12T17:27:59.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:27:59.336 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.336 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:59.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:59.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:59.336 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:59.336 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:27:59.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.337 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:59.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:27:59.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:59.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:27:59.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:27:59.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:27:59.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:27:59.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:27:59.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:27:59.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:27:59.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:27:59.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:27:59.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:27:59.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:27:59.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:27:59.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:59.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:27:59.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:27:59.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:59.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:27:59.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:27:59.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:59.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:27:59.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:27:59.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:59.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:27:59.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:27:59.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:27:59.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:27:59.346 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.346 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.346 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.347 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:27:59.347 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:59.347 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.994508841, 2020-11-12T17:27:59.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:27:59.348 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.348 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:59.348 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:59.348 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:27:59.348 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:27:59.348 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:27:59.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.348 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:59.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:27:59.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:27:59.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:27:59.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:27:59.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:27:59.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:27:59.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:27:59.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:27:59.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:27:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:27:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:27:59.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:27:59.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:27:59.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:27:59.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:27:59.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:27:59.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:27:59.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:59.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:27:59.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:27:59.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:59.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:27:59.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:27:59.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:59.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:27:59.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:27:59.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:27:59.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:27:59.360 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.360 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.360 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.361 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:27:59.361 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:59.361 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 120.977549392, 2020-11-12T17:27:59.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:27:59.361 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.362 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:59.362 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:59.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:27:59.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:27:59.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:27:59.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:27:59.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:27:59.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:27:59.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:27:59.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:27:59.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:27:59.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:27:59.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:27:59.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:27:59.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:27:59.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:27:59.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:27:59.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:27:59.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.371 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.372 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.372 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(5.2 168/167 [PushOp(5:41867905:::benchmark_data_smithi036_24110_object139:head, version: 130'104, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:41867905:::benchmark_data_smithi036_24110_object139:head@130'104, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:27:59.372 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.025380+0000", 2020-11-12T17:27:59.373 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.8435795119999998, 2020-11-12T17:27:59.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36060000800000003, 2020-11-12T17:27:59.373 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.373 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:59.374 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025380+0000", 2020-11-12T17:27:59.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025380+0000", 2020-11-12T17:27:59.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:27:59.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025355+0000", 2020-11-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8812000000000002e-05 2020-11-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025454+0000", 2020-11-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35809733300000002 2020-11-12T17:27:59.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383551+0000", 2020-11-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:27:59.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383559+0000", 2020-11-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1902000000000004e-05 2020-11-12T17:27:59.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383631+0000", 2020-11-12T17:27:59.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3990000000000004e-06 2020-11-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383640+0000", 2020-11-12T17:27:59.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023402269999999998 2020-11-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.385980+0000", 2020-11-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36060000800000003 2020-11-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.384 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.385 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:59.387 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:59.384+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:59.387 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:27:59.446 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:27:59.456 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:27:59.454+0000 7f928515c700 -1 osd.7 171 handle_osd_map injecting map crc failure 2020-11-12T17:27:59.506 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:27:59.504+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:27:59.564 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 73 16 62694 62678 6.707 5.375 0.0239378 0.0186227 2020-11-12T17:27:59.589 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:59.586+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:59.599 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:59.600 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:59.600 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:27:59.600 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:59.609 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:27:59.681 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:27:59.683 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:27:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:27:59.685 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:27:59.690 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:27:59.686+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:27:59.791 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:59.788+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:59.792 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:59.792 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:27:59.793 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:27:59.793 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:27:59.793 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:27:59.805 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:27:59.894 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:27:59.892+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:27:59.966 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:27:59.966 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:27:59.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:27:59.966 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:27:59.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.967 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:27:59.967 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:59.967 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 285.54540754700002, 2020-11-12T17:27:59.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:27:59.967 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.967 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:59.968 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:59.968 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:59.968 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:59.968 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:27:59.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.968 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:59.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:27:59.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:27:59.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:27:59.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:27:59.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:27:59.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.980 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 285.53846348500002, 2020-11-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.988 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 249.36462569899999, 2020-11-12T17:27:59.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:27:59.990 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:59.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:27:59.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:27:59.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:27:59.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:27:59.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:27:59.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:27:59.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:27:59.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:27:59.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:27:59.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:27:59.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:27:59.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:27:59.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:27:59.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:27:59.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:27:59.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:27:59.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:27:59.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:27:59.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:27:59.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:27:59.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.001 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 233.10092060599999, 2020-11-12T17:28:00.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.003 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:28:00.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:28:00.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:00.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:28:00.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:28:00.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:28:00.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:28:00.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:28:00.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:28:00.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:28:00.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:28:00.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:28:00.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:28:00.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:28:00.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:28:00.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:00.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:28:00.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:28:00.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:28:00.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:28:00.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:28:00.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:28:00.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:28:00.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:28:00.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:28:00.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:28:00.021 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.022 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.022 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.022 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:28:00.022 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:28:00.022 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 218.01554028000001, 2020-11-12T17:28:00.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:28:00.023 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.023 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.023 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:28:00.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:28:00.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:00.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:28:00.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:28:00.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:28:00.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:28:00.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:28:00.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:28:00.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:28:00.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:28:00.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:28:00.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:28:00.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:28:00.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:28:00.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:28:00.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:28:00.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:28:00.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:28:00.030 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.030 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.031 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.031 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:28:00.031 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:28:00.032 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 216.321402006, 2020-11-12T17:28:00.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:28:00.032 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.032 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.032 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.033 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:00.033 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:00.033 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:28:00.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.033 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:28:00.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:28:00.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:28:00.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:28:00.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:28:00.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:28:00.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:28:00.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:28:00.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:28:00.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:28:00.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:28:00.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:28:00.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:28:00.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:28:00.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:28:00.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:00.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:28:00.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:28:00.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:28:00.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:28:00.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:28:00.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:28:00.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:28:00.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:28:00.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:28:00.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:28:00.045 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.045 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.045 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.045 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:28:00.045 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:28:00.046 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 158.65216328400001, 2020-11-12T17:28:00.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:28:00.046 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.046 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.046 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.046 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:00.046 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:00.047 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:28:00.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.047 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:28:00.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:28:00.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:00.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:28:00.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:28:00.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:28:00.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:28:00.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:28:00.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:28:00.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:28:00.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:28:00.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:28:00.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:28:00.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:28:00.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:28:00.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:28:00.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:28:00.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:28:00.056 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.056 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.056 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.057 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:30608 4.0 e83/69 ondisk, result = 0)", 2020-11-12T17:28:00.057 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:28:00.057 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 158.63898652500001, 2020-11-12T17:28:00.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001, 2020-11-12T17:28:00.057 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.058 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:00.058 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:28:00.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324909+0000", 2020-11-12T17:28:00.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:28:00.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324889+0000", 2020-11-12T17:28:00.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2550999999999999e-05 2020-11-12T17:28:00.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.324941+0000", 2020-11-12T17:28:00.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35224479800000003 2020-11-12T17:28:00.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677186+0000", 2020-11-12T17:28:00.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0446e-05 2020-11-12T17:28:00.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677196+0000", 2020-11-12T17:28:00.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013785499999999999 2020-11-12T17:28:00.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677334+0000", 2020-11-12T17:28:00.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9548000000000002e-05 2020-11-12T17:28:00.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677374+0000", 2020-11-12T17:28:00.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022063200000000001 2020-11-12T17:28:00.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677594+0000", 2020-11-12T17:28:00.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35268507500000001 2020-11-12T17:28:00.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.065 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.065 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:28:00.065 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:28:00.066 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 154.08490507600001, 2020-11-12T17:28:00.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:28:00.066 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.066 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.066 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.066 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:00.066 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:00.067 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:28:00.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.067 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:28:00.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:28:00.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:28:00.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:28:00.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:28:00.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:28:00.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:28:00.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:28:00.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:28:00.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:28:00.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:28:00.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:28:00.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:28:00.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:28:00.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:28:00.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:00.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:28:00.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:28:00.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:28:00.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:28:00.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:28:00.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:28:00.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:28:00.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:28:00.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:28:00.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:28:00.078 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.079 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.079 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.079 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:28:00.079 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:28:00.079 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 148.057990456, 2020-11-12T17:28:00.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:28:00.080 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.080 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:00.080 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:00.080 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:28:00.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.081 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:28:00.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:28:00.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:28:00.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:28:00.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:28:00.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:28:00.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:28:00.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:28:00.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:28:00.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:28:00.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:28:00.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:28:00.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:28:00.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:28:00.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:28:00.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:00.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:28:00.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:28:00.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:28:00.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:28:00.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:28:00.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:28:00.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:28:00.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:28:00.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:28:00.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:28:00.090 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.090 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.091 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.091 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:28:00.091 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:28:00.091 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.25555155800001, 2020-11-12T17:28:00.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:28:00.092 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.093 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.094 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.094 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:00.094 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:00.094 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:28:00.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.095 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:28:00.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:28:00.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:00.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:28:00.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:28:00.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:28:00.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:28:00.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:28:00.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:28:00.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:28:00.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:28:00.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:28:00.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:28:00.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:28:00.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:28:00.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:00.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:28:00.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:28:00.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:28:00.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:28:00.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:28:00.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:28:00.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:28:00.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:28:00.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:28:00.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:28:00.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.111 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.112 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:28:00.112 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:28:00.112 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.17642924099999, 2020-11-12T17:28:00.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:28:00.112 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.112 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.112 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:28:00.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:28:00.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:28:00.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:28:00.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:28:00.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:28:00.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:28:00.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.137 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:28:00.138 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 118.39407827399999, 2020-11-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.139 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:28:00.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:28:00.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:28:00.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:28:00.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:28:00.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:28:00.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:28:00.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:28:00.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:28:00.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:28:00.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:28:00.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:28:00.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:28:00.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:28:00.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:28:00.157 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.158 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.158 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.158 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:28:00.158 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:28:00.158 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 102.931035925, 2020-11-12T17:28:00.159 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:28:00.159 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.159 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:00.159 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:00.160 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:28:00.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.160 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:28:00.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:28:00.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:28:00.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:28:00.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:28:00.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:28:00.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:28:00.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:28:00.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:28:00.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:28:00.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:28:00.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:28:00.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:28:00.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.165 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:28:00.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:28:00.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:00.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:28:00.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:28:00.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:28:00.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:28:00.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:28:00.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:28:00.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:28:00.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:28:00.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:28:00.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:28:00.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.169 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.169 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.169 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:28:00.169 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:28:00.169 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.909276773999999, 2020-11-12T17:28:00.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:28:00.170 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.170 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.171 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:00.171 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:00.171 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:28:00.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.171 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:28:00.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:28:00.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:00.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:28:00.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:28:00.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:28:00.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:28:00.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:28:00.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:28:00.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:28:00.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:28:00.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:28:00.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:28:00.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:28:00.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:28:00.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:00.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:28:00.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:28:00.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:28:00.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:28:00.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:28:00.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:28:00.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:28:00.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:28:00.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:28:00.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:28:00.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.181 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:28:00.181 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:28:00.181 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 35.847917103999997, 2020-11-12T17:28:00.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:28:00.181 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.181 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.181 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.182 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:00.182 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:00.183 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:28:00.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.183 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.183 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.183 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:28:00.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:28:00.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:28:00.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:28:00.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:28:00.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:28:00.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:28:00.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:28:00.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:28:00.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:28:00.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:28:00.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:28:00.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:28:00.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:28:00.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:28:00.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:00.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:28:00.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:28:00.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:28:00.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:28:00.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:28:00.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:28:00.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:28:00.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:28:00.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:28:00.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:28:00.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.199 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.200 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36416 5.0 5:05125f34:::benchmark_data_smithi036_24110_object4551:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:28:00.200 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:28:00.200 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.990189078999997, 2020-11-12T17:28:00.200 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002, 2020-11-12T17:28:00.200 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.201 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.201 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.201 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:00.201 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:00.201 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36416 2020-11-12T17:28:00.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.201 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973666+0000", 2020-11-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117633 2020-11-12T17:28:00.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973783+0000", 2020-11-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6325999999999999e-05 2020-11-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973800+0000", 2020-11-12T17:28:00.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:28:00.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973807+0000", 2020-11-12T17:28:00.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054509620000000002 2020-11-12T17:28:00.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979258+0000", 2020-11-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1768999999999996e-05 2020-11-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979340+0000", 2020-11-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107278 2020-11-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979447+0000", 2020-11-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005025753 2020-11-12T17:28:00.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.984473+0000", 2020-11-12T17:28:00.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35634463199999999 2020-11-12T17:28:00.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340818+0000", 2020-11-12T17:28:00.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3640000000000001e-05 2020-11-12T17:28:00.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340871+0000", 2020-11-12T17:28:00.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2222999999999998e-05 2020-11-12T17:28:00.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340924+0000", 2020-11-12T17:28:00.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002 2020-11-12T17:28:00.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.210 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.211 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.211 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:59192 5.0 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e168)", 2020-11-12T17:28:00.211 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:28:00.211 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 6.1612183119999999, 2020-11-12T17:28:00.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003, 2020-11-12T17:28:00.212 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.212 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:00.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:00.213 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:00.213 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 59192 2020-11-12T17:28:00.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.213 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:28:00.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:28:00.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:00.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802660+0000", 2020-11-12T17:28:00.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9094000000000001e-05 2020-11-12T17:28:00.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802709+0000", 2020-11-12T17:28:00.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9580000000000004e-06 2020-11-12T17:28:00.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802715+0000", 2020-11-12T17:28:00.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0690000000000002e-06 2020-11-12T17:28:00.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802719+0000", 2020-11-12T17:28:00.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010962786 2020-11-12T17:28:00.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813681+0000", 2020-11-12T17:28:00.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011702 2020-11-12T17:28:00.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813798+0000", 2020-11-12T17:28:00.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187436 2020-11-12T17:28:00.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:00.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813986+0000", 2020-11-12T17:28:00.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020009369999999999 2020-11-12T17:28:00.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:00.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.815987+0000", 2020-11-12T17:28:00.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46767350899999999 2020-11-12T17:28:00.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283660+0000", 2020-11-12T17:28:00.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3396e-05 2020-11-12T17:28:00.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283734+0000", 2020-11-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0195999999999998e-05 2020-11-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283784+0000", 2020-11-12T17:28:00.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003 2020-11-12T17:28:00.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.222 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.222 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59360 5.1 e169/127 5:8e053221:::benchmark_data_smithi036_24110_object7419:head v 169'3752, mlcod=169'3747)", 2020-11-12T17:28:00.223 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:28:00.223 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.2627310410000003, 2020-11-12T17:28:00.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999, 2020-11-12T17:28:00.223 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.223 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.223 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:28:00.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701143+0000", 2020-11-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4913000000000006e-05 2020-11-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701218+0000", 2020-11-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45075755000000001 2020-11-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151975+0000", 2020-11-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7439999999999996e-06 2020-11-12T17:28:00.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151984+0000", 2020-11-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5661000000000001e-05 2020-11-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152040+0000", 2020-11-12T17:28:00.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0267e-05 2020-11-12T17:28:00.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152070+0000", 2020-11-12T17:28:00.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027662300000000002 2020-11-12T17:28:00.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154836+0000", 2020-11-12T17:28:00.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0707e-05 2020-11-12T17:28:00.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154897+0000", 2020-11-12T17:28:00.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999 2020-11-12T17:28:00.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.230 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.230 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:62424 5.1 e171/127 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head v 171'3992, mlcod=171'3984)", 2020-11-12T17:28:00.231 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:28:00.231 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.76497040400000005, 2020-11-12T17:28:00.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437, 2020-11-12T17:28:00.231 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:00.231 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.231 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:00.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:00.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:28:00.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:00.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:00.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:28:00.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198896+0000", 2020-11-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9000999999999997e-05 2020-11-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198985+0000", 2020-11-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48058147200000001 2020-11-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679566+0000", 2020-11-12T17:28:00.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9140000000000003e-06 2020-11-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679576+0000", 2020-11-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1407000000000003e-05 2020-11-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679647+0000", 2020-11-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1270999999999999e-05 2020-11-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679679+0000", 2020-11-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002926648 2020-11-12T17:28:00.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682605+0000", 2020-11-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1626999999999998e-05 2020-11-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:00.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682667+0000", 2020-11-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437 2020-11-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:00.238 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:00.239 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:00.240 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:00.032+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:00.241 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:00.238+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:00.343 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:00.338+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:00.350 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:00.351 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:00.351 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:28:00.351 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:00.361 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:00.449 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:00.446+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:00.525 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:00.540 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:00.541 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:00.542 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:00.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 74 15 62878 62863 6.6359 1.44531 0.0194499 0.0188292 2020-11-12T17:28:00.583 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:00.582+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:00.649 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:00.646+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:00.708 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:00.708 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:00.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:00.709 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:00.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.710 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:28:00.710 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:28:00.711 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 290.01984617099998, 2020-11-12T17:28:00.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:28:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.712 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:00.713 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:28:00.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:28:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:00.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:00.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:28:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:28:00.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:28:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:28:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:28:00.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:00.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:28:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:28:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:28:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:28:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:28:00.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:28:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:00.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:28:00.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:28:00.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:00.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:28:00.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:28:00.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:00.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:28:00.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:28:00.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:28:00.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:28:00.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:00.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:28:00.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:28:00.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:00.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:28:00.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:28:00.738 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.738 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:00.738 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:28:00.739 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:28:00.740 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 290.014366102, 2020-11-12T17:28:00.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:28:00.740 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:00.741 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:00.741 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:00.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:00.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:28:00.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:00.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:00.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:28:00.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:00.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:00.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:28:00.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:28:00.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:00.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:28:00.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:28:00.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:00.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:28:00.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:28:00.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:00.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:00.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:28:00.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:28:00.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:00.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:28:00.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:28:00.753 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.753 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:00.753 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.754 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:28:00.754 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:28:00.754 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 281.824244502, 2020-11-12T17:28:00.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:28:00.754 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:00.755 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:00.755 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:00.755 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:00.755 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:00.755 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:28:00.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.755 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:00.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:00.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:28:00.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:00.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:00.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:28:00.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:28:00.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:00.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:28:00.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:28:00.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:00.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:28:00.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:28:00.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:28:00.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:00.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:28:00.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:28:00.765 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:00.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 281.81700079299998, 2020-11-12T17:28:00.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:28:00.768 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:00.768 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:00.768 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:00.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:00.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:28:00.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:00.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:00.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:28:00.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:28:00.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:00.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:28:00.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:28:00.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:00.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:28:00.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:28:00.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:00.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:28:00.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:28:00.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:28:00.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:28:00.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:00.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:28:00.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:28:00.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:00.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:28:00.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:28:00.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:00.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:28:00.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:28:00.775 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.775 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:00.775 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.776 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:28:00.776 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:28:00.776 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 205.820911419, 2020-11-12T17:28:00.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:28:00.776 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:00.777 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:00.777 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:00.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:00.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:28:00.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:28:00.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:00.784 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:28:00.785 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 139.69338890700001, 2020-11-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:00.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:28:00.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:28:00.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:00.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:28:00.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:28:00.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:00.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:28:00.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:28:00.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:00.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:28:00.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:28:00.793 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:28:00.794 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.64264146599999, 2020-11-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:28:01.038 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:28:01.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:28:01.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:28:01.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:28:01.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:28:01.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:28:01.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:28:01.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:28:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:28:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:28:01.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:28:01.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:28:01.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:28:01.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:01.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:28:01.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:28:01.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:28:01.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:28:01.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:28:01.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:28:01.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:28:01.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:28:01.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:28:01.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:28:01.050 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.050 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.050 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.052 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:28:01.052 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:28:01.052 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.642553271, 2020-11-12T17:28:01.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:28:01.052 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.052 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.053 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.053 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:01.053 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:01.053 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:28:01.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.054 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:28:01.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:28:01.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:01.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:28:01.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:28:01.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53719 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.623924966, 2020-11-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998, 2020-11-12T17:28:01.065 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:28:01.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082634+0000", 2020-11-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:28:01.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082600+0000", 2020-11-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3908999999999999e-05 2020-11-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082684+0000", 2020-11-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41158298199999999 2020-11-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494267+0000", 2020-11-12T17:28:01.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3980000000000001e-06 2020-11-12T17:28:01.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494271+0000", 2020-11-12T17:28:01.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012987099999999999 2020-11-12T17:28:01.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494401+0000", 2020-11-12T17:28:01.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1606999999999999e-05 2020-11-12T17:28:01.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494413+0000", 2020-11-12T17:28:01.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016532499999999999 2020-11-12T17:28:01.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494578+0000", 2020-11-12T17:28:01.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41194420999999998 2020-11-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:28:01.073 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.62384023800001, 2020-11-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:28:01.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:28:01.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:28:01.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:28:01.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:28:01.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:28:01.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:28:01.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:28:01.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:28:01.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:28:01.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:28:01.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:28:01.081 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.081 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.081 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.081 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:01.082 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:28:01.082 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 99.873017786999995, 2020-11-12T17:28:01.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:28:01.082 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.082 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.082 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:28:01.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:28:01.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:28:01.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:28:01.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:01.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:28:01.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:28:01.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:28:01.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:28:01.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:28:01.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:28:01.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:28:01.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:28:01.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:28:01.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:28:01.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.093 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.093 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:01.094 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:28:01.094 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 98.786362299000004, 2020-11-12T17:28:01.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:28:01.095 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.095 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.095 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.096 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:01.096 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:01.096 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:28:01.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.096 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:28:01.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:28:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:28:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:28:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:28:01.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:28:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:28:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:28:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:28:01.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:28:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:28:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:28:01.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:28:01.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:28:01.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:28:01.158 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.158 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.158 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.158 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:28:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:28:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 98.772881072000004, 2020-11-12T17:28:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:28:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:28:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:28:01.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:28:01.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:28:01.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:28:01.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.770592870000002, 2020-11-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:28:01.199 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.200 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:28:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.201 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:28:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:28:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:28:01.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:28:01.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:28:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:28:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:28:01.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:28:01.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:28:01.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:28:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:28:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:28:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:28:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:28:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:28:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:28:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.764776286, 2020-11-12T17:28:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:28:01.215 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:01.216 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:28:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:28:01.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:28:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:28:01.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:28:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:28:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:28:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:28:01.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:28:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:28:01.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:28:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:28:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:28:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:28:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:28:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:28:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:28:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:28:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:28:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:28:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:28:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:28:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:28:01.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:28:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:28:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:28:01.229 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.230 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:28:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:28:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.741842771999998, 2020-11-12T17:28:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:28:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.231 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:28:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:28:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:28:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:28:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:28:01.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:28:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:28:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:28:01.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:28:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:28:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:28:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:28:01.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:28:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:28:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:28:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:28:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:28:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:28:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:28:01.242 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:28:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 57.209364745000002, 2020-11-12T17:28:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:28:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.243 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:28:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:28:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:28:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:28:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:28:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:28:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:28:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:28:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:28:01.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:28:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:28:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:28:01.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:28:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:28:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:28:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:28:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:28:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:28:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.252 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e169)", 2020-11-12T17:28:01.256 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:28:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.0146587050000004, 2020-11-12T17:28:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002, 2020-11-12T17:28:01.257 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.258 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:28:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:28:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:28:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:28:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691863+0000", 2020-11-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103144 2020-11-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691966+0000", 2020-11-12T17:28:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8453000000000001e-05 2020-11-12T17:28:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691985+0000", 2020-11-12T17:28:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0385e-05 2020-11-12T17:28:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691995+0000", 2020-11-12T17:28:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0098187989999999996 2020-11-12T17:28:01.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701814+0000", 2020-11-12T17:28:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000135065 2020-11-12T17:28:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701949+0000", 2020-11-12T17:28:01.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025538399999999999 2020-11-12T17:28:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.702205+0000", 2020-11-12T17:28:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034246620000000002 2020-11-12T17:28:01.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.705629+0000", 2020-11-12T17:28:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.450897995 2020-11-12T17:28:01.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156527+0000", 2020-11-12T17:28:01.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2074000000000001e-05 2020-11-12T17:28:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156599+0000", 2020-11-12T17:28:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1148000000000002e-05 2020-11-12T17:28:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156690+0000", 2020-11-12T17:28:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002 2020-11-12T17:28:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.272 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.287 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e169)", 2020-11-12T17:28:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:28:01.288 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 5.9930400910000001, 2020-11-12T17:28:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003, 2020-11-12T17:28:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:01.289 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:28:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.290 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:28:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713485+0000", 2020-11-12T17:28:01.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7021000000000005e-05 2020-11-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713582+0000", 2020-11-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2103000000000001e-05 2020-11-12T17:28:01.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713595+0000", 2020-11-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0129999999999999e-06 2020-11-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713601+0000", 2020-11-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001321727 2020-11-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.714922+0000", 2020-11-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011930300000000001 2020-11-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:01.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.715042+0000", 2020-11-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44158781200000002 2020-11-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156629+0000", 2020-11-12T17:28:01.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003 2020-11-12T17:28:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.300 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62424 5.1 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e171)", 2020-11-12T17:28:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:28:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 1.5111079970000001, 2020-11-12T17:28:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456, 2020-11-12T17:28:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.301 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62424 2020-11-12T17:28:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:28:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:28:01.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999809 2020-11-12T17:28:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195432+0000", 2020-11-12T17:28:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1144999999999999e-05 2020-11-12T17:28:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195483+0000", 2020-11-12T17:28:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2553e-05 2020-11-12T17:28:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195496+0000", 2020-11-12T17:28:01.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0469999999999996e-06 2020-11-12T17:28:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195503+0000", 2020-11-12T17:28:01.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041025339999999997 2020-11-12T17:28:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199605+0000", 2020-11-12T17:28:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114968 2020-11-12T17:28:01.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199720+0000", 2020-11-12T17:28:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020953000000000001 2020-11-12T17:28:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199930+0000", 2020-11-12T17:28:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043700170000000003 2020-11-12T17:28:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.204300+0000", 2020-11-12T17:28:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.480176663 2020-11-12T17:28:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684477+0000", 2020-11-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017691000000000001 2020-11-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684653+0000", 2020-11-12T17:28:01.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107935 2020-11-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684761+0000", 2020-11-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456 2020-11-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.315 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.316 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:01.317 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:01.318 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:01.314+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:01.419 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:01.418+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:01.464 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:01.460+0000 7f4dea6fe700 -1 osd.1 173 handle_osd_map injecting map crc failure 2020-11-12T17:28:01.474 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:28:01.480 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:01.490 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:01.520 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:01.516+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:01.563 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 75 16 63562 63546 6.61856 5.33594 0.0149465 0.0188697 2020-11-12T17:28:01.620 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:01.616+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:01.664 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:01.665 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:01.665 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:01.665 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:01.665 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:01.666 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:01.699 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:01.721 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:01.718+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:01.783 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:01.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:01.821 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:01.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.821 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:01.821 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:28:01.821 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 287.25672952999997, 2020-11-12T17:28:01.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:28:01.822 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.822 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.822 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.822 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:01.822 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:28:01.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:28:01.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:01.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:28:01.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:28:01.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:28:01.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:28:01.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:28:01.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:28:01.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:28:01.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:28:01.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:28:01.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:28:01.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:28:01.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:28:01.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:01.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:28:01.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:28:01.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:28:01.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:28:01.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:28:01.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:28:01.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:28:01.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:28:01.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:28:01.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:28:01.833 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.834 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.834 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.834 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:28:01.834 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:01.834 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 251.777440149, 2020-11-12T17:28:01.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:28:01.835 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.835 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.835 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:01.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:01.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:01.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:28:01.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:28:01.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:28:01.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:28:01.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:28:01.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:28:01.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:28:01.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:28:01.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:28:01.842 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.842 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.842 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.842 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:28:01.843 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:01.843 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 219.83745480600001, 2020-11-12T17:28:01.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:28:01.843 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.843 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.843 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.843 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:01.843 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:01.844 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:28:01.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.844 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:01.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:01.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:28:01.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:28:01.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:28:01.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:28:01.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:28:01.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:28:01.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:01.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:28:01.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:28:01.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:28:01.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:28:01.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:28:01.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.855 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 208.36035373199999, 2020-11-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:01.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:28:01.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:28:01.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:28:01.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:28:01.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:28:01.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:28:01.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:28:01.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:28:01.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:28:01.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:28:01.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:28:01.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:28:01.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:28:01.862 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.862 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.862 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.862 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:28:01.862 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:01.863 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 207.24134334499999, 2020-11-12T17:28:01.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:28:01.863 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.863 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:01.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:01.863 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:01.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.864 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:01.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:28:01.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:01.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:28:01.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.892 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 207.22520534099999, 2020-11-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:28:01.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:28:01.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:28:01.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:28:01.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:28:01.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:28:01.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:28:01.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:28:01.900 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.900 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.900 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.901 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:28:01.901 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:01.902 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 207.22047766200001, 2020-11-12T17:28:01.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:28:01.902 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.902 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:01.902 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.902 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:01.902 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:01.903 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:01.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.903 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:01.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:01.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:01.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:28:01.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:28:01.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:28:01.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:28:01.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:28:01.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:01.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:28:01.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.909 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.176715763, 2020-11-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.910 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:01.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:28:01.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:28:01.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:28:01.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:28:01.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:28:01.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:28:01.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:28:01.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:28:01.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:28:01.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:28:01.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:01.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:28:01.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:28:01.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:01.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:28:01.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:28:01.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:01.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:28:01.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:28:01.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:01.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:28:01.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:28:01.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:01.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:28:01.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:28:01.920 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.921 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:01.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:01.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.921 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:01.922 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:01.922 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.17482215, 2020-11-12T17:28:01.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:28:01.922 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:01.922 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:01.922 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:01.922 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:01.923 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:01.923 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:28:01.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.923 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:01.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:01.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:01.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:01.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:01.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:01.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:01.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:01.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:28:01.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:28:01.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:01.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:28:01.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:28:01.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:01.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:28:01.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:28:01.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:01.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:28:01.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:28:01.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:01.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:28:01.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:28:01.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:01.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:01.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:28:01.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:28:01.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:01.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:02.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:28:02.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:28:02.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:02.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:28:02.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:28:02.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:02.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:28:02.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:28:02.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:02.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:28:02.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:28:02.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:28:02.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:28:02.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.085 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.085 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:02.085 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:02.086 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.17406950199999, 2020-11-12T17:28:02.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:28:02.086 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.086 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:02.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:02.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:02.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:02.087 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:28:02.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.087 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:02.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:02.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:02.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:28:02.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:28:02.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:28:02.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:28:02.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:28:02.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:28:02.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:28:02.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:28:02.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:28:02.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:02.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:28:02.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:28:02.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:02.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:28:02.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:28:02.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:28:02.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:28:02.097 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.098 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.098 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.098 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:02.099 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:02.099 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.170907985, 2020-11-12T17:28:02.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:28:02.099 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.099 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:02.100 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:02.100 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:02.100 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:02.100 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:28:02.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.101 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:02.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:02.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:02.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:28:02.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:28:02.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:28:02.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:28:02.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:28:02.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:28:02.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:28:02.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:28:02.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:28:02.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:28:02.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:28:02.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:28:02.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:02.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:28:02.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:28:02.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:02.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:28:02.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:28:02.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:02.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:28:02.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:28:02.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:02.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:28:02.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:28:02.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:28:02.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:28:02.114 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.115 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.115 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.115 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:02.115 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:02.116 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.169826818, 2020-11-12T17:28:02.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:28:02.116 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.116 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:02.116 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:02.116 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:02.117 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:02.117 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:28:02.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.117 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:02.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:02.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:02.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:28:02.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:28:02.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:28:02.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:28:02.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:28:02.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:28:02.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:28:02.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:28:02.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:28:02.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:28:02.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:28:02.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:28:02.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:02.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:28:02.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:28:02.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:02.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:28:02.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:28:02.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:02.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:28:02.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:28:02.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:02.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:28:02.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:28:02.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:28:02.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:28:02.127 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.127 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.128 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.128 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:02.129 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:02.129 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.16965772499999, 2020-11-12T17:28:02.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:28:02.129 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.129 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:02.130 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:02.130 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:02.130 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:02.130 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:28:02.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.130 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:02.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:02.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:02.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:28:02.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:28:02.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:02.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:28:02.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:28:02.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:28:02.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:02.143 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.16703907900001, 2020-11-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:02.144 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:02.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:28:02.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:28:02.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:28:02.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:02.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:28:02.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:28:02.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:02.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:28:02.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:28:02.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:02.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:28:02.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:28:02.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:02.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:28:02.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:28:02.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:28:02.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:28:02.154 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.154 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.154 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.155 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:02.155 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:02.155 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.166930996, 2020-11-12T17:28:02.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:28:02.155 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.155 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:02.155 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:02.156 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:02.156 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:02.156 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:28:02.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.156 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:02.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:02.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:02.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:28:02.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:28:02.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:28:02.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:28:02.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:28:02.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:28:02.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:28:02.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:28:02.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:28:02.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:28:02.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:28:02.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:28:02.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:02.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:28:02.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:28:02.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:02.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:28:02.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:28:02.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:02.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:28:02.165 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:02.166 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.162968314, 2020-11-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:02.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:02.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:28:02.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:28:02.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.174 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.125238572999997, 2020-11-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.176 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:02.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:28:02.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:28:02.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:28:02.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:28:02.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:28:02.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:28:02.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:28:02.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:02.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:28:02.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:28:02.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:28:02.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:28:02.184 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.184 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.184 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.184 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:28:02.184 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:02.185 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 3.6118358879999999, 2020-11-12T17:28:02.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:28:02.185 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.185 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:02.185 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:02.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:02.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:02.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:28:02.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:28:02.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:28:02.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:28:02.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:28:02.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:28:02.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:28:02.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:28:02.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:28:02.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:28:02.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:28:02.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:28:02.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:28:02.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:28:02.243 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.243 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.243 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.275526003, 2020-11-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:02.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:28:02.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:28:02.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:28:02.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:28:02.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:28:02.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:28:02.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:28:02.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:28:02.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:28:02.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:28:02.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:02.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:28:02.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:28:02.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:02.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:28:02.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:28:02.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:02.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:28:02.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:28:02.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:02.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:28:02.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:28:02.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:28:02.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:28:02.254 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.254 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.254 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.254 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:28:02.254 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:02.255 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 2.2579178770000001, 2020-11-12T17:28:02.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:28:02.255 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:02.255 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:02.255 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:02.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:02.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:02.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:02.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:02.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:02.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:02.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:02.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:28:02.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:28:02.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:02.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:28:02.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:28:02.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:02.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:28:02.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:28:02.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:02.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:28:02.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:28:02.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:02.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:28:02.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:28:02.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:02.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:28:02.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:28:02.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.262 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:02.262 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:02.262 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:02.264 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:02.265 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:02.266 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:02.266 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:02.266 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:02.266 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:02.266 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:02.267 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:02.267 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:02.262+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:02.365 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:02.364+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:02.435 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:02.436 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:02.437 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:02.467 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:28:02.671 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1, 0] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:02.671 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:02.672 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-11-12T17:28:02.673 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:02.486+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:02.674 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:02.670+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:02.674 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:02.674 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:02.675 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 76 16 63855 63839 6.56159 2.28906 0.0113363 0.0188853 2020-11-12T17:28:02.676 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:02.774 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:02.772+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:02.937 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:02.937 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:02.938 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:02.938 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:02.934+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:03.011 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:28:03.011 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:03.012 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 175, 2020-11-12T17:28:03.012 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:28:03.012 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2020-11-12T17:22:37.581394+0000", 2020-11-12T17:28:03.012 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2020-11-12T17:28:02.448403+0000", 2020-11-12T17:28:03.014 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2020-11-12T17:25:55.942493+0000", 2020-11-12T17:28:03.016 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2020-11-12T17:27:52.446296+0000", 2020-11-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2020-11-12T17:28:03.017 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2020-11-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2020-11-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2020-11-12T17:28:03.018 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2020-11-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2020-11-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 4, 2020-11-12T17:28:03.019 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2020-11-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-12T17:28:03.020 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2020-11-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 5, 2020-11-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2020-11-12T17:28:03.021 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2020-11-12T17:28:03.022 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2020-11-12T17:28:03.022 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2020-11-12T17:28:03.022 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2020-11-12T17:28:03.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.023 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2020-11-12T17:28:03.023 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2020-11-12T17:28:03.023 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:41.596657+0000", 2020-11-12T17:28:03.024 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:28:03.024 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:28:03.024 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:28:03.025 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:28:03.025 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:28:03.025 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:28:03.026 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:28:03.026 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:28:03.026 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2020-11-12T17:28:03.026 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2020-11-12T17:28:03.027 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2020-11-12T17:28:03.027 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2020-11-12T17:28:03.027 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2020-11-12T17:28:03.028 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:28:03.028 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:28:03.028 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:28:03.028 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:28:03.029 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:28:03.029 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:28:03.029 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:28:03.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.031 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "16", 2020-11-12T17:28:03.032 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:28:03.032 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:28:03.032 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:28:03.033 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:28:03.033 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:28:03.033 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:28:03.033 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:28:03.034 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:28:03.036 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:28:03.037 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:28:03.038 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:28:03.039 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:28:03.040 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:28:03.041 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:28:03.041 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:28:03.041 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:28:03.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:28:03.043 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:28:03.044 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2020-11-12T17:28:03.046 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2020-11-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2020-11-12T17:28:03.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2020-11-12T17:28:03.048 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2020-11-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:49.905816+0000", 2020-11-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:28:03.049 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:28:03.050 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:28:03.050 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:28:03.050 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:28:03.051 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:28:03.051 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:28:03.051 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 18, 2020-11-12T17:28:03.052 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 18, 2020-11-12T17:28:03.054 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 18, 2020-11-12T17:28:03.054 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 18, 2020-11-12T17:28:03.055 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 18, 2020-11-12T17:28:03.055 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:28:03.056 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:28:03.056 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:28:03.057 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:28:03.057 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:28:03.058 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:28:03.058 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:28:03.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.059 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "165", 2020-11-12T17:28:03.059 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:28:03.059 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:28:03.059 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "163", 2020-11-12T17:28:03.060 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:28:03.060 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:28:03.060 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:28:03.060 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:28:03.061 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:28:03.061 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:28:03.061 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:28:03.061 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:28:03.062 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:28:03.062 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:28:03.062 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:28:03.062 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:28:03.063 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:28:03.064 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:28:03.064 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:28:03.065 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.066 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:28:03.067 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2020-11-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.069 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 5, 2020-11-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "unique_pool_2", 2020-11-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:26:43.854598+0000", 2020-11-12T17:28:03.070 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:28:03.071 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:28:03.072 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:28:03.074 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 16, 2020-11-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 16, 2020-11-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 16, 2020-11-12T17:28:03.075 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 16, 2020-11-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 16, 2020-11-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:28:03.076 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:28:03.077 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:28:03.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.079 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "129", 2020-11-12T17:28:03.079 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:28:03.081 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:28:03.081 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:28:03.081 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:28:03.082 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:28:03.082 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:28:03.082 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:28:03.082 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:28:03.083 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:28:03.083 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:28:03.083 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:28:03.084 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:28:03.084 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:28:03.084 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:28:03.084 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:28:03.085 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:28:03.085 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:28:03.085 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:28:03.086 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:28:03.086 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:28:03.086 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:28:03.086 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:28:03.087 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:28:03.087 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:28:03.087 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:28:03.089 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:28:03.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.090 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:28:03.090 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:28:03.090 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:28:03.091 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:28:03.091 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:28:03.091 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:28:03.091 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:28:03.092 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:28:03.092 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:28:03.092 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:28:03.093 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:28:03.093 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:28:03.093 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:28:03.093 INFO:teuthology.orchestra.run.smithi036.stdout: "rados": {} 2020-11-12T17:28:03.094 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.094 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.094 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:03.095 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2020-11-12T17:28:03.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.095 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:28:03.096 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "bd1d5457-5d54-4074-b378-9da417f42976", 2020-11-12T17:28:03.096 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:03.097 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:03.097 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:03.097 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:03.098 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:03.098 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:03.098 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:03.098 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 174, 2020-11-12T17:28:03.099 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:03.099 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:03.099 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:03.126 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.127 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.127 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6801", 2020-11-12T17:28:03.127 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:03.128 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.129 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.129 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2020-11-12T17:28:03.129 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:03.129 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.129 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.130 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:03.130 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2020-11-12T17:28:03.131 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:03.134 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.134 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.135 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:03.135 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.136 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.136 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2020-11-12T17:28:03.137 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:03.137 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.137 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.138 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6801/12304", 2020-11-12T17:28:03.138 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6802/12304", 2020-11-12T17:28:03.138 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6806/12304", 2020-11-12T17:28:03.138 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6804/12304", 2020-11-12T17:28:03.139 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:03.139 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:03.139 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:03.139 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.140 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:28:03.140 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "37152eee-a8d8-40f1-8e27-2899e7b94c98", 2020-11-12T17:28:03.140 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:03.140 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:03.140 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:03.140 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:03.140 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:28:03.141 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 57, 2020-11-12T17:28:03.141 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 88, 2020-11-12T17:28:03.141 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 171, 2020-11-12T17:28:03.141 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 58, 2020-11-12T17:28:03.141 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:03.141 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:03.142 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.142 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.142 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2020-11-12T17:28:03.142 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:03.142 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.143 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.143 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:03.143 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.143 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.143 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2020-11-12T17:28:03.144 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:03.144 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.145 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.146 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:03.146 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.146 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.146 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2020-11-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:03.147 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2020-11-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/20274", 2020-11-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6814/20274", 2020-11-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6816/20274", 2020-11-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6815/20274", 2020-11-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:03.149 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:03.150 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:03.150 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.151 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:28:03.151 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "d8ec2abb-38bf-4863-969a-482c4fa44f41", 2020-11-12T17:28:03.151 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:03.151 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:03.151 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:03.151 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:03.152 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:28:03.152 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 93, 2020-11-12T17:28:03.152 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 102, 2020-11-12T17:28:03.152 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 167, 2020-11-12T17:28:03.152 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 94, 2020-11-12T17:28:03.152 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2020-11-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:03.153 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2020-11-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.156 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:03.156 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.156 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.156 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2020-11-12T17:28:03.156 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:03.157 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.157 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.157 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:03.157 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.157 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.158 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2020-11-12T17:28:03.158 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:03.158 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.158 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.159 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/21493", 2020-11-12T17:28:03.159 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/21493", 2020-11-12T17:28:03.159 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6808/21493", 2020-11-12T17:28:03.159 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/21493", 2020-11-12T17:28:03.159 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:03.159 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:03.159 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:03.160 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.160 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:28:03.160 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "799d3499-577c-4510-a00c-9b2e126fc449", 2020-11-12T17:28:03.160 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:03.161 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:03.161 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:03.161 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:03.161 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:03.164 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:03.164 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:03.164 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:28:03.164 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.165 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2020-11-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:03.166 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2020-11-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.167 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2020-11-12T17:28:03.168 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2020-11-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6809/12305", 2020-11-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6810/12305", 2020-11-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6813/12305", 2020-11-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6811/12305", 2020-11-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:03.171 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:28:03.172 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "c36e3100-aadc-4117-b495-24fb08a34148", 2020-11-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:03.173 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 167, 2020-11-12T17:28:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:03.174 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6804", 2020-11-12T17:28:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.175 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.176 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6805", 2020-11-12T17:28:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6807", 2020-11-12T17:28:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.179 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6806", 2020-11-12T17:28:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6804/12499", 2020-11-12T17:28:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6805/12499", 2020-11-12T17:28:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6807/12499", 2020-11-12T17:28:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6806/12499", 2020-11-12T17:28:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:03.181 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:28:03.182 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "b152141f-b530-448e-8dff-fe200559eff0", 2020-11-12T17:28:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:03.183 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 173, 2020-11-12T17:28:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:03.184 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6808", 2020-11-12T17:28:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.185 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.186 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6810", 2020-11-12T17:28:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:03.187 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6814", 2020-11-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.188 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6812", 2020-11-12T17:28:03.189 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6808/12525", 2020-11-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6810/12525", 2020-11-12T17:28:03.190 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6814/12525", 2020-11-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6812/12525", 2020-11-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.191 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "62a140ba-7f94-4bb6-8a62-fda077f81354", 2020-11-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:03.192 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 167, 2020-11-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6809", 2020-11-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6811", 2020-11-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:03.195 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.196 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6815", 2020-11-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6813", 2020-11-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.198 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6809/12524", 2020-11-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6811/12524", 2020-11-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6815/12524", 2020-11-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6813/12524", 2020-11-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:03.199 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "32879bd7-780c-4da6-9838-5850b6277902", 2020-11-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:03.200 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 0, 2020-11-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:28:03.201 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.202 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6800", 2020-11-12T17:28:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:03.203 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6801", 2020-11-12T17:28:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.204 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.205 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6803", 2020-11-12T17:28:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.206 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6802", 2020-11-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.207 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6800/12522", 2020-11-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6801/12522", 2020-11-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6803/12522", 2020-11-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6802/12522", 2020-11-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:03.208 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2020-11-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:28:03.209 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:44.606542+0000", 2020-11-12T17:28:03.210 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:03.211 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:33.512821+0000", 2020-11-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 58 2020-11-12T17:28:03.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:28:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:03.213 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:57.104840+0000", 2020-11-12T17:28:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 94 2020-11-12T17:28:03.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:28:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:03.215 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:47.239812+0000", 2020-11-12T17:28:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:28:03.216 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:46.300658+0000", 2020-11-12T17:28:03.217 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:28:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:03.218 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:47.757739+0000", 2020-11-12T17:28:03.219 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:28:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:03.220 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:44.608417+0000", 2020-11-12T17:28:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:28:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:03.222 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:46.424553+0000", 2020-11-12T17:28:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.223 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2020-11-12T17:28:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2020-11-12T17:28:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2020-11-12T17:28:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2020-11-12T17:28:03.224 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2020-11-12T17:28:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2020-11-12T17:28:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2020-11-12T17:28:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2020-11-12T17:28:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2020-11-12T17:28:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2020-11-12T17:28:03.225 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2020-11-12T17:28:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2020-11-12T17:28:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2020-11-12T17:28:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2020-11-12T17:28:03.226 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2020-11-12T17:28:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2020-11-12T17:28:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2020-11-12T17:28:03.227 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2020-11-12T17:28:03.227 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:03.229 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:03.229 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:03.230 INFO:tasks.thrashosds.thrasher:j is {'epoch': 175, 'fsid': '8c8a6bcc-49d4-47d1-904f-e20798ef8e1f', 'created': '2020-11-12T17:22:37.581394+0000', 'modified': '2020-11-12T17:28:02.448403+0000', 'last_up_change': '2020-11-12T17:25:55.942493+0000', 'last_in_change': '2020-11-12T17:27:52.446296+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '163', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'unique_pool_2', 'create_time': '2020-11-12T17:26:43.854598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'bd1d5457-5d54-4074-b378-9da417f42976', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6801', 'nonce': 12304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6802', 'nonce': 12304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6806', 'nonce': 12304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6804', 'nonce': 12304}]}, 'public_addr': '172.21.15.36:6801/12304', 'cluster_addr': '172.21.15.36:6802/12304', 'heartbeat_back_addr': '172.21.15.36:6806/12304', 'heartbeat_front_addr': '172.21.15.36:6804/12304', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '37152eee-a8d8-40f1-8e27-2899e7b94c98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 57, 'up_from': 88, 'up_thru': 171, 'down_at': 58, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6812', 'nonce': 20274}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6814', 'nonce': 20274}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6816', 'nonce': 20274}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6815', 'nonce': 20274}]}, 'public_addr': '172.21.15.36:6812/20274', 'cluster_addr': '172.21.15.36:6814/20274', 'heartbeat_back_addr': '172.21.15.36:6816/20274', 'heartbeat_front_addr': '172.21.15.36:6815/20274', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd8ec2abb-38bf-4863-969a-482c4fa44f41', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 93, 'up_from': 102, 'up_thru': 167, 'down_at': 94, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6803', 'nonce': 21493}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6805', 'nonce': 21493}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6808', 'nonce': 21493}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6807', 'nonce': 21493}]}, 'public_addr': '172.21.15.36:6803/21493', 'cluster_addr': '172.21.15.36:6805/21493', 'heartbeat_back_addr': '172.21.15.36:6808/21493', 'heartbeat_front_addr': '172.21.15.36:6807/21493', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '799d3499-577c-4510-a00c-9b2e126fc449', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6809', 'nonce': 12305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6810', 'nonce': 12305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6813', 'nonce': 12305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6811', 'nonce': 12305}]}, 'public_addr': '172.21.15.36:6809/12305', 'cluster_addr': '172.21.15.36:6810/12305', 'heartbeat_back_addr': '172.21.15.36:6813/12305', 'heartbeat_front_addr': '172.21.15.36:6811/12305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c36e3100-aadc-4117-b495-24fb08a34148', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 167, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6804', 'nonce': 12499}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6805', 'nonce': 12499}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6807', 'nonce': 12499}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6806', 'nonce': 12499}]}, 'public_addr': '172.21.15.205:6804/12499', 'cluster_addr': '172.21.15.205:6805/12499', 'heartbeat_back_addr': '172.21.15.205:6807/12499', 'heartbeat_front_addr': '172.21.15.205:6806/12499', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b152141f-b530-448e-8dff-fe200559eff0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 173, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6808', 'nonce': 12525}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6810', 'nonce': 12525}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6814', 'nonce': 12525}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6812', 'nonce': 12525}]}, 'public_addr': '172.21.15.205:6808/12525', 'cluster_addr': '172.21.15.205:6810/12525', 'heartbeat_back_addr': '172.21.15.205:6814/12525', 'heartbeat_front_addr': '172.21.15.205:6812/12525', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '62a140ba-7f94-4bb6-8a62-fda077f81354', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 167, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6809', 'nonce': 12524}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6811', 'nonce': 12524}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6815', 'nonce': 12524}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6813', 'nonce': 12524}]}, 'public_addr': '172.21.15.205:6809/12524', 'cluster_addr': '172.21.15.205:6811/12524', 'heartbeat_back_addr': '172.21.15.205:6815/12524', 'heartbeat_front_addr': '172.21.15.205:6813/12524', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '32879bd7-780c-4da6-9838-5850b6277902', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6800', 'nonce': 12522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6801', 'nonce': 12522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6803', 'nonce': 12522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6802', 'nonce': 12522}]}, 'public_addr': '172.21.15.205:6800/12522', 'cluster_addr': '172.21.15.205:6801/12522', 'heartbeat_back_addr': '172.21.15.205:6803/12522', 'heartbeat_front_addr': '172.21.15.205:6802/12522', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:44.606542+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:33.512821+0000', 'dead_epoch': 58}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:57.104840+0000', 'dead_epoch': 94}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:47.239812+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:46.300658+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:47.757739+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:44.608417+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:46.424553+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-11-12T17:28:03.230 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:28:03.231 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:03.224+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:03.232 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:03.346 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:03.418 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:03.419 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:03.561 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:28:03.568 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 77 16 63856 63840 6.47648 0.0078125 0.527377 0.0188933 2020-11-12T17:28:03.568 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:28:03.575 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2020-11-12T17:28:02.469258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":517537792,"num_objects":7899,"num_object_clones":0,"num_object_copies":15798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7899,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63178,"num_write_kb":505410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2871,"num_bytes_recovered":187981824,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63178,"ondisk_log_size":63178,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8840668,"kb_used_data":451996,"kb_used_omap":118,"kb_used_meta":8388489,"kb_avail":746134052,"statfs":{"total":773094113280,"available":764041269248,"internally_reserved":8589934592,"allocated":462843904,"data_stored":1068275155,"data_compressed":6162347,"data_compressed_allocated":452890624,"data_compressed_original":1064280064,"omap_allocated":121799,"internal_metadata":8589812793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1,2,1,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23789568,"num_objects":363,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1601,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2904,"num_write_kb":23232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1601,"num_bytes_recovered":104923136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.499007"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"16","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.465515+0000","last_change":"2020-11-12T17:27:51.467795+0000","last_active":"2020-11-12T17:27:59.465515+0000","last_peered":"2020-11-12T17:27:59.465515+0000","last_clean":"2020-11-12T17:27:59.465515+0000","last_became_active":"2020-11-12T17:27:51.467388+0000","last_became_peered":"2020-11-12T17:27:51.467388+0000","last_unstale":"2020-11-12T17:27:59.465515+0000","last_undegraded":"2020-11-12T17:27:59.465515+0000","last_fullsized":"2020-11-12T17:27:59.465515+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"15","reported_epoch":"171","state":"active+clean","last_fresh":"2020-11-12T17:27:57.972302+0000","last_change":"2020-11-12T17:27:51.468206+0000","last_active":"2020-11-12T17:27:57.972302+0000","last_peered":"2020-11-12T17:27:57.972302+0000","last_clean":"2020-11-12T17:27:57.972302+0000","last_became_active":"2020-11-12T17:27:51.465928+0000","last_became_peered":"2020-11-12T17:27:51.465928+0000","last_unstale":"2020-11-12T17:27:57.972302+0000","last_undegraded":"2020-11-12T17:27:57.972302+0000","last_fullsized":"2020-11-12T17:27:57.972302+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:51.816592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:51.816592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"15","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:00.451742+0000","last_change":"2020-11-12T17:27:53.470049+0000","last_active":"2020-11-12T17:28:00.451742+0000","last_peered":"2020-11-12T17:28:00.451742+0000","last_clean":"2020-11-12T17:28:00.451742+0000","last_became_active":"2020-11-12T17:27:53.469606+0000","last_became_peered":"2020-11-12T17:27:53.469606+0000","last_unstale":"2020-11-12T17:28:00.451742+0000","last_undegraded":"2020-11-12T17:28:00.451742+0000","last_fullsized":"2020-11-12T17:28:00.451742+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:51.816592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:51.816592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"173'4056","reported_seq":"4110","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:01.444123+0000","last_change":"2020-11-12T17:26:45.503348+0000","last_active":"2020-11-12T17:28:01.444123+0000","last_peered":"2020-11-12T17:28:01.444123+0000","last_clean":"2020-11-12T17:28:01.444123+0000","last_became_active":"2020-11-12T17:26:45.502940+0000","last_became_peered":"2020-11-12T17:26:45.502940+0000","last_unstale":"2020-11-12T17:28:01.444123+0000","last_undegraded":"2020-11-12T17:28:01.444123+0000","last_fullsized":"2020-11-12T17:28:01.444123+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4056,"ondisk_log_size":4056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":507,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4056,"num_write_kb":32448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"16","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.446328+0000","last_change":"2020-11-12T17:27:51.459712+0000","last_active":"2020-11-12T17:27:59.446328+0000","last_peered":"2020-11-12T17:27:59.446328+0000","last_clean":"2020-11-12T17:27:59.446328+0000","last_became_active":"2020-11-12T17:27:51.458965+0000","last_became_peered":"2020-11-12T17:27:51.458965+0000","last_unstale":"2020-11-12T17:27:59.446328+0000","last_undegraded":"2020-11-12T17:27:59.446328+0000","last_fullsized":"2020-11-12T17:27:59.446328+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"173'4016","reported_seq":"4069","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:00.910085+0000","last_change":"2020-11-12T17:26:45.491058+0000","last_active":"2020-11-12T17:28:00.910085+0000","last_peered":"2020-11-12T17:28:00.910085+0000","last_clean":"2020-11-12T17:28:00.910085+0000","last_became_active":"2020-11-12T17:26:45.490308+0000","last_became_peered":"2020-11-12T17:26:45.490308+0000","last_unstale":"2020-11-12T17:28:00.910085+0000","last_undegraded":"2020-11-12T17:28:00.910085+0000","last_fullsized":"2020-11-12T17:28:00.910085+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4016,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":502,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4016,"num_write_kb":32128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"213","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.446472+0000","last_change":"2020-11-12T17:27:51.534870+0000","last_active":"2020-11-12T17:27:59.446472+0000","last_peered":"2020-11-12T17:27:59.446472+0000","last_clean":"2020-11-12T17:27:59.446472+0000","last_became_active":"2020-11-12T17:27:51.533667+0000","last_became_peered":"2020-11-12T17:27:51.533667+0000","last_unstale":"2020-11-12T17:27:59.446472+0000","last_undegraded":"2020-11-12T17:27:59.446472+0000","last_fullsized":"2020-11-12T17:27:59.446472+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:05.616420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:05.616420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"172'3888","reported_seq":"3939","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.576789+0000","last_change":"2020-11-12T17:26:45.490550+0000","last_active":"2020-11-12T17:27:59.576789+0000","last_peered":"2020-11-12T17:27:59.576789+0000","last_clean":"2020-11-12T17:27:59.576789+0000","last_became_active":"2020-11-12T17:26:45.490025+0000","last_became_peered":"2020-11-12T17:26:45.490025+0000","last_unstale":"2020-11-12T17:27:59.576789+0000","last_undegraded":"2020-11-12T17:27:59.576789+0000","last_fullsized":"2020-11-12T17:27:59.576789+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3888,"ondisk_log_size":3888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31850496,"num_objects":486,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3888,"num_write_kb":31104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"16","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.453753+0000","last_change":"2020-11-12T17:27:51.459168+0000","last_active":"2020-11-12T17:27:59.453753+0000","last_peered":"2020-11-12T17:27:59.453753+0000","last_clean":"2020-11-12T17:27:59.453753+0000","last_became_active":"2020-11-12T17:27:51.458677+0000","last_became_peered":"2020-11-12T17:27:51.458677+0000","last_unstale":"2020-11-12T17:27:59.453753+0000","last_undegraded":"2020-11-12T17:27:59.453753+0000","last_fullsized":"2020-11-12T17:27:59.453753+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:23.933684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:23.933684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"173'3968","reported_seq":"4258","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:00.900280+0000","last_change":"2020-11-12T17:27:04.424601+0000","last_active":"2020-11-12T17:28:00.900280+0000","last_peered":"2020-11-12T17:28:00.900280+0000","last_clean":"2020-11-12T17:28:00.900280+0000","last_became_active":"2020-11-12T17:27:04.422158+0000","last_became_peered":"2020-11-12T17:27:04.422158+0000","last_unstale":"2020-11-12T17:28:00.900280+0000","last_undegraded":"2020-11-12T17:28:00.900280+0000","last_fullsized":"2020-11-12T17:28:00.900280+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3968,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3968,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":7471104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"15","reported_epoch":"171","state":"active+clean","last_fresh":"2020-11-12T17:27:57.972246+0000","last_change":"2020-11-12T17:27:51.483730+0000","last_active":"2020-11-12T17:27:57.972246+0000","last_peered":"2020-11-12T17:27:57.972246+0000","last_clean":"2020-11-12T17:27:57.972246+0000","last_became_active":"2020-11-12T17:27:51.483394+0000","last_became_peered":"2020-11-12T17:27:51.483394+0000","last_unstale":"2020-11-12T17:27:57.972246+0000","last_undegraded":"2020-11-12T17:27:57.972246+0000","last_fullsized":"2020-11-12T17:27:57.972246+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_clean_scrub_stamp":"2020-11-12T17:27:15.924179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"172'4040","reported_seq":"5054","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.940042+0000","last_change":"2020-11-12T17:27:59.940042+0000","last_active":"2020-11-12T17:27:59.940042+0000","last_peered":"2020-11-12T17:27:59.940042+0000","last_clean":"2020-11-12T17:27:59.940042+0000","last_became_active":"2020-11-12T17:27:53.574726+0000","last_became_peered":"2020-11-12T17:27:53.574726+0000","last_unstale":"2020-11-12T17:27:59.940042+0000","last_undegraded":"2020-11-12T17:27:59.940042+0000","last_fullsized":"2020-11-12T17:27:59.940042+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4040,"ondisk_log_size":4040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33095680,"num_objects":505,"num_object_clones":0,"num_object_copies":1010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":505,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4040,"num_write_kb":32320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":476,"num_bytes_recovered":31195136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"16","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.448854+0000","last_change":"2020-11-12T17:27:51.459559+0000","last_active":"2020-11-12T17:27:59.448854+0000","last_peered":"2020-11-12T17:27:59.448854+0000","last_clean":"2020-11-12T17:27:59.448854+0000","last_became_active":"2020-11-12T17:27:51.458861+0000","last_became_peered":"2020-11-12T17:27:51.458861+0000","last_unstale":"2020-11-12T17:27:59.448854+0000","last_undegraded":"2020-11-12T17:27:59.448854+0000","last_fullsized":"2020-11-12T17:27:59.448854+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:04.764948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:27:04.764948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"172'3984","reported_seq":"4036","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.554496+0000","last_change":"2020-11-12T17:26:45.490968+0000","last_active":"2020-11-12T17:27:59.554496+0000","last_peered":"2020-11-12T17:27:59.554496+0000","last_clean":"2020-11-12T17:27:59.554496+0000","last_became_active":"2020-11-12T17:26:45.490602+0000","last_became_peered":"2020-11-12T17:26:45.490602+0000","last_unstale":"2020-11-12T17:27:59.554496+0000","last_undegraded":"2020-11-12T17:27:59.554496+0000","last_fullsized":"2020-11-12T17:27:59.554496+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3984,"ondisk_log_size":3984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32636928,"num_objects":498,"num_object_clones":0,"num_object_copies":996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":498,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3984,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"15","reported_epoch":"171","state":"active+clean","last_fresh":"2020-11-12T17:27:57.972391+0000","last_change":"2020-11-12T17:27:51.534861+0000","last_active":"2020-11-12T17:27:57.972391+0000","last_peered":"2020-11-12T17:27:57.972391+0000","last_clean":"2020-11-12T17:27:57.972391+0000","last_became_active":"2020-11-12T17:27:51.533701+0000","last_became_peered":"2020-11-12T17:27:51.533701+0000","last_unstale":"2020-11-12T17:27:57.972391+0000","last_undegraded":"2020-11-12T17:27:57.972391+0000","last_fullsized":"2020-11-12T17:27:57.972391+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:52.317257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:52.317257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"173'3688","reported_seq":"3744","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:00.568173+0000","last_change":"2020-11-12T17:27:28.815974+0000","last_active":"2020-11-12T17:28:00.568173+0000","last_peered":"2020-11-12T17:28:00.568173+0000","last_clean":"2020-11-12T17:28:00.568173+0000","last_became_active":"2020-11-12T17:27:28.811530+0000","last_became_peered":"2020-11-12T17:27:28.811530+0000","last_unstale":"2020-11-12T17:28:00.568173+0000","last_undegraded":"2020-11-12T17:28:00.568173+0000","last_fullsized":"2020-11-12T17:28:00.568173+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3688,"ondisk_log_size":3688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":461,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3688,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"24","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.453646+0000","last_change":"2020-11-12T17:27:53.467729+0000","last_active":"2020-11-12T17:27:59.453646+0000","last_peered":"2020-11-12T17:27:59.453646+0000","last_clean":"2020-11-12T17:27:59.453646+0000","last_became_active":"2020-11-12T17:27:53.467149+0000","last_became_peered":"2020-11-12T17:27:53.467149+0000","last_unstale":"2020-11-12T17:27:59.453646+0000","last_undegraded":"2020-11-12T17:27:59.453646+0000","last_fullsized":"2020-11-12T17:27:59.453646+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:53.490814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:26:53.490814+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"172'3888","reported_seq":"5074","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.726061+0000","last_change":"2020-11-12T17:27:59.473272+0000","last_active":"2020-11-12T17:27:59.726061+0000","last_peered":"2020-11-12T17:27:59.726061+0000","last_clean":"2020-11-12T17:27:59.726061+0000","last_became_active":"2020-11-12T17:27:53.599307+0000","last_became_peered":"2020-11-12T17:27:53.599307+0000","last_unstale":"2020-11-12T17:27:59.726061+0000","last_undegraded":"2020-11-12T17:27:59.726061+0000","last_fullsized":"2020-11-12T17:27:59.726061+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"162'3464","last_scrub_stamp":"2020-11-12T17:27:48.555220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:27:48.555220+0000","log_size":3888,"ondisk_log_size":3888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31850496,"num_objects":486,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":486,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3888,"num_write_kb":31104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":558,"num_bytes_recovered":36528128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"173'4032","reported_seq":"5034","reported_epoch":"174","state":"creating+peering","last_fresh":"2020-11-12T17:28:01.459496+0000","last_change":"2020-11-12T17:28:01.459395+0000","last_active":"2020-11-12T17:26:44.442765+0000","last_peered":"2020-11-12T17:26:44.442765+0000","last_clean":"2020-11-12T17:26:44.442765+0000","last_became_active":"2020-11-12T17:27:54.616386+0000","last_became_peered":"2020-11-12T17:27:54.616386+0000","last_unstale":"2020-11-12T17:28:01.459496+0000","last_undegraded":"2020-11-12T17:28:01.459496+0000","last_fullsized":"2020-11-12T17:28:01.459496+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4032,"ondisk_log_size":4032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4032,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":473,"num_bytes_recovered":30998528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"68","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.446543+0000","last_change":"2020-11-12T17:27:53.466298+0000","last_active":"2020-11-12T17:27:59.446543+0000","last_peered":"2020-11-12T17:27:59.446543+0000","last_clean":"2020-11-12T17:27:59.446543+0000","last_became_active":"2020-11-12T17:27:53.465795+0000","last_became_peered":"2020-11-12T17:27:53.465795+0000","last_unstale":"2020-11-12T17:27:59.446543+0000","last_undegraded":"2020-11-12T17:27:59.446543+0000","last_fullsized":"2020-11-12T17:27:59.446543+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:50.128859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:27:50.128859+0000","last_clean_scrub_stamp":"2020-11-12T17:27:50.128859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"174'3936","reported_seq":"5152","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.600962+0000","last_change":"2020-11-12T17:28:00.461041+0000","last_active":"2020-11-12T17:28:01.600962+0000","last_peered":"2020-11-12T17:28:01.600962+0000","last_clean":"2020-11-12T17:28:01.600962+0000","last_became_active":"2020-11-12T17:28:00.456669+0000","last_became_peered":"2020-11-12T17:28:00.456669+0000","last_unstale":"2020-11-12T17:28:01.600962+0000","last_undegraded":"2020-11-12T17:28:01.600962+0000","last_fullsized":"2020-11-12T17:28:01.600962+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3936,"ondisk_log_size":3936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32243712,"num_objects":492,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3936,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":570,"num_bytes_recovered":37355520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"217","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:00.461070+0000","last_change":"2020-11-12T17:27:52.083310+0000","last_active":"2020-11-12T17:28:00.461070+0000","last_peered":"2020-11-12T17:28:00.461070+0000","last_clean":"2020-11-12T17:28:00.461070+0000","last_became_active":"2020-11-12T17:27:49.463678+0000","last_became_peered":"2020-11-12T17:27:49.463678+0000","last_unstale":"2020-11-12T17:28:00.461070+0000","last_undegraded":"2020-11-12T17:28:00.461070+0000","last_fullsized":"2020-11-12T17:28:00.461070+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:52.083239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:52.083239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"172'4032","reported_seq":"4087","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.829313+0000","last_change":"2020-11-12T17:27:47.563620+0000","last_active":"2020-11-12T17:27:59.829313+0000","last_peered":"2020-11-12T17:27:59.829313+0000","last_clean":"2020-11-12T17:27:59.829313+0000","last_became_active":"2020-11-12T17:26:45.480445+0000","last_became_peered":"2020-11-12T17:26:45.480445+0000","last_unstale":"2020-11-12T17:27:59.829313+0000","last_undegraded":"2020-11-12T17:27:59.829313+0000","last_fullsized":"2020-11-12T17:27:59.829313+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'3552","last_scrub_stamp":"2020-11-12T17:27:47.563469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:27:47.563469+0000","log_size":4032,"ondisk_log_size":4032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4032,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"74","reported_epoch":"171","state":"active+clean","last_fresh":"2020-11-12T17:27:57.972250+0000","last_change":"2020-11-12T17:27:49.451672+0000","last_active":"2020-11-12T17:27:57.972250+0000","last_peered":"2020-11-12T17:27:57.972250+0000","last_clean":"2020-11-12T17:27:57.972250+0000","last_became_active":"2020-11-12T17:27:49.451258+0000","last_became_peered":"2020-11-12T17:27:49.451258+0000","last_unstale":"2020-11-12T17:27:57.972250+0000","last_undegraded":"2020-11-12T17:27:57.972250+0000","last_fullsized":"2020-11-12T17:27:57.972250+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"172'3744","reported_seq":"3797","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.510407+0000","last_change":"2020-11-12T17:27:28.813298+0000","last_active":"2020-11-12T17:27:59.510407+0000","last_peered":"2020-11-12T17:27:59.510407+0000","last_clean":"2020-11-12T17:27:59.510407+0000","last_became_active":"2020-11-12T17:27:28.808532+0000","last_became_peered":"2020-11-12T17:27:28.808532+0000","last_unstale":"2020-11-12T17:27:59.510407+0000","last_undegraded":"2020-11-12T17:27:59.510407+0000","last_fullsized":"2020-11-12T17:27:59.510407+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3744,"ondisk_log_size":3744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30670848,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3744,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"197","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:00.461203+0000","last_change":"2020-11-12T17:27:49.467151+0000","last_active":"2020-11-12T17:28:00.461203+0000","last_peered":"2020-11-12T17:28:00.461203+0000","last_clean":"2020-11-12T17:28:00.461203+0000","last_became_active":"2020-11-12T17:27:49.466326+0000","last_became_peered":"2020-11-12T17:27:49.466326+0000","last_unstale":"2020-11-12T17:28:00.461203+0000","last_undegraded":"2020-11-12T17:28:00.461203+0000","last_fullsized":"2020-11-12T17:28:00.461203+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:23.933684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:23.933684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"21","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:00.451787+0000","last_change":"2020-11-12T17:27:53.578136+0000","last_active":"2020-11-12T17:28:00.451787+0000","last_peered":"2020-11-12T17:28:00.451787+0000","last_clean":"2020-11-12T17:28:00.451787+0000","last_became_active":"2020-11-12T17:27:53.469341+0000","last_became_peered":"2020-11-12T17:27:53.469341+0000","last_unstale":"2020-11-12T17:28:00.451787+0000","last_undegraded":"2020-11-12T17:28:00.451787+0000","last_fullsized":"2020-11-12T17:28:00.451787+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:27:47.164517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:27:47.164517+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"174'3872","reported_seq":"4123","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.586024+0000","last_change":"2020-11-12T17:27:01.968627+0000","last_active":"2020-11-12T17:28:01.586024+0000","last_peered":"2020-11-12T17:28:01.586024+0000","last_clean":"2020-11-12T17:28:01.586024+0000","last_became_active":"2020-11-12T17:27:00.629289+0000","last_became_peered":"2020-11-12T17:27:00.629289+0000","last_unstale":"2020-11-12T17:28:01.586024+0000","last_undegraded":"2020-11-12T17:28:01.586024+0000","last_fullsized":"2020-11-12T17:28:01.586024+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3872,"ondisk_log_size":3872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31719424,"num_objects":484,"num_object_clones":0,"num_object_copies":968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":484,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3872,"num_write_kb":30976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"211","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:01.007380+0000","last_change":"2020-11-12T17:28:01.007482+0000","last_active":"2020-11-12T17:28:01.007380+0000","last_peered":"2020-11-12T17:28:01.007380+0000","last_clean":"2020-11-12T17:28:01.007380+0000","last_became_active":"2020-11-12T17:27:49.456337+0000","last_became_peered":"2020-11-12T17:27:49.456337+0000","last_unstale":"2020-11-12T17:28:01.007380+0000","last_undegraded":"2020-11-12T17:28:01.007380+0000","last_fullsized":"2020-11-12T17:28:01.007380+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:01.007379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:28:01.007379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"173'4104","reported_seq":"5119","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:00.567234+0000","last_change":"2020-11-12T17:27:59.912080+0000","last_active":"2020-11-12T17:28:00.567234+0000","last_peered":"2020-11-12T17:28:00.567234+0000","last_clean":"2020-11-12T17:28:00.567234+0000","last_became_active":"2020-11-12T17:27:53.623896+0000","last_became_peered":"2020-11-12T17:27:53.623896+0000","last_unstale":"2020-11-12T17:28:00.567234+0000","last_undegraded":"2020-11-12T17:28:00.567234+0000","last_fullsized":"2020-11-12T17:28:00.567234+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4104,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33619968,"num_objects":513,"num_object_clones":0,"num_object_copies":1026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4104,"num_write_kb":32832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":476,"num_bytes_recovered":31195136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"173","state":"active+clean","last_fresh":"2020-11-12T17:28:00.451960+0000","last_change":"2020-11-12T17:27:53.469179+0000","last_active":"2020-11-12T17:28:00.451960+0000","last_peered":"2020-11-12T17:28:00.451960+0000","last_clean":"2020-11-12T17:28:00.451960+0000","last_became_active":"2020-11-12T17:27:53.468698+0000","last_became_peered":"2020-11-12T17:27:53.468698+0000","last_unstale":"2020-11-12T17:28:00.451960+0000","last_undegraded":"2020-11-12T17:28:00.451960+0000","last_fullsized":"2020-11-12T17:28:00.451960+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:51.287572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:27:51.287572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"172'4000","reported_seq":"4053","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.751049+0000","last_change":"2020-11-12T17:26:45.490394+0000","last_active":"2020-11-12T17:27:59.751049+0000","last_peered":"2020-11-12T17:27:59.751049+0000","last_clean":"2020-11-12T17:27:59.751049+0000","last_became_active":"2020-11-12T17:26:45.489929+0000","last_became_peered":"2020-11-12T17:26:45.489929+0000","last_unstale":"2020-11-12T17:27:59.751049+0000","last_undegraded":"2020-11-12T17:27:59.751049+0000","last_fullsized":"2020-11-12T17:27:59.751049+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4000,"ondisk_log_size":4000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32768000,"num_objects":500,"num_object_clones":0,"num_object_copies":1000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4000,"num_write_kb":32000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"54","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.446586+0000","last_change":"2020-11-12T17:27:49.453312+0000","last_active":"2020-11-12T17:27:59.446586+0000","last_peered":"2020-11-12T17:27:59.446586+0000","last_clean":"2020-11-12T17:27:59.446586+0000","last_became_active":"2020-11-12T17:27:49.452359+0000","last_became_peered":"2020-11-12T17:27:49.452359+0000","last_unstale":"2020-11-12T17:27:59.446586+0000","last_undegraded":"2020-11-12T17:27:59.446586+0000","last_fullsized":"2020-11-12T17:27:59.446586+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:52.317257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:52.317257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"174'3928","reported_seq":"4208","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.639757+0000","last_change":"2020-11-12T17:27:01.959937+0000","last_active":"2020-11-12T17:28:01.639757+0000","last_peered":"2020-11-12T17:28:01.639757+0000","last_clean":"2020-11-12T17:28:01.639757+0000","last_became_active":"2020-11-12T17:27:00.648415+0000","last_became_peered":"2020-11-12T17:27:00.648415+0000","last_unstale":"2020-11-12T17:28:01.639757+0000","last_undegraded":"2020-11-12T17:28:01.639757+0000","last_fullsized":"2020-11-12T17:28:01.639757+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3928,"ondisk_log_size":3928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":491,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3928,"num_write_kb":31424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":7077888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"174","reported_epoch":"172","state":"active+clean","last_fresh":"2020-11-12T17:27:59.465560+0000","last_change":"2020-11-12T17:27:52.416332+0000","last_active":"2020-11-12T17:27:59.465560+0000","last_peered":"2020-11-12T17:27:59.465560+0000","last_clean":"2020-11-12T17:27:59.465560+0000","last_became_active":"2020-11-12T17:27:49.451818+0000","last_became_peered":"2020-11-12T17:27:49.451818+0000","last_unstale":"2020-11-12T17:27:59.465560+0000","last_undegraded":"2020-11-12T17:27:59.465560+0000","last_fullsized":"2020-11-12T17:27:59.465560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:52.416215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:27:52.416215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":517537792,"num_objects":7897,"num_object_clones":0,"num_object_copies":15794,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7897,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63176,"num_write_kb":505408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2869,"num_bytes_recovered":187981824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":455974912,"data_stored":1070448640,"data_compressed":6203762,"data_compressed_allocated":455974912,"data_compressed_original":1070448640,"omap_allocated":0,"internal_metadata":0},"log_size":63176,"ondisk_log_size":63176,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095244,"kb_used_data":46660,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276596,"statfs":{"total":96636764160,"available":95515234304,"internally_reserved":1073741824,"allocated":47779840,"data_stored":93538816,"data_compressed":622571,"data_compressed_allocated":46518272,"data_compressed_original":93036544,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":9.4589999999999996,"15min":4.1989999999999998},"min":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":7.2270000000000003,"5min":727.43499999999995,"15min":727.43499999999995},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.6399999999999999,"5min":2.6419999999999999,"15min":2.3109999999999999},"min":{"1min":0.60299999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":7.375,"5min":101.371,"15min":101.371},"last":1.2669999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:27:36 2020","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":6.1219999999999999,"15min":6.8579999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":3.5449999999999999,"5min":102.354,"15min":102.354},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.718,"5min":5.8339999999999996,"15min":6.5199999999999996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":5.399,"5min":102.08199999999999,"15min":102.08199999999999},"last":1.9670000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":5.5439999999999996,"15min":6.1349999999999998},"min":{"1min":0.76200000000000001,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":10.603,"5min":102.038,"15min":102.038},"last":1.8500000000000001},{"interface":"front","average":{"1min":2.355,"5min":5.8410000000000002,"15min":6.4219999999999997},"min":{"1min":0.92300000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":10.726000000000001,"5min":102.92,"15min":102.92},"last":1.538}]},{"osd":3,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":2.7949999999999999,"15min":2.4060000000000001},"min":{"1min":1.0149999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":10.640000000000001,"5min":102.443,"15min":102.443},"last":1.913},{"interface":"front","average":{"1min":2.3580000000000001,"5min":9.4209999999999994,"15min":4.8129999999999997},"min":{"1min":1.0589999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":10.526,"5min":871.76700000000005,"15min":871.76700000000005},"last":2.02}]},{"osd":4,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.169,"5min":23.588999999999999,"15min":43.701000000000001},"min":{"1min":0.83999999999999997,"5min":0.624,"15min":0.624},"max":{"1min":10.275,"5min":849.06500000000005,"15min":849.06500000000005},"last":2.1259999999999999},{"interface":"front","average":{"1min":2.6269999999999998,"5min":4.1440000000000001,"15min":2.718},"min":{"1min":0.81499999999999995,"5min":0.621,"15min":0.621},"max":{"1min":14.92,"5min":108.14,"15min":108.14},"last":1.571}]},{"osd":5,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":6.0869999999999997,"15min":3.8570000000000002},"min":{"1min":0.88900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":9.8350000000000009,"5min":311.077,"15min":311.077},"last":2.1659999999999999},{"interface":"front","average":{"1min":2.3050000000000002,"5min":3.2469999999999999,"15min":2.9940000000000002},"min":{"1min":0.97199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":9.9250000000000007,"5min":104.02,"15min":104.02},"last":2.883}]},{"osd":6,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.6760000000000002,"5min":7.7569999999999997,"15min":4.4589999999999996},"min":{"1min":0.91200000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":10.422000000000001,"5min":375.04199999999997,"15min":375.04199999999997},"last":2.6160000000000001},{"interface":"front","average":{"1min":2.5390000000000001,"5min":19.574000000000002,"15min":42.152000000000001},"min":{"1min":1.103,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":10.356,"5min":975.20899999999995,"15min":975.20899999999995},"last":2.3500000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1129572,"kb_used_data":80988,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93242268,"statfs":{"total":96636764160,"available":95480082432,"internally_reserved":1073741824,"allocated":82931712,"data_stored":163866395,"data_compressed":1093540,"data_compressed_allocated":81682432,"data_compressed_original":163364864,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.367,"15min":1.6719999999999999},"min":{"1min":0.65800000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5409999999999999,"5min":5.0309999999999997,"15min":5.0309999999999997},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.5389999999999999,"15min":1.9339999999999999},"min":{"1min":0.68600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.776,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":2.2869999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:27:34 2020","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.5980000000000001,"15min":1.5920000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":4.327,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":1.73},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.778,"15min":1.802},"min":{"1min":1.0669999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.024,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.0920000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.7490000000000001,"15min":1.754},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":3.782,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":2.5449999999999999},{"interface":"front","average":{"1min":1.9470000000000001,"5min":1.7929999999999999,"15min":1.7669999999999999},"min":{"1min":1.034,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0640000000000001,"5min":5.0640000000000001,"15min":5.0640000000000001},"last":1.609}]},{"osd":3,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1560000000000001,"5min":2.6040000000000001,"15min":2.6960000000000002},"min":{"1min":1.028,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":4.4790000000000001,"5min":49.442999999999998,"15min":49.442999999999998},"last":2.4329999999999998},{"interface":"front","average":{"1min":23.279,"5min":6.2480000000000002,"15min":3.7400000000000002},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":437.625,"5min":437.625,"15min":437.625},"last":1.8149999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":6.0880000000000001,"15min":3.5139999999999998},"min":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.6619999999999999,"5min":459.15499999999997,"15min":459.15499999999997},"last":1.8680000000000001},{"interface":"front","average":{"1min":1.504,"5min":4.7699999999999996,"15min":3.6240000000000001},"min":{"1min":0.82199999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.1669999999999998,"5min":324.95600000000002,"15min":324.95600000000002},"last":1.675}]},{"osd":6,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1280000000000001,"5min":2.0150000000000001,"15min":2.2330000000000001},"min":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.984,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":2.5},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.8360000000000001,"15min":2.194},"min":{"1min":0.82299999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.786,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":2.1360000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":19.530000000000001,"5min":6.0430000000000001,"15min":4.0830000000000002},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":359.55599999999998,"5min":359.55599999999998,"15min":359.55599999999998},"last":2.3410000000000002},{"interface":"front","average":{"1min":2.0979999999999999,"5min":8.1829999999999998,"15min":4.6639999999999997},"min":{"1min":0.84399999999999997,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.7519999999999998,"5min":693.23000000000002,"15min":693.23000000000002},"last":2.7320000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542209,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1129628,"kb_used_data":81044,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93242212,"statfs":{"total":96636764160,"available":95480025088,"internally_reserved":1073741824,"allocated":82989056,"data_stored":164009184,"data_compressed":1094162,"data_compressed_allocated":81756160,"data_compressed_original":163512320,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":2.1629999999999998,"5min":12.895,"15min":5.3540000000000001},"min":{"1min":0.70899999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":13.298,"5min":765.13099999999997,"15min":765.13099999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.6120000000000001,"5min":14.550000000000001,"15min":36.204000000000001},"min":{"1min":0.872,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5609999999999999,"5min":948.30899999999997,"15min":948.30899999999997},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":2.3849999999999998,"5min":15.705,"15min":17.925000000000001},"min":{"1min":0.79900000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":7.4329999999999998,"5min":356.46699999999998,"15min":356.46699999999998},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.911,"5min":15.529,"15min":17.798999999999999},"min":{"1min":0.92800000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.8799999999999999,"5min":356.18599999999998,"15min":356.18599999999998},"last":1.407}]},{"osd":2,"last update":"Thu Nov 12 17:27:00 2020","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":6.9630000000000001,"5min":6.9630000000000001,"15min":6.9630000000000001},"last":0.746},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":4.056,"5min":4.056,"15min":4.056},"last":0.93999999999999995}]},{"osd":3,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":2.738,"5min":5.9480000000000004,"15min":3.3420000000000001},"min":{"1min":0.876,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":11.282,"5min":356.02300000000002,"15min":356.02300000000002},"last":1.1120000000000001},{"interface":"front","average":{"1min":2.2450000000000001,"5min":9.2590000000000003,"15min":4.5300000000000002},"min":{"1min":1.0529999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":3.9769999999999999,"5min":357.79000000000002,"15min":357.79000000000002},"last":1.3260000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":3.0089999999999999,"5min":12.48,"15min":5.5279999999999996},"min":{"1min":0.96799999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":13.417999999999999,"5min":575.16800000000001,"15min":575.16800000000001},"last":2.9860000000000002},{"interface":"front","average":{"1min":2.6589999999999998,"5min":16.007000000000001,"15min":6.843},"min":{"1min":1.3149999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":5.6609999999999996,"5min":908.52700000000004,"15min":908.52700000000004},"last":1.548}]},{"osd":6,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":3.1219999999999999,"5min":12.295,"15min":26.529},"min":{"1min":0.95099999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":11.757,"5min":665.13999999999999,"15min":665.13999999999999},"last":1.077},{"interface":"front","average":{"1min":2.5939999999999999,"5min":10.083,"15min":4.8550000000000004},"min":{"1min":0.88200000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":13.446,"5min":426.197,"15min":426.197},"last":1.153}]},{"osd":7,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":2.4660000000000002,"5min":14.332000000000001,"15min":6.3719999999999999},"min":{"1min":1.474,"5min":0.87,"15min":0.87},"max":{"1min":4.1920000000000002,"5min":584.00300000000004,"15min":584.00300000000004},"last":1.4490000000000001},{"interface":"front","average":{"1min":3.3410000000000002,"5min":15.398,"15min":6.5919999999999996},"min":{"1min":1.3,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":11.363,"5min":915.22900000000004,"15min":915.22900000000004},"last":1.3720000000000001}]}]},{"osd":1,"up_from":88,"seq":377957122079,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1100268,"kb_used_data":51684,"kb_used_omap":114,"kb_used_meta":1048461,"kb_avail":93271572,"statfs":{"total":96636764160,"available":95510089728,"internally_reserved":1073741824,"allocated":52924416,"data_stored":128174287,"data_compressed":708713,"data_compressed_allocated":51679232,"data_compressed_original":127672320,"omap_allocated":117414,"internal_metadata":1073624410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":32.381,"5min":7.7869999999999999,"15min":3.6880000000000002},"min":{"1min":0.86499999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":503.14299999999997,"5min":503.14299999999997,"15min":503.14299999999997},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.7030000000000001,"15min":1.752},"min":{"1min":0.81200000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.3650000000000002,"5min":4.202,"15min":4.202},"last":2.0099999999999998}]},{"osd":2,"last update":"Thu Nov 12 17:27:00 2020","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":2.1120000000000001},{"interface":"front","average":{"1min":1.72,"5min":1.72,"15min":1.72},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.8079999999999998,"5min":2.8079999999999998,"15min":2.8079999999999998},"last":1.3029999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:27:39 2020","interfaces":[{"interface":"back","average":{"1min":91.236000000000004,"5min":19.588000000000001,"15min":7.6459999999999999},"min":{"1min":0.96299999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":958.71600000000001,"5min":958.71600000000001,"15min":958.71600000000001},"last":1.837},{"interface":"front","average":{"1min":1.95,"5min":2.1389999999999998,"15min":2.1709999999999998},"min":{"1min":1.107,"5min":0.872,"15min":0.872},"max":{"1min":3.7309999999999999,"5min":6.056,"15min":6.056},"last":3.3780000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.8919999999999999,"15min":1.9219999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":2.21},{"interface":"front","average":{"1min":2.0800000000000001,"5min":2.077,"15min":2.077},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":3.2879999999999998,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":2.1640000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0800000000000001,"5min":2.0350000000000001,"15min":2.0270000000000001},"min":{"1min":1.1479999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.7559999999999998,"5min":6.1159999999999997,"15min":6.1159999999999997},"last":1.9399999999999999},{"interface":"front","average":{"1min":2.077,"5min":2.3570000000000002,"15min":2.403},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":3.1669999999999998,"5min":6.7859999999999996,"15min":6.7859999999999996},"last":2.7069999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":2.2909999999999999,"15min":2.3250000000000002},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.4529999999999998,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":2.782},{"interface":"front","average":{"1min":2.2839999999999998,"5min":2.3119999999999998,"15min":2.3159999999999998},"min":{"1min":1.5349999999999999,"5min":1.161,"15min":1.161},"max":{"1min":3.774,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":2.7360000000000002}]},{"osd":7,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":2.294,"5min":2.4660000000000002,"15min":2.4940000000000002},"min":{"1min":1.502,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":3.79,"5min":6.577,"15min":6.577},"last":3.4910000000000001},{"interface":"front","average":{"1min":2.0990000000000002,"5min":2.4159999999999999,"15min":2.4689999999999999},"min":{"1min":1.056,"5min":1.056,"15min":1.056},"max":{"1min":3.3130000000000002,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":2.6579999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1096684,"kb_used_data":48100,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93275156,"statfs":{"total":96636764160,"available":95513759744,"internally_reserved":1073741824,"allocated":49254400,"data_stored":96507569,"data_compressed":642576,"data_compressed_allocated":48005120,"data_compressed_original":96010240,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":1.8300000000000001,"5min":1.6180000000000001,"15min":1.718},"min":{"1min":0.67100000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":6.0990000000000002,"5min":6.0990000000000002,"15min":6.0990000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":13.329000000000001,"5min":3.9470000000000001,"15min":2.6890000000000001},"min":{"1min":0.80100000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":254.70500000000001,"5min":254.70500000000001,"15min":254.70500000000001},"last":1.3680000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":4.6139999999999999,"5min":35.189,"15min":40.284999999999997},"min":{"1min":1.0069999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":49.276000000000003,"5min":665.476,"15min":665.476},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.929,"5min":1.3779999999999999,"15min":1.286},"min":{"1min":0.82899999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":4.5549999999999997,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":1.206}]},{"osd":2,"last update":"Thu Nov 12 17:26:58 2020","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":7.0579999999999998,"5min":3.1949999999999998,"15min":2.4710000000000001},"min":{"1min":0.99099999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":118.611,"5min":118.611,"15min":118.611},"last":1.254},{"interface":"front","average":{"1min":40.183999999999997,"5min":9.8610000000000007,"15min":4.9269999999999996},"min":{"1min":1.1479999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":764.62800000000004,"5min":764.62800000000004,"15min":764.62800000000004},"last":1.1830000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":1.78,"5min":7.1500000000000004,"15min":3.8700000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.5549999999999997,"5min":489.149,"15min":489.149},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.6799999999999999,"5min":9.0609999999999999,"15min":4.8010000000000002},"min":{"1min":0.70199999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":10.935,"5min":480.79599999999999,"15min":480.79599999999999},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":1.8839999999999999,"5min":20.385000000000002,"15min":8.3149999999999995},"min":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":8.1880000000000006,"5min":804.62199999999996,"15min":804.62199999999996},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.0379999999999998,"5min":11.406000000000001,"15min":18.963000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":5.6269999999999998,"5min":494.78399999999999,"15min":494.78399999999999},"last":1.411}]},{"osd":7,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":17.474,"15min":7.6779999999999999},"min":{"1min":0.80500000000000005,"5min":0.626,"15min":0.626},"max":{"1min":8.0890000000000004,"5min":1002.347,"15min":1002.347},"last":1.5029999999999999},{"interface":"front","average":{"1min":2.2999999999999998,"5min":2.2240000000000002,"15min":2.4239999999999999},"min":{"1min":1.1180000000000001,"5min":0.878,"15min":0.878},"max":{"1min":6.7839999999999998,"5min":10.271000000000001,"15min":10.271000000000001},"last":1.4390000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542209,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1064240,"kb_used_data":15656,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93307600,"statfs":{"total":96636764160,"available":95546982400,"internally_reserved":1073741824,"allocated":16031744,"data_stored":164259245,"data_compressed":281524,"data_compressed_allocated":14786560,"data_compressed_original":163758080,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 17:27:34 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":33.646999999999998,"15min":38.969000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":4.6310000000000002,"5min":501.38600000000002,"15min":501.38600000000002},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.6180000000000001,"5min":1.698,"15min":1.712},"min":{"1min":0.97299999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.702,"5min":3.141,"15min":3.141},"last":1.244}]},{"osd":2,"last update":"Thu Nov 12 17:27:57 2020","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.6679999999999999,"15min":1.704},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.323,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":2.802},{"interface":"front","average":{"1min":1.627,"5min":31.257000000000001,"15min":36.195},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":4.4180000000000001,"5min":811.02700000000004,"15min":811.02700000000004},"last":1.7350000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":25.684999999999999,"5min":9.2959999999999994,"15min":13.548},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":413.33699999999999,"5min":413.33699999999999,"15min":413.33699999999999},"last":1.327},{"interface":"front","average":{"1min":1.649,"5min":1.744,"15min":1.9550000000000001},"min":{"1min":0.872,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.4420000000000002,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":2.754}]},{"osd":4,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":5.0339999999999998,"15min":3.1379999999999999},"min":{"1min":1.085,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.5419999999999998,"5min":347.87599999999998,"15min":347.87599999999998},"last":2.1040000000000001},{"interface":"front","average":{"1min":6.976,"5min":5.9740000000000002,"15min":3.2869999999999999},"min":{"1min":1.0609999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":89.954999999999998,"5min":347.07499999999999,"15min":347.07499999999999},"last":1.4950000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":34.363,"5min":11.606999999999999,"15min":5.2990000000000004},"min":{"1min":1.0289999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":551.47299999999996,"5min":551.47299999999996,"15min":551.47299999999996},"last":1.286},{"interface":"front","average":{"1min":1.867,"5min":14.631,"15min":38.652999999999999},"min":{"1min":0.94099999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":3.5310000000000001,"5min":920.76900000000001,"15min":920.76900000000001},"last":3.54}]},{"osd":6,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":6.4950000000000001,"15min":3.746},"min":{"1min":1.004,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":7.8499999999999996,"5min":429.55599999999998,"15min":429.55599999999998},"last":3.2719999999999998},{"interface":"front","average":{"1min":2.2629999999999999,"5min":15.630000000000001,"15min":6.8799999999999999},"min":{"1min":1.0089999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":4.9720000000000004,"5min":931.65200000000004,"15min":931.65200000000004},"last":2.1360000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":15.689,"15min":24.651},"min":{"1min":1.1220000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":4.8079999999999998,"5min":502.31,"15min":502.31},"last":2.157},{"interface":"front","average":{"1min":2.427,"5min":11.563000000000001,"15min":36.590000000000003},"min":{"1min":1.1719999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":5.8090000000000002,"5min":502.42099999999999,"15min":502.42099999999999},"last":2.2839999999999998}]}]},{"osd":2,"up_from":102,"seq":438086664218,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1143516,"kb_used_data":94932,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93228324,"statfs":{"total":96636764160,"available":95465803776,"internally_reserved":1073741824,"allocated":97210368,"data_stored":192495064,"data_compressed":1284906,"data_compressed_allocated":96002048,"data_compressed_original":192004096,"omap_allocated":4385,"internal_metadata":1073737439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":27.831,"15min":32.198},"min":{"1min":0.92400000000000004,"5min":0.755,"15min":0.755},"max":{"1min":2.931,"5min":524.55600000000004,"15min":524.55600000000004},"last":1.7949999999999999},{"interface":"front","average":{"1min":1.631,"5min":1.5880000000000001,"15min":1.581},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":3.7730000000000001,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":1.8600000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":40.386000000000003,"5min":9.6799999999999997,"15min":4.5620000000000003},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":776.01499999999999,"5min":776.01499999999999,"15min":776.01499999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.722,"15min":1.7030000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":4.4210000000000003,"5min":4.4210000000000003,"15min":4.4210000000000003},"last":1.1519999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.841,"15min":1.8620000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":1},{"interface":"front","average":{"1min":1.8939999999999999,"5min":46.975999999999999,"15min":54.490000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":5.1260000000000003,"5min":902.96299999999997,"15min":902.96299999999997},"last":1.274}]},{"osd":4,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":16.821000000000002,"5min":4.8049999999999997,"15min":2.8029999999999999},"min":{"1min":0.80300000000000005,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":258.35599999999999,"5min":258.35599999999999,"15min":258.35599999999999},"last":2.04},{"interface":"front","average":{"1min":4.3300000000000001,"5min":2.4089999999999998,"15min":2.089},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":46.899000000000001,"5min":46.899000000000001,"15min":46.899000000000001},"last":1.5009999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":2.5179999999999998,"15min":2.5680000000000001},"min":{"1min":1.27,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":5.2270000000000003,"5min":10.308,"15min":10.308},"last":1.5840000000000001},{"interface":"front","average":{"1min":2.5779999999999998,"5min":2.194,"15min":2.1299999999999999},"min":{"1min":1.0649999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":5.3970000000000002,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":3.254}]},{"osd":6,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.3359999999999999,"5min":2.1829999999999998,"15min":2.157},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":5.7759999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":4.4489999999999998},{"interface":"front","average":{"1min":2.3290000000000002,"5min":10.577,"15min":11.952},"min":{"1min":1.3240000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":5.1859999999999999,"5min":168.64599999999999,"15min":168.64599999999999},"last":1.617}]},{"osd":7,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":20.908999999999999,"5min":6.2039999999999997,"15min":3.7530000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":374.077,"5min":374.077,"15min":374.077},"last":1.825},{"interface":"front","average":{"1min":42.392000000000003,"5min":10.497999999999999,"15min":5.1820000000000004},"min":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"max":{"1min":528.596,"5min":528.596,"15min":528.596},"last":4.3620000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542209,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1081516,"kb_used_data":32932,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93290324,"statfs":{"total":96636764160,"available":95529291776,"internally_reserved":1073741824,"allocated":33722368,"data_stored":65424595,"data_compressed":434355,"data_compressed_allocated":32460800,"data_compressed_original":64921600,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":3.6240000000000001,"15min":2.4060000000000001},"min":{"1min":0.69299999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.8580000000000001,"5min":178.36699999999999,"15min":178.36699999999999},"last":0.997},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.821,"15min":1.911},"min":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.222,"5min":16.902000000000001,"15min":16.902000000000001},"last":2.742}]},{"osd":1,"last update":"Thu Nov 12 17:27:36 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":30.931000000000001,"15min":35.847000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.7040000000000002,"5min":501.91199999999998,"15min":501.91199999999998},"last":1.0609999999999999},{"interface":"front","average":{"1min":29.451000000000001,"5min":27.236999999999998,"15min":26.867999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":501.91399999999999,"5min":501.91399999999999,"15min":501.91399999999999},"last":2.2389999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":40.996000000000002,"5min":49.390000000000001,"15min":50.789000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":501.85700000000003,"5min":942.58500000000004,"15min":942.58500000000004},"last":1.9339999999999999},{"interface":"front","average":{"1min":1.8580000000000001,"5min":21.530000000000001,"15min":24.808},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.6240000000000001,"5min":461.721,"15min":461.721},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9330000000000001,"5min":2.0390000000000001,"15min":2.3730000000000002},"min":{"1min":0.88800000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.6390000000000002,"5min":10.318,"15min":10.318},"last":1.667},{"interface":"front","average":{"1min":9.0190000000000001,"5min":3.3399999999999999,"15min":2.778},"min":{"1min":0.86499999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":173.863,"5min":173.863,"15min":173.863},"last":1.149}]},{"osd":5,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9750000000000001,"5min":8.0860000000000003,"15min":24.167999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":4.7629999999999999,"5min":622.07799999999997,"15min":622.07799999999997},"last":1.1020000000000001},{"interface":"front","average":{"1min":2.0259999999999998,"5min":2.2130000000000001,"15min":2.6429999999999998},"min":{"1min":1.0249999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6699999999999999,"5min":10.436,"15min":10.436},"last":1.8879999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":7.1680000000000001,"15min":4.1390000000000002},"min":{"1min":0.92200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":4.9059999999999997,"5min":466.58199999999999,"15min":466.58199999999999},"last":1.427},{"interface":"front","average":{"1min":2.036,"5min":2.2530000000000001,"15min":2.5830000000000002},"min":{"1min":1.0629999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.403,"5min":11.497999999999999,"15min":11.497999999999999},"last":1.629}]},{"osd":7,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":5.2030000000000003,"15min":3.6869999999999998},"min":{"1min":1.1160000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.0569999999999999,"5min":287.43099999999998,"15min":287.43099999999998},"last":1.7170000000000001},{"interface":"front","average":{"1min":2.266,"5min":14.045,"15min":24.808},"min":{"1min":1.1559999999999999,"5min":1.016,"15min":1.016},"max":{"1min":4.8440000000000003,"5min":606.49099999999999,"15min":606.49099999999999},"last":1.3799999999999999}]}]}]}} 2020-11-12T17:28:03.579 INFO:tasks.thrashosds.thrasher:Setting 5.9 to [0, 2] 2020-11-12T17:28:03.580 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '5.9', '0', '2'] 2020-11-12T17:28:03.580 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap 5.9 0 2 2020-11-12T17:28:03.581 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:03.581 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:03.587 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:28:03.626 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:03.462+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:03.626 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:03.530+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:03.626 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:03.326+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:03.634 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:03.628+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:03.692 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:03.708 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:03.709 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:28:03.736 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:03.734+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:03.838 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:03.832+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:03.861 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:03.862 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:03.867 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:28:03.881 INFO:teuthology.orchestra.run.smithi036.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-11-12T17:28:03.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:28:03.885 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap, ignoring 2020-11-12T17:28:03.938 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:03.936+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:03.985 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:03.985 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:04.000 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:28:04.134 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:04.128+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:04.235 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:04.232+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:04.342 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:04.344 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:04.344 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:04.345 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:28:04.346 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:04.342+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:04.445 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:04.442+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:04.468 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:04.468 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:04.478 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:28:04.510 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:04.537 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:04.546 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:04.542+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:04.563 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 78 16 63856 63840 6.39345 0 - 0.0188933 2020-11-12T17:28:04.565 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:04.585 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:04.586 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:28:04.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:28:04.586 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:28:04.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.586 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.6 123/122 [PushOp(4:60824407:::benchmark_data_smithi036_18856_object6950:head, version: 100'3208, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:60824407:::benchmark_data_smithi036_18856_object6950:head@100'3208, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:28:04.587 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:28:04.587 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 87.896355666999995, 2020-11-12T17:28:04.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998, 2020-11-12T17:28:04.587 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.587 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:04.587 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:28:04.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:28:04.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:28:04.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687268+0000", 2020-11-12T17:28:04.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2052999999999994e-05 2020-11-12T17:28:04.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687360+0000", 2020-11-12T17:28:04.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54419334699999999 2020-11-12T17:28:04.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231553+0000", 2020-11-12T17:28:04.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.362e-06 2020-11-12T17:28:04.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231560+0000", 2020-11-12T17:28:04.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000185682 2020-11-12T17:28:04.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231746+0000", 2020-11-12T17:28:04.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0793e-05 2020-11-12T17:28:04.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231797+0000", 2020-11-12T17:28:04.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003344549 2020-11-12T17:28:04.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.235141+0000", 2020-11-12T17:28:04.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998 2020-11-12T17:28:04.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.594 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.594 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11902 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:04.595 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:28:04.595 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.632592474999996, 2020-11-12T17:28:04.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002, 2020-11-12T17:28:04.595 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.595 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.595 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.595 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.596 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.596 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11902 2020-11-12T17:28:04.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.596 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:28:04.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:28:04.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:28:04.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950968+0000", 2020-11-12T17:28:04.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022604299999999999 2020-11-12T17:28:04.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951194+0000", 2020-11-12T17:28:04.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1806e-05 2020-11-12T17:28:04.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951226+0000", 2020-11-12T17:28:04.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5761999999999999e-05 2020-11-12T17:28:04.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951241+0000", 2020-11-12T17:28:04.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006854845 2020-11-12T17:28:04.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958096+0000", 2020-11-12T17:28:04.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026652700000000002 2020-11-12T17:28:04.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958363+0000", 2020-11-12T17:28:04.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000368857 2020-11-12T17:28:04.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:04.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958732+0000", 2020-11-12T17:28:04.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027531859999999999 2020-11-12T17:28:04.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961485+0000", 2020-11-12T17:28:04.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43528204399999998 2020-11-12T17:28:04.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396767+0000", 2020-11-12T17:28:04.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015781399999999999 2020-11-12T17:28:04.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396925+0000", 2020-11-12T17:28:04.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109403 2020-11-12T17:28:04.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397034+0000", 2020-11-12T17:28:04.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002 2020-11-12T17:28:04.605 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.606 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.606 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.606 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11903 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:04.606 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:28:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.631994929000001, 2020-11-12T17:28:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221, 2020-11-12T17:28:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.607 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11903 2020-11-12T17:28:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:28:04.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:28:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999228 2020-11-12T17:28:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951566+0000", 2020-11-12T17:28:04.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024334899999999999 2020-11-12T17:28:04.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951810+0000", 2020-11-12T17:28:04.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9034e-05 2020-11-12T17:28:04.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951839+0000", 2020-11-12T17:28:04.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4151000000000001e-05 2020-11-12T17:28:04.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951853+0000", 2020-11-12T17:28:04.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081211489999999994 2020-11-12T17:28:04.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.959974+0000", 2020-11-12T17:28:04.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013490799999999999 2020-11-12T17:28:04.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960109+0000", 2020-11-12T17:28:04.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000252172 2020-11-12T17:28:04.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960361+0000", 2020-11-12T17:28:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024598829999999999 2020-11-12T17:28:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962821+0000", 2020-11-12T17:28:04.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43434482000000002 2020-11-12T17:28:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397166+0000", 2020-11-12T17:28:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054200000000001 2020-11-12T17:28:04.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397296+0000", 2020-11-12T17:28:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5556000000000005e-05 2020-11-12T17:28:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397392+0000", 2020-11-12T17:28:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221 2020-11-12T17:28:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11904 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:28:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.629531814000003, 2020-11-12T17:28:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003, 2020-11-12T17:28:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.620 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.621 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.621 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11904 2020-11-12T17:28:04.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.622 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:28:04.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:28:04.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999237 2020-11-12T17:28:04.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954031+0000", 2020-11-12T17:28:04.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021660900000000001 2020-11-12T17:28:04.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954247+0000", 2020-11-12T17:28:04.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4606e-05 2020-11-12T17:28:04.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954282+0000", 2020-11-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.552e-05 2020-11-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954297+0000", 2020-11-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0072408330000000003 2020-11-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961538+0000", 2020-11-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013512800000000001 2020-11-12T17:28:04.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961673+0000", 2020-11-12T17:28:04.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023430200000000001 2020-11-12T17:28:04.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:04.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961908+0000", 2020-11-12T17:28:04.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016600740000000001 2020-11-12T17:28:04.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963568+0000", 2020-11-12T17:28:04.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43393070099999997 2020-11-12T17:28:04.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397499+0000", 2020-11-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012872 2020-11-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397627+0000", 2020-11-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4786999999999999e-05 2020-11-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397722+0000", 2020-11-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003 2020-11-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11909 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.621793117999999, 2020-11-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999, 2020-11-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.655 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11909 2020-11-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:28:04.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:28:04.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:28:04.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961803+0000", 2020-11-12T17:28:04.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9606999999999998e-05 2020-11-12T17:28:04.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961893+0000", 2020-11-12T17:28:04.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0258000000000001e-05 2020-11-12T17:28:04.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961903+0000", 2020-11-12T17:28:04.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8450000000000003e-06 2020-11-12T17:28:04.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961911+0000", 2020-11-12T17:28:04.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00090397899999999996 2020-11-12T17:28:04.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962815+0000", 2020-11-12T17:28:04.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106487 2020-11-12T17:28:04.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962921+0000", 2020-11-12T17:28:04.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027479400000000003 2020-11-12T17:28:04.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:04.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963196+0000", 2020-11-12T17:28:04.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002806041 2020-11-12T17:28:04.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966002+0000", 2020-11-12T17:28:04.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42403797700000001 2020-11-12T17:28:04.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390040+0000", 2020-11-12T17:28:04.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017360699999999999 2020-11-12T17:28:04.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390214+0000", 2020-11-12T17:28:04.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012036600000000001 2020-11-12T17:28:04.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390334+0000", 2020-11-12T17:28:04.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999 2020-11-12T17:28:04.665 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.665 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.665 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.666 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11910 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:04.666 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:28:04.666 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.620576826000004, 2020-11-12T17:28:04.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002, 2020-11-12T17:28:04.666 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.667 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.667 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.667 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.667 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.667 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11910 2020-11-12T17:28:04.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.667 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:28:04.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:28:04.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999413 2020-11-12T17:28:04.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963003+0000", 2020-11-12T17:28:04.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017848699999999999 2020-11-12T17:28:04.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963182+0000", 2020-11-12T17:28:04.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7229000000000001e-05 2020-11-12T17:28:04.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963199+0000", 2020-11-12T17:28:04.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2609999999999999e-06 2020-11-12T17:28:04.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963208+0000", 2020-11-12T17:28:04.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089699300000000001 2020-11-12T17:28:04.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.672 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.672 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964105+0000", 2020-11-12T17:28:04.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012321200000000001 2020-11-12T17:28:04.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964228+0000", 2020-11-12T17:28:04.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022185600000000001 2020-11-12T17:28:04.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:04.673 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964450+0000", 2020-11-12T17:28:04.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001555697 2020-11-12T17:28:04.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966006+0000", 2020-11-12T17:28:04.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42809403299999998 2020-11-12T17:28:04.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394100+0000", 2020-11-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012522 2020-11-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394225+0000", 2020-11-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014087 2020-11-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394366+0000", 2020-11-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002 2020-11-12T17:28:04.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.677 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11911 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.620347084000002, 2020-11-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998, 2020-11-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.678 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11911 2020-11-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.679 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999547 2020-11-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963246+0000", 2020-11-12T17:28:04.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000132867 2020-11-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963379+0000", 2020-11-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1556000000000002e-05 2020-11-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963401+0000", 2020-11-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2499999999999997e-05 2020-11-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963433+0000", 2020-11-12T17:28:04.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018380040000000001 2020-11-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965271+0000", 2020-11-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6691000000000002e-05 2020-11-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965338+0000", 2020-11-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100777 2020-11-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965439+0000", 2020-11-12T17:28:04.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001679198 2020-11-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967118+0000", 2020-11-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.435251412 2020-11-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402369+0000", 2020-11-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6074000000000005e-05 2020-11-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402435+0000", 2020-11-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6678999999999997e-05 2020-11-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402492+0000", 2020-11-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998 2020-11-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.688 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11912 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.617319133999999, 2020-11-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997, 2020-11-12T17:28:04.689 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11912 2020-11-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.690 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966296+0000", 2020-11-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6765000000000002e-05 2020-11-12T17:28:04.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966363+0000", 2020-11-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3097e-05 2020-11-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966376+0000", 2020-11-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0669999999999998e-06 2020-11-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966385+0000", 2020-11-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7963999999999997e-05 2020-11-12T17:28:04.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966433+0000", 2020-11-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0263999999999998e-05 2020-11-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966494+0000", 2020-11-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120279 2020-11-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966614+0000", 2020-11-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001180424 2020-11-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967794+0000", 2020-11-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43476916100000002 2020-11-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402563+0000", 2020-11-12T17:28:04.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7442999999999998e-05 2020-11-12T17:28:04.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402631+0000", 2020-11-12T17:28:04.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8424999999999998e-05 2020-11-12T17:28:04.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.699 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402679+0000", 2020-11-12T17:28:04.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997 2020-11-12T17:28:04.699 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.699 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.699 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.700 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:16064 5.a 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:28:04.700 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:28:04.700 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 61.088490559999997, 2020-11-12T17:28:04.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999, 2020-11-12T17:28:04.700 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.700 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.700 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.701 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.701 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 16064 2020-11-12T17:28:04.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.701 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:28:04.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:28:04.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:28:04.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495102+0000", 2020-11-12T17:28:04.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012806100000000001 2020-11-12T17:28:04.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495230+0000", 2020-11-12T17:28:04.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1214999999999999e-05 2020-11-12T17:28:04.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495251+0000", 2020-11-12T17:28:04.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1668000000000001e-05 2020-11-12T17:28:04.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495262+0000", 2020-11-12T17:28:04.705 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6068999999999994e-05 2020-11-12T17:28:04.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.705 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495329+0000", 2020-11-12T17:28:04.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011465599999999999 2020-11-12T17:28:04.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.706 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495443+0000", 2020-11-12T17:28:04.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000230077 2020-11-12T17:28:04.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:04.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495673+0000", 2020-11-12T17:28:04.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013291710000000001 2020-11-12T17:28:04.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.497002+0000", 2020-11-12T17:28:04.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69030446599999995 2020-11-12T17:28:04.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187307+0000", 2020-11-12T17:28:04.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011451999999999999 2020-11-12T17:28:04.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187421+0000", 2020-11-12T17:28:04.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5153000000000004e-05 2020-11-12T17:28:04.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187497+0000", 2020-11-12T17:28:04.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999 2020-11-12T17:28:04.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.710 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.710 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36040 5.a 5:5a4d50fb:::benchmark_data_smithi036_24110_object4504:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:28:04.710 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.529209+0000", 2020-11-12T17:28:04.711 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 40.054429251999998, 2020-11-12T17:28:04.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.413632096, 2020-11-12T17:28:04.711 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.711 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.711 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.711 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.711 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.711 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36040 2020-11-12T17:28:04.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.712 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529209+0000", 2020-11-12T17:28:04.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529209+0000", 2020-11-12T17:28:04.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:04.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529168+0000", 2020-11-12T17:28:04.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119506 2020-11-12T17:28:04.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.714 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529287+0000", 2020-11-12T17:28:04.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8187000000000001e-05 2020-11-12T17:28:04.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529305+0000", 2020-11-12T17:28:04.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6398000000000001e-05 2020-11-12T17:28:04.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.715 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.715 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529322+0000", 2020-11-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.004923256 2020-11-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.534245+0000", 2020-11-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015559699999999999 2020-11-12T17:28:04.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.534401+0000", 2020-11-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141383 2020-11-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.534542+0000", 2020-11-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001966364 2020-11-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.536508+0000", 2020-11-12T17:28:04.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.406177766 2020-11-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.942686+0000", 2020-11-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3378e-05 2020-11-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.942770+0000", 2020-11-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1925e-05 2020-11-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.942842+0000", 2020-11-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.413632096 2020-11-12T17:28:04.720 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:47368 5.d 5:bb02c29c:::benchmark_data_smithi036_24110_object5920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e156)", 2020-11-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:37.868932+0000", 2020-11-12T17:28:04.721 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.714706632999999, 2020-11-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.57837236700000005, 2020-11-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 47368 2020-11-12T17:28:04.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868932+0000", 2020-11-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868932+0000", 2020-11-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868914+0000", 2020-11-12T17:28:04.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1044999999999996e-05 2020-11-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868975+0000", 2020-11-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4759999999999998e-06 2020-11-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868984+0000", 2020-11-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9969999999999998e-06 2020-11-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868989+0000", 2020-11-12T17:28:04.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010214598 2020-11-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.879203+0000", 2020-11-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00045404100000000003 2020-11-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.879657+0000", 2020-11-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016182300000000001 2020-11-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.879819+0000", 2020-11-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002506416 2020-11-12T17:28:04.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.882326+0000", 2020-11-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56483934000000002 2020-11-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447165+0000", 2020-11-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6382000000000002e-05 2020-11-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447241+0000", 2020-11-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3171999999999998e-05 2020-11-12T17:28:04.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447304+0000", 2020-11-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.57837236700000005 2020-11-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:47368 5.d e157/127 ondisk, result = 0)", 2020-11-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:37.881979+0000", 2020-11-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.701660046000001, 2020-11-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56533648800000003, 2020-11-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.732 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:04.733 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.881979+0000", 2020-11-12T17:28:04.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.881979+0000", 2020-11-12T17:28:04.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999738 2020-11-12T17:28:04.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.881952+0000", 2020-11-12T17:28:04.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6735000000000004e-05 2020-11-12T17:28:04.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.882019+0000", 2020-11-12T17:28:04.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56217692500000005 2020-11-12T17:28:04.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.444196+0000", 2020-11-12T17:28:04.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9569999999999999e-06 2020-11-12T17:28:04.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.444202+0000", 2020-11-12T17:28:04.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002939863 2020-11-12T17:28:04.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447142+0000", 2020-11-12T17:28:04.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3016999999999999e-05 2020-11-12T17:28:04.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447155+0000", 2020-11-12T17:28:04.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016018200000000001 2020-11-12T17:28:04.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447315+0000", 2020-11-12T17:28:04.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56533648800000003 2020-11-12T17:28:04.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.739 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.739 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:47440 5.a 5:524d237b:::benchmark_data_smithi036_24110_object5929:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e157)", 2020-11-12T17:28:04.739 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:38.289101+0000", 2020-11-12T17:28:04.739 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.294537862999999, 2020-11-12T17:28:04.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42989421300000003, 2020-11-12T17:28:04.740 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.740 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.740 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.740 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.740 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.740 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 47440 2020-11-12T17:28:04.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.741 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.741 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289101+0000", 2020-11-12T17:28:04.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289101+0000", 2020-11-12T17:28:04.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999404 2020-11-12T17:28:04.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289041+0000", 2020-11-12T17:28:04.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016792000000000001 2020-11-12T17:28:04.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289209+0000", 2020-11-12T17:28:04.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7087e-05 2020-11-12T17:28:04.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289236+0000", 2020-11-12T17:28:04.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8799999999999997e-06 2020-11-12T17:28:04.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289245+0000", 2020-11-12T17:28:04.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.009443112 2020-11-12T17:28:04.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.298688+0000", 2020-11-12T17:28:04.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102744 2020-11-12T17:28:04.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.298791+0000", 2020-11-12T17:28:04.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000179529 2020-11-12T17:28:04.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:04.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.298970+0000", 2020-11-12T17:28:04.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021817910000000002 2020-11-12T17:28:04.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.301152+0000", 2020-11-12T17:28:04.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41777362099999998 2020-11-12T17:28:04.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718926+0000", 2020-11-12T17:28:04.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0852999999999997e-05 2020-11-12T17:28:04.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718967+0000", 2020-11-12T17:28:04.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8350000000000001e-05 2020-11-12T17:28:04.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718995+0000", 2020-11-12T17:28:04.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42989421300000003 2020-11-12T17:28:04.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.749 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.750 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:47440 5.a e157/127 ondisk, result = 0)", 2020-11-12T17:28:04.750 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:38.308251+0000", 2020-11-12T17:28:04.750 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.275387941999998, 2020-11-12T17:28:04.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41075154800000002, 2020-11-12T17:28:04.750 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.751 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:04.751 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.308251+0000", 2020-11-12T17:28:04.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.308251+0000", 2020-11-12T17:28:04.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:28:04.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.308207+0000", 2020-11-12T17:28:04.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011763400000000001 2020-11-12T17:28:04.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.308325+0000", 2020-11-12T17:28:04.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40919850400000002 2020-11-12T17:28:04.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.717524+0000", 2020-11-12T17:28:04.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1149999999999996e-06 2020-11-12T17:28:04.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.717531+0000", 2020-11-12T17:28:04.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013845350000000001 2020-11-12T17:28:04.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.755 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718915+0000", 2020-11-12T17:28:04.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:28:04.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.755 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718920+0000", 2020-11-12T17:28:04.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2062000000000001e-05 2020-11-12T17:28:04.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.719002+0000", 2020-11-12T17:28:04.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41075154800000002 2020-11-12T17:28:04.757 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.757 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.757 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.757 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:51080 5.8 e158/135 ondisk, result = 0)", 2020-11-12T17:28:04.757 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:42.698641+0000", 2020-11-12T17:28:04.757 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 21.884997370000001, 2020-11-12T17:28:04.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46923845800000002, 2020-11-12T17:28:04.758 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.758 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:04.758 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:42.698641+0000", 2020-11-12T17:28:04.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:42.698641+0000", 2020-11-12T17:28:04.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:28:04.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:42.698622+0000", 2020-11-12T17:28:04.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0272000000000003e-05 2020-11-12T17:28:04.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:42.698673+0000", 2020-11-12T17:28:04.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46684430399999999 2020-11-12T17:28:04.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.165517+0000", 2020-11-12T17:28:04.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9720000000000003e-06 2020-11-12T17:28:04.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.165521+0000", 2020-11-12T17:28:04.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002158975 2020-11-12T17:28:04.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.167680+0000", 2020-11-12T17:28:04.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4918e-05 2020-11-12T17:28:04.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.167695+0000", 2020-11-12T17:28:04.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018486500000000001 2020-11-12T17:28:04.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.167880+0000", 2020-11-12T17:28:04.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46923845800000002 2020-11-12T17:28:04.764 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.765 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.765 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.765 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:52600 5.a 5:5e833be2:::benchmark_data_smithi036_24110_object6574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e159)", 2020-11-12T17:28:04.765 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:44.608056+0000", 2020-11-12T17:28:04.765 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.975582878000001, 2020-11-12T17:28:04.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.512363283, 2020-11-12T17:28:04.766 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.766 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.766 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.766 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.766 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.766 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 52600 2020-11-12T17:28:04.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.767 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.767 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608056+0000", 2020-11-12T17:28:04.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608056+0000", 2020-11-12T17:28:04.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:04.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608020+0000", 2020-11-12T17:28:04.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5087999999999996e-05 2020-11-12T17:28:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608105+0000", 2020-11-12T17:28:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2513e-05 2020-11-12T17:28:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608118+0000", 2020-11-12T17:28:04.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0320000000000003e-06 2020-11-12T17:28:04.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608123+0000", 2020-11-12T17:28:04.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087713050000000001 2020-11-12T17:28:04.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.616894+0000", 2020-11-12T17:28:04.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7459000000000005e-05 2020-11-12T17:28:04.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.616971+0000", 2020-11-12T17:28:04.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116193 2020-11-12T17:28:04.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:04.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.617087+0000", 2020-11-12T17:28:04.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0062006379999999996 2020-11-12T17:28:04.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.623288+0000", 2020-11-12T17:28:04.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49692469700000003 2020-11-12T17:28:04.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120213+0000", 2020-11-12T17:28:04.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2360000000000004e-05 2020-11-12T17:28:04.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120295+0000", 2020-11-12T17:28:04.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000123917 2020-11-12T17:28:04.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.775 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.775 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120419+0000", 2020-11-12T17:28:04.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.512363283 2020-11-12T17:28:04.775 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.775 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.775 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.776 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:52600 5.a e159/127 ondisk, result = 0)", 2020-11-12T17:28:04.776 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:44.620241+0000", 2020-11-12T17:28:04.776 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 19.963397862000001, 2020-11-12T17:28:04.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50019401399999996, 2020-11-12T17:28:04.776 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.776 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:04.777 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.620241+0000", 2020-11-12T17:28:04.777 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.620241+0000", 2020-11-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.620215+0000", 2020-11-12T17:28:04.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4766999999999998e-05 2020-11-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.620280+0000", 2020-11-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49972755099999999 2020-11-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120007+0000", 2020-11-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.102e-05 2020-11-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120018+0000", 2020-11-12T17:28:04.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015120300000000001 2020-11-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120170+0000", 2020-11-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0275999999999999e-05 2020-11-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120200+0000", 2020-11-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023494 2020-11-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120435+0000", 2020-11-12T17:28:04.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50019401399999996 2020-11-12T17:28:04.783 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.783 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.783 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.783 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:62696 5.d 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:04.783 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:59.571028+0000", 2020-11-12T17:28:04.784 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.0126110940000004, 2020-11-12T17:28:04.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.714481692, 2020-11-12T17:28:04.784 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.784 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.784 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.784 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.784 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.784 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 62696 2020-11-12T17:28:04.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.785 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571028+0000", 2020-11-12T17:28:04.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571028+0000", 2020-11-12T17:28:04.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:28:04.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571005+0000", 2020-11-12T17:28:04.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1137999999999996e-05 2020-11-12T17:28:04.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.787 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571066+0000", 2020-11-12T17:28:04.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.516e-06 2020-11-12T17:28:04.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571076+0000", 2020-11-12T17:28:04.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8019999999999999e-06 2020-11-12T17:28:04.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.788 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.788 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.788 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571081+0000", 2020-11-12T17:28:04.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015302549999999999 2020-11-12T17:28:04.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.789 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.572611+0000", 2020-11-12T17:28:04.789 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104756 2020-11-12T17:28:04.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.572716+0000", 2020-11-12T17:28:04.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018723700000000001 2020-11-12T17:28:04.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:04.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.572903+0000", 2020-11-12T17:28:04.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066609590000000002 2020-11-12T17:28:04.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.579564+0000", 2020-11-12T17:28:04.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.70574321600000001 2020-11-12T17:28:04.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.285307+0000", 2020-11-12T17:28:04.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012079299999999999 2020-11-12T17:28:04.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.285428+0000", 2020-11-12T17:28:04.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1409999999999995e-05 2020-11-12T17:28:04.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.285509+0000", 2020-11-12T17:28:04.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.714481692 2020-11-12T17:28:04.793 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.793 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.794 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.794 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63136 5.d 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e173)", 2020-11-12T17:28:04.794 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.877330+0000", 2020-11-12T17:28:04.794 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.706308682, 2020-11-12T17:28:04.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59933710100000004, 2020-11-12T17:28:04.794 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.795 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:04.795 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.795 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.795 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.795 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63136 2020-11-12T17:28:04.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877330+0000", 2020-11-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877330+0000", 2020-11-12T17:28:04.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:04.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877290+0000", 2020-11-12T17:28:04.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018022900000000001 2020-11-12T17:28:04.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877470+0000", 2020-11-12T17:28:04.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6106000000000003e-05 2020-11-12T17:28:04.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877506+0000", 2020-11-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2989e-05 2020-11-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877519+0000", 2020-11-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016617435999999999 2020-11-12T17:28:04.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.894136+0000", 2020-11-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018983100000000001 2020-11-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:04.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.894326+0000", 2020-11-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019385100000000001 2020-11-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.894520+0000", 2020-11-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026166140000000002 2020-11-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.897137+0000", 2020-11-12T17:28:04.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.57945034500000003 2020-11-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.476587+0000", 2020-11-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6149000000000002e-05 2020-11-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.476623+0000", 2020-11-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3951e-05 2020-11-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.476667+0000", 2020-11-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59933710100000004 2020-11-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63136 5.d 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e173)", 2020-11-12T17:28:04.832 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.997193+0000", 2020-11-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.586445764, 2020-11-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47944447499999998, 2020-11-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:04.833 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63136 2020-11-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997193+0000", 2020-11-12T17:28:04.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997193+0000", 2020-11-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997174+0000", 2020-11-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0644999999999999e-05 2020-11-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997244+0000", 2020-11-12T17:28:04.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1749000000000001e-05 2020-11-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997256+0000", 2020-11-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:04.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997263+0000", 2020-11-12T17:28:04.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5563999999999999e-05 2020-11-12T17:28:04.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:04.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997309+0000", 2020-11-12T17:28:04.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4527999999999997e-05 2020-11-12T17:28:04.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:04.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997363+0000", 2020-11-12T17:28:04.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47927397900000002 2020-11-12T17:28:04.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:04.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:04.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:04.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.476637+0000", 2020-11-12T17:28:04.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47944447499999998 2020-11-12T17:28:04.840 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.840 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.840 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.840 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:04.840 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:04.840 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:04.841 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:28:04.843 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:04.843 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:04.844 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:04.844 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:04.844 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:04.844 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:04.844 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:04.845 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:04.845 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:04.845 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:04.845 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:04.845 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:04.845 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:04.846 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:04.838+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:04.846 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:28:04.943 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:04.942+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:04.993 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:28:04.994 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:05.003 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:28:05.051 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:05.048+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:05.108 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:28:05.109 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:05.118 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:28:05.146 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:05.142+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:05.247 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:05.246+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:05.273 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:05.273 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:28:05.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:28:05.273 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:28:05.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.274 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:28:05.274 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:28:05.274 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 300.16109479099998, 2020-11-12T17:28:05.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:28:05.275 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.275 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.275 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.275 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:05.275 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:05.275 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:28:05.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.276 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:28:05.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:28:05.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:28:05.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:28:05.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:28:05.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:28:05.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:28:05.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:28:05.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:28:05.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:28:05.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:28:05.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:28:05.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:28:05.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:05.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:28:05.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:28:05.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:28:05.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:28:05.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:28:05.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.285 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.286 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:28:05.286 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:28:05.286 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 300.15400299499998, 2020-11-12T17:28:05.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:28:05.287 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.287 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:05.287 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:28:05.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:28:05.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:28:05.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:28:05.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:28:05.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:28:05.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:28:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 290.72144349799999, 2020-11-12T17:28:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:28:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:28:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:28:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:28:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:28:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:28:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:28:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:28:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:28:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:28:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:28:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:28:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:28:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:28:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:28:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:28:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:28:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:28:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:28:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:28:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:28:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:28:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:28:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:28:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:28:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:28:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:28:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:28:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:28:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 256.77132340399999, 2020-11-12T17:28:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:28:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:28:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:28:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:28:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:28:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:28:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:28:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:28:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:28:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 254.665721512, 2020-11-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:28:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:28:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:28:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:28:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:28:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:28:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:28:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:28:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:28:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:28:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:28:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:28:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 223.31923817800001, 2020-11-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:28:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:28:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:28:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:28:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:28:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:28:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:28:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:28:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:28:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:28:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:28:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:28:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:28:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:28:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:28:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:28:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 214.32339637600001, 2020-11-12T17:28:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:28:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:28:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:28:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:28:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:28:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:28:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 210.38829297699999, 2020-11-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:28:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:28:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:28:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:28:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:28:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:28:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:28:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:28:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:28:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:15104 4.b e75/69 ondisk, result = 0)", 2020-11-12T17:28:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 179.623652486, 2020-11-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166, 2020-11-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646319+0000", 2020-11-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999852 2020-11-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646304+0000", 2020-11-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7163000000000003e-05 2020-11-12T17:28:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.646342+0000", 2020-11-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31531126199999998 2020-11-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961653+0000", 2020-11-12T17:28:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3550000000000001e-06 2020-11-12T17:28:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.961659+0000", 2020-11-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00072051700000000005 2020-11-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962380+0000", 2020-11-12T17:28:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962386+0000", 2020-11-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010436 2020-11-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:05.962491+0000", 2020-11-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.316171166 2020-11-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 173.36714380199999, 2020-11-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:28:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:28:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:28:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:28:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:28:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:28:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:28:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:28:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:28:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:28:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:28:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:28:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:28:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:28:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:28:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:28:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 173.36698143199999, 2020-11-12T17:28:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:28:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:28:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:28:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:28:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:28:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:28:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:28:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:28:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:28:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:28:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:28:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:28:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:28:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:28:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:28:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:28:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:28:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:28:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:28:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:28:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:28:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:28:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:28:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:28:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:28:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:28:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:28:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:21487 4.b e78/69 ondisk, result = 0)", 2020-11-12T17:28:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:28:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 173.358412445, 2020-11-12T17:28:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998, 2020-11-12T17:28:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:28:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911559+0000", 2020-11-12T17:28:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911523+0000", 2020-11-12T17:28:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8275000000000006e-05 2020-11-12T17:28:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.911592+0000", 2020-11-12T17:28:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33737477500000002 2020-11-12T17:28:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248966+0000", 2020-11-12T17:28:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1411e-05 2020-11-12T17:28:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.248978+0000", 2020-11-12T17:28:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0384000000000003e-05 2020-11-12T17:28:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249038+0000", 2020-11-12T17:28:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1608999999999999e-05 2020-11-12T17:28:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249060+0000", 2020-11-12T17:28:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000195117 2020-11-12T17:28:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249255+0000", 2020-11-12T17:28:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33769534499999998 2020-11-12T17:28:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.393 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:28:05.393 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:28:05.393 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 147.368351709, 2020-11-12T17:28:05.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:28:05.526 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.526 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.526 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.526 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:05.526 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:05.527 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:28:05.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.527 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:28:05.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:28:05.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:28:05.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:28:05.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:28:05.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:28:05.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:28:05.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:28:05.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:28:05.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.799 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:28:05.800 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.801 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 144.29503327699999, 2020-11-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:28:05.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 143.23938830099999, 2020-11-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.810 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.811 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:28:05.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:28:05.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:05.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.821 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.822 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 142.85118392999999, 2020-11-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:28:05.823 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.824 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:28:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:28:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:28:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:28:05.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:28:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:28:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:28:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:28:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:28:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:28:05.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:28:05.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:28:05.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:28:05.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:28:05.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:05.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:28:05.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:28:05.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:28:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:28:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:28:05.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.833 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:28:05.834 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 128.64472699800001, 2020-11-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:28:05.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:28:05.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:28:05.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:28:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:28:05.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:28:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:28:05.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:28:05.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:28:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:28:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:28:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:28:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:28:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:28:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:28:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:28:05.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:28:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:28:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:28:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:28:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:28:05.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:28:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:28:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:28:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:28:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:28:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:28:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:28:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 127.39552138099999, 2020-11-12T17:28:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:28:05.851 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:28:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:28:05.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:28:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:28:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:28:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:28:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:28:05.858 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:28:05.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:28:05.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:28:05.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:28:05.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:28:05.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:28:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:28:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:28:05.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:28:05.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:28:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:28:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:28:05.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:28:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:28:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:28:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:28:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:28:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:28:05.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:28:05.866 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.866 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.866 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.866 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:28:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:28:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 127.378561932, 2020-11-12T17:28:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:28:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:28:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:28:05.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:28:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:28:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:28:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:28:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:28:05.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:28:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:28:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:28:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:28:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:28:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:28:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:28:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:28:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:28:05.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(5.2 168/167 [PushOp(5:41867905:::benchmark_data_smithi036_24110_object139:head, version: 130'104, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:41867905:::benchmark_data_smithi036_24110_object139:head@130'104, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:28:05.938 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.025380+0000", 2020-11-12T17:28:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.244592052, 2020-11-12T17:28:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36060000800000003, 2020-11-12T17:28:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:05.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025380+0000", 2020-11-12T17:28:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025380+0000", 2020-11-12T17:28:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:28:05.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025355+0000", 2020-11-12T17:28:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8812000000000002e-05 2020-11-12T17:28:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025454+0000", 2020-11-12T17:28:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35809733300000002 2020-11-12T17:28:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383551+0000", 2020-11-12T17:28:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:28:05.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383559+0000", 2020-11-12T17:28:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1902000000000004e-05 2020-11-12T17:28:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383631+0000", 2020-11-12T17:28:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3990000000000004e-06 2020-11-12T17:28:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383640+0000", 2020-11-12T17:28:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023402269999999998 2020-11-12T17:28:05.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.385980+0000", 2020-11-12T17:28:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36060000800000003 2020-11-12T17:28:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.945 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:05.946 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:05.948 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:28:05.948 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 79 16 63856 63840 6.31251 0 - 0.0188933 2020-11-12T17:28:05.949 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:05.944+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:06.010 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:28:06.048 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:06.046+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:06.097 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:06.098 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:06.098 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:28:06.098 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:06.107 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:28:06.154 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:06.152+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:06.217 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:28:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:28:06.218 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:06.227 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:28:06.271 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:06.268+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:06.352 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:06.354+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:06.391 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:06.391 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:28:06.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:28:06.392 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:28:06.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:06.392 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:07.187 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:28:07.187 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 291.96965012099997, 2020-11-12T17:28:07.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:28:07.188 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.188 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.188 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.188 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:07.188 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:07.188 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:28:07.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.189 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:28:07.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.190 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:28:07.190 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:28:07.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.190 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:28:07.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:28:07.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:28:07.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:28:07.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:28:07.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:28:07.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:28:07.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:28:07.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:28:07.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:28:07.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:28:07.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:28:07.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:07.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:28:07.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:28:07.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:28:07.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:28:07.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:28:07.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:28:07.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.198 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.198 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:28:07.198 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:28:07.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.199 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.199 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:28:07.199 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:28:07.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.200 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.200 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.200 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:28:07.200 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:28:07.201 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 291.96270605900003, 2020-11-12T17:28:07.201 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:28:07.201 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.201 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:07.201 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.202 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.202 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:28:07.202 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.203 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.203 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:28:07.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:07.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.203 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:28:07.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:28:07.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:28:07.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:28:07.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:28:07.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:28:07.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.207 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:28:07.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:28:07.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.208 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.208 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:28:07.208 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:28:07.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.209 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.209 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:28:07.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:28:07.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:28:07.210 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:28:07.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.210 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:28:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:28:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 255.78886827299999, 2020-11-12T17:28:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:28:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.211 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:07.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:07.212 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:28:07.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.212 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:28:07.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:28:07.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:28:07.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:28:07.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:28:07.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:28:07.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:28:07.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:28:07.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:28:07.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:28:07.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:28:07.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:28:07.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:28:07.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:28:07.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:28:07.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:28:07.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:28:07.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:28:07.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:28:07.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:28:07.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:28:07.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:28:07.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:28:07.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:28:07.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:28:07.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:28:07.222 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.222 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.223 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.223 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:28:07.223 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:28:07.223 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 239.52516317999999, 2020-11-12T17:28:07.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:28:07.224 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.224 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.224 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:07.225 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:07.225 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:28:07.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.225 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:28:07.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:28:07.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:07.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:28:07.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:28:07.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:28:07.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:28:07.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:28:07.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:28:07.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:28:07.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:28:07.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:28:07.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:28:07.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:28:07.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:28:07.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:07.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:28:07.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:28:07.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:28:07.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:28:07.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:28:07.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:28:07.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:28:07.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:28:07.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:28:07.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:28:07.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.235 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.236 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:28:07.236 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:28:07.236 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 224.43978285399999, 2020-11-12T17:28:07.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:28:07.236 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.237 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.237 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:28:07.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:28:07.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:07.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:28:07.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:28:07.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:28:07.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:28:07.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:28:07.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:28:07.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:28:07.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:28:07.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:28:07.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:28:07.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:28:07.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:28:07.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:28:07.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:28:07.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:28:07.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:28:07.244 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.245 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.245 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.245 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:28:07.245 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:28:07.245 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 222.74564458, 2020-11-12T17:28:07.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:28:07.246 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.246 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.246 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.246 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:07.246 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:07.246 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:28:07.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.247 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:28:07.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:28:07.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:28:07.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:28:07.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:28:07.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:28:07.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:28:07.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:28:07.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:28:07.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:28:07.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:28:07.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:28:07.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:28:07.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:28:07.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:28:07.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:07.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:28:07.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:28:07.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:28:07.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:28:07.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:28:07.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:28:07.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:28:07.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:28:07.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:28:07.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:28:07.257 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.257 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.257 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.258 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:30608 4.0 4:00e13226:::benchmark_data_smithi036_18856_object3825:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e83)", 2020-11-12T17:28:07.258 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:28:07.258 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 165.07640585799999, 2020-11-12T17:28:07.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999, 2020-11-12T17:28:07.258 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.259 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.259 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.259 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:07.259 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:07.259 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30608 2020-11-12T17:28:07.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.259 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:28:07.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311733+0000", 2020-11-12T17:28:07.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:07.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311692+0000", 2020-11-12T17:28:07.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111506 2020-11-12T17:28:07.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311804+0000", 2020-11-12T17:28:07.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7025999999999999e-05 2020-11-12T17:28:07.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311821+0000", 2020-11-12T17:28:07.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1509999999999993e-06 2020-11-12T17:28:07.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.311830+0000", 2020-11-12T17:28:07.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0068827769999999996 2020-11-12T17:28:07.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318713+0000", 2020-11-12T17:28:07.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2622999999999997e-05 2020-11-12T17:28:07.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318806+0000", 2020-11-12T17:28:07.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015780699999999999 2020-11-12T17:28:07.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:07.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.318963+0000", 2020-11-12T17:28:07.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001520775 2020-11-12T17:28:07.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.320484+0000", 2020-11-12T17:28:07.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.356903097 2020-11-12T17:28:07.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677387+0000", 2020-11-12T17:28:07.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8049999999999999e-05 2020-11-12T17:28:07.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677475+0000", 2020-11-12T17:28:07.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6146999999999999e-05 2020-11-12T17:28:07.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:21.677571+0000", 2020-11-12T17:28:07.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36583891699999999 2020-11-12T17:28:07.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.269 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.270 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:34936 4.0 4:06d5dbcc:::benchmark_data_smithi036_18856_object4366:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e85)", 2020-11-12T17:28:07.270 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:28:07.270 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 160.50914764999999, 2020-11-12T17:28:07.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002, 2020-11-12T17:28:07.270 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.271 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.271 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.271 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:07.271 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:07.271 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 34936 2020-11-12T17:28:07.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.272 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:28:07.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878991+0000", 2020-11-12T17:28:07.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999614 2020-11-12T17:28:07.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.878952+0000", 2020-11-12T17:28:07.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111755 2020-11-12T17:28:07.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879064+0000", 2020-11-12T17:28:07.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8607e-05 2020-11-12T17:28:07.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879082+0000", 2020-11-12T17:28:07.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.893e-06 2020-11-12T17:28:07.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.879092+0000", 2020-11-12T17:28:07.276 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049818800000000002 2020-11-12T17:28:07.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.276 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.276 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884074+0000", 2020-11-12T17:28:07.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5186999999999996e-05 2020-11-12T17:28:07.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884159+0000", 2020-11-12T17:28:07.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001416 2020-11-12T17:28:07.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:07.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.884301+0000", 2020-11-12T17:28:07.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003801628 2020-11-12T17:28:07.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:25.888103+0000", 2020-11-12T17:28:07.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35022745700000002 2020-11-12T17:28:07.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238330+0000", 2020-11-12T17:28:07.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5797999999999996e-05 2020-11-12T17:28:07.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238396+0000", 2020-11-12T17:28:07.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6578e-05 2020-11-12T17:28:07.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:26.238442+0000", 2020-11-12T17:28:07.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35945162800000002 2020-11-12T17:28:07.281 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.281 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.282 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.282 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:28:07.282 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:28:07.282 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 154.48223303, 2020-11-12T17:28:07.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:28:07.283 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.283 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.283 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.283 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:07.283 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:07.283 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:28:07.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.284 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:28:07.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:28:07.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:28:07.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:28:07.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:28:07.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:28:07.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:28:07.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:28:07.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:28:07.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:28:07.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:28:07.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:28:07.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:28:07.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:28:07.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:28:07.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:07.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:28:07.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:28:07.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:28:07.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:28:07.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:28:07.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:28:07.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:28:07.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:28:07.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:28:07.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:28:07.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.293 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.294 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:28:07.294 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:28:07.294 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 149.67979413200001, 2020-11-12T17:28:07.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:28:07.294 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.295 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:07.295 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:07.295 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:28:07.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.295 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:28:07.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:28:07.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:07.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.297 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:28:07.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:28:07.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:28:07.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:28:07.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:28:07.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:28:07.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:28:07.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:28:07.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:28:07.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:28:07.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:28:07.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:28:07.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:07.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:28:07.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:28:07.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:28:07.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:28:07.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:28:07.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:28:07.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:28:07.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:28:07.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.306 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:28:07.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:28:07.306 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.306 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.306 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.307 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:28:07.307 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:28:07.307 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 149.600671815, 2020-11-12T17:28:07.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:28:07.307 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.308 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.308 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.308 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:07.308 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:07.308 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:28:07.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.309 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:28:07.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:28:07.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:28:07.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:28:07.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:28:07.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:28:07.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:28:07.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:28:07.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:28:07.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:28:07.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:28:07.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:28:07.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:28:07.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:28:07.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:28:07.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:07.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:28:07.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:28:07.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:28:07.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:28:07.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:28:07.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:28:07.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:28:07.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:28:07.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:28:07.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:28:07.318 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.318 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.318 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.319 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:28:07.319 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:28:07.319 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 124.818320848, 2020-11-12T17:28:07.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:28:07.319 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.319 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.319 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.320 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:07.320 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:07.320 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:28:07.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.320 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:28:07.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:28:07.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:28:07.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:28:07.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:28:07.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:28:07.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:28:07.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:28:07.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:28:07.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:28:07.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:28:07.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:28:07.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:28:07.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:28:07.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:28:07.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:07.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:28:07.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:28:07.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:28:07.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:28:07.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:28:07.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:28:07.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:28:07.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:28:07.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:28:07.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:28:07.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.330 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.331 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:73552 4.0 4:0df96463:::benchmark_data_smithi036_18856_object9193:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e110)", 2020-11-12T17:28:07.331 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:28:07.331 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 109.35527849899999, 2020-11-12T17:28:07.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999, 2020-11-12T17:28:07.331 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.331 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.331 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.332 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:07.332 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:07.332 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 73552 2020-11-12T17:28:07.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.332 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:28:07.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032860+0000", 2020-11-12T17:28:07.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999318 2020-11-12T17:28:07.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032792+0000", 2020-11-12T17:28:07.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014316 2020-11-12T17:28:07.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032935+0000", 2020-11-12T17:28:07.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6855e-05 2020-11-12T17:28:07.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032952+0000", 2020-11-12T17:28:07.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7539999999999995e-06 2020-11-12T17:28:07.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.032961+0000", 2020-11-12T17:28:07.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.017841427999999999 2020-11-12T17:28:07.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050802+0000", 2020-11-12T17:28:07.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6639999999999996e-05 2020-11-12T17:28:07.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.050899+0000", 2020-11-12T17:28:07.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012059 2020-11-12T17:28:07.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:07.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.051019+0000", 2020-11-12T17:28:07.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048465189999999997 2020-11-12T17:28:07.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.339 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.339 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.055866+0000", 2020-11-12T17:28:07.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34074205200000002 2020-11-12T17:28:07.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396608+0000", 2020-11-12T17:28:07.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4420999999999997e-05 2020-11-12T17:28:07.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396692+0000", 2020-11-12T17:28:07.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3012e-05 2020-11-12T17:28:07.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:17.396745+0000", 2020-11-12T17:28:07.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36388536799999999 2020-11-12T17:28:07.342 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.342 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.342 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.342 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:28:07.342 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:28:07.343 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 64.333519347999996, 2020-11-12T17:28:07.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:28:07.343 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.343 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.343 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.343 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:07.344 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:07.344 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:28:07.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.344 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:28:07.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:28:07.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:07.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:28:07.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:28:07.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:28:07.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:28:07.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:28:07.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:28:07.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.348 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:28:07.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:28:07.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:28:07.349 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:28:07.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.349 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.349 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:28:07.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:28:07.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.350 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:07.350 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:28:07.350 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:28:07.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.351 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.351 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:28:07.351 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:28:07.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:28:07.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:28:07.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:28:07.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:28:07.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:28:07.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:28:07.353 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.354 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.354 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.354 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:28:07.354 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:28:07.355 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 42.272159678000001, 2020-11-12T17:28:07.355 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:28:07.355 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.355 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.355 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.355 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:07.355 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:07.356 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:28:07.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.356 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.356 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.356 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:28:07.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.357 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.357 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:28:07.357 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:28:07.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.358 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.358 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:28:07.358 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:28:07.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:28:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:28:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.359 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:28:07.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:28:07.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.360 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.360 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:28:07.360 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:28:07.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.361 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.361 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:28:07.361 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:28:07.361 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.361 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:28:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:28:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.362 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:28:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:28:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:28:07.363 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:28:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:28:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:28:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.364 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:28:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:28:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:28:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:28:07.365 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36416 5.0 5:05125f34:::benchmark_data_smithi036_24110_object4551:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:28:07.366 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:28:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 41.414431653000001, 2020-11-12T17:28:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002, 2020-11-12T17:28:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:07.367 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36416 2020-11-12T17:28:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:28:07.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973707+0000", 2020-11-12T17:28:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999959 2020-11-12T17:28:07.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973666+0000", 2020-11-12T17:28:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000117633 2020-11-12T17:28:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.370 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973783+0000", 2020-11-12T17:28:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6325999999999999e-05 2020-11-12T17:28:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973800+0000", 2020-11-12T17:28:07.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:28:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.973807+0000", 2020-11-12T17:28:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054509620000000002 2020-11-12T17:28:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979258+0000", 2020-11-12T17:28:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1768999999999996e-05 2020-11-12T17:28:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979340+0000", 2020-11-12T17:28:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107278 2020-11-12T17:28:07.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979447+0000", 2020-11-12T17:28:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.005025753 2020-11-12T17:28:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.984473+0000", 2020-11-12T17:28:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35634463199999999 2020-11-12T17:28:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340818+0000", 2020-11-12T17:28:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3640000000000001e-05 2020-11-12T17:28:07.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340871+0000", 2020-11-12T17:28:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2222999999999998e-05 2020-11-12T17:28:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340924+0000", 2020-11-12T17:28:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36721694100000002 2020-11-12T17:28:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:59192 5.0 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e168)", 2020-11-12T17:28:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:28:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 12.585460886, 2020-11-12T17:28:07.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003, 2020-11-12T17:28:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:07.380 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 59192 2020-11-12T17:28:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:28:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:28:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802660+0000", 2020-11-12T17:28:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9094000000000001e-05 2020-11-12T17:28:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802709+0000", 2020-11-12T17:28:07.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9580000000000004e-06 2020-11-12T17:28:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802715+0000", 2020-11-12T17:28:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0690000000000002e-06 2020-11-12T17:28:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802719+0000", 2020-11-12T17:28:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010962786 2020-11-12T17:28:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813681+0000", 2020-11-12T17:28:07.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011702 2020-11-12T17:28:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813798+0000", 2020-11-12T17:28:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187436 2020-11-12T17:28:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813986+0000", 2020-11-12T17:28:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020009369999999999 2020-11-12T17:28:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.815987+0000", 2020-11-12T17:28:07.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46767350899999999 2020-11-12T17:28:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283660+0000", 2020-11-12T17:28:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3396e-05 2020-11-12T17:28:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283734+0000", 2020-11-12T17:28:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0195999999999998e-05 2020-11-12T17:28:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283784+0000", 2020-11-12T17:28:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003 2020-11-12T17:28:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59360 5.1 e169/127 5:8e053221:::benchmark_data_smithi036_24110_object7419:head v 169'3752, mlcod=169'3747)", 2020-11-12T17:28:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:28:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.686973614999999, 2020-11-12T17:28:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999, 2020-11-12T17:28:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.391 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:28:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:28:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:28:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701143+0000", 2020-11-12T17:28:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4913000000000006e-05 2020-11-12T17:28:07.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701218+0000", 2020-11-12T17:28:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45075755000000001 2020-11-12T17:28:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151975+0000", 2020-11-12T17:28:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7439999999999996e-06 2020-11-12T17:28:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151984+0000", 2020-11-12T17:28:07.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5661000000000001e-05 2020-11-12T17:28:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152040+0000", 2020-11-12T17:28:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0267e-05 2020-11-12T17:28:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152070+0000", 2020-11-12T17:28:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027662300000000002 2020-11-12T17:28:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154836+0000", 2020-11-12T17:28:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0707e-05 2020-11-12T17:28:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154897+0000", 2020-11-12T17:28:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999 2020-11-12T17:28:07.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:62424 5.1 e171/127 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head v 171'3992, mlcod=171'3984)", 2020-11-12T17:28:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:28:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 7.1892129779999996, 2020-11-12T17:28:07.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437, 2020-11-12T17:28:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:28:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:28:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:28:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198896+0000", 2020-11-12T17:28:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9000999999999997e-05 2020-11-12T17:28:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198985+0000", 2020-11-12T17:28:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48058147200000001 2020-11-12T17:28:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679566+0000", 2020-11-12T17:28:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9140000000000003e-06 2020-11-12T17:28:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679576+0000", 2020-11-12T17:28:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1407000000000003e-05 2020-11-12T17:28:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679647+0000", 2020-11-12T17:28:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1270999999999999e-05 2020-11-12T17:28:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679679+0000", 2020-11-12T17:28:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002926648 2020-11-12T17:28:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682605+0000", 2020-11-12T17:28:07.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1626999999999998e-05 2020-11-12T17:28:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.407 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682667+0000", 2020-11-12T17:28:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437 2020-11-12T17:28:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.408 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63008 5.0 5:0fbe378e:::benchmark_data_smithi036_24110_object7875:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e173)", 2020-11-12T17:28:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.704621+0000", 2020-11-12T17:28:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.6835176609999998, 2020-11-12T17:28:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.363300179, 2020-11-12T17:28:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:07.409 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63008 2020-11-12T17:28:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:07.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.704621+0000", 2020-11-12T17:28:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.704621+0000", 2020-11-12T17:28:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999747 2020-11-12T17:28:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.704596+0000", 2020-11-12T17:28:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9361000000000002e-05 2020-11-12T17:28:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:07.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.704665+0000", 2020-11-12T17:28:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4853e-05 2020-11-12T17:28:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.704680+0000", 2020-11-12T17:28:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8169999999999999e-06 2020-11-12T17:28:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.704688+0000", 2020-11-12T17:28:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.018691570000000001 2020-11-12T17:28:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:07.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.723379+0000", 2020-11-12T17:28:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014404500000000001 2020-11-12T17:28:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.723523+0000", 2020-11-12T17:28:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002130257 2020-11-12T17:28:07.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.725653+0000", 2020-11-12T17:28:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00356727 2020-11-12T17:28:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.729221+0000", 2020-11-12T17:28:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33854121500000001 2020-11-12T17:28:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.067762+0000", 2020-11-12T17:28:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5127e-05 2020-11-12T17:28:07.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.067847+0000", 2020-11-12T17:28:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3879000000000002e-05 2020-11-12T17:28:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:07.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.067921+0000", 2020-11-12T17:28:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.363300179 2020-11-12T17:28:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:07.419 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:07.420 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:07.420 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:07.422 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:28:06.564912+0000 min lat: 0.00209322 max lat: 2.20267 avg lat: 0.0188933 2020-11-12T17:28:07.422 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:28:07.422 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 80 16 63856 63840 6.23361 0 - 0.0188933 2020-11-12T17:28:07.423 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:07.418+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:07.423 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:07.522 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:07.516+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:07.538 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:07.539 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:07.539 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:28:07.539 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:07.549 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:07.563 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 81 16 63856 63840 6.15665 0 - 0.0188933 2020-11-12T17:28:07.623 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:07.620+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:07.628 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:07.659 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:07.659 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:07.660 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:07.660 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:07.660 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:07.660 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:07.669 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:07.685 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:07.715 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:07.723 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:07.720+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:07.743 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:07.772 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:07.773 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:07.773 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:07.782 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:07.806 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:07.825 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:07.820+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:07.834 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:07.837 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:07.837 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:07.837 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:07.837 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:07.837 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:07.837 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:07.838 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:07.838 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:07.886 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:07.886 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:07.895 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:07.925 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:07.924+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:08.002 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:08.184 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:08.185 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:28:08.187 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:08.186+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:08.188 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:08.288 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:08.284+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:08.349 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:08.361 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:08.363 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:08.411 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:08.410+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:08.477 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:08.619 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:08.621 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 82 16 63856 63840 6.08156 0 - 0.0188933 2020-11-12T17:28:08.622 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:08.623 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:08.620+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:08.722 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:08.718+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:08.775 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:08.812 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:08.814 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:08.855 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:08.854+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:08.886 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1, 0] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:09.080 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:09.081 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-11-12T17:28:09.083 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:09.083 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:09.084 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:09.085 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:09.082+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:09.184 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:09.182+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:09.243 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:09.277 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:09.279 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:09.351 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:09.348+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:09.373 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:28:09.404 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:09.404 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 176, 2020-11-12T17:28:09.404 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:28:09.404 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2020-11-12T17:22:37.581394+0000", 2020-11-12T17:28:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2020-11-12T17:28:05.990035+0000", 2020-11-12T17:28:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2020-11-12T17:25:55.942493+0000", 2020-11-12T17:28:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2020-11-12T17:27:52.446296+0000", 2020-11-12T17:28:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-12T17:28:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5801984, 2020-11-12T17:28:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2020-11-12T17:28:09.405 INFO:teuthology.orchestra.run.smithi036.stdout: "noscrub", 2020-11-12T17:28:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2020-11-12T17:28:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2020-11-12T17:28:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2020-11-12T17:28:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2020-11-12T17:28:09.406 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 4, 2020-11-12T17:28:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2020-11-12T17:28:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-12T17:28:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-12T17:28:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2020-11-12T17:28:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 5, 2020-11-12T17:28:09.407 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2020-11-12T17:28:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2020-11-12T17:28:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2020-11-12T17:28:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2020-11-12T17:28:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2020-11-12T17:28:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2020-11-12T17:28:09.408 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2020-11-12T17:28:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:41.596657+0000", 2020-11-12T17:28:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:28:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:28:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:28:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:28:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:28:09.409 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:28:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:28:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:28:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2020-11-12T17:28:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2020-11-12T17:28:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2020-11-12T17:28:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2020-11-12T17:28:09.410 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2020-11-12T17:28:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:28:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:28:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:28:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:28:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:28:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:28:09.411 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:28:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "16", 2020-11-12T17:28:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:28:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:28:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:28:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:28:09.412 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:28:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:28:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:28:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:28:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:28:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:28:09.413 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:28:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:28:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:28:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:28:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:28:09.414 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:28:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:28:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:28:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:28:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:28:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:28:09.415 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:28:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:28:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:28:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:28:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:28:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:28:09.416 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:28:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:28:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:28:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:28:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:28:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:28:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:28:09.417 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:28:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:28:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:28:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2020-11-12T17:28:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2020-11-12T17:28:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:28:09.418 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2020-11-12T17:28:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2020-11-12T17:28:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2020-11-12T17:28:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:49.905816+0000", 2020-11-12T17:28:09.419 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:28:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:28:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:28:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:28:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:28:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:28:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:28:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:28:09.420 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 18, 2020-11-12T17:28:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 18, 2020-11-12T17:28:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 18, 2020-11-12T17:28:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 18, 2020-11-12T17:28:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 18, 2020-11-12T17:28:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:28:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:28:09.421 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:28:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:28:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:28:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:28:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:28:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "165", 2020-11-12T17:28:09.422 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:28:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:28:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "163", 2020-11-12T17:28:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:28:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:28:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:28:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:28:09.423 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:28:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:28:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:28:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:28:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:28:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:28:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:28:09.424 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:28:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:28:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:28:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:28:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:28:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:28:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:28:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:28:09.425 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:28:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:28:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:28:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:28:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:28:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:28:09.426 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:28:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:28:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:28:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:28:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:28:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:28:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:28:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:28:09.427 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:28:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:28:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:28:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2020-11-12T17:28:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 5, 2020-11-12T17:28:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "unique_pool_2", 2020-11-12T17:28:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:26:43.854598+0000", 2020-11-12T17:28:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:28:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:28:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:28:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:28:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:28:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:28:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:28:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:28:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 16, 2020-11-12T17:28:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 16, 2020-11-12T17:28:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 16, 2020-11-12T17:28:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 16, 2020-11-12T17:28:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 16, 2020-11-12T17:28:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:28:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:28:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:28:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:28:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:28:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:28:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:28:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "129", 2020-11-12T17:28:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:28:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:28:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:28:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:28:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:28:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:28:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:28:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:28:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:28:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:28:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:28:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:28:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:28:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:28:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:28:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:28:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:28:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:28:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:28:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:28:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:28:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:28:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:28:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:28:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:28:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:28:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:28:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:28:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:28:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:28:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:28:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:28:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:28:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:28:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:28:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:28:09.436 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:28:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:28:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:28:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: "rados": {} 2020-11-12T17:28:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2020-11-12T17:28:09.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:28:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "bd1d5457-5d54-4074-b378-9da417f42976", 2020-11-12T17:28:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:09.438 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 174, 2020-11-12T17:28:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6801", 2020-11-12T17:28:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.440 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2020-11-12T17:28:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.442 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:09.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.442 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2020-11-12T17:28:09.442 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:09.442 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2020-11-12T17:28:09.443 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6801/12304", 2020-11-12T17:28:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6802/12304", 2020-11-12T17:28:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6806/12304", 2020-11-12T17:28:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6804/12304", 2020-11-12T17:28:09.444 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:28:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "37152eee-a8d8-40f1-8e27-2899e7b94c98", 2020-11-12T17:28:09.445 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:09.446 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:09.446 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:09.446 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:09.446 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:28:09.446 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 57, 2020-11-12T17:28:09.446 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 88, 2020-11-12T17:28:09.446 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 171, 2020-11-12T17:28:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 58, 2020-11-12T17:28:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2020-11-12T17:28:09.447 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.448 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2020-11-12T17:28:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.449 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2020-11-12T17:28:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:09.450 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2020-11-12T17:28:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.451 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/20274", 2020-11-12T17:28:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6814/20274", 2020-11-12T17:28:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6816/20274", 2020-11-12T17:28:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6815/20274", 2020-11-12T17:28:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:28:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "d8ec2abb-38bf-4863-969a-482c4fa44f41", 2020-11-12T17:28:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:09.453 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:28:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 93, 2020-11-12T17:28:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 102, 2020-11-12T17:28:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 167, 2020-11-12T17:28:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 94, 2020-11-12T17:28:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:09.454 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2020-11-12T17:28:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2020-11-12T17:28:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:09.456 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2020-11-12T17:28:09.457 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2020-11-12T17:28:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/21493", 2020-11-12T17:28:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/21493", 2020-11-12T17:28:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6808/21493", 2020-11-12T17:28:09.459 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/21493", 2020-11-12T17:28:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.460 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:28:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "799d3499-577c-4510-a00c-9b2e126fc449", 2020-11-12T17:28:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:09.461 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:28:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.462 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2020-11-12T17:28:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.463 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2020-11-12T17:28:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:09.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2020-11-12T17:28:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.465 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2020-11-12T17:28:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6809/12305", 2020-11-12T17:28:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6810/12305", 2020-11-12T17:28:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6813/12305", 2020-11-12T17:28:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6811/12305", 2020-11-12T17:28:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:09.467 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:28:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "c36e3100-aadc-4117-b495-24fb08a34148", 2020-11-12T17:28:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:09.468 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 167, 2020-11-12T17:28:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:09.469 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6804", 2020-11-12T17:28:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6805", 2020-11-12T17:28:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:09.471 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6807", 2020-11-12T17:28:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6806", 2020-11-12T17:28:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.474 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6804/12499", 2020-11-12T17:28:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6805/12499", 2020-11-12T17:28:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6807/12499", 2020-11-12T17:28:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6806/12499", 2020-11-12T17:28:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:28:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "b152141f-b530-448e-8dff-fe200559eff0", 2020-11-12T17:28:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:09.476 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 173, 2020-11-12T17:28:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6808", 2020-11-12T17:28:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.478 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6810", 2020-11-12T17:28:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.479 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6814", 2020-11-12T17:28:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:09.480 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6812", 2020-11-12T17:28:09.481 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6808/12525", 2020-11-12T17:28:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6810/12525", 2020-11-12T17:28:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6814/12525", 2020-11-12T17:28:09.482 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6812/12525", 2020-11-12T17:28:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.483 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:28:09.493 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "62a140ba-7f94-4bb6-8a62-fda077f81354", 2020-11-12T17:28:09.494 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:09.494 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:09.494 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:09.494 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:09.494 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:09.495 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:09.495 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:09.495 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 167, 2020-11-12T17:28:09.495 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:09.495 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:09.636 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:09.637 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.637 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.637 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6809", 2020-11-12T17:28:09.637 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:09.637 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.638 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.638 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:09.638 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.638 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.638 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6811", 2020-11-12T17:28:09.639 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:09.639 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.639 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.639 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:09.639 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.640 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.640 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6815", 2020-11-12T17:28:09.640 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:09.640 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.641 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.641 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:09.641 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.641 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.641 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6813", 2020-11-12T17:28:09.642 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:09.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.642 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.642 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6809/12524", 2020-11-12T17:28:09.642 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6811/12524", 2020-11-12T17:28:09.642 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6815/12524", 2020-11-12T17:28:09.643 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6813/12524", 2020-11-12T17:28:09.643 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:09.643 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:09.643 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:09.643 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.644 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:28:09.644 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "32879bd7-780c-4da6-9838-5850b6277902", 2020-11-12T17:28:09.644 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:09.644 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:09.644 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:09.645 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 0, 2020-11-12T17:28:09.645 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:09.645 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:09.645 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:09.645 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 135, 2020-11-12T17:28:09.645 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:09.645 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:09.646 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:09.646 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.646 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.646 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6800", 2020-11-12T17:28:09.646 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:09.646 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.647 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.647 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:09.647 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.647 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.647 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6801", 2020-11-12T17:28:09.648 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:09.648 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.648 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.648 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:09.651 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.652 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.652 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6803", 2020-11-12T17:28:09.652 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:09.652 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.652 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.652 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:09.653 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:09.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.653 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:09.653 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6802", 2020-11-12T17:28:09.653 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:09.653 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.653 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.654 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6800/12522", 2020-11-12T17:28:09.654 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6801/12522", 2020-11-12T17:28:09.654 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6803/12522", 2020-11-12T17:28:09.654 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6802/12522", 2020-11-12T17:28:09.655 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:09.655 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:09.655 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:09.655 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:09.655 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.656 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:09.656 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2020-11-12T17:28:09.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.656 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:28:09.656 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:09.656 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:09.656 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:09.656 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:09.657 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:09.657 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:44.606542+0000", 2020-11-12T17:28:09.657 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:09.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.657 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:28:09.658 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:09.658 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:09.658 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:09.658 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:09.658 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:09.658 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:33.512821+0000", 2020-11-12T17:28:09.658 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 58 2020-11-12T17:28:09.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.659 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:28:09.659 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:09.659 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:09.660 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:09.660 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:09.660 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:09.661 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:57.104840+0000", 2020-11-12T17:28:09.661 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 94 2020-11-12T17:28:09.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.662 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:28:09.662 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:09.663 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:09.663 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:09.664 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:09.664 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:09.664 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:47.239812+0000", 2020-11-12T17:28:09.664 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:09.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.665 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:28:09.665 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:09.665 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:09.666 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:09.666 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:09.666 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:09.666 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:46.300658+0000", 2020-11-12T17:28:09.667 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:09.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.667 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:28:09.668 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:09.668 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:09.668 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:09.668 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:09.668 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:09.668 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:47.757739+0000", 2020-11-12T17:28:09.669 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:09.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.669 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:28:09.669 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:09.669 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:09.669 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:09.670 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:09.670 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:09.670 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:44.608417+0000", 2020-11-12T17:28:09.670 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:09.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:09.671 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:28:09.671 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:09.671 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:09.671 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:09.671 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:09.672 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:09.672 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:46.424553+0000", 2020-11-12T17:28:09.672 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:09.672 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.672 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:09.672 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2020-11-12T17:28:09.672 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2020-11-12T17:28:09.673 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2020-11-12T17:28:09.673 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2020-11-12T17:28:09.673 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2020-11-12T17:28:09.673 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2020-11-12T17:28:09.673 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2020-11-12T17:28:09.673 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2020-11-12T17:28:09.673 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2020-11-12T17:28:09.674 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2020-11-12T17:28:09.674 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2020-11-12T17:28:09.674 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2020-11-12T17:28:09.674 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2020-11-12T17:28:09.674 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:09.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:09.674 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2020-11-12T17:28:09.675 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2020-11-12T17:28:09.675 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2020-11-12T17:28:09.675 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2020-11-12T17:28:09.675 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2020-11-12T17:28:09.675 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:09.677 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:09.678 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:09.678 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:28:09.678 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 83 16 63856 63840 6.00829 0 - 0.0188933 2020-11-12T17:28:09.679 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:09.672+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:09.679 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:09.680 INFO:tasks.thrashosds.thrasher:j is {'epoch': 176, 'fsid': '8c8a6bcc-49d4-47d1-904f-e20798ef8e1f', 'created': '2020-11-12T17:22:37.581394+0000', 'modified': '2020-11-12T17:28:05.990035+0000', 'last_up_change': '2020-11-12T17:25:55.942493+0000', 'last_in_change': '2020-11-12T17:27:52.446296+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '163', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'unique_pool_2', 'create_time': '2020-11-12T17:26:43.854598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'bd1d5457-5d54-4074-b378-9da417f42976', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 174, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6801', 'nonce': 12304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6802', 'nonce': 12304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6806', 'nonce': 12304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6804', 'nonce': 12304}]}, 'public_addr': '172.21.15.36:6801/12304', 'cluster_addr': '172.21.15.36:6802/12304', 'heartbeat_back_addr': '172.21.15.36:6806/12304', 'heartbeat_front_addr': '172.21.15.36:6804/12304', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '37152eee-a8d8-40f1-8e27-2899e7b94c98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 57, 'up_from': 88, 'up_thru': 171, 'down_at': 58, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6812', 'nonce': 20274}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6814', 'nonce': 20274}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6816', 'nonce': 20274}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6815', 'nonce': 20274}]}, 'public_addr': '172.21.15.36:6812/20274', 'cluster_addr': '172.21.15.36:6814/20274', 'heartbeat_back_addr': '172.21.15.36:6816/20274', 'heartbeat_front_addr': '172.21.15.36:6815/20274', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd8ec2abb-38bf-4863-969a-482c4fa44f41', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 93, 'up_from': 102, 'up_thru': 167, 'down_at': 94, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6803', 'nonce': 21493}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6805', 'nonce': 21493}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6808', 'nonce': 21493}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6807', 'nonce': 21493}]}, 'public_addr': '172.21.15.36:6803/21493', 'cluster_addr': '172.21.15.36:6805/21493', 'heartbeat_back_addr': '172.21.15.36:6808/21493', 'heartbeat_front_addr': '172.21.15.36:6807/21493', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '799d3499-577c-4510-a00c-9b2e126fc449', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6809', 'nonce': 12305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6810', 'nonce': 12305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6813', 'nonce': 12305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6811', 'nonce': 12305}]}, 'public_addr': '172.21.15.36:6809/12305', 'cluster_addr': '172.21.15.36:6810/12305', 'heartbeat_back_addr': '172.21.15.36:6813/12305', 'heartbeat_front_addr': '172.21.15.36:6811/12305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c36e3100-aadc-4117-b495-24fb08a34148', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 167, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6804', 'nonce': 12499}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6805', 'nonce': 12499}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6807', 'nonce': 12499}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6806', 'nonce': 12499}]}, 'public_addr': '172.21.15.205:6804/12499', 'cluster_addr': '172.21.15.205:6805/12499', 'heartbeat_back_addr': '172.21.15.205:6807/12499', 'heartbeat_front_addr': '172.21.15.205:6806/12499', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b152141f-b530-448e-8dff-fe200559eff0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 173, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6808', 'nonce': 12525}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6810', 'nonce': 12525}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6814', 'nonce': 12525}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6812', 'nonce': 12525}]}, 'public_addr': '172.21.15.205:6808/12525', 'cluster_addr': '172.21.15.205:6810/12525', 'heartbeat_back_addr': '172.21.15.205:6814/12525', 'heartbeat_front_addr': '172.21.15.205:6812/12525', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '62a140ba-7f94-4bb6-8a62-fda077f81354', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 167, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6809', 'nonce': 12524}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6811', 'nonce': 12524}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6815', 'nonce': 12524}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6813', 'nonce': 12524}]}, 'public_addr': '172.21.15.205:6809/12524', 'cluster_addr': '172.21.15.205:6811/12524', 'heartbeat_back_addr': '172.21.15.205:6815/12524', 'heartbeat_front_addr': '172.21.15.205:6813/12524', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '32879bd7-780c-4da6-9838-5850b6277902', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 135, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6800', 'nonce': 12522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6801', 'nonce': 12522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6803', 'nonce': 12522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6802', 'nonce': 12522}]}, 'public_addr': '172.21.15.205:6800/12522', 'cluster_addr': '172.21.15.205:6801/12522', 'heartbeat_back_addr': '172.21.15.205:6803/12522', 'heartbeat_front_addr': '172.21.15.205:6802/12522', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:44.606542+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:33.512821+0000', 'dead_epoch': 58}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:57.104840+0000', 'dead_epoch': 94}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:47.239812+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:46.300658+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:47.757739+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:44.608417+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:46.424553+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-11-12T17:28:09.681 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:28:09.778 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:09.772+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:09.778 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:09.772+0000 7f6583748700 -1 osd.0 176 handle_osd_map injecting map crc failure 2020-11-12T17:28:09.799 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:09.800 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:09.809 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:28:09.849 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:09.880 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:09.878+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:09.945 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:09.946 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:09.955 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:28:09.981 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:09.978+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:10.005 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:10.031 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:10.040 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:28:10.042 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:28:10.056 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2020-11-12T17:28:09.610572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":522977280,"num_objects":7982,"num_object_clones":0,"num_object_copies":15964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7982,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63842,"num_write_kb":510722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2871,"num_bytes_recovered":187981824,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63842,"ondisk_log_size":63842,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8831964,"kb_used_data":443292,"kb_used_omap":118,"kb_used_meta":8388489,"kb_avail":746142756,"statfs":{"total":773094113280,"available":764050182144,"internally_reserved":8589934592,"allocated":453931008,"data_stored":1050048748,"data_compressed":6040000,"data_compressed_allocated":443727872,"data_compressed_original":1045954560,"omap_allocated":121799,"internal_metadata":8589812793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.141314"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"18","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.462960+0000","last_change":"2020-11-12T17:27:51.467795+0000","last_active":"2020-11-12T17:28:01.462960+0000","last_peered":"2020-11-12T17:28:01.462960+0000","last_clean":"2020-11-12T17:28:01.462960+0000","last_became_active":"2020-11-12T17:27:51.467388+0000","last_became_peered":"2020-11-12T17:27:51.467388+0000","last_unstale":"2020-11-12T17:28:01.462960+0000","last_undegraded":"2020-11-12T17:28:01.462960+0000","last_fullsized":"2020-11-12T17:28:01.462960+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"18","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.475730+0000","last_change":"2020-11-12T17:27:51.468206+0000","last_active":"2020-11-12T17:28:01.475730+0000","last_peered":"2020-11-12T17:28:01.475730+0000","last_clean":"2020-11-12T17:28:01.475730+0000","last_became_active":"2020-11-12T17:27:51.465928+0000","last_became_peered":"2020-11-12T17:27:51.465928+0000","last_unstale":"2020-11-12T17:28:01.475730+0000","last_undegraded":"2020-11-12T17:28:01.475730+0000","last_fullsized":"2020-11-12T17:28:01.475730+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:51.816592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:51.816592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"19","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:02.192815+0000","last_change":"2020-11-12T17:28:02.192815+0000","last_active":"2020-11-12T17:28:02.192815+0000","last_peered":"2020-11-12T17:28:02.192815+0000","last_clean":"2020-11-12T17:28:02.192815+0000","last_became_active":"2020-11-12T17:27:53.469606+0000","last_became_peered":"2020-11-12T17:27:53.469606+0000","last_unstale":"2020-11-12T17:28:02.192815+0000","last_undegraded":"2020-11-12T17:28:02.192815+0000","last_fullsized":"2020-11-12T17:28:02.192815+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:02.192623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:28:02.192623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"174'4072","reported_seq":"4128","reported_epoch":"175","state":"active+clean","last_fresh":"2020-11-12T17:28:02.708748+0000","last_change":"2020-11-12T17:26:45.503348+0000","last_active":"2020-11-12T17:28:02.708748+0000","last_peered":"2020-11-12T17:28:02.708748+0000","last_clean":"2020-11-12T17:28:02.708748+0000","last_became_active":"2020-11-12T17:26:45.502940+0000","last_became_peered":"2020-11-12T17:26:45.502940+0000","last_unstale":"2020-11-12T17:28:02.708748+0000","last_undegraded":"2020-11-12T17:28:02.708748+0000","last_fullsized":"2020-11-12T17:28:02.708748+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4072,"ondisk_log_size":4072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33357824,"num_objects":509,"num_object_clones":0,"num_object_copies":1018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":509,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4072,"num_write_kb":32576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"18","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.467539+0000","last_change":"2020-11-12T17:27:51.459712+0000","last_active":"2020-11-12T17:28:01.467539+0000","last_peered":"2020-11-12T17:28:01.467539+0000","last_clean":"2020-11-12T17:28:01.467539+0000","last_became_active":"2020-11-12T17:27:51.458965+0000","last_became_peered":"2020-11-12T17:27:51.458965+0000","last_unstale":"2020-11-12T17:28:01.467539+0000","last_undegraded":"2020-11-12T17:28:01.467539+0000","last_fullsized":"2020-11-12T17:28:01.467539+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"173'4064","reported_seq":"4122","reported_epoch":"175","state":"active+clean","last_fresh":"2020-11-12T17:28:05.619302+0000","last_change":"2020-11-12T17:28:05.619468+0000","last_active":"2020-11-12T17:28:05.619302+0000","last_peered":"2020-11-12T17:28:05.619302+0000","last_clean":"2020-11-12T17:28:05.619302+0000","last_became_active":"2020-11-12T17:26:45.490308+0000","last_became_peered":"2020-11-12T17:26:45.490308+0000","last_unstale":"2020-11-12T17:28:05.619302+0000","last_undegraded":"2020-11-12T17:28:05.619302+0000","last_fullsized":"2020-11-12T17:28:05.619302+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"173'4064","last_scrub_stamp":"2020-11-12T17:28:05.619301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:28:05.619301+0000","log_size":4064,"ondisk_log_size":4064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":508,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4064,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"215","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.467565+0000","last_change":"2020-11-12T17:27:51.534870+0000","last_active":"2020-11-12T17:28:01.467565+0000","last_peered":"2020-11-12T17:28:01.467565+0000","last_clean":"2020-11-12T17:28:01.467565+0000","last_became_active":"2020-11-12T17:27:51.533667+0000","last_became_peered":"2020-11-12T17:27:51.533667+0000","last_unstale":"2020-11-12T17:28:01.467565+0000","last_undegraded":"2020-11-12T17:28:01.467565+0000","last_fullsized":"2020-11-12T17:28:01.467565+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:05.616420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:05.616420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"174'3936","reported_seq":"3991","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.931873+0000","last_change":"2020-11-12T17:26:45.490550+0000","last_active":"2020-11-12T17:28:01.931873+0000","last_peered":"2020-11-12T17:28:01.931873+0000","last_clean":"2020-11-12T17:28:01.931873+0000","last_became_active":"2020-11-12T17:26:45.490025+0000","last_became_peered":"2020-11-12T17:26:45.490025+0000","last_unstale":"2020-11-12T17:28:01.931873+0000","last_undegraded":"2020-11-12T17:28:01.931873+0000","last_fullsized":"2020-11-12T17:28:01.931873+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3936,"ondisk_log_size":3936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32243712,"num_objects":492,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":492,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3936,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"21","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.550722+0000","last_change":"2020-11-12T17:28:01.550722+0000","last_active":"2020-11-12T17:28:01.550722+0000","last_peered":"2020-11-12T17:28:01.550722+0000","last_clean":"2020-11-12T17:28:01.550722+0000","last_became_active":"2020-11-12T17:27:51.458677+0000","last_became_peered":"2020-11-12T17:27:51.458677+0000","last_unstale":"2020-11-12T17:28:01.550722+0000","last_undegraded":"2020-11-12T17:28:01.550722+0000","last_fullsized":"2020-11-12T17:28:01.550722+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:01.550624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:28:01.550624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"174'4000","reported_seq":"4293","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.858343+0000","last_change":"2020-11-12T17:27:04.424601+0000","last_active":"2020-11-12T17:28:01.858343+0000","last_peered":"2020-11-12T17:28:01.858343+0000","last_clean":"2020-11-12T17:28:01.858343+0000","last_became_active":"2020-11-12T17:27:04.422158+0000","last_became_peered":"2020-11-12T17:27:04.422158+0000","last_unstale":"2020-11-12T17:28:01.858343+0000","last_undegraded":"2020-11-12T17:28:01.858343+0000","last_fullsized":"2020-11-12T17:28:01.858343+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4000,"ondisk_log_size":4000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32768000,"num_objects":500,"num_object_clones":0,"num_object_copies":1000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4000,"num_write_kb":32000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":7471104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"18","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.475478+0000","last_change":"2020-11-12T17:27:51.483730+0000","last_active":"2020-11-12T17:28:01.475478+0000","last_peered":"2020-11-12T17:28:01.475478+0000","last_clean":"2020-11-12T17:28:01.475478+0000","last_became_active":"2020-11-12T17:27:51.483394+0000","last_became_peered":"2020-11-12T17:27:51.483394+0000","last_unstale":"2020-11-12T17:28:01.475478+0000","last_undegraded":"2020-11-12T17:28:01.475478+0000","last_fullsized":"2020-11-12T17:28:01.475478+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_clean_scrub_stamp":"2020-11-12T17:27:15.924179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"174'4104","reported_seq":"5121","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.525490+0000","last_change":"2020-11-12T17:27:59.940042+0000","last_active":"2020-11-12T17:28:01.525490+0000","last_peered":"2020-11-12T17:28:01.525490+0000","last_clean":"2020-11-12T17:28:01.525490+0000","last_became_active":"2020-11-12T17:27:53.574726+0000","last_became_peered":"2020-11-12T17:27:53.574726+0000","last_unstale":"2020-11-12T17:28:01.525490+0000","last_undegraded":"2020-11-12T17:28:01.525490+0000","last_fullsized":"2020-11-12T17:28:01.525490+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4104,"ondisk_log_size":4104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33619968,"num_objects":513,"num_object_clones":0,"num_object_copies":1026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":513,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4104,"num_write_kb":32832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":476,"num_bytes_recovered":31195136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"18","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.467756+0000","last_change":"2020-11-12T17:27:51.459559+0000","last_active":"2020-11-12T17:28:01.467756+0000","last_peered":"2020-11-12T17:28:01.467756+0000","last_clean":"2020-11-12T17:28:01.467756+0000","last_became_active":"2020-11-12T17:27:51.458861+0000","last_became_peered":"2020-11-12T17:27:51.458861+0000","last_unstale":"2020-11-12T17:28:01.467756+0000","last_undegraded":"2020-11-12T17:28:01.467756+0000","last_fullsized":"2020-11-12T17:28:01.467756+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:04.764948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:27:04.764948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"173'3992","reported_seq":"4047","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.475410+0000","last_change":"2020-11-12T17:26:45.490968+0000","last_active":"2020-11-12T17:28:01.475410+0000","last_peered":"2020-11-12T17:28:01.475410+0000","last_clean":"2020-11-12T17:28:01.475410+0000","last_became_active":"2020-11-12T17:26:45.490602+0000","last_became_peered":"2020-11-12T17:26:45.490602+0000","last_unstale":"2020-11-12T17:28:01.475410+0000","last_undegraded":"2020-11-12T17:28:01.475410+0000","last_fullsized":"2020-11-12T17:28:01.475410+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3992,"ondisk_log_size":3992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32702464,"num_objects":499,"num_object_clones":0,"num_object_copies":998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":499,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3992,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"18","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.475615+0000","last_change":"2020-11-12T17:27:51.534861+0000","last_active":"2020-11-12T17:28:01.475615+0000","last_peered":"2020-11-12T17:28:01.475615+0000","last_clean":"2020-11-12T17:28:01.475615+0000","last_became_active":"2020-11-12T17:27:51.533701+0000","last_became_peered":"2020-11-12T17:27:51.533701+0000","last_unstale":"2020-11-12T17:28:01.475615+0000","last_undegraded":"2020-11-12T17:28:01.475615+0000","last_fullsized":"2020-11-12T17:28:01.475615+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:52.317257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:52.317257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"174'3736","reported_seq":"3794","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:02.063635+0000","last_change":"2020-11-12T17:27:28.815974+0000","last_active":"2020-11-12T17:28:02.063635+0000","last_peered":"2020-11-12T17:28:02.063635+0000","last_clean":"2020-11-12T17:28:02.063635+0000","last_became_active":"2020-11-12T17:27:28.811530+0000","last_became_peered":"2020-11-12T17:27:28.811530+0000","last_unstale":"2020-11-12T17:28:02.063635+0000","last_undegraded":"2020-11-12T17:28:02.063635+0000","last_fullsized":"2020-11-12T17:28:02.063635+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3736,"ondisk_log_size":3736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":467,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3736,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"29","reported_epoch":"175","state":"active+clean","last_fresh":"2020-11-12T17:28:04.618039+0000","last_change":"2020-11-12T17:28:04.618132+0000","last_active":"2020-11-12T17:28:04.618039+0000","last_peered":"2020-11-12T17:28:04.618039+0000","last_clean":"2020-11-12T17:28:04.618039+0000","last_became_active":"2020-11-12T17:27:53.467149+0000","last_became_peered":"2020-11-12T17:27:53.467149+0000","last_unstale":"2020-11-12T17:28:04.618039+0000","last_undegraded":"2020-11-12T17:28:04.618039+0000","last_fullsized":"2020-11-12T17:28:04.618039+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:04.618038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:28:04.618038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"174'3976","reported_seq":"5165","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:02.049258+0000","last_change":"2020-11-12T17:27:59.473272+0000","last_active":"2020-11-12T17:28:02.049258+0000","last_peered":"2020-11-12T17:28:02.049258+0000","last_clean":"2020-11-12T17:28:02.049258+0000","last_became_active":"2020-11-12T17:27:53.599307+0000","last_became_peered":"2020-11-12T17:27:53.599307+0000","last_unstale":"2020-11-12T17:28:02.049258+0000","last_undegraded":"2020-11-12T17:28:02.049258+0000","last_fullsized":"2020-11-12T17:28:02.049258+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"162'3464","last_scrub_stamp":"2020-11-12T17:27:48.555220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:27:48.555220+0000","log_size":3976,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3976,"num_write_kb":31808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":558,"num_bytes_recovered":36528128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"173'4032","reported_seq":"5042","reported_epoch":"175","state":"active+clean+wait","last_fresh":"2020-11-12T17:28:02.477677+0000","last_change":"2020-11-12T17:28:02.477677+0000","last_active":"2020-11-12T17:28:02.477677+0000","last_peered":"2020-11-12T17:28:02.477677+0000","last_clean":"2020-11-12T17:28:02.477677+0000","last_became_active":"2020-11-12T17:28:02.474029+0000","last_became_peered":"2020-11-12T17:28:02.474029+0000","last_unstale":"2020-11-12T17:28:02.477677+0000","last_undegraded":"2020-11-12T17:28:02.477677+0000","last_fullsized":"2020-11-12T17:28:02.477677+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4032,"ondisk_log_size":4032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":504,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4032,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":473,"num_bytes_recovered":30998528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"70","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.467415+0000","last_change":"2020-11-12T17:27:53.466298+0000","last_active":"2020-11-12T17:28:01.467415+0000","last_peered":"2020-11-12T17:28:01.467415+0000","last_clean":"2020-11-12T17:28:01.467415+0000","last_became_active":"2020-11-12T17:27:53.465795+0000","last_became_peered":"2020-11-12T17:27:53.465795+0000","last_unstale":"2020-11-12T17:28:01.467415+0000","last_undegraded":"2020-11-12T17:28:01.467415+0000","last_fullsized":"2020-11-12T17:28:01.467415+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:50.128859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:27:50.128859+0000","last_clean_scrub_stamp":"2020-11-12T17:27:50.128859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"174'3960","reported_seq":"5181","reported_epoch":"175","state":"active+clean","last_fresh":"2020-11-12T17:28:04.897723+0000","last_change":"2020-11-12T17:28:04.897912+0000","last_active":"2020-11-12T17:28:04.897723+0000","last_peered":"2020-11-12T17:28:04.897723+0000","last_clean":"2020-11-12T17:28:04.897723+0000","last_became_active":"2020-11-12T17:28:00.456669+0000","last_became_peered":"2020-11-12T17:28:00.456669+0000","last_unstale":"2020-11-12T17:28:04.897723+0000","last_undegraded":"2020-11-12T17:28:04.897723+0000","last_fullsized":"2020-11-12T17:28:04.897723+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'3960","last_scrub_stamp":"2020-11-12T17:28:04.897722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:28:04.897722+0000","log_size":3960,"ondisk_log_size":3960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3960,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":570,"num_bytes_recovered":37355520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"219","reported_epoch":"175","state":"active+clean","last_fresh":"2020-11-12T17:28:02.708555+0000","last_change":"2020-11-12T17:27:52.083310+0000","last_active":"2020-11-12T17:28:02.708555+0000","last_peered":"2020-11-12T17:28:02.708555+0000","last_clean":"2020-11-12T17:28:02.708555+0000","last_became_active":"2020-11-12T17:27:49.463678+0000","last_became_peered":"2020-11-12T17:27:49.463678+0000","last_unstale":"2020-11-12T17:28:02.708555+0000","last_undegraded":"2020-11-12T17:28:02.708555+0000","last_fullsized":"2020-11-12T17:28:02.708555+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:52.083239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:52.083239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"174'4128","reported_seq":"4186","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:02.037727+0000","last_change":"2020-11-12T17:27:47.563620+0000","last_active":"2020-11-12T17:28:02.037727+0000","last_peered":"2020-11-12T17:28:02.037727+0000","last_clean":"2020-11-12T17:28:02.037727+0000","last_became_active":"2020-11-12T17:26:45.480445+0000","last_became_peered":"2020-11-12T17:26:45.480445+0000","last_unstale":"2020-11-12T17:28:02.037727+0000","last_undegraded":"2020-11-12T17:28:02.037727+0000","last_fullsized":"2020-11-12T17:28:02.037727+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'3552","last_scrub_stamp":"2020-11-12T17:27:47.563469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:27:47.563469+0000","log_size":4128,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":516,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"77","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.475418+0000","last_change":"2020-11-12T17:27:49.451672+0000","last_active":"2020-11-12T17:28:01.475418+0000","last_peered":"2020-11-12T17:28:01.475418+0000","last_clean":"2020-11-12T17:28:01.475418+0000","last_became_active":"2020-11-12T17:27:49.451258+0000","last_became_peered":"2020-11-12T17:27:49.451258+0000","last_unstale":"2020-11-12T17:28:01.475418+0000","last_undegraded":"2020-11-12T17:28:01.475418+0000","last_fullsized":"2020-11-12T17:28:01.475418+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"174'3784","reported_seq":"3840","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.999642+0000","last_change":"2020-11-12T17:27:28.813298+0000","last_active":"2020-11-12T17:28:01.999642+0000","last_peered":"2020-11-12T17:28:01.999642+0000","last_clean":"2020-11-12T17:28:01.999642+0000","last_became_active":"2020-11-12T17:27:28.808532+0000","last_became_peered":"2020-11-12T17:27:28.808532+0000","last_unstale":"2020-11-12T17:28:01.999642+0000","last_undegraded":"2020-11-12T17:28:01.999642+0000","last_fullsized":"2020-11-12T17:28:01.999642+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3784,"ondisk_log_size":3784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":473,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3784,"num_write_kb":30272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"202","reported_epoch":"175","state":"active+clean","last_fresh":"2020-11-12T17:28:03.942232+0000","last_change":"2020-11-12T17:28:03.942232+0000","last_active":"2020-11-12T17:28:03.942232+0000","last_peered":"2020-11-12T17:28:03.942232+0000","last_clean":"2020-11-12T17:28:03.942232+0000","last_became_active":"2020-11-12T17:27:49.466326+0000","last_became_peered":"2020-11-12T17:27:49.466326+0000","last_unstale":"2020-11-12T17:28:03.942232+0000","last_undegraded":"2020-11-12T17:28:03.942232+0000","last_fullsized":"2020-11-12T17:28:03.942232+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:03.941996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:28:03.941996+0000","last_clean_scrub_stamp":"2020-11-12T17:28:03.941996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"22","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.459243+0000","last_change":"2020-11-12T17:27:53.578136+0000","last_active":"2020-11-12T17:28:01.459243+0000","last_peered":"2020-11-12T17:28:01.459243+0000","last_clean":"2020-11-12T17:28:01.459243+0000","last_became_active":"2020-11-12T17:27:53.469341+0000","last_became_peered":"2020-11-12T17:27:53.469341+0000","last_unstale":"2020-11-12T17:28:01.459243+0000","last_undegraded":"2020-11-12T17:28:01.459243+0000","last_fullsized":"2020-11-12T17:28:01.459243+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:27:47.164517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:27:47.164517+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"174'3896","reported_seq":"4149","reported_epoch":"175","state":"active+clean","last_fresh":"2020-11-12T17:28:02.709067+0000","last_change":"2020-11-12T17:27:01.968627+0000","last_active":"2020-11-12T17:28:02.709067+0000","last_peered":"2020-11-12T17:28:02.709067+0000","last_clean":"2020-11-12T17:28:02.709067+0000","last_became_active":"2020-11-12T17:27:00.629289+0000","last_became_peered":"2020-11-12T17:27:00.629289+0000","last_unstale":"2020-11-12T17:28:02.709067+0000","last_undegraded":"2020-11-12T17:28:02.709067+0000","last_fullsized":"2020-11-12T17:28:02.709067+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3896,"ondisk_log_size":3896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31916032,"num_objects":487,"num_object_clones":0,"num_object_copies":974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":487,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3896,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"213","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.467571+0000","last_change":"2020-11-12T17:28:01.007482+0000","last_active":"2020-11-12T17:28:01.467571+0000","last_peered":"2020-11-12T17:28:01.467571+0000","last_clean":"2020-11-12T17:28:01.467571+0000","last_became_active":"2020-11-12T17:27:49.456337+0000","last_became_peered":"2020-11-12T17:27:49.456337+0000","last_unstale":"2020-11-12T17:28:01.467571+0000","last_undegraded":"2020-11-12T17:28:01.467571+0000","last_fullsized":"2020-11-12T17:28:01.467571+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:01.007379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:28:01.007379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"174'4168","reported_seq":"5185","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.747690+0000","last_change":"2020-11-12T17:27:59.912080+0000","last_active":"2020-11-12T17:28:01.747690+0000","last_peered":"2020-11-12T17:28:01.747690+0000","last_clean":"2020-11-12T17:28:01.747690+0000","last_became_active":"2020-11-12T17:27:53.623896+0000","last_became_peered":"2020-11-12T17:27:53.623896+0000","last_unstale":"2020-11-12T17:28:01.747690+0000","last_undegraded":"2020-11-12T17:28:01.747690+0000","last_fullsized":"2020-11-12T17:28:01.747690+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4168,"ondisk_log_size":4168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34144256,"num_objects":521,"num_object_clones":0,"num_object_copies":1042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":521,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4168,"num_write_kb":33344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":476,"num_bytes_recovered":31195136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.459142+0000","last_change":"2020-11-12T17:27:53.469179+0000","last_active":"2020-11-12T17:28:01.459142+0000","last_peered":"2020-11-12T17:28:01.459142+0000","last_clean":"2020-11-12T17:28:01.459142+0000","last_became_active":"2020-11-12T17:27:53.468698+0000","last_became_peered":"2020-11-12T17:27:53.468698+0000","last_unstale":"2020-11-12T17:28:01.459142+0000","last_undegraded":"2020-11-12T17:28:01.459142+0000","last_fullsized":"2020-11-12T17:28:01.459142+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:51.287572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:27:51.287572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"174'4048","reported_seq":"4103","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.988035+0000","last_change":"2020-11-12T17:26:45.490394+0000","last_active":"2020-11-12T17:28:01.988035+0000","last_peered":"2020-11-12T17:28:01.988035+0000","last_clean":"2020-11-12T17:28:01.988035+0000","last_became_active":"2020-11-12T17:26:45.489929+0000","last_became_peered":"2020-11-12T17:26:45.489929+0000","last_unstale":"2020-11-12T17:28:01.988035+0000","last_undegraded":"2020-11-12T17:28:01.988035+0000","last_fullsized":"2020-11-12T17:28:01.988035+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4048,"ondisk_log_size":4048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33161216,"num_objects":506,"num_object_clones":0,"num_object_copies":1012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":506,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4048,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"56","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.467797+0000","last_change":"2020-11-12T17:27:49.453312+0000","last_active":"2020-11-12T17:28:01.467797+0000","last_peered":"2020-11-12T17:28:01.467797+0000","last_clean":"2020-11-12T17:28:01.467797+0000","last_became_active":"2020-11-12T17:27:49.452359+0000","last_became_peered":"2020-11-12T17:27:49.452359+0000","last_unstale":"2020-11-12T17:28:01.467797+0000","last_undegraded":"2020-11-12T17:28:01.467797+0000","last_fullsized":"2020-11-12T17:28:01.467797+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:52.317257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:52.317257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"174'3944","reported_seq":"4227","reported_epoch":"175","state":"active+clean+scrubbing","last_fresh":"2020-11-12T17:28:06.284206+0000","last_change":"2020-11-12T17:28:06.284206+0000","last_active":"2020-11-12T17:28:06.284206+0000","last_peered":"2020-11-12T17:28:06.284206+0000","last_clean":"2020-11-12T17:28:06.284206+0000","last_became_active":"2020-11-12T17:27:00.648415+0000","last_became_peered":"2020-11-12T17:27:00.648415+0000","last_unstale":"2020-11-12T17:28:06.284206+0000","last_undegraded":"2020-11-12T17:28:06.284206+0000","last_fullsized":"2020-11-12T17:28:06.284206+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":3944,"ondisk_log_size":3944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32309248,"num_objects":493,"num_object_clones":0,"num_object_copies":986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":493,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3944,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":7077888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"176","reported_epoch":"174","state":"active+clean","last_fresh":"2020-11-12T17:28:01.463131+0000","last_change":"2020-11-12T17:27:52.416332+0000","last_active":"2020-11-12T17:28:01.463131+0000","last_peered":"2020-11-12T17:28:01.463131+0000","last_clean":"2020-11-12T17:28:01.463131+0000","last_became_active":"2020-11-12T17:27:49.451818+0000","last_became_peered":"2020-11-12T17:27:49.451818+0000","last_unstale":"2020-11-12T17:28:01.463131+0000","last_undegraded":"2020-11-12T17:28:01.463131+0000","last_fullsized":"2020-11-12T17:28:01.463131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:52.416215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:27:52.416215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":522977280,"num_objects":7980,"num_object_clones":0,"num_object_copies":15960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7980,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63840,"num_write_kb":510720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2869,"num_bytes_recovered":187981824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":443727872,"data_stored":1045954560,"data_compressed":6040000,"data_compressed_allocated":443727872,"data_compressed_original":1045954560,"omap_allocated":0,"internal_metadata":0},"log_size":63840,"ondisk_log_size":63840,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542210,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1095664,"kb_used_data":47080,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93276176,"statfs":{"total":96636764160,"available":95514804224,"internally_reserved":1073741824,"allocated":48209920,"data_stored":94359305,"data_compressed":628016,"data_compressed_allocated":46923776,"data_compressed_original":93847552,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":9.4589999999999996,"15min":4.1989999999999998},"min":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":7.2270000000000003,"5min":727.43499999999995,"15min":727.43499999999995},"last":1.448},{"interface":"front","average":{"1min":1.6399999999999999,"5min":2.6419999999999999,"15min":2.3109999999999999},"min":{"1min":0.60299999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":7.375,"5min":101.371,"15min":101.371},"last":1.0629999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:27:36 2020","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":6.1219999999999999,"15min":6.8579999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":3.5449999999999999,"5min":102.354,"15min":102.354},"last":1.8939999999999999},{"interface":"front","average":{"1min":1.718,"5min":5.8339999999999996,"15min":6.5199999999999996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":5.399,"5min":102.08199999999999,"15min":102.08199999999999},"last":2.3900000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":5.5439999999999996,"15min":6.1349999999999998},"min":{"1min":0.76200000000000001,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":10.603,"5min":102.038,"15min":102.038},"last":2.2909999999999999},{"interface":"front","average":{"1min":2.355,"5min":5.8410000000000002,"15min":6.4219999999999997},"min":{"1min":0.92300000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":10.726000000000001,"5min":102.92,"15min":102.92},"last":1.3740000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":2.7949999999999999,"15min":2.4060000000000001},"min":{"1min":1.0149999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":10.640000000000001,"5min":102.443,"15min":102.443},"last":2.3559999999999999},{"interface":"front","average":{"1min":2.3580000000000001,"5min":9.4209999999999994,"15min":4.8129999999999997},"min":{"1min":1.0589999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":10.526,"5min":871.76700000000005,"15min":871.76700000000005},"last":2.246}]},{"osd":4,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.169,"5min":23.588999999999999,"15min":43.701000000000001},"min":{"1min":0.83999999999999997,"5min":0.624,"15min":0.624},"max":{"1min":10.275,"5min":849.06500000000005,"15min":849.06500000000005},"last":1.2290000000000001},{"interface":"front","average":{"1min":2.6269999999999998,"5min":4.1440000000000001,"15min":2.718},"min":{"1min":0.81499999999999995,"5min":0.621,"15min":0.621},"max":{"1min":14.92,"5min":108.14,"15min":108.14},"last":1.5229999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":6.0869999999999997,"15min":3.8570000000000002},"min":{"1min":0.88900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":9.8350000000000009,"5min":311.077,"15min":311.077},"last":1.768},{"interface":"front","average":{"1min":2.3050000000000002,"5min":3.2469999999999999,"15min":2.9940000000000002},"min":{"1min":0.97199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":9.9250000000000007,"5min":104.02,"15min":104.02},"last":1.8540000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.6760000000000002,"5min":7.7569999999999997,"15min":4.4589999999999996},"min":{"1min":0.91200000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":10.422000000000001,"5min":375.04199999999997,"15min":375.04199999999997},"last":1.8140000000000001},{"interface":"front","average":{"1min":2.5390000000000001,"5min":19.574000000000002,"15min":42.152000000000001},"min":{"1min":1.103,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":10.356,"5min":975.20899999999995,"15min":975.20899999999995},"last":1.294}]}]},{"osd":5,"up_from":14,"seq":60129542211,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1114480,"kb_used_data":65896,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93257360,"statfs":{"total":96636764160,"available":95495536640,"internally_reserved":1073741824,"allocated":67477504,"data_stored":132898454,"data_compressed":886218,"data_compressed_allocated":66191360,"data_compressed_original":132382720,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.367,"15min":1.6719999999999999},"min":{"1min":0.65800000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5409999999999999,"5min":5.0309999999999997,"15min":5.0309999999999997},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.5389999999999999,"15min":1.9339999999999999},"min":{"1min":0.68600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.776,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":2.548}]},{"osd":1,"last update":"Thu Nov 12 17:27:34 2020","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.5980000000000001,"15min":1.5920000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":4.327,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.778,"15min":1.802},"min":{"1min":1.0669999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.024,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":1.895}]},{"osd":2,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.7490000000000001,"15min":1.754},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":3.782,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":1.956},{"interface":"front","average":{"1min":1.9470000000000001,"5min":1.7929999999999999,"15min":1.7669999999999999},"min":{"1min":1.034,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0640000000000001,"5min":5.0640000000000001,"15min":5.0640000000000001},"last":1.645}]},{"osd":3,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1560000000000001,"5min":2.6040000000000001,"15min":2.6960000000000002},"min":{"1min":1.028,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":4.4790000000000001,"5min":49.442999999999998,"15min":49.442999999999998},"last":1.7450000000000001},{"interface":"front","average":{"1min":23.279,"5min":6.2480000000000002,"15min":3.7400000000000002},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":437.625,"5min":437.625,"15min":437.625},"last":2.0819999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":6.0880000000000001,"15min":3.5139999999999998},"min":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.6619999999999999,"5min":459.15499999999997,"15min":459.15499999999997},"last":2.044},{"interface":"front","average":{"1min":1.504,"5min":4.7699999999999996,"15min":3.6240000000000001},"min":{"1min":0.82199999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.1669999999999998,"5min":324.95600000000002,"15min":324.95600000000002},"last":2.1699999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1280000000000001,"5min":2.0150000000000001,"15min":2.2330000000000001},"min":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.984,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":2.3719999999999999},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.8360000000000001,"15min":2.194},"min":{"1min":0.82299999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.786,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":2.2839999999999998}]},{"osd":7,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":19.530000000000001,"5min":6.0430000000000001,"15min":4.0830000000000002},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":359.55599999999998,"5min":359.55599999999998,"15min":359.55599999999998},"last":2.6040000000000001},{"interface":"front","average":{"1min":2.0979999999999999,"5min":8.1829999999999998,"15min":4.6639999999999997},"min":{"1min":0.84399999999999997,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.7519999999999998,"5min":693.23000000000002,"15min":693.23000000000002},"last":2.4590000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542210,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1130524,"kb_used_data":81940,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93241316,"statfs":{"total":96636764160,"available":95479107584,"internally_reserved":1073741824,"allocated":83906560,"data_stored":165792631,"data_compressed":1106042,"data_compressed_allocated":82640896,"data_compressed_original":165281792,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":2.1629999999999998,"5min":12.895,"15min":5.3540000000000001},"min":{"1min":0.70899999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":13.298,"5min":765.13099999999997,"15min":765.13099999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":1.6120000000000001,"5min":14.550000000000001,"15min":36.204000000000001},"min":{"1min":0.872,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5609999999999999,"5min":948.30899999999997,"15min":948.30899999999997},"last":1.0720000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":2.3849999999999998,"5min":15.705,"15min":17.925000000000001},"min":{"1min":0.79900000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":7.4329999999999998,"5min":356.46699999999998,"15min":356.46699999999998},"last":2.2200000000000002},{"interface":"front","average":{"1min":1.911,"5min":15.529,"15min":17.798999999999999},"min":{"1min":0.92800000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.8799999999999999,"5min":356.18599999999998,"15min":356.18599999999998},"last":0.86499999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:28:01 2020","interfaces":[{"interface":"back","average":{"1min":2.383,"5min":1.948,"15min":1.8759999999999999},"min":{"1min":0.746,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":13.382999999999999,"5min":13.382999999999999,"15min":13.382999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.9490000000000001,"5min":1.7769999999999999,"15min":1.7490000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.9780000000000002,"5min":4.056,"15min":4.056},"last":1.589}]},{"osd":3,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":2.738,"5min":5.9480000000000004,"15min":3.3420000000000001},"min":{"1min":0.876,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":11.282,"5min":356.02300000000002,"15min":356.02300000000002},"last":0.89200000000000002},{"interface":"front","average":{"1min":2.2450000000000001,"5min":9.2590000000000003,"15min":4.5300000000000002},"min":{"1min":1.0529999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":3.9769999999999999,"5min":357.79000000000002,"15min":357.79000000000002},"last":1.3089999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":3.0089999999999999,"5min":12.48,"15min":5.5279999999999996},"min":{"1min":0.96799999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":13.417999999999999,"5min":575.16800000000001,"15min":575.16800000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":2.6589999999999998,"5min":16.007000000000001,"15min":6.843},"min":{"1min":1.3149999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":5.6609999999999996,"5min":908.52700000000004,"15min":908.52700000000004},"last":1.643}]},{"osd":6,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":3.1219999999999999,"5min":12.295,"15min":26.529},"min":{"1min":0.95099999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":11.757,"5min":665.13999999999999,"15min":665.13999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":2.5939999999999999,"5min":10.083,"15min":4.8550000000000004},"min":{"1min":0.88200000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":13.446,"5min":426.197,"15min":426.197},"last":1.161}]},{"osd":7,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":2.4660000000000002,"5min":14.332000000000001,"15min":6.3719999999999999},"min":{"1min":1.474,"5min":0.87,"15min":0.87},"max":{"1min":4.1920000000000002,"5min":584.00300000000004,"15min":584.00300000000004},"last":1.6180000000000001},{"interface":"front","average":{"1min":3.3410000000000002,"5min":15.398,"15min":6.5919999999999996},"min":{"1min":1.3,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":11.363,"5min":915.22900000000004,"15min":915.22900000000004},"last":1.036}]}]},{"osd":1,"up_from":88,"seq":377957122080,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1101148,"kb_used_data":52564,"kb_used_omap":114,"kb_used_meta":1048461,"kb_avail":93270692,"statfs":{"total":96636764160,"available":95509188608,"internally_reserved":1073741824,"allocated":53825536,"data_stored":129944783,"data_compressed":720538,"data_compressed_allocated":52559872,"data_compressed_original":129433600,"omap_allocated":117414,"internal_metadata":1073624410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":32.381,"5min":7.7869999999999999,"15min":3.6880000000000002},"min":{"1min":0.86499999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":503.14299999999997,"5min":503.14299999999997,"15min":503.14299999999997},"last":1.214},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.7030000000000001,"15min":1.752},"min":{"1min":0.81200000000000006,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.3650000000000002,"5min":4.202,"15min":4.202},"last":2.3069999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:28:04 2020","interfaces":[{"interface":"back","average":{"1min":1.6519999999999999,"5min":1.698,"15min":1.706},"min":{"1min":0.77700000000000002,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.1970000000000001,"5min":3.597,"15min":3.597},"last":1.399},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.698,"15min":1.712},"min":{"1min":0.88500000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":3.089,"5min":3.089,"15min":3.089},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:27:39 2020","interfaces":[{"interface":"back","average":{"1min":91.236000000000004,"5min":19.588000000000001,"15min":7.6459999999999999},"min":{"1min":0.96299999999999997,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":958.71600000000001,"5min":958.71600000000001,"15min":958.71600000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.95,"5min":2.1389999999999998,"15min":2.1709999999999998},"min":{"1min":1.107,"5min":0.872,"15min":0.872},"max":{"1min":3.7309999999999999,"5min":6.056,"15min":6.056},"last":1.262}]},{"osd":4,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.8919999999999999,"15min":1.9219999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":3.718,"5min":3.718,"15min":3.718},"last":2.246},{"interface":"front","average":{"1min":2.0800000000000001,"5min":2.077,"15min":2.077},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":3.2879999999999998,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0800000000000001,"5min":2.0350000000000001,"15min":2.0270000000000001},"min":{"1min":1.1479999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.7559999999999998,"5min":6.1159999999999997,"15min":6.1159999999999997},"last":1.5840000000000001},{"interface":"front","average":{"1min":2.077,"5min":2.3570000000000002,"15min":2.403},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":3.1669999999999998,"5min":6.7859999999999996,"15min":6.7859999999999996},"last":2.1749999999999998}]},{"osd":6,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":2.2909999999999999,"15min":2.3250000000000002},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.4529999999999998,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.768},{"interface":"front","average":{"1min":2.2839999999999998,"5min":2.3119999999999998,"15min":2.3159999999999998},"min":{"1min":1.5349999999999999,"5min":1.161,"15min":1.161},"max":{"1min":3.774,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":1.55}]},{"osd":7,"last update":"Thu Nov 12 17:27:38 2020","interfaces":[{"interface":"back","average":{"1min":2.294,"5min":2.4660000000000002,"15min":2.4940000000000002},"min":{"1min":1.502,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":3.79,"5min":6.577,"15min":6.577},"last":1.621},{"interface":"front","average":{"1min":2.0990000000000002,"5min":2.4159999999999999,"15min":2.4689999999999999},"min":{"1min":1.056,"5min":1.056,"15min":1.056},"max":{"1min":3.3130000000000002,"5min":6.6950000000000003,"15min":6.6950000000000003},"last":1.6499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542210,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1097584,"kb_used_data":49000,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93274256,"statfs":{"total":96636764160,"available":95512838144,"internally_reserved":1073741824,"allocated":50176000,"data_stored":98291281,"data_compressed":654456,"data_compressed_allocated":48889856,"data_compressed_original":97779712,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":1.8300000000000001,"5min":1.6180000000000001,"15min":1.718},"min":{"1min":0.67100000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":6.0990000000000002,"5min":6.0990000000000002,"15min":6.0990000000000002},"last":2.726},{"interface":"front","average":{"1min":13.329000000000001,"5min":3.9470000000000001,"15min":2.6890000000000001},"min":{"1min":0.80100000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":254.70500000000001,"5min":254.70500000000001,"15min":254.70500000000001},"last":2.8140000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":4.6139999999999999,"5min":35.189,"15min":40.284999999999997},"min":{"1min":1.0069999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":49.276000000000003,"5min":665.476,"15min":665.476},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.929,"5min":1.3779999999999999,"15min":1.286},"min":{"1min":0.82899999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":4.5549999999999997,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":2.6480000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:28:01 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.6639999999999999,"15min":1.6339999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":7.1369999999999996,"5min":7.1369999999999996,"15min":7.1369999999999996},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.9039999999999999,"5min":1.617,"15min":1.569},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":4.6379999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":2.9260000000000002}]},{"osd":3,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":7.0579999999999998,"5min":3.1949999999999998,"15min":2.4710000000000001},"min":{"1min":0.99099999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":118.611,"5min":118.611,"15min":118.611},"last":1.7290000000000001},{"interface":"front","average":{"1min":40.183999999999997,"5min":9.8610000000000007,"15min":4.9269999999999996},"min":{"1min":1.1479999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":764.62800000000004,"5min":764.62800000000004,"15min":764.62800000000004},"last":1.6679999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":1.78,"5min":7.1500000000000004,"15min":3.8700000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.5549999999999997,"5min":489.149,"15min":489.149},"last":2.8730000000000002},{"interface":"front","average":{"1min":1.6799999999999999,"5min":9.0609999999999999,"15min":4.8010000000000002},"min":{"1min":0.70199999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":10.935,"5min":480.79599999999999,"15min":480.79599999999999},"last":2.0390000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":1.8839999999999999,"5min":20.385000000000002,"15min":8.3149999999999995},"min":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":8.1880000000000006,"5min":804.62199999999996,"15min":804.62199999999996},"last":1.8680000000000001},{"interface":"front","average":{"1min":2.0379999999999998,"5min":11.406000000000001,"15min":18.963000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":5.6269999999999998,"5min":494.78399999999999,"15min":494.78399999999999},"last":3.327}]},{"osd":7,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":17.474,"15min":7.6779999999999999},"min":{"1min":0.80500000000000005,"5min":0.626,"15min":0.626},"max":{"1min":8.0890000000000004,"5min":1002.347,"15min":1002.347},"last":2.02},{"interface":"front","average":{"1min":2.2999999999999998,"5min":2.2240000000000002,"15min":2.4239999999999999},"min":{"1min":1.1180000000000001,"5min":0.878,"15min":0.878},"max":{"1min":6.7839999999999998,"5min":10.271000000000001,"15min":10.271000000000001},"last":3.3860000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1065264,"kb_used_data":16680,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93306576,"statfs":{"total":96636764160,"available":95545933824,"internally_reserved":1073741824,"allocated":17080320,"data_stored":166316726,"data_compressed":295274,"data_compressed_allocated":15810560,"data_compressed_original":165806080,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 17:27:34 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":33.646999999999998,"15min":38.969000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":4.6310000000000002,"5min":501.38600000000002,"15min":501.38600000000002},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.6180000000000001,"5min":1.698,"15min":1.712},"min":{"1min":0.97299999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.702,"5min":3.141,"15min":3.141},"last":0.98999999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:27:57 2020","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.6679999999999999,"15min":1.704},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.323,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.627,"5min":31.257000000000001,"15min":36.195},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":4.4180000000000001,"5min":811.02700000000004,"15min":811.02700000000004},"last":1.2629999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":25.684999999999999,"5min":9.2959999999999994,"15min":13.548},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":413.33699999999999,"5min":413.33699999999999,"15min":413.33699999999999},"last":1.417},{"interface":"front","average":{"1min":1.649,"5min":1.744,"15min":1.9550000000000001},"min":{"1min":0.872,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.4420000000000002,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.4379999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":5.0339999999999998,"15min":3.1379999999999999},"min":{"1min":1.085,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.5419999999999998,"5min":347.87599999999998,"15min":347.87599999999998},"last":1.294},{"interface":"front","average":{"1min":6.976,"5min":5.9740000000000002,"15min":3.2869999999999999},"min":{"1min":1.0609999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":89.954999999999998,"5min":347.07499999999999,"15min":347.07499999999999},"last":1.7010000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":34.363,"5min":11.606999999999999,"15min":5.2990000000000004},"min":{"1min":1.0289999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":551.47299999999996,"5min":551.47299999999996,"15min":551.47299999999996},"last":1.744},{"interface":"front","average":{"1min":1.867,"5min":14.631,"15min":38.652999999999999},"min":{"1min":0.94099999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":3.5310000000000001,"5min":920.76900000000001,"15min":920.76900000000001},"last":2.25}]},{"osd":6,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":6.4950000000000001,"15min":3.746},"min":{"1min":1.004,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":7.8499999999999996,"5min":429.55599999999998,"15min":429.55599999999998},"last":1.9259999999999999},{"interface":"front","average":{"1min":2.2629999999999999,"5min":15.630000000000001,"15min":6.8799999999999999},"min":{"1min":1.0089999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":4.9720000000000004,"5min":931.65200000000004,"15min":931.65200000000004},"last":2.0009999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":15.689,"15min":24.651},"min":{"1min":1.1220000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":4.8079999999999998,"5min":502.31,"15min":502.31},"last":1.542},{"interface":"front","average":{"1min":2.427,"5min":11.563000000000001,"15min":36.590000000000003},"min":{"1min":1.1719999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":5.8090000000000002,"5min":502.42099999999999,"15min":502.42099999999999},"last":1.893}]}]},{"osd":2,"up_from":102,"seq":438086664219,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1145492,"kb_used_data":96908,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93226348,"statfs":{"total":96636764160,"available":95463780352,"internally_reserved":1073741824,"allocated":99233792,"data_stored":196462628,"data_compressed":1311416,"data_compressed_allocated":97976320,"data_compressed_original":195952640,"omap_allocated":4385,"internal_metadata":1073737439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":27.831,"15min":32.198},"min":{"1min":0.92400000000000004,"5min":0.755,"15min":0.755},"max":{"1min":2.931,"5min":524.55600000000004,"15min":524.55600000000004},"last":2.5699999999999998},{"interface":"front","average":{"1min":1.631,"5min":1.5880000000000001,"15min":1.581},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":3.7730000000000001,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":2.5219999999999998}]},{"osd":1,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":40.386000000000003,"5min":9.6799999999999997,"15min":4.5620000000000003},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":776.01499999999999,"5min":776.01499999999999,"15min":776.01499999999999},"last":2.6840000000000002},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.722,"15min":1.7030000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":4.4210000000000003,"5min":4.4210000000000003,"15min":4.4210000000000003},"last":2.6179999999999999}]},{"osd":3,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.841,"15min":1.8620000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.8939999999999999,"5min":46.975999999999999,"15min":54.490000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":5.1260000000000003,"5min":902.96299999999997,"15min":902.96299999999997},"last":2.8210000000000002}]},{"osd":4,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":16.821000000000002,"5min":4.8049999999999997,"15min":2.8029999999999999},"min":{"1min":0.80300000000000005,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":258.35599999999999,"5min":258.35599999999999,"15min":258.35599999999999},"last":2.46},{"interface":"front","average":{"1min":4.3300000000000001,"5min":2.4089999999999998,"15min":2.089},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":46.899000000000001,"5min":46.899000000000001,"15min":46.899000000000001},"last":1.371}]},{"osd":5,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":2.5179999999999998,"15min":2.5680000000000001},"min":{"1min":1.27,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":5.2270000000000003,"5min":10.308,"15min":10.308},"last":379.274},{"interface":"front","average":{"1min":2.5779999999999998,"5min":2.194,"15min":2.1299999999999999},"min":{"1min":1.0649999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":5.3970000000000002,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":2.4009999999999998}]},{"osd":6,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.3359999999999999,"5min":2.1829999999999998,"15min":2.157},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":5.7759999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":1.762},{"interface":"front","average":{"1min":2.3290000000000002,"5min":10.577,"15min":11.952},"min":{"1min":1.3240000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":5.1859999999999999,"5min":168.64599999999999,"15min":168.64599999999999},"last":2.7799999999999998}]},{"osd":7,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":20.908999999999999,"5min":6.2039999999999997,"15min":3.7530000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":374.077,"5min":374.077,"15min":374.077},"last":2.7210000000000001},{"interface":"front","average":{"1min":42.392000000000003,"5min":10.497999999999999,"15min":5.1820000000000004},"min":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"max":{"1min":528.596,"5min":528.596,"15min":528.596},"last":2.0939999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542210,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1081808,"kb_used_data":33224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93290032,"statfs":{"total":96636764160,"available":95528992768,"internally_reserved":1073741824,"allocated":34021376,"data_stored":65982940,"data_compressed":438040,"data_compressed_allocated":32735232,"data_compressed_original":65470464,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":3.6240000000000001,"15min":2.4060000000000001},"min":{"1min":0.69299999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.8580000000000001,"5min":178.36699999999999,"15min":178.36699999999999},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.821,"15min":1.911},"min":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.222,"5min":16.902000000000001,"15min":16.902000000000001},"last":2.125}]},{"osd":1,"last update":"Thu Nov 12 17:27:36 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":30.931000000000001,"15min":35.847000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.7040000000000002,"5min":501.91199999999998,"15min":501.91199999999998},"last":1.8680000000000001},{"interface":"front","average":{"1min":29.451000000000001,"5min":27.236999999999998,"15min":26.867999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":501.91399999999999,"5min":501.91399999999999,"15min":501.91399999999999},"last":1.794}]},{"osd":2,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":40.996000000000002,"5min":49.390000000000001,"15min":50.789000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":501.85700000000003,"5min":942.58500000000004,"15min":942.58500000000004},"last":2.2410000000000001},{"interface":"front","average":{"1min":1.8580000000000001,"5min":21.530000000000001,"15min":24.808},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.6240000000000001,"5min":461.721,"15min":461.721},"last":2.319}]},{"osd":4,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9330000000000001,"5min":2.0390000000000001,"15min":2.3730000000000002},"min":{"1min":0.88800000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.6390000000000002,"5min":10.318,"15min":10.318},"last":3.198},{"interface":"front","average":{"1min":9.0190000000000001,"5min":3.3399999999999999,"15min":2.778},"min":{"1min":0.86499999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":173.863,"5min":173.863,"15min":173.863},"last":2.8170000000000002}]},{"osd":5,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9750000000000001,"5min":8.0860000000000003,"15min":24.167999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":4.7629999999999999,"5min":622.07799999999997,"15min":622.07799999999997},"last":2.8999999999999999},{"interface":"front","average":{"1min":2.0259999999999998,"5min":2.2130000000000001,"15min":2.6429999999999998},"min":{"1min":1.0249999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6699999999999999,"5min":10.436,"15min":10.436},"last":3.5219999999999998}]},{"osd":6,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":7.1680000000000001,"15min":4.1390000000000002},"min":{"1min":0.92200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":4.9059999999999997,"5min":466.58199999999999,"15min":466.58199999999999},"last":2.9980000000000002},{"interface":"front","average":{"1min":2.036,"5min":2.2530000000000001,"15min":2.5830000000000002},"min":{"1min":1.0629999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.403,"5min":11.497999999999999,"15min":11.497999999999999},"last":3.3889999999999998}]},{"osd":7,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":5.2030000000000003,"15min":3.6869999999999998},"min":{"1min":1.1160000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.0569999999999999,"5min":287.43099999999998,"15min":287.43099999999998},"last":3.0739999999999998},{"interface":"front","average":{"1min":2.266,"5min":14.045,"15min":24.808},"min":{"1min":1.1559999999999999,"5min":1.016,"15min":1.016},"max":{"1min":4.8440000000000003,"5min":606.49099999999999,"15min":606.49099999999999},"last":3.698}]}]}]}} 2020-11-12T17:28:10.060 INFO:tasks.thrashosds.thrasher:Setting 2.a to [0, 3, 4, 5] 2020-11-12T17:28:10.060 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.a', '0', '3', '4', '5'] 2020-11-12T17:28:10.061 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pg-upmap-items 2.a 0 3 4 5 2020-11-12T17:28:10.061 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:10.062 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:10.062 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:10.062 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:28:10.062 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:28:10.062 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:10.070 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:28:10.080 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:10.078+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:10.084 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:10.113 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:10.143 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:10.175 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:10.181 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:10.176+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:10.206 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:28:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:28:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:28:10.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.208 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79413 4.6 4:67cb455f:::benchmark_data_smithi036_18856_object3024:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:28:10.208 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:28:10.208 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.419944137000002, 2020-11-12T17:28:10.209 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27681071899999998, 2020-11-12T17:28:10.209 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.209 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.209 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:10.210 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:10.210 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:10.210 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79413 2020-11-12T17:28:10.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.212 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:28:10.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:28:10.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:10.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784228+0000", 2020-11-12T17:28:10.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3021e-05 2020-11-12T17:28:10.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784271+0000", 2020-11-12T17:28:10.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8409999999999995e-06 2020-11-12T17:28:10.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784280+0000", 2020-11-12T17:28:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6380000000000003e-06 2020-11-12T17:28:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784285+0000", 2020-11-12T17:28:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027973920000000001 2020-11-12T17:28:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787083+0000", 2020-11-12T17:28:10.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7495000000000001e-05 2020-11-12T17:28:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:28:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787180+0000", 2020-11-12T17:28:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12926628300000001 2020-11-12T17:28:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.916446+0000", 2020-11-12T17:28:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00093402899999999996 2020-11-12T17:28:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:28:10.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.917380+0000", 2020-11-12T17:28:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020407538999999999 2020-11-12T17:28:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.937788+0000", 2020-11-12T17:28:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000401386 2020-11-12T17:28:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:28:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.938189+0000", 2020-11-12T17:28:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.097742617000000004 2020-11-12T17:28:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.226 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.035932+0000", 2020-11-12T17:28:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00070456200000000005 2020-11-12T17:28:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.036636+0000", 2020-11-12T17:28:10.227 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001004916 2020-11-12T17:28:10.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:10.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.037641+0000", 2020-11-12T17:28:10.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012882807 2020-11-12T17:28:10.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:10.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.050524+0000", 2020-11-12T17:28:10.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084925529999999999 2020-11-12T17:28:10.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:10.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.059017+0000", 2020-11-12T17:28:10.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041484399999999999 2020-11-12T17:28:10.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.059432+0000", 2020-11-12T17:28:10.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016295210000000001 2020-11-12T17:28:10.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061061+0000", 2020-11-12T17:28:10.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27681071899999998 2020-11-12T17:28:10.231 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.232 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.232 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.232 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79414 4.6 4:60cd86ce:::benchmark_data_smithi036_18856_object3025:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:28:10.233 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:28:10.234 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.419867672999999, 2020-11-12T17:28:10.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998, 2020-11-12T17:28:10.234 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.234 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.235 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:10.235 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:10.235 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:10.235 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79414 2020-11-12T17:28:10.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.235 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:28:10.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:28:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:28:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784303+0000", 2020-11-12T17:28:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4221999999999997e-05 2020-11-12T17:28:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784358+0000", 2020-11-12T17:28:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8389999999999996e-06 2020-11-12T17:28:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784366+0000", 2020-11-12T17:28:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2040000000000002e-06 2020-11-12T17:28:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784370+0000", 2020-11-12T17:28:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029216049999999999 2020-11-12T17:28:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787291+0000", 2020-11-12T17:28:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3842e-05 2020-11-12T17:28:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:28:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787385+0000", 2020-11-12T17:28:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15210379399999999 2020-11-12T17:28:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.939489+0000", 2020-11-12T17:28:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00095422699999999998 2020-11-12T17:28:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:28:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940443+0000", 2020-11-12T17:28:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092951600000000002 2020-11-12T17:28:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.949738+0000", 2020-11-12T17:28:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00060685800000000005 2020-11-12T17:28:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:28:10.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.950345+0000", 2020-11-12T17:28:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093005117999999998 2020-11-12T17:28:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.043350+0000", 2020-11-12T17:28:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001029147 2020-11-12T17:28:10.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.044379+0000", 2020-11-12T17:28:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001543397 2020-11-12T17:28:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:10.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045923+0000", 2020-11-12T17:28:10.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015442345999999999 2020-11-12T17:28:10.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061365+0000", 2020-11-12T17:28:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0095990889999999999 2020-11-12T17:28:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.070964+0000", 2020-11-12T17:28:10.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000446744 2020-11-12T17:28:10.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.071411+0000", 2020-11-12T17:28:10.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001655534 2020-11-12T17:28:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.073066+0000", 2020-11-12T17:28:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998 2020-11-12T17:28:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.249 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79425 4.6 4:6231d6c2:::benchmark_data_smithi036_18856_object3036:head [delete] snapc 0=[] ondisk+write+known_if_redirected e118)", 2020-11-12T17:28:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:28:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.419794177, 2020-11-12T17:28:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002, 2020-11-12T17:28:10.250 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79425 2020-11-12T17:28:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:28:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:28:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:28:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784379+0000", 2020-11-12T17:28:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6152000000000001e-05 2020-11-12T17:28:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784426+0000", 2020-11-12T17:28:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6860000000000003e-06 2020-11-12T17:28:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784431+0000", 2020-11-12T17:28:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6460000000000002e-06 2020-11-12T17:28:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784434+0000", 2020-11-12T17:28:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030643549999999999 2020-11-12T17:28:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787498+0000", 2020-11-12T17:28:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100717 2020-11-12T17:28:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:28:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787599+0000", 2020-11-12T17:28:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15298814699999999 2020-11-12T17:28:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940587+0000", 2020-11-12T17:28:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00097205100000000003 2020-11-12T17:28:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:28:10.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.941559+0000", 2020-11-12T17:28:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.019466477999999999 2020-11-12T17:28:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961026+0000", 2020-11-12T17:28:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058434100000000005 2020-11-12T17:28:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:28:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961610+0000", 2020-11-12T17:28:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13222599700000001 2020-11-12T17:28:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.093836+0000", 2020-11-12T17:28:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089939299999999996 2020-11-12T17:28:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.094735+0000", 2020-11-12T17:28:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001382973 2020-11-12T17:28:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.096118+0000", 2020-11-12T17:28:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046953350000000001 2020-11-12T17:28:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:10.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100814+0000", 2020-11-12T17:28:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9295000000000006e-05 2020-11-12T17:28:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100893+0000", 2020-11-12T17:28:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00035136400000000001 2020-11-12T17:28:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.101244+0000", 2020-11-12T17:28:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015508290000000001 2020-11-12T17:28:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.102795+0000", 2020-11-12T17:28:10.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002 2020-11-12T17:28:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79491 4.4 4:2feb571e:::benchmark_data_smithi036_18856_object3102:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:28:10.265 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:28:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.345782251000003, 2020-11-12T17:28:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458, 2020-11-12T17:28:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:10.266 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79491 2020-11-12T17:28:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:28:10.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:28:10.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:10.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858382+0000", 2020-11-12T17:28:10.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8493999999999998e-05 2020-11-12T17:28:10.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858450+0000", 2020-11-12T17:28:10.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:10.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858460+0000", 2020-11-12T17:28:10.280 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5260000000000004e-06 2020-11-12T17:28:10.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858465+0000", 2020-11-12T17:28:10.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002042622 2020-11-12T17:28:10.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860507+0000", 2020-11-12T17:28:10.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5987000000000003e-05 2020-11-12T17:28:10.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:28:10.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860583+0000", 2020-11-12T17:28:10.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.264296631 2020-11-12T17:28:10.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.124880+0000", 2020-11-12T17:28:10.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00260079 2020-11-12T17:28:10.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:28:10.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.127481+0000", 2020-11-12T17:28:10.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015473191000000001 2020-11-12T17:28:10.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.142954+0000", 2020-11-12T17:28:10.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068121100000000003 2020-11-12T17:28:10.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.143635+0000", 2020-11-12T17:28:10.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014373840000000001 2020-11-12T17:28:10.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:10.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.145073+0000", 2020-11-12T17:28:10.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020755122000000001 2020-11-12T17:28:10.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:10.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.165828+0000", 2020-11-12T17:28:10.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047732520000000004 2020-11-12T17:28:10.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:10.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.170601+0000", 2020-11-12T17:28:10.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00046765100000000003 2020-11-12T17:28:10.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.171069+0000", 2020-11-12T17:28:10.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018080010000000001 2020-11-12T17:28:10.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.288 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.172877+0000", 2020-11-12T17:28:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458 2020-11-12T17:28:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:14736 5.0 e137/135 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head v 137'896, mlcod=137'891)", 2020-11-12T17:28:10.289 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:28:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.143979681000005, 2020-11-12T17:28:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999, 2020-11-12T17:28:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:28:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:28:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:10.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060202+0000", 2020-11-12T17:28:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8984000000000003e-05 2020-11-12T17:28:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060261+0000", 2020-11-12T17:28:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56005787699999998 2020-11-12T17:28:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620318+0000", 2020-11-12T17:28:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8369999999999999e-06 2020-11-12T17:28:10.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620325+0000", 2020-11-12T17:28:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012664800000000001 2020-11-12T17:28:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.294 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620452+0000", 2020-11-12T17:28:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3432e-05 2020-11-12T17:28:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620495+0000", 2020-11-12T17:28:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002919905 2020-11-12T17:28:10.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623415+0000", 2020-11-12T17:28:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9338999999999995e-05 2020-11-12T17:28:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623485+0000", 2020-11-12T17:28:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999 2020-11-12T17:28:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26040 5.0 e144/135 5:0f4f1556:::benchmark_data_smithi036_24110_object3254:head v 144'1616, mlcod=144'1611)", 2020-11-12T17:28:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:28:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 56.528504744999999, 2020-11-12T17:28:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999, 2020-11-12T17:28:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.298 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:28:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:28:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:28:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675665+0000", 2020-11-12T17:28:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5723000000000006e-05 2020-11-12T17:28:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675751+0000", 2020-11-12T17:28:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28004843800000001 2020-11-12T17:28:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955800+0000", 2020-11-12T17:28:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4329999999999997e-06 2020-11-12T17:28:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955804+0000", 2020-11-12T17:28:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8045000000000003e-05 2020-11-12T17:28:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955872+0000", 2020-11-12T17:28:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9106999999999997e-05 2020-11-12T17:28:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955911+0000", 2020-11-12T17:28:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001589479 2020-11-12T17:28:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957501+0000", 2020-11-12T17:28:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7602999999999998e-05 2020-11-12T17:28:10.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957548+0000", 2020-11-12T17:28:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999 2020-11-12T17:28:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.305 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26152 5.7 e144/135 5:e84d984e:::benchmark_data_smithi036_24110_object3268:head v 144'1448, mlcod=144'1443)", 2020-11-12T17:28:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:28:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 56.413899401999998, 2020-11-12T17:28:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003, 2020-11-12T17:28:10.306 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:28:10.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:28:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:28:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790267+0000", 2020-11-12T17:28:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010217000000000001 2020-11-12T17:28:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790369+0000", 2020-11-12T17:28:10.309 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38220455399999997 2020-11-12T17:28:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172574+0000", 2020-11-12T17:28:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5129999999999998e-06 2020-11-12T17:28:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172578+0000", 2020-11-12T17:28:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8815999999999999e-05 2020-11-12T17:28:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172657+0000", 2020-11-12T17:28:10.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1084000000000003e-05 2020-11-12T17:28:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172688+0000", 2020-11-12T17:28:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013615529999999999 2020-11-12T17:28:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174050+0000", 2020-11-12T17:28:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4009000000000002e-05 2020-11-12T17:28:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174124+0000", 2020-11-12T17:28:10.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003 2020-11-12T17:28:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35656 5.0 e149/135 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head v 149'2136, mlcod=149'2128)", 2020-11-12T17:28:10.314 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:28:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.083143874000001, 2020-11-12T17:28:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999, 2020-11-12T17:28:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:28:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:28:10.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121021+0000", 2020-11-12T17:28:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5146e-05 2020-11-12T17:28:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121116+0000", 2020-11-12T17:28:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35999075400000002 2020-11-12T17:28:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481107+0000", 2020-11-12T17:28:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4069999999999998e-06 2020-11-12T17:28:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481113+0000", 2020-11-12T17:28:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1341999999999997e-05 2020-11-12T17:28:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481165+0000", 2020-11-12T17:28:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1209999999999999e-05 2020-11-12T17:28:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481186+0000", 2020-11-12T17:28:10.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018927709999999999 2020-11-12T17:28:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483079+0000", 2020-11-12T17:28:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:28:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483131+0000", 2020-11-12T17:28:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999 2020-11-12T17:28:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:36416 5.0 e149/135 5:05125f34:::benchmark_data_smithi036_24110_object4551:head v 149'2208, mlcod=149'2200)", 2020-11-12T17:28:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:28:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 45.224519866999998, 2020-11-12T17:28:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002, 2020-11-12T17:28:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.323 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:28:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:28:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:28:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979647+0000", 2020-11-12T17:28:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7427000000000001e-05 2020-11-12T17:28:10.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979744+0000", 2020-11-12T17:28:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35673495900000002 2020-11-12T17:28:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336479+0000", 2020-11-12T17:28:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7480000000000001e-06 2020-11-12T17:28:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336484+0000", 2020-11-12T17:28:10.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5201000000000003e-05 2020-11-12T17:28:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336529+0000", 2020-11-12T17:28:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6535999999999999e-05 2020-11-12T17:28:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336545+0000", 2020-11-12T17:28:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003854597 2020-11-12T17:28:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340400+0000", 2020-11-12T17:28:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5745000000000001e-05 2020-11-12T17:28:10.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340476+0000", 2020-11-12T17:28:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002 2020-11-12T17:28:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.330 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:48936 5.7 e157/135 5:ebe6a5f2:::benchmark_data_smithi036_24110_object6116:head v 157'2960, mlcod=157'2956)", 2020-11-12T17:28:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:28:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 30.249773843, 2020-11-12T17:28:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003, 2020-11-12T17:28:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.331 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:28:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:28:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954403+0000", 2020-11-12T17:28:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0948e-05 2020-11-12T17:28:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954464+0000", 2020-11-12T17:28:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32108862399999999 2020-11-12T17:28:10.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275553+0000", 2020-11-12T17:28:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2849999999999997e-06 2020-11-12T17:28:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275560+0000", 2020-11-12T17:28:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8199999999999999e-05 2020-11-12T17:28:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275608+0000", 2020-11-12T17:28:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6923999999999998e-05 2020-11-12T17:28:10.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275635+0000", 2020-11-12T17:28:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036371630000000001 2020-11-12T17:28:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279272+0000", 2020-11-12T17:28:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0575000000000002e-05 2020-11-12T17:28:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279333+0000", 2020-11-12T17:28:10.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003 2020-11-12T17:28:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:52816 5.8 e159/135 5:1b562a6a:::benchmark_data_smithi036_24110_object6601:head v 159'3312, mlcod=159'3307)", 2020-11-12T17:28:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:28:10.339 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.329766587999998, 2020-11-12T17:28:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002, 2020-11-12T17:28:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:28:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:28:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874411+0000", 2020-11-12T17:28:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5874000000000001e-05 2020-11-12T17:28:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874467+0000", 2020-11-12T17:28:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.369977422 2020-11-12T17:28:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244444+0000", 2020-11-12T17:28:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.797e-06 2020-11-12T17:28:10.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244449+0000", 2020-11-12T17:28:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9617999999999994e-05 2020-11-12T17:28:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244549+0000", 2020-11-12T17:28:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6636999999999999e-05 2020-11-12T17:28:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244575+0000", 2020-11-12T17:28:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002465971 2020-11-12T17:28:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247041+0000", 2020-11-12T17:28:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1267999999999995e-05 2020-11-12T17:28:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247123+0000", 2020-11-12T17:28:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002 2020-11-12T17:28:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59192 5.0 e168/135 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head v 168'3640, mlcod=168'3635)", 2020-11-12T17:28:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:28:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 16.390027495999998, 2020-11-12T17:28:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998, 2020-11-12T17:28:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:28:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:28:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814137+0000", 2020-11-12T17:28:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135962 2020-11-12T17:28:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814273+0000", 2020-11-12T17:28:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46601277200000002 2020-11-12T17:28:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280285+0000", 2020-11-12T17:28:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0178e-05 2020-11-12T17:28:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280295+0000", 2020-11-12T17:28:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4779999999999999e-05 2020-11-12T17:28:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280370+0000", 2020-11-12T17:28:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2793999999999998e-05 2020-11-12T17:28:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280403+0000", 2020-11-12T17:28:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002761753 2020-11-12T17:28:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283165+0000", 2020-11-12T17:28:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3588e-05 2020-11-12T17:28:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283248+0000", 2020-11-12T17:28:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998 2020-11-12T17:28:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:61880 5.7 e171/135 5:e7903c7f:::benchmark_data_smithi036_24110_object7734:head v 171'3720, mlcod=171'3715)", 2020-11-12T17:28:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:28:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.845614872000001, 2020-11-12T17:28:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002, 2020-11-12T17:28:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:28:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:28:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:28:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358563+0000", 2020-11-12T17:28:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8774000000000002e-05 2020-11-12T17:28:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358642+0000", 2020-11-12T17:28:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36108309599999999 2020-11-12T17:28:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719725+0000", 2020-11-12T17:28:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8320000000000002e-06 2020-11-12T17:28:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719731+0000", 2020-11-12T17:28:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5495999999999997e-05 2020-11-12T17:28:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719806+0000", 2020-11-12T17:28:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3250999999999997e-05 2020-11-12T17:28:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719840+0000", 2020-11-12T17:28:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030159739999999998 2020-11-12T17:28:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722856+0000", 2020-11-12T17:28:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7215e-05 2020-11-12T17:28:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722913+0000", 2020-11-12T17:28:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002 2020-11-12T17:28:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e173)", 2020-11-12T17:28:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:28:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3171477510000003, 2020-11-12T17:28:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003, 2020-11-12T17:28:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:28:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:28:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:28:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887020+0000", 2020-11-12T17:28:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1260999999999993e-05 2020-11-12T17:28:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887101+0000", 2020-11-12T17:28:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2444e-05 2020-11-12T17:28:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887113+0000", 2020-11-12T17:28:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7610000000000002e-06 2020-11-12T17:28:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887123+0000", 2020-11-12T17:28:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096366420000000008 2020-11-12T17:28:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896760+0000", 2020-11-12T17:28:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8652000000000005e-05 2020-11-12T17:28:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896838+0000", 2020-11-12T17:28:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108306 2020-11-12T17:28:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896947+0000", 2020-11-12T17:28:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001848639 2020-11-12T17:28:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.898795+0000", 2020-11-12T17:28:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50804395899999999 2020-11-12T17:28:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406839+0000", 2020-11-12T17:28:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3349000000000004e-05 2020-11-12T17:28:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406923+0000", 2020-11-12T17:28:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7622999999999998e-05 2020-11-12T17:28:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407010+0000", 2020-11-12T17:28:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003 2020-11-12T17:28:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63144 5.c e173/139 ondisk, result = 0)", 2020-11-12T17:28:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:28:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.3032043309999999, 2020-11-12T17:28:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996, 2020-11-12T17:28:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:28:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:28:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900974+0000", 2020-11-12T17:28:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1072999999999998e-05 2020-11-12T17:28:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.901015+0000", 2020-11-12T17:28:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50574218299999996 2020-11-12T17:28:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406758+0000", 2020-11-12T17:28:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0649999999999999e-06 2020-11-12T17:28:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406766+0000", 2020-11-12T17:28:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1774999999999998e-05 2020-11-12T17:28:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406817+0000", 2020-11-12T17:28:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0681e-05 2020-11-12T17:28:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406828+0000", 2020-11-12T17:28:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000198078 2020-11-12T17:28:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407026+0000", 2020-11-12T17:28:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996 2020-11-12T17:28:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e173)", 2020-11-12T17:28:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:28:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 9.2984768459999998, 2020-11-12T17:28:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013, 2020-11-12T17:28:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:28:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:28:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:28:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:28:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999471 2020-11-12T17:28:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905665+0000", 2020-11-12T17:28:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017430399999999999 2020-11-12T17:28:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905839+0000", 2020-11-12T17:28:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0282e-05 2020-11-12T17:28:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905859+0000", 2020-11-12T17:28:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4520000000000003e-06 2020-11-12T17:28:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905869+0000", 2020-11-12T17:28:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5303999999999999e-05 2020-11-12T17:28:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905914+0000", 2020-11-12T17:28:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6926999999999999e-05 2020-11-12T17:28:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905971+0000", 2020-11-12T17:28:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50097548000000003 2020-11-12T17:28:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406947+0000", 2020-11-12T17:28:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013 2020-11-12T17:28:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63511 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:28:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:28:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.7261605949999996, 2020-11-12T17:28:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997, 2020-11-12T17:28:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63511 2020-11-12T17:28:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:28:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:28:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.477991+0000", 2020-11-12T17:28:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9875000000000003e-05 2020-11-12T17:28:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478081+0000", 2020-11-12T17:28:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3559999999999993e-06 2020-11-12T17:28:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478089+0000", 2020-11-12T17:28:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8300000000000003e-06 2020-11-12T17:28:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478094+0000", 2020-11-12T17:28:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055625520000000001 2020-11-12T17:28:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483657+0000", 2020-11-12T17:28:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118057 2020-11-12T17:28:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483775+0000", 2020-11-12T17:28:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019058000000000001 2020-11-12T17:28:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483965+0000", 2020-11-12T17:28:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052812179999999999 2020-11-12T17:28:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489246+0000", 2020-11-12T17:28:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32502241999999998 2020-11-12T17:28:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814269+0000", 2020-11-12T17:28:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1461000000000002e-05 2020-11-12T17:28:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814310+0000", 2020-11-12T17:28:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8736999999999999e-05 2020-11-12T17:28:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814339+0000", 2020-11-12T17:28:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997 2020-11-12T17:28:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63512 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:28:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:28:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.7260709510000005, 2020-11-12T17:28:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002, 2020-11-12T17:28:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63512 2020-11-12T17:28:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:28:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:28:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478106+0000", 2020-11-12T17:28:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0413e-05 2020-11-12T17:28:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478156+0000", 2020-11-12T17:28:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9499999999999998e-06 2020-11-12T17:28:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478162+0000", 2020-11-12T17:28:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.225e-06 2020-11-12T17:28:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478165+0000", 2020-11-12T17:28:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080122779999999994 2020-11-12T17:28:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486178+0000", 2020-11-12T17:28:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001128 2020-11-12T17:28:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486291+0000", 2020-11-12T17:28:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024748499999999998 2020-11-12T17:28:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486538+0000", 2020-11-12T17:28:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034654350000000002 2020-11-12T17:28:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.490003+0000", 2020-11-12T17:28:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35059826799999999 2020-11-12T17:28:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840602+0000", 2020-11-12T17:28:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3192000000000003e-05 2020-11-12T17:28:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840645+0000", 2020-11-12T17:28:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2951999999999999e-05 2020-11-12T17:28:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840678+0000", 2020-11-12T17:28:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002 2020-11-12T17:28:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63511 5.c e174/139 ondisk, result = 0)", 2020-11-12T17:28:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:28:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.7145373510000006, 2020-11-12T17:28:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002, 2020-11-12T17:28:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:28:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:28:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99998 2020-11-12T17:28:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489637+0000", 2020-11-12T17:28:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5010999999999999e-05 2020-11-12T17:28:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489692+0000", 2020-11-12T17:28:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32451660599999999 2020-11-12T17:28:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814209+0000", 2020-11-12T17:28:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3729999999999993e-06 2020-11-12T17:28:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814217+0000", 2020-11-12T17:28:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9755999999999997e-05 2020-11-12T17:28:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814257+0000", 2020-11-12T17:28:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2589999999999997e-06 2020-11-12T17:28:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814263+0000", 2020-11-12T17:28:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0548000000000002e-05 2020-11-12T17:28:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814344+0000", 2020-11-12T17:28:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002 2020-11-12T17:28:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "replica_scrub(pg: 5.0,from:0'0,to:164'3496,epoch:175/135,start:5:073087b9:::benchmark_data_smithi036_24110_object5847:0,end:5:07fd2517:::benchmark_data_smithi036_24110_object2426:0,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2020-11-12T17:28:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:28:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 3.8725215660000001, 2020-11-12T17:28:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003, 2020-11-12T17:28:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:28:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:28:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:28:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331660+0000", 2020-11-12T17:28:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6072000000000003e-05 2020-11-12T17:28:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331696+0000", 2020-11-12T17:28:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73693106399999997 2020-11-12T17:28:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068627+0000", 2020-11-12T17:28:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6524999999999998e-05 2020-11-12T17:28:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068643+0000", 2020-11-12T17:28:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000180683 2020-11-12T17:28:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068824+0000", 2020-11-12T17:28:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101581 2020-11-12T17:28:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068926+0000", 2020-11-12T17:28:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003 2020-11-12T17:28:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:10.542 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:10.545 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:10.545 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:10.545 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:10.545 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:10.545 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:10.545 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:10.546 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:10.546 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:10.546 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:10.546 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:28:10.547 INFO:teuthology.orchestra.run.smithi036.stderr:Error EPERM: min_compat_client jewel < luminous, which is required for pg-upmap. Try 'ceph osd set-require-min-compat-client luminous' before using the new interface 2020-11-12T17:28:10.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-12T17:28:10.548 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2020-11-12T17:28:10.548 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:10.546+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:10.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 84 16 63856 63840 5.93676 0 - 0.0188933 2020-11-12T17:28:10.645 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:10.640+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:10.696 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:10.696 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:10.697 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:28:10.697 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:10.709 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:28:10.753 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:10.748+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:10.847 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:10.844+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:10.886 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:10.887 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:10.887 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:28:10.887 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:28:10.887 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:10.900 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:28:10.986 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:10.984+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:11.049 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:11.044+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:11.061 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:11.061 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:28:11.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:28:11.062 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:28:11.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.062 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(4.6 123/122 [PushOp(4:60824407:::benchmark_data_smithi036_18856_object6950:head, version: 100'3208, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:60824407:::benchmark_data_smithi036_18856_object6950:head@100'3208, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:28:11.062 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:28:11.062 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 94.372896389000005, 2020-11-12T17:28:11.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998, 2020-11-12T17:28:11.063 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:11.063 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:11.063 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:11.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:11.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:28:11.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:11.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:11.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687283+0000", 2020-11-12T17:28:11.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999847 2020-11-12T17:28:11.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:11.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687268+0000", 2020-11-12T17:28:11.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2052999999999994e-05 2020-11-12T17:28:11.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:11.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:36.687360+0000", 2020-11-12T17:28:11.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54419334699999999 2020-11-12T17:28:11.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:11.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231553+0000", 2020-11-12T17:28:11.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.362e-06 2020-11-12T17:28:11.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:11.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231560+0000", 2020-11-12T17:28:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000185682 2020-11-12T17:28:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:11.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231746+0000", 2020-11-12T17:28:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0793e-05 2020-11-12T17:28:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.231797+0000", 2020-11-12T17:28:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003344549 2020-11-12T17:28:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:37.235141+0000", 2020-11-12T17:28:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54785832499999998 2020-11-12T17:28:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:11.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11902 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:28:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.109133197000006, 2020-11-12T17:28:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002, 2020-11-12T17:28:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:11.074 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11902 2020-11-12T17:28:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:11.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:28:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:11.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951046+0000", 2020-11-12T17:28:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999218 2020-11-12T17:28:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.950968+0000", 2020-11-12T17:28:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022604299999999999 2020-11-12T17:28:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951194+0000", 2020-11-12T17:28:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1806e-05 2020-11-12T17:28:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:11.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951226+0000", 2020-11-12T17:28:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5761999999999999e-05 2020-11-12T17:28:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:11.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951241+0000", 2020-11-12T17:28:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006854845 2020-11-12T17:28:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958096+0000", 2020-11-12T17:28:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026652700000000002 2020-11-12T17:28:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958363+0000", 2020-11-12T17:28:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000368857 2020-11-12T17:28:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:11.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.958732+0000", 2020-11-12T17:28:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027531859999999999 2020-11-12T17:28:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961485+0000", 2020-11-12T17:28:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43528204399999998 2020-11-12T17:28:11.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396767+0000", 2020-11-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015781399999999999 2020-11-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.396925+0000", 2020-11-12T17:28:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000109403 2020-11-12T17:28:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397034+0000", 2020-11-12T17:28:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44598790100000002 2020-11-12T17:28:11.085 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11903 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:28:11.086 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.108535650999997, 2020-11-12T17:28:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221, 2020-11-12T17:28:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11903 2020-11-12T17:28:11.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:28:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:11.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951644+0000", 2020-11-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999228 2020-11-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951566+0000", 2020-11-12T17:28:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024334899999999999 2020-11-12T17:28:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951810+0000", 2020-11-12T17:28:11.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9034e-05 2020-11-12T17:28:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951839+0000", 2020-11-12T17:28:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4151000000000001e-05 2020-11-12T17:28:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.951853+0000", 2020-11-12T17:28:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081211489999999994 2020-11-12T17:28:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.959974+0000", 2020-11-12T17:28:11.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013490799999999999 2020-11-12T17:28:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960109+0000", 2020-11-12T17:28:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000252172 2020-11-12T17:28:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:11.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.960361+0000", 2020-11-12T17:28:11.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024598829999999999 2020-11-12T17:28:11.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:11.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962821+0000", 2020-11-12T17:28:11.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43434482000000002 2020-11-12T17:28:11.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:11.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397166+0000", 2020-11-12T17:28:11.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013054200000000001 2020-11-12T17:28:11.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:11.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:11.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397296+0000", 2020-11-12T17:28:11.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5556000000000005e-05 2020-11-12T17:28:11.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:11.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.210 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:12.210 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397392+0000", 2020-11-12T17:28:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.445748221 2020-11-12T17:28:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.211 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11904 5.d 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:28:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.106072535999999, 2020-11-12T17:28:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003, 2020-11-12T17:28:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:12.212 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11904 2020-11-12T17:28:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:12.213 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:28:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:12.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954107+0000", 2020-11-12T17:28:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999237 2020-11-12T17:28:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954031+0000", 2020-11-12T17:28:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021660900000000001 2020-11-12T17:28:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:12.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954247+0000", 2020-11-12T17:28:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4606e-05 2020-11-12T17:28:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954282+0000", 2020-11-12T17:28:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.552e-05 2020-11-12T17:28:12.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.954297+0000", 2020-11-12T17:28:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0072408330000000003 2020-11-12T17:28:12.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961538+0000", 2020-11-12T17:28:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013512800000000001 2020-11-12T17:28:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961673+0000", 2020-11-12T17:28:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023430200000000001 2020-11-12T17:28:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961908+0000", 2020-11-12T17:28:12.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016600740000000001 2020-11-12T17:28:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963568+0000", 2020-11-12T17:28:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43393070099999997 2020-11-12T17:28:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:12.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397499+0000", 2020-11-12T17:28:13.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012872 2020-11-12T17:28:13.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397627+0000", 2020-11-12T17:28:13.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4786999999999999e-05 2020-11-12T17:28:13.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.397722+0000", 2020-11-12T17:28:13.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44361512800000003 2020-11-12T17:28:13.153 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.154 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.154 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.155 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11909 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:13.155 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:28:13.155 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.098333839999995, 2020-11-12T17:28:13.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999, 2020-11-12T17:28:13.155 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.155 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.156 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.156 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.156 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.156 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11909 2020-11-12T17:28:13.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.156 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:28:13.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961846+0000", 2020-11-12T17:28:13.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999576 2020-11-12T17:28:13.158 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.158 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.158 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961803+0000", 2020-11-12T17:28:13.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9606999999999998e-05 2020-11-12T17:28:13.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.159 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.159 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961893+0000", 2020-11-12T17:28:13.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0258000000000001e-05 2020-11-12T17:28:13.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961903+0000", 2020-11-12T17:28:13.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8450000000000003e-06 2020-11-12T17:28:13.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.961911+0000", 2020-11-12T17:28:13.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00090397899999999996 2020-11-12T17:28:13.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962815+0000", 2020-11-12T17:28:13.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106487 2020-11-12T17:28:13.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.962921+0000", 2020-11-12T17:28:13.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027479400000000003 2020-11-12T17:28:13.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:13.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963196+0000", 2020-11-12T17:28:13.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002806041 2020-11-12T17:28:13.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966002+0000", 2020-11-12T17:28:13.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42403797700000001 2020-11-12T17:28:13.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.165 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390040+0000", 2020-11-12T17:28:13.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017360699999999999 2020-11-12T17:28:13.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390214+0000", 2020-11-12T17:28:13.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012036600000000001 2020-11-12T17:28:13.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.390334+0000", 2020-11-12T17:28:13.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42848861399999999 2020-11-12T17:28:13.168 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.168 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.169 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.169 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11910 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:13.169 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:28:13.169 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.097117548, 2020-11-12T17:28:13.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002, 2020-11-12T17:28:13.170 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.170 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.170 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.171 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11910 2020-11-12T17:28:13.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.171 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:28:13.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.172 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963062+0000", 2020-11-12T17:28:13.172 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999413 2020-11-12T17:28:13.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.172 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963003+0000", 2020-11-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017848699999999999 2020-11-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963182+0000", 2020-11-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7229000000000001e-05 2020-11-12T17:28:13.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963199+0000", 2020-11-12T17:28:13.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2609999999999999e-06 2020-11-12T17:28:13.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963208+0000", 2020-11-12T17:28:13.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089699300000000001 2020-11-12T17:28:13.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964105+0000", 2020-11-12T17:28:13.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012321200000000001 2020-11-12T17:28:13.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964228+0000", 2020-11-12T17:28:13.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00022185600000000001 2020-11-12T17:28:13.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:13.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.964450+0000", 2020-11-12T17:28:13.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001555697 2020-11-12T17:28:13.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966006+0000", 2020-11-12T17:28:13.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42809403299999998 2020-11-12T17:28:13.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394100+0000", 2020-11-12T17:28:13.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012522 2020-11-12T17:28:13.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394225+0000", 2020-11-12T17:28:13.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014087 2020-11-12T17:28:13.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.394366+0000", 2020-11-12T17:28:13.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43130421200000002 2020-11-12T17:28:13.181 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.181 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.182 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.182 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11911 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:13.182 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:28:13.183 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.096887805999998, 2020-11-12T17:28:13.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998, 2020-11-12T17:28:13.183 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.183 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.183 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.184 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11911 2020-11-12T17:28:13.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.184 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:28:13.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963292+0000", 2020-11-12T17:28:13.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999547 2020-11-12T17:28:13.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963246+0000", 2020-11-12T17:28:13.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000132867 2020-11-12T17:28:13.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963379+0000", 2020-11-12T17:28:13.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1556000000000002e-05 2020-11-12T17:28:13.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963401+0000", 2020-11-12T17:28:13.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2499999999999997e-05 2020-11-12T17:28:13.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.963433+0000", 2020-11-12T17:28:13.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018380040000000001 2020-11-12T17:28:13.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965271+0000", 2020-11-12T17:28:13.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6691000000000002e-05 2020-11-12T17:28:13.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.217 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.217 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.217 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965338+0000", 2020-11-12T17:28:13.217 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100777 2020-11-12T17:28:13.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.218 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:13.219 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.965439+0000", 2020-11-12T17:28:13.219 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001679198 2020-11-12T17:28:13.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.219 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967118+0000", 2020-11-12T17:28:13.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.435251412 2020-11-12T17:28:13.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.220 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.220 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402369+0000", 2020-11-12T17:28:13.220 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6074000000000005e-05 2020-11-12T17:28:13.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.221 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.222 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402435+0000", 2020-11-12T17:28:13.222 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6678999999999997e-05 2020-11-12T17:28:13.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402492+0000", 2020-11-12T17:28:13.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43920047499999998 2020-11-12T17:28:13.223 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.224 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.224 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.225 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:11912 5.a 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:13.225 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:28:13.225 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.093859855999995, 2020-11-12T17:28:13.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997, 2020-11-12T17:28:13.225 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.226 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.226 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.227 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 11912 2020-11-12T17:28:13.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.227 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.227 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.228 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:28:13.228 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.228 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966320+0000", 2020-11-12T17:28:13.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:13.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.229 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.229 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966296+0000", 2020-11-12T17:28:13.229 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6765000000000002e-05 2020-11-12T17:28:13.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.230 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.230 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966363+0000", 2020-11-12T17:28:13.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3097e-05 2020-11-12T17:28:13.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.231 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966376+0000", 2020-11-12T17:28:13.231 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0669999999999998e-06 2020-11-12T17:28:13.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966385+0000", 2020-11-12T17:28:13.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7963999999999997e-05 2020-11-12T17:28:13.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966433+0000", 2020-11-12T17:28:13.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0263999999999998e-05 2020-11-12T17:28:13.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966494+0000", 2020-11-12T17:28:13.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000120279 2020-11-12T17:28:13.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:13.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.966614+0000", 2020-11-12T17:28:13.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001180424 2020-11-12T17:28:13.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.236 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:56.967794+0000", 2020-11-12T17:28:13.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43476916100000002 2020-11-12T17:28:13.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.237 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402563+0000", 2020-11-12T17:28:13.237 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7442999999999998e-05 2020-11-12T17:28:13.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.237 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402631+0000", 2020-11-12T17:28:13.238 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8424999999999998e-05 2020-11-12T17:28:13.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.238 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.238 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:57.402679+0000", 2020-11-12T17:28:13.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43635978199999997 2020-11-12T17:28:13.239 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.239 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.239 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.240 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:16064 5.a 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:28:13.240 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:28:13.240 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.565031282000007, 2020-11-12T17:28:13.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999, 2020-11-12T17:28:13.240 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.241 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.241 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.241 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.241 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.242 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 16064 2020-11-12T17:28:13.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.243 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:28:13.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495148+0000", 2020-11-12T17:28:13.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:28:13.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495102+0000", 2020-11-12T17:28:13.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012806100000000001 2020-11-12T17:28:13.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495230+0000", 2020-11-12T17:28:13.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1214999999999999e-05 2020-11-12T17:28:13.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495251+0000", 2020-11-12T17:28:13.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1668000000000001e-05 2020-11-12T17:28:13.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495262+0000", 2020-11-12T17:28:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6068999999999994e-05 2020-11-12T17:28:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495329+0000", 2020-11-12T17:28:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011465599999999999 2020-11-12T17:28:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495443+0000", 2020-11-12T17:28:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000230077 2020-11-12T17:28:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.495673+0000", 2020-11-12T17:28:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013291710000000001 2020-11-12T17:28:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:03.497002+0000", 2020-11-12T17:28:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69030446599999995 2020-11-12T17:28:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187307+0000", 2020-11-12T17:28:13.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011451999999999999 2020-11-12T17:28:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187421+0000", 2020-11-12T17:28:13.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5153000000000004e-05 2020-11-12T17:28:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:04.187497+0000", 2020-11-12T17:28:13.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.69234842299999999 2020-11-12T17:28:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:36040 5.a 5:5a4d50fb:::benchmark_data_smithi036_24110_object4504:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:28:13.255 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.529209+0000", 2020-11-12T17:28:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.530969974000001, 2020-11-12T17:28:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.413632096, 2020-11-12T17:28:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.256 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 36040 2020-11-12T17:28:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.257 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529209+0000", 2020-11-12T17:28:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529209+0000", 2020-11-12T17:28:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529168+0000", 2020-11-12T17:28:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119506 2020-11-12T17:28:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529287+0000", 2020-11-12T17:28:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8187000000000001e-05 2020-11-12T17:28:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529305+0000", 2020-11-12T17:28:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6398000000000001e-05 2020-11-12T17:28:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.529322+0000", 2020-11-12T17:28:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.004923256 2020-11-12T17:28:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.534245+0000", 2020-11-12T17:28:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015559699999999999 2020-11-12T17:28:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.534401+0000", 2020-11-12T17:28:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000141383 2020-11-12T17:28:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.534542+0000", 2020-11-12T17:28:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001966364 2020-11-12T17:28:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.536508+0000", 2020-11-12T17:28:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.406177766 2020-11-12T17:28:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.942686+0000", 2020-11-12T17:28:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3378e-05 2020-11-12T17:28:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.942770+0000", 2020-11-12T17:28:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1925e-05 2020-11-12T17:28:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.942842+0000", 2020-11-12T17:28:13.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.413632096 2020-11-12T17:28:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:47368 5.d 5:bb02c29c:::benchmark_data_smithi036_24110_object5920:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e156)", 2020-11-12T17:28:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:37.868932+0000", 2020-11-12T17:28:13.272 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 33.191247355000002, 2020-11-12T17:28:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.57837236700000005, 2020-11-12T17:28:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.273 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 47368 2020-11-12T17:28:13.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.275 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868932+0000", 2020-11-12T17:28:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868932+0000", 2020-11-12T17:28:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868914+0000", 2020-11-12T17:28:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1044999999999996e-05 2020-11-12T17:28:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868975+0000", 2020-11-12T17:28:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4759999999999998e-06 2020-11-12T17:28:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868984+0000", 2020-11-12T17:28:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9969999999999998e-06 2020-11-12T17:28:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.868989+0000", 2020-11-12T17:28:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010214598 2020-11-12T17:28:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.879203+0000", 2020-11-12T17:28:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00045404100000000003 2020-11-12T17:28:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.879657+0000", 2020-11-12T17:28:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016182300000000001 2020-11-12T17:28:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.879819+0000", 2020-11-12T17:28:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002506416 2020-11-12T17:28:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.882326+0000", 2020-11-12T17:28:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56483934000000002 2020-11-12T17:28:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447165+0000", 2020-11-12T17:28:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.6382000000000002e-05 2020-11-12T17:28:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447241+0000", 2020-11-12T17:28:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3171999999999998e-05 2020-11-12T17:28:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447304+0000", 2020-11-12T17:28:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.57837236700000005 2020-11-12T17:28:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:47368 5.d e157/127 ondisk, result = 0)", 2020-11-12T17:28:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:37.881979+0000", 2020-11-12T17:28:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 33.178200768000004, 2020-11-12T17:28:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56533648800000003, 2020-11-12T17:28:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.881979+0000", 2020-11-12T17:28:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.881979+0000", 2020-11-12T17:28:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999738 2020-11-12T17:28:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.881952+0000", 2020-11-12T17:28:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6735000000000004e-05 2020-11-12T17:28:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:37.882019+0000", 2020-11-12T17:28:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56217692500000005 2020-11-12T17:28:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.444196+0000", 2020-11-12T17:28:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9569999999999999e-06 2020-11-12T17:28:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.444202+0000", 2020-11-12T17:28:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002939863 2020-11-12T17:28:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447142+0000", 2020-11-12T17:28:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3016999999999999e-05 2020-11-12T17:28:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447155+0000", 2020-11-12T17:28:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016018200000000001 2020-11-12T17:28:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.447315+0000", 2020-11-12T17:28:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56533648800000003 2020-11-12T17:28:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:47440 5.a 5:524d237b:::benchmark_data_smithi036_24110_object5929:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e157)", 2020-11-12T17:28:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:38.289101+0000", 2020-11-12T17:28:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 32.771078584999998, 2020-11-12T17:28:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42989421300000003, 2020-11-12T17:28:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 47440 2020-11-12T17:28:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289101+0000", 2020-11-12T17:28:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289101+0000", 2020-11-12T17:28:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999404 2020-11-12T17:28:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289041+0000", 2020-11-12T17:28:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016792000000000001 2020-11-12T17:28:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289209+0000", 2020-11-12T17:28:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.7087e-05 2020-11-12T17:28:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289236+0000", 2020-11-12T17:28:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8799999999999997e-06 2020-11-12T17:28:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.289245+0000", 2020-11-12T17:28:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.009443112 2020-11-12T17:28:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.298688+0000", 2020-11-12T17:28:13.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000102744 2020-11-12T17:28:13.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.298791+0000", 2020-11-12T17:28:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000179529 2020-11-12T17:28:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.298970+0000", 2020-11-12T17:28:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021817910000000002 2020-11-12T17:28:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.301152+0000", 2020-11-12T17:28:13.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41777362099999998 2020-11-12T17:28:13.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718926+0000", 2020-11-12T17:28:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0852999999999997e-05 2020-11-12T17:28:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718967+0000", 2020-11-12T17:28:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8350000000000001e-05 2020-11-12T17:28:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718995+0000", 2020-11-12T17:28:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42989421300000003 2020-11-12T17:28:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:47440 5.a e157/127 ondisk, result = 0)", 2020-11-12T17:28:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:38.308251+0000", 2020-11-12T17:28:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 32.751928663999998, 2020-11-12T17:28:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41075154800000002, 2020-11-12T17:28:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.308251+0000", 2020-11-12T17:28:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.308251+0000", 2020-11-12T17:28:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999566 2020-11-12T17:28:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.308207+0000", 2020-11-12T17:28:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011763400000000001 2020-11-12T17:28:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.308325+0000", 2020-11-12T17:28:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40919850400000002 2020-11-12T17:28:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.717524+0000", 2020-11-12T17:28:13.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1149999999999996e-06 2020-11-12T17:28:13.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.717531+0000", 2020-11-12T17:28:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013845350000000001 2020-11-12T17:28:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718915+0000", 2020-11-12T17:28:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0499999999999999e-06 2020-11-12T17:28:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.718920+0000", 2020-11-12T17:28:13.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2062000000000001e-05 2020-11-12T17:28:13.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:38.719002+0000", 2020-11-12T17:28:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41075154800000002 2020-11-12T17:28:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.495 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:51080 5.8 e158/135 ondisk, result = 0)", 2020-11-12T17:28:13.495 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:42.698641+0000", 2020-11-12T17:28:13.495 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 28.361538092, 2020-11-12T17:28:13.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46923845800000002, 2020-11-12T17:28:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:42.698641+0000", 2020-11-12T17:28:13.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:42.698641+0000", 2020-11-12T17:28:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:28:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:42.698622+0000", 2020-11-12T17:28:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0272000000000003e-05 2020-11-12T17:28:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:42.698673+0000", 2020-11-12T17:28:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46684430399999999 2020-11-12T17:28:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.165517+0000", 2020-11-12T17:28:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9720000000000003e-06 2020-11-12T17:28:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.165521+0000", 2020-11-12T17:28:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002158975 2020-11-12T17:28:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.167680+0000", 2020-11-12T17:28:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4918e-05 2020-11-12T17:28:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.167695+0000", 2020-11-12T17:28:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018486500000000001 2020-11-12T17:28:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:43.167880+0000", 2020-11-12T17:28:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46923845800000002 2020-11-12T17:28:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.505 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:52600 5.a 5:5e833be2:::benchmark_data_smithi036_24110_object6574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e159)", 2020-11-12T17:28:13.505 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:44.608056+0000", 2020-11-12T17:28:13.505 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.4521236, 2020-11-12T17:28:13.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.512363283, 2020-11-12T17:28:13.505 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.506 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.506 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.506 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.506 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.506 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 52600 2020-11-12T17:28:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608056+0000", 2020-11-12T17:28:13.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608056+0000", 2020-11-12T17:28:13.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:13.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608020+0000", 2020-11-12T17:28:13.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5087999999999996e-05 2020-11-12T17:28:13.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608105+0000", 2020-11-12T17:28:13.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2513e-05 2020-11-12T17:28:13.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608118+0000", 2020-11-12T17:28:13.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0320000000000003e-06 2020-11-12T17:28:13.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.608123+0000", 2020-11-12T17:28:13.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0087713050000000001 2020-11-12T17:28:13.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.616894+0000", 2020-11-12T17:28:13.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7459000000000005e-05 2020-11-12T17:28:13.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.616971+0000", 2020-11-12T17:28:13.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000116193 2020-11-12T17:28:13.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:13.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.617087+0000", 2020-11-12T17:28:13.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0062006379999999996 2020-11-12T17:28:13.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.623288+0000", 2020-11-12T17:28:13.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49692469700000003 2020-11-12T17:28:13.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120213+0000", 2020-11-12T17:28:13.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2360000000000004e-05 2020-11-12T17:28:13.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120295+0000", 2020-11-12T17:28:13.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000123917 2020-11-12T17:28:13.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120419+0000", 2020-11-12T17:28:13.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.512363283 2020-11-12T17:28:13.560 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.560 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.561 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.561 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:52600 5.a e159/127 ondisk, result = 0)", 2020-11-12T17:28:13.561 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:44.620241+0000", 2020-11-12T17:28:13.561 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 26.439938584, 2020-11-12T17:28:13.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50019401399999996, 2020-11-12T17:28:13.561 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.562 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:13.562 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.620241+0000", 2020-11-12T17:28:13.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.620241+0000", 2020-11-12T17:28:13.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999743 2020-11-12T17:28:13.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.620215+0000", 2020-11-12T17:28:13.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4766999999999998e-05 2020-11-12T17:28:13.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.620280+0000", 2020-11-12T17:28:13.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49972755099999999 2020-11-12T17:28:13.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120007+0000", 2020-11-12T17:28:13.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.102e-05 2020-11-12T17:28:13.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120018+0000", 2020-11-12T17:28:13.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015120300000000001 2020-11-12T17:28:13.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120170+0000", 2020-11-12T17:28:13.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0275999999999999e-05 2020-11-12T17:28:13.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.705 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120200+0000", 2020-11-12T17:28:13.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00023494 2020-11-12T17:28:13.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.120435+0000", 2020-11-12T17:28:13.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50019401399999996 2020-11-12T17:28:13.746 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.746 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.746 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.748 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:62696 5.d 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:13.748 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:59.571028+0000", 2020-11-12T17:28:13.748 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 11.489151816, 2020-11-12T17:28:13.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.714481692, 2020-11-12T17:28:13.749 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.750 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.751 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.752 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.752 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 62696 2020-11-12T17:28:13.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.753 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.754 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.754 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571028+0000", 2020-11-12T17:28:13.755 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571028+0000", 2020-11-12T17:28:13.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:28:13.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571005+0000", 2020-11-12T17:28:13.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1137999999999996e-05 2020-11-12T17:28:13.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571066+0000", 2020-11-12T17:28:13.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.516e-06 2020-11-12T17:28:13.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571076+0000", 2020-11-12T17:28:13.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8019999999999999e-06 2020-11-12T17:28:13.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.571081+0000", 2020-11-12T17:28:13.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015302549999999999 2020-11-12T17:28:13.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.766 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.766 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.572611+0000", 2020-11-12T17:28:13.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104756 2020-11-12T17:28:13.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.572716+0000", 2020-11-12T17:28:13.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018723700000000001 2020-11-12T17:28:13.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:13.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.572903+0000", 2020-11-12T17:28:13.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066609590000000002 2020-11-12T17:28:13.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.579564+0000", 2020-11-12T17:28:13.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.70574321600000001 2020-11-12T17:28:13.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.285307+0000", 2020-11-12T17:28:13.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012079299999999999 2020-11-12T17:28:13.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.285428+0000", 2020-11-12T17:28:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1409999999999995e-05 2020-11-12T17:28:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.285509+0000", 2020-11-12T17:28:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.714481692 2020-11-12T17:28:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63136 5.d 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e173)", 2020-11-12T17:28:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.877330+0000", 2020-11-12T17:28:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.182849404000001, 2020-11-12T17:28:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59933710100000004, 2020-11-12T17:28:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63136 2020-11-12T17:28:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877330+0000", 2020-11-12T17:28:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877330+0000", 2020-11-12T17:28:13.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:13.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877290+0000", 2020-11-12T17:28:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018022900000000001 2020-11-12T17:28:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877470+0000", 2020-11-12T17:28:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6106000000000003e-05 2020-11-12T17:28:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877506+0000", 2020-11-12T17:28:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2989e-05 2020-11-12T17:28:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.877519+0000", 2020-11-12T17:28:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016617435999999999 2020-11-12T17:28:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.894136+0000", 2020-11-12T17:28:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018983100000000001 2020-11-12T17:28:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.894326+0000", 2020-11-12T17:28:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019385100000000001 2020-11-12T17:28:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.894520+0000", 2020-11-12T17:28:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026166140000000002 2020-11-12T17:28:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.897137+0000", 2020-11-12T17:28:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.57945034500000003 2020-11-12T17:28:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:13.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.476587+0000", 2020-11-12T17:28:13.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6149000000000002e-05 2020-11-12T17:28:13.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.476623+0000", 2020-11-12T17:28:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3951e-05 2020-11-12T17:28:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.476667+0000", 2020-11-12T17:28:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59933710100000004 2020-11-12T17:28:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63136 5.d 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e173)", 2020-11-12T17:28:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.997193+0000", 2020-11-12T17:28:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.062986486, 2020-11-12T17:28:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47944447499999998, 2020-11-12T17:28:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:28:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63136 2020-11-12T17:28:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997193+0000", 2020-11-12T17:28:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997193+0000", 2020-11-12T17:28:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:28:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:13.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997174+0000", 2020-11-12T17:28:13.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0644999999999999e-05 2020-11-12T17:28:13.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997244+0000", 2020-11-12T17:28:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1749000000000001e-05 2020-11-12T17:28:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997256+0000", 2020-11-12T17:28:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1790000000000002e-06 2020-11-12T17:28:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997263+0000", 2020-11-12T17:28:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5563999999999999e-05 2020-11-12T17:28:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997309+0000", 2020-11-12T17:28:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4527999999999997e-05 2020-11-12T17:28:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.997363+0000", 2020-11-12T17:28:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47927397900000002 2020-11-12T17:28:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.476637+0000", 2020-11-12T17:28:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47944447499999998 2020-11-12T17:28:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:13.967 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:13.968 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:28:14.092 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:14.095 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 85 16 64606 64590 5.93584 0.732422 0.0180669 0.0210481 2020-11-12T17:28:14.095 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 86 16 65333 65317 5.93286 5.67969 0.0128195 0.0210543 2020-11-12T17:28:14.095 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 87 16 65956 65940 5.92061 4.86719 0.0115217 0.0211021 2020-11-12T17:28:14.096 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:13.966+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:14.096 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:28:14.099 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:14.098+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:14.202 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:14.198+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:14.301 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:14.296+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:14.312 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:14.313 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:28:14.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.314 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:66524 5.3 5:c766034e:::benchmark_data_smithi036_24110_object8315:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e178)", 2020-11-12T17:28:14.314 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:14.290396+0000", 2020-11-12T17:28:14.314 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.016623663, 2020-11-12T17:28:14.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.01664728, 2020-11-12T17:28:14.315 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:14.315 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:14.315 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:14.315 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:14.316 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:14.316 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 66524 2020-11-12T17:28:14.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.472 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:14.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:14.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290396+0000", 2020-11-12T17:28:14.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:14.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:14.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290396+0000", 2020-11-12T17:28:14.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:14.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:14.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290358+0000", 2020-11-12T17:28:14.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9741999999999995e-05 2020-11-12T17:28:14.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:14.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290458+0000", 2020-11-12T17:28:14.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2728000000000001e-05 2020-11-12T17:28:14.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:14.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290470+0000", 2020-11-12T17:28:14.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3840000000000002e-06 2020-11-12T17:28:14.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:14.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290477+0000", 2020-11-12T17:28:14.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003311385 2020-11-12T17:28:14.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:14.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.293788+0000", 2020-11-12T17:28:14.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0634e-05 2020-11-12T17:28:14.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:14.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.293879+0000", 2020-11-12T17:28:14.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107159 2020-11-12T17:28:14.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:14.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.293986+0000", 2020-11-12T17:28:14.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0056414220000000001 2020-11-12T17:28:14.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:14.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.299627+0000", 2020-11-12T17:28:14.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092314029999999991 2020-11-12T17:28:14.481 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:14.481 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.482 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:66525 5.3 5:c766034e:::benchmark_data_smithi036_24110_object8315:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e178)", 2020-11-12T17:28:14.482 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:14.290626+0000", 2020-11-12T17:28:14.482 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.016393475000000001, 2020-11-12T17:28:14.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016530804, 2020-11-12T17:28:14.483 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:14.483 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:14.483 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:14.483 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:14.484 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:14.484 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 66525 2020-11-12T17:28:14.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.484 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:14.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:14.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290626+0000", 2020-11-12T17:28:14.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:14.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:14.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290626+0000", 2020-11-12T17:28:14.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999676 2020-11-12T17:28:14.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:14.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290594+0000", 2020-11-12T17:28:14.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0544000000000006e-05 2020-11-12T17:28:14.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:14.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290684+0000", 2020-11-12T17:28:14.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5199e-05 2020-11-12T17:28:14.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:14.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290700+0000", 2020-11-12T17:28:14.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0950000000000001e-06 2020-11-12T17:28:14.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:14.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290706+0000", 2020-11-12T17:28:14.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0045834350000000003 2020-11-12T17:28:14.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:14.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.295289+0000", 2020-11-12T17:28:14.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7827e-05 2020-11-12T17:28:14.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:14.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.295357+0000", 2020-11-12T17:28:14.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119435 2020-11-12T17:28:14.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:14.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.295476+0000", 2020-11-12T17:28:14.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0095512349999999999 2020-11-12T17:28:14.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:14.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.305028+0000", 2020-11-12T17:28:14.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.014401476999999999 2020-11-12T17:28:14.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.492 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:14.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.493 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:66526 5.3 5:c766034e:::benchmark_data_smithi036_24110_object8315:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e178)", 2020-11-12T17:28:14.493 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:14.290846+0000", 2020-11-12T17:28:14.493 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.016173131, 2020-11-12T17:28:14.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016415437000000001, 2020-11-12T17:28:14.493 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:14.493 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:14.494 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:14.494 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:14.494 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:14.494 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 66526 2020-11-12T17:28:14.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.494 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:14.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:14.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290846+0000", 2020-11-12T17:28:14.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:14.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:14.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290846+0000", 2020-11-12T17:28:14.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:28:14.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:14.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290809+0000", 2020-11-12T17:28:14.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010270800000000001 2020-11-12T17:28:14.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:14.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290912+0000", 2020-11-12T17:28:14.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5889999999999999e-05 2020-11-12T17:28:14.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:14.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290928+0000", 2020-11-12T17:28:14.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8259999999999993e-06 2020-11-12T17:28:14.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:14.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.290936+0000", 2020-11-12T17:28:14.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066306799999999999 2020-11-12T17:28:14.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:14.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.297566+0000", 2020-11-12T17:28:14.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000228027 2020-11-12T17:28:14.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:14.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.297794+0000", 2020-11-12T17:28:14.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000176396 2020-11-12T17:28:14.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:14.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.297971+0000", 2020-11-12T17:28:14.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0071242679999999996 2020-11-12T17:28:14.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.501 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:14.501 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.501 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:66527 5.3 5:c766034e:::benchmark_data_smithi036_24110_object8315:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e178)", 2020-11-12T17:28:14.501 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:14.292300+0000", 2020-11-12T17:28:14.502 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.014719549, 2020-11-12T17:28:14.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015059362999999999, 2020-11-12T17:28:14.502 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:14.502 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:14.502 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:14.502 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:14.502 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:14.503 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 66527 2020-11-12T17:28:14.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.503 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:14.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:14.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.292300+0000", 2020-11-12T17:28:14.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:14.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:14.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.292300+0000", 2020-11-12T17:28:14.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:14.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:14.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.292273+0000", 2020-11-12T17:28:14.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8214999999999996e-05 2020-11-12T17:28:14.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:14.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.292351+0000", 2020-11-12T17:28:14.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0917999999999999e-05 2020-11-12T17:28:14.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:14.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.292362+0000", 2020-11-12T17:28:14.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7760000000000003e-06 2020-11-12T17:28:14.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:14.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.292368+0000", 2020-11-12T17:28:14.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0081670860000000005 2020-11-12T17:28:14.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:14.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.300535+0000", 2020-11-12T17:28:14.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5993000000000003e-05 2020-11-12T17:28:14.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:14.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.300601+0000", 2020-11-12T17:28:14.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6082999999999995e-05 2020-11-12T17:28:14.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:14.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.300697+0000", 2020-11-12T17:28:14.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0083967120000000006 2020-11-12T17:28:14.509 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.509 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:14.509 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.510 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:66528 5.3 5:c766034e:::benchmark_data_smithi036_24110_object8315:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e178)", 2020-11-12T17:28:14.510 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:14.293973+0000", 2020-11-12T17:28:14.510 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.013046599000000001, 2020-11-12T17:28:14.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.013480644, 2020-11-12T17:28:14.510 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:14.511 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:14.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:14.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:14.511 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:14.511 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 66528 2020-11-12T17:28:14.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.511 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:14.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:14.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.293973+0000", 2020-11-12T17:28:14.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:14.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:14.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.293973+0000", 2020-11-12T17:28:14.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:28:14.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:14.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.293952+0000", 2020-11-12T17:28:14.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7979000000000002e-05 2020-11-12T17:28:14.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:14.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.294010+0000", 2020-11-12T17:28:14.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4069999999999993e-06 2020-11-12T17:28:14.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:14.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.294018+0000", 2020-11-12T17:28:14.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7509999999999999e-06 2020-11-12T17:28:14.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:14.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.294023+0000", 2020-11-12T17:28:14.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011078118 2020-11-12T17:28:14.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:14.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.305101+0000", 2020-11-12T17:28:14.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018723899999999999 2020-11-12T17:28:14.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:14.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.305289+0000", 2020-11-12T17:28:14.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000209519 2020-11-12T17:28:14.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:14.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.305498+0000", 2020-11-12T17:28:14.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011525069000000001 2020-11-12T17:28:14.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:14.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.518 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:66524 5.3 e178/174 ondisk, result = 0)", 2020-11-12T17:28:14.518 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:14.298009+0000", 2020-11-12T17:28:14.518 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0090106720000000008, 2020-11-12T17:28:14.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0095462350000000001, 2020-11-12T17:28:14.519 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:14.519 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:14.519 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:14.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:14.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.298009+0000", 2020-11-12T17:28:14.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:14.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:14.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.298009+0000", 2020-11-12T17:28:14.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:14.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:14.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.297980+0000", 2020-11-12T17:28:14.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0807000000000002e-05 2020-11-12T17:28:14.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:14.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.298050+0000", 2020-11-12T17:28:14.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028453430000000002 2020-11-12T17:28:14.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:14.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.300896+0000", 2020-11-12T17:28:14.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1190000000000003e-06 2020-11-12T17:28:14.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:14.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.300905+0000", 2020-11-12T17:28:14.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0064817479999999998 2020-11-12T17:28:14.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:14.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.307387+0000", 2020-11-12T17:28:14.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2490000000000007e-06 2020-11-12T17:28:14.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:14.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.307396+0000", 2020-11-12T17:28:14.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0093869850000000005 2020-11-12T17:28:14.524 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.525 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:14.525 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.525 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:66525 5.3 e178/174)", 2020-11-12T17:28:14.525 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:14.300842+0000", 2020-11-12T17:28:14.525 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0061777630000000002, 2020-11-12T17:28:14.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0067888080000000003, 2020-11-12T17:28:14.526 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:14.526 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "queued for pg", 2020-11-12T17:28:14.526 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:14.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:14.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.300842+0000", 2020-11-12T17:28:14.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:14.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:14.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.300842+0000", 2020-11-12T17:28:14.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:28:14.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:14.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.300820+0000", 2020-11-12T17:28:14.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5822999999999997e-05 2020-11-12T17:28:14.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:14.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.300876+0000", 2020-11-12T17:28:14.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002828788 2020-11-12T17:28:14.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:14.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.303704+0000", 2020-11-12T17:28:14.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3259999999999996e-06 2020-11-12T17:28:14.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:14.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:14.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:14.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:14.303713+0000", 2020-11-12T17:28:14.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028710060000000002 2020-11-12T17:28:14.530 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.530 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:14.531 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.531 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:14.531 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:14.531 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 7 2020-11-12T17:28:14.531 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:14.533 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:28:14.534 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:14.534 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:14.534 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:14.534 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:14.534 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:14.535 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:14.530+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:14.559 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:14.564 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 88 16 66737 66721 5.92266 6.10156 0.0135886 0.021098 2020-11-12T17:28:14.604 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:14.632 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:14.635 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:14.632+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:14.639 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:14.639 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:14.639 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:14.640 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:14.640 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:14.640 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:14.640 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:14.640 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:14.688 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:14.688 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:14.699 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:28:14.736 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:14.734+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:14.837 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:14.834+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:14.867 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:14.868 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:14.879 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:28:14.937 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:14.934+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:15.027 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:15.028 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:15.039 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:15.036+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:15.041 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:28:15.045 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:28:15.053 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:15.048+0000 7f0389ec4700 -1 osd.2 178 handle_osd_map injecting map crc failure 2020-11-12T17:28:15.145 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:15.136+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:15.187 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:15.187 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:15.199 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:28:15.242 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:15.240+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:15.342 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:15.338+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:15.374 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:15.375 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:15.388 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:15.443 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:15.440+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:15.515 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:15.515 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:15.524 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:15.544 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:15.540+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:15.548 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 1, 0] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:15.549 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:15.550 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [3, 4, 5, 7, 6, 2, 1, 0] 2020-11-12T17:28:15.550 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd out 1 2020-11-12T17:28:15.564 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 89 16 67523 67507 5.9251 6.14062 0.195192 0.0210824 2020-11-12T17:28:15.641 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:15.642 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:15.645 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:15.642+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:15.653 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:15.746 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:15.742+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:15.804 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:15.805 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:15.816 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:15.847 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:15.844+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:15.896 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:28:15.892+0000 7f4952786700 -1 mon.a@0(leader).osd e179 definitely_dead 0 2020-11-12T17:28:15.950 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:15.944+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:15.973 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:15.973 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:15.982 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:16.049 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:16.046+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:16.068 INFO:teuthology.orchestra.run.smithi036.stderr:marked out osd.1. 2020-11-12T17:28:16.100 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:16.101 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:16.109 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:16.150 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:16.148+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:16.251 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:16.250+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:16.265 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:16.266 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:16.274 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:16.375 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:16.374+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:16.442 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:16.443 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:16.453 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:16.454 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:16.448+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:16.555 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:16.550+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:16.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 90 16 67887 67871 5.89086 2.84375 0.281675 0.021096 2020-11-12T17:28:16.601 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:16.686 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:16.687 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:16.688 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:16.689 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:16.686+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:16.788 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:16.786+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:16.845 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:16.902 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:16.903 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:16.903 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:16.904 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:16.905 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:16.900+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:16.920 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:16.949 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:16.978 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:17.004 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:17.000+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:17.008 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:17.040 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:17.322 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:28:17.325 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:17.325 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:17.325 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:17.325 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:17.326 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:17.326 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:17.326 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:17.326 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:17.326 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:17.327 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:17.327 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:17.327 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:17.320+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:17.329 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:17.418 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:17.416+0000 7f038ead6700 -1 osd.2 181 handle_osd_map injecting map crc failure 2020-11-12T17:28:17.515 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:17.515 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:17.515 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:17.515 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:17.515 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:17.516 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:17.517 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:17.512+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:17.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Total time run: 90.7046 2020-11-12T17:28:17.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Total writes made: 67887 2020-11-12T17:28:17.565 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Write size: 8192 2020-11-12T17:28:17.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Object size: 65536 2020-11-12T17:28:17.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Bandwidth (MB/sec): 5.84719 2020-11-12T17:28:17.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev Bandwidth: 2.82945 2020-11-12T17:28:17.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max bandwidth (MB/sec): 10.1875 2020-11-12T17:28:17.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min bandwidth (MB/sec): 0 2020-11-12T17:28:17.566 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Average IOPS: 748 2020-11-12T17:28:17.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev IOPS: 362.184 2020-11-12T17:28:17.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max IOPS: 1304 2020-11-12T17:28:17.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min IOPS: 0 2020-11-12T17:28:17.567 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Average Latency(s): 0.021368 2020-11-12T17:28:17.568 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev Latency(s): 0.14346 2020-11-12T17:28:17.568 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max latency(s): 8.87534 2020-11-12T17:28:17.568 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min latency(s): 0.00209322 2020-11-12T17:28:17.575 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Cleaning up (deleting benchmark objects) 2020-11-12T17:28:17.617 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:17.612+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:17.676 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:17.944 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:17.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:17.945 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:28:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:17.946 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 308.83116984399999, 2020-11-12T17:28:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:28:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:17.947 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:17.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:17.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:28:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:28:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:28:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:28:17.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:28:17.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:28:17.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:17.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:28:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:28:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:28:17.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:28:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:28:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:28:17.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:28:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:28:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:17.959 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 303.27097262199999, 2020-11-12T17:28:17.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:28:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:17.961 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:28:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.962 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:17.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:17.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:28:17.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:28:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:28:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:28:17.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:28:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:28:17.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:28:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:28:17.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:28:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:28:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:28:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:28:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:17.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:28:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:28:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:28:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:28:17.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:28:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:28:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:28:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:28:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:28:17.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:28:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.974 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:28:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 303.26508029899998, 2020-11-12T17:28:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:28:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:17.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:17.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:28:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:28:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:28:17.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:28:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:28:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:28:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:28:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:28:17.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:28:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:28:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:28:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:28:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:28:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:28:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:28:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:17.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:28:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 273.13909003100002, 2020-11-12T17:28:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:28:17.985 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:28:17.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:17.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:17.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:28:17.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:28:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:28:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:28:17.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:28:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:28:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:28:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:28:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:17.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:28:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:28:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:28:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:28:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:28:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:28:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:17.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:28:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:28:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:28:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:28:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:28:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:28:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:17.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:28:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:28:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:28:17.997 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 273.13178631199997, 2020-11-12T17:28:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:28:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:17.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:28:17.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:28:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:28:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:28:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:28:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:28:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:28:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:28:18.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:28:18.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:28:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:28:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:28:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:28:18.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:28:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:28:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.004 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:28:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 272.75820781900001, 2020-11-12T17:28:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:28:18.005 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.006 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:18.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:18.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:18.006 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:28:18.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:28:18.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:28:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:28:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:28:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:28:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:28:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:28:18.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:28:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:28:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:28:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:28:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:28:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:18.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:28:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:28:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:28:18.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:28:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:28:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:28:18.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:28:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:28:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:28:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:28:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:28:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 272.74665469899998, 2020-11-12T17:28:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:28:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.017 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:28:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:28:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:28:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:28:18.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:28:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:28:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:28:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:28:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:28:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:28:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:28:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:28:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:28:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:28:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.024 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:28:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 267.673534518, 2020-11-12T17:28:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:28:18.025 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:28:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.026 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:28:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:28:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:28:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:28:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:28:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:28:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:28:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:28:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:28:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:28:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:28:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:28:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:28:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:28:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:28:18.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:28:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:28:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:18.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:28:18.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:28:18.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:28:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:28:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:28:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:28:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.037 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:28:18.037 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:18.037 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 160.962710125, 2020-11-12T17:28:18.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:28:18.037 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.037 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:28:18.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:28:18.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:28:18.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:28:18.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:28:18.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:28:18.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:28:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:28:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:28:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:28:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:28:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:28:18.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:28:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:28:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:28:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:28:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.046 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:28:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 155.6337676, 2020-11-12T17:28:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:28:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:18.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:28:18.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:28:18.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:28:18.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:28:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:28:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:28:18.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:28:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:28:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:28:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:28:18.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:28:18.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:28:18.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:28:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:28:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:28:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:28:18.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:28:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:28:18.059 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 141.03925974200001, 2020-11-12T17:28:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:28:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:28:18.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:28:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:28:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:28:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:28:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:28:18.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:28:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:28:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:28:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:28:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:28:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:28:18.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:28:18.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:28:18.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:28:18.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:28:18.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:28:18.067 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.068 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.068 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.068 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:28:18.069 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:18.069 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 136.83718461399999, 2020-11-12T17:28:18.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:28:18.069 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.069 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:28:18.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:28:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:28:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:28:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:28:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:28:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:28:18.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:28:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:28:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:28:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:28:18.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:28:18.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:28:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:28:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:28:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:28:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.089 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:28:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 124.79514221300001, 2020-11-12T17:28:18.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:28:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:18.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:18.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:28:18.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:28:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:28:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:28:18.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:28:18.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:28:18.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:28:18.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:28:18.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:28:18.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:28:18.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:28:18.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:28:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:28:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:28:18.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:28:18.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:28:18.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:28:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:28:18.100 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 80.713341327999998, 2020-11-12T17:28:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:28:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:18.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:28:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:28:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:28:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:28:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:28:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:28:18.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:28:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:28:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:28:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:28:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:28:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:28:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:28:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:28:18.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:28:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:28:18.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:25824 5.9 5:939cc28b:::benchmark_data_smithi036_24110_object3227:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:28:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.207187435999998, 2020-11-12T17:28:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998, 2020-11-12T17:28:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25824 2020-11-12T17:28:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:28:18.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466401+0000", 2020-11-12T17:28:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3675000000000001e-05 2020-11-12T17:28:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466485+0000", 2020-11-12T17:28:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0393e-05 2020-11-12T17:28:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466495+0000", 2020-11-12T17:28:18.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1100000000000002e-06 2020-11-12T17:28:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466500+0000", 2020-11-12T17:28:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034414860000000001 2020-11-12T17:28:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.469942+0000", 2020-11-12T17:28:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8772999999999999e-05 2020-11-12T17:28:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470021+0000", 2020-11-12T17:28:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015431599999999999 2020-11-12T17:28:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:18.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470175+0000", 2020-11-12T17:28:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001516643 2020-11-12T17:28:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.471692+0000", 2020-11-12T17:28:18.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36737703500000002 2020-11-12T17:28:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839069+0000", 2020-11-12T17:28:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2213000000000006e-05 2020-11-12T17:28:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839161+0000", 2020-11-12T17:28:18.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8376999999999999e-05 2020-11-12T17:28:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839239+0000", 2020-11-12T17:28:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998 2020-11-12T17:28:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.121 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:28:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.454271349999999, 2020-11-12T17:28:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:28:18.122 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:28:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.123 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:28:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:28:18.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:28:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:28:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:28:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:28:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:28:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:28:18.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:28:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:28:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:28:18.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:28:18.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:28:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:28:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:28:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:28:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:28:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:28:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:28:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:28:18.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:28:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.134 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:28:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.444446849000002, 2020-11-12T17:28:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:28:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:18.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:28:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:28:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:28:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:28:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:28:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:28:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:28:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:28:18.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:28:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:28:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:28:18.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:28:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:28:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:28:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.142 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:28:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 18.099191016999999, 2020-11-12T17:28:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:28:18.143 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:28:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:28:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:28:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:28:18.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:28:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:28:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:28:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:28:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:28:18.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:28:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:28:18.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:28:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:28:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:28:18.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:28:18.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:28:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:28:18.152 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.777514104000002, 2020-11-12T17:28:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:28:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:28:18.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:28:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:28:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:28:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:28:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:28:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:28:18.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:28:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:28:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:28:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:28:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:28:18.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:28:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:28:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:28:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:28:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:28:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:28:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.6959922379999997, 2020-11-12T17:28:18.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:28:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:18.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:28:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:28:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:18.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:28:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:28:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:28:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:28:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:28:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:28:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:28:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:28:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:18.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:28:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:28:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:28:18.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:28:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:28:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:28:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.169 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:18.170 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:18.170 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:18.171 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:18.170+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:18.172 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:28:18.273 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:18.268+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:18.609 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:18.442+0000 7f928515c700 -1 osd.7 182 handle_osd_map injecting map crc failure 2020-11-12T17:28:18.609 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:18.609 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:18.609 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:28:18.610 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:18.610 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:28:18.611 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:18.476+0000 7f4de5aec700 -1 osd.1 182 handle_osd_map injecting map crc failure 2020-11-12T17:28:18.611 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:28:18.612 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:18.606+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:18.712 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:18.704+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:18.950 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:28:18.951 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:28:18.952 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:18.952 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:28:18.957 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:18.946+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:19.052 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:19.050+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:19.182 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:28:19.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:28:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:28:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79413 4.6 4:67cb455f:::benchmark_data_smithi036_18856_object3024:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:28:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:28:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.347939493, 2020-11-12T17:28:19.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27681071899999998, 2020-11-12T17:28:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79413 2020-11-12T17:28:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.184 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:28:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784250+0000", 2020-11-12T17:28:19.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:19.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784228+0000", 2020-11-12T17:28:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3021e-05 2020-11-12T17:28:19.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784271+0000", 2020-11-12T17:28:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8409999999999995e-06 2020-11-12T17:28:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784280+0000", 2020-11-12T17:28:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6380000000000003e-06 2020-11-12T17:28:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784285+0000", 2020-11-12T17:28:19.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027973920000000001 2020-11-12T17:28:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787083+0000", 2020-11-12T17:28:19.203 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7495000000000001e-05 2020-11-12T17:28:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:28:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787180+0000", 2020-11-12T17:28:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.12926628300000001 2020-11-12T17:28:19.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.916446+0000", 2020-11-12T17:28:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00093402899999999996 2020-11-12T17:28:19.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:28:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.917380+0000", 2020-11-12T17:28:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020407538999999999 2020-11-12T17:28:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.206 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.207 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.937788+0000", 2020-11-12T17:28:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000401386 2020-11-12T17:28:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:28:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.938189+0000", 2020-11-12T17:28:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.097742617000000004 2020-11-12T17:28:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.214 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.035932+0000", 2020-11-12T17:28:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00070456200000000005 2020-11-12T17:28:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.036636+0000", 2020-11-12T17:28:19.215 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001004916 2020-11-12T17:28:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.037641+0000", 2020-11-12T17:28:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.012882807 2020-11-12T17:28:19.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.222 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.050524+0000", 2020-11-12T17:28:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0084925529999999999 2020-11-12T17:28:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.223 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.059017+0000", 2020-11-12T17:28:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041484399999999999 2020-11-12T17:28:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.224 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.059432+0000", 2020-11-12T17:28:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0016295210000000001 2020-11-12T17:28:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061061+0000", 2020-11-12T17:28:19.225 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27681071899999998 2020-11-12T17:28:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.226 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79414 4.6 4:60cd86ce:::benchmark_data_smithi036_18856_object3025:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:28:19.229 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:28:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.347863029, 2020-11-12T17:28:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998, 2020-11-12T17:28:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.230 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79414 2020-11-12T17:28:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.231 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:28:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.232 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:28:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:28:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784303+0000", 2020-11-12T17:28:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4221999999999997e-05 2020-11-12T17:28:19.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784358+0000", 2020-11-12T17:28:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8389999999999996e-06 2020-11-12T17:28:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784366+0000", 2020-11-12T17:28:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2040000000000002e-06 2020-11-12T17:28:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.235 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784370+0000", 2020-11-12T17:28:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029216049999999999 2020-11-12T17:28:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787291+0000", 2020-11-12T17:28:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3842e-05 2020-11-12T17:28:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:28:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787385+0000", 2020-11-12T17:28:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15210379399999999 2020-11-12T17:28:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.939489+0000", 2020-11-12T17:28:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00095422699999999998 2020-11-12T17:28:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:28:19.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940443+0000", 2020-11-12T17:28:19.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092951600000000002 2020-11-12T17:28:19.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.247 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.247 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.949738+0000", 2020-11-12T17:28:19.247 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00060685800000000005 2020-11-12T17:28:19.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:28:19.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.950345+0000", 2020-11-12T17:28:19.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093005117999999998 2020-11-12T17:28:19.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.043350+0000", 2020-11-12T17:28:19.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001029147 2020-11-12T17:28:19.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.044379+0000", 2020-11-12T17:28:19.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001543397 2020-11-12T17:28:19.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:19.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045923+0000", 2020-11-12T17:28:19.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015442345999999999 2020-11-12T17:28:19.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061365+0000", 2020-11-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0095990889999999999 2020-11-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.070964+0000", 2020-11-12T17:28:19.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000446744 2020-11-12T17:28:19.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.071411+0000", 2020-11-12T17:28:19.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001655534 2020-11-12T17:28:19.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.254 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.254 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.073066+0000", 2020-11-12T17:28:19.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998 2020-11-12T17:28:19.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.255 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.255 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.255 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79425 4.6 4:6231d6c2:::benchmark_data_smithi036_18856_object3036:head [delete] snapc 0=[] ondisk+write+known_if_redirected e118)", 2020-11-12T17:28:19.255 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:28:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.347789533, 2020-11-12T17:28:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002, 2020-11-12T17:28:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.256 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79425 2020-11-12T17:28:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:28:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:28:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:28:19.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784379+0000", 2020-11-12T17:28:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6152000000000001e-05 2020-11-12T17:28:19.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784426+0000", 2020-11-12T17:28:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6860000000000003e-06 2020-11-12T17:28:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784431+0000", 2020-11-12T17:28:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6460000000000002e-06 2020-11-12T17:28:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.262 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784434+0000", 2020-11-12T17:28:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030643549999999999 2020-11-12T17:28:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.263 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787498+0000", 2020-11-12T17:28:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100717 2020-11-12T17:28:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:28:19.264 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787599+0000", 2020-11-12T17:28:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15298814699999999 2020-11-12T17:28:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940587+0000", 2020-11-12T17:28:19.265 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00097205100000000003 2020-11-12T17:28:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:28:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.941559+0000", 2020-11-12T17:28:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.019466477999999999 2020-11-12T17:28:19.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961026+0000", 2020-11-12T17:28:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058434100000000005 2020-11-12T17:28:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.267 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:28:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961610+0000", 2020-11-12T17:28:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13222599700000001 2020-11-12T17:28:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.268 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.093836+0000", 2020-11-12T17:28:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089939299999999996 2020-11-12T17:28:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.269 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.094735+0000", 2020-11-12T17:28:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001382973 2020-11-12T17:28:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.096118+0000", 2020-11-12T17:28:19.270 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046953350000000001 2020-11-12T17:28:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100814+0000", 2020-11-12T17:28:19.271 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9295000000000006e-05 2020-11-12T17:28:19.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.272 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.272 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100893+0000", 2020-11-12T17:28:19.272 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00035136400000000001 2020-11-12T17:28:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.101244+0000", 2020-11-12T17:28:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015508290000000001 2020-11-12T17:28:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.102795+0000", 2020-11-12T17:28:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002 2020-11-12T17:28:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.274 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79491 4.4 4:2feb571e:::benchmark_data_smithi036_18856_object3102:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:28:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:28:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.273777607, 2020-11-12T17:28:19.275 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458, 2020-11-12T17:28:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79491 2020-11-12T17:28:19.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:28:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.278 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.278 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:28:19.278 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:19.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.279 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.279 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858382+0000", 2020-11-12T17:28:19.279 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8493999999999998e-05 2020-11-12T17:28:19.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.280 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.280 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858450+0000", 2020-11-12T17:28:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858460+0000", 2020-11-12T17:28:19.281 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5260000000000004e-06 2020-11-12T17:28:19.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.282 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.282 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858465+0000", 2020-11-12T17:28:19.282 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002042622 2020-11-12T17:28:19.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.283 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.283 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860507+0000", 2020-11-12T17:28:19.283 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5987000000000003e-05 2020-11-12T17:28:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:28:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860583+0000", 2020-11-12T17:28:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.264296631 2020-11-12T17:28:19.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.285 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.285 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.124880+0000", 2020-11-12T17:28:19.285 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00260079 2020-11-12T17:28:19.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.286 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:28:19.286 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.127481+0000", 2020-11-12T17:28:19.286 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015473191000000001 2020-11-12T17:28:19.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.287 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.142954+0000", 2020-11-12T17:28:19.287 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068121100000000003 2020-11-12T17:28:19.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.287 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.288 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.143635+0000", 2020-11-12T17:28:19.288 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014373840000000001 2020-11-12T17:28:19.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.289 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:19.289 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.145073+0000", 2020-11-12T17:28:19.289 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020755122000000001 2020-11-12T17:28:19.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.290 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:19.290 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.165828+0000", 2020-11-12T17:28:19.290 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047732520000000004 2020-11-12T17:28:19.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.291 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.291 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.170601+0000", 2020-11-12T17:28:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00046765100000000003 2020-11-12T17:28:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.171069+0000", 2020-11-12T17:28:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018080010000000001 2020-11-12T17:28:19.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.172877+0000", 2020-11-12T17:28:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458 2020-11-12T17:28:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.293 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.294 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:14736 5.0 e137/135 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head v 137'896, mlcod=137'891)", 2020-11-12T17:28:19.294 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:28:19.294 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 77.071975037000001, 2020-11-12T17:28:19.294 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999, 2020-11-12T17:28:19.295 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.295 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.295 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.295 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.295 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:28:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.296 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.297 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:28:19.297 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:19.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.298 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.298 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060202+0000", 2020-11-12T17:28:19.298 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8984000000000003e-05 2020-11-12T17:28:19.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060261+0000", 2020-11-12T17:28:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56005787699999998 2020-11-12T17:28:19.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620318+0000", 2020-11-12T17:28:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8369999999999999e-06 2020-11-12T17:28:19.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620325+0000", 2020-11-12T17:28:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012664800000000001 2020-11-12T17:28:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620452+0000", 2020-11-12T17:28:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3432e-05 2020-11-12T17:28:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620495+0000", 2020-11-12T17:28:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002919905 2020-11-12T17:28:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623415+0000", 2020-11-12T17:28:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9338999999999995e-05 2020-11-12T17:28:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623485+0000", 2020-11-12T17:28:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999 2020-11-12T17:28:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.305 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26040 5.0 e144/135 5:0f4f1556:::benchmark_data_smithi036_24110_object3254:head v 144'1616, mlcod=144'1611)", 2020-11-12T17:28:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:28:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.456500101000003, 2020-11-12T17:28:19.306 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999, 2020-11-12T17:28:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.307 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:28:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:28:19.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:28:19.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675665+0000", 2020-11-12T17:28:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5723000000000006e-05 2020-11-12T17:28:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675751+0000", 2020-11-12T17:28:19.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28004843800000001 2020-11-12T17:28:19.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955800+0000", 2020-11-12T17:28:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4329999999999997e-06 2020-11-12T17:28:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955804+0000", 2020-11-12T17:28:19.312 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8045000000000003e-05 2020-11-12T17:28:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955872+0000", 2020-11-12T17:28:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9106999999999997e-05 2020-11-12T17:28:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955911+0000", 2020-11-12T17:28:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001589479 2020-11-12T17:28:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957501+0000", 2020-11-12T17:28:19.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7602999999999998e-05 2020-11-12T17:28:19.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957548+0000", 2020-11-12T17:28:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999 2020-11-12T17:28:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.316 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.317 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26152 5.7 e144/135 5:e84d984e:::benchmark_data_smithi036_24110_object3268:head v 144'1448, mlcod=144'1443)", 2020-11-12T17:28:19.317 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:28:19.317 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 65.341894757999995, 2020-11-12T17:28:19.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003, 2020-11-12T17:28:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:28:19.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:28:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:28:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790267+0000", 2020-11-12T17:28:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010217000000000001 2020-11-12T17:28:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790369+0000", 2020-11-12T17:28:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38220455399999997 2020-11-12T17:28:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.322 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172574+0000", 2020-11-12T17:28:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5129999999999998e-06 2020-11-12T17:28:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172578+0000", 2020-11-12T17:28:19.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8815999999999999e-05 2020-11-12T17:28:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172657+0000", 2020-11-12T17:28:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1084000000000003e-05 2020-11-12T17:28:19.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172688+0000", 2020-11-12T17:28:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013615529999999999 2020-11-12T17:28:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174050+0000", 2020-11-12T17:28:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4009000000000002e-05 2020-11-12T17:28:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.326 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174124+0000", 2020-11-12T17:28:19.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003 2020-11-12T17:28:19.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.327 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35656 5.0 e149/135 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head v 149'2136, mlcod=149'2128)", 2020-11-12T17:28:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:28:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.011139229999998, 2020-11-12T17:28:19.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999, 2020-11-12T17:28:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:28:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:28:19.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:19.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121021+0000", 2020-11-12T17:28:19.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5146e-05 2020-11-12T17:28:19.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121116+0000", 2020-11-12T17:28:19.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35999075400000002 2020-11-12T17:28:19.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481107+0000", 2020-11-12T17:28:19.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4069999999999998e-06 2020-11-12T17:28:19.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481113+0000", 2020-11-12T17:28:19.334 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1341999999999997e-05 2020-11-12T17:28:19.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.335 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.335 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481165+0000", 2020-11-12T17:28:19.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1209999999999999e-05 2020-11-12T17:28:19.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.336 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.336 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481186+0000", 2020-11-12T17:28:19.336 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018927709999999999 2020-11-12T17:28:19.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.337 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483079+0000", 2020-11-12T17:28:19.337 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:28:19.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.337 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.338 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483131+0000", 2020-11-12T17:28:19.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999 2020-11-12T17:28:19.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.338 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.339 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:36416 5.0 e149/135 5:05125f34:::benchmark_data_smithi036_24110_object4551:head v 149'2208, mlcod=149'2200)", 2020-11-12T17:28:19.342 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:28:19.342 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 54.152515223000002, 2020-11-12T17:28:19.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002, 2020-11-12T17:28:19.342 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.343 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.351 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.352 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.352 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:28:19.352 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:28:19.353 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:28:19.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.353 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.353 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979647+0000", 2020-11-12T17:28:19.354 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7427000000000001e-05 2020-11-12T17:28:19.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.367 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.367 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979744+0000", 2020-11-12T17:28:19.367 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35673495900000002 2020-11-12T17:28:19.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.368 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.368 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336479+0000", 2020-11-12T17:28:19.368 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7480000000000001e-06 2020-11-12T17:28:19.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.369 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336484+0000", 2020-11-12T17:28:19.369 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5201000000000003e-05 2020-11-12T17:28:19.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.369 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.370 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336529+0000", 2020-11-12T17:28:19.370 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6535999999999999e-05 2020-11-12T17:28:19.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.371 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.371 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336545+0000", 2020-11-12T17:28:19.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003854597 2020-11-12T17:28:19.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340400+0000", 2020-11-12T17:28:19.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5745000000000001e-05 2020-11-12T17:28:19.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340476+0000", 2020-11-12T17:28:19.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002 2020-11-12T17:28:19.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.380 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.381 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:48936 5.7 e157/135 5:ebe6a5f2:::benchmark_data_smithi036_24110_object6116:head v 157'2960, mlcod=157'2956)", 2020-11-12T17:28:19.381 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:28:19.381 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.177769198999997, 2020-11-12T17:28:19.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003, 2020-11-12T17:28:19.382 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.382 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.382 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:28:19.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:28:19.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:19.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954403+0000", 2020-11-12T17:28:19.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0948e-05 2020-11-12T17:28:19.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954464+0000", 2020-11-12T17:28:19.385 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32108862399999999 2020-11-12T17:28:19.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.385 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.385 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275553+0000", 2020-11-12T17:28:19.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2849999999999997e-06 2020-11-12T17:28:19.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.386 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.386 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275560+0000", 2020-11-12T17:28:19.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8199999999999999e-05 2020-11-12T17:28:19.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275608+0000", 2020-11-12T17:28:19.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6923999999999998e-05 2020-11-12T17:28:19.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275635+0000", 2020-11-12T17:28:19.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036371630000000001 2020-11-12T17:28:19.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279272+0000", 2020-11-12T17:28:19.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0575000000000002e-05 2020-11-12T17:28:19.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279333+0000", 2020-11-12T17:28:19.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003 2020-11-12T17:28:19.391 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.392 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.392 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:52816 5.8 e159/135 5:1b562a6a:::benchmark_data_smithi036_24110_object6601:head v 159'3312, mlcod=159'3307)", 2020-11-12T17:28:19.392 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:28:19.392 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 34.257761944000002, 2020-11-12T17:28:19.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002, 2020-11-12T17:28:19.393 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.393 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.393 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:28:19.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:28:19.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:19.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874411+0000", 2020-11-12T17:28:19.404 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5874000000000001e-05 2020-11-12T17:28:19.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.405 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.405 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874467+0000", 2020-11-12T17:28:19.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.369977422 2020-11-12T17:28:19.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244444+0000", 2020-11-12T17:28:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.797e-06 2020-11-12T17:28:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244449+0000", 2020-11-12T17:28:19.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9617999999999994e-05 2020-11-12T17:28:19.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244549+0000", 2020-11-12T17:28:19.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6636999999999999e-05 2020-11-12T17:28:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244575+0000", 2020-11-12T17:28:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002465971 2020-11-12T17:28:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247041+0000", 2020-11-12T17:28:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1267999999999995e-05 2020-11-12T17:28:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247123+0000", 2020-11-12T17:28:19.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002 2020-11-12T17:28:19.449 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.449 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.449 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.449 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59192 5.0 e168/135 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head v 168'3640, mlcod=168'3635)", 2020-11-12T17:28:19.449 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:28:19.450 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 25.318022851999999, 2020-11-12T17:28:19.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998, 2020-11-12T17:28:19.450 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.451 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.451 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.451 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.451 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:28:19.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:28:19.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:19.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814137+0000", 2020-11-12T17:28:19.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135962 2020-11-12T17:28:19.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814273+0000", 2020-11-12T17:28:19.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46601277200000002 2020-11-12T17:28:19.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280285+0000", 2020-11-12T17:28:19.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0178e-05 2020-11-12T17:28:19.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280295+0000", 2020-11-12T17:28:19.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4779999999999999e-05 2020-11-12T17:28:19.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280370+0000", 2020-11-12T17:28:19.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2793999999999998e-05 2020-11-12T17:28:19.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280403+0000", 2020-11-12T17:28:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002761753 2020-11-12T17:28:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283165+0000", 2020-11-12T17:28:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3588e-05 2020-11-12T17:28:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283248+0000", 2020-11-12T17:28:19.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998 2020-11-12T17:28:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:61880 5.7 e171/135 5:e7903c7f:::benchmark_data_smithi036_24110_object7734:head v 171'3720, mlcod=171'3715)", 2020-11-12T17:28:19.460 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:28:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 20.773610227999999, 2020-11-12T17:28:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002, 2020-11-12T17:28:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:28:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:28:19.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:28:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358563+0000", 2020-11-12T17:28:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8774000000000002e-05 2020-11-12T17:28:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358642+0000", 2020-11-12T17:28:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36108309599999999 2020-11-12T17:28:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719725+0000", 2020-11-12T17:28:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8320000000000002e-06 2020-11-12T17:28:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719731+0000", 2020-11-12T17:28:19.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5495999999999997e-05 2020-11-12T17:28:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719806+0000", 2020-11-12T17:28:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3250999999999997e-05 2020-11-12T17:28:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719840+0000", 2020-11-12T17:28:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030159739999999998 2020-11-12T17:28:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722856+0000", 2020-11-12T17:28:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7215e-05 2020-11-12T17:28:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722913+0000", 2020-11-12T17:28:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002 2020-11-12T17:28:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.470 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e173)", 2020-11-12T17:28:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:28:19.471 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.245143107000001, 2020-11-12T17:28:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003, 2020-11-12T17:28:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.472 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:28:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:28:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:28:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:19.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887020+0000", 2020-11-12T17:28:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1260999999999993e-05 2020-11-12T17:28:19.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887101+0000", 2020-11-12T17:28:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2444e-05 2020-11-12T17:28:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887113+0000", 2020-11-12T17:28:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7610000000000002e-06 2020-11-12T17:28:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887123+0000", 2020-11-12T17:28:19.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096366420000000008 2020-11-12T17:28:19.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896760+0000", 2020-11-12T17:28:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8652000000000005e-05 2020-11-12T17:28:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896838+0000", 2020-11-12T17:28:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108306 2020-11-12T17:28:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896947+0000", 2020-11-12T17:28:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001848639 2020-11-12T17:28:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.898795+0000", 2020-11-12T17:28:19.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50804395899999999 2020-11-12T17:28:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406839+0000", 2020-11-12T17:28:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3349000000000004e-05 2020-11-12T17:28:19.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406923+0000", 2020-11-12T17:28:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7622999999999998e-05 2020-11-12T17:28:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407010+0000", 2020-11-12T17:28:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003 2020-11-12T17:28:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63144 5.c e173/139 ondisk, result = 0)", 2020-11-12T17:28:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:28:19.485 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.231199687, 2020-11-12T17:28:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996, 2020-11-12T17:28:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:19.486 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:28:19.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:28:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:19.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900974+0000", 2020-11-12T17:28:19.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1072999999999998e-05 2020-11-12T17:28:19.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.901015+0000", 2020-11-12T17:28:19.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50574218299999996 2020-11-12T17:28:19.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406758+0000", 2020-11-12T17:28:19.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0649999999999999e-06 2020-11-12T17:28:19.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406766+0000", 2020-11-12T17:28:19.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1774999999999998e-05 2020-11-12T17:28:19.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406817+0000", 2020-11-12T17:28:19.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0681e-05 2020-11-12T17:28:19.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406828+0000", 2020-11-12T17:28:19.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000198078 2020-11-12T17:28:19.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407026+0000", 2020-11-12T17:28:19.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996 2020-11-12T17:28:19.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.526 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.530 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e173)", 2020-11-12T17:28:19.531 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:28:19.531 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.226472202, 2020-11-12T17:28:19.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013, 2020-11-12T17:28:19.532 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:28:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.533 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:28:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.534 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:28:19.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:28:19.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999471 2020-11-12T17:28:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905665+0000", 2020-11-12T17:28:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017430399999999999 2020-11-12T17:28:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905839+0000", 2020-11-12T17:28:19.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0282e-05 2020-11-12T17:28:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905859+0000", 2020-11-12T17:28:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4520000000000003e-06 2020-11-12T17:28:19.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905869+0000", 2020-11-12T17:28:19.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5303999999999999e-05 2020-11-12T17:28:19.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905914+0000", 2020-11-12T17:28:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6926999999999999e-05 2020-11-12T17:28:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905971+0000", 2020-11-12T17:28:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50097548000000003 2020-11-12T17:28:19.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406947+0000", 2020-11-12T17:28:19.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013 2020-11-12T17:28:19.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.552 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63511 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:28:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:28:19.555 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 17.654155951, 2020-11-12T17:28:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997, 2020-11-12T17:28:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.556 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.557 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.558 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.558 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63511 2020-11-12T17:28:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:28:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:28:19.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:19.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.477991+0000", 2020-11-12T17:28:19.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9875000000000003e-05 2020-11-12T17:28:19.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478081+0000", 2020-11-12T17:28:19.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3559999999999993e-06 2020-11-12T17:28:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478089+0000", 2020-11-12T17:28:19.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8300000000000003e-06 2020-11-12T17:28:19.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478094+0000", 2020-11-12T17:28:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055625520000000001 2020-11-12T17:28:19.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483657+0000", 2020-11-12T17:28:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118057 2020-11-12T17:28:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483775+0000", 2020-11-12T17:28:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019058000000000001 2020-11-12T17:28:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483965+0000", 2020-11-12T17:28:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052812179999999999 2020-11-12T17:28:19.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489246+0000", 2020-11-12T17:28:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32502241999999998 2020-11-12T17:28:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814269+0000", 2020-11-12T17:28:19.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1461000000000002e-05 2020-11-12T17:28:19.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814310+0000", 2020-11-12T17:28:19.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8736999999999999e-05 2020-11-12T17:28:19.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814339+0000", 2020-11-12T17:28:19.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997 2020-11-12T17:28:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63512 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:28:19.623 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:28:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 17.654066307000001, 2020-11-12T17:28:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002, 2020-11-12T17:28:19.624 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.625 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:19.625 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63512 2020-11-12T17:28:19.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:28:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:28:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478106+0000", 2020-11-12T17:28:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0413e-05 2020-11-12T17:28:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478156+0000", 2020-11-12T17:28:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9499999999999998e-06 2020-11-12T17:28:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478162+0000", 2020-11-12T17:28:19.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.225e-06 2020-11-12T17:28:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478165+0000", 2020-11-12T17:28:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080122779999999994 2020-11-12T17:28:19.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486178+0000", 2020-11-12T17:28:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001128 2020-11-12T17:28:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486291+0000", 2020-11-12T17:28:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024748499999999998 2020-11-12T17:28:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:19.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486538+0000", 2020-11-12T17:28:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034654350000000002 2020-11-12T17:28:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.490003+0000", 2020-11-12T17:28:19.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35059826799999999 2020-11-12T17:28:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840602+0000", 2020-11-12T17:28:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3192000000000003e-05 2020-11-12T17:28:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840645+0000", 2020-11-12T17:28:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2951999999999999e-05 2020-11-12T17:28:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840678+0000", 2020-11-12T17:28:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002 2020-11-12T17:28:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63511 5.c e174/139 ondisk, result = 0)", 2020-11-12T17:28:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:28:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 17.642532707000001, 2020-11-12T17:28:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002, 2020-11-12T17:28:19.646 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:28:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:28:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99998 2020-11-12T17:28:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489637+0000", 2020-11-12T17:28:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5010999999999999e-05 2020-11-12T17:28:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489692+0000", 2020-11-12T17:28:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32451660599999999 2020-11-12T17:28:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814209+0000", 2020-11-12T17:28:19.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3729999999999993e-06 2020-11-12T17:28:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814217+0000", 2020-11-12T17:28:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9755999999999997e-05 2020-11-12T17:28:19.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814257+0000", 2020-11-12T17:28:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2589999999999997e-06 2020-11-12T17:28:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814263+0000", 2020-11-12T17:28:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0548000000000002e-05 2020-11-12T17:28:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814344+0000", 2020-11-12T17:28:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002 2020-11-12T17:28:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.654 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "replica_scrub(pg: 5.0,from:0'0,to:164'3496,epoch:175/135,start:5:073087b9:::benchmark_data_smithi036_24110_object5847:0,end:5:07fd2517:::benchmark_data_smithi036_24110_object2426:0,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2020-11-12T17:28:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:28:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 12.800516922, 2020-11-12T17:28:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003, 2020-11-12T17:28:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:28:19.655 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:28:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:28:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331660+0000", 2020-11-12T17:28:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6072000000000003e-05 2020-11-12T17:28:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331696+0000", 2020-11-12T17:28:19.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73693106399999997 2020-11-12T17:28:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068627+0000", 2020-11-12T17:28:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6524999999999998e-05 2020-11-12T17:28:19.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068643+0000", 2020-11-12T17:28:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000180683 2020-11-12T17:28:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068824+0000", 2020-11-12T17:28:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101581 2020-11-12T17:28:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:19.661 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068926+0000", 2020-11-12T17:28:19.662 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003 2020-11-12T17:28:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.664 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.665 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.665 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:19.666 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:28:19.666 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:19.178+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:19.670 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:19.677 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:19.668+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:19.775 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:19.768+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:19.827 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:19.828 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:28:19.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.828 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:70441 5.b 5:d6ae103f:::benchmark_data_smithi036_24110_object2551:head [delete] snapc 0=[] ondisk+write+known_if_redirected e183)", 2020-11-12T17:28:19.829 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:19.810204+0000", 2020-11-12T17:28:19.829 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.015910622999999999, 2020-11-12T17:28:19.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015936914999999999, 2020-11-12T17:28:19.830 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.830 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:19.830 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.831 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.831 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.831 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70441 2020-11-12T17:28:19.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.832 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.833 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810204+0000", 2020-11-12T17:28:19.833 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.834 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.834 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810204+0000", 2020-11-12T17:28:19.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:28:19.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810172+0000", 2020-11-12T17:28:19.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0715000000000003e-05 2020-11-12T17:28:19.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810243+0000", 2020-11-12T17:28:19.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1824000000000001e-05 2020-11-12T17:28:19.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810254+0000", 2020-11-12T17:28:19.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5589999999999996e-06 2020-11-12T17:28:19.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810260+0000", 2020-11-12T17:28:19.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5191000000000002e-05 2020-11-12T17:28:19.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810305+0000", 2020-11-12T17:28:19.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000178486 2020-11-12T17:28:19.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810484+0000", 2020-11-12T17:28:19.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162001 2020-11-12T17:28:19.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.845 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:28:19.845 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810646+0000", 2020-11-12T17:28:19.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0040214020000000003 2020-11-12T17:28:19.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.846 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.814667+0000", 2020-11-12T17:28:19.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044631990000000002 2020-11-12T17:28:19.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.847 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.848 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:70443 5.a 5:5c3dcf50:::benchmark_data_smithi036_24110_object2553:head [delete] snapc 0=[] ondisk+write+known_if_redirected e183)", 2020-11-12T17:28:19.850 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:19.810442+0000", 2020-11-12T17:28:19.850 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.015672383000000002, 2020-11-12T17:28:19.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015794084999999999, 2020-11-12T17:28:19.850 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.851 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:19.851 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.851 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.851 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.852 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70443 2020-11-12T17:28:19.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.852 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810442+0000", 2020-11-12T17:28:19.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.856 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810442+0000", 2020-11-12T17:28:19.856 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:28:19.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.857 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.857 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810411+0000", 2020-11-12T17:28:19.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2482000000000002e-05 2020-11-12T17:28:19.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.858 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.858 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810483+0000", 2020-11-12T17:28:19.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1799e-05 2020-11-12T17:28:19.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810495+0000", 2020-11-12T17:28:19.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5650000000000001e-06 2020-11-12T17:28:19.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810500+0000", 2020-11-12T17:28:19.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7917000000000002e-05 2020-11-12T17:28:19.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810548+0000", 2020-11-12T17:28:19.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015343900000000001 2020-11-12T17:28:19.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810702+0000", 2020-11-12T17:28:19.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000133552 2020-11-12T17:28:19.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:19.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.810835+0000", 2020-11-12T17:28:19.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0038147879999999999 2020-11-12T17:28:19.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.814650+0000", 2020-11-12T17:28:19.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042080700000000004 2020-11-12T17:28:19.865 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.865 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.866 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.866 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:70445 5.b 5:d41237a5:::benchmark_data_smithi036_24110_object2555:head [delete] snapc 0=[] ondisk+write+known_if_redirected e183)", 2020-11-12T17:28:19.867 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:19.815194+0000", 2020-11-12T17:28:19.867 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.010920739, 2020-11-12T17:28:19.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011149088999999999, 2020-11-12T17:28:19.868 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.868 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:19.868 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.868 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.869 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.869 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70445 2020-11-12T17:28:19.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.869 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.815194+0000", 2020-11-12T17:28:19.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.815194+0000", 2020-11-12T17:28:19.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:28:19.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.815164+0000", 2020-11-12T17:28:19.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7488000000000002e-05 2020-11-12T17:28:19.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.815231+0000", 2020-11-12T17:28:19.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2952000000000001e-05 2020-11-12T17:28:19.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.815244+0000", 2020-11-12T17:28:19.885 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7519999999999999e-06 2020-11-12T17:28:19.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.885 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.815251+0000", 2020-11-12T17:28:19.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0077999999999997e-05 2020-11-12T17:28:19.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.815301+0000", 2020-11-12T17:28:19.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012912700000000001 2020-11-12T17:28:19.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.815430+0000", 2020-11-12T17:28:19.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000146389 2020-11-12T17:28:19.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:28:19.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.815576+0000", 2020-11-12T17:28:19.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0066384269999999997 2020-11-12T17:28:19.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822215+0000", 2020-11-12T17:28:19.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070211680000000004 2020-11-12T17:28:19.898 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.898 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:70446 5.b 5:d751d3b7:::benchmark_data_smithi036_24110_object2556:head [delete] snapc 0=[] ondisk+write+known_if_redirected e183)", 2020-11-12T17:28:19.899 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:19.816470+0000", 2020-11-12T17:28:19.900 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0096446180000000006, 2020-11-12T17:28:19.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0099913399999999996, 2020-11-12T17:28:19.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.901 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:19.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.902 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70446 2020-11-12T17:28:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.816470+0000", 2020-11-12T17:28:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.816470+0000", 2020-11-12T17:28:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:28:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.816440+0000", 2020-11-12T17:28:19.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6618000000000005e-05 2020-11-12T17:28:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.816506+0000", 2020-11-12T17:28:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1086e-05 2020-11-12T17:28:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.816517+0000", 2020-11-12T17:28:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4960000000000004e-06 2020-11-12T17:28:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.816523+0000", 2020-11-12T17:28:19.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024889759999999999 2020-11-12T17:28:19.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.819012+0000", 2020-11-12T17:28:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016511999999999999 2020-11-12T17:28:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.819177+0000", 2020-11-12T17:28:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013561500000000001 2020-11-12T17:28:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:28:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.819313+0000", 2020-11-12T17:28:19.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.006827306 2020-11-12T17:28:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.826140+0000", 2020-11-12T17:28:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096701579999999999 2020-11-12T17:28:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.926 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:70450 5.b 5:d421c01d:::benchmark_data_smithi036_24110_object2560:head [delete] snapc 0=[] ondisk+write+known_if_redirected e183)", 2020-11-12T17:28:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:19.822285+0000", 2020-11-12T17:28:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0038289460000000002, 2020-11-12T17:28:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0042745029999999998, 2020-11-12T17:28:19.927 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70450 2020-11-12T17:28:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.928 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.929 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822285+0000", 2020-11-12T17:28:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822285+0000", 2020-11-12T17:28:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:28:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822255+0000", 2020-11-12T17:28:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9498000000000004e-05 2020-11-12T17:28:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822324+0000", 2020-11-12T17:28:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2267e-05 2020-11-12T17:28:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822336+0000", 2020-11-12T17:28:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.998e-06 2020-11-12T17:28:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822342+0000", 2020-11-12T17:28:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0642000000000001e-05 2020-11-12T17:28:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822393+0000", 2020-11-12T17:28:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8943000000000005e-05 2020-11-12T17:28:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822492+0000", 2020-11-12T17:28:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000326454 2020-11-12T17:28:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:28:19.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822818+0000", 2020-11-12T17:28:19.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00053283699999999998 2020-11-12T17:28:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:70454 5.4 5:2142f556:::benchmark_data_smithi036_24110_object2564:head [delete] snapc 0=[] ondisk+write+known_if_redirected e183)", 2020-11-12T17:28:19.972 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:19.822802+0000", 2020-11-12T17:28:19.972 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.0033120770000000001, 2020-11-12T17:28:19.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003837081, 2020-11-12T17:28:19.972 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.972 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70454 2020-11-12T17:28:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822802+0000", 2020-11-12T17:28:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822802+0000", 2020-11-12T17:28:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:28:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822771+0000", 2020-11-12T17:28:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1019000000000006e-05 2020-11-12T17:28:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822842+0000", 2020-11-12T17:28:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3108999999999999e-05 2020-11-12T17:28:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822855+0000", 2020-11-12T17:28:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0670000000000003e-06 2020-11-12T17:28:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822862+0000", 2020-11-12T17:28:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011583599999999999 2020-11-12T17:28:19.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:19.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.822978+0000", 2020-11-12T17:28:19.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015079700000000001 2020-11-12T17:28:19.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823129+0000", 2020-11-12T17:28:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015026500000000001 2020-11-12T17:28:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823279+0000", 2020-11-12T17:28:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000476832 2020-11-12T17:28:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:70455 5.a 5:509ac48b:::benchmark_data_smithi036_24110_object2565:head [delete] snapc 0=[] ondisk+write+known_if_redirected e183)", 2020-11-12T17:28:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:19.823490+0000", 2020-11-12T17:28:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 0.002624875, 2020-11-12T17:28:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003242516, 2020-11-12T17:28:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 70455 2020-11-12T17:28:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823490+0000", 2020-11-12T17:28:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823490+0000", 2020-11-12T17:28:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823461+0000", 2020-11-12T17:28:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2855999999999996e-05 2020-11-12T17:28:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823524+0000", 2020-11-12T17:28:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0231999999999999e-05 2020-11-12T17:28:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:20.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823544+0000", 2020-11-12T17:28:20.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0650000000000004e-06 2020-11-12T17:28:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823550+0000", 2020-11-12T17:28:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9746000000000001e-05 2020-11-12T17:28:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823600+0000", 2020-11-12T17:28:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016191400000000001 2020-11-12T17:28:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823762+0000", 2020-11-12T17:28:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000189085 2020-11-12T17:28:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:19.823951+0000", 2020-11-12T17:28:20.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00046116899999999999 2020-11-12T17:28:20.018 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:20.019 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:20.019 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:20.019 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:20.020 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:20.020 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 7 2020-11-12T17:28:20.020 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:20.037 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:28:20.038 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:20.039 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:20.039 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:20.039 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:20.040 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:20.040 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:20.020+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:20.070 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:20.106 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:20.132 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:20.126+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:20.145 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:20.150 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:20.151 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:20.151 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:20.151 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:20.151 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:20.151 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:20.151 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:20.152 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:20.238 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:20.226+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:20.240 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:20.240 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:20.255 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:28:20.331 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:20.330+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:20.402 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:20.402 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:20.417 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:28:20.468 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:20.464+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:20.533 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:20.528+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:20.563 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:20.564 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:20.577 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:28:20.612 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:28:20.675 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:20.672+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:20.735 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:20.732+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:20.806 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:20.806 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:20.817 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:28:20.870 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:20.860+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:20.947 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:20.942+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:21.038 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:21.039 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:21.054 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:21.040+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:21.055 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:28:21.079 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 0] out_osds: [1] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:21.079 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:21.079 INFO:tasks.thrashosds.thrasher:Shrinking pool device_health_metrics 2020-11-12T17:28:21.080 INFO:tasks.ceph.ceph_manager.ceph:contract_pool device_health_metrics by 10 min 8 2020-11-12T17:28:21.080 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-11-12T17:28:21.139 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:21.134+0000 7f7b4fea9700 -1 osd.4 183 handle_osd_map injecting map crc failure 2020-11-12T17:28:21.147 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:21.142+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:21.166 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:28:21.248 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:21.246+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:21.291 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:21.291 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:21.307 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:28:21.354 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:21.352+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:21.449 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:21.446+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:21.481 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:21.481 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:21.495 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:28:21.550 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:21.546+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:21.598 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:28:21.610 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2020-11-12T17:28:21.626 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2020-11-12T17:28:21.135303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":408911896,"num_objects":6243,"num_object_clones":0,"num_object_copies":12486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":276,"num_objects_unfound":0,"num_objects_dirty":6243,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":70124,"num_write_kb":543011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3123,"num_bytes_recovered":204496896,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70124,"ondisk_log_size":70124,"up":70,"acting":70,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":7684556,"kb_used_data":344468,"kb_used_omap":4,"kb_used_meta":7340027,"kb_avail":652918324,"statfs":{"total":676457349120,"available":668588363776,"internally_reserved":7516192768,"allocated":352735232,"data_stored":830980493,"data_compressed":4690718,"data_compressed_allocated":343314432,"data_compressed_original":827203584,"omap_allocated":4385,"internal_metadata":7516188383},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,4,2,3,2,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-134897640,"num_objects":-2057,"num_object_clones":0,"num_object_copies":-4114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":276,"num_objects_unfound":0,"num_objects_dirty":-2057,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3739,"num_write_kb":11945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":16515072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.085633"},"pg_stats":[{"pgid":"2.11","version":"0'0","reported_seq":"29","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.581560+0000","last_change":"2020-11-12T17:28:16.464567+0000","last_active":"2020-11-12T17:28:17.581560+0000","last_peered":"2020-11-12T17:28:17.581560+0000","last_clean":"2020-11-12T17:28:17.581560+0000","last_became_active":"2020-11-12T17:27:51.467388+0000","last_became_peered":"2020-11-12T17:27:51.467388+0000","last_unstale":"2020-11-12T17:28:17.581560+0000","last_undegraded":"2020-11-12T17:28:17.581560+0000","last_fullsized":"2020-11-12T17:28:17.581560+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:16.464425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:28:16.464425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"34","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.427101+0000","last_change":"2020-11-12T17:28:17.069657+0000","last_active":"2020-11-12T17:28:17.427101+0000","last_peered":"2020-11-12T17:28:17.427101+0000","last_clean":"2020-11-12T17:28:17.427101+0000","last_became_active":"2020-11-12T17:28:17.069158+0000","last_became_peered":"2020-11-12T17:28:17.069158+0000","last_unstale":"2020-11-12T17:28:17.427101+0000","last_undegraded":"2020-11-12T17:28:17.427101+0000","last_fullsized":"2020-11-12T17:28:17.427101+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:51.816592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:51.816592+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"24","reported_epoch":"179","state":"active+clean","last_fresh":"2020-11-12T17:28:15.051994+0000","last_change":"2020-11-12T17:28:02.192815+0000","last_active":"2020-11-12T17:28:15.051994+0000","last_peered":"2020-11-12T17:28:15.051994+0000","last_clean":"2020-11-12T17:28:15.051994+0000","last_became_active":"2020-11-12T17:27:53.469606+0000","last_became_peered":"2020-11-12T17:27:53.469606+0000","last_unstale":"2020-11-12T17:28:15.051994+0000","last_undegraded":"2020-11-12T17:28:15.051994+0000","last_fullsized":"2020-11-12T17:28:15.051994+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:02.192623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:28:02.192623+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"179'4312","reported_seq":"4372","reported_epoch":"179","state":"active+clean","last_fresh":"2020-11-12T17:28:15.212608+0000","last_change":"2020-11-12T17:26:45.503348+0000","last_active":"2020-11-12T17:28:15.212608+0000","last_peered":"2020-11-12T17:28:15.212608+0000","last_clean":"2020-11-12T17:28:15.212608+0000","last_became_active":"2020-11-12T17:26:45.502940+0000","last_became_peered":"2020-11-12T17:26:45.502940+0000","last_unstale":"2020-11-12T17:28:15.212608+0000","last_undegraded":"2020-11-12T17:28:15.212608+0000","last_fullsized":"2020-11-12T17:28:15.212608+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4312,"ondisk_log_size":4312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35323904,"num_objects":539,"num_object_clones":0,"num_object_copies":1078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":539,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4312,"num_write_kb":34496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"1","reported_epoch":"180","state":"peering","last_fresh":"2020-11-12T17:28:16.054491+0000","last_change":"2020-11-12T17:28:16.054491+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2020-11-12T17:28:16.054491+0000","last_undegraded":"2020-11-12T17:28:16.054491+0000","last_fullsized":"2020-11-12T17:28:16.054491+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:48.417869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:48.417869+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"183'4559","reported_seq":"4625","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.895367+0000","last_change":"2020-11-12T17:28:05.619468+0000","last_active":"2020-11-12T17:28:20.895367+0000","last_peered":"2020-11-12T17:28:20.895367+0000","last_clean":"2020-11-12T17:28:20.895367+0000","last_became_active":"2020-11-12T17:26:45.490308+0000","last_became_peered":"2020-11-12T17:26:45.490308+0000","last_unstale":"2020-11-12T17:28:20.895367+0000","last_undegraded":"2020-11-12T17:28:20.895367+0000","last_fullsized":"2020-11-12T17:28:20.895367+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"173'4064","last_scrub_stamp":"2020-11-12T17:28:05.619301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:28:05.619301+0000","log_size":4559,"ondisk_log_size":4559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19726336,"num_objects":301,"num_object_clones":0,"num_object_copies":602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":301,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4559,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"201","reported_epoch":"180","state":"peering","last_fresh":"2020-11-12T17:28:16.052669+0000","last_change":"2020-11-12T17:28:16.052862+0000","last_active":"2020-11-12T17:27:48.438455+0000","last_peered":"2020-11-12T17:27:47.435400+0000","last_clean":"2020-11-12T17:27:47.435400+0000","last_became_active":"2020-11-12T17:27:00.609586+0000","last_became_peered":"2020-11-12T17:27:00.609586+0000","last_unstale":"2020-11-12T17:28:16.052669+0000","last_undegraded":"2020-11-12T17:28:16.052669+0000","last_fullsized":"2020-11-12T17:28:16.052669+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:05.616420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:05.616420+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"183'4374","reported_seq":"4438","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.081325+0000","last_change":"2020-11-12T17:26:45.490550+0000","last_active":"2020-11-12T17:28:20.081325+0000","last_peered":"2020-11-12T17:28:20.081325+0000","last_clean":"2020-11-12T17:28:20.081325+0000","last_became_active":"2020-11-12T17:26:45.490025+0000","last_became_peered":"2020-11-12T17:26:45.490025+0000","last_unstale":"2020-11-12T17:28:20.081325+0000","last_undegraded":"2020-11-12T17:28:20.081325+0000","last_fullsized":"2020-11-12T17:28:20.081325+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4374,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21299224,"num_objects":326,"num_object_clones":0,"num_object_copies":652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4374,"num_write_kb":33409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"29","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.428524+0000","last_change":"2020-11-12T17:28:01.550722+0000","last_active":"2020-11-12T17:28:17.428524+0000","last_peered":"2020-11-12T17:28:17.428524+0000","last_clean":"2020-11-12T17:28:17.428524+0000","last_became_active":"2020-11-12T17:27:51.458677+0000","last_became_peered":"2020-11-12T17:27:51.458677+0000","last_unstale":"2020-11-12T17:28:17.428524+0000","last_undegraded":"2020-11-12T17:28:17.428524+0000","last_fullsized":"2020-11-12T17:28:17.428524+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:01.550624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:28:01.550624+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"183'4462","reported_seq":"5271","reported_epoch":"183","state":"active+recovering","last_fresh":"2020-11-12T17:28:20.915181+0000","last_change":"2020-11-12T17:28:17.224405+0000","last_active":"2020-11-12T17:28:20.915181+0000","last_peered":"2020-11-12T17:28:20.915181+0000","last_clean":"2020-11-12T17:28:15.580098+0000","last_became_active":"2020-11-12T17:28:17.215836+0000","last_became_peered":"2020-11-12T17:28:17.215836+0000","last_unstale":"2020-11-12T17:28:20.915181+0000","last_undegraded":"2020-11-12T17:28:20.915181+0000","last_fullsized":"2020-11-12T17:28:20.915181+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4462,"ondisk_log_size":4462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":276,"num_objects_unfound":0,"num_objects_dirty":290,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4462,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":23986176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","1"],"object_location_counts":[{"shards":"0,4","objects":14},{"shards":"1,4","objects":276}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"26","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.427251+0000","last_change":"2020-11-12T17:27:51.483730+0000","last_active":"2020-11-12T17:28:17.427251+0000","last_peered":"2020-11-12T17:28:17.427251+0000","last_clean":"2020-11-12T17:28:17.427251+0000","last_became_active":"2020-11-12T17:27:51.483394+0000","last_became_peered":"2020-11-12T17:27:51.483394+0000","last_unstale":"2020-11-12T17:28:17.427251+0000","last_undegraded":"2020-11-12T17:28:17.427251+0000","last_fullsized":"2020-11-12T17:28:17.427251+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:27:15.924179+0000","last_clean_scrub_stamp":"2020-11-12T17:27:15.924179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"183'4682","reported_seq":"5707","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.105791+0000","last_change":"2020-11-12T17:27:59.940042+0000","last_active":"2020-11-12T17:28:20.105791+0000","last_peered":"2020-11-12T17:28:20.105791+0000","last_clean":"2020-11-12T17:28:20.105791+0000","last_became_active":"2020-11-12T17:27:53.574726+0000","last_became_peered":"2020-11-12T17:27:53.574726+0000","last_unstale":"2020-11-12T17:28:20.105791+0000","last_undegraded":"2020-11-12T17:28:20.105791+0000","last_fullsized":"2020-11-12T17:28:20.105791+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4682,"ondisk_log_size":4682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4682,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":476,"num_bytes_recovered":31195136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"145","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.428204+0000","last_change":"2020-11-12T17:28:17.074880+0000","last_active":"2020-11-12T17:28:17.428204+0000","last_peered":"2020-11-12T17:28:17.428204+0000","last_clean":"2020-11-12T17:28:17.428204+0000","last_became_active":"2020-11-12T17:28:17.074435+0000","last_became_peered":"2020-11-12T17:28:17.074435+0000","last_unstale":"2020-11-12T17:28:17.428204+0000","last_undegraded":"2020-11-12T17:28:17.428204+0000","last_fullsized":"2020-11-12T17:28:17.428204+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:04.764948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:27:04.764948+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"183'4428","reported_seq":"4489","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.089939+0000","last_change":"2020-11-12T17:26:45.490968+0000","last_active":"2020-11-12T17:28:20.089939+0000","last_peered":"2020-11-12T17:28:20.089939+0000","last_clean":"2020-11-12T17:28:20.089939+0000","last_became_active":"2020-11-12T17:26:45.490602+0000","last_became_peered":"2020-11-12T17:26:45.490602+0000","last_unstale":"2020-11-12T17:28:20.089939+0000","last_undegraded":"2020-11-12T17:28:20.089939+0000","last_fullsized":"2020-11-12T17:28:20.089939+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4428,"ondisk_log_size":4428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4428,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"26","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.427248+0000","last_change":"2020-11-12T17:27:51.534861+0000","last_active":"2020-11-12T17:28:17.427248+0000","last_peered":"2020-11-12T17:28:17.427248+0000","last_clean":"2020-11-12T17:28:17.427248+0000","last_became_active":"2020-11-12T17:27:51.533701+0000","last_became_peered":"2020-11-12T17:27:51.533701+0000","last_unstale":"2020-11-12T17:28:17.427248+0000","last_undegraded":"2020-11-12T17:28:17.427248+0000","last_fullsized":"2020-11-12T17:28:17.427248+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:52.317257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:52.317257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"183'4214","reported_seq":"4279","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.661952+0000","last_change":"2020-11-12T17:27:28.815974+0000","last_active":"2020-11-12T17:28:20.661952+0000","last_peered":"2020-11-12T17:28:20.661952+0000","last_clean":"2020-11-12T17:28:20.661952+0000","last_became_active":"2020-11-12T17:27:28.811530+0000","last_became_peered":"2020-11-12T17:27:28.811530+0000","last_unstale":"2020-11-12T17:28:20.661952+0000","last_undegraded":"2020-11-12T17:28:20.661952+0000","last_fullsized":"2020-11-12T17:28:20.661952+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4214,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18153472,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4214,"num_write_kb":31936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":"37","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.427953+0000","last_change":"2020-11-12T17:28:04.618132+0000","last_active":"2020-11-12T17:28:17.427953+0000","last_peered":"2020-11-12T17:28:17.427953+0000","last_clean":"2020-11-12T17:28:17.427953+0000","last_became_active":"2020-11-12T17:27:53.467149+0000","last_became_peered":"2020-11-12T17:27:53.467149+0000","last_unstale":"2020-11-12T17:28:17.427953+0000","last_undegraded":"2020-11-12T17:28:17.427953+0000","last_fullsized":"2020-11-12T17:28:17.427953+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":4,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:04.618038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:28:04.618038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"183'4388","reported_seq":"5585","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.082070+0000","last_change":"2020-11-12T17:27:59.473272+0000","last_active":"2020-11-12T17:28:20.082070+0000","last_peered":"2020-11-12T17:28:20.082070+0000","last_clean":"2020-11-12T17:28:20.082070+0000","last_became_active":"2020-11-12T17:27:53.599307+0000","last_became_peered":"2020-11-12T17:27:53.599307+0000","last_unstale":"2020-11-12T17:28:20.082070+0000","last_undegraded":"2020-11-12T17:28:20.082070+0000","last_fullsized":"2020-11-12T17:28:20.082070+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"162'3464","last_scrub_stamp":"2020-11-12T17:27:48.555220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:27:48.555220+0000","log_size":4388,"ondisk_log_size":4388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22675456,"num_objects":346,"num_object_clones":0,"num_object_copies":692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4388,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":558,"num_bytes_recovered":36528128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"179'4296","reported_seq":"5312","reported_epoch":"179","state":"active+clean","last_fresh":"2020-11-12T17:28:16.028199+0000","last_change":"2020-11-12T17:28:10.616914+0000","last_active":"2020-11-12T17:28:16.028199+0000","last_peered":"2020-11-12T17:28:16.028199+0000","last_clean":"2020-11-12T17:28:16.028199+0000","last_became_active":"2020-11-12T17:28:02.474029+0000","last_became_peered":"2020-11-12T17:28:02.474029+0000","last_unstale":"2020-11-12T17:28:16.028199+0000","last_undegraded":"2020-11-12T17:28:16.028199+0000","last_fullsized":"2020-11-12T17:28:16.028199+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4296,"ondisk_log_size":4296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35192832,"num_objects":537,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":537,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4296,"num_write_kb":34368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":473,"num_bytes_recovered":30998528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"58","reported_epoch":"180","state":"peering","last_fresh":"2020-11-12T17:28:16.059199+0000","last_change":"2020-11-12T17:28:16.059416+0000","last_active":"2020-11-12T17:27:52.462532+0000","last_peered":"2020-11-12T17:27:51.455611+0000","last_clean":"2020-11-12T17:27:51.455611+0000","last_became_active":"2020-11-12T17:27:49.455858+0000","last_became_peered":"2020-11-12T17:27:49.455858+0000","last_unstale":"2020-11-12T17:28:16.059199+0000","last_undegraded":"2020-11-12T17:28:16.059199+0000","last_fullsized":"2020-11-12T17:28:16.059199+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:50.128859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:27:50.128859+0000","last_clean_scrub_stamp":"2020-11-12T17:27:50.128859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"179'4208","reported_seq":"5435","reported_epoch":"180","state":"peering","last_fresh":"2020-11-12T17:28:16.060397+0000","last_change":"2020-11-12T17:28:16.060815+0000","last_active":"2020-11-12T17:28:16.060397+0000","last_peered":"2020-11-12T17:28:16.016971+0000","last_clean":"2020-11-12T17:28:16.016971+0000","last_became_active":"2020-11-12T17:28:00.456669+0000","last_became_peered":"2020-11-12T17:28:00.456669+0000","last_unstale":"2020-11-12T17:28:16.060397+0000","last_undegraded":"2020-11-12T17:28:16.060397+0000","last_fullsized":"2020-11-12T17:28:16.060397+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'3960","last_scrub_stamp":"2020-11-12T17:28:04.897722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:28:04.897722+0000","log_size":4208,"ondisk_log_size":4208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":526,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4208,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":570,"num_bytes_recovered":37355520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"224","reported_epoch":"180","state":"peering","last_fresh":"2020-11-12T17:28:16.064457+0000","last_change":"2020-11-12T17:28:16.064700+0000","last_active":"2020-11-12T17:28:16.064457+0000","last_peered":"2020-11-12T17:28:15.036181+0000","last_clean":"2020-11-12T17:28:15.036181+0000","last_became_active":"2020-11-12T17:27:49.463678+0000","last_became_peered":"2020-11-12T17:27:49.463678+0000","last_unstale":"2020-11-12T17:28:16.064457+0000","last_undegraded":"2020-11-12T17:28:16.064457+0000","last_fullsized":"2020-11-12T17:28:16.064457+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:52.083239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:27:52.083239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"183'4539","reported_seq":"4605","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.069523+0000","last_change":"2020-11-12T17:27:47.563620+0000","last_active":"2020-11-12T17:28:20.069523+0000","last_peered":"2020-11-12T17:28:20.069523+0000","last_clean":"2020-11-12T17:28:20.069523+0000","last_became_active":"2020-11-12T17:26:45.480445+0000","last_became_peered":"2020-11-12T17:26:45.480445+0000","last_unstale":"2020-11-12T17:28:20.069523+0000","last_undegraded":"2020-11-12T17:28:20.069523+0000","last_fullsized":"2020-11-12T17:28:20.069523+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'3552","last_scrub_stamp":"2020-11-12T17:27:47.563469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:27:47.563469+0000","log_size":4539,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24576000,"num_objects":375,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":375,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4539,"num_write_kb":34944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"88","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.427203+0000","last_change":"2020-11-12T17:28:05.349133+0000","last_active":"2020-11-12T17:28:17.427203+0000","last_peered":"2020-11-12T17:28:17.427203+0000","last_clean":"2020-11-12T17:28:17.427203+0000","last_became_active":"2020-11-12T17:27:49.451258+0000","last_became_peered":"2020-11-12T17:27:49.451258+0000","last_unstale":"2020-11-12T17:28:17.427203+0000","last_undegraded":"2020-11-12T17:28:17.427203+0000","last_fullsized":"2020-11-12T17:28:17.427203+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:05.349023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:28:05.349023+0000","last_clean_scrub_stamp":"2020-11-12T17:28:05.349023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"183'4221","reported_seq":"4285","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.094142+0000","last_change":"2020-11-12T17:27:28.813298+0000","last_active":"2020-11-12T17:28:20.094142+0000","last_peered":"2020-11-12T17:28:20.094142+0000","last_clean":"2020-11-12T17:28:20.094142+0000","last_became_active":"2020-11-12T17:27:28.808532+0000","last_became_peered":"2020-11-12T17:27:28.808532+0000","last_unstale":"2020-11-12T17:28:20.094142+0000","last_undegraded":"2020-11-12T17:28:20.094142+0000","last_fullsized":"2020-11-12T17:28:20.094142+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4221,"ondisk_log_size":4221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4221,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"206","reported_epoch":"179","state":"active+clean","last_fresh":"2020-11-12T17:28:15.036208+0000","last_change":"2020-11-12T17:28:03.942232+0000","last_active":"2020-11-12T17:28:15.036208+0000","last_peered":"2020-11-12T17:28:15.036208+0000","last_clean":"2020-11-12T17:28:15.036208+0000","last_became_active":"2020-11-12T17:27:49.466326+0000","last_became_peered":"2020-11-12T17:27:49.466326+0000","last_unstale":"2020-11-12T17:28:15.036208+0000","last_undegraded":"2020-11-12T17:28:15.036208+0000","last_fullsized":"2020-11-12T17:28:15.036208+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:03.941996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:28:03.941996+0000","last_clean_scrub_stamp":"2020-11-12T17:28:03.941996+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"27","reported_epoch":"179","state":"active+clean","last_fresh":"2020-11-12T17:28:15.052176+0000","last_change":"2020-11-12T17:27:53.578136+0000","last_active":"2020-11-12T17:28:15.052176+0000","last_peered":"2020-11-12T17:28:15.052176+0000","last_clean":"2020-11-12T17:28:15.052176+0000","last_became_active":"2020-11-12T17:27:53.469341+0000","last_became_peered":"2020-11-12T17:27:53.469341+0000","last_unstale":"2020-11-12T17:28:15.052176+0000","last_undegraded":"2020-11-12T17:28:15.052176+0000","last_fullsized":"2020-11-12T17:28:15.052176+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2020-11-12T17:27:47.164517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:42.530591+0000","last_clean_scrub_stamp":"2020-11-12T17:27:47.164517+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"179'4112","reported_seq":"4373","reported_epoch":"180","state":"peering","last_fresh":"2020-11-12T17:28:16.065456+0000","last_change":"2020-11-12T17:28:16.066424+0000","last_active":"2020-11-12T17:28:16.065456+0000","last_peered":"2020-11-12T17:28:15.950538+0000","last_clean":"2020-11-12T17:28:15.950538+0000","last_became_active":"2020-11-12T17:27:00.629289+0000","last_became_peered":"2020-11-12T17:27:00.629289+0000","last_unstale":"2020-11-12T17:28:16.065456+0000","last_undegraded":"2020-11-12T17:28:16.065456+0000","last_fullsized":"2020-11-12T17:28:16.065456+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'4112","last_scrub_stamp":"2020-11-12T17:28:15.311462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:28:15.311462+0000","log_size":4112,"ondisk_log_size":4112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":514,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4112,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":6160384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"1","reported_epoch":"180","state":"peering","last_fresh":"2020-11-12T17:28:16.058195+0000","last_change":"2020-11-12T17:28:16.058195+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2020-11-12T17:28:16.058195+0000","last_undegraded":"2020-11-12T17:28:16.058195+0000","last_fullsized":"2020-11-12T17:28:16.058195+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:28:01.007379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:28:01.007379+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"183'4571","reported_seq":"5596","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.646316+0000","last_change":"2020-11-12T17:27:59.912080+0000","last_active":"2020-11-12T17:28:20.646316+0000","last_peered":"2020-11-12T17:28:20.646316+0000","last_clean":"2020-11-12T17:28:20.646316+0000","last_became_active":"2020-11-12T17:27:53.623896+0000","last_became_peered":"2020-11-12T17:27:53.623896+0000","last_unstale":"2020-11-12T17:28:20.646316+0000","last_undegraded":"2020-11-12T17:28:20.646316+0000","last_fullsized":"2020-11-12T17:28:20.646316+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4571,"ondisk_log_size":4571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4571,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":476,"num_bytes_recovered":31195136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"21","reported_epoch":"179","state":"active+clean","last_fresh":"2020-11-12T17:28:15.052408+0000","last_change":"2020-11-12T17:27:53.469179+0000","last_active":"2020-11-12T17:28:15.052408+0000","last_peered":"2020-11-12T17:28:15.052408+0000","last_clean":"2020-11-12T17:28:15.052408+0000","last_became_active":"2020-11-12T17:27:53.468698+0000","last_became_peered":"2020-11-12T17:27:53.468698+0000","last_unstale":"2020-11-12T17:28:15.052408+0000","last_undegraded":"2020-11-12T17:28:15.052408+0000","last_fullsized":"2020-11-12T17:28:15.052408+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:51.287572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:14.829737+0000","last_clean_scrub_stamp":"2020-11-12T17:27:51.287572+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"183'4544","reported_seq":"4606","reported_epoch":"183","state":"active+clean","last_fresh":"2020-11-12T17:28:20.920821+0000","last_change":"2020-11-12T17:26:45.490394+0000","last_active":"2020-11-12T17:28:20.920821+0000","last_peered":"2020-11-12T17:28:20.920821+0000","last_clean":"2020-11-12T17:28:20.920821+0000","last_became_active":"2020-11-12T17:26:45.489929+0000","last_became_peered":"2020-11-12T17:26:45.489929+0000","last_unstale":"2020-11-12T17:28:20.920821+0000","last_undegraded":"2020-11-12T17:28:20.920821+0000","last_fullsized":"2020-11-12T17:28:20.920821+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4544,"ondisk_log_size":4544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":298,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"131","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.588329+0000","last_change":"2020-11-12T17:28:17.075409+0000","last_active":"2020-11-12T17:28:17.588329+0000","last_peered":"2020-11-12T17:28:17.588329+0000","last_clean":"2020-11-12T17:28:17.588329+0000","last_became_active":"2020-11-12T17:28:17.074744+0000","last_became_peered":"2020-11-12T17:28:17.074744+0000","last_unstale":"2020-11-12T17:28:17.588329+0000","last_undegraded":"2020-11-12T17:28:17.588329+0000","last_fullsized":"2020-11-12T17:28:17.588329+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:52.317257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:22:50.324059+0000","last_clean_scrub_stamp":"2020-11-12T17:26:52.317257+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"179'4212","reported_seq":"4497","reported_epoch":"180","state":"peering","last_fresh":"2020-11-12T17:28:16.058811+0000","last_change":"2020-11-12T17:28:16.059623+0000","last_active":"2020-11-12T17:28:16.058811+0000","last_peered":"2020-11-12T17:28:15.970968+0000","last_clean":"2020-11-12T17:28:15.970968+0000","last_became_active":"2020-11-12T17:27:00.648415+0000","last_became_peered":"2020-11-12T17:27:00.648415+0000","last_unstale":"2020-11-12T17:28:16.058811+0000","last_undegraded":"2020-11-12T17:28:16.058811+0000","last_fullsized":"2020-11-12T17:28:16.058811+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:26:44.442765+0000","last_clean_scrub_stamp":"2020-11-12T17:26:44.442765+0000","log_size":4212,"ondisk_log_size":4212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34504704,"num_objects":527,"num_object_clones":0,"num_object_copies":1054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":527,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4212,"num_write_kb":33696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":7077888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"184","reported_epoch":"182","state":"active+clean","last_fresh":"2020-11-12T17:28:17.581654+0000","last_change":"2020-11-12T17:27:52.416332+0000","last_active":"2020-11-12T17:28:17.581654+0000","last_peered":"2020-11-12T17:28:17.581654+0000","last_clean":"2020-11-12T17:28:17.581654+0000","last_became_active":"2020-11-12T17:27:49.451818+0000","last_became_peered":"2020-11-12T17:27:49.451818+0000","last_unstale":"2020-11-12T17:28:17.581654+0000","last_undegraded":"2020-11-12T17:28:17.581654+0000","last_fullsized":"2020-11-12T17:28:17.581654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12T17:27:52.416215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12T17:24:18.165582+0000","last_clean_scrub_stamp":"2020-11-12T17:27:52.416215+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":408911896,"num_objects":6241,"num_object_clones":0,"num_object_copies":12482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":276,"num_objects_unfound":0,"num_objects_dirty":6241,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":70122,"num_write_kb":543009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3121,"num_bytes_recovered":204496896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":382169088,"data_stored":929218584,"data_compressed":5227167,"data_compressed_allocated":382164992,"data_compressed_original":929218560,"omap_allocated":0,"internal_metadata":0},"log_size":70122,"ondisk_log_size":70122,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":18,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542212,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1098748,"kb_used_data":50164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93273092,"statfs":{"total":96636764160,"available":95511646208,"internally_reserved":1073741824,"allocated":51367936,"data_stored":100603877,"data_compressed":669816,"data_compressed_allocated":50036736,"data_compressed_original":100073472,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":9.4589999999999996,"15min":4.1989999999999998},"min":{"1min":0.60599999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":7.2270000000000003,"5min":727.43499999999995,"15min":727.43499999999995},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.6399999999999999,"5min":2.6419999999999999,"15min":2.3109999999999999},"min":{"1min":0.60299999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":7.375,"5min":101.371,"15min":101.371},"last":1.0649999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:27:36 2020","interfaces":[{"interface":"back","average":{"1min":1.71,"5min":6.1219999999999999,"15min":6.8579999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":3.5449999999999999,"5min":102.354,"15min":102.354},"last":1.121},{"interface":"front","average":{"1min":1.718,"5min":5.8339999999999996,"15min":6.5199999999999996},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":5.399,"5min":102.08199999999999,"15min":102.08199999999999},"last":2.0430000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":5.5439999999999996,"15min":6.1349999999999998},"min":{"1min":0.76200000000000001,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":10.603,"5min":102.038,"15min":102.038},"last":2.2669999999999999},{"interface":"front","average":{"1min":2.355,"5min":5.8410000000000002,"15min":6.4219999999999997},"min":{"1min":0.92300000000000004,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":10.726000000000001,"5min":102.92,"15min":102.92},"last":1.29}]},{"osd":3,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.1379999999999999,"5min":2.7949999999999999,"15min":2.4060000000000001},"min":{"1min":1.0149999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":10.640000000000001,"5min":102.443,"15min":102.443},"last":1.964},{"interface":"front","average":{"1min":2.3580000000000001,"5min":9.4209999999999994,"15min":4.8129999999999997},"min":{"1min":1.0589999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":10.526,"5min":871.76700000000005,"15min":871.76700000000005},"last":2.1989999999999998}]},{"osd":4,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.169,"5min":23.588999999999999,"15min":43.701000000000001},"min":{"1min":0.83999999999999997,"5min":0.624,"15min":0.624},"max":{"1min":10.275,"5min":849.06500000000005,"15min":849.06500000000005},"last":2.129},{"interface":"front","average":{"1min":2.6269999999999998,"5min":4.1440000000000001,"15min":2.718},"min":{"1min":0.81499999999999995,"5min":0.621,"15min":0.621},"max":{"1min":14.92,"5min":108.14,"15min":108.14},"last":1.5229999999999999}]},{"osd":5,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":6.0869999999999997,"15min":3.8570000000000002},"min":{"1min":0.88900000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":9.8350000000000009,"5min":311.077,"15min":311.077},"last":1.7669999999999999},{"interface":"front","average":{"1min":2.3050000000000002,"5min":3.2469999999999999,"15min":2.9940000000000002},"min":{"1min":0.97199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":9.9250000000000007,"5min":104.02,"15min":104.02},"last":1.8620000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.6760000000000002,"5min":7.7569999999999997,"15min":4.4589999999999996},"min":{"1min":0.91200000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":10.422000000000001,"5min":375.04199999999997,"15min":375.04199999999997},"last":1.4910000000000001},{"interface":"front","average":{"1min":2.5390000000000001,"5min":19.574000000000002,"15min":42.152000000000001},"min":{"1min":1.103,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":10.356,"5min":975.20899999999995,"15min":975.20899999999995},"last":2.532}]}]},{"osd":5,"up_from":14,"seq":60129542213,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1118328,"kb_used_data":69744,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93253512,"statfs":{"total":96636764160,"available":95491596288,"internally_reserved":1073741824,"allocated":71417856,"data_stored":140700052,"data_compressed":938468,"data_compressed_allocated":70082560,"data_compressed_original":140165120,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.367,"15min":1.6719999999999999},"min":{"1min":0.65800000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.5409999999999999,"5min":5.0309999999999997,"15min":5.0309999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.147,"5min":1.5389999999999999,"15min":1.9339999999999999},"min":{"1min":0.68600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.776,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":1.123}]},{"osd":1,"last update":"Thu Nov 12 17:27:34 2020","interfaces":[{"interface":"back","average":{"1min":1.633,"5min":1.5980000000000001,"15min":1.5920000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":4.327,"5min":4.6959999999999997,"15min":4.6959999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.778,"15min":1.802},"min":{"1min":1.0669999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.024,"5min":4.4370000000000003,"15min":4.4370000000000003},"last":544.63499999999999}]},{"osd":2,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.7490000000000001,"15min":1.754},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":3.782,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":1.25},{"interface":"front","average":{"1min":1.9470000000000001,"5min":1.7929999999999999,"15min":1.7669999999999999},"min":{"1min":1.034,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0640000000000001,"5min":5.0640000000000001,"15min":5.0640000000000001},"last":1.3520000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1560000000000001,"5min":2.6040000000000001,"15min":2.6960000000000002},"min":{"1min":1.028,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":4.4790000000000001,"5min":49.442999999999998,"15min":49.442999999999998},"last":1.381},{"interface":"front","average":{"1min":23.279,"5min":6.2480000000000002,"15min":3.7400000000000002},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":437.625,"5min":437.625,"15min":437.625},"last":1.3160000000000001}]},{"osd":4,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":6.0880000000000001,"15min":3.5139999999999998},"min":{"1min":0.59099999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.6619999999999999,"5min":459.15499999999997,"15min":459.15499999999997},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.504,"5min":4.7699999999999996,"15min":3.6240000000000001},"min":{"1min":0.82199999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.1669999999999998,"5min":324.95600000000002,"15min":324.95600000000002},"last":2.2170000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1280000000000001,"5min":2.0150000000000001,"15min":2.2330000000000001},"min":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":4.984,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":1.403},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.8360000000000001,"15min":2.194},"min":{"1min":0.82299999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.786,"5min":5.1210000000000004,"15min":5.1210000000000004},"last":1.0900000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":19.530000000000001,"5min":6.0430000000000001,"15min":4.0830000000000002},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":359.55599999999998,"5min":359.55599999999998,"15min":359.55599999999998},"last":1.506},{"interface":"front","average":{"1min":2.0979999999999999,"5min":8.1829999999999998,"15min":4.6639999999999997},"min":{"1min":0.84399999999999997,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.7519999999999998,"5min":693.23000000000002,"15min":693.23000000000002},"last":1.2769999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542213,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1103492,"kb_used_data":54908,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93268348,"statfs":{"total":96636764160,"available":95506788352,"internally_reserved":1073741824,"allocated":56225792,"data_stored":116670337,"data_compressed":740700,"data_compressed_allocated":54865920,"data_compressed_original":116121600,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":2.1629999999999998,"5min":12.895,"15min":5.3540000000000001},"min":{"1min":0.70899999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":13.298,"5min":765.13099999999997,"15min":765.13099999999997},"last":0.623},{"interface":"front","average":{"1min":1.6120000000000001,"5min":14.550000000000001,"15min":36.204000000000001},"min":{"1min":0.872,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.5609999999999999,"5min":948.30899999999997,"15min":948.30899999999997},"last":1.4690000000000001}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":2.3849999999999998,"5min":15.705,"15min":17.925000000000001},"min":{"1min":0.79900000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":7.4329999999999998,"5min":356.46699999999998,"15min":356.46699999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.911,"5min":15.529,"15min":17.798999999999999},"min":{"1min":0.92800000000000005,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":3.8799999999999999,"5min":356.18599999999998,"15min":356.18599999999998},"last":1.5129999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:28:01 2020","interfaces":[{"interface":"back","average":{"1min":2.383,"5min":1.948,"15min":1.8759999999999999},"min":{"1min":0.746,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":13.382999999999999,"5min":13.382999999999999,"15min":13.382999999999999},"last":1.075},{"interface":"front","average":{"1min":1.9490000000000001,"5min":1.7769999999999999,"15min":1.7490000000000001},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":3.9780000000000002,"5min":4.056,"15min":4.056},"last":1.6140000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":2.738,"5min":5.9480000000000004,"15min":3.3420000000000001},"min":{"1min":0.876,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":11.282,"5min":356.02300000000002,"15min":356.02300000000002},"last":1.5449999999999999},{"interface":"front","average":{"1min":2.2450000000000001,"5min":9.2590000000000003,"15min":4.5300000000000002},"min":{"1min":1.0529999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":3.9769999999999999,"5min":357.79000000000002,"15min":357.79000000000002},"last":1.649}]},{"osd":5,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":3.0089999999999999,"5min":12.48,"15min":5.5279999999999996},"min":{"1min":0.96799999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":13.417999999999999,"5min":575.16800000000001,"15min":575.16800000000001},"last":1.107},{"interface":"front","average":{"1min":2.6589999999999998,"5min":16.007000000000001,"15min":6.843},"min":{"1min":1.3149999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":5.6609999999999996,"5min":908.52700000000004,"15min":908.52700000000004},"last":1.5720000000000001}]},{"osd":6,"last update":"Thu Nov 12 17:27:55 2020","interfaces":[{"interface":"back","average":{"1min":3.1219999999999999,"5min":12.295,"15min":26.529},"min":{"1min":0.95099999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":11.757,"5min":665.13999999999999,"15min":665.13999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":2.5939999999999999,"5min":10.083,"15min":4.8550000000000004},"min":{"1min":0.88200000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":13.446,"5min":426.197,"15min":426.197},"last":1.2030000000000001}]},{"osd":7,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":2.4660000000000002,"5min":14.332000000000001,"15min":6.3719999999999999},"min":{"1min":1.474,"5min":0.87,"15min":0.87},"max":{"1min":4.1920000000000002,"5min":584.00300000000004,"15min":584.00300000000004},"last":1.8049999999999999},{"interface":"front","average":{"1min":3.3410000000000002,"5min":15.398,"15min":6.5919999999999996},"min":{"1min":1.3,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":11.363,"5min":915.22900000000004,"15min":915.22900000000004},"last":0.96099999999999997}]}]},{"osd":1,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":14,"seq":60129542213,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1081584,"kb_used_data":33000,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93290256,"statfs":{"total":96636764160,"available":95529222144,"internally_reserved":1073741824,"allocated":33792000,"data_stored":65364807,"data_compressed":435160,"data_compressed_allocated":32407552,"data_compressed_original":64815104,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":1.8300000000000001,"5min":1.6180000000000001,"15min":1.718},"min":{"1min":0.67100000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":6.0990000000000002,"5min":6.0990000000000002,"15min":6.0990000000000002},"last":1.7090000000000001},{"interface":"front","average":{"1min":13.329000000000001,"5min":3.9470000000000001,"15min":2.6890000000000001},"min":{"1min":0.80100000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":254.70500000000001,"5min":254.70500000000001,"15min":254.70500000000001},"last":2.4399999999999999}]},{"osd":1,"last update":"Thu Nov 12 17:27:32 2020","interfaces":[{"interface":"back","average":{"1min":4.6139999999999999,"5min":35.189,"15min":40.284999999999997},"min":{"1min":1.0069999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":49.276000000000003,"5min":665.476,"15min":665.476},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.929,"5min":1.3779999999999999,"15min":1.286},"min":{"1min":0.82899999999999996,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":4.5549999999999997,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":1.7350000000000001}]},{"osd":2,"last update":"Thu Nov 12 17:28:01 2020","interfaces":[{"interface":"back","average":{"1min":1.8480000000000001,"5min":1.6639999999999999,"15min":1.6339999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":7.1369999999999996,"5min":7.1369999999999996,"15min":7.1369999999999996},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.9039999999999999,"5min":1.617,"15min":1.569},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":4.6379999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":2.4990000000000001}]},{"osd":3,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":7.0579999999999998,"5min":3.1949999999999998,"15min":2.4710000000000001},"min":{"1min":0.99099999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":118.611,"5min":118.611,"15min":118.611},"last":2.71},{"interface":"front","average":{"1min":40.183999999999997,"5min":9.8610000000000007,"15min":4.9269999999999996},"min":{"1min":1.1479999999999999,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":764.62800000000004,"5min":764.62800000000004,"15min":764.62800000000004},"last":1.0329999999999999}]},{"osd":4,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":1.78,"5min":7.1500000000000004,"15min":3.8700000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.5549999999999997,"5min":489.149,"15min":489.149},"last":1.663},{"interface":"front","average":{"1min":1.6799999999999999,"5min":9.0609999999999999,"15min":4.8010000000000002},"min":{"1min":0.70199999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":10.935,"5min":480.79599999999999,"15min":480.79599999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":1.8839999999999999,"5min":20.385000000000002,"15min":8.3149999999999995},"min":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":8.1880000000000006,"5min":804.62199999999996,"15min":804.62199999999996},"last":1.1739999999999999},{"interface":"front","average":{"1min":2.0379999999999998,"5min":11.406000000000001,"15min":18.963000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":5.6269999999999998,"5min":494.78399999999999,"15min":494.78399999999999},"last":1.7649999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:27:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":17.474,"15min":7.6779999999999999},"min":{"1min":0.80500000000000005,"5min":0.626,"15min":0.626},"max":{"1min":8.0890000000000004,"5min":1002.347,"15min":1002.347},"last":1.2949999999999999},{"interface":"front","average":{"1min":2.2999999999999998,"5min":2.2240000000000002,"15min":2.4239999999999999},"min":{"1min":1.1180000000000001,"5min":0.878,"15min":0.878},"max":{"1min":6.7839999999999998,"5min":10.271000000000001,"15min":10.271000000000001},"last":1.8220000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542212,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1070300,"kb_used_data":21716,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93301540,"statfs":{"total":96636764160,"available":95540776960,"internally_reserved":1073741824,"allocated":22237184,"data_stored":176558994,"data_compressed":363914,"data_compressed_allocated":20922368,"data_compressed_original":176029696,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,0,0,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 17:27:34 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":33.646999999999998,"15min":38.969000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":4.6310000000000002,"5min":501.38600000000002,"15min":501.38600000000002},"last":1.163},{"interface":"front","average":{"1min":1.6180000000000001,"5min":1.698,"15min":1.712},"min":{"1min":0.97299999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.702,"5min":3.141,"15min":3.141},"last":1.284}]},{"osd":2,"last update":"Thu Nov 12 17:27:57 2020","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.6679999999999999,"15min":1.704},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":3.323,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":1.627,"5min":31.257000000000001,"15min":36.195},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":4.4180000000000001,"5min":811.02700000000004,"15min":811.02700000000004},"last":1.206}]},{"osd":3,"last update":"Thu Nov 12 17:27:52 2020","interfaces":[{"interface":"back","average":{"1min":25.684999999999999,"5min":9.2959999999999994,"15min":13.548},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":413.33699999999999,"5min":413.33699999999999,"15min":413.33699999999999},"last":1.335},{"interface":"front","average":{"1min":1.649,"5min":1.744,"15min":1.9550000000000001},"min":{"1min":0.872,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.4420000000000002,"5min":4.9649999999999999,"15min":4.9649999999999999},"last":1.429}]},{"osd":4,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":5.0339999999999998,"15min":3.1379999999999999},"min":{"1min":1.085,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.5419999999999998,"5min":347.87599999999998,"15min":347.87599999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":6.976,"5min":5.9740000000000002,"15min":3.2869999999999999},"min":{"1min":1.0609999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":89.954999999999998,"5min":347.07499999999999,"15min":347.07499999999999},"last":1.877}]},{"osd":5,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":34.363,"5min":11.606999999999999,"15min":5.2990000000000004},"min":{"1min":1.0289999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":551.47299999999996,"5min":551.47299999999996,"15min":551.47299999999996},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.867,"5min":14.631,"15min":38.652999999999999},"min":{"1min":0.94099999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":3.5310000000000001,"5min":920.76900000000001,"15min":920.76900000000001},"last":1.6759999999999999}]},{"osd":6,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":6.4950000000000001,"15min":3.746},"min":{"1min":1.004,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":7.8499999999999996,"5min":429.55599999999998,"15min":429.55599999999998},"last":1.7130000000000001},{"interface":"front","average":{"1min":2.2629999999999999,"5min":15.630000000000001,"15min":6.8799999999999999},"min":{"1min":1.0089999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":4.9720000000000004,"5min":931.65200000000004,"15min":931.65200000000004},"last":1.6539999999999999}]},{"osd":7,"last update":"Thu Nov 12 17:27:51 2020","interfaces":[{"interface":"back","average":{"1min":2.1869999999999998,"5min":15.689,"15min":24.651},"min":{"1min":1.1220000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":4.8079999999999998,"5min":502.31,"15min":502.31},"last":1.7789999999999999},{"interface":"front","average":{"1min":2.427,"5min":11.563000000000001,"15min":36.590000000000003},"min":{"1min":1.1719999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":5.8090000000000002,"5min":502.42099999999999,"15min":502.42099999999999},"last":1.829}]}]},{"osd":2,"up_from":102,"seq":438086664222,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1128144,"kb_used_data":79560,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93243696,"statfs":{"total":96636764160,"available":95481544704,"internally_reserved":1073741824,"allocated":81469440,"data_stored":160783194,"data_compressed":1075800,"data_compressed_allocated":80117760,"data_compressed_original":160235520,"omap_allocated":4385,"internal_metadata":1073737439},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":27.831,"15min":32.198},"min":{"1min":0.92400000000000004,"5min":0.755,"15min":0.755},"max":{"1min":2.931,"5min":524.55600000000004,"15min":524.55600000000004},"last":1.155},{"interface":"front","average":{"1min":1.631,"5min":1.5880000000000001,"15min":1.581},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":3.7730000000000001,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":40.386000000000003,"5min":9.6799999999999997,"15min":4.5620000000000003},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":776.01499999999999,"5min":776.01499999999999,"15min":776.01499999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.722,"15min":1.7030000000000001},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":4.4210000000000003,"5min":4.4210000000000003,"15min":4.4210000000000003},"last":0.873}]},{"osd":3,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":1.841,"15min":1.8620000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":2.3940000000000001},{"interface":"front","average":{"1min":1.8939999999999999,"5min":46.975999999999999,"15min":54.490000000000002},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":5.1260000000000003,"5min":902.96299999999997,"15min":902.96299999999997},"last":1.181}]},{"osd":4,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":16.821000000000002,"5min":4.8049999999999997,"15min":2.8029999999999999},"min":{"1min":0.80300000000000005,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":258.35599999999999,"5min":258.35599999999999,"15min":258.35599999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":4.3300000000000001,"5min":2.4089999999999998,"15min":2.089},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":46.899000000000001,"5min":46.899000000000001,"15min":46.899000000000001},"last":2.806}]},{"osd":5,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.214,"5min":2.5179999999999998,"15min":2.5680000000000001},"min":{"1min":1.27,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":5.2270000000000003,"5min":10.308,"15min":10.308},"last":1.1970000000000001},{"interface":"front","average":{"1min":2.5779999999999998,"5min":2.194,"15min":2.1299999999999999},"min":{"1min":1.0649999999999999,"5min":0.98199999999999998,"15min":0.98199999999999998},"max":{"1min":5.3970000000000002,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":1.526}]},{"osd":6,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":2.3359999999999999,"5min":2.1829999999999998,"15min":2.157},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":5.7759999999999998,"5min":5.7759999999999998,"15min":5.7759999999999998},"last":2.8399999999999999},{"interface":"front","average":{"1min":2.3290000000000002,"5min":10.577,"15min":11.952},"min":{"1min":1.3240000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":5.1859999999999999,"5min":168.64599999999999,"15min":168.64599999999999},"last":1.78}]},{"osd":7,"last update":"Thu Nov 12 17:27:58 2020","interfaces":[{"interface":"back","average":{"1min":20.908999999999999,"5min":6.2039999999999997,"15min":3.7530000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":374.077,"5min":374.077,"15min":374.077},"last":1.0640000000000001},{"interface":"front","average":{"1min":42.392000000000003,"5min":10.497999999999999,"15min":5.1820000000000004},"min":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"max":{"1min":528.596,"5min":528.596,"15min":528.596},"last":2.8570000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542212,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1083960,"kb_used_data":35376,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93287880,"statfs":{"total":96636764160,"available":95526789120,"internally_reserved":1073741824,"allocated":36225024,"data_stored":70299232,"data_compressed":466860,"data_compressed_allocated":34881536,"data_compressed_original":69763072,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.5049999999999999,"5min":3.6240000000000001,"15min":2.4060000000000001},"min":{"1min":0.69299999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.8580000000000001,"5min":178.36699999999999,"15min":178.36699999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.821,"15min":1.911},"min":{"1min":0.54600000000000004,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.222,"5min":16.902000000000001,"15min":16.902000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Nov 12 17:27:36 2020","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":30.931000000000001,"15min":35.847000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.7040000000000002,"5min":501.91199999999998,"15min":501.91199999999998},"last":1.179},{"interface":"front","average":{"1min":29.451000000000001,"5min":27.236999999999998,"15min":26.867999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":501.91399999999999,"5min":501.91399999999999,"15min":501.91399999999999},"last":1.0189999999999999}]},{"osd":2,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":40.996000000000002,"5min":49.390000000000001,"15min":50.789000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":501.85700000000003,"5min":942.58500000000004,"15min":942.58500000000004},"last":1.7270000000000001},{"interface":"front","average":{"1min":1.8580000000000001,"5min":21.530000000000001,"15min":24.808},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.6240000000000001,"5min":461.721,"15min":461.721},"last":1.484}]},{"osd":4,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9330000000000001,"5min":2.0390000000000001,"15min":2.3730000000000002},"min":{"1min":0.88800000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.6390000000000002,"5min":10.318,"15min":10.318},"last":1.45},{"interface":"front","average":{"1min":9.0190000000000001,"5min":3.3399999999999999,"15min":2.778},"min":{"1min":0.86499999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":173.863,"5min":173.863,"15min":173.863},"last":1.2270000000000001}]},{"osd":5,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9750000000000001,"5min":8.0860000000000003,"15min":24.167999999999999},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":4.7629999999999999,"5min":622.07799999999997,"15min":622.07799999999997},"last":2.5289999999999999},{"interface":"front","average":{"1min":2.0259999999999998,"5min":2.2130000000000001,"15min":2.6429999999999998},"min":{"1min":1.0249999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":3.6699999999999999,"5min":10.436,"15min":10.436},"last":1.538}]},{"osd":6,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":2.1230000000000002,"5min":7.1680000000000001,"15min":4.1390000000000002},"min":{"1min":0.92200000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":4.9059999999999997,"5min":466.58199999999999,"15min":466.58199999999999},"last":2.5920000000000001},{"interface":"front","average":{"1min":2.036,"5min":2.2530000000000001,"15min":2.5830000000000002},"min":{"1min":1.0629999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.403,"5min":11.497999999999999,"15min":11.497999999999999},"last":1.405}]},{"osd":7,"last update":"Thu Nov 12 17:27:59 2020","interfaces":[{"interface":"back","average":{"1min":1.8680000000000001,"5min":5.2030000000000003,"15min":3.6869999999999998},"min":{"1min":1.1160000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.0569999999999999,"5min":287.43099999999998,"15min":287.43099999999998},"last":1.661},{"interface":"front","average":{"1min":2.266,"5min":14.045,"15min":24.808},"min":{"1min":1.1559999999999999,"5min":1.016,"15min":1.016},"max":{"1min":4.8440000000000003,"5min":606.49099999999999,"15min":606.49099999999999},"last":1.974}]}]}]}} 2020-11-12T17:28:21.631 INFO:tasks.ceph.ceph_manager.ceph:would drop below min_pgs, proj -9, currently 1 2020-11-12T17:28:21.651 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:21.650+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:21.904 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:21.904 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:21.905 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:21.907 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:21.900+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:22.005 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:22.000+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:22.062 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:22.063 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:22.078 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:22.105 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:22.100+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:22.161 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:22.226 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:22.220+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:22.235 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:22.245 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:22.325 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:22.320+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:22.392 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:22.392 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:22.404 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:22.405 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:22.426 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:22.424+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:22.439 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:22.527 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:22.527 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:22.528 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:22.524+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:22.530 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:22.542 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:22.571 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:22.611 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:22.631 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:22.626+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:22.790 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:22.791 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:22.792 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:22.792 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:22.792 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:22.792 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:22.792 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:22.793 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:22.793 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:22.793 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:22.784+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:22.794 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:22.794 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:22.794 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:22.794 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:22.795 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:22.892 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:22.888+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:22.982 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.983 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9976 3.c 3:390c921c:::benchmark_data_smithi036_14212_object1246:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 308.45384327900001, 2020-11-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001, 2020-11-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:22.984 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:22.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:22.985 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9976 2020-11-12T17:28:22.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.985 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:22.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:22.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:28:22.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:22.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:22.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526238+0000", 2020-11-12T17:28:22.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:22.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:22.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526189+0000", 2020-11-12T17:28:22.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013495799999999999 2020-11-12T17:28:22.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:22.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526323+0000", 2020-11-12T17:28:22.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3502e-05 2020-11-12T17:28:22.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:22.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526337+0000", 2020-11-12T17:28:22.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6079999999999998e-06 2020-11-12T17:28:22.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:22.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526345+0000", 2020-11-12T17:28:22.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00046766199999999998 2020-11-12T17:28:22.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:22.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526812+0000", 2020-11-12T17:28:22.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7918000000000007e-05 2020-11-12T17:28:22.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:22.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.526910+0000", 2020-11-12T17:28:22.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015794999999999999 2020-11-12T17:28:22.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:22.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.527068+0000", 2020-11-12T17:28:22.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001178948 2020-11-12T17:28:22.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:22.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.528247+0000", 2020-11-12T17:28:22.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40478128000000002 2020-11-12T17:28:22.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:22.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933028+0000", 2020-11-12T17:28:22.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018941699999999999 2020-11-12T17:28:22.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:22.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933218+0000", 2020-11-12T17:28:22.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014517999999999999 2020-11-12T17:28:22.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:22.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.933363+0000", 2020-11-12T17:28:22.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40712474500000001 2020-11-12T17:28:22.995 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:22.996 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:22.996 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:22.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.996 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:28:22.996 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:22.996 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 272.97455389800001, 2020-11-12T17:28:22.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:28:22.997 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:22.997 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:22.997 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:22.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:22.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:22.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:28:22.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:28:23.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:28:23.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.004 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:23.005 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 241.03456855499999, 2020-11-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:23.010 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:23.011 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:28:23.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.011 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:23.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:23.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:28:23.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:28:23.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:28:23.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:28:23.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:28:23.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:28:23.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:23.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:28:23.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:28:23.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:28:23.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:28:23.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:28:23.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:28:23.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:23.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:28:23.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:28:23.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:28:23.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:28:23.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:28:23.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:28:23.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:28:23.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:28:23.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:28:23.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:28:23.020 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.020 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 229.557467481, 2020-11-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:23.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:28:23.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:28:23.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.027 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 228.438457094, 2020-11-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:28:23.028 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.029 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:28:23.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:28:23.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:28:23.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:28:23.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:28:23.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:28:23.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:28:23.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:28:23.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:28:23.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:28:23.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:28:23.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:23.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:28:23.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:28:23.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:28:23.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:28:23.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:28:23.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:28:23.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:28:23.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:28:23.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 228.42231909, 2020-11-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:23.039 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:28:23.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:28:23.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:28:23.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:28:23.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:28:23.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:28:23.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:28:23.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:28:23.045 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.046 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.046 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.046 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:28:23.046 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:23.046 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 228.41759141099999, 2020-11-12T17:28:23.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:28:23.047 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.047 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:23.047 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.047 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:23.047 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:23.047 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:23.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.048 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:23.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:23.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:23.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:28:23.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:28:23.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:28:23.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:28:23.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:28:23.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:23.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:28:23.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:28:23.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:28:23.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:28:23.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:23.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:28:23.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:28:23.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:28:23.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:28:23.053 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.054 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.054 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.054 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:23.054 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:23.054 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.373829512, 2020-11-12T17:28:23.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:28:23.055 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.055 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.055 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.055 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:23.055 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:23.055 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:28:23.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.056 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:23.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:23.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:23.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:28:23.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:28:23.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:28:23.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:28:23.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:28:23.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:28:23.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:28:23.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:28:23.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:28:23.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:28:23.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:28:23.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:28:23.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:28:23.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:28:23.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:28:23.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:28:23.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:28:23.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:28:23.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:28:23.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:28:23.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:28:23.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:28:23.064 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.064 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.064 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.065 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:23.065 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:23.065 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.37193589899999, 2020-11-12T17:28:23.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:28:23.065 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.065 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.066 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.066 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:23.066 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:23.066 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:28:23.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.066 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:23.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:23.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:23.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:28:23.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:28:23.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:28:23.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:28:23.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:28:23.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:28:23.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:28:23.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:28:23.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:28:23.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:28:23.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:28:23.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:28:23.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:28:23.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:28:23.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:28:23.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:28:23.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:28:23.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:28:23.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:28:23.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:28:23.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:28:23.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:28:23.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.076 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.076 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.076 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:23.076 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:23.076 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.37118325100001, 2020-11-12T17:28:23.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:28:23.077 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.077 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.077 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.077 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:23.077 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:23.077 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:28:23.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.078 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:23.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:23.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:23.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:28:23.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:28:23.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:28:23.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:28:23.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:28:23.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:28:23.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:28:23.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:28:23.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:28:23.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:28:23.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:28:23.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:28:23.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:28:23.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:28:23.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:28:23.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:28:23.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:28:23.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:28:23.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:28:23.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:28:23.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:28:23.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:28:23.086 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.086 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.087 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.087 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:23.087 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:23.087 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.368021734, 2020-11-12T17:28:23.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:28:23.087 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.088 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.088 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.088 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:23.088 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:23.088 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:28:23.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.088 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:23.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:23.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:23.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:28:23.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:28:23.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:28:23.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:28:23.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:28:23.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:28:23.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:28:23.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:28:23.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:28:23.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:28:23.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:28:23.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:28:23.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:28:23.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:28:23.098 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.098 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.098 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.098 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:23.098 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:23.099 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.366940567, 2020-11-12T17:28:23.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:28:23.099 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.099 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.099 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.099 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:23.099 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:23.099 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:28:23.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.100 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:23.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:23.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:23.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:28:23.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:28:23.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:28:23.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:28:23.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:28:23.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.366771474, 2020-11-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.308 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:23.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:23.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:23.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:28:23.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:28:23.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:28:23.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:28:23.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:28:23.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:28:23.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:28:23.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:28:23.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:28:23.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:28:23.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:28:23.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:28:23.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:28:23.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:28:23.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:28:23.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:28:23.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.322 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.364152828, 2020-11-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.323 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:23.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:23.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:28:23.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:28:23.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:28:23.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:28:23.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:28:23.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:28:23.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:28:23.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:28:23.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:28:23.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:28:23.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:28:23.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:28:23.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:28:23.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:28:23.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:28:23.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:28:23.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:28:23.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.343 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.343 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.344 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:23.344 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:23.344 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.364044745, 2020-11-12T17:28:23.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:28:23.345 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.345 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.345 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.346 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:23.346 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:23.346 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:28:23.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.347 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:23.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:23.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:23.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:28:23.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:28:23.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:28:23.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:28:23.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:28:23.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:28:23.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:28:23.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:28:23.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:28:23.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:28:23.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:28:23.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:28:23.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:28:23.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:28:23.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:28:23.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:28:23.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:28:23.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:28:23.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:28:23.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:28:23.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:28:23.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:28:23.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.363 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.364 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.364 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:28:23.364 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:23.364 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 122.36008206299999, 2020-11-12T17:28:23.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:28:23.365 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.365 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:23.365 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:23.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:23.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:28:23.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:28:23.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:28:23.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:28:23.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:28:23.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:28:23.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:28:23.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:28:23.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:28:23.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:28:23.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:28:23.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:28:23.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:28:23.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:28:23.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:28:23.372 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.372 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.372 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.373 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:28:23.373 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:23.373 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.322352322, 2020-11-12T17:28:23.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:28:23.373 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.373 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.373 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:23.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:23.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:23.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:28:23.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:28:23.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:28:23.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:28:23.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:28:23.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:28:23.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:28:23.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:28:23.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:28:23.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:28:23.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:28:23.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:28:23.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:28:23.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:28:23.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:28:23.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:28:23.380 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.380 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.380 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.381 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:28:23.381 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:23.381 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 24.808949637000001, 2020-11-12T17:28:23.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:28:23.382 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.382 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:23.382 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:23.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:23.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:23.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:28:23.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:28:23.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:28:23.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:28:23.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:28:23.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:28:23.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:28:23.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:28:23.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:28:23.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:28:23.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:28:23.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:28:23.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:28:23.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:28:23.389 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.389 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.389 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.389 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:23.390 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:23.390 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 23.472639751999999, 2020-11-12T17:28:23.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:28:23.390 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.390 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.390 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.390 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:23.390 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:23.391 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:28:23.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.391 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:23.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:23.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:23.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:28:23.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:28:23.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:28:23.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:28:23.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:28:23.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:28:23.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:28:23.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:28:23.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:28:23.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:28:23.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:28:23.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:28:23.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:23.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:28:23.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:28:23.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:23.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:28:23.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:28:23.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:23.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:28:23.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:28:23.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:23.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:28:23.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:28:23.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:28:23.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:28:23.400 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.400 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.400 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.400 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:28:23.401 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:23.401 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 23.455031626, 2020-11-12T17:28:23.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:28:23.401 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.401 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:23.401 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:23.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:23.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:23.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:28:23.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:28:23.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:28:23.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:28:23.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:28:23.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:28:23.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:28:23.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:28:23.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:28:23.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:28:23.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:28:23.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:28:23.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:28:23.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:28:23.408 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.408 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.409 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.409 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.409 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.409 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:23.410 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:28:23.411 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:23.413 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:23.410+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:23.513 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:23.510+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:23.567 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:23.567 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:23.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.567 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:74321 5.9 5:95a1e5f7:::benchmark_data_smithi036_24110_object6431:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2020-11-12T17:28:23.567 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:23.556785+0000", 2020-11-12T17:28:23.568 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.010869793000000001, 2020-11-12T17:28:23.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010895121000000001, 2020-11-12T17:28:23.568 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.568 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:23.568 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.568 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:23.568 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:23.569 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 74321 2020-11-12T17:28:23.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.569 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.556785+0000", 2020-11-12T17:28:23.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.556785+0000", 2020-11-12T17:28:23.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:23.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.556754+0000", 2020-11-12T17:28:23.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6923999999999998e-05 2020-11-12T17:28:23.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.556821+0000", 2020-11-12T17:28:23.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4715999999999999e-05 2020-11-12T17:28:23.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.556836+0000", 2020-11-12T17:28:23.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4880000000000007e-06 2020-11-12T17:28:23.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.556844+0000", 2020-11-12T17:28:23.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011086099999999999 2020-11-12T17:28:23.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.556955+0000", 2020-11-12T17:28:23.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016028400000000001 2020-11-12T17:28:23.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.557116+0000", 2020-11-12T17:28:23.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014615599999999999 2020-11-12T17:28:23.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.557262+0000", 2020-11-12T17:28:23.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00047687199999999998 2020-11-12T17:28:23.583 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.583 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.583 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.583 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:74323 5.9 5:9f96f6b3:::benchmark_data_smithi036_24110_object6433:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2020-11-12T17:28:23.583 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:23.560742+0000", 2020-11-12T17:28:23.584 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0069128849999999997, 2020-11-12T17:28:23.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0069949540000000003, 2020-11-12T17:28:23.584 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.584 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:23.584 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.584 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:23.584 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:23.584 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 74323 2020-11-12T17:28:23.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.585 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.560742+0000", 2020-11-12T17:28:23.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.560742+0000", 2020-11-12T17:28:23.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:23.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.560724+0000", 2020-11-12T17:28:23.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9551000000000001e-05 2020-11-12T17:28:23.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.560764+0000", 2020-11-12T17:28:23.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0649999999999999e-06 2020-11-12T17:28:23.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.560772+0000", 2020-11-12T17:28:23.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5369999999999999e-06 2020-11-12T17:28:23.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.560776+0000", 2020-11-12T17:28:23.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6751000000000001e-05 2020-11-12T17:28:23.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.560813+0000", 2020-11-12T17:28:23.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5939000000000004e-05 2020-11-12T17:28:23.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.560909+0000", 2020-11-12T17:28:23.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010303599999999999 2020-11-12T17:28:23.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.561012+0000", 2020-11-12T17:28:23.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027022199999999998 2020-11-12T17:28:23.591 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.591 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.591 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.591 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:74326 5.9 5:95cdea4d:::benchmark_data_smithi036_24110_object6436:head [delete] snapc 0=[] ondisk+write+known_if_redirected e184)", 2020-11-12T17:28:23.592 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:23.561374+0000", 2020-11-12T17:28:23.592 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0062802149999999996, 2020-11-12T17:28:23.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006410092, 2020-11-12T17:28:23.592 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.592 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:23.592 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.592 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:23.593 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:23.593 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 74326 2020-11-12T17:28:23.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.593 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.561374+0000", 2020-11-12T17:28:23.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.561374+0000", 2020-11-12T17:28:23.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:28:23.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.561347+0000", 2020-11-12T17:28:23.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2513000000000003e-05 2020-11-12T17:28:23.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.561409+0000", 2020-11-12T17:28:23.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9025000000000002e-05 2020-11-12T17:28:23.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.561428+0000", 2020-11-12T17:28:23.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0820000000000004e-06 2020-11-12T17:28:23.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.561434+0000", 2020-11-12T17:28:23.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035111679999999998 2020-11-12T17:28:23.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.564946+0000", 2020-11-12T17:28:23.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000173182 2020-11-12T17:28:23.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:23.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.565119+0000", 2020-11-12T17:28:23.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013580499999999999 2020-11-12T17:28:23.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:23.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.565255+0000", 2020-11-12T17:28:23.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0038801349999999998 2020-11-12T17:28:23.608 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.608 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.609 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.610 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:74323 5.9 e184/151)", 2020-11-12T17:28:23.610 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:23.564437+0000", 2020-11-12T17:28:23.610 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.003217948, 2020-11-12T17:28:23.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033897139999999998, 2020-11-12T17:28:23.610 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.610 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:28:23.611 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.564437+0000", 2020-11-12T17:28:23.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.564437+0000", 2020-11-12T17:28:23.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:23.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.564415+0000", 2020-11-12T17:28:23.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4821000000000002e-05 2020-11-12T17:28:23.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.564470+0000", 2020-11-12T17:28:23.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5572999999999999e-05 2020-11-12T17:28:23.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.564516+0000", 2020-11-12T17:28:23.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6459999999999998e-06 2020-11-12T17:28:23.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.564521+0000", 2020-11-12T17:28:23.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4649999999999998e-05 2020-11-12T17:28:23.622 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.622 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.622 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.622 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.622 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:28:23.622 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 4 2020-11-12T17:28:23.623 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:23.624 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:23.630 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:23.626+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:23.726 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:23.722+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:23.768 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:23.768 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:23.768 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:23.769 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:23.769 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:23.780 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:23.831 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:23.830+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:23.928 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:23.926+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:23.959 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:23.960 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:23.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:23.960 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:23.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.961 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:28:23.961 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:23.963 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.284009486, 2020-11-12T17:28:23.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:28:23.964 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.964 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:23.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.965 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:23.968 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:23.969 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:28:23.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.971 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:23.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:23.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:28:23.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:28:23.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:28:23.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:28:23.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:28:23.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:28:23.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:28:23.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:28:23.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:28:23.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:28:23.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:28:23.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:23.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:28:23.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:28:23.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:28:23.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:28:23.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:23.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:28:23.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:28:23.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:28:23.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:28:23.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:23.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:28:23.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:28:23.986 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.987 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:23.987 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:23.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.987 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:23.987 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:23.988 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.283607125, 2020-11-12T17:28:23.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:28:23.988 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:23.988 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:23.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:23.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:23.989 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:23.989 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:28:23.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.989 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:23.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:23.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:23.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:23.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:23.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:23.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:28:23.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:23.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:28:23.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:28:23.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:23.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:28:23.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:28:23.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:23.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:28:23.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:28:23.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:23.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:28:23.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:28:23.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:28:23.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:28:23.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:23.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:28:23.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:28:23.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:28:23.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:28:23.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:23.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:28:23.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:28:23.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:23.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:23.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:23.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:28:23.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:28:24.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:28:24.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:28:24.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:28:24.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:28:24.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:28:24.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:28:24.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:28:24.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:28:24.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:28:24.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:28:24.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:28:24.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:28:24.005 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.005 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.005 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.005 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.005 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:24.006 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28328313200001, 2020-11-12T17:28:24.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:28:24.006 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.006 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.006 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.007 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.007 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.007 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:28:24.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.007 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:24.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:24.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:28:24.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:28:24.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:28:24.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:28:24.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:28:24.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:28:24.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:28:24.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:28:24.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:28:24.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:28:24.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:28:24.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:28:24.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:28:24.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:28:24.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:28:24.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:28:24.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:28:24.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:28:24.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:28:24.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:28:24.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:28:24.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:28:24.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:28:24.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:28:24.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:28:24.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:28:24.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:28:24.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:28:24.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:28:24.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:28:24.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:28:24.025 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.025 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.025 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.026 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.026 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:24.030 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28303942100001, 2020-11-12T17:28:24.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:28:24.030 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.031 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.031 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.031 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.031 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.031 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:28:24.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.032 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:24.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:24.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:28:24.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:28:24.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:28:24.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:28:24.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:28:24.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:28:24.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:28:24.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:28:24.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:28:24.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:28:24.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:28:24.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:28:24.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:28:24.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:28:24.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:28:24.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:28:24.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:28:24.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:28:24.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:28:24.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:28:24.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:28:24.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:28:24.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:28:24.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:28:24.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:28:24.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:28:24.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:28:24.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:28:24.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:28:24.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:28:24.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:28:24.049 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.049 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.049 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.050 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.050 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:24.050 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28280127400001, 2020-11-12T17:28:24.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:28:24.051 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.051 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.051 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.051 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.051 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.052 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:28:24.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.052 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:24.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:24.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:28:24.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:28:24.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:28:24.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:28:24.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:28:24.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:28:24.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:28:24.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:28:24.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:28:24.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:28:24.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:28:24.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:28:24.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:28:24.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:28:24.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:28:24.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:28:24.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:28:24.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:28:24.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:28:24.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:28:24.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:28:24.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:28:24.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:28:24.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:28:24.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:28:24.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:28:24.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:28:24.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:28:24.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:28:24.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:28:24.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:28:24.069 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.069 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.069 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.070 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.070 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:24.070 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28259923399997, 2020-11-12T17:28:24.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:28:24.071 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.071 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.071 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.071 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.071 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.072 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:28:24.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.072 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:24.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:24.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:28:24.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:28:24.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:28:24.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:28:24.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:28:24.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:28:24.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:28:24.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:28:24.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:28:24.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:28:24.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:28:24.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:28:24.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:28:24.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:28:24.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:28:24.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:28:24.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:28:24.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:28:24.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:28:24.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:28:24.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:28:24.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:28:24.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:28:24.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:28:24.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:28:24.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:28:24.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:28:24.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:28:24.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:28:24.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:28:24.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:28:24.091 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.091 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.091 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.092 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.092 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:24.092 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28239386400003, 2020-11-12T17:28:24.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:28:24.093 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.093 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.093 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.093 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.093 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.093 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:28:24.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.094 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:24.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:24.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:24.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:28:24.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:28:24.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:28:24.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:28:24.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:28:24.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:28:24.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:28:24.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:28:24.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:28:24.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:28:24.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:28:24.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:28:24.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:28:24.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:28:24.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:28:24.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:28:24.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:28:24.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:28:24.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:28:24.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:28:24.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:28:24.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:28:24.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:28:24.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:28:24.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:28:24.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:28:24.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:28:24.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:28:24.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:28:24.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:28:24.115 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.115 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.115 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.116 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.116 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:24.116 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28220803699998, 2020-11-12T17:28:24.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:28:24.116 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.117 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.117 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.117 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.117 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.117 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:28:24.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.118 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:24.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:24.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:24.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:28:24.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:28:24.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:28:24.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:28:24.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:28:24.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:28:24.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:28:24.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:28:24.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:28:24.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:28:24.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:28:24.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:28:24.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:28:24.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:28:24.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:28:24.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:28:24.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:28:24.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:28:24.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:28:24.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:28:24.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:28:24.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:28:24.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:28:24.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:28:24.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:28:24.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:28:24.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:28:24.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:28:24.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:28:24.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:28:24.138 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.138 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.138 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.139 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.139 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:24.139 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28201107299998, 2020-11-12T17:28:24.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:28:24.139 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.139 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.140 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.140 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.140 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.140 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:28:24.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.140 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:24.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:24.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:28:24.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:28:24.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:28:24.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:28:24.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:28:24.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:28:24.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:28:24.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:28:24.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:28:24.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:28:24.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:28:24.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:28:24.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:28:24.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:28:24.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:28:24.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:28:24.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:28:24.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:28:24.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:28:24.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:28:24.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:28:24.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:28:24.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:28:24.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:28:24.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:28:24.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:28:24.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:28:24.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:28:24.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:28:24.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:28:24.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:28:24.156 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.156 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.156 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.157 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.157 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:24.158 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28181504299999, 2020-11-12T17:28:24.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:28:24.158 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.158 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.158 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.159 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.159 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.159 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:28:24.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.159 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:24.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:24.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:24.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:28:24.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:28:24.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:28:24.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:28:24.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:28:24.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:28:24.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:28:24.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:28:24.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:28:24.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:28:24.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:28:24.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:28:24.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:28:24.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:28:24.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:28:24.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:28:24.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:28:24.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:28:24.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:28:24.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:28:24.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:28:24.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:28:24.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:28:24.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:28:24.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:28:24.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:28:24.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:28:24.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:28:24.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:28:24.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:28:24.174 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.175 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.175 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.175 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.175 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:24.176 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28163424299998, 2020-11-12T17:28:24.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:28:24.176 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.176 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.176 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.176 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.177 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.177 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:28:24.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.177 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:24.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:24.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:28:24.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:28:24.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:28:24.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:28:24.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:28:24.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:28:24.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:28:24.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:28:24.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:28:24.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:28:24.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:28:24.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:28:24.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:28:24.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:28:24.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:28:24.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:28:24.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:28:24.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:28:24.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:28:24.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:28:24.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:28:24.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:28:24.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:28:24.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:28:24.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:28:24.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:28:24.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:28:24.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:28:24.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:28:24.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:28:24.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:28:24.192 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.192 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.192 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.193 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.193 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:24.193 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28143828999998, 2020-11-12T17:28:24.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:28:24.193 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.193 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.194 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.194 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.194 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.195 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:28:24.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.195 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:24.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:24.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:24.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:28:24.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:28:24.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:28:24.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:28:24.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:28:24.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:28:24.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:28:24.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:28:24.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:28:24.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:28:24.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:28:24.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:28:24.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:28:24.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:28:24.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:28:24.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:28:24.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:28:24.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:28:24.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:28:24.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:28:24.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:28:24.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:28:24.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:28:24.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:28:24.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:28:24.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:28:24.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:28:24.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:28:24.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:28:24.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:28:24.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.210 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.210 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.211 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.211 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:24.211 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28124468200002, 2020-11-12T17:28:24.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:28:24.211 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.211 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.212 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.212 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.212 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.212 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:28:24.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.212 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:24.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:24.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:28:24.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:28:24.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:28:24.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:28:24.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:28:24.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:28:24.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:28:24.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:28:24.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:28:24.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:28:24.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:28:24.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:28:24.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:28:24.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:28:24.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:28:24.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:28:24.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:28:24.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:28:24.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:28:24.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:28:24.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:28:24.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:28:24.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:28:24.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:28:24.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:28:24.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:28:24.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:28:24.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:28:24.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:28:24.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:28:24.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:28:24.227 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.228 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.228 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.228 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.228 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:24.229 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28093281899999, 2020-11-12T17:28:24.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:28:24.229 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.229 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.229 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.229 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.229 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.230 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:28:24.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.230 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:24.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:24.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:28:24.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:28:24.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:28:24.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:28:24.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:28:24.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:28:24.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:28:24.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:28:24.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:28:24.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:28:24.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:28:24.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:28:24.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:28:24.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:28:24.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:28:24.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:28:24.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:28:24.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:28:24.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:28:24.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:28:24.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:28:24.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:28:24.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:28:24.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:28:24.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:28:24.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:28:24.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:28:24.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:28:24.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:28:24.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:28:24.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:28:24.247 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.247 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.247 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.248 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.248 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:24.248 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.280645322, 2020-11-12T17:28:24.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:28:24.249 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.249 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.249 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.249 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.249 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.249 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:28:24.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.250 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:24.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:24.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:28:24.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:28:24.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:28:24.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:28:24.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:28:24.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:28:24.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:28:24.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:28:24.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:28:24.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:28:24.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:28:24.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:28:24.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:28:24.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:28:24.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:28:24.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:28:24.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:28:24.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:28:24.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:28:24.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:28:24.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:28:24.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:28:24.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:28:24.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:28:24.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:28:24.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:28:24.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:28:24.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:28:24.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:28:24.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:28:24.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:28:24.266 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.266 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.266 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.266 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:24.267 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:24.267 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 304.28042495099999, 2020-11-12T17:28:24.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:28:24.267 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.267 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.267 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.268 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.268 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.268 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:28:24.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.268 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:24.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:24.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:28:24.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:28:24.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:28:24.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:28:24.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:28:24.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:28:24.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:28:24.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:28:24.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:28:24.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:28:24.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:28:24.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:24.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:28:24.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:28:24.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:28:24.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:28:24.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:24.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:28:24.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:28:24.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:28:24.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:28:24.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:28:24.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:28:24.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:24.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:28:24.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:28:24.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:28:24.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:28:24.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:28:24.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:28:24.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:28:24.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:28:24.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:28:24.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:28:24.282 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.282 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.282 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.283 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:28:24.283 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:24.283 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 142.37084596099999, 2020-11-12T17:28:24.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:28:24.283 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.284 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.284 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:24.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:24.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:28:24.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:28:24.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:28:24.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:28:24.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:28:24.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:28:24.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:28:24.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:28:24.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:28:24.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:28:24.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:28:24.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:28:24.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:28:24.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:28:24.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:28:24.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:28:24.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:28:24.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.293 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.294 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:28:24.294 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:24.294 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 80.296470201000005, 2020-11-12T17:28:24.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:28:24.294 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.294 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.295 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.295 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:24.295 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:24.295 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:28:24.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.296 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:24.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:24.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:24.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:28:24.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:28:24.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:28:24.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:28:24.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:28:24.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:28:24.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:28:24.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:28:24.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:28:24.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:28:24.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:28:24.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:28:24.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:24.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:28:24.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:28:24.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:28:24.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:28:24.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:28:24.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:28:24.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:28:24.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:28:24.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:28:24.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:28:24.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.307 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.307 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.308 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:28:24.308 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:24.308 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.526043833999999, 2020-11-12T17:28:24.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:28:24.308 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.309 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:24.309 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:24.309 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:28:24.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.310 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:24.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:24.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:28:24.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:28:24.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:28:24.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:28:24.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:28:24.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:28:24.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:28:24.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:28:24.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:28:24.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:28:24.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:28:24.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:28:24.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:28:24.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:24.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:28:24.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:28:24.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:28:24.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:28:24.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:28:24.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:28:24.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:28:24.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:28:24.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:28:24.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:28:24.321 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.321 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.321 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.322 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:28:24.322 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:24.322 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.517946801000001, 2020-11-12T17:28:24.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:28:24.322 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.322 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:24.323 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:24.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:24.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:28:24.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:28:24.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:28:24.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:28:24.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:28:24.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:28:24.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:28:24.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:28:24.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:28:24.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:28:24.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:28:24.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:28:24.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:28:24.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:28:24.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:28:24.330 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.331 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.331 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.331 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.331 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.331 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:24.332 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:24.333 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:24.046+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:24.334 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:24.140+0000 7fc24d2e3700 -1 osd.3 184 handle_osd_map injecting map crc failure 2020-11-12T17:28:24.334 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:24.330+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:24.380 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:24.378+0000 7f280e6c1700 -1 osd.6 184 handle_osd_map injecting map crc failure 2020-11-12T17:28:24.383 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:28:24.435 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:24.434+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:24.482 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:24.482 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:24.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.483 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:74508 5.d e185/127 5:bbbac5cc:::benchmark_data_smithi036_24110_object6618:head v 185'4579, mlcod=185'4577)", 2020-11-12T17:28:24.483 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:24.482947+0000", 2020-11-12T17:28:24.483 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0011146039999999999, 2020-11-12T17:28:24.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001140781, 2020-11-12T17:28:24.483 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.483 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:24.483 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.482947+0000", 2020-11-12T17:28:24.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.482947+0000", 2020-11-12T17:28:24.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999757 2020-11-12T17:28:24.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.482923+0000", 2020-11-12T17:28:24.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7398999999999994e-05 2020-11-12T17:28:24.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.483010+0000", 2020-11-12T17:28:24.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9623000000000003e-05 2020-11-12T17:28:24.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.483050+0000", 2020-11-12T17:28:24.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5129999999999996e-06 2020-11-12T17:28:24.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.483058+0000", 2020-11-12T17:28:24.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112341 2020-11-12T17:28:24.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.483171+0000", 2020-11-12T17:28:24.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0694000000000001e-05 2020-11-12T17:28:24.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.483202+0000", 2020-11-12T17:28:24.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025426499999999999 2020-11-12T17:28:24.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.489 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.489 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:28:24.489 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:28:24.490 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:24.496 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:24.536 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:24.532+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:24.637 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:24.632+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:24.683 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:24.683 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:24.684 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:24.684 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:24.684 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:24.700 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:24.737 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:24.732+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:24.794 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:24.839 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:24.838+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:24.841 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:24.842 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:24.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:24.842 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:24.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.843 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:28:24.843 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:24.843 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 315.99942581400001, 2020-11-12T17:28:24.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:28:24.843 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.843 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:24.843 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:24.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:24.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:24.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:28:24.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:28:24.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:28:24.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:28:24.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:28:24.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:28:24.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:28:24.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:28:24.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:28:24.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:28:24.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:28:24.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:28:24.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:28:24.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:28:24.849 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.850 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.850 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:24.850 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:24.850 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 310.43922859200001, 2020-11-12T17:28:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:28:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.851 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:28:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:24.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:28:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:28:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:28:24.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:28:24.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:28:24.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:28:24.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:28:24.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:28:24.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:28:24.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:28:24.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:28:24.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:28:24.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:24.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:28:24.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:28:24.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:28:24.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:28:24.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:28:24.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:28:24.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:28:24.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:28:24.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:28:24.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:28:24.862 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.862 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.862 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.862 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:28:24.862 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:24.862 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 310.43333626899999, 2020-11-12T17:28:24.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:28:24.863 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.863 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:24.863 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:24.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:24.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:28:24.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:28:24.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:28:24.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:28:24.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:28:24.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:28:24.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:28:24.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:28:24.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:28:24.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:28:24.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:28:24.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:28:24.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:28:24.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:28:24.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:28:24.869 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.869 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.870 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.870 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:28:24.870 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:24.870 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 280.30734600099998, 2020-11-12T17:28:24.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:28:24.871 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.871 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.871 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.871 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.871 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.871 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:28:24.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.872 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:24.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:24.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:24.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:28:24.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:28:24.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:28:24.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:28:24.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:28:24.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:28:24.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:28:24.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:28:24.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:28:24.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:28:24.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:28:24.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:28:24.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:24.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:28:24.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:28:24.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:28:24.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:28:24.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:28:24.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:28:24.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:28:24.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:28:24.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:28:24.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:28:24.880 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.881 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.881 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.881 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:28:24.881 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:24.881 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 280.30004228199999, 2020-11-12T17:28:24.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:28:24.882 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.882 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:24.882 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:24.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:24.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:28:24.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:28:24.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:28:24.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:28:24.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:28:24.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:28:24.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:28:24.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:28:24.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:28:24.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:28:24.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:28:24.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:28:24.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:28:24.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:28:24.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:28:24.888 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.888 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.888 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.889 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:28:24.889 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:24.889 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 279.92646378900002, 2020-11-12T17:28:24.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:28:24.889 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.889 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.890 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:28:24.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.890 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:24.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:24.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:24.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:28:24.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:28:24.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:28:24.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:28:24.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:28:24.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:28:24.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:28:24.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:28:24.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:28:24.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:28:24.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:28:24.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:28:24.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:24.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:28:24.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:28:24.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:28:24.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:28:24.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:28:24.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:28:24.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:28:24.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:28:24.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:28:24.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:28:24.899 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.900 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.900 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.900 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:28:24.900 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:24.900 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 279.91491066899999, 2020-11-12T17:28:24.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:28:24.901 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.901 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:24.901 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:24.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:24.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:24.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:28:24.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:28:24.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:28:24.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:28:24.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:28:24.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:28:24.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:28:24.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:28:24.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:28:24.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:28:24.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:28:24.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:28:24.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:28:24.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:28:24.907 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.907 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.907 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.908 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:28:24.908 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:24.908 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 274.84179048800002, 2020-11-12T17:28:24.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:28:24.908 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.909 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.909 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.909 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:24.909 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:24.909 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:28:24.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.909 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:24.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:24.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:28:24.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:28:24.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:28:24.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:28:24.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:28:24.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:28:24.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:28:24.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:28:24.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:28:24.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:28:24.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:28:24.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:28:24.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:28:24.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:24.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:28:24.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:28:24.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:28:24.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:28:24.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:28:24.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:28:24.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:28:24.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:28:24.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:28:24.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:28:24.918 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.919 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.919 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.919 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:28:24.919 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:24.919 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 168.13096609499999, 2020-11-12T17:28:24.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:28:24.920 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.920 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.920 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:24.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:24.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:24.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:28:24.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:28:24.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:28:24.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:28:24.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:28:24.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:28:24.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:28:24.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:28:24.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:28:24.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:28:24.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:28:24.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:28:24.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:28:24.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:28:24.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:28:24.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:28:24.927 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.927 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.927 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.928 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:28:24.928 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:24.928 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.80202356999999, 2020-11-12T17:28:24.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:28:24.928 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.928 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.928 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:24.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:24.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:28:24.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:28:24.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:28:24.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:28:24.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:28:24.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:28:24.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:28:24.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:28:24.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:28:24.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:28:24.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:28:24.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:28:24.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:28:24.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:28:24.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:28:24.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:28:24.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:28:24.935 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.935 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.935 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.936 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:28:24.936 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:24.936 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.207515712, 2020-11-12T17:28:24.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:28:24.936 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.937 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.937 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:24.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:24.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:28:24.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:28:24.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:28:24.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:28:24.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:28:24.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:28:24.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:28:24.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:28:24.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:28:24.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:28:24.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:28:24.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:28:24.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:28:24.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:28:24.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:28:24.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:28:24.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:28:24.944 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.944 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.944 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.945 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:28:24.945 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:24.945 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.00544058400001, 2020-11-12T17:28:24.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:28:24.946 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.946 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.946 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:24.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:24.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:24.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:28:24.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:28:24.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:28:24.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:28:24.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:28:24.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:28:24.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:28:24.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:28:24.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:28:24.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:28:24.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:28:24.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:28:24.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:28:24.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:28:24.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:28:24.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:28:24.954 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.954 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.954 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.954 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:28:24.955 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:24.955 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 131.96339818300001, 2020-11-12T17:28:24.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:28:24.955 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.955 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.955 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:24.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:24.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:28:24.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:28:24.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:28:24.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:28:24.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:28:24.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:28:24.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:28:24.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:28:24.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:28:24.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:28:24.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:28:24.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:28:24.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:28:24.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:28:24.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:28:24.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:28:24.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:28:24.963 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.963 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.964 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.964 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:28:24.964 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:24.964 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 87.881597298000003, 2020-11-12T17:28:24.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:28:24.965 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.965 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.965 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:24.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:24.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:24.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:28:24.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:28:24.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:28:24.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:28:24.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:28:24.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:28:24.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:28:24.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:28:24.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:28:24.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:28:24.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:28:24.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:28:24.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:28:24.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:28:24.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:28:24.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:28:24.973 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.973 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.973 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.974 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:25824 5.9 5:939cc28b:::benchmark_data_smithi036_24110_object3227:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:28:24.974 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:24.974 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 71.375443406000002, 2020-11-12T17:28:24.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998, 2020-11-12T17:28:24.974 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.974 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.975 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.975 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:24.975 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:24.975 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25824 2020-11-12T17:28:24.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.975 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:24.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:24.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:28:24.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466401+0000", 2020-11-12T17:28:24.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3675000000000001e-05 2020-11-12T17:28:24.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466485+0000", 2020-11-12T17:28:24.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0393e-05 2020-11-12T17:28:24.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466495+0000", 2020-11-12T17:28:24.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1100000000000002e-06 2020-11-12T17:28:24.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466500+0000", 2020-11-12T17:28:24.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034414860000000001 2020-11-12T17:28:24.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.469942+0000", 2020-11-12T17:28:24.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8772999999999999e-05 2020-11-12T17:28:24.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470021+0000", 2020-11-12T17:28:24.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015431599999999999 2020-11-12T17:28:24.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:24.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470175+0000", 2020-11-12T17:28:24.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001516643 2020-11-12T17:28:24.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.471692+0000", 2020-11-12T17:28:24.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36737703500000002 2020-11-12T17:28:24.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839069+0000", 2020-11-12T17:28:24.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2213000000000006e-05 2020-11-12T17:28:24.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839161+0000", 2020-11-12T17:28:24.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8376999999999999e-05 2020-11-12T17:28:24.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839239+0000", 2020-11-12T17:28:24.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998 2020-11-12T17:28:24.986 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.986 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.986 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.986 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:28:24.987 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:24.987 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 65.622527320000003, 2020-11-12T17:28:24.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:28:24.988 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.988 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:24.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:24.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:24.988 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:24.989 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:28:24.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.989 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:24.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:24.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:24.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:24.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:24.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:24.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:24.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:24.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:28:24.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:28:24.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:24.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:28:24.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:28:24.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:24.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:28:24.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:24.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:24.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:28:24.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:28:24.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:24.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:28:24.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:28:24.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:24.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:28:24.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:28:24.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:24.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:28:24.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:28:24.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:24.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:28:24.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:28:24.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:24.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:28:24.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:28:24.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:24.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:28:24.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:28:24.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:24.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:28:24.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:28:24.998 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.998 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:24.998 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:24.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:24.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:24.999 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:28:24.999 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:24.999 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 65.612702819000006, 2020-11-12T17:28:24.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:28:24.999 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:24.999 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:24.999 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:25.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:25.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:25.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:25.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:25.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:25.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:25.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:25.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:28:25.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:28:25.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:25.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:28:25.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:28:25.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:25.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:28:25.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:28:25.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:25.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:28:25.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:28:25.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:25.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:28:25.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:28:25.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:25.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:28:25.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:28:25.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:25.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:28:25.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:28:25.005 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:25.005 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:25.006 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:25.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.006 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:28:25.006 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:25.006 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.267446987, 2020-11-12T17:28:25.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:28:25.007 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:25.007 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:25.007 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:25.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:25.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:25.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:25.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:25.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:25.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:25.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:25.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:28:25.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:28:25.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:25.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:28:25.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:28:25.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:25.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:28:25.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:28:25.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:25.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:28:25.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:28:25.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:25.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:28:25.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:28:25.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:25.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:28:25.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:28:25.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:25.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:28:25.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:28:25.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:25.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:28:25.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:28:25.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:25.014 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:25.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:25.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.014 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:28:25.015 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:25.015 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 23.945770073999999, 2020-11-12T17:28:25.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:28:25.015 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:25.015 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:25.015 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:25.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:25.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:25.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:25.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:25.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:25.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:28:25.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:25.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:28:25.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:28:25.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:25.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:28:25.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:28:25.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:25.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:28:25.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:28:25.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:25.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:28:25.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:28:25.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:25.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:28:25.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:28:25.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:25.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:28:25.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:28:25.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:25.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:28:25.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:28:25.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:25.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:28:25.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:28:25.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:25.022 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:25.022 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:25.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.023 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:28:25.023 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:25.023 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.864248207999999, 2020-11-12T17:28:25.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:28:25.023 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:25.023 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:25.023 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:25.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:25.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:25.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:25.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:25.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:25.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:25.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:25.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:28:25.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:28:25.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:25.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:28:25.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:28:25.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:25.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:28:25.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:28:25.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:25.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:28:25.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:28:25.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:25.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:28:25.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:28:25.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:25.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:28:25.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:28:25.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:25.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:28:25.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:28:25.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:25.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:25.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:25.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:28:25.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:28:25.030 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:25.030 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:25.031 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:25.031 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:25.031 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:25.031 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:25.032 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:25.032 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:25.033 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:28:25.034 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:25.028+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:25.063 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:25.111 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:25.133 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:25.130+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:25.154 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:25.172 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:25.172 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:25.188 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:28:25.191 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:25.229 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:25.440 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:25.441 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:25.441 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:25.441 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:25.441 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:25.442 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:25.442 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:25.442 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:25.442 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:25.442 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:25.443 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:25.443 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:25.438+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:25.443 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:28:25.548 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:25.540+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:25.631 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:25.631 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:25.644 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:25.640+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:25.644 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:28:25.747 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:25.740+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:25.819 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:25.819 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:25.831 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:28:25.875 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:25.872+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:25.948 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:25.946+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:26.009 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:26.009 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:26.023 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:28:26.071 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:26.068+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:26.150 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:26.144+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:26.170 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:26.170 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:26.184 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:28:26.297 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:26.288+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:26.351 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:26.348+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:26.381 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:26.382 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:26.394 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:28:26.414 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:28:26.452 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:26.450+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:26.553 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:26.554 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:26.554 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:26.548+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:26.568 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:28:26.632 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 0] out_osds: [1] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:26.632 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:26.633 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.000000 2020-11-12T17:28:26.633 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd primary-affinity 4 0 2020-11-12T17:28:26.656 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:26.654+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:26.722 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:26.723 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:26.732 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:28:26.782 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:26.780+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:26.836 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:26.837 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:26.846 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:28:26.858 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:26.854+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:26.966 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:26.962+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:27.015 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:27.061 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:27.064 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:28:27.069 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:27.066+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:27.169 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:27.164+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:27.180 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:28:27.180 INFO:teuthology.orchestra.run.smithi036.stderr:set osd.4 primary-affinity to 0 (802) 2020-11-12T17:28:27.182 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:27.183 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:27.195 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:27.270 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:27.264+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:27.307 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:27.308 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:27.317 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:27.369 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Removed 8486 objects 2020-11-12T17:28:27.370 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Clean up completed and total clean up time :9.79439 2020-11-12T17:28:27.372 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:27.368+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:27.425 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:27.483 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:27.484 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:27.486 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:27.487 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:27.480+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:27.587 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:27.584+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:27.594 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:27.595 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:27.603 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:27.654 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:27.684 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:27.687 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:27.686+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:27.713 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:27.713 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:27.714 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:27.722 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:27.741 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:27.770 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:27.789 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:27.784+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:27.801 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:27.830 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:27.860 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:27.863 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:27.863 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:27.863 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:27.863 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:27.864 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:27.864 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:27.864 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:27.865 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:27.872 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:27.873 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:27.873 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:27.873 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:27.873 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:27.883 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:27.922 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:27.920+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:27.996 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:27.992+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:28.000 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:28.000 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:28.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:28.000 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:28.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.001 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:28:28.001 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:28.001 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 277.993090569, 2020-11-12T17:28:28.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:28:28.001 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.001 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.001 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:28.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:28.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:28.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:28:28.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:28:28.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:28:28.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:28:28.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:28:28.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:28:28.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:28:28.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:28:28.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:28:28.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:28:28.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:28:28.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:28:28.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:28:28.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:28:28.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:28:28.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:28:28.010 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.011 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.011 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.011 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:28:28.012 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:28.012 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 246.05310522600001, 2020-11-12T17:28:28.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:28:28.012 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.012 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.013 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.013 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:28:28.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.013 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:28.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:28.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:28:28.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:28:28.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:28:28.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:28:28.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:28:28.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:28:28.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:28.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:28:28.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:28:28.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:28:28.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:28:28.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:28:28.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:28:28.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:28.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:28:28.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:28:28.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:28:28.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:28:28.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:28:28.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:28:28.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:28:28.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:28:28.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:28:28.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:28:28.024 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.027 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.027 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.027 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:28:28.027 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:28.028 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 234.576004152, 2020-11-12T17:28:28.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:28:28.028 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.028 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:28.028 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:28.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:28.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:28:28.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:28:28.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:28:28.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:28:28.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:28:28.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:28:28.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:28:28.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:28:28.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:28:28.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:28:28.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:28:28.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:28:28.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:28:28.034 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.034 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.034 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.034 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:28:28.035 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:28.035 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 233.45699376499999, 2020-11-12T17:28:28.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:28:28.035 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.035 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.035 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.035 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.036 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.036 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:28.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.036 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:28.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:28.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:28.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:28:28.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:28:28.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:28:28.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:28:28.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:28:28.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:28:28.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:28:28.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:28:28.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:28:28.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:28:28.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:28:28.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:28:28.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:28.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:28:28.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:28:28.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:28:28.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:28:28.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:28:28.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:28:28.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:28:28.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:28:28.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:28:28.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:28:28.045 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.045 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.045 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.046 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:28:28.046 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:28.046 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 233.44085576099999, 2020-11-12T17:28:28.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:28:28.046 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.046 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:28.046 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:28.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:28.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:28.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:28:28.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:28:28.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:28:28.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:28:28.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:28:28.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:28:28.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:28:28.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:28:28.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:28:28.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:28:28.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:28:28.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:28:28.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:28:28.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:28:28.052 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.053 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.053 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.053 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:28:28.053 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:28.053 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 233.43612808200001, 2020-11-12T17:28:28.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:28:28.054 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.054 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:28.054 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.054 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.054 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.054 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:28.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.055 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:28.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:28.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:28.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:28:28.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:28:28.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:28:28.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:28:28.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:28:28.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:28.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:28:28.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:28:28.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:28:28.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:28:28.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:28.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:28:28.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:28:28.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:28:28.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:28:28.061 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.061 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.061 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.061 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:28.061 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:28.062 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.39236618299999, 2020-11-12T17:28:28.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:28:28.062 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.062 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.062 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.062 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:28.062 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:28.063 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:28:28.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.063 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:28.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:28.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:28.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:28:28.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:28:28.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:28:28.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:28:28.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:28:28.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:28:28.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:28:28.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:28:28.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:28:28.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:28:28.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:28:28.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:28:28.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:28.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:28:28.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:28:28.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:28:28.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:28:28.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:28:28.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:28:28.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:28:28.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:28:28.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:28:28.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:28:28.074 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.074 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.074 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.074 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:28.075 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:28.075 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.39047257, 2020-11-12T17:28:28.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:28:28.075 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.075 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:28.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:28.076 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:28:28.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.076 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:28.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:28.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:28.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:28:28.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:28:28.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:28:28.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:28:28.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:28:28.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:28:28.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:28:28.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:28:28.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:28:28.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:28:28.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:28:28.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:28:28.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:28.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:28:28.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:28:28.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:28:28.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:28:28.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:28:28.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:28:28.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:28:28.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:28:28.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:28:28.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:28:28.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.085 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.085 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:28.085 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:28.086 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.389719922, 2020-11-12T17:28:28.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:28:28.086 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.086 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:28.086 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:28.086 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:28:28.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.087 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:28.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:28.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:28.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:28:28.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:28:28.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:28:28.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:28:28.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:28:28.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:28:28.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:28:28.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:28:28.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:28:28.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:28:28.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:28:28.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:28:28.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:28.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:28:28.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:28:28.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:28:28.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:28:28.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:28:28.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:28:28.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:28:28.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:28:28.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:28:28.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:28:28.095 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.096 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.096 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.096 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:28.096 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:28.096 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.386558405, 2020-11-12T17:28:28.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:28:28.097 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.097 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.097 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.097 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:28.097 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:28.097 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:28:28.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.098 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:28.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:28.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:28.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:28:28.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:28:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:28:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:28:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:28:28.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:28:28.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:28:28.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:28:28.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:28:28.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:28:28.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:28:28.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:28:28.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:28.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:28:28.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:28:28.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:28:28.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:28:28.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:28:28.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:28:28.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:28:28.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:28:28.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:28:28.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:28:28.106 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.106 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.106 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.107 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:28.107 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:28.107 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.38547723799999, 2020-11-12T17:28:28.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:28:28.107 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.108 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:28.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:28.108 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:28:28.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.108 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:28.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:28.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:28.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:28:28.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:28:28.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:28:28.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:28:28.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:28:28.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:28:28.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:28:28.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:28:28.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:28:28.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:28:28.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:28:28.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:28:28.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:28.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:28:28.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:28:28.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:28:28.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:28:28.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:28:28.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:28:28.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:28:28.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:28:28.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:28:28.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:28:28.118 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.118 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.118 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.119 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:28.119 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:28.119 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.385308145, 2020-11-12T17:28:28.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:28:28.119 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.120 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:28.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:28.120 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:28:28.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.120 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:28.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:28.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:28.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:28:28.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:28:28.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:28:28.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:28:28.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:28:28.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:28:28.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:28:28.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:28:28.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:28:28.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:28:28.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:28:28.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:28:28.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:28.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:28:28.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:28:28.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:28:28.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:28:28.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:28:28.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:28:28.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:28:28.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:28:28.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:28:28.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:28:28.129 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.129 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.129 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.130 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:28.130 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:28.130 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.38268949899999, 2020-11-12T17:28:28.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:28:28.130 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.130 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.131 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.131 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:28.131 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:28.131 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:28:28.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.131 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:28.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:28.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:28.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:28:28.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:28:28.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:28:28.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:28:28.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:28:28.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:28:28.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:28:28.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:28:28.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:28:28.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:28:28.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:28:28.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:28:28.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:28.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:28:28.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:28:28.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:28:28.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:28:28.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:28:28.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:28:28.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:28:28.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:28:28.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:28:28.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:28:28.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.141 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.141 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.142 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:28.142 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:28.142 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.38258141599999, 2020-11-12T17:28:28.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:28:28.143 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.143 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:28.143 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:28.143 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:28:28.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.144 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:28.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:28.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:28.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:28:28.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:28:28.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:28:28.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:28:28.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:28:28.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:28:28.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:28:28.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:28:28.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:28:28.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:28:28.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:28:28.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:28:28.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:28.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:28:28.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:28:28.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:28:28.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:28:28.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:28:28.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:28:28.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:28:28.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:28:28.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:28:28.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:28:28.154 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.154 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.154 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.155 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:28:28.155 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:28.155 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 127.378618734, 2020-11-12T17:28:28.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:28:28.155 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.155 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:28.155 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:28.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:28.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:28:28.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:28:28.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:28:28.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:28:28.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:28:28.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:28:28.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:28:28.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:28:28.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:28:28.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:28:28.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:28:28.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:28:28.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:28:28.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:28:28.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:28:28.161 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.162 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.162 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.162 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:28:28.162 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:28.162 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 84.340888992999993, 2020-11-12T17:28:28.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:28:28.163 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.163 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.163 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:28.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:28.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:28.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:28:28.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:28:28.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:28:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:28:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:28:28.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:28:28.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:28:28.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:28:28.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:28:28.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:28:28.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:28:28.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:28:28.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:28:28.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:28:28.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:28:28.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:28:28.171 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.171 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.171 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.172 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:28:28.172 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:28.172 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.827486308000001, 2020-11-12T17:28:28.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:28:28.172 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.173 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:28.173 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:28.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:28.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:28.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:28:28.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:28:28.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:28:28.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:28:28.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:28:28.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:28:28.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:28:28.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:28:28.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:28:28.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:28:28.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:28:28.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:28:28.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:28:28.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:28:28.249 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.249 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.249 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.249 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:28.250 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:28.250 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.491176422999999, 2020-11-12T17:28:28.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:28:28.250 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.251 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.251 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.251 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:28.251 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:28.251 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:28:28.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.252 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:28.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:28.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:28.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:28:28.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:28:28.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:28:28.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:28:28.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:28:28.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:28:28.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:28:28.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:28:28.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:28:28.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:28:28.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:28:28.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:28:28.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:28:28.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:28:28.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:28:28.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:28:28.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:28:28.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:28:28.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:28:28.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:28:28.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:28:28.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:28:28.269 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.270 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.270 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.271 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:28:28.271 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:28.272 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.473568297, 2020-11-12T17:28:28.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:28:28.272 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.272 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:28.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:28:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:28:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:28:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:28:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:28:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:28:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:28:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:28:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:28:28.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:28:28.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:28:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:28:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:28:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:28:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(5.7 184/180 [PushReplyOp(5:e5a77d6d:::benchmark_data_smithi036_24110_object6672:head)])", 2020-11-12T17:28:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 4.0796453750000001, 2020-11-12T17:28:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002, 2020-11-12T17:28:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:28:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918950+0000", 2020-11-12T17:28:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8150999999999999e-05 2020-11-12T17:28:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.919008+0000", 2020-11-12T17:28:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41560975 2020-11-12T17:28:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334617+0000", 2020-11-12T17:28:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5324000000000001e-05 2020-11-12T17:28:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334633+0000", 2020-11-12T17:28:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016332299999999999 2020-11-12T17:28:28.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334796+0000", 2020-11-12T17:28:28.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010469629999999999 2020-11-12T17:28:28.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.335843+0000", 2020-11-12T17:28:28.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002 2020-11-12T17:28:28.292 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.292 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.293 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.293 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.293 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:28.295 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:28.294+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:28.296 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:28.396 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:28.394+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:28.457 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:28.457 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:28.457 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:28:28.457 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:28.464 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:28.507 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:28.506+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:28.598 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:28.596+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:28.615 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:28.615 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:28.615 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:28.616 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:28.616 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:28.624 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:28.699 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:28.698+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:28.729 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:28.730 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:28.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:28.730 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:28.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.730 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:28:28.730 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:28.731 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05925502600002, 2020-11-12T17:28:28.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:28:28.731 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.731 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:28.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.732 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.732 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:28:28.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.732 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:28.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:28.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:28:28.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:28:28.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:28:28.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:28:28.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:28:28.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:28:28.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:28:28.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:28:28.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:28:28.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:28:28.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:28:28.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:28:28.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:28:28.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:28:28.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:28:28.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:28:28.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:28:28.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:28:28.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:28:28.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:28:28.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:28:28.743 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.744 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.744 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.744 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.744 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:28.744 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05885266500002, 2020-11-12T17:28:28.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:28:28.745 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.745 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.745 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.745 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.745 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.745 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:28:28.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.746 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:28.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:28.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:28:28.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:28:28.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:28:28.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:28:28.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:28:28.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:28:28.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:28:28.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.762 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.763 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05852867200002, 2020-11-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.764 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.765 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:28:28.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:28:28.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:28:28.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:28:28.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:28:28.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:28:28.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:28:28.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:28:28.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:28:28.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:28:28.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:28:28.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:28:28.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:28:28.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:28:28.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:28:28.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:28:28.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:28:28.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:28:28.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:28:28.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:28:28.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:28:28.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:28:28.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:28:28.789 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.789 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.789 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.790 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.790 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:28.790 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05828496100003, 2020-11-12T17:28:28.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:28:28.790 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.791 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.791 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.791 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.791 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.791 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:28:28.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.791 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:28.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:28.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:28:28.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:28:28.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:28:28.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:28:28.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:28:28.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:28:28.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:28:28.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:28:28.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:28:28.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:28:28.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:28:28.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:28:28.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:28:28.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:28:28.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:28:28.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:28:28.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:28:28.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:28:28.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:28:28.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:28:28.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:28:28.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:28:28.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:28:28.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:28:28.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:28:28.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:28:28.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:28:28.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:28:28.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:28:28.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:28:28.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:28:28.808 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.809 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.809 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.809 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.809 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:28.809 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05804681400002, 2020-11-12T17:28:28.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:28:28.810 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.810 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.810 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.810 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.810 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.811 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:28:28.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.811 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:28.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:28.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:28:28.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:28:28.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:28:28.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:28:28.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:28:28.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:28:28.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:28:28.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:28:28.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:28:28.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:28:28.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:28:28.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:28:28.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:28:28.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:28:28.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:28:28.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:28:28.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:28:28.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:28:28.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:28:28.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:28:28.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:28:28.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:28:28.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:28:28.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:28:28.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:28:28.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:28:28.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:28:28.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:28:28.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:28:28.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:28:28.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:28:28.823 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.824 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.824 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.824 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.824 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:28.825 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05784477399999, 2020-11-12T17:28:28.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:28:28.825 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.825 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.825 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.825 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.826 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.826 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:28:28.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.826 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:28.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:28.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:28:28.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:28:28.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:28:28.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:28:28.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:28:28.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:28:28.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:28:28.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:28:28.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:28:28.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:28:28.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:28:28.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:28:28.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:28:28.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:28:28.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:28:28.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:28:28.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:28:28.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:28:28.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:28:28.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:28:28.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:28:28.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:28:28.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:28:28.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:28:28.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:28:28.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:28:28.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:28:28.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:28:28.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:28:28.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:28:28.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:28:28.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.839 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.840 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.840 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:28.840 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05763940399999, 2020-11-12T17:28:28.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:28:28.840 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.841 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.841 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.841 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.841 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.841 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:28:28.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.841 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:28.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:28.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:28.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:28:28.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:28:28.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:28:28.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:28:28.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:28:28.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:28:28.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:28:28.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:28:28.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:28:28.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:28:28.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:28:28.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:28:28.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:28:28.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:28:28.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:28:28.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:28:28.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:28:28.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:28:28.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:28:28.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:28:28.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:28:28.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:28:28.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:28:28.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:28:28.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:28:28.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:28:28.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:28:28.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:28:28.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:28:28.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:28:28.858 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.858 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.858 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.859 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.859 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:28.859 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05745357699999, 2020-11-12T17:28:28.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:28:28.867 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.867 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.868 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.868 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.868 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.869 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:28:28.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.869 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:28.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:28.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:28.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:28:28.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:28:28.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:28:28.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:28:28.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:28:28.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:28:28.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:28:28.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:28:28.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:28:28.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:28:28.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:28:28.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:28:28.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:28:28.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:28:28.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:28:28.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:28:28.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:28:28.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:28:28.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:28:28.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:28:28.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:28:28.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:28:28.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:28:28.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:28:28.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:28:28.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:28:28.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:28:28.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:28:28.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:28:28.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:28:28.890 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.891 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.891 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.891 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.891 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:28.891 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05725661299999, 2020-11-12T17:28:28.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:28:28.892 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.892 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.892 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.892 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.892 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.892 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:28:28.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.893 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:28.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:28.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:28:28.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:28:28.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:28:28.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:28:28.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:28:28.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:28:28.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:28:28.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:28:28.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:28:28.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:28:28.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:28:28.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:28:28.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:28:28.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:28:28.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:28:28.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:28:28.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:28:28.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:28:28.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:28:28.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:28:28.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:28:28.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:28:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:28:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:28:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:28:28.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:28:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:28:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:28:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:28:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:28:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:28:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05706058300001, 2020-11-12T17:28:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:28:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:28:28.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.912 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:28:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:28:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:28:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:28:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:28:28.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:28:28.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:28:28.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:28:28.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:28:28.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:28:28.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:28:28.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:28:28.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:28:28.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:28:28.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:28:28.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:28:28.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:28:28.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:28:28.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:28:28.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:28:28.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:28:28.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:28:28.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:28:28.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:28:28.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:28:28.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:28:28.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:28:28.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:28:28.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:28:28.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:28:28.929 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.929 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.930 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.930 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.930 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:28.930 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.056879783, 2020-11-12T17:28:28.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:28:28.931 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.936 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.936 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.937 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.937 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.937 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:28:28.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.937 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:28.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:28.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:28:28.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:28:28.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:28:28.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:28:28.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:28:28.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:28:28.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:28:28.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:28:28.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:28:28.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:28:28.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:28:28.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:28:28.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:28:28.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:28:28.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:28:28.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:28:28.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:28:28.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:28:28.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:28:28.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:28:28.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:28:28.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:28:28.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:28:28.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:28:28.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:28:28.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:28:28.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:28:28.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:28:28.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:28:28.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:28:28.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:28:28.952 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.952 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.952 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.953 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.953 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:28.953 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05668383, 2020-11-12T17:28:28.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:28:28.953 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.953 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.953 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.954 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.954 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.954 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:28:28.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.954 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:28.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:28.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:28.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:28:28.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:28:28.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:28:28.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:28:28.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:28:28.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:28:28.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:28:28.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:28:28.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:28:28.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:28:28.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:28:28.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:28:28.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:28:28.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:28:28.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:28:28.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:28:28.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:28:28.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:28:28.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:28:28.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:28:28.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:28:28.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:28:28.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:28:28.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:28:28.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:28:28.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:28:28.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:28:28.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:28:28.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:28:28.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:28:28.967 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.968 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.968 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.968 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.968 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:28.968 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05649022199998, 2020-11-12T17:28:28.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:28:28.969 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.969 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.969 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.969 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.969 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.969 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:28:28.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.970 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:28.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:28.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:28:28.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:28:28.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:28:28.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:28:28.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:28:28.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:28:28.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:28:28.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:28:28.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:28:28.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:28:28.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:28:28.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:28:28.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:28:28.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:28:28.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:28:28.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:28:28.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:28:28.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:28:28.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:28:28.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:28:28.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:28:28.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:28:28.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:28:28.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:28:28.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:28:28.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:28:28.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:28:28.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:28:28.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:28:28.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:28:28.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:28:28.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.984 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.985 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.985 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:28.985 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.056178359, 2020-11-12T17:28:28.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:28:28.985 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:28.986 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:28.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:28.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:28.987 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:28.987 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:28:28.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.987 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:28.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:28.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:28.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:28.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:28.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:28.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:28:28.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:28.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:28:28.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:28:28.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:28.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:28:28.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:28:28.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:28.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:28:28.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:28:28.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:28.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:28:28.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:28:28.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:28:28.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:28:28.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:28.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:28:28.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:28:28.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:28:28.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:28:28.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:28.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:28:28.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:28:28.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:28.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:28:28.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:28:28.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:28.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:28:28.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:28:28.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:28.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:28:28.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:28:28.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:28.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:28:28.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:28:28.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:28.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:28:28.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:28:28.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:28.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:28:28.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:28:28.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:28.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:28:28.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:28:28.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.999 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:28.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:28.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:28.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:28.999 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:28.999 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:29.000 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.05589086200001, 2020-11-12T17:28:29.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:28:29.000 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.000 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:29.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:29.001 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:28:29.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.001 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:29.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:29.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:28:29.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:28:29.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:28:29.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:28:29.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:28:29.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:28:29.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:28:29.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:28:29.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:28:29.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:28:29.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:28:29.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:29.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:28:29.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:28:29.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:28:29.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:28:29.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:29.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:28:29.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:28:29.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:28:29.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:28:29.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:28:29.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:28:29.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:29.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:28:29.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:28:29.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:28:29.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:28:29.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:28:29.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:28:29.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:28:29.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:28:29.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:28:29.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:28:29.013 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.013 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.014 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:29.014 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:29.014 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.055670491, 2020-11-12T17:28:29.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:28:29.015 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.015 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.015 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.015 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:29.016 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:29.016 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:28:29.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.016 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:29.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:29.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:28:29.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:28:29.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:28:29.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:28:29.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:28:29.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:28:29.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:28:29.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:28:29.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:28:29.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:28:29.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:28:29.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:29.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:28:29.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:28:29.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:28:29.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:28:29.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:29.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:28:29.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:28:29.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:28:29.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:28:29.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:28:29.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:28:29.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:29.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:28:29.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:28:29.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:28:29.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:28:29.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:28:29.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:28:29.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:28:29.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:28:29.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:28:29.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:28:29.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.029 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.030 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.030 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:28:29.030 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:29.030 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 147.146091501, 2020-11-12T17:28:29.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:28:29.031 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.031 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.031 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:29.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:29.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:28:29.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:28:29.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:28:29.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:28:29.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:28:29.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:28:29.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:28:29.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:28:29.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:28:29.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:28:29.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:28:29.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:28:29.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:28:29.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:28:29.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:28:29.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:28:29.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:28:29.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.038 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.038 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.038 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:28:29.038 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:29.039 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.071715741000006, 2020-11-12T17:28:29.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:28:29.039 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.039 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:29.039 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:29.040 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:28:29.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.040 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:29.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:29.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:29.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:28:29.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:28:29.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:28:29.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:28:29.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:28:29.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:28:29.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:28:29.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:28:29.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:28:29.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:28:29.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:28:29.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:28:29.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:29.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:28:29.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:28:29.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:28:29.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:28:29.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:28:29.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:28:29.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:28:29.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:28:29.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:28:29.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:28:29.051 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.051 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.051 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.052 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:28:29.052 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:29.052 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.301289374, 2020-11-12T17:28:29.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:28:29.052 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.052 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.053 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.053 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:29.053 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:29.053 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:28:29.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.053 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:29.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:29.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:28:29.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:28:29.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:28:29.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:28:29.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:28:29.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:28:29.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:28:29.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:28:29.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:28:29.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:28:29.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:28:29.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:28:29.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:28:29.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:29.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:28:29.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:28:29.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:28:29.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:28:29.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:28:29.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:28:29.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:28:29.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:28:29.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:28:29.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:28:29.063 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.063 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.063 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.063 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:28:29.063 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:29.064 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 54.293192341000001, 2020-11-12T17:28:29.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:28:29.064 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.065 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:29.065 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:29.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:29.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:28:29.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:28:29.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:28:29.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:28:29.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:28:29.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:28:29.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:28:29.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:28:29.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:28:29.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:28:29.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:28:29.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:28:29.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:28:29.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:28:29.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:28:29.071 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.071 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.072 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.072 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.072 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.072 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:29.075 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:29.076 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:29.070+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:29.175 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:29.174+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:29.196 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:28:29.239 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:29.239 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:29.240 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:28:29.240 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:29.249 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:29.291 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:29.290+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:29.378 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:29.378+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:29.403 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:29.404 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:29.404 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:29.404 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:29.404 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:29.413 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:29.508 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:29.502+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:29.575 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:29.576 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:29.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:29.576 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:29.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.576 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:28:29.577 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:29.577 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 320.73208187300003, 2020-11-12T17:28:29.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:28:29.577 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.577 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:29.586 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:29.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:29.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:29.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:28:29.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:28:29.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:28:29.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:28:29.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:28:29.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:28:29.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:28:29.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:28:29.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:28:29.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:28:29.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:28:29.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:28:29.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:28:29.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:28:29.605 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.605 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.605 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.606 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:29.606 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:29.606 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 315.17188465100003, 2020-11-12T17:28:29.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:28:29.606 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.606 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.606 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:29.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:29.607 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:28:29.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.607 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:29.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:29.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:29.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:28:29.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:28:29.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:28:29.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:28:29.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:28:29.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:28:29.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:28:29.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:28:29.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:28:29.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:28:29.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:28:29.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:28:29.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:29.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:28:29.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:28:29.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:28:29.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:28:29.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:28:29.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:28:29.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:28:29.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:28:29.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:28:29.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:28:29.621 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.622 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.623 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:28:29.623 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:29.623 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 315.16599232800002, 2020-11-12T17:28:29.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:28:29.624 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.624 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:29.624 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:29.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:29.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:28:29.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:28:29.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:28:29.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:28:29.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:28:29.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:28:29.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:28:29.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:28:29.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:28:29.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:28:29.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:28:29.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:28:29.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:28:29.635 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.636 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.636 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:28:29.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:28:29.636 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.636 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.636 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.637 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:28:29.637 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:29.637 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 285.04000206000001, 2020-11-12T17:28:29.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:28:29.637 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.638 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.638 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.638 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:29.638 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:29.638 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:28:29.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.639 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:29.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:29.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:29.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:28:29.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:28:29.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:28:29.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:28:29.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:28:29.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:28:29.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:28:29.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:28:29.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:28:29.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:28:29.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:28:29.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:28:29.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:29.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:28:29.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:28:29.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:28:29.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:28:29.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:28:29.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:28:29.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:28:29.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:28:29.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:28:29.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:28:29.651 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.651 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.651 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.651 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:28:29.651 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:29.652 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 285.03269834100001, 2020-11-12T17:28:29.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:28:29.652 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.652 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:29.652 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:29.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:29.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:28:29.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:28:29.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:28:29.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:28:29.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:28:29.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:28:29.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:28:29.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:28:29.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:28:29.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:28:29.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:28:29.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:28:29.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:28:29.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:28:29.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:28:29.660 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.660 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.660 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.660 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:28:29.660 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:29.661 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 284.65911984799999, 2020-11-12T17:28:29.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:28:29.661 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.661 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:29.661 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:29.661 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:28:29.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.662 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:29.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:29.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:29.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:28:29.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:28:29.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:28:29.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:28:29.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:28:29.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:28:29.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:28:29.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:28:29.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:28:29.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:28:29.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:28:29.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:28:29.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:29.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:28:29.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:28:29.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:28:29.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:28:29.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:28:29.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:28:29.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:28:29.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:28:29.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:28:29.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:28:29.670 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.671 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.671 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.671 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:28:29.671 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:29.671 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 284.64756672800002, 2020-11-12T17:28:29.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:28:29.672 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.672 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:29.672 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:29.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:29.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:29.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:28:29.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:28:29.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:28:29.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:28:29.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:28:29.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:28:29.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:28:29.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:28:29.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:28:29.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:28:29.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:28:29.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:28:29.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:28:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:28:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:28:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 279.57444654699998, 2020-11-12T17:28:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:28:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.679 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:28:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:28:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:28:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:28:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:28:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:28:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:28:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:28:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:28:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:28:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:28:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:28:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:28:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:28:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:28:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:28:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:28:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:28:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:28:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:28:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:28:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:28:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:28:29.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:28:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:28:29.689 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:29.690 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 172.86362215400001, 2020-11-12T17:28:29.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:28:29.690 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.690 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.690 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:29.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:29.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:29.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:28:29.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:28:29.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:28:29.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:28:29.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:28:29.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:28:29.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:28:29.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:28:29.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:28:29.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:28:29.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:28:29.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:28:29.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:28:29.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:28:29.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:28:29.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:28:29.697 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.697 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.697 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:28:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 167.53467962900001, 2020-11-12T17:28:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:28:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.698 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:28:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:28:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:28:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:28:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:28:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:28:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:28:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:28:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:28:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:28:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:28:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:28:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:28:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:28:29.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:28:29.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:28:29.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:28:29.705 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.705 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:28:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 152.940171771, 2020-11-12T17:28:29.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:28:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:28:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:28:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:28:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:28:29.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:28:29.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:28:29.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:28:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:28:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:28:29.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:28:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:28:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:28:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:28:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:28:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:28:29.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:28:29.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:28:29.714 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.714 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.714 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.715 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:28:29.715 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:29.715 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.73809664300001, 2020-11-12T17:28:29.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:28:29.715 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.715 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.716 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:29.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:29.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:29.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:28:29.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:28:29.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:28:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:28:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:28:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:28:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:28:29.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:28:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:28:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:28:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:28:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:28:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:28:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:28:29.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:28:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:28:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.722 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.723 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:28:29.723 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:29.723 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 136.696054242, 2020-11-12T17:28:29.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:28:29.723 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:28:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:28:29.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:28:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:28:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:28:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:28:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:28:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:28:29.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:28:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:28:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:28:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:28:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:28:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:28:29.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:28:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:28:29.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:28:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:28:29.731 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 92.614253356999996, 2020-11-12T17:28:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:28:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:29.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:28:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:28:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:28:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:28:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:28:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:28:29.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:28:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:28:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:28:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:28:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:28:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:28:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:28:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:28:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:28:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:28:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.739 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:25824 5.9 5:939cc28b:::benchmark_data_smithi036_24110_object3227:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:28:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 76.108099464999995, 2020-11-12T17:28:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998, 2020-11-12T17:28:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:29.740 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25824 2020-11-12T17:28:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:28:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466401+0000", 2020-11-12T17:28:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3675000000000001e-05 2020-11-12T17:28:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466485+0000", 2020-11-12T17:28:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0393e-05 2020-11-12T17:28:29.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466495+0000", 2020-11-12T17:28:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1100000000000002e-06 2020-11-12T17:28:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466500+0000", 2020-11-12T17:28:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034414860000000001 2020-11-12T17:28:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.469942+0000", 2020-11-12T17:28:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8772999999999999e-05 2020-11-12T17:28:29.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470021+0000", 2020-11-12T17:28:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015431599999999999 2020-11-12T17:28:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470175+0000", 2020-11-12T17:28:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001516643 2020-11-12T17:28:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.471692+0000", 2020-11-12T17:28:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36737703500000002 2020-11-12T17:28:29.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839069+0000", 2020-11-12T17:28:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2213000000000006e-05 2020-11-12T17:28:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839161+0000", 2020-11-12T17:28:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8376999999999999e-05 2020-11-12T17:28:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839239+0000", 2020-11-12T17:28:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998 2020-11-12T17:28:29.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:28:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:29.750 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 70.355183378999996, 2020-11-12T17:28:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:28:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:28:29.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:28:29.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:28:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:28:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:28:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:28:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:28:29.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:28:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:28:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:28:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:28:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:28:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:28:29.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:28:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:28:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:28:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:28:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:28:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:28:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:28:29.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:28:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:28:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.760 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:28:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 70.345358877999999, 2020-11-12T17:28:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:28:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.761 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:28:29.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:28:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:28:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:28:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:28:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:28:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:28:29.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:28:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:28:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:28:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:28:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:28:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:28:29.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:28:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:28:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:29.768 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 30.000103046, 2020-11-12T17:28:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:28:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:29.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:28:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:28:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:28:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:28:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:28:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:28:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:28:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:28:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:28:29.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:28:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:28:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:28:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:28:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:28:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:28:29.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:28:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:28:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:29.776 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 28.678426132999999, 2020-11-12T17:28:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:28:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:28:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:28:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:28:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:28:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:28:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:28:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:28:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:28:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:28:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:28:29.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:28:29.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:28:29.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:28:29.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:28:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:28:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:28:29.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:28:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:28:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:29.784 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 16.596904266999999, 2020-11-12T17:28:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:28:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:29.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:28:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:28:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:28:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:28:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:28:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:28:29.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:28:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:28:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:29.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:28:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:28:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:28:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:28:29.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:28:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:28:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:29.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:28:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:28:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:29.792 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:29.792 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:29.794 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:28:29.795 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:29.792+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:29.877 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:29.895 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:29.894+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:29.913 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:29.913 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:29.913 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:28:29.914 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:29.923 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:28:30.016 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:30.012+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:30.253 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:30.253 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:30.253 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:30.253 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:30.253 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:30.254 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:30.254 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:30.254 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:30.254 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:30.254 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:30.255 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:28:30.255 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:30.255 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:30.255 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:30.255 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:30.255 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:30.256 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:30.256 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:30.256 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:30.256 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:30.250+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:30.257 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:28:30.353 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:30.350+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:30.415 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:30.573 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:30.575 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:28:30.576 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:30.572+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:30.676 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:30.672+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:30.683 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:30.682+0000 7f928515c700 -1 osd.7 187 handle_osd_map injecting map crc failure 2020-11-12T17:28:30.739 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:30.739 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:30.749 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:28:30.777 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:30.778+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:30.878 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:30.874+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:30.904 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:30.904 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:30.914 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:28:30.981 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:30.982+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:31.019 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:31.029 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:31.034 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:28:31.131 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:31.128+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:31.181 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:31.182 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:31.183 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:31.178+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:31.191 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:28:31.283 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:31.282+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:31.343 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:31.343 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:31.352 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:28:31.384 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:31.382+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:31.466 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:31.467 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:31.477 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:28:31.526 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:31.524+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:31.586 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:31.582+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:31.591 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:31.591 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:31.601 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:28:31.687 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:31.686+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:31.753 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:31.753 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:31.763 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:28:31.811 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:31.808+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:31.873 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:31.873 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:31.883 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:31.926 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:31.924+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:31.990 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:31.986+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:32.001 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:32.002 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:32.011 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:32.104 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:32.100+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:32.169 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:32.179 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:32.180 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:32.195 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 0] out_osds: [1] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:32.195 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:32.196 INFO:tasks.thrashosds.thrasher:Adding osd 1 2020-11-12T17:28:32.196 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd in 1 2020-11-12T17:28:32.212 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:32.208+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:32.257 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:32.259 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:28:32.290 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:32.291 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:32.300 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:32.322 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:32.320+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:32.400 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2020-11-12T17:28:32.402 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2020-11-12T17:28:32.404 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:32.400+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:32.405 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:32.405 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:32.414 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:32.453 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:32.489 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:32.505 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:32.502+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:32.509 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:32.519 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:32.519 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:32.528 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:32.534 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:32.561 INFO:tasks.ceph.mon.a.smithi036.stderr:2020-11-12T17:28:32.556+0000 7f4952786700 -1 mon.a@0(leader).osd e188 definitely_dead 0 2020-11-12T17:28:32.567 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:32.598 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:32.609 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:32.604+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:32.626 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:32.656 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:32.658 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:32.658 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:32.658 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:32.658 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:32.659 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:32.659 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:32.659 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:32.659 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:32.684 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:32.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:28:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 282.67891573100002, 2020-11-12T17:28:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:28:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.685 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:28:32.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:28:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:28:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:28:32.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:28:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:28:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:28:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:28:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:28:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:28:32.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:28:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:28:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:28:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:28:32.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:28:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:28:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.693 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:28:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 250.738930388, 2020-11-12T17:28:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:28:32.694 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:28:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.695 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:28:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:28:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:28:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:28:32.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:28:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:28:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:28:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:28:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:28:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:28:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:28:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:28:32.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:32.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:28:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:28:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:28:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:28:32.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:28:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:28:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:28:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:28:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:28:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:28:32.705 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:28:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:32.706 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 239.26182931400001, 2020-11-12T17:28:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:28:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:28:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:28:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:28:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:28:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:28:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:28:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:28:32.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:28:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:28:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:28:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:28:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:28:32.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:28:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:28:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 238.14281892700001, 2020-11-12T17:28:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:28:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.714 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:28:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:28:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:28:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:28:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:28:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:28:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:28:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:28:32.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:28:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:28:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:28:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:28:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:28:32.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:28:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:28:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:28:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:28:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:28:32.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:28:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:28:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:28:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:28:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.725 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:28:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 238.12668092300001, 2020-11-12T17:28:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:28:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:28:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:28:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:28:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:28:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:28:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:28:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:28:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:28:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:28:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:28:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:28:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:28:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:28:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:28:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.732 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:28:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 238.121953244, 2020-11-12T17:28:32.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:28:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:32.734 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:28:32.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:28:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:28:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:28:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:28:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:28:32.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:28:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:28:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:28:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:28:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:28:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:28:32.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:28:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:32.741 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.07819134499999, 2020-11-12T17:28:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:28:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:32.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:28:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:32.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:28:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:28:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:28:32.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:28:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:28:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:28:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:28:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:28:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:28:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:28:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:28:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:28:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:28:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:28:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:28:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:28:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:28:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:28:32.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:28:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:28:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:28:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:28:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.752 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.076297732, 2020-11-12T17:28:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:28:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:32.753 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:28:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:28:32.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:28:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:28:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:28:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:28:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:28:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:28:32.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:28:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:28:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:28:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:28:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:28:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:28:32.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:28:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:28:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:28:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:28:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:28:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:28:32.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:28:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:28:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:28:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.763 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.075545084, 2020-11-12T17:28:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:28:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.764 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:28:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:28:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:28:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:28:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:28:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:28:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:28:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:28:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:28:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:28:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:28:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:28:32.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:28:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:28:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:28:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:28:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:28:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:28:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:28:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:28:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:28:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:28:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:28:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:32.775 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.072383567, 2020-11-12T17:28:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:28:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:32.776 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:28:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:28:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:28:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:28:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:28:32.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:28:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:28:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:28:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:28:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:28:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:28:32.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:28:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:28:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:28:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:28:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:28:32.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:28:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:28:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:28:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:28:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:28:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:28:32.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:28:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:32.786 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.07130240000001, 2020-11-12T17:28:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:28:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:32.787 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:28:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:28:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:28:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:28:32.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:28:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:28:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:28:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:28:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:28:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:28:32.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:28:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:28:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:28:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:28:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:28:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:28:32.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:28:32.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:28:32.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:28:32.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:28:32.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:28:32.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:28:32.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:28:32.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.797 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.797 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:32.797 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:32.797 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.071133307, 2020-11-12T17:28:32.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:28:32.798 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.798 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.798 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.798 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:32.798 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:32.798 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:28:32.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.799 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:32.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:32.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:32.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:28:32.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:28:32.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:28:32.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:28:32.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:28:32.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:28:32.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:28:32.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:28:32.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:28:32.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:28:32.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:28:32.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:28:32.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:32.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:28:32.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:28:32.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:28:32.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:28:32.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:28:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:28:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:28:32.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:28:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:28:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:28:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.807 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.06851466099999, 2020-11-12T17:28:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:28:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.808 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:28:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:32.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:28:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:28:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:28:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:28:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:28:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:28:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:28:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:28:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:28:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:28:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:28:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:28:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:28:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:28:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:28:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:28:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:28:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:28:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:28:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:28:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:28:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:28:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.06840657800001, 2020-11-12T17:28:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:28:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.819 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:28:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:32.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:28:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:28:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:28:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:28:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:28:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:28:32.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:28:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:28:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:28:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:28:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:28:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:28:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:28:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:28:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:28:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:28:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:28:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:28:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:28:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:28:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:28:32.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:28:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:28:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:32.829 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.064443896, 2020-11-12T17:28:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:28:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:28:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:28:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:28:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:28:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:28:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:28:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:28:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:28:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:28:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:28:32.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:28:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:28:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:28:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:28:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:28:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:28:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 89.026714154999993, 2020-11-12T17:28:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:28:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:32.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:28:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:28:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:28:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:28:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:28:32.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:28:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:28:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:28:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:28:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:28:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:28:32.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:28:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:28:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:28:32.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:28:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:28:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.844 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:28:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.513311469999998, 2020-11-12T17:28:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:28:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.845 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:28:32.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:28:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:28:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:28:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:28:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:28:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:28:32.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:28:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:28:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:28:32.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:28:32.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:28:32.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:28:32.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:28:32.852 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.852 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.852 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.852 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:32.853 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:32.853 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.177001584999999, 2020-11-12T17:28:32.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:28:32.853 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.853 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:32.853 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:32.853 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:32.854 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:32.854 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:28:32.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.854 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:32.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:32.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:32.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:28:32.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:28:32.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:28:32.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:28:32.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:28:32.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:28:32.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:28:32.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:28:32.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:28:32.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:28:32.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:28:32.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:28:32.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:32.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:28:32.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:28:32.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:32.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:28:32.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:28:32.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:32.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:28:32.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:28:32.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:32.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:28:32.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:28:32.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:28:32.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:28:32.863 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.863 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.863 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.864 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:28:32.864 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:32.864 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.159393459, 2020-11-12T17:28:32.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:28:32.864 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.865 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:32.865 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:32.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:32.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:32.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:28:32.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:28:32.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:28:32.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:28:32.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:28:32.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:28:32.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:28:32.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:28:32.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:28:32.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:28:32.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:32.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:28:32.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:28:32.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:28:32.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:28:32.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.871 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.871 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(5.7 184/180 [PushReplyOp(5:e5a77d6d:::benchmark_data_smithi036_24110_object6672:head)])", 2020-11-12T17:28:32.871 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:32.872 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 8.7654705370000006, 2020-11-12T17:28:32.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002, 2020-11-12T17:28:32.872 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:32.872 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:32.872 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:32.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:32.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:32.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:32.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:32.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:32.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:28:32.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:32.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918950+0000", 2020-11-12T17:28:32.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8150999999999999e-05 2020-11-12T17:28:32.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:32.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.919008+0000", 2020-11-12T17:28:32.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41560975 2020-11-12T17:28:32.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:32.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334617+0000", 2020-11-12T17:28:32.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5324000000000001e-05 2020-11-12T17:28:32.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:32.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334633+0000", 2020-11-12T17:28:32.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016332299999999999 2020-11-12T17:28:32.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:32.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334796+0000", 2020-11-12T17:28:32.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010469629999999999 2020-11-12T17:28:32.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:32.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:32.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:32.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.335843+0000", 2020-11-12T17:28:32.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002 2020-11-12T17:28:32.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.878 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:32.878 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:32.878 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:32.880 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:32.880 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:32.876+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:32.980 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:32.978+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:33.008 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:33.008 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:33.008 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:28:33.008 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:33.018 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:33.103 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:33.102+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:33.174 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:33.537 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:33.538 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:33.538 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:33.538 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:33.540 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:28:33.541 INFO:teuthology.orchestra.run.smithi036.stderr:marked in osd.1. 2020-11-12T17:28:33.541 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'unique_pool_2' removed 2020-11-12T17:28:33.541 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:33.536+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:33.542 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:33.543 INFO:tasks.thrashosds.thrasher:Added osd 1 2020-11-12T17:28:33.543 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2020-11-12T17:28:33.544 INFO:tasks.radosbench:Beginning radosbench... 2020-11-12T17:28:33.544 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2020-11-12T17:28:33.545 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create unique_pool_3 16 2020-11-12T17:28:33.640 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:33.638+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:33.728 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:33.729 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:33.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:33.729 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:33.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.729 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:28:33.730 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:33.730 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05758423399999, 2020-11-12T17:28:33.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:28:33.730 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.730 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:33.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.731 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.731 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:28:33.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.731 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:33.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:33.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:28:33.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:28:33.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:28:33.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:28:33.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:28:33.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:28:33.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:28:33.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:28:33.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:28:33.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:28:33.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:28:33.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:28:33.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:28:33.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:28:33.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:28:33.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:28:33.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:28:33.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:28:33.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:28:33.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:28:33.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:28:33.740 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.741 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.741 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.741 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.741 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:33.741 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05718187299999, 2020-11-12T17:28:33.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:28:33.742 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.742 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.742 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:28:33.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.743 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:33.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:33.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:28:33.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:28:33.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:28:33.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:28:33.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:28:33.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:28:33.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:28:33.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:28:33.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:28:33.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:28:33.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:28:33.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:28:33.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:28:33.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:28:33.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:28:33.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:28:33.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:28:33.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:28:33.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:28:33.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:28:33.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:28:33.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:28:33.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:28:33.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:28:33.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:28:33.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:28:33.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:28:33.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:28:33.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:28:33.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:28:33.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:28:33.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.756 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.756 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.756 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.756 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:33.756 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05685788, 2020-11-12T17:28:33.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:28:33.757 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.757 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.757 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.757 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.757 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.758 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:28:33.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.758 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:33.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:33.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:28:33.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:28:33.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:28:33.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:28:33.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:28:33.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:28:33.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:28:33.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:28:33.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:28:33.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:28:33.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:28:33.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:28:33.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:28:33.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:28:33.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:28:33.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:28:33.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:28:33.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:28:33.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:28:33.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:28:33.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:28:33.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:28:33.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:28:33.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:28:33.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:28:33.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:28:33.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:28:33.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:28:33.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:28:33.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:28:33.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:28:33.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.771 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.771 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.772 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:33.772 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.056614169, 2020-11-12T17:28:33.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:28:33.772 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.772 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.772 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.773 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.773 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.773 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:28:33.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.773 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:33.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:33.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:28:33.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:28:33.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:28:33.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:28:33.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:28:33.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:28:33.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:28:33.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:28:33.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:28:33.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:28:33.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:28:33.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:28:33.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:28:33.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:28:33.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:28:33.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:28:33.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:28:33.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:28:33.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:28:33.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:28:33.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:28:33.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:28:33.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:28:33.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:28:33.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:28:33.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:28:33.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:28:33.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:28:33.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:28:33.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:28:33.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:28:33.795 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.795 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.796 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.797 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.797 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:33.797 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05637602199999, 2020-11-12T17:28:33.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:28:33.798 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.798 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.798 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.799 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:28:33.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.800 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:33.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:33.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:28:33.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:28:33.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:28:33.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:28:33.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:28:33.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:28:33.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:28:33.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:28:33.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:28:33.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:28:33.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:28:33.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:28:33.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:28:33.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:28:33.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:28:33.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:28:33.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:28:33.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:28:33.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:28:33.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:28:33.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:28:33.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:28:33.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:28:33.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:28:33.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:28:33.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:28:33.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:28:33.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:28:33.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:28:33.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:28:33.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:28:33.828 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.828 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.829 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.830 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.830 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:33.830 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05617398200002, 2020-11-12T17:28:33.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:28:33.831 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.831 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.832 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.833 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:28:33.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.834 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:33.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:33.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:28:33.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:28:33.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:28:33.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:28:33.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:28:33.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:28:33.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:28:33.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:28:33.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:28:33.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:28:33.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:28:33.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:28:33.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:28:33.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:28:33.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:28:33.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:28:33.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:28:33.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:28:33.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:28:33.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:28:33.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:28:33.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:28:33.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:28:33.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:28:33.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:28:33.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:28:33.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:28:33.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:28:33.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:28:33.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:28:33.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:28:33.864 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.864 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.865 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.865 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.866 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:33.866 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05596861200002, 2020-11-12T17:28:33.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:28:33.867 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.867 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.868 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:28:33.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.868 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:33.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:33.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:33.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:28:33.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:28:33.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:28:33.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:28:33.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:28:33.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:28:33.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:28:33.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:28:33.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:28:33.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:28:33.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:28:33.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:28:33.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:28:33.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:28:33.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:28:33.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:28:33.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:28:33.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:28:33.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:28:33.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:28:33.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:28:33.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:28:33.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:28:33.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:28:33.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:28:33.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:28:33.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:28:33.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:28:33.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:28:33.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:28:33.899 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.899 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.900 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.901 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.902 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:33.902 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05578278500002, 2020-11-12T17:28:33.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:28:33.903 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.903 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.903 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.903 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.904 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.904 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:28:33.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.905 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:33.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:33.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:33.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:28:33.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:28:33.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:28:33.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:28:33.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:28:33.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:28:33.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:28:33.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:28:33.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:28:33.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:28:33.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:28:33.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:28:33.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:28:33.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:28:33.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:28:33.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:28:33.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:28:33.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:28:33.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:28:33.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:28:33.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:28:33.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:28:33.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:28:33.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:28:33.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:28:33.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:28:33.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:28:33.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:28:33.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:28:33.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:28:33.928 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.928 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.928 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.929 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.929 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:33.929 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05558582100002, 2020-11-12T17:28:33.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:28:33.930 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.930 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.930 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.930 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.931 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.931 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:28:33.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.931 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:33.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:33.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:28:33.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:28:33.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:28:33.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:28:33.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:28:33.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:28:33.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:28:33.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:28:33.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:28:33.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:28:33.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:28:33.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:28:33.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:28:33.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:28:33.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:28:33.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:28:33.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:28:33.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:28:33.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:28:33.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:28:33.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:28:33.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:28:33.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:28:33.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:28:33.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:28:33.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:28:33.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:28:33.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:28:33.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:28:33.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:28:33.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:28:33.953 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.953 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.953 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.954 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.954 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:33.954 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05538979099998, 2020-11-12T17:28:33.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:28:33.954 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.954 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.955 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.955 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.955 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.955 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:28:33.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.955 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:33.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:33.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:33.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:28:33.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:28:33.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:28:33.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:28:33.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:28:33.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:28:33.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:28:33.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:28:33.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:28:33.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:28:33.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:28:33.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:28:33.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:28:33.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:28:33.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:28:33.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:28:33.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:28:33.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:28:33.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:28:33.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:28:33.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:28:33.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:28:33.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:28:33.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:28:33.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:28:33.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:28:33.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:28:33.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:28:33.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:28:33.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:28:33.969 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.969 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.969 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.969 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.969 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:33.970 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05520899099997, 2020-11-12T17:28:33.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:28:33.970 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.970 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.970 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.970 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.970 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.971 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:28:33.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.971 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:33.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:33.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:28:33.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:28:33.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:28:33.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:28:33.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:28:33.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:28:33.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:28:33.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:28:33.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:28:33.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:28:33.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:28:33.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:28:33.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:28:33.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:28:33.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:28:33.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:28:33.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:28:33.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:28:33.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:28:33.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:28:33.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:28:33.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:28:33.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:28:33.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:28:33.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:28:33.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:28:33.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:28:33.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:28:33.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:28:33.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:28:33.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:28:33.983 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.984 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.984 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:33.984 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:33.984 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05501303800003, 2020-11-12T17:28:33.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:28:33.985 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:33.985 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:33.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:33.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:33.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:33.985 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:28:33.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.986 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:33.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:33.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:33.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:33.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:33.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:33.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:33.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:33.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:28:33.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:28:33.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:33.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:28:33.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:28:33.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:33.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:28:33.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:28:33.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:33.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:28:33.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:28:33.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:28:33.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:28:33.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:33.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:28:33.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:28:33.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:28:33.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:28:33.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:33.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:28:33.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:28:33.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:33.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:28:33.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:28:33.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:33.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:28:33.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:28:33.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:33.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:28:33.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:28:33.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:33.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:28:33.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:28:33.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:33.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:28:33.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:28:33.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:33.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:28:33.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:28:33.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:33.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:33.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:33.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:28:33.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:28:33.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:33.999 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:33.999 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.000 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:34.000 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:34.000 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05481943000001, 2020-11-12T17:28:34.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:28:34.000 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.001 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:34.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:34.001 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:28:34.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.001 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:34.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:34.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:28:34.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:28:34.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:28:34.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:28:34.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:28:34.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:28:34.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:28:34.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:28:34.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:28:34.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:28:34.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:28:34.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:34.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:28:34.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:28:34.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:28:34.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:28:34.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:34.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:28:34.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:28:34.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:28:34.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:28:34.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:28:34.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:28:34.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:34.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:28:34.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:28:34.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:28:34.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:28:34.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:28:34.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:28:34.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:28:34.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:28:34.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:28:34.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:28:34.016 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.016 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.016 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.016 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:34.016 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:34.017 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05450756699997, 2020-11-12T17:28:34.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:28:34.017 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.017 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.017 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.017 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:34.017 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:34.018 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:28:34.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.018 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:34.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:34.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:28:34.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:28:34.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:28:34.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:28:34.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:28:34.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:28:34.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:28:34.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:28:34.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:28:34.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:28:34.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:28:34.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:34.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:28:34.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:28:34.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:28:34.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:28:34.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:34.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:28:34.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:28:34.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:28:34.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:28:34.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:28:34.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:28:34.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:34.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:28:34.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:28:34.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:28:34.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:28:34.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:28:34.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:28:34.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:28:34.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:28:34.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:28:34.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:28:34.030 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.030 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.031 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.031 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:34.031 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:34.031 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05422006999999, 2020-11-12T17:28:34.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:28:34.032 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.032 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.032 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.032 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:34.032 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:34.033 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:28:34.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.033 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:34.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:34.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:28:34.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:28:34.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:28:34.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:28:34.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:28:34.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:28:34.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:28:34.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:28:34.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:28:34.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:28:34.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:28:34.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:34.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:28:34.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:28:34.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:34.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:28:34.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:28:34.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:28:34.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:28:34.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:28:34.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:28:34.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:34.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:28:34.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:28:34.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:28:34.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:28:34.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:28:34.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:28:34.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:28:34.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:28:34.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:28:34.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:28:34.047 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.047 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.047 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.048 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:34.048 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:34.048 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.05399969899997, 2020-11-12T17:28:34.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:28:34.049 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.049 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.049 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.049 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:34.049 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:34.049 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:28:34.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.050 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:34.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:34.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:28:34.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:28:34.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:28:34.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:28:34.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:28:34.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:28:34.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:28:34.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:28:34.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:28:34.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:28:34.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:28:34.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:34.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:28:34.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:28:34.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:28:34.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:28:34.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:34.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:28:34.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:28:34.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.059 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:28:34.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:28:34.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:28:34.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:28:34.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:34.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:28:34.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:28:34.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:28:34.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:28:34.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:28:34.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:28:34.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:28:34.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:28:34.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:28:34.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:28:34.065 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.065 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.066 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.066 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:28:34.066 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:34.066 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 152.144420709, 2020-11-12T17:28:34.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:28:34.067 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.067 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.067 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:34.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:34.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:28:34.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:28:34.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:28:34.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:28:34.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:28:34.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:28:34.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:28:34.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:28:34.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:28:34.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:28:34.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:28:34.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:28:34.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:28:34.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:28:34.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:28:34.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:28:34.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:28:34.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.075 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.076 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:28:34.076 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:34.076 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 90.070044949000007, 2020-11-12T17:28:34.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:28:34.076 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.077 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.077 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.077 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:34.077 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:34.077 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:28:34.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.077 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:34.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:34.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:34.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:28:34.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:28:34.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:28:34.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:28:34.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:28:34.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:28:34.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:28:34.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:28:34.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:28:34.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:28:34.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:28:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:28:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:34.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:28:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:28:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:28:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:28:34.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:28:34.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:28:34.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:28:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:28:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:28:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:28:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:28:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.299618582000001, 2020-11-12T17:28:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:28:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.089 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:28:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:28:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:28:34.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:28:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:28:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:28:34.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:28:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:28:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:28:34.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:28:34.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:28:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:28:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:28:34.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:28:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:28:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:28:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:28:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:28:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:28:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:28:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:28:34.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:28:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:28:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:28:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.100 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.101 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.101 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:28:34.101 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:34.101 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 59.291521549000002, 2020-11-12T17:28:34.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:28:34.102 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.102 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:34.102 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:28:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:28:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:28:34.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:28:34.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:28:34.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:28:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:28:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:28:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:28:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:28:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:28:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:28:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:28:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:28:34.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:28:34.109 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.109 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.109 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.109 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.109 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.109 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:34.111 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:34.112 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:34.108+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:34.212 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:34.208+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:34.269 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:34.269 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:34.270 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:28:34.270 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:34.279 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:34.313 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:34.312+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:34.378 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:34.378 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:34.378 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:34.379 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:34.379 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:34.387 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:34.439 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:34.438+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:34.458 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'unique_pool_3' created 2020-11-12T17:28:34.471 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2020-11-12T17:28:34.506 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:34.506 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:34.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:34.507 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:34.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.507 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:28:34.507 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:34.507 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.65427924300002, 2020-11-12T17:28:34.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:28:34.507 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.508 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:34.508 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:34.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:34.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:34.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:28:34.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:28:34.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:28:34.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:28:34.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:28:34.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:28:34.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:28:34.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:28:34.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:28:34.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:28:34.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:28:34.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:28:34.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:28:34.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:28:34.514 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.514 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.514 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.515 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:34.515 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:34.515 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 320.09408202100002, 2020-11-12T17:28:34.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:28:34.515 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.516 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.516 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.516 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:34.516 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:34.516 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:28:34.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.516 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:34.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:34.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:34.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:28:34.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:28:34.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:28:34.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:28:34.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:28:34.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:28:34.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:28:34.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:28:34.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:28:34.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:28:34.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:28:34.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:28:34.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:34.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:28:34.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:28:34.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:28:34.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:28:34.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:28:34.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:28:34.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:28:34.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:28:34.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:28:34.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:28:34.526 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.526 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.526 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.527 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:28:34.527 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:34.527 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 320.08818969800001, 2020-11-12T17:28:34.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:28:34.527 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.528 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:34.528 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:34.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:34.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:28:34.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:28:34.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:28:34.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:28:34.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:28:34.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:28:34.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:28:34.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:28:34.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:28:34.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:28:34.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:28:34.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:28:34.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:28:34.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:28:34.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:28:34.535 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.535 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.535 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:28:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 289.96219943, 2020-11-12T17:28:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:28:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.536 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:28:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:34.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:34.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:34.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:28:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:28:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:28:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:28:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:28:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:28:34.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:28:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:28:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:28:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:28:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:28:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:28:34.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:28:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:28:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:28:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:28:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:28:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:28:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:28:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:28:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:28:34.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:28:34.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.546 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.546 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:28:34.546 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 289.95489571100001, 2020-11-12T17:28:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:28:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:28:34.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:28:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:28:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:28:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:28:34.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:28:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:28:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:28:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:28:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:28:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:28:34.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:28:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:28:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.554 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:28:34.554 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:34.554 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 289.58131721799998, 2020-11-12T17:28:34.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:28:34.554 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.554 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:28:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:34.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:28:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:28:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:28:34.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:28:34.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:28:34.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:28:34.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:28:34.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:28:34.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:28:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:28:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:28:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:28:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:28:34.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:28:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:28:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:28:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:28:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:28:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:28:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:28:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:28:34.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:28:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:28:34.565 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:34.566 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 289.56976409800001, 2020-11-12T17:28:34.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:28:34.566 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.566 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:34.566 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:34.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:28:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:28:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:28:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:28:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:28:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:28:34.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:28:34.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:28:34.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:28:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:28:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:28:34.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:28:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:28:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:28:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.572 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.573 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.573 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:28:34.573 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:34.573 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 284.49664391699997, 2020-11-12T17:28:34.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:28:34.574 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.574 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.574 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.574 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:34.574 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:34.575 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:28:34.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.575 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:34.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:28:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:28:34.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:28:34.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:28:34.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:28:34.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:28:34.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:28:34.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:28:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:28:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:28:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:28:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:28:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:28:34.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:28:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:28:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:28:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:28:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:28:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:28:34.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:28:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:28:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:28:34.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:28:34.584 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.584 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.585 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.586 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:28:34.586 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:34.586 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 177.785819524, 2020-11-12T17:28:34.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:28:34.586 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:34.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:28:34.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:28:34.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:28:34.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:28:34.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:28:34.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:28:34.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:28:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:28:34.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:28:34.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:28:34.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:28:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:28:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:28:34.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:28:34.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:28:34.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:28:34.596 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.596 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.596 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.597 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:28:34.597 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:34.597 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 172.456876999, 2020-11-12T17:28:34.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:28:34.598 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.598 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.598 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:34.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:28:34.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:28:34.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:28:34.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:28:34.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:28:34.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:28:34.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:28:34.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:28:34.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:28:34.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:28:34.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:28:34.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:28:34.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:28:34.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:28:34.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:28:34.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:28:34.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:28:34.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.607 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.608 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:28:34.608 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:34.608 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.86236914099999, 2020-11-12T17:28:34.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:28:34.609 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.609 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.609 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:34.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:34.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:28:34.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:28:34.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:28:34.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:28:34.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:28:34.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:28:34.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:28:34.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:28:34.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:28:34.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:28:34.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:28:34.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:28:34.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:28:34.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:28:34.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:28:34.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:28:34.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:28:34.617 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.617 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.618 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.618 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:28:34.619 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:34.619 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 153.660294013, 2020-11-12T17:28:34.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:28:34.619 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.619 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.619 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:34.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:34.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:34.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:28:34.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:28:34.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:28:34.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:28:34.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:28:34.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:28:34.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:28:34.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:28:34.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:28:34.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:28:34.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:28:34.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:28:34.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:28:34.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:28:34.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:28:34.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:28:34.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.750 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.751 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:28:34.751 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:34.751 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 141.61825161199999, 2020-11-12T17:28:34.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:28:34.752 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.752 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.752 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:34.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:34.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:28:34.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:28:34.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:28:34.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:28:34.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:28:34.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:28:34.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:28:34.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:28:34.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:28:34.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:28:34.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:28:34.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:28:34.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:28:34.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:28:34.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:28:34.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:28:34.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:28:34.767 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.768 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.768 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.769 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:28:34.769 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:34.769 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 97.536450727000002, 2020-11-12T17:28:34.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:28:34.770 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.770 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.770 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:34.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:34.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:34.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:28:34.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:28:34.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:28:34.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:28:34.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:28:34.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:28:34.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:28:34.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:28:34.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:28:34.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:28:34.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:28:34.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:28:34.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:28:34.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:28:34.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:28:34.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:28:34.782 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.782 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.782 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.783 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:25824 5.9 5:939cc28b:::benchmark_data_smithi036_24110_object3227:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:28:34.783 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:34.784 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 81.030296835000001, 2020-11-12T17:28:34.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998, 2020-11-12T17:28:34.784 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.784 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.785 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.785 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:34.785 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:34.785 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25824 2020-11-12T17:28:34.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.786 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:34.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:34.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:28:34.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466401+0000", 2020-11-12T17:28:34.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3675000000000001e-05 2020-11-12T17:28:34.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466485+0000", 2020-11-12T17:28:34.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0393e-05 2020-11-12T17:28:34.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466495+0000", 2020-11-12T17:28:34.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1100000000000002e-06 2020-11-12T17:28:34.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466500+0000", 2020-11-12T17:28:34.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034414860000000001 2020-11-12T17:28:34.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.469942+0000", 2020-11-12T17:28:34.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8772999999999999e-05 2020-11-12T17:28:34.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470021+0000", 2020-11-12T17:28:34.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015431599999999999 2020-11-12T17:28:34.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:34.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470175+0000", 2020-11-12T17:28:34.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001516643 2020-11-12T17:28:34.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.471692+0000", 2020-11-12T17:28:34.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36737703500000002 2020-11-12T17:28:34.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839069+0000", 2020-11-12T17:28:34.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2213000000000006e-05 2020-11-12T17:28:34.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839161+0000", 2020-11-12T17:28:34.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8376999999999999e-05 2020-11-12T17:28:34.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839239+0000", 2020-11-12T17:28:34.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998 2020-11-12T17:28:34.802 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.802 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.802 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.803 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:28:34.803 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:34.804 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 75.277380749000002, 2020-11-12T17:28:34.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:28:34.804 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.804 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.805 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:34.805 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:34.805 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:34.805 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:28:34.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.806 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:34.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:34.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:34.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:28:34.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:28:34.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:28:34.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:28:34.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:28:34.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:28:34.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:28:34.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:28:34.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:28:34.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:28:34.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:34.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:28:34.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:28:34.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:34.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:28:34.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:28:34.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:34.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:28:34.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:28:34.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:28:34.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:28:34.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:28:34.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:28:34.821 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.821 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.822 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.822 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:28:34.822 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:34.823 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 75.267556248000005, 2020-11-12T17:28:34.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:28:34.823 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.823 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:34.824 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:34.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:34.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:34.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:28:34.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:28:34.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:28:34.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:28:34.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:28:34.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:28:34.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:28:34.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:28:34.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:28:34.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:28:34.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:28:34.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:28:34.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:28:34.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:28:34.833 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.834 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.834 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.834 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:28:34.834 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:34.835 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 34.922300415999999, 2020-11-12T17:28:34.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:28:34.835 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.835 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.835 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:34.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:34.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:34.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:28:34.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:28:34.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:28:34.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:28:34.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:28:34.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:28:34.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:28:34.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:28:34.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:28:34.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:28:34.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:28:34.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:28:34.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:28:34.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:28:34.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:28:34.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:28:34.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.848 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.849 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:28:34.849 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:34.849 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 33.600623503000001, 2020-11-12T17:28:34.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:28:34.850 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.850 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.851 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:34.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:34.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:28:34.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:28:34.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:28:34.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:28:34.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:28:34.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:28:34.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:28:34.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:28:34.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:28:34.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:28:34.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:28:34.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:28:34.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:28:34.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:28:34.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:28:34.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:28:34.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:28:34.864 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.864 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.865 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.865 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:28:34.866 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:34.866 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 21.519101636999999, 2020-11-12T17:28:34.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:28:34.866 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:34.867 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:34.867 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:34.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:34.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:34.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:34.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:34.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:34.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:34.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:34.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:28:34.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:28:34.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:34.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:28:34.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:28:34.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:34.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:28:34.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:28:34.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:34.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:28:34.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:28:34.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:34.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:28:34.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:28:34.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:34.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:28:34.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:28:34.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:34.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:28:34.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:28:34.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:34.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:34.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:34.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:28:34.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:28:34.877 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.877 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:34.878 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:34.878 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:34.879 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:28:34.880 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:34.881 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:34.880+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:34.985 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:34.978+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:34.995 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:34.995 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:28:34.995 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:28:34.995 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:35.011 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:28:35.031 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:35.060 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:35.083 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:35.082+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:35.086 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:35.111 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:35.116 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:35.117 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:35.126 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:28:35.142 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:35.183 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:35.184 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:35.180+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:35.227 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:35.260 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:35.262 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:35.262 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:35.263 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:35.263 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:35.263 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:35.263 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:35.264 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:35.264 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:35.265 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:35.265 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:35.276 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:28:35.285 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:35.282+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:35.386 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:35.384+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:35.429 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:35.430 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:35.439 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:28:35.441 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:35.436+0000 7fc24d2e3700 -1 osd.3 190 handle_osd_map injecting map crc failure 2020-11-12T17:28:35.445 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:35.442+0000 7f9a0b6b4700 -1 osd.5 190 handle_osd_map injecting map crc failure 2020-11-12T17:28:35.448 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:35.446+0000 7f280e6c1700 -1 osd.6 190 handle_osd_map injecting map crc failure 2020-11-12T17:28:35.456 INFO:teuthology.orchestra.run.smithi036.stderr:enabled application 'rados' on pool 'unique_pool_3' 2020-11-12T17:28:35.487 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:35.486+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:35.543 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:28:35.545 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:35.545 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:35.555 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:28:35.599 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:35.596+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:35.694 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:35.692+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:35.706 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:35.707 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:35.714 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:28:35.798 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:35.794+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:35.881 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:35.882 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:35.885 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:28:35.895 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:35.894+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:35.992 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:35.992 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:35.998 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:35.994+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:36.010 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:28:36.102 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:36.098+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:36.229 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:36.230 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:36.231 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:36.226+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:36.231 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:28:36.329 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:36.326+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:36.363 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:36.364 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:36.374 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:28:36.432 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:36.430+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:36.459 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:28:36.471 INFO:teuthology.orchestra.run.smithi036:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_3 bench 90 write' 2020-11-12T17:28:36.473 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2020-11-12T17:28:36.474 INFO:teuthology.orchestra.run:waiting for 3000 2020-11-12T17:28:36.486 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:36.487 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:36.499 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:28:36.521 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:hints = 1 2020-11-12T17:28:36.522 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2020-11-12T17:28:36.522 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Object prefix: benchmark_data_smithi036_29033 2020-11-12T17:28:36.523 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:28:36.523 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 0 0 0 0 0 0 - 0 2020-11-12T17:28:36.533 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:36.530+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:36.633 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:36.630+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:36.656 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:36.657 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:36.669 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:36.734 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:36.732+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:36.795 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:36.989 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:36.991 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:36.991 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:36.986+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:37.091 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:37.088+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:37.152 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:37.153 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:37.163 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:37.192 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:37.188+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:37.279 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:37.288 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:37.289 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:37.299 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:37.326 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:37.324+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:37.394 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:37.392+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:37.421 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:37.421 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:37.433 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:37.457 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:37.484 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:37.495 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:37.492+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:37.517 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:37.520 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 1 16 1287 1271 9.92918 9.92969 0.0090803 0.0124721 2020-11-12T17:28:37.548 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:37.560 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:37.561 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:37.573 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:37.583 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:37.596 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:37.592+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:37.617 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:37.690 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:37.690 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:37.690 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:37.691 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:37.691 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:37.691 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:37.691 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:37.691 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:37.691 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:37.691 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:37.701 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:37.696+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:37.702 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:37.703 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:37.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:37.703 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:37.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.703 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:28:37.703 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:37.704 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 287.69058206, 2020-11-12T17:28:37.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:28:37.704 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.704 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.704 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:37.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:37.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:37.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:28:37.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:28:37.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:28:37.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:28:37.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:28:37.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:28:37.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:28:37.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:28:37.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:28:37.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:28:37.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:28:37.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:28:37.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:28:37.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:28:37.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:28:37.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:28:37.718 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.718 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.718 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.719 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:28:37.719 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:37.719 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 255.75059671700001, 2020-11-12T17:28:37.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:28:37.719 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.719 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.719 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.720 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:37.720 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:37.720 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:28:37.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.720 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:37.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:37.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:28:37.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:28:37.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:28:37.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:28:37.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:28:37.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:28:37.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:37.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:28:37.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:28:37.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:28:37.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:28:37.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:28:37.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:28:37.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:37.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:28:37.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:28:37.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:28:37.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:28:37.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:28:37.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:28:37.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:28:37.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:28:37.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:28:37.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:28:37.763 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.763 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.763 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.763 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:28:37.763 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:37.764 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 244.27349564299999, 2020-11-12T17:28:37.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:28:37.764 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.764 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:37.764 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:37.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:37.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:28:37.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:28:37.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:28:37.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:28:37.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:28:37.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:28:37.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:28:37.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:28:37.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:28:37.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:28:37.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:28:37.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:28:37.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:28:37.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.771 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.772 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:28:37.787 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:37.787 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 243.15448525599999, 2020-11-12T17:28:37.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:28:37.787 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.788 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.788 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.788 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:37.788 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:37.788 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:37.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.788 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:37.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:37.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:37.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:28:37.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:28:37.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:28:37.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:28:37.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:28:37.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:28:37.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:28:37.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:28:37.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:28:37.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:28:37.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:28:37.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:28:37.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:37.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:28:37.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:28:37.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:28:37.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:28:37.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:28:37.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:28:37.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:28:37.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:28:37.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:28:37.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:28:37.807 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.807 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.807 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.808 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:28:37.808 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:37.808 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 243.13834725199999, 2020-11-12T17:28:37.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:28:37.809 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.809 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:37.809 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:37.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:37.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:37.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:28:37.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:28:37.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:28:37.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:28:37.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:28:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:28:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:28:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:28:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:28:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:28:37.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:28:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:28:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:28:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:28:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.816 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:28:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 243.133619573, 2020-11-12T17:28:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:28:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:37.817 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.820 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:28:37.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:28:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:28:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:28:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:28:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:28:37.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:28:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:28:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:28:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:37.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:28:37.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:28:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:28:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:28:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.827 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.089857674, 2020-11-12T17:28:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:28:37.828 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:37.829 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:28:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:28:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:28:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:28:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:28:37.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:28:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:28:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:28:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:28:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:28:37.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:28:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:28:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:28:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:28:37.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:28:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:28:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:28:37.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:28:37.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:28:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:28:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:28:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:28:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:28:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:37.851 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.08796406100001, 2020-11-12T17:28:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:28:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:37.852 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:28:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:28:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:28:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:28:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:28:37.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:28:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:28:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:28:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:28:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:28:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:28:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:28:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:28:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:28:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:28:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:28:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:28:37.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:28:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:28:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:28:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:28:37.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:28:37.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:28:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:37.863 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.08721141300001, 2020-11-12T17:28:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:28:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:37.864 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:28:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:28:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:28:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:28:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:28:37.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:28:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:28:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:28:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:28:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:28:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:28:37.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:28:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:28:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:28:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:28:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:28:37.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:28:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:28:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:28:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:28:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:28:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:28:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:28:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:37.875 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.08404989600001, 2020-11-12T17:28:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:28:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:37.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:28:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:28:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:28:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:28:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:28:37.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:28:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:28:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:28:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:28:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:28:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:28:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:28:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:28:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:28:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:28:37.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:28:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:28:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:28:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:28:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:28:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:28:37.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:28:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:28:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.08296872899999, 2020-11-12T17:28:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:28:37.895 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.896 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:28:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.897 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:28:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:28:37.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:28:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:28:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:28:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:28:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:28:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:28:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:28:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:28:37.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:28:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:28:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:37.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:28:37.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:28:37.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:28:37.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:28:37.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:28:37.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:28:37.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:28:37.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:28:37.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:28:37.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:28:37.908 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.908 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.908 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.909 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:37.909 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:37.909 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.082799636, 2020-11-12T17:28:37.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:28:37.909 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.909 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.910 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.910 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:37.910 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:37.911 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:28:37.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.911 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:37.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:37.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:37.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:28:37.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:28:37.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:28:37.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:28:37.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:28:37.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:28:37.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:28:37.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:28:37.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:28:37.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:28:37.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:28:37.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:28:37.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:37.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:28:37.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:28:37.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:28:37.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:28:37.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:28:37.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:28:37.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:28:37.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:28:37.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:28:37.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:28:37.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.921 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.922 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.922 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:37.922 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:37.922 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.08018099, 2020-11-12T17:28:37.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:28:37.923 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.923 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.923 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.923 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:37.923 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:37.923 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:28:37.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.924 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:37.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:37.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:37.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:28:37.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:28:37.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:28:37.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:28:37.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:28:37.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:28:37.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:28:37.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:28:37.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:28:37.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:28:37.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:28:37.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:28:37.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:37.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:28:37.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:28:37.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:28:37.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:28:37.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:28:37.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:28:37.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:28:37.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:28:37.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:28:37.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:28:37.934 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.934 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.934 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.934 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:37.935 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:37.935 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.08007290699999, 2020-11-12T17:28:37.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:28:37.935 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.935 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.935 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.935 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:37.935 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:37.936 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:28:37.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.936 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:37.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:37.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:37.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:28:37.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:28:37.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:28:37.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:28:37.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.940 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.940 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:28:37.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:28:37.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:28:37.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:28:37.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:28:37.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:28:37.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:28:37.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:28:37.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:37.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:28:37.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:28:37.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:37.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:28:37.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:28:37.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:37.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:28:37.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:28:37.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:28:37.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:28:37.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:28:37.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:28:37.946 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.947 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.947 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.947 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:28:37.947 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:37.947 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.07611022500001, 2020-11-12T17:28:37.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:28:37.948 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.948 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:37.949 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:37.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:37.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:28:37.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:28:37.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:28:37.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:28:37.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:28:37.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:28:37.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:28:37.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:28:37.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:28:37.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:28:37.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:28:37.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:28:37.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:28:37.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:28:37.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:28:37.970 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.970 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.970 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.971 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:28:37.971 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:37.971 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 94.038380484000001, 2020-11-12T17:28:37.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:28:37.972 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.972 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.972 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:37.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:37.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:37.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:28:37.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:28:37.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:28:37.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:28:37.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:28:37.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:28:37.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:28:37.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:28:37.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:28:37.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:28:37.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:28:37.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:28:37.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:37.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:28:37.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:28:37.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:28:37.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:28:37.981 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.981 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.981 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.982 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:28:37.982 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:37.982 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.524977798999998, 2020-11-12T17:28:37.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:28:37.982 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.983 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:37.983 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:37.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:37.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:37.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:28:37.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:28:37.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:37.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:28:37.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:28:37.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:37.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:28:37.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:28:37.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:37.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:28:37.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:28:37.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:37.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:28:37.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:28:37.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:37.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:28:37.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:28:37.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:37.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:28:37.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:28:37.992 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.992 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:37.993 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:37.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.994 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:37.994 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:37.994 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 38.188667914, 2020-11-12T17:28:37.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:28:37.994 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:37.995 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:37.995 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:37.995 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:37.995 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:37.995 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:28:37.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.996 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:37.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:37.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:37.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:37.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:37.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:37.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:37.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:37.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:37.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:37.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:28:37.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:28:38.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:28:38.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:28:38.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:28:38.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:28:38.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:28:38.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:28:38.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:28:38.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:28:38.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:28:38.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:28:38.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:28:38.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:28:38.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:28:38.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:28:38.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:28:38.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:28:38.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:28:38.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:28:38.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:28:38.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:28:38.012 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.012 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.013 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.013 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:28:38.013 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:38.014 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 38.171059788000001, 2020-11-12T17:28:38.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:28:38.014 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.014 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:38.014 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:38.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:38.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:38.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:28:38.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:28:38.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:28:38.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:28:38.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:28:38.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:28:38.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:28:38.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:28:38.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:28:38.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:28:38.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:28:38.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:28:38.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:28:38.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:28:38.021 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.021 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.021 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.022 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(5.7 184/180 [PushReplyOp(5:e5a77d6d:::benchmark_data_smithi036_24110_object6672:head)])", 2020-11-12T17:28:38.022 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:38.022 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 13.777136865999999, 2020-11-12T17:28:38.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002, 2020-11-12T17:28:38.022 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.023 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:38.023 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:38.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:38.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:28:38.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918950+0000", 2020-11-12T17:28:38.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8150999999999999e-05 2020-11-12T17:28:38.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.919008+0000", 2020-11-12T17:28:38.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41560975 2020-11-12T17:28:38.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334617+0000", 2020-11-12T17:28:38.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5324000000000001e-05 2020-11-12T17:28:38.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334633+0000", 2020-11-12T17:28:38.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016332299999999999 2020-11-12T17:28:38.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334796+0000", 2020-11-12T17:28:38.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010469629999999999 2020-11-12T17:28:38.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.335843+0000", 2020-11-12T17:28:38.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002 2020-11-12T17:28:38.028 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.029 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.029 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.029 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:38.030 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:38.031 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:37.902+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:38.032 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:38.030+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:38.136 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:38.130+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:38.152 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:38.152 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:38.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.153 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:2160 6.1 e192/190 6:8f5aefc6:::benchmark_data_smithi036_29033_object269:head v 192'120, mlcod=192'115)", 2020-11-12T17:28:38.153 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:38.150012+0000", 2020-11-12T17:28:38.153 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0040774260000000003, 2020-11-12T17:28:38.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041106820000000001, 2020-11-12T17:28:38.153 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.154 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:38.154 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:38.150012+0000", 2020-11-12T17:28:38.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:38.150012+0000", 2020-11-12T17:28:38.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:28:38.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:38.149978+0000", 2020-11-12T17:28:38.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011887699999999999 2020-11-12T17:28:38.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:38.150097+0000", 2020-11-12T17:28:38.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105528 2020-11-12T17:28:38.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:38.150202+0000", 2020-11-12T17:28:38.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1300000000000001e-06 2020-11-12T17:28:38.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:38.150210+0000", 2020-11-12T17:28:38.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5653999999999999e-05 2020-11-12T17:28:38.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:38.150266+0000", 2020-11-12T17:28:38.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7282000000000001e-05 2020-11-12T17:28:38.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:38.150293+0000", 2020-11-12T17:28:38.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028167399999999999 2020-11-12T17:28:38.163 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.164 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.164 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:28:38.164 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:28:38.164 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:38.165 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:38.236 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:38.232+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:38.330 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:38.331 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:38.331 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:38.335 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:38.334+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:38.338 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:38.436 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:38.432+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:38.470 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:28:38.685 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 0, 1] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:38.686 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:38.686 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.000000 2020-11-12T17:28:38.686 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd primary-affinity 0 0 2020-11-12T17:28:38.689 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 2 16 2617 2601 10.1595 10.3906 0.0110016 0.0121106 2020-11-12T17:28:38.689 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:38.684+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:38.690 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:38.690 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:38.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:38.690 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:38.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.691 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:28:38.691 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:38.691 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83734688700002, 2020-11-12T17:28:38.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:28:38.691 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.691 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:38.692 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.692 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.692 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.692 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:28:38.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.692 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:38.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:38.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:28:38.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:28:38.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:28:38.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:28:38.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:28:38.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:28:38.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:28:38.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:28:38.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:28:38.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:28:38.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:28:38.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:28:38.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:28:38.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:28:38.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:28:38.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:28:38.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:28:38.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:28:38.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:28:38.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:28:38.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:28:38.705 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.706 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.706 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.706 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:38.707 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83694452600002, 2020-11-12T17:28:38.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:28:38.707 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.708 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.708 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.708 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.708 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.708 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:28:38.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.709 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:38.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:38.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:28:38.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:28:38.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:28:38.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:28:38.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:28:38.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:28:38.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:28:38.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:28:38.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:28:38.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:28:38.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:28:38.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:28:38.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:28:38.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:28:38.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:28:38.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:28:38.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:28:38.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:28:38.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:28:38.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:28:38.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:28:38.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:28:38.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:28:38.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:28:38.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:28:38.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:28:38.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:28:38.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:28:38.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:28:38.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:28:38.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:28:38.726 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.726 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.726 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.727 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.727 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:38.727 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83662053299997, 2020-11-12T17:28:38.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:28:38.727 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.728 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.728 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.728 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.728 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.729 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:28:38.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.729 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:38.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:38.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:28:38.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:28:38.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:28:38.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:28:38.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:28:38.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:28:38.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:28:38.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:28:38.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:28:38.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:28:38.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:28:38.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:28:38.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:28:38.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:28:38.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:28:38.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:28:38.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:28:38.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:28:38.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:28:38.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:28:38.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:28:38.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:28:38.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:28:38.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:28:38.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:28:38.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:28:38.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:28:38.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:28:38.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:28:38.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:28:38.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:28:38.742 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.742 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.742 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.743 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.743 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:38.743 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83637682199998, 2020-11-12T17:28:38.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:28:38.744 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.744 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.744 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.744 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.744 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.744 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:28:38.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.745 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:38.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:38.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:28:38.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:28:38.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:28:38.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:28:38.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:28:38.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:28:38.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:28:38.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:28:38.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:28:38.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:28:38.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:28:38.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:28:38.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:28:38.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:28:38.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:28:38.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:28:38.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:28:38.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:28:38.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:28:38.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:28:38.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:28:38.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:28:38.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:28:38.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:28:38.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:28:38.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:28:38.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:28:38.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:28:38.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:28:38.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:28:38.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:28:38.759 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.759 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.760 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.761 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.761 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:38.761 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83613867499997, 2020-11-12T17:28:38.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:28:38.761 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.761 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.762 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.762 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.762 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.762 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:28:38.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.763 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:38.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:38.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:28:38.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:28:38.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:28:38.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:28:38.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:28:38.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:28:38.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:28:38.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:28:38.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:28:38.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:28:38.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:28:38.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:28:38.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:28:38.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:28:38.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:28:38.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:28:38.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:28:38.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:28:38.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:28:38.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:28:38.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:28:38.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:28:38.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:28:38.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:28:38.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:28:38.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:28:38.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:28:38.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:28:38.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:28:38.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:28:38.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:28:38.779 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.780 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.780 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.780 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.781 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:38.781 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.835936635, 2020-11-12T17:28:38.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:28:38.781 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.781 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.782 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.782 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.782 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.783 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:28:38.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.783 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:38.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:38.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:28:38.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:28:38.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:28:38.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:28:38.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:28:38.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:28:38.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:28:38.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:28:38.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:28:38.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:28:38.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:28:38.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:28:38.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:28:38.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:28:38.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:28:38.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:28:38.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:28:38.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:28:38.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:28:38.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:28:38.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:28:38.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:28:38.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:28:38.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:28:38.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:28:38.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:28:38.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:28:38.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:28:38.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:28:38.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:28:38.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:28:38.802 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.802 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.802 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.803 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.803 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:38.804 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83573126499999, 2020-11-12T17:28:38.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:28:38.804 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.804 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.804 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.805 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.805 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.805 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:28:38.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.806 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:38.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:38.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:38.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:28:38.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:28:38.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:28:38.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:28:38.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:28:38.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:28:38.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:28:38.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:28:38.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:28:38.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:28:38.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:28:38.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:28:38.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:28:38.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:28:38.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:28:38.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:28:38.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:28:38.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:28:38.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:28:38.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:28:38.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:28:38.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:28:38.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:28:38.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:28:38.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:28:38.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:28:38.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:28:38.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:28:38.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:28:38.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:28:38.819 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.819 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.819 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.820 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.820 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:38.820 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.835545438, 2020-11-12T17:28:38.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:28:38.820 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.820 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.821 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.821 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.821 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:28:38.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.821 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:38.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:38.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:38.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:28:38.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:28:38.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:28:38.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:28:38.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:28:38.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:28:38.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:28:38.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:28:38.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:28:38.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:28:38.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:28:38.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:28:38.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:28:38.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:28:38.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:28:38.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:28:38.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:28:38.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:28:38.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:28:38.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:28:38.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:28:38.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:28:38.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:28:38.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:28:38.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:28:38.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:28:38.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:28:38.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:28:38.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.837 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.837 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:38.837 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.835348474, 2020-11-12T17:28:38.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:28:38.837 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.837 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.838 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.838 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.838 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.838 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:28:38.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.838 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:38.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:38.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:28:38.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:28:38.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:28:38.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:28:38.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:28:38.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:28:38.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:28:38.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:28:38.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:28:38.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:28:38.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:28:38.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:28:38.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:28:38.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:28:38.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:28:38.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:28:38.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:28:38.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:28:38.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:28:38.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:28:38.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:28:38.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:28:38.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:28:38.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:28:38.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:28:38.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:28:38.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:28:38.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:28:38.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:28:38.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:28:38.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:28:38.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.851 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.851 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.851 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:38.852 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83515244400002, 2020-11-12T17:28:38.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:28:38.852 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.852 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.852 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.852 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:28:38.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.853 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:38.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:38.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:38.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:28:38.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:28:38.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:28:38.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:28:38.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:28:38.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:28:38.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:28:38.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:28:38.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:28:38.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:28:38.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:28:38.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:28:38.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:28:38.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:28:38.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:28:38.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:28:38.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:28:38.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:28:38.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:28:38.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:28:38.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:28:38.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:28:38.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:28:38.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:28:38.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:28:38.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:28:38.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:28:38.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:28:38.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:28:38.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:28:38.866 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.866 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.866 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.866 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.866 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:38.867 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83497164400001, 2020-11-12T17:28:38.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:28:38.867 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.867 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.868 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:28:38.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.868 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:38.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:38.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:28:38.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:28:38.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:28:38.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:28:38.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:28:38.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:28:38.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:28:38.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:28:38.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:28:38.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:28:38.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:28:38.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:28:38.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:28:38.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:28:38.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:28:38.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:28:38.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:28:38.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:28:38.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:28:38.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:28:38.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:28:38.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:28:38.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:28:38.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:28:38.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:28:38.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:28:38.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:28:38.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:28:38.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:28:38.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:28:38.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:28:38.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.879 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.880 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.880 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:38.880 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.834775691, 2020-11-12T17:28:38.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:28:38.880 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.880 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.881 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.881 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.881 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.881 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:28:38.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.881 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:38.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:38.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:38.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:28:38.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:28:38.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:28:38.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:28:38.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:28:38.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:28:38.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:28:38.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:28:38.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:28:38.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:28:38.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:28:38.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:28:38.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:28:38.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:28:38.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:28:38.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:28:38.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:28:38.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:28:38.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:28:38.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:28:38.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:28:38.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:28:38.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:28:38.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:28:38.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:28:38.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:28:38.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:28:38.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:28:38.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:28:38.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:28:38.895 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.895 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.895 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.896 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.896 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:38.896 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83458208299999, 2020-11-12T17:28:38.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:28:38.896 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.896 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.896 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.896 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.897 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.897 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:28:38.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.897 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:38.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:38.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:28:38.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:28:38.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:28:38.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:28:38.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:28:38.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:28:38.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:28:38.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:28:38.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:28:38.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:28:38.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:28:38.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:28:38.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:28:38.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:28:38.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:28:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:28:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:28:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:28:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:28:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:28:38.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:28:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:28:38.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:28:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:28:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:28:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:28:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:28:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:28:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:28:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:28:38.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:28:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.910 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83427022000001, 2020-11-12T17:28:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:28:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.911 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:28:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:28:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:28:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:28:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:28:38.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:28:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:28:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:28:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:28:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:28:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:28:38.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:28:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:28:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:28:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:28:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:28:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:28:38.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:28:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:28:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:28:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:28:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:28:38.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:28:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:28:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:28:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:28:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:28:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:28:38.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:28:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:28:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:28:38.923 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.924 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.924 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83398272300002, 2020-11-12T17:28:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:28:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.926 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:28:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:28:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:28:38.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:28:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:28:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:28:38.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:28:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:28:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:28:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:28:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:28:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:28:38.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:28:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:28:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:28:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:28:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:28:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:28:38.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:28:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:28:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:28:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:28:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:28:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:28:38.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:28:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:28:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:28:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:28:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:28:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:28:38.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:28:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:28:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.939 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 318.83376235200001, 2020-11-12T17:28:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:28:38.940 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:28:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.941 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:28:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:28:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:28:38.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:28:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:28:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:28:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:28:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:28:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:28:38.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:28:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:28:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:28:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:28:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:28:38.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:28:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:28:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:28:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.948 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:28:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:28:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:28:38.949 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:28:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:28:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:28:38.950 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:28:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:28:38.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:28:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:28:38.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:28:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:28:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:28:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:28:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.954 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:28:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.92418336200001, 2020-11-12T17:28:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:28:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:28:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:28:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:28:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:28:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:28:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:28:38.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:28:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:28:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:28:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:28:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:28:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:28:38.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:28:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:28:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:28:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:28:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:28:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:28:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 94.849807601999998, 2020-11-12T17:28:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:28:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.963 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:28:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:28:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:28:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:28:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:28:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:28:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:28:38.967 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:28:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:28:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.968 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:28:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:28:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:28:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:28:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:28:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:28:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:28:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:28:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:28:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:28:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:28:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:28:38.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:28:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:28:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.973 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:28:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.079381235, 2020-11-12T17:28:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:28:38.974 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:28:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:28:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:28:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:28:38.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:28:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:28:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:28:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:28:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:28:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:28:38.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:28:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:28:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:28:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:28:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:28:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:28:38.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:28:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:28:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:28:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:28:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:28:38.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:28:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:28:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:28:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:28:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.071284202000001, 2020-11-12T17:28:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:28:38.985 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:38.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:28:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:38.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:28:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:28:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:28:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:28:38.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:28:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:28:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:28:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:28:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:28:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:28:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:28:38.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:28:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:28:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:28:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.992 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.993 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:38.993 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:38.993 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:38.993 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:38.995 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:38.994+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:39.098 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:39.092+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:39.126 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:39.128 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:39.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.129 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3367 6.9 e192/190 6:9c42034b:::benchmark_data_smithi036_29033_object420:head v 192'231, mlcod=192'224)", 2020-11-12T17:28:39.130 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.123542+0000", 2020-11-12T17:28:39.131 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0046324620000000004, 2020-11-12T17:28:39.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046513300000000004, 2020-11-12T17:28:39.133 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.134 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:39.134 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.123542+0000", 2020-11-12T17:28:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.123542+0000", 2020-11-12T17:28:39.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:39.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.123525+0000", 2020-11-12T17:28:39.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0505000000000003e-05 2020-11-12T17:28:39.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.123596+0000", 2020-11-12T17:28:39.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8285999999999998e-05 2020-11-12T17:28:39.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.123644+0000", 2020-11-12T17:28:39.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1190000000000002e-06 2020-11-12T17:28:39.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.123650+0000", 2020-11-12T17:28:39.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.6096000000000001e-05 2020-11-12T17:28:39.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.123686+0000", 2020-11-12T17:28:39.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4528999999999999e-05 2020-11-12T17:28:39.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.123701+0000", 2020-11-12T17:28:39.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000158448 2020-11-12T17:28:39.145 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.145 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.146 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.146 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3368 6.9 e192/190 6:9c42034b:::benchmark_data_smithi036_29033_object420:head v 192'232, mlcod=192'224)", 2020-11-12T17:28:39.146 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.124188+0000", 2020-11-12T17:28:39.146 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0039868969999999997, 2020-11-12T17:28:39.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004050026, 2020-11-12T17:28:39.146 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.147 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:39.147 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.124188+0000", 2020-11-12T17:28:39.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.124188+0000", 2020-11-12T17:28:39.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:28:39.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.124174+0000", 2020-11-12T17:28:39.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8174000000000003e-05 2020-11-12T17:28:39.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.124222+0000", 2020-11-12T17:28:39.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5231000000000001e-05 2020-11-12T17:28:39.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.124268+0000", 2020-11-12T17:28:39.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.425e-06 2020-11-12T17:28:39.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.124272+0000", 2020-11-12T17:28:39.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5284999999999998e-05 2020-11-12T17:28:39.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.124307+0000", 2020-11-12T17:28:39.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5284000000000001e-05 2020-11-12T17:28:39.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.124323+0000", 2020-11-12T17:28:39.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013472700000000001 2020-11-12T17:28:39.153 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.153 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.153 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.154 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.154 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:28:39.154 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 2 2020-11-12T17:28:39.154 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:39.155 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:39.203 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:39.202+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:39.278 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:39.279 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:39.279 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:39.279 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:39.280 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:39.291 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:39.302 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:39.300+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:39.404 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:39.402+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:39.447 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:28:39.448 INFO:teuthology.orchestra.run.smithi036.stderr:set osd.0 primary-affinity to 0 (802) 2020-11-12T17:28:39.464 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:39.465 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:39.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:39.466 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:39.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.466 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:28:39.467 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:39.468 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 330.62192406299999, 2020-11-12T17:28:39.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:28:39.468 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.468 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:39.469 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:39.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:39.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:39.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:28:39.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:28:39.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:28:39.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:28:39.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:28:39.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:28:39.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:28:39.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:28:39.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:28:39.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:28:39.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:28:39.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:28:39.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:28:39.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:28:39.751 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.751 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.751 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.751 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:39.752 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:39.752 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.061726841, 2020-11-12T17:28:39.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:28:39.752 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.752 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:39.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:39.753 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:39.753 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:28:39.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.753 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:39.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:39.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:28:39.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:28:39.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:28:39.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:28:39.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:28:39.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:28:39.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:28:39.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:28:39.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:28:39.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:28:39.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:28:39.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:28:39.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:39.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:28:39.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:28:39.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:39.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:28:39.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:28:39.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:39.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:28:39.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:28:39.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:28:39.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:28:39.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:28:39.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:28:39.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.766 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.767 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:28:39.767 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:39.767 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.05583451799998, 2020-11-12T17:28:39.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:28:39.767 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.767 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:28:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:28:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:28:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:28:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:28:39.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:28:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:28:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:28:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:28:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:28:39.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:28:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:28:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:28:39.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:28:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:28:39.879 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:28:39.881 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 294.92984424999997, 2020-11-12T17:28:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:28:39.882 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:39.883 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:28:39.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:28:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:28:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:28:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:28:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:28:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:28:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:28:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:28:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:28:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:28:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:28:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:28:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:28:39.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:28:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:28:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:28:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:28:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:28:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:28:39.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:28:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:28:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:28:39.893 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24584 3.d e45/20 ondisk, result = 0)", 2020-11-12T17:28:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 294.92254053099998, 2020-11-12T17:28:39.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002, 2020-11-12T17:28:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:39.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541831+0000", 2020-11-12T17:28:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999847 2020-11-12T17:28:39.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541815+0000", 2020-11-12T17:28:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9975000000000002e-05 2020-11-12T17:28:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541865+0000", 2020-11-12T17:28:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37295165899999999 2020-11-12T17:28:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914817+0000", 2020-11-12T17:28:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0199000000000001e-05 2020-11-12T17:28:39.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.914837+0000", 2020-11-12T17:28:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010285699999999999 2020-11-12T17:28:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915866+0000", 2020-11-12T17:28:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2559999999999996e-06 2020-11-12T17:28:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915873+0000", 2020-11-12T17:28:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010470400000000001 2020-11-12T17:28:39.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915978+0000", 2020-11-12T17:28:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37414719600000002 2020-11-12T17:28:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.902 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.903 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:28:39.903 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:39.903 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 294.54896203800001, 2020-11-12T17:28:39.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:28:39.903 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:28:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:39.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:28:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:28:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:28:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:28:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:28:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:28:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:28:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:28:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:28:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:28:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:28:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:28:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:28:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:28:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:28:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:28:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:39.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:28:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:28:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:28:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:28:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:28:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:28:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.913 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:28:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 294.53740891799998, 2020-11-12T17:28:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:28:39.914 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:28:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:28:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:28:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:28:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:28:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:28:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:28:39.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:28:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:28:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:28:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:28:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:28:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:28:39.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:28:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:28:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:39.921 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 289.464288737, 2020-11-12T17:28:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:28:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:39.922 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:28:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.923 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:28:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.924 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:28:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:28:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:28:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:28:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.925 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:28:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:28:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:28:39.926 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:28:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:28:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:28:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.927 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:28:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:28:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:28:39.928 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:28:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:28:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:28:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.929 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:28:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:28:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:28:39.930 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:28:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:28:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:28:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.931 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:28:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 182.75346434400001, 2020-11-12T17:28:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:28:39.932 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.933 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.934 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:28:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:28:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.935 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:28:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:28:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:28:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:28:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.936 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:28:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:28:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.937 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:28:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:28:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:28:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:28:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.938 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:28:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:28:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.939 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:28:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:28:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:28:39.940 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 177.42452181900001, 2020-11-12T17:28:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:28:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.941 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:28:39.942 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:28:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:28:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.943 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:28:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:28:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:28:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:28:39.944 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:28:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:28:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.945 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:28:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:28:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:28:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:28:39.946 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:28:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:28:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.947 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:28:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:28:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.948 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:28:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:39.949 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.83001396099999, 2020-11-12T17:28:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:28:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.950 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:28:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:28:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:28:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:28:39.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:28:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:28:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:28:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:28:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:28:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:28:39.954 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:28:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:28:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:28:39.955 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:28:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:28:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:28:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:28:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.957 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:28:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 158.627938833, 2020-11-12T17:28:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:28:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:39.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:28:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:28:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:28:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:28:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:28:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:28:39.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:28:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:28:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:28:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:28:39.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:28:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:28:39.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:28:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:28:39.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:28:39.966 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:28:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.967 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:28:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:39.968 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 146.585896432, 2020-11-12T17:28:39.969 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:28:39.969 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.969 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.969 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.969 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.970 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.970 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:39.970 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.970 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:39.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:28:39.971 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.971 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.971 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.971 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:28:39.971 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:28:39.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.972 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.972 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:28:39.972 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:28:39.972 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.972 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:28:39.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:28:39.973 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.973 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.973 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.973 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:28:39.973 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:28:39.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.974 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.974 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:28:39.974 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:28:39.974 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.974 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:28:39.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:28:39.975 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.975 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.975 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.975 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:28:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:28:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:28:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:28:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.976 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.977 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:28:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 102.50409554700001, 2020-11-12T17:28:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:28:39.978 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:28:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:28:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:28:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:28:39.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:28:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:28:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:28:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:28:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:28:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:28:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:28:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:28:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:28:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:28:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:28:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:28:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.985 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:25824 5.9 5:939cc28b:::benchmark_data_smithi036_24110_object3227:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e144)", 2020-11-12T17:28:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 85.997941655000005, 2020-11-12T17:28:39.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998, 2020-11-12T17:28:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:39.987 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 25824 2020-11-12T17:28:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:39.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466429+0000", 2020-11-12T17:28:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999719 2020-11-12T17:28:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466401+0000", 2020-11-12T17:28:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3675000000000001e-05 2020-11-12T17:28:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:39.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466485+0000", 2020-11-12T17:28:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0393e-05 2020-11-12T17:28:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466495+0000", 2020-11-12T17:28:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1100000000000002e-06 2020-11-12T17:28:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.466500+0000", 2020-11-12T17:28:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034414860000000001 2020-11-12T17:28:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:39.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.469942+0000", 2020-11-12T17:28:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8772999999999999e-05 2020-11-12T17:28:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470021+0000", 2020-11-12T17:28:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015431599999999999 2020-11-12T17:28:39.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.470175+0000", 2020-11-12T17:28:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001516643 2020-11-12T17:28:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.471692+0000", 2020-11-12T17:28:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.36737703500000002 2020-11-12T17:28:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839069+0000", 2020-11-12T17:28:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2213000000000006e-05 2020-11-12T17:28:39.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839161+0000", 2020-11-12T17:28:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8376999999999999e-05 2020-11-12T17:28:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:39.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:13.839239+0000", 2020-11-12T17:28:39.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37280987799999998 2020-11-12T17:28:39.997 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.997 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:39.997 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:39.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:39.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:39.998 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:28:39.998 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:39.998 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 80.245025569000006, 2020-11-12T17:28:39.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:28:39.999 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:39.999 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:39.999 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:40.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:40.000 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:40.000 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:28:40.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.000 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:40.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:40.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:40.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:40.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:40.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:40.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:40.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:40.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:28:40.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:28:40.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:40.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:28:40.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:28:40.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:40.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:28:40.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:40.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:40.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:28:40.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:28:40.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:40.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:28:40.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:28:40.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:40.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:28:40.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:28:40.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:40.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:28:40.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:28:40.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:40.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:28:40.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:28:40.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:40.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:28:40.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:28:40.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:40.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:28:40.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:28:40.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:40.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:28:40.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:28:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.153 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:28:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 80.235201067999995, 2020-11-12T17:28:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:28:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:40.154 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:40.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:40.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:40.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:28:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:28:40.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:28:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:28:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:28:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:28:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:28:40.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:28:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:28:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:28:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:28:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:28:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:28:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:28:40.165 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:28:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:40.166 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.889945236000003, 2020-11-12T17:28:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:28:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:40.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:40.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:28:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:28:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:40.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:28:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:28:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:28:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:28:40.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:28:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:28:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:40.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:28:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:28:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:28:40.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:28:40.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:28:40.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:28:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:40.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:28:40.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:28:40.375 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.375 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:40.375 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.376 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:28:40.376 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:40.376 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 38.568268322999998, 2020-11-12T17:28:40.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:28:40.376 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:40.376 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:40.377 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:40.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:40.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:40.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:40.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:40.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:40.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:28:40.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:40.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:28:40.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:28:40.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:40.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:28:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:28:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:28:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:28:40.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:28:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:28:40.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:28:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:28:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:28:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:28:40.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:28:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:28:40.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:28:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:28:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:40.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:28:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 26.486746456999999, 2020-11-12T17:28:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:28:40.387 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:28:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:28:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:28:40.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:28:40.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:40.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:28:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:28:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:28:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:28:40.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:40.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:28:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:28:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:28:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:28:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:28:40.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:28:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:40.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:28:40.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:28:40.586 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.586 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:40.587 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.587 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:40.587 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:40.587 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:40.588 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:40.728 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 3 16 3835 3819 9.94462 9.51562 0.0035485 0.0122544 2020-11-12T17:28:40.728 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 4 16 3907 3891 7.59904 0.5625 0.00933999 0.0164167 2020-11-12T17:28:40.728 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:40.112+0000 7f4de5aec700 -1 osd.1 192 handle_osd_map injecting map crc failure 2020-11-12T17:28:40.729 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:40.584+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:40.729 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:28:40.864 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:40.862+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:40.882 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:40.912 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:40.938 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:40.964 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:40.964 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:40.962+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:40.971 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:40.972 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:40.982 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:28:41.002 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:41.046 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:41.065 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:41.062+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:41.080 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:41.119 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:41.121 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:41.121 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:41.121 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:41.121 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:41.122 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:41.122 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:41.122 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:41.122 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:41.136 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:41.136 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:41.149 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:28:41.190 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:41.188+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:41.268 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:41.264+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:41.320 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:41.320 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:41.369 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:28:41.370 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:41.366+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:41.462 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:28:41.506 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:41.504+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:41.520 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 5 16 4859 4843 7.56658 7.4375 0.0101925 0.016422 2020-11-12T17:28:41.548 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:41.548 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:41.563 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:28:41.606 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:41.604+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:41.671 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:41.668+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:41.733 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:41.734 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:41.744 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:28:41.773 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:41.770+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:41.874 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:41.872+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:41.908 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:41.908 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:41.921 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:28:41.974 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:41.974+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:42.076 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:42.072+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:42.094 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:42.094 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:42.107 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:28:42.176 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:42.174+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:42.277 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:42.274+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:42.280 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:42.280 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:42.294 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:28:42.378 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:42.376+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:42.413 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:42.414 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:42.424 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:28:42.478 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:42.474+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:42.520 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 6 16 5958 5942 7.73635 8.58594 0.00558734 0.0160152 2020-11-12T17:28:42.579 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:42.578+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:42.590 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:42.590 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:42.603 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:28:42.653 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:28:42.691 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:42.686+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:42.728 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:42.728 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:42.741 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:28:42.789 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:42.784+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:42.867 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:42.868 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:42.880 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:42.927 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:42.926+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:42.991 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:42.988+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:43.003 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:43.004 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:43.015 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:43.092 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:43.088+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:43.132 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:43.182 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:43.182 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:43.191 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:43.192 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:43.188+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:43.294 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:43.292+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:43.296 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:43.314 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:43.315 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:43.326 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:43.327 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:43.361 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:43.392 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:43.395 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:43.392+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:43.421 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:43.441 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:43.442 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:43.449 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:43.452 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:43.481 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:43.495 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:43.492+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:43.513 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:43.515 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:43.516 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:43.516 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:43.516 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:43.516 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:43.517 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:43.517 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:43.517 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:43.520 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 7 16 7088 7072 7.8922 8.82812 0.00513146 0.0157684 2020-11-12T17:28:43.573 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:43.574 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:43.574 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:43.575 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:43.575 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:43.586 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:43.596 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:43.592+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:43.698 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:43.696+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:43.721 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:43.722 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:43.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:43.722 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:43.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.723 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:28:43.723 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:43.723 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 293.71636138500003, 2020-11-12T17:28:43.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:28:43.723 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.724 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.724 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:43.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:43.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:43.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:28:43.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:28:43.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:28:43.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:28:43.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:28:43.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:28:43.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:28:43.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:28:43.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:28:43.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:28:43.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:28:43.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:28:43.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:28:43.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:28:43.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:28:43.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:28:43.733 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.733 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.733 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.734 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:28:43.734 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:43.734 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 261.77637604199998, 2020-11-12T17:28:43.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:28:43.734 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.734 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.735 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.735 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:43.735 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:43.735 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:28:43.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.736 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:43.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:43.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:28:43.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:28:43.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:28:43.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:28:43.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:28:43.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:28:43.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:43.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:28:43.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:28:43.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:28:43.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:28:43.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:28:43.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:28:43.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:43.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:28:43.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:28:43.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:28:43.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:28:43.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:28:43.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:28:43.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:28:43.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:28:43.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:28:43.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:28:43.746 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.746 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.747 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.747 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:28:43.747 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:43.747 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 250.29927496799999, 2020-11-12T17:28:43.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:28:43.748 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.748 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:43.748 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:43.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:43.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:28:43.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:28:43.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:28:43.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:28:43.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:28:43.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:28:43.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:28:43.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:28:43.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:28:43.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:28:43.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:28:43.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:28:43.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:28:43.754 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.755 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.755 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:28:43.755 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:43.755 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 249.18026458099999, 2020-11-12T17:28:43.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:28:43.756 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.756 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:43.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:43.756 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:43.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.757 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:43.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:43.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:43.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:28:43.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:28:43.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:28:43.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:28:43.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:28:43.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:28:43.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:28:43.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:28:43.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:28:43.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:28:43.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:28:43.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:28:43.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:43.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:28:43.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:28:43.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:28:43.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:28:43.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:28:43.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:28:43.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:28:43.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:28:43.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:28:43.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:28:43.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.767 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.767 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.767 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:28:43.767 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:43.767 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 249.16412657699999, 2020-11-12T17:28:43.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:28:43.768 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.768 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:43.768 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:43.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:43.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:43.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:28:43.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:28:43.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:28:43.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:28:43.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:28:43.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:28:43.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:28:43.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:28:43.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:28:43.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:28:43.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:28:43.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:28:43.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:28:43.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:28:43.775 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.775 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.776 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.776 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:28:43.776 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:43.776 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 249.15939889800001, 2020-11-12T17:28:43.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:28:43.777 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.777 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:43.777 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.777 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:43.777 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:43.777 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:43.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.777 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:43.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:43.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:43.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:28:43.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:28:43.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:28:43.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:28:43.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:28:43.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:43.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:28:43.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:28:43.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:28:43.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:28:43.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:43.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:28:43.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:28:43.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:28:43.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:28:43.785 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.785 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.785 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.786 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:43.786 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:43.786 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.115636999, 2020-11-12T17:28:43.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:28:43.786 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.786 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:43.787 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:43.787 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:28:43.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.787 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:43.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:43.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:43.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:28:43.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:28:43.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:28:43.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:28:43.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:28:43.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:28:43.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:28:43.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:28:43.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:28:43.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:28:43.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:28:43.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:28:43.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:43.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:28:43.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:28:43.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:28:43.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:28:43.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:28:43.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:28:43.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:28:43.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:28:43.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:28:43.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:28:43.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.798 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.798 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.798 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:43.798 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.11374338600001, 2020-11-12T17:28:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:28:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:43.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:28:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:28:43.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:28:43.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:28:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:28:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:28:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:28:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:28:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:28:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:28:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:28:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:28:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:28:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:28:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:28:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:28:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:28:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:28:43.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:28:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:28:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:28:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:28:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:28:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.813 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:43.813 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:43.813 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.11299073800001, 2020-11-12T17:28:43.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:28:43.813 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:28:43.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:43.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:28:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:28:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:28:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:28:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:28:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:28:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:28:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:28:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:28:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:28:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:28:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:28:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:28:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:28:43.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:28:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:28:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:28:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:28:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:28:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:28:43.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:28:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:28:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.824 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.10982922100001, 2020-11-12T17:28:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:28:43.825 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:28:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.826 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:28:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:28:43.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:28:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:28:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:28:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:28:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:28:43.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:28:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:28:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:28:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:28:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:28:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:43.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:28:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:28:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:28:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:28:43.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:28:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:28:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:28:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:28:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:28:43.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:28:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:43.836 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.10874805399999, 2020-11-12T17:28:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:28:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:43.837 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:28:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:43.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:28:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:28:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:28:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:28:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:28:43.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:28:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:28:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:28:43.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:28:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:28:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:28:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:28:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:43.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:28:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:28:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:28:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:28:43.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:28:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:28:43.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:28:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:28:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:28:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:28:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.10857896100001, 2020-11-12T17:28:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:28:43.849 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:28:43.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:28:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:28:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:28:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:28:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:28:43.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:28:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:28:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:28:43.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:28:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:28:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:28:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:28:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:28:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:28:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:28:43.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:28:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:28:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:28:43.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:28:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:28:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:28:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:28:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.105960315, 2020-11-12T17:28:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:28:43.862 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:28:43.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:28:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:28:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:28:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:28:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:28:43.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:28:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:28:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:28:43.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:28:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:28:43.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:28:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:28:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:28:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:28:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:28:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:28:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:28:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:28:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:28:43.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:28:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:28:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:28:43.874 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:43.875 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.10585223199999, 2020-11-12T17:28:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:28:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:43.876 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:28:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:28:43.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:28:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:28:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:28:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:28:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:28:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:28:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:28:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:28:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:28:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:28:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:28:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:28:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:28:43.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:28:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:28:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:28:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:28:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:28:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:28:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:28:43.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:28:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.888 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:28:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 143.10188955000001, 2020-11-12T17:28:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:28:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:43.889 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:28:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:28:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:28:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:28:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:28:43.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:28:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:28:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:28:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:28:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:28:43.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:28:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:28:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:28:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:28:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:28:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.896 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:28:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 100.064159809, 2020-11-12T17:28:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:28:43.897 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:43.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:43.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:28:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:28:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:28:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:28:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:28:43.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:28:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:28:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:28:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:28:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:28:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:28:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:28:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:28:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:28:43.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:28:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:28:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.905 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:28:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.550757124, 2020-11-12T17:28:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:28:43.906 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:43.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:28:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:28:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:28:43.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:28:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:28:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:28:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:28:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:28:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:43.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:28:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:28:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:28:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:28:43.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:28:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:28:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:43.913 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.556 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:44.557 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:44.557 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.214447239000002, 2020-11-12T17:28:44.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:28:44.557 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:44.558 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:44.558 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:44.558 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:44.558 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:44.559 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:28:44.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.560 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:44.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:44.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:44.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:44.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:44.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:44.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:44.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:44.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:28:44.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:28:44.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:44.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:28:44.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:28:44.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:44.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:28:44.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:28:44.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:44.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:28:44.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:28:44.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:28:44.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:28:44.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:28:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:28:44.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:44.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:28:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:28:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:44.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:28:44.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:28:44.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:44.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:28:44.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:28:44.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:44.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:28:44.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:28:44.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:44.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:28:44.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:28:44.588 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.588 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:44.588 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.589 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:28:44.589 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:44.589 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.196839113000003, 2020-11-12T17:28:44.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:28:44.589 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:44.589 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:44.590 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:44.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:44.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:44.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:44.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:44.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:44.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:44.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:44.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:28:44.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:28:44.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:44.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:28:44.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:28:44.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:44.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:28:44.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:28:44.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:44.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:28:44.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:28:44.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:44.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:28:44.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:28:44.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:44.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:28:44.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:28:44.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:44.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:28:44.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:28:44.597 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.597 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:44.597 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.598 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(5.7 184/180 [PushReplyOp(5:e5a77d6d:::benchmark_data_smithi036_24110_object6672:head)])", 2020-11-12T17:28:44.598 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:44.598 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 19.802916191000001, 2020-11-12T17:28:44.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002, 2020-11-12T17:28:44.598 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:44.598 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:44.599 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:44.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:44.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:44.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:44.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:44.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:44.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:28:44.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:44.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918950+0000", 2020-11-12T17:28:44.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8150999999999999e-05 2020-11-12T17:28:44.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:44.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.919008+0000", 2020-11-12T17:28:44.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41560975 2020-11-12T17:28:44.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:44.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334617+0000", 2020-11-12T17:28:44.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5324000000000001e-05 2020-11-12T17:28:44.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:44.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334633+0000", 2020-11-12T17:28:44.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016332299999999999 2020-11-12T17:28:44.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:44.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334796+0000", 2020-11-12T17:28:44.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010469629999999999 2020-11-12T17:28:44.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:44.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.335843+0000", 2020-11-12T17:28:44.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002 2020-11-12T17:28:44.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.607 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:44.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.607 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:44.608 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:44.608 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 0, 1] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:44.609 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:44.609 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump -f json-pretty 2020-11-12T17:28:44.610 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 8 16 8234 8218 8.02472 8.95312 0.0446688 0.0155217 2020-11-12T17:28:44.611 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:44.612 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:44.606+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:44.669 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:28:44.710 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:44.710+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:44.773 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:44.773 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:44.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.774 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:8312 6.5 6:a05980dc:::benchmark_data_smithi036_29033_object1038:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e195)", 2020-11-12T17:28:44.774 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:44.589519+0000", 2020-11-12T17:28:44.774 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.18617278300000001, 2020-11-12T17:28:44.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.18620156400000001, 2020-11-12T17:28:44.774 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:44.775 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:44.775 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:44.775 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:44.775 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:44.775 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 8312 2020-11-12T17:28:44.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.775 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:44.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:44.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.589519+0000", 2020-11-12T17:28:44.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:44.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:44.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.589519+0000", 2020-11-12T17:28:44.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999752 2020-11-12T17:28:44.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:44.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.589494+0000", 2020-11-12T17:28:44.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9703000000000007e-05 2020-11-12T17:28:44.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:44.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.589564+0000", 2020-11-12T17:28:44.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5109999999999992e-06 2020-11-12T17:28:44.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:44.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.589574+0000", 2020-11-12T17:28:44.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3799999999999999e-06 2020-11-12T17:28:44.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:44.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.589580+0000", 2020-11-12T17:28:44.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019698649999999999 2020-11-12T17:28:44.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:44.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.591550+0000", 2020-11-12T17:28:44.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6713999999999998e-05 2020-11-12T17:28:44.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:44.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.591626+0000", 2020-11-12T17:28:44.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000122865 2020-11-12T17:28:44.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:44.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.591749+0000", 2020-11-12T17:28:44.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034457009999999998 2020-11-12T17:28:44.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:44.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:44.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:44.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:44.595195+0000", 2020-11-12T17:28:44.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056760409999999997 2020-11-12T17:28:44.782 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.783 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:44.783 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.783 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:44.783 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:28:44.783 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:28:44.783 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:44.784 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:44.811 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:44.808+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:44.913 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:44.908+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:44.951 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:44.952 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:44.952 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:44.952 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:44.953 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:44.963 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:44.965 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:28:44.965 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:44.965 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 195, 2020-11-12T17:28:44.966 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "8c8a6bcc-49d4-47d1-904f-e20798ef8e1f", 2020-11-12T17:28:44.966 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2020-11-12T17:22:37.581394+0000", 2020-11-12T17:28:44.967 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2020-11-12T17:28:42.643224+0000", 2020-11-12T17:28:44.967 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2020-11-12T17:25:55.942493+0000", 2020-11-12T17:28:44.967 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2020-11-12T17:28:33.422645+0000", 2020-11-12T17:28:44.968 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-11-12T17:28:44.968 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2020-11-12T17:28:44.968 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2020-11-12T17:28:44.968 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2020-11-12T17:28:44.969 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2020-11-12T17:28:44.969 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2020-11-12T17:28:44.969 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2020-11-12T17:28:44.970 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:44.970 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 4, 2020-11-12T17:28:44.970 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2020-11-12T17:28:44.971 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-11-12T17:28:44.971 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2020-11-12T17:28:44.971 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2020-11-12T17:28:44.972 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 6, 2020-11-12T17:28:44.972 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2020-11-12T17:28:44.972 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2020-11-12T17:28:44.973 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2020-11-12T17:28:44.973 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2020-11-12T17:28:44.973 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2020-11-12T17:28:44.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:44.974 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2020-11-12T17:28:44.974 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2020-11-12T17:28:44.975 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:41.596657+0000", 2020-11-12T17:28:44.975 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:28:44.975 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:28:44.976 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:28:44.976 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:28:44.976 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:28:44.976 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:28:44.977 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:28:44.977 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:28:44.977 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2020-11-12T17:28:44.978 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2020-11-12T17:28:44.978 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2020-11-12T17:28:44.978 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2020-11-12T17:28:44.979 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2020-11-12T17:28:44.979 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:28:44.979 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:28:44.980 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:28:44.980 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:28:44.980 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:28:44.981 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:28:44.981 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:28:44.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:44.981 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "16", 2020-11-12T17:28:44.982 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:28:44.982 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:28:44.982 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:28:44.982 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:28:44.982 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:28:44.982 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:28:44.983 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:28:44.983 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:28:44.983 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:28:44.983 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:28:44.983 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:28:44.983 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:28:44.984 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:28:44.984 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:28:44.984 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:28:44.984 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:28:44.984 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:28:44.984 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:28:44.984 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:28:44.985 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:28:44.985 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:28:44.985 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:28:44.985 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:28:44.985 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:28:44.985 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:28:44.985 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:28:44.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:44.986 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:28:44.986 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:28:44.986 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:28:44.986 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:28:44.986 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:28:44.987 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:28:44.987 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:28:44.987 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:28:44.987 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:28:44.987 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:28:44.987 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:28:44.987 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2020-11-12T17:28:44.988 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2020-11-12T17:28:44.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:44.988 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:28:44.988 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2020-11-12T17:28:44.988 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:44.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:44.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:44.989 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2020-11-12T17:28:44.989 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2020-11-12T17:28:44.989 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:22:49.905816+0000", 2020-11-12T17:28:44.989 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:28:44.989 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:28:44.989 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:28:44.989 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:28:44.989 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:28:44.990 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:28:44.990 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:28:44.990 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:28:44.990 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 18, 2020-11-12T17:28:44.990 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 18, 2020-11-12T17:28:44.990 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 18, 2020-11-12T17:28:44.991 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 18, 2020-11-12T17:28:44.991 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 18, 2020-11-12T17:28:44.991 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:28:44.991 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:28:44.991 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:28:44.991 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:28:44.991 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:28:44.992 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:28:44.992 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:28:44.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:44.992 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "165", 2020-11-12T17:28:44.992 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:28:44.992 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:28:44.992 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "163", 2020-11-12T17:28:44.993 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:28:44.993 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:28:44.993 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:28:44.993 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:28:44.993 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:28:44.993 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:28:44.993 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:28:44.994 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:28:44.994 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:28:44.994 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:28:44.994 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:28:44.994 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:28:44.994 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:28:44.994 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:28:44.995 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:28:44.995 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:28:44.995 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:28:44.995 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:28:44.995 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:28:44.995 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:28:44.995 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:28:44.996 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:28:44.996 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:28:44.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:44.996 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:28:44.996 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:28:44.996 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:28:44.996 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:28:44.997 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:28:44.997 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:28:44.997 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:28:44.997 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:28:44.997 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:28:44.997 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:28:44.997 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:28:44.998 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:28:44.998 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:28:44.998 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2020-11-12T17:28:44.998 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:44.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:44.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:44.998 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 6, 2020-11-12T17:28:44.999 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "unique_pool_3", 2020-11-12T17:28:44.999 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2020-11-12T17:28:33.923168+0000", 2020-11-12T17:28:44.999 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2020-11-12T17:28:44.999 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2020-11-12T17:28:44.999 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2020-11-12T17:28:44.999 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2020-11-12T17:28:44.999 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 2, 2020-11-12T17:28:45.000 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2020-11-12T17:28:45.000 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2020-11-12T17:28:45.000 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2020-11-12T17:28:45.000 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 16, 2020-11-12T17:28:45.000 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 16, 2020-11-12T17:28:45.000 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 16, 2020-11-12T17:28:45.000 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 16, 2020-11-12T17:28:45.001 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 16, 2020-11-12T17:28:45.001 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2020-11-12T17:28:45.001 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2020-11-12T17:28:45.001 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2020-11-12T17:28:45.001 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2020-11-12T17:28:45.001 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2020-11-12T17:28:45.001 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2020-11-12T17:28:45.002 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2020-11-12T17:28:45.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.002 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "192", 2020-11-12T17:28:45.002 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2020-11-12T17:28:45.002 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2020-11-12T17:28:45.002 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2020-11-12T17:28:45.002 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2020-11-12T17:28:45.003 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2020-11-12T17:28:45.003 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2020-11-12T17:28:45.003 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2020-11-12T17:28:45.003 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2020-11-12T17:28:45.003 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2020-11-12T17:28:45.003 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2020-11-12T17:28:45.003 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2020-11-12T17:28:45.004 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2020-11-12T17:28:45.004 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2020-11-12T17:28:45.004 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2020-11-12T17:28:45.004 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2020-11-12T17:28:45.004 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2020-11-12T17:28:45.004 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2020-11-12T17:28:45.004 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2020-11-12T17:28:45.005 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-11-12T17:28:45.005 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-11-12T17:28:45.005 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2020-11-12T17:28:45.005 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2020-11-12T17:28:45.005 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2020-11-12T17:28:45.005 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2020-11-12T17:28:45.005 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2020-11-12T17:28:45.005 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2020-11-12T17:28:45.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.006 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2020-11-12T17:28:45.006 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2020-11-12T17:28:45.006 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2020-11-12T17:28:45.006 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2020-11-12T17:28:45.006 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2020-11-12T17:28:45.006 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2020-11-12T17:28:45.007 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2020-11-12T17:28:45.007 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2020-11-12T17:28:45.007 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2020-11-12T17:28:45.007 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2020-11-12T17:28:45.007 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2020-11-12T17:28:45.007 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2020-11-12T17:28:45.007 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2020-11-12T17:28:45.008 INFO:teuthology.orchestra.run.smithi036.stdout: "rados": {} 2020-11-12T17:28:45.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.008 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:45.008 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2020-11-12T17:28:45.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.008 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:28:45.009 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "bd1d5457-5d54-4074-b378-9da417f42976", 2020-11-12T17:28:45.009 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:45.009 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:45.009 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:45.009 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 0, 2020-11-12T17:28:45.009 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:45.010 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:45.010 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:45.010 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 190, 2020-11-12T17:28:45.010 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:45.010 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:45.010 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:45.010 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.011 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.011 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6801", 2020-11-12T17:28:45.011 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:45.011 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.011 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.012 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:45.012 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.012 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.012 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2020-11-12T17:28:45.012 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:45.012 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.013 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.013 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:45.013 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.013 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.013 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2020-11-12T17:28:45.014 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:45.014 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.014 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.014 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:45.014 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.015 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.015 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2020-11-12T17:28:45.015 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12304 2020-11-12T17:28:45.015 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.015 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.015 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6801/12304", 2020-11-12T17:28:45.016 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6802/12304", 2020-11-12T17:28:45.016 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6806/12304", 2020-11-12T17:28:45.016 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6804/12304", 2020-11-12T17:28:45.016 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:45.016 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:45.016 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:45.016 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.017 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:28:45.017 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "37152eee-a8d8-40f1-8e27-2899e7b94c98", 2020-11-12T17:28:45.017 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:45.017 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:45.017 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:45.018 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:45.018 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:28:45.018 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 57, 2020-11-12T17:28:45.018 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 88, 2020-11-12T17:28:45.018 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 190, 2020-11-12T17:28:45.018 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 58, 2020-11-12T17:28:45.018 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:45.019 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:45.019 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.019 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.019 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2020-11-12T17:28:45.019 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:45.019 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.020 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.020 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:45.020 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.020 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.020 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2020-11-12T17:28:45.021 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:45.021 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.021 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.021 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:45.021 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.022 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.022 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2020-11-12T17:28:45.022 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:45.022 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.022 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.023 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:45.023 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.023 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.023 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2020-11-12T17:28:45.023 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 20274 2020-11-12T17:28:45.023 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.023 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.024 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/20274", 2020-11-12T17:28:45.024 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6814/20274", 2020-11-12T17:28:45.024 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6816/20274", 2020-11-12T17:28:45.024 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6815/20274", 2020-11-12T17:28:45.024 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:45.024 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:45.025 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:45.025 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.025 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:28:45.025 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "d8ec2abb-38bf-4863-969a-482c4fa44f41", 2020-11-12T17:28:45.025 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:45.026 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:45.026 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:45.026 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:45.026 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 14, 2020-11-12T17:28:45.026 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 93, 2020-11-12T17:28:45.026 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 102, 2020-11-12T17:28:45.027 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 190, 2020-11-12T17:28:45.027 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 94, 2020-11-12T17:28:45.027 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:45.027 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:45.027 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.027 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.028 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2020-11-12T17:28:45.028 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:45.028 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.028 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.028 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:45.028 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.029 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.029 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2020-11-12T17:28:45.029 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:45.029 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.029 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.030 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:45.030 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.030 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.030 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2020-11-12T17:28:45.030 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:45.030 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.031 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.031 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:45.031 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.031 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.031 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2020-11-12T17:28:45.032 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 21493 2020-11-12T17:28:45.032 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.032 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.032 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/21493", 2020-11-12T17:28:45.032 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/21493", 2020-11-12T17:28:45.032 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6808/21493", 2020-11-12T17:28:45.032 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/21493", 2020-11-12T17:28:45.033 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:45.033 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:45.033 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:45.033 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.033 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:28:45.034 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "799d3499-577c-4510-a00c-9b2e126fc449", 2020-11-12T17:28:45.034 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:45.034 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:45.034 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:45.034 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:45.034 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:45.035 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:45.035 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:45.035 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 193, 2020-11-12T17:28:45.035 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:45.035 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:45.035 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:45.035 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2020-11-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.036 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:45.037 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.037 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.037 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2020-11-12T17:28:45.037 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:45.037 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.037 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.038 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:45.038 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.038 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.038 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2020-11-12T17:28:45.038 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:45.039 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.039 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.039 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:45.039 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.040 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.040 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2020-11-12T17:28:45.040 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12305 2020-11-12T17:28:45.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.040 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.041 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6809/12305", 2020-11-12T17:28:45.041 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6810/12305", 2020-11-12T17:28:45.041 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6813/12305", 2020-11-12T17:28:45.041 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6811/12305", 2020-11-12T17:28:45.041 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:45.041 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:45.041 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:45.042 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.042 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:28:45.042 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "c36e3100-aadc-4117-b495-24fb08a34148", 2020-11-12T17:28:45.042 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:45.042 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:45.043 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:45.043 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 0, 2020-11-12T17:28:45.043 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:45.043 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:45.043 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:45.043 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 193, 2020-11-12T17:28:45.044 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:45.044 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:45.044 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:45.044 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.044 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.044 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6804", 2020-11-12T17:28:45.045 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:45.045 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.045 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.045 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:45.045 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.046 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.046 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6805", 2020-11-12T17:28:45.046 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:45.046 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.046 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.046 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:45.047 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.047 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.047 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6807", 2020-11-12T17:28:45.047 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:45.047 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.047 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.048 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:45.048 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.048 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.048 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6806", 2020-11-12T17:28:45.048 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12499 2020-11-12T17:28:45.049 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.049 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.049 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6804/12499", 2020-11-12T17:28:45.049 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6805/12499", 2020-11-12T17:28:45.049 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6807/12499", 2020-11-12T17:28:45.049 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6806/12499", 2020-11-12T17:28:45.050 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:45.050 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:45.050 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:45.050 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.051 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:28:45.051 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "b152141f-b530-448e-8dff-fe200559eff0", 2020-11-12T17:28:45.051 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:45.051 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:45.051 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:45.051 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:45.051 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:45.052 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:45.052 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:45.052 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 190, 2020-11-12T17:28:45.052 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:45.052 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:45.052 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:45.052 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.053 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.053 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6808", 2020-11-12T17:28:45.053 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:45.053 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.053 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.054 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:45.054 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.054 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.054 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6810", 2020-11-12T17:28:45.054 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:45.054 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.055 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.055 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:45.055 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.055 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.055 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6814", 2020-11-12T17:28:45.056 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:45.056 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.056 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.056 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:45.056 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.057 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.057 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6812", 2020-11-12T17:28:45.057 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12525 2020-11-12T17:28:45.057 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.057 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.057 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6808/12525", 2020-11-12T17:28:45.058 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6810/12525", 2020-11-12T17:28:45.058 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6814/12525", 2020-11-12T17:28:45.058 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6812/12525", 2020-11-12T17:28:45.058 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:45.058 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:45.058 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:45.059 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.059 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:28:45.059 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "62a140ba-7f94-4bb6-8a62-fda077f81354", 2020-11-12T17:28:45.059 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:45.059 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:45.060 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:45.060 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2020-11-12T17:28:45.060 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:45.060 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:45.060 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:45.060 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 190, 2020-11-12T17:28:45.060 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:45.061 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:45.061 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:45.061 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.061 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.061 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6809", 2020-11-12T17:28:45.061 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:45.062 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.062 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.062 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:45.062 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.062 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.063 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6811", 2020-11-12T17:28:45.063 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:45.063 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.063 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.063 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:45.064 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.064 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.064 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6815", 2020-11-12T17:28:45.064 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:45.064 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.064 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.065 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:45.065 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.065 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.065 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6813", 2020-11-12T17:28:45.065 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12524 2020-11-12T17:28:45.066 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.066 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.066 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6809/12524", 2020-11-12T17:28:45.066 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6811/12524", 2020-11-12T17:28:45.066 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6815/12524", 2020-11-12T17:28:45.066 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6813/12524", 2020-11-12T17:28:45.067 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:45.067 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:45.067 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:45.067 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.067 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:28:45.068 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "32879bd7-780c-4da6-9838-5850b6277902", 2020-11-12T17:28:45.068 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2020-11-12T17:28:45.068 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2020-11-12T17:28:45.068 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2020-11-12T17:28:45.068 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 0, 2020-11-12T17:28:45.068 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2020-11-12T17:28:45.068 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2020-11-12T17:28:45.069 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 14, 2020-11-12T17:28:45.069 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 193, 2020-11-12T17:28:45.069 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2020-11-12T17:28:45.069 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2020-11-12T17:28:45.069 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2020-11-12T17:28:45.069 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.070 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.070 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6800", 2020-11-12T17:28:45.070 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:45.070 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.070 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.071 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2020-11-12T17:28:45.071 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.071 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.071 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6801", 2020-11-12T17:28:45.071 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:45.072 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.072 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.072 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2020-11-12T17:28:45.072 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.073 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.073 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6803", 2020-11-12T17:28:45.073 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:45.073 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.073 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.074 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2020-11-12T17:28:45.074 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2020-11-12T17:28:45.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.074 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2020-11-12T17:28:45.074 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.205:6802", 2020-11-12T17:28:45.074 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 12522 2020-11-12T17:28:45.074 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.075 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.075 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.205:6800/12522", 2020-11-12T17:28:45.075 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.205:6801/12522", 2020-11-12T17:28:45.075 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.205:6803/12522", 2020-11-12T17:28:45.075 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.205:6802/12522", 2020-11-12T17:28:45.075 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2020-11-12T17:28:45.076 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2020-11-12T17:28:45.076 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2020-11-12T17:28:45.076 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:45.076 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.076 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:45.076 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2020-11-12T17:28:45.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.077 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2020-11-12T17:28:45.077 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:45.077 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:45.077 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:45.077 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:45.077 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:45.077 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:44.606542+0000", 2020-11-12T17:28:45.078 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:45.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.078 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2020-11-12T17:28:45.078 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:45.078 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:45.079 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:45.079 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:45.079 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:45.079 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:28:34.032657+0000", 2020-11-12T17:28:45.079 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 58 2020-11-12T17:28:45.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.080 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2020-11-12T17:28:45.080 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:45.080 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:45.080 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:45.080 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:45.080 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:45.080 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:57.104840+0000", 2020-11-12T17:28:45.081 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 94 2020-11-12T17:28:45.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.081 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2020-11-12T17:28:45.081 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:45.081 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:45.081 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:45.082 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:45.082 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:45.082 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:47.239812+0000", 2020-11-12T17:28:45.082 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:45.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.082 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2020-11-12T17:28:45.083 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:45.083 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:45.083 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:45.083 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:45.083 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:45.083 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:46.300658+0000", 2020-11-12T17:28:45.084 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:45.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.084 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2020-11-12T17:28:45.084 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:45.084 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:45.084 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:45.085 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:45.085 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:45.085 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:47.757739+0000", 2020-11-12T17:28:45.085 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:45.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.086 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2020-11-12T17:28:45.086 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:45.086 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:45.086 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:45.086 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:45.086 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:45.087 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:44.608417+0000", 2020-11-12T17:28:45.087 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:45.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:45.087 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2020-11-12T17:28:45.087 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2020-11-12T17:28:45.087 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2020-11-12T17:28:45.088 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2020-11-12T17:28:45.088 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2020-11-12T17:28:45.088 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2020-11-12T17:28:45.088 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2020-11-12T17:27:46.424553+0000", 2020-11-12T17:28:45.088 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2020-11-12T17:28:45.088 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.088 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2020-11-12T17:28:45.089 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2020-11-12T17:28:45.089 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2020-11-12T17:28:45.089 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2020-11-12T17:28:45.089 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2020-11-12T17:28:45.089 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2020-11-12T17:28:45.089 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2020-11-12T17:28:45.090 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2020-11-12T17:28:45.090 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2020-11-12T17:28:45.090 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2020-11-12T17:28:45.090 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2020-11-12T17:28:45.090 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2020-11-12T17:28:45.090 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2020-11-12T17:28:45.091 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2020-11-12T17:28:45.091 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:45.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:45.091 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2020-11-12T17:28:45.091 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2020-11-12T17:28:45.091 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2020-11-12T17:28:45.091 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2020-11-12T17:28:45.092 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2020-11-12T17:28:45.092 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:45.094 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:45.090+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:45.095 INFO:tasks.thrashosds.thrasher:j is {'epoch': 195, 'fsid': '8c8a6bcc-49d4-47d1-904f-e20798ef8e1f', 'created': '2020-11-12T17:22:37.581394+0000', 'modified': '2020-11-12T17:28:42.643224+0000', 'last_up_change': '2020-11-12T17:25:55.942493+0000', 'last_in_change': '2020-11-12T17:28:33.422645+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 6, 'max_osd': 8, 'require_min_compat_client': 'jewel', 'min_compat_client': 'jewel', 'require_osd_release': 'octopus', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '163', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'unique_pool_3', 'create_time': '2020-11-12T17:28:33.923168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'bd1d5457-5d54-4074-b378-9da417f42976', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 190, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6801', 'nonce': 12304}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6802', 'nonce': 12304}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6806', 'nonce': 12304}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6804', 'nonce': 12304}]}, 'public_addr': '172.21.15.36:6801/12304', 'cluster_addr': '172.21.15.36:6802/12304', 'heartbeat_back_addr': '172.21.15.36:6806/12304', 'heartbeat_front_addr': '172.21.15.36:6804/12304', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '37152eee-a8d8-40f1-8e27-2899e7b94c98', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 57, 'up_from': 88, 'up_thru': 190, 'down_at': 58, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6812', 'nonce': 20274}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6814', 'nonce': 20274}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6816', 'nonce': 20274}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6815', 'nonce': 20274}]}, 'public_addr': '172.21.15.36:6812/20274', 'cluster_addr': '172.21.15.36:6814/20274', 'heartbeat_back_addr': '172.21.15.36:6816/20274', 'heartbeat_front_addr': '172.21.15.36:6815/20274', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'd8ec2abb-38bf-4863-969a-482c4fa44f41', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 14, 'last_clean_end': 93, 'up_from': 102, 'up_thru': 190, 'down_at': 94, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6803', 'nonce': 21493}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6805', 'nonce': 21493}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6808', 'nonce': 21493}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6807', 'nonce': 21493}]}, 'public_addr': '172.21.15.36:6803/21493', 'cluster_addr': '172.21.15.36:6805/21493', 'heartbeat_back_addr': '172.21.15.36:6808/21493', 'heartbeat_front_addr': '172.21.15.36:6807/21493', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '799d3499-577c-4510-a00c-9b2e126fc449', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 193, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6809', 'nonce': 12305}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6810', 'nonce': 12305}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6813', 'nonce': 12305}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.36:6811', 'nonce': 12305}]}, 'public_addr': '172.21.15.36:6809/12305', 'cluster_addr': '172.21.15.36:6810/12305', 'heartbeat_back_addr': '172.21.15.36:6813/12305', 'heartbeat_front_addr': '172.21.15.36:6811/12305', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c36e3100-aadc-4117-b495-24fb08a34148', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 193, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6804', 'nonce': 12499}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6805', 'nonce': 12499}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6807', 'nonce': 12499}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6806', 'nonce': 12499}]}, 'public_addr': '172.21.15.205:6804/12499', 'cluster_addr': '172.21.15.205:6805/12499', 'heartbeat_back_addr': '172.21.15.205:6807/12499', 'heartbeat_front_addr': '172.21.15.205:6806/12499', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b152141f-b530-448e-8dff-fe200559eff0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 190, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6808', 'nonce': 12525}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6810', 'nonce': 12525}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6814', 'nonce': 12525}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6812', 'nonce': 12525}]}, 'public_addr': '172.21.15.205:6808/12525', 'cluster_addr': '172.21.15.205:6810/12525', 'heartbeat_back_addr': '172.21.15.205:6814/12525', 'heartbeat_front_addr': '172.21.15.205:6812/12525', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '62a140ba-7f94-4bb6-8a62-fda077f81354', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 190, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6809', 'nonce': 12524}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6811', 'nonce': 12524}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6815', 'nonce': 12524}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6813', 'nonce': 12524}]}, 'public_addr': '172.21.15.205:6809/12524', 'cluster_addr': '172.21.15.205:6811/12524', 'heartbeat_back_addr': '172.21.15.205:6815/12524', 'heartbeat_front_addr': '172.21.15.205:6813/12524', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '32879bd7-780c-4da6-9838-5850b6277902', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 193, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6800', 'nonce': 12522}]}, 'cluster_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6801', 'nonce': 12522}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6803', 'nonce': 12522}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.205:6802', 'nonce': 12522}]}, 'public_addr': '172.21.15.205:6800/12522', 'cluster_addr': '172.21.15.205:6801/12522', 'heartbeat_back_addr': '172.21.15.205:6803/12522', 'heartbeat_front_addr': '172.21.15.205:6802/12522', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:44.606542+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:28:34.032657+0000', 'dead_epoch': 58}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:57.104840+0000', 'dead_epoch': 94}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:47.239812+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:46.300658+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:47.757739+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:44.608417+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138292840890367, 'old_weight': 0, 'last_purged_snaps_scrub': '2020-11-12T17:27:46.424553+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blacklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}} 2020-11-12T17:28:45.096 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2020-11-12T17:28:45.096 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:45.096 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:28:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:45.097 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41688699299999, 2020-11-12T17:28:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:28:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.098 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:28:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:45.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:28:45.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:28:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:28:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:28:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:28:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:28:45.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:28:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:28:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:28:45.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:28:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:28:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:28:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:28:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:28:45.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:28:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:28:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:28:45.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:28:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:28:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:28:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:28:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41648463199999, 2020-11-12T17:28:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:28:45.109 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:28:45.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:28:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:28:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:28:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:28:45.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:28:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:28:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:28:45.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:28:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:28:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:28:45.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:28:45.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:28:45.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:28:45.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:28:45.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:28:45.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:28:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:28:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:28:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:28:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:28:45.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:28:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:28:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:28:45.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:28:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:28:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:28:45.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:28:45.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:28:45.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:28:45.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:28:45.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:28:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.124 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:45.125 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.416160639, 2020-11-12T17:28:45.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:28:45.125 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.125 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.125 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.125 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:28:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:45.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:45.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:28:45.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:28:45.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:28:45.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:28:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:28:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:28:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:28:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:28:45.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:28:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:28:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:28:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:28:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:28:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:28:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:28:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:28:45.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:28:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:28:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:28:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:28:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:28:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:28:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:28:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:28:45.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:28:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:28:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:28:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:28:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:28:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:28:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:28:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.139 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.415916928, 2020-11-12T17:28:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:28:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.140 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:28:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:45.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:28:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:28:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:28:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:28:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:28:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:28:45.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:28:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:28:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:28:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:28:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:28:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:28:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:28:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:28:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:28:45.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:28:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:28:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:28:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:28:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:28:45.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:28:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:28:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:28:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:28:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:28:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:28:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:28:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:28:45.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:28:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:28:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:28:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.153 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.415678781, 2020-11-12T17:28:45.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:28:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:28:45.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:28:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:28:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:28:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:28:45.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:28:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:28:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:28:45.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:28:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:28:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:28:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:28:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:28:45.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:28:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:28:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:28:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:28:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:28:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:28:45.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:28:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:28:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:28:45.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:28:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:28:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:28:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:28:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:28:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:28:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:28:45.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:28:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:28:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:28:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.168 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:45.169 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41547674100002, 2020-11-12T17:28:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:28:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.170 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:28:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:28:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:28:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:28:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:28:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:28:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:28:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:28:45.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:28:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:28:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:28:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:28:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:28:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:28:45.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:28:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:28:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:28:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:28:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:28:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:28:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:28:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:28:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:28:45.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:28:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:28:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:28:45.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:28:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:28:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:28:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:28:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:28:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:28:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41527137100002, 2020-11-12T17:28:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:28:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.185 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:28:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.186 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:28:45.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:28:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:28:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:28:45.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:28:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:28:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:28:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:28:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:28:45.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:28:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:28:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:28:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:28:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:28:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:28:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:28:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:28:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:28:45.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:28:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:28:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:28:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:28:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:28:45.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:28:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:28:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:28:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:28:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:28:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:28:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:28:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41508554400002, 2020-11-12T17:28:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:28:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:28:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:28:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:28:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:28:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:28:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:28:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:28:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:28:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:28:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:28:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:28:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:28:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:28:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:28:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:28:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:28:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:28:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:28:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:28:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:28:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:28:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:28:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:28:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:28:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:28:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:28:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:28:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:28:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:28:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:28:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:28:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.220 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.220 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41488858000002, 2020-11-12T17:28:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:28:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.223 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.223 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:28:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:28:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:28:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:28:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:28:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:28:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:28:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:28:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:28:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:28:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:28:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:28:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:28:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:28:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:28:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:28:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:28:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:28:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:28:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:28:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:28:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:28:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:28:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:28:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:28:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:28:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:28:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:28:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:28:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:28:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:28:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:28:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41469254999998, 2020-11-12T17:28:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:28:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:28:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:28:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:28:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:28:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:28:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:28:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:28:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:28:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:28:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:28:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:28:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:28:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:28:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:28:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:28:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:28:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:28:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:28:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:28:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:28:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:28:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:28:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:28:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:28:45.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:28:45.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:28:45.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:28:45.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:28:45.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:28:45.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:28:45.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:28:45.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.253 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.253 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.254 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.254 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:45.254 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41451174999997, 2020-11-12T17:28:45.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:28:45.255 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.255 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.255 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.255 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:28:45.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.256 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:45.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:45.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:28:45.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:28:45.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:28:45.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:28:45.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:28:45.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:28:45.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:28:45.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:28:45.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:28:45.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:28:45.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:28:45.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:28:45.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:28:45.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:28:45.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:28:45.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:28:45.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:28:45.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:28:45.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:28:45.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:28:45.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:28:45.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:28:45.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:28:45.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:28:45.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:28:45.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:28:45.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:28:45.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:28:45.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:28:45.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:28:45.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:28:45.269 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.269 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.269 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.270 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.270 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:45.270 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41431579699997, 2020-11-12T17:28:45.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:28:45.271 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.271 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.271 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.271 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.271 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.271 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:28:45.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.272 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:45.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:45.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:45.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:28:45.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:28:45.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:28:45.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:28:45.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:28:45.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:28:45.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:28:45.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:28:45.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:28:45.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:28:45.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:28:45.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:28:45.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:28:45.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:28:45.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:28:45.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:28:45.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:28:45.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:28:45.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:28:45.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:28:45.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:28:45.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:28:45.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:28:45.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:28:45.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:28:45.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:28:45.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:28:45.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:28:45.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:28:45.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:28:45.285 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.285 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.285 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.285 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.286 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:45.286 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41412218900001, 2020-11-12T17:28:45.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:28:45.286 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.286 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.286 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.287 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.287 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.287 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:28:45.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.287 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:45.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:45.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:28:45.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:28:45.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:28:45.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:28:45.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:28:45.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:28:45.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:28:45.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:28:45.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:28:45.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:28:45.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:28:45.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:28:45.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:28:45.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:28:45.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:28:45.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:28:45.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:28:45.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:28:45.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:28:45.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:28:45.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:28:45.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:28:45.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:28:45.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:28:45.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:28:45.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:28:45.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:28:45.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:28:45.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:28:45.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:28:45.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:28:45.305 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.305 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.305 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.306 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.306 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:45.306 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41381032599998, 2020-11-12T17:28:45.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:28:45.306 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.307 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.307 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.307 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.308 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.308 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:28:45.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.309 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:45.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:45.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:28:45.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:28:45.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:28:45.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:28:45.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:28:45.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:28:45.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:28:45.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:28:45.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:28:45.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:28:45.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:28:45.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:28:45.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:28:45.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:28:45.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:28:45.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:28:45.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:28:45.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:28:45.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:28:45.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:28:45.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:28:45.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:28:45.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:28:45.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:28:45.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:28:45.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:28:45.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:28:45.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:28:45.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:28:45.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:28:45.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:28:45.323 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.324 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.324 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.324 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.324 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:45.325 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41352282899999, 2020-11-12T17:28:45.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:28:45.325 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.325 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.325 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.325 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.325 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.326 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:28:45.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.326 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:45.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:45.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:28:45.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:28:45.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:28:45.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.328 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:28:45.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:28:45.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:28:45.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:28:45.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:28:45.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:28:45.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:28:45.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:28:45.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:28:45.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:28:45.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:28:45.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:28:45.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:28:45.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:28:45.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:28:45.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:28:45.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:28:45.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:28:45.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:28:45.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:28:45.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:28:45.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:28:45.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:28:45.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:28:45.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:28:45.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:28:45.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:28:45.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:28:45.339 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.339 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.339 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.340 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:45.340 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:45.340 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 325.41330245799998, 2020-11-12T17:28:45.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:28:45.340 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.340 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.341 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.341 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.341 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.341 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:28:45.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.341 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:45.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:45.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:28:45.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:28:45.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:28:45.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:28:45.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:28:45.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:28:45.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:28:45.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:28:45.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:28:45.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:28:45.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:28:45.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:45.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:28:45.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:28:45.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:28:45.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:28:45.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:45.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:28:45.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:28:45.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:28:45.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:28:45.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:28:45.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:28:45.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:45.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:28:45.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:28:45.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:28:45.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:28:45.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:28:45.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:28:45.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:28:45.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:28:45.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:28:45.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:28:45.354 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.354 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.355 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.355 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:28:45.355 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:45.355 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 163.503723468, 2020-11-12T17:28:45.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:28:45.356 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.356 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.356 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:45.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:45.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:28:45.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:28:45.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:28:45.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:28:45.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:28:45.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:28:45.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:28:45.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:28:45.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:28:45.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:28:45.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:28:45.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:28:45.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:28:45.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:28:45.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:28:45.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:28:45.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:28:45.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.363 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.364 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:28:45.364 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:45.364 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 101.42934770799999, 2020-11-12T17:28:45.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:28:45.364 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.365 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.365 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.365 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:45.365 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:45.365 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:28:45.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.365 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:45.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:45.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:45.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:28:45.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:28:45.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:28:45.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:28:45.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:28:45.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:28:45.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:28:45.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:28:45.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:28:45.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:28:45.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:28:45.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:28:45.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:45.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:28:45.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:28:45.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:28:45.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:28:45.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:28:45.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:28:45.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:28:45.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:28:45.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:28:45.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:28:45.375 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.375 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.375 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.376 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:28:45.376 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:45.376 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 70.658921340999996, 2020-11-12T17:28:45.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:28:45.377 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.377 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.377 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.377 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:45.377 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:45.377 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:28:45.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.378 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:45.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:45.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:28:45.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:28:45.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:28:45.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:28:45.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:28:45.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:28:45.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:28:45.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:28:45.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:28:45.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:28:45.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:28:45.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:28:45.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:28:45.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:45.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:28:45.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:28:45.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:28:45.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:28:45.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:28:45.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:28:45.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:28:45.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:28:45.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:28:45.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:28:45.387 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.388 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.388 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.388 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:28:45.388 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:45.388 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 70.650824307999997, 2020-11-12T17:28:45.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:28:45.389 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.389 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:45.389 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:45.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:45.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:28:45.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:28:45.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:28:45.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:28:45.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:28:45.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:28:45.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:28:45.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:28:45.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:28:45.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:28:45.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:28:45.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:28:45.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:28:45.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:28:45.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:28:45.396 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.396 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.396 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.396 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.396 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.397 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:45.399 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:45.399 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:28:45.400 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:45.396+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:45.500 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:45.496+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:45.520 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 9 16 9363 9347 8.11303 8.82031 0.00905347 0.0153837 2020-11-12T17:28:45.527 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:45.558 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:45.559 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:45.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.559 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:9399 6.9 e196/190 6:9f23550e:::benchmark_data_smithi036_29033_object1174:head v 196'575, mlcod=196'572)", 2020-11-12T17:28:45.559 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:45.559976+0000", 2020-11-12T17:28:45.560 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00026638500000000001, 2020-11-12T17:28:45.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029356599999999999, 2020-11-12T17:28:45.560 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.560 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:45.561 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:45.559976+0000", 2020-11-12T17:28:45.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:45.559976+0000", 2020-11-12T17:28:45.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:45.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:45.559963+0000", 2020-11-12T17:28:45.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8381999999999999e-05 2020-11-12T17:28:45.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:45.560011+0000", 2020-11-12T17:28:45.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1819000000000001e-05 2020-11-12T17:28:45.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:45.560043+0000", 2020-11-12T17:28:45.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3729999999999998e-06 2020-11-12T17:28:45.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:45.560049+0000", 2020-11-12T17:28:45.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0788000000000003e-05 2020-11-12T17:28:45.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:45.560090+0000", 2020-11-12T17:28:45.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7248000000000002e-05 2020-11-12T17:28:45.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:45.560108+0000", 2020-11-12T17:28:45.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013130499999999999 2020-11-12T17:28:45.568 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.569 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.569 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:28:45.569 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:28:45.570 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:45.571 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:45.600 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:45.596+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:45.689 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:45.689 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:45.690 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:45.690 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:45.690 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:45.701 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:45.702 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:45.703 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:45.700+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:45.726 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:45.757 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:45.792 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:45.803 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:45.800+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:45.819 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:45.831 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:45.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:28:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 336.98347803399997, 2020-11-12T17:28:45.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:28:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:45.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:28:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:28:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:28:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:28:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:28:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:28:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:28:45.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:28:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:28:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:28:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:28:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:28:45.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:28:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:28:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:28:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.839 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 331.42328081199997, 2020-11-12T17:28:45.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:28:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.841 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:28:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:45.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:28:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:45.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:28:45.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:28:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:28:45.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:28:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:28:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:28:45.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:28:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:28:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:28:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:28:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:28:45.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:28:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:28:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:28:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:28:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:28:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:28:45.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:28:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:28:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:28:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:28:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:28:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:28:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 331.41738848900002, 2020-11-12T17:28:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:28:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:45.853 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:28:45.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:28:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:28:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:28:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:28:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:28:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:28:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:28:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:28:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:28:45.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:28:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:28:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:28:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:28:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:28:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:28:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:28:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 301.29139822100001, 2020-11-12T17:28:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:28:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.862 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:28:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:28:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:28:45.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:28:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:28:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:28:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:28:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:28:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:28:45.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:28:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:28:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:28:45.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:28:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:28:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:28:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:28:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:45.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:28:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:28:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:28:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:28:45.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:28:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:28:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:28:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:28:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:45.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:28:45.874 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 300.91051600899999, 2020-11-12T17:28:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:28:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:45.887 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:28:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:45.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:28:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:45.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:28:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:28:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:45.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:28:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:28:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:45.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:28:46.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:28:46.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:28:46.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:28:46.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:28:46.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:28:46.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:28:46.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:28:46.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:46.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:28:46.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:28:46.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:46.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:28:46.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:28:46.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:46.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:28:46.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:28:46.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:28:46.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:28:46.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:28:46.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:28:46.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.040 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.040 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:28:46.040 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:46.040 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 300.89896288900002, 2020-11-12T17:28:46.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:28:46.041 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.041 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:46.041 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:46.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:28:46.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:46.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:28:46.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:28:46.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:28:46.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:28:46.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:28:46.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:28:46.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:28:46.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:28:46.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:28:46.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:28:46.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:28:46.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:28:46.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:28:46.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:28:46.048 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.048 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.048 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.048 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:28:46.048 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:46.048 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 295.82584270799998, 2020-11-12T17:28:46.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:28:46.049 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.049 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.049 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:46.049 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:46.049 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:46.049 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:28:46.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.050 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:46.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:28:46.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:28:46.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:28:46.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:28:46.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:28:46.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:28:46.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:28:46.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:28:46.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:28:46.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:28:46.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:28:46.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:28:46.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:28:46.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:28:46.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:46.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:28:46.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:28:46.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:46.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:28:46.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:28:46.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:46.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:28:46.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:28:46.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:28:46.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:28:46.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:28:46.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:28:46.058 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.058 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.059 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:28:46.059 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:46.059 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 189.11501831499999, 2020-11-12T17:28:46.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:28:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:28:46.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:46.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:28:46.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:28:46.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:28:46.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:28:46.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:28:46.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:28:46.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:28:46.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:28:46.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:28:46.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:28:46.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:28:46.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:28:46.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:28:46.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:28:46.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:28:46.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:28:46.066 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.066 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.067 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.067 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:28:46.067 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:46.067 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 183.78607579000001, 2020-11-12T17:28:46.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:28:46.067 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.068 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.068 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:46.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:28:46.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:28:46.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:28:46.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:28:46.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:28:46.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:28:46.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:28:46.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:28:46.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:28:46.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:28:46.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:28:46.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:28:46.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:28:46.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:28:46.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:28:46.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:28:46.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:28:46.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:28:46.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.075 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.075 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.075 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:28:46.075 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:46.075 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 169.191567932, 2020-11-12T17:28:46.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:28:46.076 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.076 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.076 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:46.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:28:46.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:28:46.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:28:46.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:28:46.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:28:46.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:28:46.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:28:46.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:28:46.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:28:46.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:28:46.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:28:46.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:28:46.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:28:46.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:28:46.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:28:46.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:28:46.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:28:46.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:28:46.084 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.085 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.085 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.085 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:28:46.085 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:46.085 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 164.98949280400001, 2020-11-12T17:28:46.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:28:46.086 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.086 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.086 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:46.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:28:46.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:46.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:28:46.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:28:46.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:28:46.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:28:46.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:28:46.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:28:46.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:28:46.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:28:46.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:28:46.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:28:46.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:28:46.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:28:46.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:28:46.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:28:46.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:28:46.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:28:46.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.093 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.093 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:28:46.093 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:46.094 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 152.947450403, 2020-11-12T17:28:46.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:28:46.094 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.094 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.094 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:46.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:28:46.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:28:46.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:28:46.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:28:46.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:28:46.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:28:46.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:28:46.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:28:46.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:28:46.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:28:46.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:28:46.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:28:46.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:28:46.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:28:46.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:28:46.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:28:46.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:28:46.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:28:46.101 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.101 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.101 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.101 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:28:46.102 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:46.102 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 108.865649518, 2020-11-12T17:28:46.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:28:46.102 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.102 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.102 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:46.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:28:46.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:46.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:28:46.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:28:46.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:28:46.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:28:46.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:28:46.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:28:46.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:28:46.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:28:46.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:28:46.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:28:46.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:28:46.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:28:46.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:28:46.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:28:46.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:28:46.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:28:46.109 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.109 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.109 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.109 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:28:46.110 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:46.110 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 86.606579539999998, 2020-11-12T17:28:46.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:28:46.110 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.110 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:46.110 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:46.111 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:46.111 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:28:46.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.111 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:46.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:28:46.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:46.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:28:46.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:28:46.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:28:46.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:28:46.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:28:46.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:46.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:28:46.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:28:46.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:28:46.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:28:46.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:28:46.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:28:46.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:46.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:28:46.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:28:46.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:46.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:28:46.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:28:46.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:46.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:28:46.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:28:46.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:28:46.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:28:46.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:28:46.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:28:46.120 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.120 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.120 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.120 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:28:46.121 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:46.122 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 86.596755039000001, 2020-11-12T17:28:46.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:28:46.122 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.123 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:46.123 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:46.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:28:46.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:46.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:28:46.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:28:46.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:28:46.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:28:46.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:28:46.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:28:46.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:28:46.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:28:46.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:28:46.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:28:46.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:28:46.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:28:46.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:28:46.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:28:46.129 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.129 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.129 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.129 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:28:46.130 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:46.130 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 46.251499207000002, 2020-11-12T17:28:46.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:28:46.130 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.130 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.130 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:46.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:28:46.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:28:46.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:28:46.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:28:46.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:28:46.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:28:46.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:28:46.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:28:46.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:28:46.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:28:46.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:28:46.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:28:46.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:28:46.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:28:46.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:28:46.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:28:46.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:28:46.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:28:46.137 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.137 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.137 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.137 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:28:46.137 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:46.138 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 44.929822293999997, 2020-11-12T17:28:46.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:28:46.138 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.138 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.138 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:46.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:28:46.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:28:46.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:28:46.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:28:46.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:28:46.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:28:46.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:28:46.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:28:46.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:28:46.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:28:46.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:28:46.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:28:46.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:28:46.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:28:46.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:28:46.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:28:46.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:28:46.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:28:46.144 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.145 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.145 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.145 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:28:46.145 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:46.145 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 32.848300428000002, 2020-11-12T17:28:46.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:28:46.146 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.146 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.146 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:46.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:28:46.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:46.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:28:46.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:28:46.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:28:46.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:28:46.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:28:46.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:28:46.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:28:46.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:28:46.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:28:46.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:28:46.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:28:46.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:28:46.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:28:46.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:28:46.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:28:46.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:28:46.152 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.152 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.153 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.153 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3791 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'231, mlcod=192'223)", 2020-11-12T17:28:46.153 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:28:46.153 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.3884583859999999, 2020-11-12T17:28:46.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001, 2020-11-12T17:28:46.153 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.154 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.154 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:28:46.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:28:46.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:28:46.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437443+0000", 2020-11-12T17:28:46.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1434999999999995e-05 2020-11-12T17:28:46.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437525+0000", 2020-11-12T17:28:46.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42555852399999999 2020-11-12T17:28:46.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863083+0000", 2020-11-12T17:28:46.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4397e-05 2020-11-12T17:28:46.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863098+0000", 2020-11-12T17:28:46.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019535099999999999 2020-11-12T17:28:46.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863293+0000", 2020-11-12T17:28:46.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4679999999999996e-05 2020-11-12T17:28:46.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863368+0000", 2020-11-12T17:28:46.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001951045 2020-11-12T17:28:46.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865319+0000", 2020-11-12T17:28:46.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016422 2020-11-12T17:28:46.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865483+0000", 2020-11-12T17:28:46.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001 2020-11-12T17:28:46.160 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.160 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.161 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.161 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3792 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'232, mlcod=192'225)", 2020-11-12T17:28:46.161 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:28:46.161 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.3879617580000003, 2020-11-12T17:28:46.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498, 2020-11-12T17:28:46.161 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:46.162 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:46.162 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:46.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:46.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:28:46.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:46.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:46.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:28:46.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:28:46.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:46.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437930+0000", 2020-11-12T17:28:46.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108421 2020-11-12T17:28:46.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:46.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.438038+0000", 2020-11-12T17:28:46.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46508600999999999 2020-11-12T17:28:46.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:46.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903124+0000", 2020-11-12T17:28:46.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3366e-05 2020-11-12T17:28:46.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:46.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903138+0000", 2020-11-12T17:28:46.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9920000000000006e-05 2020-11-12T17:28:46.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:46.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903228+0000", 2020-11-12T17:28:46.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2246999999999997e-05 2020-11-12T17:28:46.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:46.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903270+0000", 2020-11-12T17:28:46.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017774449999999999 2020-11-12T17:28:46.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:46.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905047+0000", 2020-11-12T17:28:46.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4606999999999997e-05 2020-11-12T17:28:46.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:46.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:46.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:46.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905142+0000", 2020-11-12T17:28:46.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498 2020-11-12T17:28:46.168 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.168 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.168 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.169 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:46.169 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:46.169 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:46.170 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:46.171 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:46.171 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:46.171 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:46.171 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:46.171 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:46.172 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:46.172 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:46.172 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:46.172 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:46.172 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:46.172 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:46.168+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:46.173 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:28:46.272 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:46.270+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:46.334 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:46.335 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:46.351 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:28:46.398 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:46.396+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:46.473 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:46.470+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:46.476 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:46.476 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:46.486 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:28:46.520 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 10 16 10414 10398 8.12275 8.21094 0.00552138 0.0153146 2020-11-12T17:28:46.573 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:46.570+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:46.640 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:46.640 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:46.652 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:28:46.675 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:46.674+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:46.776 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:46.772+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:46.783 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:46.783 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:46.795 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:28:46.877 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:46.874+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:46.960 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:46.960 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:46.972 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:28:46.977 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:46.974+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:47.078 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:47.076+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:47.108 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:47.108 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:47.121 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:28:47.179 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:47.178+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:47.277 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:47.272+0000 7f038ead6700 -1 osd.2 196 handle_osd_map injecting map crc failure 2020-11-12T17:28:47.280 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:47.278+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:47.286 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:47.282+0000 7f928515c700 -1 osd.7 196 handle_osd_map injecting map crc failure 2020-11-12T17:28:47.296 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:47.296 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:47.309 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:28:47.381 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:47.376+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:47.401 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:28:47.427 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:47.424+0000 7f4dea6fe700 -1 osd.1 197 handle_osd_map injecting map crc failure 2020-11-12T17:28:47.438 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:47.439 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:47.450 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:28:47.494 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:47.492+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:47.520 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 11 16 11616 11600 8.23793 9.39062 0.00726167 0.0151219 2020-11-12T17:28:47.583 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:47.578+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:47.617 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:47.617 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:47.630 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:28:47.718 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:47.716+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:47.784 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:47.780+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:47.812 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:47.813 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:47.825 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:28:47.911 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:47.908+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:47.986 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:47.984+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:47.987 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:47.987 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:47.998 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:28:48.087 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:48.084+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:48.146 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:48.146 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:48.155 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:48.173 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:48.198 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:48.196+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:48.269 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:48.269 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:48.279 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:48.288 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:48.284+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:48.361 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:48.388 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:48.388 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:48.389 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:48.397 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:48.418 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:48.447 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:48.491 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:48.488+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:48.521 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 12 16 12287 12271 7.98825 5.24219 0.442922 0.0152113 2020-11-12T17:28:48.551 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:48.551 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:48.561 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:48.660 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:48.606+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:48.665 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:48.386+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:48.675 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:48.675 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:48.686 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:28:48.688 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:48.697 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:48.725 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:48.731 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:48.730+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:48.746 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:48.672+0000 7fc24d2e3700 -1 osd.3 198 handle_osd_map injecting map crc failure 2020-11-12T17:28:48.758 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:48.793 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:48.793 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:48.790+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:48.794 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:48.794 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:48.794 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:48.794 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:48.795 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:48.795 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:48.795 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:48.795 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:48.796 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:48.796 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:48.796 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:48.796 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:48.797 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:48.807 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:48.899 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:48.897+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:48.975 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:48.975 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:28:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:48.976 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 298.96910670599999, 2020-11-12T17:28:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:28:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:48.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:48.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:28:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:28:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:28:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:28:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:28:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:28:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:48.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:28:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:28:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:28:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:28:48.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:28:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:28:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:28:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:28:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:28:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:28:48.984 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:28:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:48.985 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 267.029121363, 2020-11-12T17:28:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:28:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:48.986 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:28:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:48.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:28:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:28:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:28:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:28:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:28:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:48.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:28:48.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:48.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:48.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:28:48.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:28:48.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:48.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:28:48.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:28:48.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:48.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:48.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:48.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:28:48.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:28:48.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:49.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:28:49.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:28:49.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:49.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:28:49.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:28:49.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:49.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:28:49.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:28:49.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:49.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:28:49.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:28:49.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:49.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:28:49.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:28:49.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.406 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:49.406 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.407 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:28:49.407 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:49.407 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 255.55202028900001, 2020-11-12T17:28:49.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:28:49.407 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:49.408 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:49.408 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:49.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:49.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:49.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:49.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:49.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:49.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:28:49.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:49.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:28:49.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:28:49.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:49.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:28:49.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:28:49.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:49.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:28:49.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:28:49.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:49.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:28:49.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:28:49.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:49.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:28:49.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:28:49.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:49.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:28:49.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:28:49.414 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.415 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:49.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.415 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:28:49.415 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:49.416 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 254.43300990200001, 2020-11-12T17:28:49.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:28:49.416 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:49.416 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:49.416 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:49.416 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:49.417 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:49.417 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:49.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.417 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:49.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:49.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:49.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:49.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:49.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:49.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:49.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:49.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:28:49.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:28:49.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:49.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:28:49.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:28:49.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:49.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:28:49.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:28:49.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:49.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:28:49.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:28:49.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:49.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:28:49.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:28:49.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:49.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:28:49.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:28:49.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:49.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:28:49.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:28:49.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:49.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:28:49.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:28:49.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:49.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:28:49.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:28:49.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:49.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:28:49.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:28:49.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:49.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:28:49.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:28:49.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.428 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:49.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.429 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:28:49.429 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:49.429 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 254.41687189800001, 2020-11-12T17:28:49.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:28:49.429 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:49.429 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:49.430 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:49.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:49.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:49.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:49.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:49.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:49.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:49.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:49.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:28:49.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:28:49.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:49.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:28:49.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:28:49.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:49.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:28:49.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:28:49.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:49.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:28:49.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:28:49.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:49.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:28:49.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:28:49.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:49.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:28:49.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:28:49.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:49.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:28:49.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:28:49.437 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.437 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:49.438 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.438 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:28:49.438 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:49.438 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 254.412144219, 2020-11-12T17:28:49.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:28:49.439 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:49.439 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:49.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:49.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:49.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:49.440 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:49.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.440 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:49.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:49.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:49.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:49.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:49.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:49.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:49.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:49.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:28:49.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:28:49.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:49.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:28:49.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:28:49.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:49.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:28:49.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:49.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:49.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:28:49.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:28:49.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:49.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:28:49.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:28:49.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:49.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:28:49.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:28:49.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:49.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:28:49.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:28:49.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.448 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:49.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.449 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:49.449 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:49.449 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.36838231999999, 2020-11-12T17:28:49.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:28:49.449 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:49.450 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:49.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:49.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:49.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:49.450 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:28:49.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.658 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:49.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:28:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:28:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:28:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:28:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:28:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:28:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:28:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:28:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:28:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:28:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:28:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:28:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:28:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:28:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:28:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:28:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:28:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:28:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:28:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:28:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:28:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:28:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:49.670 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.366488707, 2020-11-12T17:28:49.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:28:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:28:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:28:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:28:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:28:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:28:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:28:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:28:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:28:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:28:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:28:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:28:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:28:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:28:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:28:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:28:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:28:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:28:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:28:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:28:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:28:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:28:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:28:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:28:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.365736059, 2020-11-12T17:28:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:28:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:28:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:28:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:28:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:28:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:28:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:28:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:28:49.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:49.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:28:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:28:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:28:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:28:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:28:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:28:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:28:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:28:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:28:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:28:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:28:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:28:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:28:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:28:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:28:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:28:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.362574542, 2020-11-12T17:28:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:28:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:28:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:28:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:28:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:28:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:28:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:28:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:28:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:28:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:28:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:28:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:28:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:28:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:28:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.950 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:28:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:28:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:28:51.951 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:28:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:28:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:28:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.952 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:28:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:28:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:28:51.953 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:28:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:51.954 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.36149337500001, 2020-11-12T17:28:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:28:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:51.955 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:28:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:51.956 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:51.957 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:28:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:28:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:28:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:28:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:28:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:28:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:28:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:28:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:28:51.960 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:28:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:28:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:28:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.961 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:28:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:28:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:28:51.962 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:28:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:28:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:28:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.963 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:28:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:28:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:28:51.964 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:28:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:51.965 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.803 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:53.803 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:53.803 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.361324282, 2020-11-12T17:28:53.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:28:53.804 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:53.805 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:53.805 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:53.805 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:53.806 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:53.806 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:28:53.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.807 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:53.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:53.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:53.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:53.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:53.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:53.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:53.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:53.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:28:53.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:28:53.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:53.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:28:53.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:28:53.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:53.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:28:53.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:28:53.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:53.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:28:53.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:28:53.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:28:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:28:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:53.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:28:53.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:28:53.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:53.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:28:53.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:28:53.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:53.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:28:53.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:28:53.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:28:53.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:28:53.821 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.821 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.821 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.822 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:53.822 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:53.823 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.358705636, 2020-11-12T17:28:53.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:28:53.823 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:53.824 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:53.824 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:53.824 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:53.824 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:53.824 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:28:53.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.825 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:53.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:53.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:53.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:53.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:28:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:28:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:28:53.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:28:53.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:28:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:28:53.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:28:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:28:53.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:28:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:28:53.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:28:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:28:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:28:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:28:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:53.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:28:53.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:28:53.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:28:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:28:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:53.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:28:53.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:28:53.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:28:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:28:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.35859755300001, 2020-11-12T17:28:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:28:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:53.840 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:28:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:53.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:53.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:28:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:28:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:28:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:28:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:28:53.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:28:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:28:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:28:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:53.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:28:53.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:28:53.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:28:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:28:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:53.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:28:53.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:28:53.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:53.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:28:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:28:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:28:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:28:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:28:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:28:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:28:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:28:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.851 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:28:53.852 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:53.852 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 148.354634871, 2020-11-12T17:28:53.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:28:53.852 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:53.852 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:53.852 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:53.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:53.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:53.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:53.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:53.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:53.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:28:53.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:53.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:28:53.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:28:53.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:53.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:28:53.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:28:53.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:53.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:28:53.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:28:53.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:53.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:28:53.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:28:53.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:53.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:28:53.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:28:53.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:53.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:28:53.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:28:53.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:53.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:28:53.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:28:53.860 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.860 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.861 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:28:53.861 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:53.861 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 105.31690512999999, 2020-11-12T17:28:53.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:28:53.862 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:53.862 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:53.862 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:53.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:53.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:53.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:53.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:53.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:53.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:53.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:53.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:28:53.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:28:53.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:53.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:28:53.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:28:53.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:53.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:28:53.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:28:53.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:53.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:28:53.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:28:53.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:53.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:28:53.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:28:53.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:53.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:28:53.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:28:53.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:53.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:28:53.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:28:53.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:53.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:28:53.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:28:53.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.878 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.878 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.879 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:28:53.879 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:53.879 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.803502444999999, 2020-11-12T17:28:53.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:28:53.880 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:53.880 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:53.880 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:53.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:53.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:53.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:53.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:53.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:53.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:53.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:53.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:28:53.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:28:53.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:53.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:28:53.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:28:53.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:53.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:28:53.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:28:53.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:53.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:28:53.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:28:53.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:53.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:28:53.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:28:53.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:53.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:28:53.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:28:53.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:53.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:28:53.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:28:53.888 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.888 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.889 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.889 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:53.889 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:53.889 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.467192560000001, 2020-11-12T17:28:53.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:28:53.890 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:53.890 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:53.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:53.890 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:53.891 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:53.891 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:28:53.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.891 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:53.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:53.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:53.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:53.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:53.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:53.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:53.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:53.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:28:53.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:28:53.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:53.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:28:53.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:28:53.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:53.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:28:53.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:28:53.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:53.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:28:53.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:28:53.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:53.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:28:53.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:28:53.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.898 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.899 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:53.899 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:28:53.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:28:53.899 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:53.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:28:53.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:28:53.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:53.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:28:53.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:28:53.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:53.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:28:53.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:28:53.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:53.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:28:53.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:28:53.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:53.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:28:53.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:28:53.905 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.905 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.906 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.906 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:28:53.907 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:53.907 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 49.449584434000002, 2020-11-12T17:28:53.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:28:53.907 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:53.907 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:53.907 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:53.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:53.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:53.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:53.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.909 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:53.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:53.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:53.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.910 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.910 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:53.910 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:28:53.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:28:53.910 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:53.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:28:53.911 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:28:53.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.911 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:53.911 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:28:53.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:28:53.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.912 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:53.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:28:53.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:28:53.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:53.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:28:53.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:28:53.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:53.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:28:53.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:28:53.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:53.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:28:53.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:28:53.915 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.915 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.915 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.916 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(5.7 184/180 [PushReplyOp(5:e5a77d6d:::benchmark_data_smithi036_24110_object6672:head)])", 2020-11-12T17:28:53.916 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:53.916 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.055661512, 2020-11-12T17:28:53.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002, 2020-11-12T17:28:53.917 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:53.917 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:53.917 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:53.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:53.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:53.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:53.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:53.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918973+0000", 2020-11-12T17:28:53.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:28:53.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:53.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.918950+0000", 2020-11-12T17:28:53.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8150999999999999e-05 2020-11-12T17:28:53.919 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.919 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.919 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:53.919 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:23.919008+0000", 2020-11-12T17:28:53.919 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41560975 2020-11-12T17:28:53.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:53.920 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334617+0000", 2020-11-12T17:28:53.920 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5324000000000001e-05 2020-11-12T17:28:53.920 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.920 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.920 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:53.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334633+0000", 2020-11-12T17:28:53.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016332299999999999 2020-11-12T17:28:53.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.921 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.921 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:53.921 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.334796+0000", 2020-11-12T17:28:53.921 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0010469629999999999 2020-11-12T17:28:53.921 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:53.922 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:53.922 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:53.922 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:24.335843+0000", 2020-11-12T17:28:53.922 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41687025300000002 2020-11-12T17:28:53.922 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.922 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.923 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.923 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:53.923 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:53.923 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:53.924 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 0, 1] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:53.924 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:53.924 INFO:tasks.thrashosds.thrasher:inject_pause on 5 2020-11-12T17:28:53.925 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2020-11-12T17:28:53.925 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2020-11-12T17:28:53.926 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2020-11-12T17:28:53.945 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:28:53.946 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:53.948 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 13 16 13275 13259 7.96747 7.71875 0.00933476 0.0156123 2020-11-12T17:28:53.948 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 14 16 14456 14440 8.05734 9.22656 0.0192343 0.0154794 2020-11-12T17:28:53.948 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 15 16 15356 15340 7.98889 7.03125 0.0101459 0.0156114 2020-11-12T17:28:53.949 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 16 16 16221 16205 7.91191 6.75781 0.00589435 0.0157779 2020-11-12T17:28:53.949 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 17 15 17454 17439 8.01355 9.64062 0.0113867 0.0155759 2020-11-12T17:28:53.949 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:53.919+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:53.950 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:54.036 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:54.033+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:54.116 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:54.127 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:54.121+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:54.127 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:54.128 INFO:teuthology.orchestra.run.smithi205.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2020-11-12T17:28:54.128 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:54.129 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:54.129 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:54.129 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:28:54.130 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:54.141 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:54.157 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:54.197 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:54.227 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:54.231 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:54.229+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:54.260 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:54.288 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:54.312 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:54.312 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:54.313 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:54.313 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:54.313 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:54.318 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:54.326 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:54.355 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:54.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:54.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:54.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:54.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:54.357 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:54.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:54.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:54.358 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:54.369 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:54.365+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:54.429 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:54.423+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:54.496 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:54.497 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:54.509 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:54.521 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 18 16 18658 18642 8.09045 9.39844 0.0160158 0.015442 2020-11-12T17:28:54.530 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:54.523+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:54.631 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:54.627+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:54.632 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:54.633 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:54.645 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:54.689 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:54.683+0000 7fc24d2e3700 -1 osd.3 200 handle_osd_map injecting map crc failure 2020-11-12T17:28:54.696 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:28:54.751 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:54.747+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:54.765 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:54.765 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:54.774 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:54.833 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:54.827+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:54.894 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:54.895 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:54.905 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:28:54.934 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:54.929+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:55.030 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:55.031 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:55.035 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:55.029+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:55.042 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:28:55.136 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:55.131+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:55.169 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:55.170 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:55.182 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:28:55.237 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:55.233+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:55.338 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:55.338 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:55.339 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:55.333+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:55.350 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:28:55.439 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:55.435+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:55.484 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:55.484 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:55.498 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:28:55.522 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 19 16 19655 19639 8.07455 7.78906 0.00882039 0.0154377 2020-11-12T17:28:55.539 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:55.537+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:55.640 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:55.637+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:55.653 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:55.653 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:55.661 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:28:55.741 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:55.735+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:55.787 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:55.787 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:55.799 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:28:55.849 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:55.845+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:55.950 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:55.945+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:55.974 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:55.974 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:55.984 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:28:56.051 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:56.047+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:56.082 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:56.082 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:56.093 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:28:56.153 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:56.153+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:56.253 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:56.253+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:56.254 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:56.254 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:56.265 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:28:56.355 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:56.353+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:56.369 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:28:56.392 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:56.393 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:56.404 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:28:56.491 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:56.487+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:56.522 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:28:56.522881+0000 min lat: 0.00229077 max lat: 1.0374 avg lat: 0.0155696 2020-11-12T17:28:56.522 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:28:56.523 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 20 16 20530 20514 8.01259 6.83594 0.0423459 0.0155696 2020-11-12T17:28:56.553 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:56.555 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:56.551+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:56.571 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:56.571 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:56.583 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:28:56.586 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:56.619 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:56.650 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:56.657 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:56.651+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:56.683 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:56.709 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:28:56.718 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:56.720 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:28:56.721 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:28:56.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:28:56.721 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:28:56.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.721 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:28:56.721 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:28:56.722 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 342.30051329700001, 2020-11-12T17:28:56.722 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:28:56.722 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.722 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.722 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.722 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:56.723 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:56.723 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:28:56.723 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.723 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.723 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.723 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.723 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:28:56.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:28:56.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:28:56.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:28:56.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:28:56.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:28:56.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:28:56.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:28:56.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:28:56.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:28:56.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:28:56.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:28:56.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:28:56.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:28:56.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:28:56.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:56.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:28:56.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:28:56.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.730 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:28:56.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:28:56.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:28:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:28:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:28:56.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:28:56.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:28:56.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:28:56.733 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.733 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.733 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.733 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:28:56.733 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:28:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 342.29356923500001, 2020-11-12T17:28:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:28:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:28:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:28:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:28:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:28:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:28:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:28:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:28:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:28:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:28:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:28:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:28:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:28:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:28:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:28:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:28:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:28:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.742 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:28:56.742 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:28:56.742 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 306.11973144900003, 2020-11-12T17:28:56.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:28:56.742 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.742 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:28:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.744 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.744 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:28:56.744 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:28:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:28:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:28:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:28:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:28:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:28:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:28:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:28:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:28:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:28:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:28:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:28:56.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:28:56.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:28:56.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:28:56.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:28:56.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:28:56.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:28:56.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:28:56.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:28:56.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:28:56.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.752 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:28:56.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:28:56.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.753 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.753 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:28:56.753 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:28:56.753 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.753 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.753 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.754 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:28:56.754 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:28:56.754 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 289.85602635599997, 2020-11-12T17:28:56.754 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:28:56.755 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.755 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:56.755 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:56.755 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:28:56.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.756 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.756 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.756 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:28:56.756 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:28:56.757 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:56.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.757 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.757 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.757 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:28:56.758 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:28:56.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.758 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.758 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:28:56.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:28:56.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.759 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.759 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:28:56.759 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:28:56.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.760 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:28:56.760 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:28:56.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.760 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:28:56.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:28:56.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.761 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.761 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:28:56.761 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:28:56.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.762 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:56.762 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:28:56.762 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:28:56.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:28:56.763 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:28:56.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.763 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.763 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.763 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:28:56.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:28:56.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.764 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.764 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:28:56.764 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:28:56.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.765 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.765 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:28:56.765 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:28:56.765 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.765 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.765 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.766 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:28:56.766 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:28:56.767 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 274.77064603000002, 2020-11-12T17:28:56.767 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:28:56.767 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.767 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.767 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.767 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:28:56.768 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.768 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.768 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:28:56.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:56.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.769 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.769 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:28:56.769 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:28:56.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.770 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.770 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:28:56.770 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:28:56.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:28:56.771 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:28:56.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.771 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.771 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:28:56.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:28:56.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.772 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.772 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:28:56.772 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:28:56.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.773 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:28:56.773 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:28:56.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.773 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:28:56.774 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:28:56.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.774 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.774 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:28:56.775 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:28:56.775 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.775 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.775 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.775 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:28:56.776 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:28:56.776 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 273.07650775600001, 2020-11-12T17:28:56.776 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:28:56.776 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.776 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.776 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.776 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:28:56.777 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:56.777 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:28:56.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.777 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.777 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.777 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:28:56.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.778 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.778 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:28:56.778 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:28:56.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.779 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.779 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:28:56.779 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:28:56.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.780 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:28:56.780 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:28:56.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.780 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.780 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:28:56.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:28:56.781 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.781 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.781 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:28:56.781 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:28:56.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.782 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.782 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:28:56.782 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:28:56.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.783 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:28:56.783 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:28:56.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.783 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:56.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:28:56.784 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:28:56.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.784 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.784 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.784 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:28:56.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:28:56.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.785 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.785 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:28:56.785 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:28:56.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.786 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:28:56.786 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:28:56.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.786 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.787 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:28:56.787 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:28:56.787 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.787 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.787 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.787 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.788 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:28:56.788 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:28:56.788 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 204.81309620600001, 2020-11-12T17:28:56.788 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:28:56.788 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.788 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.788 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.789 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:56.789 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:56.789 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:28:56.789 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.789 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.789 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:28:56.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.790 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.790 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:28:56.790 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:28:56.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.791 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:28:56.791 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:28:56.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.791 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:28:56.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:28:56.792 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.792 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.792 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:28:56.792 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:28:56.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.793 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:28:56.793 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:28:56.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.793 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:28:56.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:28:56.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.794 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.794 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.794 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:28:56.794 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:28:56.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.795 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:56.795 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:28:56.795 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:28:56.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:28:56.796 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:28:56.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.796 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.796 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:28:56.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:28:56.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.797 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.797 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:28:56.797 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:28:56.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.798 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.798 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:28:56.798 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:28:56.798 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.798 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.798 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.799 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.799 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:28:56.799 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:28:56.799 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 200.01065730799999, 2020-11-12T17:28:56.799 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:28:56.799 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.800 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.800 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.800 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:56.800 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:56.800 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:28:56.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.800 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:28:56.801 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.801 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.801 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:28:56.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:56.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.802 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.802 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:28:56.802 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:28:56.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:28:56.803 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:28:56.803 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.803 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.803 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:28:56.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:28:56.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.804 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.804 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:28:56.804 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:28:56.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.805 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.805 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:28:56.805 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:28:56.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.806 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.806 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:28:56.806 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:28:56.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:56.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:28:56.807 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:28:56.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.807 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.807 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:28:56.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:28:56.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.808 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.808 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:28:56.808 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:28:56.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.809 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:28:56.809 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:28:56.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.809 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.810 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:28:56.810 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:28:56.810 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.810 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.810 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.811 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:28:56.811 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:28:56.811 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 199.93153499100001, 2020-11-12T17:28:56.811 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:28:56.811 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.811 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.811 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.812 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:56.812 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:56.812 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:28:56.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.812 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.812 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:28:56.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.813 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.813 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:28:56.813 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:28:56.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.814 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:28:56.814 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:28:56.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.814 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:28:56.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:28:56.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.815 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.815 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:28:56.815 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:28:56.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.816 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:28:56.816 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:28:56.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.816 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:28:56.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:28:56.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.817 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.817 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.817 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:28:56.817 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:28:56.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.818 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:56.818 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:28:56.818 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:28:56.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:28:56.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:28:56.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.819 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.819 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:28:56.819 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:28:56.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.820 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.820 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:28:56.820 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:28:56.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.821 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.821 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:28:56.821 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:28:56.821 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.821 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.821 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.821 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.822 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.822 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:28:56.822 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:28:56.822 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 175.14918402399999, 2020-11-12T17:28:56.822 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:28:56.822 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.823 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.823 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.823 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:28:56.823 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:56.823 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:28:56.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.823 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:28:56.824 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.824 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.824 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.824 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:28:56.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:28:56.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.825 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.825 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:28:56.825 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:28:56.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.826 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:28:56.826 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:28:56.826 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.826 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:28:56.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:28:56.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.827 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.827 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:28:56.827 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:28:56.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.828 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:28:56.828 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:28:56.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.828 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:28:56.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:28:56.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.829 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:56.829 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:28:56.829 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:28:56.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.830 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.830 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:28:56.830 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:28:56.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:28:56.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:28:56.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.831 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.831 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:28:56.831 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:28:56.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.832 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.832 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:28:56.832 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:28:56.832 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.833 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.833 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.833 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:28:56.833 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:28:56.833 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 114.664382524, 2020-11-12T17:28:56.834 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:28:56.834 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.834 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:56.834 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:56.834 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:28:56.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.835 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.835 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.835 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:28:56.835 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:28:56.836 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:56.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.836 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.836 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:28:56.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:28:56.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.837 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.837 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:28:56.837 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:28:56.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.838 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.838 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:28:56.838 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:28:56.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.839 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:28:56.839 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:28:56.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.839 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:28:56.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:28:56.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.840 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.840 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:28:56.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:28:56.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:56.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:28:56.841 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:28:56.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.841 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.841 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:28:56.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:28:56.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.842 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.842 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:28:56.842 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:28:56.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.843 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:28:56.843 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:28:56.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.843 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.844 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:28:56.844 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:28:56.844 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.844 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.844 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.844 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.844 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:28:56.845 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:28:56.845 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 92.603022854000002, 2020-11-12T17:28:56.845 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:28:56.845 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.845 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.845 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:56.846 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:56.846 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:28:56.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.846 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.846 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:28:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:28:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:28:56.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:28:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:28:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.848 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:28:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:28:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.849 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:28:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:28:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:28:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:28:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:28:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:28:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.851 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:28:56.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:28:56.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.852 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:56.852 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:28:56.852 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:28:56.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:28:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:28:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.853 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:28:56.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:28:56.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.854 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.854 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:28:56.854 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:28:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:28:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:28:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.855 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:59192 5.0 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e168)", 2020-11-12T17:28:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:28:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 62.916324062000001, 2020-11-12T17:28:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003, 2020-11-12T17:28:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.857 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:28:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 59192 2020-11-12T17:28:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:28:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.859 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:28:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802660+0000", 2020-11-12T17:28:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9094000000000001e-05 2020-11-12T17:28:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802709+0000", 2020-11-12T17:28:56.861 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9580000000000004e-06 2020-11-12T17:28:56.861 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.861 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.861 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802715+0000", 2020-11-12T17:28:56.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0690000000000002e-06 2020-11-12T17:28:56.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.862 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.862 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802719+0000", 2020-11-12T17:28:56.862 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010962786 2020-11-12T17:28:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813681+0000", 2020-11-12T17:28:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011702 2020-11-12T17:28:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813798+0000", 2020-11-12T17:28:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187436 2020-11-12T17:28:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813986+0000", 2020-11-12T17:28:56.864 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020009369999999999 2020-11-12T17:28:56.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.865 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.865 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.815987+0000", 2020-11-12T17:28:56.865 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46767350899999999 2020-11-12T17:28:56.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.866 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.866 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283660+0000", 2020-11-12T17:28:56.866 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3396e-05 2020-11-12T17:28:56.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283734+0000", 2020-11-12T17:28:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0195999999999998e-05 2020-11-12T17:28:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.867 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283784+0000", 2020-11-12T17:28:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003 2020-11-12T17:28:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.868 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59360 5.1 e169/127 5:8e053221:::benchmark_data_smithi036_24110_object7419:head v 169'3752, mlcod=169'3747)", 2020-11-12T17:28:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:28:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 62.017836791000001, 2020-11-12T17:28:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999, 2020-11-12T17:28:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.869 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:28:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:28:56.870 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:28:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701143+0000", 2020-11-12T17:28:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4913000000000006e-05 2020-11-12T17:28:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.871 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701218+0000", 2020-11-12T17:28:56.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45075755000000001 2020-11-12T17:28:56.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.872 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.872 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151975+0000", 2020-11-12T17:28:56.872 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7439999999999996e-06 2020-11-12T17:28:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151984+0000", 2020-11-12T17:28:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5661000000000001e-05 2020-11-12T17:28:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152040+0000", 2020-11-12T17:28:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0267e-05 2020-11-12T17:28:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152070+0000", 2020-11-12T17:28:56.874 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027662300000000002 2020-11-12T17:28:56.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.875 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.875 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154836+0000", 2020-11-12T17:28:56.875 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0707e-05 2020-11-12T17:28:56.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154897+0000", 2020-11-12T17:28:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999 2020-11-12T17:28:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:62424 5.1 e171/127 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head v 171'3992, mlcod=171'3984)", 2020-11-12T17:28:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:28:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.520076154000002, 2020-11-12T17:28:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437, 2020-11-12T17:28:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.877 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:28:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.878 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:28:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:28:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198896+0000", 2020-11-12T17:28:56.879 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9000999999999997e-05 2020-11-12T17:28:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198985+0000", 2020-11-12T17:28:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48058147200000001 2020-11-12T17:28:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.880 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679566+0000", 2020-11-12T17:28:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9140000000000003e-06 2020-11-12T17:28:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679576+0000", 2020-11-12T17:28:56.881 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1407000000000003e-05 2020-11-12T17:28:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679647+0000", 2020-11-12T17:28:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1270999999999999e-05 2020-11-12T17:28:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679679+0000", 2020-11-12T17:28:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002926648 2020-11-12T17:28:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.883 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682605+0000", 2020-11-12T17:28:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1626999999999998e-05 2020-11-12T17:28:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682667+0000", 2020-11-12T17:28:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437 2020-11-12T17:28:56.884 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:65088 5.1 e177/127 5:8edfd3fe:::benchmark_data_smithi036_24110_object8135:head v 177'4152, mlcod=177'4145)", 2020-11-12T17:28:56.885 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:28:56.886 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 44.536951365999997, 2020-11-12T17:28:56.886 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004, 2020-11-12T17:28:56.886 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.886 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.886 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.886 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.886 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:28:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:28:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:28:56.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182031+0000", 2020-11-12T17:28:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8371000000000001e-05 2020-11-12T17:28:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.888 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182090+0000", 2020-11-12T17:28:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64597910199999997 2020-11-12T17:28:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828069+0000", 2020-11-12T17:28:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6649999999999998e-06 2020-11-12T17:28:56.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828078+0000", 2020-11-12T17:28:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013253599999999999 2020-11-12T17:28:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.890 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828211+0000", 2020-11-12T17:28:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1916999999999999e-05 2020-11-12T17:28:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828253+0000", 2020-11-12T17:28:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00329598 2020-11-12T17:28:56.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831549+0000", 2020-11-12T17:28:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5890999999999996e-05 2020-11-12T17:28:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.892 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.893 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831615+0000", 2020-11-12T17:28:56.893 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004 2020-11-12T17:28:56.893 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.893 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.893 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.893 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:12064 6.0 e198/193 ondisk, result = 0)", 2020-11-12T17:28:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:28:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.8479265209999998, 2020-11-12T17:28:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674, 2020-11-12T17:28:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:28:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.895 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:28:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:28:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871061+0000", 2020-11-12T17:28:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6056000000000002e-05 2020-11-12T17:28:56.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871097+0000", 2020-11-12T17:28:56.897 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59417804799999996 2020-11-12T17:28:56.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.897 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.897 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465275+0000", 2020-11-12T17:28:56.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1326e-05 2020-11-12T17:28:56.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.898 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.898 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465287+0000", 2020-11-12T17:28:56.898 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1495000000000001e-05 2020-11-12T17:28:56.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465338+0000", 2020-11-12T17:28:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4560000000000003e-06 2020-11-12T17:28:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.899 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465345+0000", 2020-11-12T17:28:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9233000000000004e-05 2020-11-12T17:28:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465435+0000", 2020-11-12T17:28:56.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674 2020-11-12T17:28:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.6159.0:15080 6.b 6:ded5ee56:::benchmark_data_smithi036_29033_object1884:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e199)", 2020-11-12T17:28:56.901 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:28:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.4941687290000001, 2020-11-12T17:28:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999, 2020-11-12T17:28:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:28:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.6159", 2020-11-12T17:28:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:56.902 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 15080 2020-11-12T17:28:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:28:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:28:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:28:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224802+0000", 2020-11-12T17:28:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1513000000000003e-05 2020-11-12T17:28:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224893+0000", 2020-11-12T17:28:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7841000000000001e-05 2020-11-12T17:28:56.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224911+0000", 2020-11-12T17:28:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1224e-05 2020-11-12T17:28:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224922+0000", 2020-11-12T17:28:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9716000000000006e-05 2020-11-12T17:28:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225012+0000", 2020-11-12T17:28:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017505999999999999 2020-11-12T17:28:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225187+0000", 2020-11-12T17:28:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030063900000000001 2020-11-12T17:28:56.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225488+0000", 2020-11-12T17:28:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021279850000000002 2020-11-12T17:28:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:28:56.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.227616+0000", 2020-11-12T17:28:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60001606200000002 2020-11-12T17:28:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827632+0000", 2020-11-12T17:28:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3869000000000002e-05 2020-11-12T17:28:56.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827686+0000", 2020-11-12T17:28:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7774999999999997e-05 2020-11-12T17:28:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.911 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827724+0000", 2020-11-12T17:28:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999 2020-11-12T17:28:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:15080 6.b e199/190 ondisk, result = 0)", 2020-11-12T17:28:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:28:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 5.4892220829999996, 2020-11-12T17:28:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005, 2020-11-12T17:28:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:28:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:28:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:28:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:28:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229750+0000", 2020-11-12T17:28:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7358000000000001e-05 2020-11-12T17:28:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229817+0000", 2020-11-12T17:28:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59622965400000005 2020-11-12T17:28:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826047+0000", 2020-11-12T17:28:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7509999999999997e-06 2020-11-12T17:28:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826052+0000", 2020-11-12T17:28:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001561729 2020-11-12T17:28:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827614+0000", 2020-11-12T17:28:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0472000000000001e-05 2020-11-12T17:28:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827625+0000", 2020-11-12T17:28:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106687 2020-11-12T17:28:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827731+0000", 2020-11-12T17:28:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005 2020-11-12T17:28:56.919 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.6159.0:15728 6.7 e199/190 6:e4c465ea:::benchmark_data_smithi036_29033_object1965:head v 199'1032, mlcod=199'1025)", 2020-11-12T17:28:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:28:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 4.7796093510000004, 2020-11-12T17:28:56.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426, 2020-11-12T17:28:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:28:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:28:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:28:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:28:56.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:28:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:28:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:28:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:28:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:28:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939371+0000", 2020-11-12T17:28:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3385000000000002e-05 2020-11-12T17:28:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:28:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939455+0000", 2020-11-12T17:28:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40948674800000001 2020-11-12T17:28:56.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:28:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348941+0000", 2020-11-12T17:28:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3089999999999998e-06 2020-11-12T17:28:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:28:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348949+0000", 2020-11-12T17:28:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3567999999999998e-05 2020-11-12T17:28:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:28:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349022+0000", 2020-11-12T17:28:56.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2410999999999999e-05 2020-11-12T17:28:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:28:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349055+0000", 2020-11-12T17:28:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050284420000000002 2020-11-12T17:28:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:28:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354083+0000", 2020-11-12T17:28:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8516000000000005e-05 2020-11-12T17:28:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:28:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:28:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:28:56.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354162+0000", 2020-11-12T17:28:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426 2020-11-12T17:28:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:28:56.928 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:28:56.928 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:28:56.931 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:28:56.932 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:56.932 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:56.932 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:28:56.932 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:28:56.933 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:28:56.933 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:28:56.933 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:28:56.933 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:28:56.933 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:28:56.933 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:28:56.934 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:28:56.923+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:28:57.031 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:57.029+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:57.053 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:57.053 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:57.054 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:28:57.054 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:57.066 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:28:57.156 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:57.157+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:57.232 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:28:57.227+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:28:57.235 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:57.235 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:57.235 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:57.236 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:57.236 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:57.246 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:28:57.333 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:57.333+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:57.410 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:57.410 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:28:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:28:57.411 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 346.72247175400003, 2020-11-12T17:28:57.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:28:57.412 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.412 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:57.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:28:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:28:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:28:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:28:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:28:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:28:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:28:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:28:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:28:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:28:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:28:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:28:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:28:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:28:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:28:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:28:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:28:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:28:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:28:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:28:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:28:57.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:28:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:28:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:28:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:28:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:28:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.438 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:28:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:28:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 346.71699168499998, 2020-11-12T17:28:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:28:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:28:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:28:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:28:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:28:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:28:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:28:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:28:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:28:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:28:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:28:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:28:57.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:28:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:28:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:28:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:28:57.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:28:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:28:57.450 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:28:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 338.52687008499998, 2020-11-12T17:28:57.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:28:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.452 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:28:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.453 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:28:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:28:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:28:57.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:28:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:28:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:28:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:28:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:28:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:28:57.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:28:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:28:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:28:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:28:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:28:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:28:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:28:57.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:28:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:28:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:28:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:28:57.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:28:57.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:28:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:28:57.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:28:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:28:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:28:57.464 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:28:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:28:57.465 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 338.51962637600002, 2020-11-12T17:28:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:28:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:28:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:28:57.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:28:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:28:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:28:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:28:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:28:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:28:57.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:28:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:28:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:28:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:28:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:28:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:28:57.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:28:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:28:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:28:57.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:28:57.473 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:28:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 262.52353700200001, 2020-11-12T17:28:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:28:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:28:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:28:57.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:28:57.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:28:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:28:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:28:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:28:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:28:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:28:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:28:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:28:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:28:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:28:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:28:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:28:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:28:57.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:28:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.511 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:28:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:28:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 196.39601449, 2020-11-12T17:28:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:28:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.512 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:28:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:28:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:28:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:28:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:28:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:28:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:28:57.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:28:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:28:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:28:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:28:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:28:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:28:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:28:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:28:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:28:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:28:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:28:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 189.345267049, 2020-11-12T17:28:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:28:57.521 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:28:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.522 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:28:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:28:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:28:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:28:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:28:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:28:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:28:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:28:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:28:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:28:57.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:28:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:28:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:28:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:28:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:28:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:57.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:28:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:28:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:28:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:28:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:28:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:28:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:28:57.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:28:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:28:57.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:28:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.534 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:28:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:28:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 189.34517885400001, 2020-11-12T17:28:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:28:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.535 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:28:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:28:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:28:57.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:28:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:28:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:28:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:28:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:28:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:28:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:28:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:28:57.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:28:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:28:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:28:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:28:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:28:57.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:28:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:28:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:28:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:28:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:28:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:28:57.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:28:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:28:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:28:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.545 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:28:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:28:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 189.326465821, 2020-11-12T17:28:57.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:28:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:28:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:28:57.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:28:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:28:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:28:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:28:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:28:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:28:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:28:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:28:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:28:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:28:57.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:28:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:28:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:28:57.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:28:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:28:57.554 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:57.555 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:28:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 156.57564336999999, 2020-11-12T17:28:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:28:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:57.556 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:28:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:28:57.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:28:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:28:57.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:28:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:28:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:28:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:28:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:28:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:28:57.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:28:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:28:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:28:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:28:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:28:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:28:57.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:28:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:28:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:28:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:28:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:28:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:28:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:28:57.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:28:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:28:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:28:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.566 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:28:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 155.488987882, 2020-11-12T17:28:57.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:28:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:57.568 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:28:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:28:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:28:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:57.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:28:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:28:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:28:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:28:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:28:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:28:57.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:28:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:28:57.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:28:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:28:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:28:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:28:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:57.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:28:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:28:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:28:57.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:28:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:28:57.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:28:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:28:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:28:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:28:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:28:57.579 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.580 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:28:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:28:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 155.475506655, 2020-11-12T17:28:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:28:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:28:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:28:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:28:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:28:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:28:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:28:57.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:28:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:28:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:28:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:28:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:28:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:28:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:28:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:28:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:28:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:28:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:28:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.588 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:28:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 120.473218453, 2020-11-12T17:28:57.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:28:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:28:57.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:28:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:28:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:28:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:28:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:28:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:28:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:28:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:28:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:28:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:28:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:28:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:28:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:28:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:28:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:28:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:28:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:28:57.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:28:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:28:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:28:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:28:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:28:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:28:57.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:28:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:28:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.601 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:28:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:28:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 120.467401869, 2020-11-12T17:28:57.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:28:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:28:57.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:28:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:28:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:28:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:28:57.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:28:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:28:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:28:57.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:28:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:28:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:28:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:28:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:28:57.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:28:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:28:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:28:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:28:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:28:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:28:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:28:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:28:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:28:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:28:57.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:28:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:28:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:28:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:28:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:28:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:28:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 120.444468355, 2020-11-12T17:28:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:28:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.614 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:28:57.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:28:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:28:57.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:28:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:28:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:28:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:28:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:28:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:28:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:28:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:28:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:28:57.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:28:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:28:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:28:57.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:28:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:28:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:28:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:28:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.623 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:28:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:28:57.624 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 113.911990328, 2020-11-12T17:28:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:28:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.625 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:28:57.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:28:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:28:57.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:28:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:28:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:28:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:28:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:28:57.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:28:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:28:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:28:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:28:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:28:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:28:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:28:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:28:57.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:28:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:28:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:28:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.633 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.634 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.634 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e169)", 2020-11-12T17:28:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:28:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 62.717284288000002, 2020-11-12T17:28:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002, 2020-11-12T17:28:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.635 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:28:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:28:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.637 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:28:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:28:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691863+0000", 2020-11-12T17:28:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103144 2020-11-12T17:28:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691966+0000", 2020-11-12T17:28:57.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8453000000000001e-05 2020-11-12T17:28:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691985+0000", 2020-11-12T17:28:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0385e-05 2020-11-12T17:28:57.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691995+0000", 2020-11-12T17:28:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0098187989999999996 2020-11-12T17:28:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701814+0000", 2020-11-12T17:28:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000135065 2020-11-12T17:28:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701949+0000", 2020-11-12T17:28:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025538399999999999 2020-11-12T17:28:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.702205+0000", 2020-11-12T17:28:57.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034246620000000002 2020-11-12T17:28:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.705629+0000", 2020-11-12T17:28:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.450897995 2020-11-12T17:28:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156527+0000", 2020-11-12T17:28:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2074000000000001e-05 2020-11-12T17:28:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156599+0000", 2020-11-12T17:28:57.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1148000000000002e-05 2020-11-12T17:28:57.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156690+0000", 2020-11-12T17:28:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002 2020-11-12T17:28:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e169)", 2020-11-12T17:28:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:28:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 62.695665673999997, 2020-11-12T17:28:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003, 2020-11-12T17:28:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.648 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:28:57.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:28:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:28:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:28:57.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713485+0000", 2020-11-12T17:28:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7021000000000005e-05 2020-11-12T17:28:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713582+0000", 2020-11-12T17:28:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2103000000000001e-05 2020-11-12T17:28:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713595+0000", 2020-11-12T17:28:57.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0129999999999999e-06 2020-11-12T17:28:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713601+0000", 2020-11-12T17:28:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001321727 2020-11-12T17:28:57.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.714922+0000", 2020-11-12T17:28:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011930300000000001 2020-11-12T17:28:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.715042+0000", 2020-11-12T17:28:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44158781200000002 2020-11-12T17:28:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156629+0000", 2020-11-12T17:28:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003 2020-11-12T17:28:57.656 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62424 5.1 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e171)", 2020-11-12T17:28:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:28:57.657 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.213733580000003, 2020-11-12T17:28:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456, 2020-11-12T17:28:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62424 2020-11-12T17:28:57.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:28:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:28:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999809 2020-11-12T17:28:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195432+0000", 2020-11-12T17:28:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1144999999999999e-05 2020-11-12T17:28:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195483+0000", 2020-11-12T17:28:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2553e-05 2020-11-12T17:28:57.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195496+0000", 2020-11-12T17:28:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0469999999999996e-06 2020-11-12T17:28:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195503+0000", 2020-11-12T17:28:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041025339999999997 2020-11-12T17:28:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199605+0000", 2020-11-12T17:28:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114968 2020-11-12T17:28:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199720+0000", 2020-11-12T17:28:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020953000000000001 2020-11-12T17:28:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199930+0000", 2020-11-12T17:28:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043700170000000003 2020-11-12T17:28:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.666 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.204300+0000", 2020-11-12T17:28:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.480176663 2020-11-12T17:28:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684477+0000", 2020-11-12T17:28:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017691000000000001 2020-11-12T17:28:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684653+0000", 2020-11-12T17:28:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107935 2020-11-12T17:28:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684761+0000", 2020-11-12T17:28:57.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456 2020-11-12T17:28:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:65088 5.1 5:8edfd3fe:::benchmark_data_smithi036_24110_object8135:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e177)", 2020-11-12T17:28:57.669 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:28:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 45.228332530000003, 2020-11-12T17:28:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.652361309, 2020-11-12T17:28:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:57.670 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 65088 2020-11-12T17:28:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:28:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:28:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:57.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180810+0000", 2020-11-12T17:28:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120461 2020-11-12T17:28:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180931+0000", 2020-11-12T17:28:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5746000000000001e-05 2020-11-12T17:28:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180947+0000", 2020-11-12T17:28:57.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8739999999999995e-06 2020-11-12T17:28:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180955+0000", 2020-11-12T17:28:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017552710000000001 2020-11-12T17:28:57.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.182710+0000", 2020-11-12T17:28:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013040999999999999 2020-11-12T17:28:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.182840+0000", 2020-11-12T17:28:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000212112 2020-11-12T17:28:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:57.677 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.183052+0000", 2020-11-12T17:28:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031255879999999999 2020-11-12T17:28:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.186178+0000", 2020-11-12T17:28:57.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.64690791400000003 2020-11-12T17:28:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833086+0000", 2020-11-12T17:28:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2926000000000001e-05 2020-11-12T17:28:57.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833139+0000", 2020-11-12T17:28:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4467000000000004e-05 2020-11-12T17:28:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833213+0000", 2020-11-12T17:28:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.652361309 2020-11-12T17:28:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.681 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.682 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.682 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:57.684 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:57.427+0000 7fc24d2e3700 -1 osd.3 201 handle_osd_map injecting map crc failure 2020-11-12T17:28:57.684 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:28:57.685 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 21 16 21573 21557 8.01901 8.14844 0.00676423 0.0155618 2020-11-12T17:28:57.685 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:57.681+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:57.686 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:28:57.785 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:57.785+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:57.857 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:57.858 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:57.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.858 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:21845 6.d 6:bdcc109a:::benchmark_data_smithi036_29033_object2730:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e202)", 2020-11-12T17:28:57.858 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:57.852127+0000", 2020-11-12T17:28:57.858 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0054138820000000001, 2020-11-12T17:28:57.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054397120000000002, 2020-11-12T17:28:57.859 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.859 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:57.859 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.859 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:57.859 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:57.859 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 21845 2020-11-12T17:28:57.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.859 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852127+0000", 2020-11-12T17:28:57.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852127+0000", 2020-11-12T17:28:57.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999958 2020-11-12T17:28:57.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852084+0000", 2020-11-12T17:28:57.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000121166 2020-11-12T17:28:57.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852206+0000", 2020-11-12T17:28:57.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6895e-05 2020-11-12T17:28:57.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852222+0000", 2020-11-12T17:28:57.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4689999999999997e-06 2020-11-12T17:28:57.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852231+0000", 2020-11-12T17:28:57.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029438139999999999 2020-11-12T17:28:57.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.855175+0000", 2020-11-12T17:28:57.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0575999999999996e-05 2020-11-12T17:28:57.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.855255+0000", 2020-11-12T17:28:57.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9358000000000007e-05 2020-11-12T17:28:57.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:57.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.855355+0000", 2020-11-12T17:28:57.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003228079 2020-11-12T17:28:57.866 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.866 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.866 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.866 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:21846 6.d 6:bdcc109a:::benchmark_data_smithi036_29033_object2730:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e202)", 2020-11-12T17:28:57.867 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:57.856153+0000", 2020-11-12T17:28:57.867 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0013871770000000001, 2020-11-12T17:28:57.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0015200540000000001, 2020-11-12T17:28:57.867 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.867 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:57.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:57.867 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:57.868 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 21846 2020-11-12T17:28:57.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.868 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856153+0000", 2020-11-12T17:28:57.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856153+0000", 2020-11-12T17:28:57.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999647 2020-11-12T17:28:57.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856118+0000", 2020-11-12T17:28:57.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3117999999999999e-05 2020-11-12T17:28:57.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856201+0000", 2020-11-12T17:28:57.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5820000000000008e-06 2020-11-12T17:28:57.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856211+0000", 2020-11-12T17:28:57.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1479999999999997e-06 2020-11-12T17:28:57.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856216+0000", 2020-11-12T17:28:57.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013017000000000001 2020-11-12T17:28:57.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856346+0000", 2020-11-12T17:28:57.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.6088000000000006e-05 2020-11-12T17:28:57.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856442+0000", 2020-11-12T17:28:57.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016704299999999999 2020-11-12T17:28:57.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:57.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856609+0000", 2020-11-12T17:28:57.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00045566999999999998 2020-11-12T17:28:57.874 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.874 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.874 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.875 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:21847 6.d 6:bdcc109a:::benchmark_data_smithi036_29033_object2730:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e202)", 2020-11-12T17:28:57.974 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:57.856258+0000", 2020-11-12T17:28:57.975 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0012828679999999999, 2020-11-12T17:28:57.975 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001521585, 2020-11-12T17:28:57.975 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.975 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:57.975 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 21847 2020-11-12T17:28:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.976 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856258+0000", 2020-11-12T17:28:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.977 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856258+0000", 2020-11-12T17:28:57.978 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:28:57.978 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.978 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.978 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.978 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856239+0000", 2020-11-12T17:28:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3767000000000002e-05 2020-11-12T17:28:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856293+0000", 2020-11-12T17:28:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.421e-06 2020-11-12T17:28:57.979 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856299+0000", 2020-11-12T17:28:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2899999999999998e-06 2020-11-12T17:28:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.980 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856303+0000", 2020-11-12T17:28:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00091064800000000001 2020-11-12T17:28:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.857213+0000", 2020-11-12T17:28:57.981 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000118717 2020-11-12T17:28:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.857332+0000", 2020-11-12T17:28:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019133900000000001 2020-11-12T17:28:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.982 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.857523+0000", 2020-11-12T17:28:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001265682 2020-11-12T17:28:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.983 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.984 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.984 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:21848 6.d 6.590833bd (undecoded) ondisk+write+known_if_redirected e202)", 2020-11-12T17:28:57.984 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:57.856666+0000", 2020-11-12T17:28:57.984 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00087491900000000004, 2020-11-12T17:28:57.984 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001200235, 2020-11-12T17:28:57.984 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.984 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:28:57.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:57.985 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:57.985 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 21848 2020-11-12T17:28:57.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.985 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856666+0000", 2020-11-12T17:28:57.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856666+0000", 2020-11-12T17:28:57.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:28:57.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856632+0000", 2020-11-12T17:28:57.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7714000000000007e-05 2020-11-12T17:28:57.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856730+0000", 2020-11-12T17:28:57.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2464e-05 2020-11-12T17:28:57.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856742+0000", 2020-11-12T17:28:57.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1080000000000003e-06 2020-11-12T17:28:57.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856746+0000", 2020-11-12T17:28:57.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0623000000000004e-05 2020-11-12T17:28:57.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.990 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.990 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.990 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.6159.0:21842 6.d e202/190)", 2020-11-12T17:28:57.991 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:57.854886+0000", 2020-11-12T17:28:57.991 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0026547369999999999, 2020-11-12T17:28:57.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030594590000000001, 2020-11-12T17:28:57.991 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.991 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "queued for pg", 2020-11-12T17:28:57.991 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.854886+0000", 2020-11-12T17:28:57.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:57.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.854886+0000", 2020-11-12T17:28:57.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999762 2020-11-12T17:28:57.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:57.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.854862+0000", 2020-11-12T17:28:57.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5191999999999995e-05 2020-11-12T17:28:57.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:57.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.854927+0000", 2020-11-12T17:28:57.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020079329999999999 2020-11-12T17:28:57.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:57.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856935+0000", 2020-11-12T17:28:57.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.596e-06 2020-11-12T17:28:57.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:57.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856939+0000", 2020-11-12T17:28:57.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020530209999999999 2020-11-12T17:28:57.996 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.996 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:57.996 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:57.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.997 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:21842 6.d 6:bdcc109a:::benchmark_data_smithi036_29033_object2730:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e202)", 2020-11-12T17:28:57.997 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:57.851695+0000", 2020-11-12T17:28:57.997 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0058457589999999999, 2020-11-12T17:28:57.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062917199999999998, 2020-11-12T17:28:57.997 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:57.997 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:57.998 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:57.998 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:57.998 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:57.998 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 21842 2020-11-12T17:28:57.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.998 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:57.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:57.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:57.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851695+0000", 2020-11-12T17:28:57.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:57.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:57.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851695+0000", 2020-11-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.000 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851657+0000", 2020-11-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012857499999999999 2020-11-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851785+0000", 2020-11-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3685e-05 2020-11-12T17:28:58.001 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851799+0000", 2020-11-12T17:28:58.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0692e-05 2020-11-12T17:28:58.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851810+0000", 2020-11-12T17:28:58.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000004e-05 2020-11-12T17:28:58.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851875+0000", 2020-11-12T17:28:58.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010723200000000001 2020-11-12T17:28:58.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851982+0000", 2020-11-12T17:28:58.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018013099999999999 2020-11-12T17:28:58.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:58.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852162+0000", 2020-11-12T17:28:58.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041382090000000003 2020-11-12T17:28:58.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856301+0000", 2020-11-12T17:28:58.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046058280000000002 2020-11-12T17:28:58.006 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.007 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.007 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.007 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:21843 6.d 6:bdcc109a:::benchmark_data_smithi036_29033_object2730:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e202)", 2020-11-12T17:28:58.008 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:57.851890+0000", 2020-11-12T17:28:58.008 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0056504859999999997, 2020-11-12T17:28:58.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0061553800000000002, 2020-11-12T17:28:58.008 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.008 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:58.008 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:58.009 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:58.009 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 21843 2020-11-12T17:28:58.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.009 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851890+0000", 2020-11-12T17:28:58.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851890+0000", 2020-11-12T17:28:58.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:28:58.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851859+0000", 2020-11-12T17:28:58.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0414999999999996e-05 2020-11-12T17:28:58.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851930+0000", 2020-11-12T17:28:58.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0579999999999998e-06 2020-11-12T17:28:58.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851938+0000", 2020-11-12T17:28:58.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1960000000000001e-06 2020-11-12T17:28:58.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851942+0000", 2020-11-12T17:28:58.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00093811600000000001 2020-11-12T17:28:58.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852880+0000", 2020-11-12T17:28:58.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000113093 2020-11-12T17:28:58.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852993+0000", 2020-11-12T17:28:58.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020120399999999999 2020-11-12T17:28:58.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:58.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.853195+0000", 2020-11-12T17:28:58.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031129349999999998 2020-11-12T17:28:58.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.856307+0000", 2020-11-12T17:28:58.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0044174710000000001 2020-11-12T17:28:58.019 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.019 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.019 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.020 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:21844 6.d 6:bdcc109a:::benchmark_data_smithi036_29033_object2730:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e202)", 2020-11-12T17:28:58.020 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:57.851971+0000", 2020-11-12T17:28:58.020 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.005569292, 2020-11-12T17:28:58.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0061860190000000001, 2020-11-12T17:28:58.021 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.021 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:58.021 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.021 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:58.021 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:58.021 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 21844 2020-11-12T17:28:58.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.022 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851971+0000", 2020-11-12T17:28:58.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851971+0000", 2020-11-12T17:28:58.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:58.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.851954+0000", 2020-11-12T17:28:58.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0464999999999999e-05 2020-11-12T17:28:58.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852004+0000", 2020-11-12T17:28:58.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7940000000000003e-06 2020-11-12T17:28:58.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852012+0000", 2020-11-12T17:28:58.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0350000000000002e-06 2020-11-12T17:28:58.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.852015+0000", 2020-11-12T17:28:58.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020535179999999998 2020-11-12T17:28:58.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.854069+0000", 2020-11-12T17:28:58.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109312 2020-11-12T17:28:58.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.854178+0000", 2020-11-12T17:28:58.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018480100000000001 2020-11-12T17:28:58.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 1", 2020-11-12T17:28:58.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:57.854363+0000", 2020-11-12T17:28:58.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002391537 2020-11-12T17:28:58.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.029 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.030 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.030 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:28:58.030 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 8 2020-11-12T17:28:58.030 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:58.031 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:28:58.032 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:28:58.027+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:28:58.133 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:58.127+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:58.193 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:58.194 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:58.194 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:58.194 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:58.195 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:58.205 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:28:58.248 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:58.249+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:58.318 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.319 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:28:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 308.31221432400002, 2020-11-12T17:28:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:28:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:28:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:28:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:28:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:28:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:28:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:28:58.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:28:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:28:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:28:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:28:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:28:58.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:28:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:28:58.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:28:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:28:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:28:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:28:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:28:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:28:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 276.37222898099998, 2020-11-12T17:28:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:28:58.330 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.331 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.331 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.331 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:58.331 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:58.331 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:28:58.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.331 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:28:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:28:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:28:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:28:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:28:58.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:28:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:28:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:28:58.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:28:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:28:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:28:58.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:28:58.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:28:58.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:28:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:28:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:28:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:28:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:28:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:28:58.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:28:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:28:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:28:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:28:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:28:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:28:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 264.89512790700002, 2020-11-12T17:28:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:28:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.342 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:28:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:28:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:28:58.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:28:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:28:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:28:58.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:28:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:28:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:28:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:28:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:28:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:28:58.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:28:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:28:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.348 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:28:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 263.77611752000001, 2020-11-12T17:28:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:28:58.349 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.350 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:28:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:28:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:28:58.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:28:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:28:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:28:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:28:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:28:58.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:28:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:28:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:28:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:28:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:28:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:28:58.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:28:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:28:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:28:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:28:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:28:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:28:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:28:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:28:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:28:58.359 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:28:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:58.360 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 263.75997951599999, 2020-11-12T17:28:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:28:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:58.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:28:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:28:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:28:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:28:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:28:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:28:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:28:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:28:58.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:28:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:28:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:28:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:28:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:28:58.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:28:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:28:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:28:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.367 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:28:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 263.755251837, 2020-11-12T17:28:58.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:28:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:28:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:28:58.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:28:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:28:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:28:58.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:28:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:28:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:28:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:28:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:28:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:28:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:28:58.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:28:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:28:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:28:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:28:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:28:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:28:58.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:28:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:58.376 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.711489938, 2020-11-12T17:28:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:28:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:58.377 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:28:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:28:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:28:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:28:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:28:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:28:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:28:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:28:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:28:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:28:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:28:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:28:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:28:58.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:28:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:28:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:58.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:28:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:28:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:28:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:28:58.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:28:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:28:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:28:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:28:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:28:58.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:28:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:58.387 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.70959632500001, 2020-11-12T17:28:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:28:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:58.388 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:28:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:28:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:28:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:28:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:28:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:28:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:28:58.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:28:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:28:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:28:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:28:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:28:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:28:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:28:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:28:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:58.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:28:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:28:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:28:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:28:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:28:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:28:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:28:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:28:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:28:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:28:58.397 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:58.398 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.708843677, 2020-11-12T17:28:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:28:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:58.399 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:28:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:28:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:28:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:28:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:28:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:28:58.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:28:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:28:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:28:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:28:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:28:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:28:58.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:28:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:28:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:58.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:28:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:28:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:28:58.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:28:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:28:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:28:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:28:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:28:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:28:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:28:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.409 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.70568216000001, 2020-11-12T17:28:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:28:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.410 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:28:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:28:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:58.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:28:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:28:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:28:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:28:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:28:58.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:28:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:28:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:28:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:28:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:28:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:28:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:28:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:28:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:28:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:28:58.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:28:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:28:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:28:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:28:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:28:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:28:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:28:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.421 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:58.422 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:58.422 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.70460099300001, 2020-11-12T17:28:58.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:28:58.442 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:28:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.443 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:28:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:28:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:28:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:28:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:28:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:28:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:28:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:28:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:28:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:28:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:28:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:28:58.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:28:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:28:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:58.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:28:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:28:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:28:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:28:58.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:28:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:28:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:28:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:28:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:28:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:28:58.452 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.7044319, 2020-11-12T17:28:58.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:28:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:28:58.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:28:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:28:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:28:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:28:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:28:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:28:58.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:28:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:28:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:28:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:28:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:28:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:28:58.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:28:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:28:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:58.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:28:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:28:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:28:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:28:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:28:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:28:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:28:58.463 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:58.464 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.701813254, 2020-11-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:58.465 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:28:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:28:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:28:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:28:58.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:28:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:28:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:28:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:28:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:28:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:28:58.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:28:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:28:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:28:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:28:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:28:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:28:58.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:28:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:28:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:28:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:28:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:28:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:28:58.474 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:28:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:58.475 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.70170517099999, 2020-11-12T17:28:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:28:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:28:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:28:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:28:58.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:28:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:28:58.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:28:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:28:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:28:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:28:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:28:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:28:58.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:28:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:28:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:28:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:58.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:28:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:28:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:28:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:28:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:28:58.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:28:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:28:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:28:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.485 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 157.69774248900001, 2020-11-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:28:58.486 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:58.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:28:58.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:28:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:28:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:28:58.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 114.660012748, 2020-11-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.494 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:28:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:28:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:28:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:28:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:28:58.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:28:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:28:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:28:58.503 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:28:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:58.504 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 60.146610062999997, 2020-11-12T17:28:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:28:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:58.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:28:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:28:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:28:58.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:28:58.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:28:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.810300177999999, 2020-11-12T17:28:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:28:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.512 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:28:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:28:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:28:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:28:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:28:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:28:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:28:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:28:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:28:58.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:28:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:28:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:28:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:28:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:28:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:28:58.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:28:58.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.792692052, 2020-11-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:58.523 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:28:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:28:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:28:58.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:28:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:28:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:28:58.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:28:58.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:28:58.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:28:58.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:28:58.530 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.530 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.530 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.530 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:15728 6.7 6:e4c465ea:::benchmark_data_smithi036_29033_object1965:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e199)", 2020-11-12T17:28:58.531 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:51.936993+0000", 2020-11-12T17:28:58.531 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 6.3807484670000001, 2020-11-12T17:28:58.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42862954800000003, 2020-11-12T17:28:58.531 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.531 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:58.531 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.531 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 15728 2020-11-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.936993+0000", 2020-11-12T17:28:58.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.936993+0000", 2020-11-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.936974+0000", 2020-11-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.728e-05 2020-11-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.937031+0000", 2020-11-12T17:28:58.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0029999999999994e-06 2020-11-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.937039+0000", 2020-11-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8280000000000002e-06 2020-11-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.937044+0000", 2020-11-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027712489999999999 2020-11-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.939815+0000", 2020-11-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114197 2020-11-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.939929+0000", 2020-11-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020821500000000001 2020-11-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:28:58.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.940138+0000", 2020-11-12T17:28:58.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001754907 2020-11-12T17:28:58.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.941893+0000", 2020-11-12T17:28:58.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42363165000000003 2020-11-12T17:28:58.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:58.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:52.365524+0000", 2020-11-12T17:28:58.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030999999999999e-05 2020-11-12T17:28:58.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:58.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:52.365580+0000", 2020-11-12T17:28:58.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2740000000000001e-05 2020-11-12T17:28:58.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:58.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:52.365623+0000", 2020-11-12T17:28:58.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42862954800000003 2020-11-12T17:28:58.541 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.541 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.542 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:58.543 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 22 16 22561 22545 8.00533 7.71875 0.0108903 0.0155904 2020-11-12T17:28:58.544 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:28:58.544 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:28:58.541+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:28:58.644 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:58.645+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:58.706 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:58.707 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:58.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.707 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:22664 6.3 6:c1815cc6:::benchmark_data_smithi036_29033_object2832:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e202)", 2020-11-12T17:28:58.708 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:58.630131+0000", 2020-11-12T17:28:58.708 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.076854785999999994, 2020-11-12T17:28:58.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.076926048999999996, 2020-11-12T17:28:58.708 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:58.709 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "waiting for sub ops", 2020-11-12T17:28:58.709 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:58.709 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:28:58.710 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:28:58.710 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 22664 2020-11-12T17:28:58.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.710 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:58.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:58.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.630131+0000", 2020-11-12T17:28:58.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:58.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:58.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.630131+0000", 2020-11-12T17:28:58.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:28:58.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:58.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.630109+0000", 2020-11-12T17:28:58.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2106000000000005e-05 2020-11-12T17:28:58.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:58.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.630171+0000", 2020-11-12T17:28:58.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9620000000000005e-06 2020-11-12T17:28:58.716 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:58.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.630181+0000", 2020-11-12T17:28:58.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2739999999999998e-06 2020-11-12T17:28:58.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:58.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.630187+0000", 2020-11-12T17:28:58.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003462775 2020-11-12T17:28:58.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:58.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.633649+0000", 2020-11-12T17:28:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1099000000000003e-05 2020-11-12T17:28:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.633740+0000", 2020-11-12T17:28:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000160173 2020-11-12T17:28:58.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.633901+0000", 2020-11-12T17:28:58.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030704980000000001 2020-11-12T17:28:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:58.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:58.636971+0000", 2020-11-12T17:28:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068404169999999997 2020-11-12T17:28:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.724 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:28:58.725 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:28:58.726 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:58.727 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:28:58.745 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:58.739+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:58.847 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:28:58.843+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:28:58.891 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:58.892 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:28:58.892 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:28:58.893 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:28:58.893 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:58.902 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:28:58.934 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:28:58.952 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:58.953+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:59.031 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:28:59.032 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:28:59.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:28:59.032 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:28:59.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.032 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:28:59.033 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:59.033 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.36036973400002, 2020-11-12T17:28:59.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:28:59.033 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.033 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:28:59.033 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.033 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.034 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.034 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:28:59.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.034 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:59.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:28:59.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:28:59.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:28:59.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:28:59.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:28:59.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:28:59.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:28:59.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:28:59.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:28:59.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:28:59.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:28:59.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:28:59.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:28:59.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:28:59.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:28:59.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:28:59.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:28:59.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:28:59.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:28:59.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:28:59.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:28:59.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:28:59.042 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.042 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35996737300002, 2020-11-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:28:59.043 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.044 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.044 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.044 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.044 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.044 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:28:59.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:28:59.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:28:59.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:28:59.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:28:59.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:28:59.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:28:59.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:28:59.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:28:59.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:28:59.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:28:59.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:28:59.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:28:59.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:28:59.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:28:59.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:28:59.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:28:59.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:28:59.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:28:59.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:28:59.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:28:59.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:28:59.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:28:59.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:28:59.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:28:59.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:28:59.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.059 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:28:59.059 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:28:59.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.059 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.060 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.060 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.060 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.060 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.061 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:59.061 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35964338000002, 2020-11-12T17:28:59.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:28:59.062 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.062 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.062 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.062 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.063 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.063 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:28:59.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.063 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:59.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:28:59.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:28:59.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:28:59.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:28:59.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:28:59.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:28:59.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:28:59.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:28:59.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:28:59.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:28:59.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:28:59.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:28:59.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:28:59.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:28:59.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:28:59.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:28:59.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:28:59.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:28:59.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:28:59.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:28:59.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:28:59.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:28:59.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:28:59.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:28:59.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:28:59.076 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.076 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.077 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.077 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.077 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:59.077 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35939966900003, 2020-11-12T17:28:59.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:28:59.078 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.078 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.078 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.078 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.078 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:59.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:28:59.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:28:59.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:28:59.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:28:59.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:28:59.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:28:59.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:28:59.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:28:59.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:28:59.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:28:59.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:28:59.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:28:59.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:28:59.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:28:59.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:28:59.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:28:59.093 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.094 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.094 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.094 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.095 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:59.095 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35916152200002, 2020-11-12T17:28:59.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:28:59.095 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.095 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.095 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.096 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.096 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.096 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:28:59.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.096 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:59.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:28:59.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:28:59.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:28:59.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:28:59.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:28:59.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:28:59.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:28:59.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:28:59.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:28:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:28:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:28:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:28:59.112 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.113 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.113 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35895948199999, 2020-11-12T17:28:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:28:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.114 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.115 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.115 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.115 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.115 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:28:59.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.115 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:28:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:28:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:28:59.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:28:59.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:28:59.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:28:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:28:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:28:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:28:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:28:59.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:28:59.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:28:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:28:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.129 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35875411199999, 2020-11-12T17:28:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:28:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.130 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:28:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:59.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:28:59.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:59.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:28:59.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:28:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:28:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:28:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:28:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:28:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:28:59.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:28:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:28:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:28:59.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:28:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:28:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:28:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:28:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:28:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:28:59.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:28:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:28:59.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:28:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:28:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:28:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:28:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:28:59.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:28:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:28:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:28:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:28:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:28:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:28:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:28:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.144 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35856828499999, 2020-11-12T17:28:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:28:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.145 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:28:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:59.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:28:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:28:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:28:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:28:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:28:59.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:28:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:28:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:28:59.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.150 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.150 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.150 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:28:59.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:28:59.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:28:59.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:28:59.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:28:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:28:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:28:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:28:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:28:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:28:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:28:59.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:28:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:28:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:28:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:28:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:28:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:28:59.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:28:59.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:28:59.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:28:59.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:28:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:28:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:28:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:28:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.159 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.160 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:59.160 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35837132099999, 2020-11-12T17:28:59.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:28:59.160 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.160 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:28:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:59.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:28:59.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:28:59.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:28:59.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:28:59.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:28:59.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:28:59.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:28:59.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:28:59.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:28:59.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:28:59.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:28:59.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:28:59.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:28:59.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:28:59.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:28:59.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:28:59.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:28:59.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:28:59.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:28:59.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:28:59.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:28:59.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:28:59.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:28:59.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:28:59.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:28:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:28:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:28:59.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:28:59.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.260 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.261 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:59.262 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35817529100001, 2020-11-12T17:28:59.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:28:59.262 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.263 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.264 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:28:59.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.264 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:59.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:28:59.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:59.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:28:59.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:28:59.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:28:59.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:28:59.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:28:59.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:28:59.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:28:59.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:28:59.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:28:59.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:28:59.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:28:59.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:28:59.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:28:59.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:28:59.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:28:59.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:28:59.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:28:59.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:28:59.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:28:59.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:28:59.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:28:59.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:28:59.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:28:59.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:28:59.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:28:59.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:28:59.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:28:59.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:28:59.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:28:59.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:28:59.288 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.288 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.289 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.290 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.290 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:59.290 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.357994491, 2020-11-12T17:28:59.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:28:59.291 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.291 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.291 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.291 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.292 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.292 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:28:59.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.293 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:59.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:28:59.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:28:59.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:28:59.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:28:59.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:28:59.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:28:59.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:28:59.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:28:59.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:28:59.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:28:59.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:28:59.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:28:59.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:28:59.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:28:59.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:28:59.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:28:59.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:28:59.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:28:59.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.306 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:28:59.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:28:59.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:28:59.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:28:59.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:28:59.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:28:59.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:28:59.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:28:59.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:28:59.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:28:59.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:28:59.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.357798538, 2020-11-12T17:28:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:28:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.316 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:28:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:28:59.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:28:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:28:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:28:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:28:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:28:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:28:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:28:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:28:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:28:59.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:28:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:28:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:28:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:28:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:28:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:28:59.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:28:59.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:28:59.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:28:59.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:28:59.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:28:59.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:28:59.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:28:59.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:28:59.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:28:59.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:28:59.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.328 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:28:59.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:28:59.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:28:59.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:28:59.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:28:59.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:28:59.330 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.330 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.330 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.330 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35760492999998, 2020-11-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.331 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:28:59.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:28:59.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:28:59.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:28:59.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:28:59.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:28:59.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:28:59.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:28:59.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:28:59.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:28:59.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:28:59.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:28:59.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:28:59.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:28:59.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:28:59.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:28:59.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:28:59.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:28:59.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:28:59.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:28:59.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:28:59.344 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.344 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.344 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.344 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.345 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:59.345 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.357293067, 2020-11-12T17:28:59.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:28:59.345 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.345 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.345 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.345 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.346 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.346 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:28:59.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.346 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:59.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:28:59.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:28:59.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:28:59.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:28:59.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:28:59.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:28:59.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:28:59.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:28:59.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:28:59.357 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.357 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.357 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.358 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.358 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:59.358 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.35700557000001, 2020-11-12T17:28:59.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:28:59.358 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.358 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.359 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.359 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.359 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.359 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:28:59.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.359 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:59.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:28:59.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:28:59.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:28:59.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:28:59.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:28:59.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:28:59.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:28:59.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:28:59.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:28:59.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:28:59.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:28:59.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:28:59.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:28:59.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:28:59.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:28:59.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:28:59.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:28:59.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:28:59.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:28:59.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:28:59.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:28:59.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:28:59.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:28:59.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:28:59.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 339.356785199, 2020-11-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.372 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:28:59.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:28:59.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:28:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:28:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:28:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:28:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:28:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:28:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:28:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:28:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:28:59.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:28:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:28:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:28:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:28:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:28:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:28:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:28:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:28:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:28:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.385 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:28:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 177.447206209, 2020-11-12T17:28:59.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:28:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:28:59.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:28:59.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:28:59.393 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:28:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:59.394 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 115.37283044900001, 2020-11-12T17:28:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:28:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:28:59.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:28:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:28:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:28:59.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:28:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:28:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:28:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:28:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:28:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:28:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:28:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:28:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:28:59.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:28:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:28:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:28:59.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:28:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:28:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:28:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:28:59.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:28:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:28:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:28:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:28:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:28:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:28:59.404 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:28:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 84.602404082000007, 2020-11-12T17:28:59.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:28:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:28:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:28:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:28:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:28:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:28:59.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:28:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:28:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:28:59.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:28:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:28:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:28:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:28:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:28:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:28:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:28:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:28:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:28:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:28:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:28:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:28:59.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:28:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:28:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:28:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:28:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:28:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:28:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:28:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:28:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:28:59.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:28:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:28:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:28:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:28:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.415 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:28:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 84.594307048999994, 2020-11-12T17:28:59.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:28:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:28:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:28:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:28:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:28:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:59.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:28:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:28:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:28:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:28:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:28:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:28:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:28:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:28:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:28:59.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:28:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:28:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:28:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:28:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:28:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:28:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:28:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:28:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:28:59.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:28:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:28:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:28:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:28:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:28:59.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:28:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:28:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:28:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:28:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:28:59.423 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:28:59.424 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:28:59.424 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 0, 1] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:28:59.428 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:28:59.428 INFO:tasks.thrashosds.thrasher:Setting osd 3 primary_affinity to 1.000000 2020-11-12T17:28:59.429 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd primary-affinity 3 1 2020-11-12T17:28:59.431 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:28:59.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:28:59.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:28:59.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:28:59.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:28:59.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:28:59.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:28:59.432 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:28:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:28:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:28:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:28:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:28:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:28:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:28:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:28:59.434 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:28:59.434 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:59.425+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:59.435 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:28:59.522 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 23 16 23527 23511 7.98537 7.54688 0.0105867 0.0156331 2020-11-12T17:28:59.528 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:59.529+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:59.596 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:59.596 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:59.607 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:28:59.648 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:28:59.649+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:28:59.686 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:28:59.727 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:59.725+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:59.773 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:59.773 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:59.784 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:28:59.828 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:28:59.829+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:28:59.929 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:28:59.929+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:28:59.955 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:28:59.955 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:28:59.967 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:29:00.031 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:00.029+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:00.119 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:00.120 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:00.131 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:29:00.132 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:00.129+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:00.232 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:00.233+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:00.266 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:00.267 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:00.278 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:29:00.333 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:00.333+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:00.405 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:00.405 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:00.416 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:29:00.434 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:00.433+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:00.522 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 24 15 24526 24511 7.97814 7.8125 0.00494098 0.0156438 2020-11-12T17:29:00.535 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:00.533+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:00.550 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:00.551 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:00.561 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:29:00.636 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:00.635+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:00.687 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:00.687 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:00.699 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:29:00.726 INFO:teuthology.orchestra.run.smithi036.stderr:set osd.3 primary-affinity to 1 (8655362) 2020-11-12T17:29:00.727 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:29:00.742 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:00.739+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:00.838 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:29:00.835+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:29:00.858 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:00.971 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:00.973 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:00.973+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:00.973 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:29:01.073 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:01.071+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:01.137 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:01.137 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:01.147 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:29:01.195 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:01.195+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:01.276 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:01.273+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:01.323 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:01.323 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:01.335 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:29:01.379 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:29:01.379+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:29:01.435 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:29:01.453 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:01.453 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:01.466 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:29:01.511 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:01.511+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:01.522 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 25 16 25351 25335 7.91649 6.4375 0.0104707 0.0157673 2020-11-12T17:29:01.578 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:01.575+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:01.603 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:01.635 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:01.641 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:01.642 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:01.651 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:29:01.661 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:29:01.695 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:01.696 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:01.695+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:01.740 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:01.777 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:01.780 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:01.777+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:01.792 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:01.793 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:01.793 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:29:01.793 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:29:01.793 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:01.806 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:29:01.821 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:01.863 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:01.867 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:29:01.868 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:29:01.868 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:29:01.868 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:29:01.868 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:29:01.868 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:29:01.869 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:29:01.869 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:29:01.881 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:01.879+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:01.955 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:29:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:29:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:29:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:29:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 347.532329033, 2020-11-12T17:29:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:29:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:29:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:01.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:29:01.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:29:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:29:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:29:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:29:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:29:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:29:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:29:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:29:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:29:01.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:29:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:29:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:29:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:29:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:29:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:01.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:29:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:29:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:29:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:29:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:29:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:29:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:01.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:29:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:29:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.969 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:29:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 347.52538497099999, 2020-11-12T17:29:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:29:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:01.970 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:01.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:01.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:01.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:01.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:01.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:01.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:01.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:01.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:29:01.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:29:01.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:01.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:29:01.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:29:01.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:01.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:29:01.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:29:01.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:01.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:29:01.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:29:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:29:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:29:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:29:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:29:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:29:01.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:29:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:29:01.977 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 311.35154718500002, 2020-11-12T17:29:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:29:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:01.978 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:29:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:01.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:29:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:01.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:29:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:29:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:29:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:29:01.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:29:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:29:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:01.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:29:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:29:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:29:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:29:01.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:01.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:29:01.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:29:01.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:29:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:29:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:29:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:29:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:29:01.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:29:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:29:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:29:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:29:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:29:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:29:01.987 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:29:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:01.988 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 295.08784209200002, 2020-11-12T17:29:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:29:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:29:01.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:29:01.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:29:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:29:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:29:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:29:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:29:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:29:01.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:29:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:29:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:29:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:01.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:29:01.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:29:01.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:01.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:29:01.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:29:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:29:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:29:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:29:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:29:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:29:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:29:01.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:29:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:29:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:01.998 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:29:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 280.00246176600001, 2020-11-12T17:29:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:29:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:01.999 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:29:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:29:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:29:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:29:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:29:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:29:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:29:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:29:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:29:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:29:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:29:02.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:29:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:29:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:29:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:29:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:29:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:29:02.006 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:29:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 278.308323492, 2020-11-12T17:29:02.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:29:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:29:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.008 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:29:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:29:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:29:02.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:29:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:29:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:29:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:29:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:29:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:29:02.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:29:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:29:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:29:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:29:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:29:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:29:02.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:02.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:29:02.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:29:02.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:29:02.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:29:02.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:29:02.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:29:02.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:29:02.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:29:02.017 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.017 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.017 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.018 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:29:02.018 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:02.018 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 210.044911942, 2020-11-12T17:29:02.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:29:02.018 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.018 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.019 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:02.019 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:02.019 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:02.019 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:29:02.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.019 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:02.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:02.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:02.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:29:02.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:29:02.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:29:02.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:29:02.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:29:02.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:29:02.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:29:02.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:29:02.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:29:02.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:29:02.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:29:02.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:29:02.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:02.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:29:02.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:29:02.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:02.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:29:02.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:29:02.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:29:02.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:29:02.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:29:02.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:29:02.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:29:02.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:29:02.028 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.028 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:29:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:02.029 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 205.24247304400001, 2020-11-12T17:29:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:29:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:29:02.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:29:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:29:02.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:29:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:29:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:29:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:29:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:29:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:29:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:29:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:29:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:29:02.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:29:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:29:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:02.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:29:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:29:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:29:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:29:02.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:29:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:29:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:29:02.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:29:02.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:29:02.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:29:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:29:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:02.040 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 205.16335072699999, 2020-11-12T17:29:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:29:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:02.041 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:29:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:29:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:29:02.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:29:02.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:29:02.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:29:02.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:29:02.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:29:02.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:29:02.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:29:02.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:29:02.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:29:02.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:29:02.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:29:02.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:02.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:29:02.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:29:02.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:02.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:29:02.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:29:02.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:29:02.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:29:02.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:29:02.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:29:02.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:29:02.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:29:02.050 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.051 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.051 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.051 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:29:02.051 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:02.051 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 180.38099976000001, 2020-11-12T17:29:02.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:29:02.052 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.052 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.052 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:02.052 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:02.052 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:02.052 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:29:02.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.053 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:02.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:02.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:29:02.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:29:02.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:29:02.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:29:02.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:29:02.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:29:02.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:29:02.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:29:02.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:29:02.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:29:02.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:29:02.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:29:02.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:29:02.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:02.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:29:02.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:29:02.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:02.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:29:02.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:29:02.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:29:02.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:29:02.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:29:02.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:29:02.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:29:02.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:29:02.061 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.061 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.062 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.062 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:29:02.062 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:02.062 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 119.89619826000001, 2020-11-12T17:29:02.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:29:02.063 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.063 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.063 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:02.063 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:02.063 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:02.063 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:29:02.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.063 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:02.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:02.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:02.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:29:02.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:29:02.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:29:02.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:29:02.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:29:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:29:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:29:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:29:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:29:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:29:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:29:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:29:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:02.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:29:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:29:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:29:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:29:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:29:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:29:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:29:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:29:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:29:02.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:29:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:29:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:02.073 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 97.834838590000004, 2020-11-12T17:29:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:29:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:02.074 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:29:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:02.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:29:02.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:29:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:29:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:29:02.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:29:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:29:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:29:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:29:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:29:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:29:02.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:29:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:29:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:29:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:29:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:29:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:29:02.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:29:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:29:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:29:02.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:29:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:29:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:29:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:29:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.084 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:59192 5.0 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e168)", 2020-11-12T17:29:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.148139798000003, 2020-11-12T17:29:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003, 2020-11-12T17:29:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:02.085 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 59192 2020-11-12T17:29:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:02.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802660+0000", 2020-11-12T17:29:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9094000000000001e-05 2020-11-12T17:29:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802709+0000", 2020-11-12T17:29:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9580000000000004e-06 2020-11-12T17:29:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802715+0000", 2020-11-12T17:29:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0690000000000002e-06 2020-11-12T17:29:02.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802719+0000", 2020-11-12T17:29:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010962786 2020-11-12T17:29:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813681+0000", 2020-11-12T17:29:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011702 2020-11-12T17:29:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813798+0000", 2020-11-12T17:29:02.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187436 2020-11-12T17:29:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813986+0000", 2020-11-12T17:29:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020009369999999999 2020-11-12T17:29:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.815987+0000", 2020-11-12T17:29:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46767350899999999 2020-11-12T17:29:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283660+0000", 2020-11-12T17:29:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3396e-05 2020-11-12T17:29:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283734+0000", 2020-11-12T17:29:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0195999999999998e-05 2020-11-12T17:29:02.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283784+0000", 2020-11-12T17:29:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003 2020-11-12T17:29:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59360 5.1 e169/127 5:8e053221:::benchmark_data_smithi036_24110_object7419:head v 169'3752, mlcod=169'3747)", 2020-11-12T17:29:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 67.249652526999995, 2020-11-12T17:29:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999, 2020-11-12T17:29:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.096 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.097 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:02.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:29:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701143+0000", 2020-11-12T17:29:02.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4913000000000006e-05 2020-11-12T17:29:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701218+0000", 2020-11-12T17:29:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45075755000000001 2020-11-12T17:29:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151975+0000", 2020-11-12T17:29:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7439999999999996e-06 2020-11-12T17:29:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151984+0000", 2020-11-12T17:29:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5661000000000001e-05 2020-11-12T17:29:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152040+0000", 2020-11-12T17:29:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0267e-05 2020-11-12T17:29:02.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152070+0000", 2020-11-12T17:29:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027662300000000002 2020-11-12T17:29:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154836+0000", 2020-11-12T17:29:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0707e-05 2020-11-12T17:29:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154897+0000", 2020-11-12T17:29:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999 2020-11-12T17:29:02.103 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:62424 5.1 e171/127 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head v 171'3992, mlcod=171'3984)", 2020-11-12T17:29:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:02.104 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 62.751891890000003, 2020-11-12T17:29:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437, 2020-11-12T17:29:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:02.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:02.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198896+0000", 2020-11-12T17:29:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9000999999999997e-05 2020-11-12T17:29:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198985+0000", 2020-11-12T17:29:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48058147200000001 2020-11-12T17:29:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679566+0000", 2020-11-12T17:29:02.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9140000000000003e-06 2020-11-12T17:29:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679576+0000", 2020-11-12T17:29:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1407000000000003e-05 2020-11-12T17:29:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679647+0000", 2020-11-12T17:29:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1270999999999999e-05 2020-11-12T17:29:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679679+0000", 2020-11-12T17:29:02.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002926648 2020-11-12T17:29:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682605+0000", 2020-11-12T17:29:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1626999999999998e-05 2020-11-12T17:29:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682667+0000", 2020-11-12T17:29:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437 2020-11-12T17:29:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:65088 5.1 e177/127 5:8edfd3fe:::benchmark_data_smithi036_24110_object8135:head v 177'4152, mlcod=177'4145)", 2020-11-12T17:29:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 49.768767101999998, 2020-11-12T17:29:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004, 2020-11-12T17:29:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.113 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:29:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182031+0000", 2020-11-12T17:29:02.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8371000000000001e-05 2020-11-12T17:29:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182090+0000", 2020-11-12T17:29:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64597910199999997 2020-11-12T17:29:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828069+0000", 2020-11-12T17:29:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6649999999999998e-06 2020-11-12T17:29:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828078+0000", 2020-11-12T17:29:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013253599999999999 2020-11-12T17:29:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828211+0000", 2020-11-12T17:29:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1916999999999999e-05 2020-11-12T17:29:02.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828253+0000", 2020-11-12T17:29:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00329598 2020-11-12T17:29:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831549+0000", 2020-11-12T17:29:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5890999999999996e-05 2020-11-12T17:29:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831615+0000", 2020-11-12T17:29:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004 2020-11-12T17:29:02.120 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:12064 6.0 e198/193 ondisk, result = 0)", 2020-11-12T17:29:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:02.121 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 14.079742256999999, 2020-11-12T17:29:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674, 2020-11-12T17:29:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:29:02.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871061+0000", 2020-11-12T17:29:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6056000000000002e-05 2020-11-12T17:29:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871097+0000", 2020-11-12T17:29:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59417804799999996 2020-11-12T17:29:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465275+0000", 2020-11-12T17:29:02.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1326e-05 2020-11-12T17:29:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465287+0000", 2020-11-12T17:29:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1495000000000001e-05 2020-11-12T17:29:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465338+0000", 2020-11-12T17:29:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4560000000000003e-06 2020-11-12T17:29:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465345+0000", 2020-11-12T17:29:02.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9233000000000004e-05 2020-11-12T17:29:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465435+0000", 2020-11-12T17:29:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674 2020-11-12T17:29:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.6159.0:15080 6.b 6:ded5ee56:::benchmark_data_smithi036_29033_object1884:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e199)", 2020-11-12T17:29:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.725984465, 2020-11-12T17:29:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999, 2020-11-12T17:29:02.129 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.6159", 2020-11-12T17:29:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:29:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 15080 2020-11-12T17:29:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.130 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:29:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224802+0000", 2020-11-12T17:29:02.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1513000000000003e-05 2020-11-12T17:29:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224893+0000", 2020-11-12T17:29:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7841000000000001e-05 2020-11-12T17:29:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224911+0000", 2020-11-12T17:29:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1224e-05 2020-11-12T17:29:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224922+0000", 2020-11-12T17:29:02.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9716000000000006e-05 2020-11-12T17:29:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225012+0000", 2020-11-12T17:29:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017505999999999999 2020-11-12T17:29:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225187+0000", 2020-11-12T17:29:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030063900000000001 2020-11-12T17:29:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225488+0000", 2020-11-12T17:29:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021279850000000002 2020-11-12T17:29:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.227616+0000", 2020-11-12T17:29:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60001606200000002 2020-11-12T17:29:02.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827632+0000", 2020-11-12T17:29:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3869000000000002e-05 2020-11-12T17:29:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827686+0000", 2020-11-12T17:29:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7774999999999997e-05 2020-11-12T17:29:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.139 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827724+0000", 2020-11-12T17:29:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999 2020-11-12T17:29:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:15080 6.b e199/190 ondisk, result = 0)", 2020-11-12T17:29:02.140 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:02.141 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.721037818999999, 2020-11-12T17:29:02.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005, 2020-11-12T17:29:02.141 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.141 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:02.141 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:02.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:02.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:02.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229750+0000", 2020-11-12T17:29:02.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7358000000000001e-05 2020-11-12T17:29:02.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229817+0000", 2020-11-12T17:29:02.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59622965400000005 2020-11-12T17:29:02.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826047+0000", 2020-11-12T17:29:02.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7509999999999997e-06 2020-11-12T17:29:02.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826052+0000", 2020-11-12T17:29:02.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001561729 2020-11-12T17:29:02.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827614+0000", 2020-11-12T17:29:02.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0472000000000001e-05 2020-11-12T17:29:02.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827625+0000", 2020-11-12T17:29:02.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106687 2020-11-12T17:29:02.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.147 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.147 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827731+0000", 2020-11-12T17:29:02.147 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005 2020-11-12T17:29:02.147 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.147 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.148 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.148 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.6159.0:15728 6.7 e199/190 6:e4c465ea:::benchmark_data_smithi036_29033_object1965:head v 199'1032, mlcod=199'1025)", 2020-11-12T17:29:02.148 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:02.148 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 10.011425086999999, 2020-11-12T17:29:02.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426, 2020-11-12T17:29:02.149 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:02.149 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.149 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:02.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:02.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:02.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:29:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939371+0000", 2020-11-12T17:29:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3385000000000002e-05 2020-11-12T17:29:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:02.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939455+0000", 2020-11-12T17:29:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40948674800000001 2020-11-12T17:29:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348941+0000", 2020-11-12T17:29:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3089999999999998e-06 2020-11-12T17:29:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348949+0000", 2020-11-12T17:29:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3567999999999998e-05 2020-11-12T17:29:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:02.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349022+0000", 2020-11-12T17:29:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2410999999999999e-05 2020-11-12T17:29:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349055+0000", 2020-11-12T17:29:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050284420000000002 2020-11-12T17:29:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354083+0000", 2020-11-12T17:29:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8516000000000005e-05 2020-11-12T17:29:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:02.155 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354162+0000", 2020-11-12T17:29:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426 2020-11-12T17:29:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:02.156 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:02.156 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:02.158 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:29:02.159 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:02.155+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:02.259 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:02.259+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:02.294 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:02.295 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:02.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.295 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:26145 6.2 e203/190 6:4926c0e5:::benchmark_data_smithi036_29033_object3268:head v 203'1409, mlcod=203'1407)", 2020-11-12T17:29:02.295 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:29:02.294608+0000", 2020-11-12T17:29:02.295 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00046609800000000002, 2020-11-12T17:29:02.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049657100000000001, 2020-11-12T17:29:02.296 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.296 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:02.296 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:02.294608+0000", 2020-11-12T17:29:02.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:02.294608+0000", 2020-11-12T17:29:02.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:29:02.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:02.294581+0000", 2020-11-12T17:29:02.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4017999999999993e-05 2020-11-12T17:29:02.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:02.294675+0000", 2020-11-12T17:29:02.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5086000000000001e-05 2020-11-12T17:29:02.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:02.294730+0000", 2020-11-12T17:29:02.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0530000000000007e-06 2020-11-12T17:29:02.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:02.294738+0000", 2020-11-12T17:29:02.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4539000000000001e-05 2020-11-12T17:29:02.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:02.294792+0000", 2020-11-12T17:29:02.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5874e-05 2020-11-12T17:29:02.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:02.294818+0000", 2020-11-12T17:29:02.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020973699999999999 2020-11-12T17:29:02.304 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.304 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.304 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.304 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.304 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:29:02.304 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 1 2020-11-12T17:29:02.304 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:02.307 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:29:02.360 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:29:02.359+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:29:02.425 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:02.425 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:02.425 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:02.426 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:02.426 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:02.438 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:29:02.439 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:29:02.435+0000 7f038ead6700 -1 osd.2 203 handle_osd_map injecting map crc failure 2020-11-12T17:29:02.439 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:02.435+0000 7fc24d2e3700 -1 osd.3 203 handle_osd_map injecting map crc failure 2020-11-12T17:29:02.472 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:02.472+0000 7f9a06aa2700 -1 osd.5 203 handle_osd_map injecting map crc failure 2020-11-12T17:29:02.473 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:02.472+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:02.523 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 26 16 26455 26439 7.94372 8.625 0.00443184 0.0157196 2020-11-12T17:29:02.562 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:02.559+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:02.569 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:02.569 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:02.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:02.569 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:02.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.570 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:29:02.570 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:29:02.570 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 351.88120816899999, 2020-11-12T17:29:02.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:29:02.571 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.571 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.571 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.571 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:02.571 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:02.572 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:29:02.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.572 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:29:02.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:29:02.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:29:02.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:29:02.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:29:02.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:29:02.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:29:02.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:29:02.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:29:02.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:29:02.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:29:02.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:29:02.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:29:02.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:29:02.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:29:02.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:02.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:29:02.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:29:02.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:29:02.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:29:02.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:29:02.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:29:02.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:29:02.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:29:02.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:29:02.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:29:02.584 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.584 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.584 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.585 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:29:02.585 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:29:02.585 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 351.8757281, 2020-11-12T17:29:02.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:29:02.585 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.585 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:02.586 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:29:02.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:29:02.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:02.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:29:02.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:29:02.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:29:02.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:29:02.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:29:02.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:29:02.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:29:02.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:29:02.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:29:02.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:29:02.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:29:02.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:29:02.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:29:02.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:29:02.594 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.594 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.594 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.594 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:29:02.595 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:29:02.595 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 343.68560650000001, 2020-11-12T17:29:02.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:29:02.595 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.595 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.595 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:02.596 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:02.596 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:29:02.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.596 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:29:02.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:29:02.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:29:02.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:29:02.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:29:02.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:29:02.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:29:02.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:29:02.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:29:02.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:29:02.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:29:02.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:29:02.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:29:02.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:29:02.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:29:02.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:02.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:29:02.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:29:02.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:29:02.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:29:02.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:29:02.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:29:02.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:29:02.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:29:02.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:29:02.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:29:02.615 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.615 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.617 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:29:02.617 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:29:02.617 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 343.67836279099998, 2020-11-12T17:29:02.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:29:02.618 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.619 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:02.619 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:29:02.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:29:02.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:29:02.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:29:02.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:29:02.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:29:02.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:29:02.626 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:29:02.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:29:02.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:29:02.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:29:02.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:29:02.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:29:02.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:29:02.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:29:02.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.634 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:29:02.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:29:02.635 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.635 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.635 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.636 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.636 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:29:02.637 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:29:02.637 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 267.68227341699998, 2020-11-12T17:29:02.637 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:29:02.637 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.637 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:02.638 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:29:02.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.639 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.639 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:29:02.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:29:02.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:29:02.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:29:02.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:29:02.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:29:02.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:29:02.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:29:02.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:29:02.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:29:02.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:29:02.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:29:02.643 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.644 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.644 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:29:02.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:29:02.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:29:02.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:29:02.645 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.645 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.646 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.646 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:29:02.646 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:29:02.646 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 201.55475090499999, 2020-11-12T17:29:02.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:29:02.647 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.647 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:02.647 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.647 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:29:02.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.648 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:29:02.648 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:02.648 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:29:02.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:29:02.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.649 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.649 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:29:02.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:29:02.650 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:29:02.650 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:29:02.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.651 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:29:02.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:29:02.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:29:02.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:29:02.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.652 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.652 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:29:02.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:29:02.653 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:29:02.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:29:02.653 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.654 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.654 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.654 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:29:02.654 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:29:02.655 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 194.50400346399999, 2020-11-12T17:29:02.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:29:02.655 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.655 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.655 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.655 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:02.655 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:02.656 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:29:02.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.656 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:29:02.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:29:02.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:29:02.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:29:02.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:29:02.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:29:02.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:29:02.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:29:02.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:29:02.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:29:02.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:29:02.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:29:02.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:29:02.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:29:02.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:29:02.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:02.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:29:02.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:29:02.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:29:02.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:29:02.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:29:02.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:29:02.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:29:02.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:29:02.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:29:02.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:29:02.665 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.665 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.665 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.666 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:29:02.666 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:29:02.666 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 194.503915269, 2020-11-12T17:29:02.666 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:29:02.666 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.667 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.667 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.667 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:02.667 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:02.667 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:29:02.667 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.667 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:29:02.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:29:02.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:02.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:29:02.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:29:02.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:29:02.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:29:02.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:29:02.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:29:02.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:29:02.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:29:02.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:29:02.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:29:02.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:29:02.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:29:02.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:02.673 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:29:02.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:29:02.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:29:02.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:29:02.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.675 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:29:02.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:29:02.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.675 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:29:02.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:29:02.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.676 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.676 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.676 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:29:02.677 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:29:02.677 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.677 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.677 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.678 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:29:02.678 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:29:02.678 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 194.48520223599999, 2020-11-12T17:29:02.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:29:02.679 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.679 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:02.679 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:29:02.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:29:02.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:02.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:29:02.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:29:02.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:29:02.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:29:02.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:29:02.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:29:02.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:29:02.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:29:02.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:29:02.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:29:02.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:29:02.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:29:02.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.688 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:29:02.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:29:02.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.688 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.689 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:02.689 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:29:02.690 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 161.73437978499999, 2020-11-12T17:29:02.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:29:02.690 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.690 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.690 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.691 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:02.691 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:02.691 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:29:02.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.691 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:29:02.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:29:02.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:29:02.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:29:02.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:29:02.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:29:02.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:29:02.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:29:02.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:29:02.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:29:02.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:29:02.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:29:02.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:29:02.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:29:02.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:29:02.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:02.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:29:02.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:29:02.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:29:02.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:29:02.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:29:02.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:29:02.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:29:02.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:29:02.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:29:02.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:29:02.704 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.704 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.705 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.705 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:02.705 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:29:02.706 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 160.647724297, 2020-11-12T17:29:02.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:29:02.706 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.706 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.706 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:02.707 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:02.707 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:29:02.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.707 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:29:02.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:29:02.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:29:02.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:29:02.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:29:02.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:29:02.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:29:02.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:29:02.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:29:02.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:29:02.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:29:02.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:29:02.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:29:02.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:29:02.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:29:02.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:02.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:29:02.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:29:02.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.715 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.715 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:29:02.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:29:02.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:29:02.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:29:02.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:29:02.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:29:02.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:29:02.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:29:02.719 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.719 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.719 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.719 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:29:02.719 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:29:02.720 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 160.63424307, 2020-11-12T17:29:02.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:29:02.720 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.720 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:02.720 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:29:02.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:29:02.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:29:02.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:29:02.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:29:02.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:29:02.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:29:02.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:29:02.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:29:02.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:29:02.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:29:02.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:29:02.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:29:02.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:29:02.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:29:02.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:29:02.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:29:02.734 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.734 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.734 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.735 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:29:02.735 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:29:02.735 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.63195486799999, 2020-11-12T17:29:02.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:29:02.736 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.736 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.736 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.736 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:02.736 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:02.737 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:29:02.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.737 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:29:02.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:29:02.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:29:02.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:29:02.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:29:02.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:29:02.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:29:02.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:29:02.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:29:02.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:29:02.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:29:02.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:29:02.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:29:02.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:29:02.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:29:02.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:02.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:29:02.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:29:02.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:29:02.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:29:02.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:29:02.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:29:02.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:29:02.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:29:02.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:29:02.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:29:02.750 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.751 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.751 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.751 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:29:02.751 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:29:02.751 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.62613828400001, 2020-11-12T17:29:02.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:29:02.752 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.752 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:02.752 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:02.752 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:29:02.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.753 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:29:02.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:29:02.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:29:02.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:29:02.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:29:02.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:29:02.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:29:02.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:29:02.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:29:02.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:29:02.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:29:02.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:29:02.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:29:02.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:29:02.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:29:02.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:02.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:29:02.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:29:02.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:29:02.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:29:02.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:29:02.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:29:02.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:29:02.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:29:02.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:29:02.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:29:02.762 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.762 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.762 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.763 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:29:02.763 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:29:02.763 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 125.60320477, 2020-11-12T17:29:02.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:29:02.763 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.763 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.763 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:29:02.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:29:02.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:02.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:29:02.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:29:02.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:29:02.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:29:02.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:29:02.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:29:02.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:29:02.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:29:02.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:29:02.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:29:02.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:29:02.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:29:02.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:29:02.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:29:02.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:29:02.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:29:02.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.771 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.771 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:29:02.771 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:29:02.771 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 119.07072674299999, 2020-11-12T17:29:02.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:29:02.772 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.772 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.772 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:29:02.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:29:02.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:29:02.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:29:02.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:29:02.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:29:02.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:29:02.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:29:02.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:29:02.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:29:02.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:29:02.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:29:02.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:29:02.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:29:02.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:29:02.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:29:02.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:29:02.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:29:02.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:29:02.779 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.779 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.779 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.780 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e169)", 2020-11-12T17:29:02.780 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:29:02.780 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.876020702999995, 2020-11-12T17:29:02.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002, 2020-11-12T17:29:02.780 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.780 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.780 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.781 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:02.781 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:02.781 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:29:02.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.781 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:29:02.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:29:02.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:29:02.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691863+0000", 2020-11-12T17:29:02.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103144 2020-11-12T17:29:02.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691966+0000", 2020-11-12T17:29:02.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8453000000000001e-05 2020-11-12T17:29:02.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691985+0000", 2020-11-12T17:29:02.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0385e-05 2020-11-12T17:29:02.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691995+0000", 2020-11-12T17:29:02.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0098187989999999996 2020-11-12T17:29:02.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701814+0000", 2020-11-12T17:29:02.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000135065 2020-11-12T17:29:02.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701949+0000", 2020-11-12T17:29:02.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025538399999999999 2020-11-12T17:29:02.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:02.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.702205+0000", 2020-11-12T17:29:02.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034246620000000002 2020-11-12T17:29:02.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.705629+0000", 2020-11-12T17:29:02.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.450897995 2020-11-12T17:29:02.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156527+0000", 2020-11-12T17:29:02.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2074000000000001e-05 2020-11-12T17:29:02.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156599+0000", 2020-11-12T17:29:02.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1148000000000002e-05 2020-11-12T17:29:02.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156690+0000", 2020-11-12T17:29:02.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002 2020-11-12T17:29:02.791 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.791 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.791 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.792 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e169)", 2020-11-12T17:29:02.792 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:29:02.792 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 67.854402089000004, 2020-11-12T17:29:02.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003, 2020-11-12T17:29:02.792 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.792 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:29:02.792 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.793 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:02.793 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:02.793 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:29:02.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.793 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:29:02.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:29:02.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:02.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713485+0000", 2020-11-12T17:29:02.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7021000000000005e-05 2020-11-12T17:29:02.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713582+0000", 2020-11-12T17:29:02.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2103000000000001e-05 2020-11-12T17:29:02.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713595+0000", 2020-11-12T17:29:02.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0129999999999999e-06 2020-11-12T17:29:02.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713601+0000", 2020-11-12T17:29:02.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001321727 2020-11-12T17:29:02.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.714922+0000", 2020-11-12T17:29:02.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011930300000000001 2020-11-12T17:29:02.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:29:02.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.715042+0000", 2020-11-12T17:29:02.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44158781200000002 2020-11-12T17:29:02.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156629+0000", 2020-11-12T17:29:02.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003 2020-11-12T17:29:02.799 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.800 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.800 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.800 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62424 5.1 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e171)", 2020-11-12T17:29:02.800 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:29:02.800 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 63.372469995000003, 2020-11-12T17:29:02.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456, 2020-11-12T17:29:02.801 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.801 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:02.801 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:02.801 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62424 2020-11-12T17:29:02.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.802 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:29:02.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:29:02.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999809 2020-11-12T17:29:02.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195432+0000", 2020-11-12T17:29:02.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1144999999999999e-05 2020-11-12T17:29:02.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195483+0000", 2020-11-12T17:29:02.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2553e-05 2020-11-12T17:29:02.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195496+0000", 2020-11-12T17:29:02.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0469999999999996e-06 2020-11-12T17:29:02.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195503+0000", 2020-11-12T17:29:02.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041025339999999997 2020-11-12T17:29:02.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199605+0000", 2020-11-12T17:29:02.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114968 2020-11-12T17:29:02.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199720+0000", 2020-11-12T17:29:02.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020953000000000001 2020-11-12T17:29:02.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:02.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199930+0000", 2020-11-12T17:29:02.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043700170000000003 2020-11-12T17:29:02.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.204300+0000", 2020-11-12T17:29:02.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.480176663 2020-11-12T17:29:02.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684477+0000", 2020-11-12T17:29:02.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017691000000000001 2020-11-12T17:29:02.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684653+0000", 2020-11-12T17:29:02.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107935 2020-11-12T17:29:02.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684761+0000", 2020-11-12T17:29:02.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456 2020-11-12T17:29:02.811 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.811 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.811 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.812 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:65088 5.1 5:8edfd3fe:::benchmark_data_smithi036_24110_object8135:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e177)", 2020-11-12T17:29:02.812 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:29:02.812 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 50.387068945000003, 2020-11-12T17:29:02.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.652361309, 2020-11-12T17:29:02.812 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:02.812 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:02.812 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:02.813 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:02.813 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:02.813 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 65088 2020-11-12T17:29:02.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.813 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:02.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:02.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:29:02.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:02.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:02.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:29:02.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:29:02.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:02.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180810+0000", 2020-11-12T17:29:02.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120461 2020-11-12T17:29:02.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:02.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180931+0000", 2020-11-12T17:29:02.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5746000000000001e-05 2020-11-12T17:29:02.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:02.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180947+0000", 2020-11-12T17:29:02.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8739999999999995e-06 2020-11-12T17:29:02.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:02.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180955+0000", 2020-11-12T17:29:02.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017552710000000001 2020-11-12T17:29:02.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:02.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.182710+0000", 2020-11-12T17:29:02.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013040999999999999 2020-11-12T17:29:02.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:02.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.182840+0000", 2020-11-12T17:29:02.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000212112 2020-11-12T17:29:02.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:02.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.183052+0000", 2020-11-12T17:29:02.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031255879999999999 2020-11-12T17:29:02.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:02.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.186178+0000", 2020-11-12T17:29:02.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.64690791400000003 2020-11-12T17:29:02.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:02.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833086+0000", 2020-11-12T17:29:02.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2926000000000001e-05 2020-11-12T17:29:02.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:02.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833139+0000", 2020-11-12T17:29:02.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4467000000000004e-05 2020-11-12T17:29:02.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:02.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:02.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:02.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833213+0000", 2020-11-12T17:29:02.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.652361309 2020-11-12T17:29:02.822 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.823 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.823 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.823 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:02.823 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:02.823 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:02.824 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:29:02.825 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:29:02.826 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:02.823+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:02.926 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:02.923+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:02.999 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:03.283 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:03.283 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:03.284 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:03.285 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:29:03.286 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:03.284+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:03.386 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:03.383+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:03.461 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:03.482 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:03.482 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:03.483 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:03.483 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:03.485 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:29:03.487 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:03.487+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:03.523 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 27 16 27432 27416 7.93218 7.63281 0.00695024 0.0157449 2020-11-12T17:29:03.589 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:03.587+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:03.631 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:03.750 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:03.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:03.751 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:03.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.752 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:29:03.752 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:29:03.753 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 313.603177507, 2020-11-12T17:29:03.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:29:03.753 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:03.754 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:03.754 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:03.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:03.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:29:03.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:03.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:03.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:29:03.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:29:03.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:03.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:29:03.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:29:03.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:03.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:29:03.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:29:03.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:03.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:29:03.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:29:03.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:03.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:29:03.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:29:03.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:03.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:29:03.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:29:03.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:03.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:29:03.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:29:03.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:03.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:29:03.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:29:03.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:03.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:29:03.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:29:03.772 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.773 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:03.773 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.774 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:29:03.774 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:29:03.775 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 281.66319216400001, 2020-11-12T17:29:03.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:29:03.775 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:03.776 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:03.776 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:03.776 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:03.776 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:03.777 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:29:03.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.777 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:03.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:03.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:29:03.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:03.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:03.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:29:03.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:29:03.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:03.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:29:03.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:29:03.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:03.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:29:03.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:29:03.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:03.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:29:03.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:29:03.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:03.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:29:03.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:29:03.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:03.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:29:03.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:29:03.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:03.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:29:03.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:29:03.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:03.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:29:03.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:29:03.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:03.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:29:03.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:29:03.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:03.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:29:03.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:29:03.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:03.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:29:03.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:29:03.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:03.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:29:03.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:29:03.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.797 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:03.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.797 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:29:03.798 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:29:03.798 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 270.18609108999999, 2020-11-12T17:29:03.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:29:03.798 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:03.798 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:29:03.798 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:03.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:03.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:29:03.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:03.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:03.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:29:03.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:29:03.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:03.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:29:03.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:29:03.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:03.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:29:03.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:29:03.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:03.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:29:03.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:29:03.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:03.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:29:03.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:29:03.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:03.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:29:03.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:29:03.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:03.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:29:03.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:29:03.804 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.804 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:03.804 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.805 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:29:03.805 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:29:03.805 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 269.06708070299999, 2020-11-12T17:29:03.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:29:03.805 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:03.806 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:03.806 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:03.806 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:03.806 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:03.806 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:29:03.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.806 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:03.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:03.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:29:03.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:03.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:03.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:29:03.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:29:03.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:03.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:29:03.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:29:03.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:03.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:29:03.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:29:03.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:03.819 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:29:03.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:29:03.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.820 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:03.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:29:03.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:29:03.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:03.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:29:03.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:29:03.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:03.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:29:03.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:29:03.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:03.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:29:03.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:29:03.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:03.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:29:03.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:29:03.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:03.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:29:03.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:29:03.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:03.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:29:03.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:29:03.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:03.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:29:03.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:29:03.825 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.825 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:03.826 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.826 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:29:03.826 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:29:03.826 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 269.05094269900002, 2020-11-12T17:29:03.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:29:03.827 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:03.827 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:03.827 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:03.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:03.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:29:03.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:03.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:03.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:29:03.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:29:03.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:03.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:29:03.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:29:03.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:03.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:29:03.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:29:03.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:03.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:29:03.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:29:03.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:03.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:29:03.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:29:03.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:03.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:29:03.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:29:03.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:03.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:29:03.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:29:03.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:03.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:29:03.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:29:03.833 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.833 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:03.833 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:03.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:03.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:03.834 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:29:03.834 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:29:03.834 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 269.04621501999998, 2020-11-12T17:29:03.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:29:03.834 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:03.834 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:29:03.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:03.969 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:03.969 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:03.970 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:29:03.970 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.195 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:29:04.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:29:04.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:29:04.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:29:04.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:29:04.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:29:04.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:29:04.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:29:04.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:29:04.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:29:04.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:29:04.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:29:04.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:29:04.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:29:04.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:29:04.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:29:04.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:29:04.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:29:04.203 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.204 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.204 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.205 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:04.205 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:29:04.205 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 163.002453121, 2020-11-12T17:29:04.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:29:04.205 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.206 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.206 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.206 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:04.206 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:04.206 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:29:04.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.207 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:29:04.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:29:04.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:04.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:29:04.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:29:04.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:29:04.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:29:04.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:29:04.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:29:04.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:29:04.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:29:04.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:29:04.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:29:04.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:29:04.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:29:04.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:04.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:29:04.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:29:04.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:29:04.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:29:04.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:29:04.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:29:04.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:29:04.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:29:04.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:29:04.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:29:04.219 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.219 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.219 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.220 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:04.220 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:29:04.221 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 163.00055950800001, 2020-11-12T17:29:04.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:29:04.221 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.221 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.221 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.221 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:04.222 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:04.222 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:29:04.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.222 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:29:04.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:29:04.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:29:04.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:29:04.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:29:04.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:29:04.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:29:04.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:29:04.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:29:04.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:29:04.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:29:04.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:29:04.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:29:04.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:29:04.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:29:04.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:04.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:29:04.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:29:04.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:29:04.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:29:04.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:29:04.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:29:04.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:29:04.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:29:04.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:29:04.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:29:04.234 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.234 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.234 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.235 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:04.235 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:29:04.235 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.99980686000001, 2020-11-12T17:29:04.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:29:04.235 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.236 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.236 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.236 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:04.236 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:04.236 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:29:04.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.237 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:29:04.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:29:04.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:29:04.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:29:04.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:29:04.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:29:04.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:29:04.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:29:04.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:29:04.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:29:04.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:29:04.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:29:04.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:29:04.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:29:04.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:29:04.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:04.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:29:04.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:29:04.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:29:04.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:29:04.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:29:04.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:29:04.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:29:04.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:29:04.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:29:04.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:29:04.248 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.248 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.248 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.248 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:04.249 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:29:04.249 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.99664534300001, 2020-11-12T17:29:04.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:29:04.249 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.249 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.249 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.249 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:04.250 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:04.250 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:29:04.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.250 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:29:04.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:29:04.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:29:04.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:29:04.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:29:04.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:29:04.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:29:04.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:29:04.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:29:04.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:29:04.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:29:04.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:29:04.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:29:04.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:29:04.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:29:04.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:04.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:29:04.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:29:04.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:29:04.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:29:04.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.259 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.259 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:29:04.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:29:04.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:29:04.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:29:04.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.260 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:29:04.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:29:04.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.261 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.261 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.261 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.262 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:04.262 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:29:04.262 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.99556417599999, 2020-11-12T17:29:04.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:29:04.262 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.263 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:04.263 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:04.263 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:29:04.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.264 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:29:04.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:29:04.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:29:04.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:29:04.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:29:04.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.266 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.266 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:29:04.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:29:04.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:29:04.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:29:04.267 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:29:04.268 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:29:04.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.269 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.269 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:29:04.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:29:04.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:29:04.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:29:04.270 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:04.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:29:04.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:29:04.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:29:04.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:29:04.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.272 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.272 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:29:04.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:29:04.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:29:04.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:29:04.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:29:04.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:29:04.274 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.274 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.274 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.275 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:04.275 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:29:04.275 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.99539508300001, 2020-11-12T17:29:04.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:29:04.275 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.275 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.276 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.276 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:04.276 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:04.276 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:29:04.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.276 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:29:04.277 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:29:04.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:29:04.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:29:04.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:29:04.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:29:04.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:29:04.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:29:04.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:29:04.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:29:04.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:29:04.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:29:04.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:29:04.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:29:04.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:29:04.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:04.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:29:04.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:29:04.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:29:04.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:29:04.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:29:04.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:29:04.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:29:04.284 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:29:04.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.285 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.285 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:29:04.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:29:04.286 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.286 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.286 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.287 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:04.287 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:29:04.287 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.992776437, 2020-11-12T17:29:04.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:29:04.288 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.288 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.288 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.288 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:04.288 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:04.289 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:29:04.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.289 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:29:04.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:29:04.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:29:04.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:29:04.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:29:04.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.292 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:29:04.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:29:04.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:29:04.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:29:04.293 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.293 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:29:04.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:29:04.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:29:04.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:29:04.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.295 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:29:04.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:29:04.296 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.296 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:04.296 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:29:04.297 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:29:04.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.297 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:29:04.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:29:04.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:29:04.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:29:04.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:29:04.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:29:04.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:29:04.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:29:04.301 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.302 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.302 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.303 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:04.303 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:29:04.303 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.99266835399999, 2020-11-12T17:29:04.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:29:04.304 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.304 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.305 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.305 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:04.305 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:04.305 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:29:04.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.306 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:29:04.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:29:04.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:04.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:29:04.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:29:04.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:29:04.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:29:04.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:29:04.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:29:04.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:29:04.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:29:04.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:29:04.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:29:04.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:29:04.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:29:04.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.314 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:04.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:29:04.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:29:04.315 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.315 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.315 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:29:04.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:29:04.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:29:04.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:29:04.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:29:04.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:29:04.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:29:04.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:29:04.318 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.318 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.318 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.319 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:29:04.319 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:29:04.319 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 162.98870567200001, 2020-11-12T17:29:04.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:29:04.319 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.319 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:04.320 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:29:04.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:29:04.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:29:04.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:29:04.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:29:04.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:29:04.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:29:04.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:29:04.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:29:04.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:29:04.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:29:04.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:29:04.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:29:04.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:29:04.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:29:04.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:29:04.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:29:04.327 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.328 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.328 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.329 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:29:04.329 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:29:04.329 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 119.950975931, 2020-11-12T17:29:04.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:29:04.329 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.330 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.330 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:29:04.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:29:04.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:04.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:29:04.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:29:04.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:29:04.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:29:04.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:29:04.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:29:04.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:29:04.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:29:04.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:29:04.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:29:04.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:29:04.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:29:04.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:29:04.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:29:04.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:29:04.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:29:04.338 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.338 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.338 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.339 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:29:04.339 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:29:04.340 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 65.437573245999999, 2020-11-12T17:29:04.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:29:04.340 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.340 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:04.340 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:29:04.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:29:04.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:29:04.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:29:04.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:29:04.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:29:04.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:29:04.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:29:04.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:29:04.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:29:04.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:29:04.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:29:04.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:29:04.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:29:04.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:29:04.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:29:04.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:29:04.348 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.349 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.349 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.350 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:29:04.350 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:29:04.350 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.101263360999994, 2020-11-12T17:29:04.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:29:04.350 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.351 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:04.351 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:04.351 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:29:04.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.352 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:29:04.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:29:04.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:29:04.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:29:04.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:29:04.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:29:04.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:29:04.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:29:04.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:29:04.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.356 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.357 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:29:04.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:29:04.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.357 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.357 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:29:04.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:29:04.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:29:04.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:29:04.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:04.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:29:04.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:29:04.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:29:04.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:29:04.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:29:04.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:29:04.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:29:04.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:29:04.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:29:04.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:29:04.363 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.363 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.364 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.364 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:29:04.364 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:29:04.364 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.083655234999995, 2020-11-12T17:29:04.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:29:04.365 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.365 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:04.365 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:29:04.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:29:04.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:04.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:29:04.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:29:04.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:29:04.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:29:04.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:29:04.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:29:04.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:29:04.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:29:04.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:29:04.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:29:04.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:29:04.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:29:04.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:29:04.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:29:04.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.373 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.373 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.374 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:15728 6.7 6:e4c465ea:::benchmark_data_smithi036_29033_object1965:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e199)", 2020-11-12T17:29:04.374 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:51.936993+0000", 2020-11-12T17:29:04.374 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 11.671711650000001, 2020-11-12T17:29:04.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42862954800000003, 2020-11-12T17:29:04.374 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:04.374 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:04.375 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:04.375 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:29:04.375 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:29:04.375 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 15728 2020-11-12T17:29:04.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.375 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:04.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:04.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.936993+0000", 2020-11-12T17:29:04.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:04.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:04.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.936993+0000", 2020-11-12T17:29:04.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:29:04.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:04.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.936974+0000", 2020-11-12T17:29:04.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.728e-05 2020-11-12T17:29:04.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:04.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.937031+0000", 2020-11-12T17:29:04.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0029999999999994e-06 2020-11-12T17:29:04.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:04.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.937039+0000", 2020-11-12T17:29:04.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8280000000000002e-06 2020-11-12T17:29:04.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:04.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.937044+0000", 2020-11-12T17:29:04.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027712489999999999 2020-11-12T17:29:04.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:04.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.939815+0000", 2020-11-12T17:29:04.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114197 2020-11-12T17:29:04.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:04.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.939929+0000", 2020-11-12T17:29:04.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020821500000000001 2020-11-12T17:29:04.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:04.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.940138+0000", 2020-11-12T17:29:04.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001754907 2020-11-12T17:29:04.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:04.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.941893+0000", 2020-11-12T17:29:04.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42363165000000003 2020-11-12T17:29:04.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:04.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:52.365524+0000", 2020-11-12T17:29:04.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030999999999999e-05 2020-11-12T17:29:04.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:04.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:52.365580+0000", 2020-11-12T17:29:04.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2740000000000001e-05 2020-11-12T17:29:04.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:04.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:04.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:04.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:52.365623+0000", 2020-11-12T17:29:04.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42862954800000003 2020-11-12T17:29:04.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.386 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.386 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:04.386 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:04.386 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:04.387 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:29:04.388 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:29:04.389 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:29:04.390 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:04.387+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:04.490 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:04.488+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:04.517 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:04.518 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:04.518 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:04.518 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:04.524 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 28 16 28253 28237 7.87795 6.41406 0.00721627 0.0158555 2020-11-12T17:29:04.531 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:29:04.606 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:04.622 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:04.620+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:04.639 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:04.669 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:29:04.691 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:04.688+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:04.699 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:04.700 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:04.700 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:04.700 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:04.700 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:04.700 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:04.711 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:29:04.728 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:04.770 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:04.793 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:04.791+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:04.879 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:04.879 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:04.890 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:29:04.936 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:04.936+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:04.995 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:29:04.995+0000 7f039a1d9700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21464) UID: 0 2020-11-12T17:29:05.012 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:05.012 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:05.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.012 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:28795 6.5 e205/190 6:a98c285e:::benchmark_data_smithi036_29033_object3599:head v 205'1971, mlcod=205'1967)", 2020-11-12T17:29:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:29:05.008248+0000", 2020-11-12T17:29:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0042693039999999998, 2020-11-12T17:29:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0042949470000000003, 2020-11-12T17:29:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.008248+0000", 2020-11-12T17:29:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.008248+0000", 2020-11-12T17:29:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999743 2020-11-12T17:29:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.008222+0000", 2020-11-12T17:29:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3276000000000006e-05 2020-11-12T17:29:05.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.008315+0000", 2020-11-12T17:29:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5787e-05 2020-11-12T17:29:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.016 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.008371+0000", 2020-11-12T17:29:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5350000000000001e-06 2020-11-12T17:29:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.008378+0000", 2020-11-12T17:29:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049858400000000005 2020-11-12T17:29:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.008876+0000", 2020-11-12T17:29:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4172000000000002e-05 2020-11-12T17:29:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.008901+0000", 2020-11-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065273999999999996 2020-11-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.019 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:28796 6.5 e205/190 6:a98c285e:::benchmark_data_smithi036_29033_object3599:head v 205'1972, mlcod=205'1967)", 2020-11-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:29:05.009476+0000", 2020-11-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0030408369999999998, 2020-11-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031450129999999999, 2020-11-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.009476+0000", 2020-11-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.009476+0000", 2020-11-12T17:29:05.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.009448+0000", 2020-11-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7595000000000004e-05 2020-11-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.009535+0000", 2020-11-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0204999999999997e-05 2020-11-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.009596+0000", 2020-11-12T17:29:05.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2349999999999996e-06 2020-11-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.009602+0000", 2020-11-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060882700000000004 2020-11-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.010211+0000", 2020-11-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1922000000000001e-05 2020-11-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.010233+0000", 2020-11-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00075639499999999998 2020-11-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.026 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:28797 6.5 e205/190 6:a98c285e:::benchmark_data_smithi036_29033_object3599:head v 205'1973, mlcod=205'1967)", 2020-11-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:29:05.010190+0000", 2020-11-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0023271949999999998, 2020-11-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024789360000000002, 2020-11-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.010190+0000", 2020-11-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.010190+0000", 2020-11-12T17:29:05.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.010167+0000", 2020-11-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7601000000000003e-05 2020-11-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.010264+0000", 2020-11-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5885999999999997e-05 2020-11-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.030 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.010350+0000", 2020-11-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8909999999999998e-06 2020-11-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.010357+0000", 2020-11-12T17:29:05.031 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00072138300000000003 2020-11-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011078+0000", 2020-11-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3424000000000001e-05 2020-11-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011092+0000", 2020-11-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00090203600000000005 2020-11-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.033 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:28792 6.b e205/190 6:d44d87ef:::benchmark_data_smithi036_29033_object3598:head v 205'1912, mlcod=205'1908)", 2020-11-12T17:29:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:29:05.011033+0000", 2020-11-12T17:29:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.0014845030000000001, 2020-11-12T17:29:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00171974, 2020-11-12T17:29:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011033+0000", 2020-11-12T17:29:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011033+0000", 2020-11-12T17:29:05.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:29:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011007+0000", 2020-11-12T17:29:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7292000000000004e-05 2020-11-12T17:29:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011094+0000", 2020-11-12T17:29:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5663999999999999e-05 2020-11-12T17:29:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011170+0000", 2020-11-12T17:29:05.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5919999999999997e-06 2020-11-12T17:29:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011177+0000", 2020-11-12T17:29:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0791999999999997e-05 2020-11-12T17:29:05.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011237+0000", 2020-11-12T17:29:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1960999999999999e-05 2020-11-12T17:29:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011259+0000", 2020-11-12T17:29:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022683299999999999 2020-11-12T17:29:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.040 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:28798 6.5 e205/190 6:a98c285e:::benchmark_data_smithi036_29033_object3599:head v 205'1974, mlcod=205'1968)", 2020-11-12T17:29:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:29:05.011619+0000", 2020-11-12T17:29:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 0.00089847500000000003, 2020-11-12T17:29:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012205899999999999, 2020-11-12T17:29:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011619+0000", 2020-11-12T17:29:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011619+0000", 2020-11-12T17:29:05.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:29:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011605+0000", 2020-11-12T17:29:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5772000000000002e-05 2020-11-12T17:29:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011651+0000", 2020-11-12T17:29:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4421000000000001e-05 2020-11-12T17:29:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.044 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011686+0000", 2020-11-12T17:29:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2200000000000003e-06 2020-11-12T17:29:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011690+0000", 2020-11-12T17:29:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012540500000000001 2020-11-12T17:29:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011815+0000", 2020-11-12T17:29:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2925000000000002e-05 2020-11-12T17:29:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:29:05.011838+0000", 2020-11-12T17:29:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000219619 2020-11-12T17:29:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: ], 2020-11-12T17:29:05.047 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 5 2020-11-12T17:29:05.047 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:05.048 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:29:05.137 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:05.136+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:05.196 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:05.196+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:05.222 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:05.222 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:05.222 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:05.222 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:05.223 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:05.234 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:29:05.297 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:05.295+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:05.398 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:05.396+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:05.410 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:05.411 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:05.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:05.411 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:05.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.411 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:29:05.412 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:05.412 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 356.56632480899998, 2020-11-12T17:29:05.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:29:05.412 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.412 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:05.412 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:05.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:05.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:29:05.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:29:05.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:29:05.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:29:05.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:29:05.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.415 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.415 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:29:05.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:29:05.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:29:05.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:29:05.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:29:05.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:29:05.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:29:05.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:29:05.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:29:05.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:29:05.418 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.418 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.419 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.419 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:29:05.419 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:05.419 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 351.00612758699998, 2020-11-12T17:29:05.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:29:05.420 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.420 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.420 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:05.420 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:05.420 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:05.420 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:29:05.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.420 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:05.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:05.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:29:05.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:29:05.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:29:05.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:29:05.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:29:05.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:29:05.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:29:05.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:29:05.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:29:05.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:29:05.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:29:05.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:29:05.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:29:05.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:05.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:29:05.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:29:05.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:05.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:29:05.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:29:05.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:05.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:29:05.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:29:05.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:29:05.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:29:05.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:29:05.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:29:05.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.429 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.430 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:29:05.430 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:05.430 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 351.00023526400003, 2020-11-12T17:29:05.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:29:05.430 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.431 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:05.431 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:05.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:05.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:29:05.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:29:05.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:29:05.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:29:05.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:29:05.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:29:05.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:29:05.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:29:05.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:29:05.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:29:05.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:29:05.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:29:05.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:29:05.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:29:05.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:29:05.437 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.437 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.437 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.438 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:29:05.438 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:05.438 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 320.87424499600002, 2020-11-12T17:29:05.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:29:05.438 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.438 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.438 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:05.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:05.439 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:05.439 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:29:05.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.439 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:05.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:05.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:05.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:29:05.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:29:05.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:29:05.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:29:05.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:29:05.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:29:05.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:29:05.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:29:05.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:29:05.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:29:05.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:29:05.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:29:05.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:05.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:29:05.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:29:05.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:05.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:29:05.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:29:05.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:05.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:29:05.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:29:05.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:29:05.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:29:05.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:29:05.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:29:05.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.448 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.449 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:29:05.449 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:05.449 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 320.493362784, 2020-11-12T17:29:05.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:29:05.449 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.449 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:05.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:05.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:05.450 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:29:05.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.450 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:05.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:05.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:05.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:29:05.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:29:05.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:29:05.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:29:05.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:29:05.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:29:05.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:29:05.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:29:05.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:29:05.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:29:05.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:29:05.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:29:05.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:05.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:29:05.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:29:05.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:05.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:29:05.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:29:05.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:05.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:29:05.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:29:05.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:29:05.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:29:05.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:29:05.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:29:05.459 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.459 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.459 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.460 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:29:05.460 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:05.460 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 320.48180966400002, 2020-11-12T17:29:05.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:29:05.460 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.460 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:05.460 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:05.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:05.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:05.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:29:05.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:29:05.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:29:05.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:29:05.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:29:05.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:29:05.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:29:05.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:29:05.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:29:05.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:29:05.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:29:05.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:29:05.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:29:05.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:29:05.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.467 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.467 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.467 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:29:05.467 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:05.467 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 315.40868948299999, 2020-11-12T17:29:05.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:29:05.468 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.468 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:05.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:05.468 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:05.468 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:29:05.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.469 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:05.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:05.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:29:05.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:29:05.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:29:05.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:29:05.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:29:05.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:29:05.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:29:05.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:29:05.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:29:05.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:29:05.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:29:05.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:29:05.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:29:05.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:05.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:29:05.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:29:05.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:05.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:29:05.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:29:05.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:05.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:29:05.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:29:05.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:29:05.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:29:05.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:29:05.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:29:05.483 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.484 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.484 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.485 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:29:05.485 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:05.485 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 208.69786508999999, 2020-11-12T17:29:05.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:29:05.486 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.486 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.487 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:05.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:05.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:05.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:29:05.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:29:05.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:29:05.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:29:05.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:29:05.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:29:05.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:29:05.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:29:05.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:29:05.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:29:05.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:29:05.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:29:05.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:29:05.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:29:05.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:29:05.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:29:05.501 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.501 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.501 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.502 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:29:05.502 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:05.503 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 203.36892256499999, 2020-11-12T17:29:05.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:29:05.503 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.503 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.504 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:05.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:05.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:29:05.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:29:05.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:29:05.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:29:05.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:29:05.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:29:05.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:29:05.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:29:05.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:29:05.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:29:05.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:29:05.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:29:05.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:29:05.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:29:05.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:29:05.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:29:05.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:29:05.514 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.514 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.514 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.515 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:29:05.515 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:05.515 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 188.77441470700001, 2020-11-12T17:29:05.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:29:05.515 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.515 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.515 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:05.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:05.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:29:05.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:29:05.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:29:05.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:29:05.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:29:05.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:29:05.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:29:05.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:29:05.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:29:05.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:29:05.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:29:05.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:29:05.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:29:05.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:29:05.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:29:05.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:29:05.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:29:05.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.522 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.522 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.523 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:29:05.523 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:05.523 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 184.57233957899999, 2020-11-12T17:29:05.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:29:05.523 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.523 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.524 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:05.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:05.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:05.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:29:05.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:29:05.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:29:05.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:29:05.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:29:05.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:29:05.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:29:05.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:29:05.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:29:05.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:29:05.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:29:05.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:29:05.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:29:05.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:29:05.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:29:05.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:29:05.530 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.530 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.530 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.531 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:29:05.531 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:05.531 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 172.53029717800001, 2020-11-12T17:29:05.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:29:05.531 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.531 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.531 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:05.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:05.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:29:05.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:29:05.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:29:05.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:29:05.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:29:05.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:29:05.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:29:05.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:29:05.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:29:05.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:29:05.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:29:05.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:29:05.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:29:05.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:29:05.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:29:05.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:29:05.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:29:05.538 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.538 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.538 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.539 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:29:05.539 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:05.539 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 128.44849629300001, 2020-11-12T17:29:05.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:29:05.539 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.539 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.539 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:05.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:05.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:05.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:29:05.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:29:05.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:29:05.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:29:05.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:29:05.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:29:05.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:29:05.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:29:05.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:29:05.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:29:05.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:29:05.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:29:05.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:29:05.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:29:05.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:29:05.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:29:05.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.546 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.546 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:29:05.546 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:05.547 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.18942631500001, 2020-11-12T17:29:05.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:29:05.547 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.547 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.547 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:05.547 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:05.547 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:05.548 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:29:05.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.548 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:05.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:05.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:05.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:29:05.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:29:05.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:29:05.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:29:05.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:29:05.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:29:05.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:29:05.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:29:05.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:29:05.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:29:05.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:29:05.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:29:05.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:05.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:29:05.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:29:05.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:05.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:29:05.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:29:05.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:05.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:29:05.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:29:05.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:29:05.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:29:05.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:29:05.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:29:05.556 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.556 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.556 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.557 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:29:05.557 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:05.557 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 106.17960181399999, 2020-11-12T17:29:05.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:29:05.557 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.557 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:05.558 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:05.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:05.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:29:05.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:29:05.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:29:05.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:29:05.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:29:05.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:29:05.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:29:05.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:29:05.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:29:05.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:29:05.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:29:05.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:29:05.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:29:05.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:29:05.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:29:05.563 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.564 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.564 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.564 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:29:05.564 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:05.564 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 65.834345982000002, 2020-11-12T17:29:05.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:29:05.565 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.565 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.565 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:05.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:05.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:29:05.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:29:05.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:29:05.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:29:05.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:29:05.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:29:05.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:29:05.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:29:05.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:29:05.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:29:05.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:29:05.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:29:05.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:29:05.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:29:05.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:29:05.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:29:05.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:29:05.571 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.571 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.571 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.572 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:29:05.572 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:05.572 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 64.512669068999998, 2020-11-12T17:29:05.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:29:05.572 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.572 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.573 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:05.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:05.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:29:05.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:29:05.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:29:05.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:29:05.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:29:05.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:29:05.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:29:05.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:29:05.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:29:05.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:29:05.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:29:05.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:29:05.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:29:05.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:29:05.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:29:05.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:29:05.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:29:05.579 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.579 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.579 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.580 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:29:05.580 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:05.580 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 52.431147203000002, 2020-11-12T17:29:05.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:29:05.580 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.580 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.580 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:05.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:05.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:05.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:29:05.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:29:05.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:29:05.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:29:05.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:29:05.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:29:05.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:29:05.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:29:05.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:29:05.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:29:05.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:29:05.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:29:05.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:29:05.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:29:05.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:29:05.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:29:05.587 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.587 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.587 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.588 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3791 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'231, mlcod=192'223)", 2020-11-12T17:29:05.588 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:05.588 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.971305161, 2020-11-12T17:29:05.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001, 2020-11-12T17:29:05.588 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.588 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.588 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:05.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:05.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:05.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437443+0000", 2020-11-12T17:29:05.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1434999999999995e-05 2020-11-12T17:29:05.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437525+0000", 2020-11-12T17:29:05.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42555852399999999 2020-11-12T17:29:05.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863083+0000", 2020-11-12T17:29:05.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4397e-05 2020-11-12T17:29:05.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863098+0000", 2020-11-12T17:29:05.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019535099999999999 2020-11-12T17:29:05.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863293+0000", 2020-11-12T17:29:05.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4679999999999996e-05 2020-11-12T17:29:05.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863368+0000", 2020-11-12T17:29:05.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001951045 2020-11-12T17:29:05.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865319+0000", 2020-11-12T17:29:05.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016422 2020-11-12T17:29:05.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865483+0000", 2020-11-12T17:29:05.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001 2020-11-12T17:29:05.595 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.595 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.595 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.595 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3792 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'232, mlcod=192'225)", 2020-11-12T17:29:05.596 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:05.596 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 25.970808533, 2020-11-12T17:29:05.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498, 2020-11-12T17:29:05.596 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:05.596 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:05.596 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:05.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:05.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:05.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:05.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:05.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:05.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:05.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:05.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437930+0000", 2020-11-12T17:29:05.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108421 2020-11-12T17:29:05.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:05.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.438038+0000", 2020-11-12T17:29:05.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46508600999999999 2020-11-12T17:29:05.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:05.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903124+0000", 2020-11-12T17:29:05.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3366e-05 2020-11-12T17:29:05.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:05.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903138+0000", 2020-11-12T17:29:05.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9920000000000006e-05 2020-11-12T17:29:05.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:05.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903228+0000", 2020-11-12T17:29:05.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2246999999999997e-05 2020-11-12T17:29:05.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:05.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903270+0000", 2020-11-12T17:29:05.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017774449999999999 2020-11-12T17:29:05.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:05.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905047+0000", 2020-11-12T17:29:05.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4606999999999997e-05 2020-11-12T17:29:05.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:05.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:05.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:05.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905142+0000", 2020-11-12T17:29:05.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498 2020-11-12T17:29:05.603 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.603 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.603 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.603 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:05.603 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:05.603 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:05.605 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 29 15 29356 29341 7.90369 8.625 0.0118206 0.0158036 2020-11-12T17:29:05.605 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:29:05.608 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:05.604+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:05.609 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:05.655 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:29:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:29:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:29:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:29:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:29:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:29:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:29:05.706 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:05.704+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:05.743 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 0, 1] out_osds: [] dead_osds: [] live_osds: [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:29:05.744 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 2020-11-12T17:29:05.744 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 3, 4, 5, 6, 7, 1, 2] 2020-11-12T17:29:05.746 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-11-12T17:29:05.746 INFO:teuthology.orchestra.run:waiting for 300 2020-11-12T17:29:05.762 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:05.762 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:05.769 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:29:05.815 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:05.815+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:05.908 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:05.904+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:05.934 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:05.934 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:05.945 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:29:06.008 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:06.007+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:06.068 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:06.068 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:06.080 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:29:06.110 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:06.108+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:06.211 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:06.208+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:06.237 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:06.237 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:06.246 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:29:06.312 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:06.308+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:06.352 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:06.352 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:06.362 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:29:06.391 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:29:06.451 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:06.451+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:06.476 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:06.477 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:06.487 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:29:06.514 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:06.512+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:06.523 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 30 16 29904 29888 7.78267 4.27344 0.277224 0.0157766 2020-11-12T17:29:06.615 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:06.612+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:06.632 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:06.632 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:06.641 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:29:06.716 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:06.712+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:06.746 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:06.747 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:06.761 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:29:06.782 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:29:06.839 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:06.839+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:06.872 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:06.872 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:06.882 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:29:06.929 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:06.928+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:06.999 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:06.999 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:07.008 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:29:07.018 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:07.015+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:07.120 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:07.119+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:07.164 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:07.164 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:07.173 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:29:07.220 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:07.220+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:07.283 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:07.284 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:07.293 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:29:07.321 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:07.319+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:07.422 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:07.420+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:07.447 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:07.447 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:07.457 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:29:07.523 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 31 16 29904 29888 7.53161 0 - 0.0157766 2020-11-12T17:29:07.544 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:07.544+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:07.609 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:07.610 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:07.619 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:29:07.623 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:07.623+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:07.675 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:29:07.725 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:07.723+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:07.770 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:07.770 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:07.779 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:29:07.826 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:07.824+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:07.828 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:07.857 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:07.882 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:07.883 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:07.884 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:07.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2020-11-12T17:29:07.892 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:29:07.921 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:07.936 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:07.936+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:07.953 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:07.984 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:08.022 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:08.023 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:29:08.023 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:29:08.023 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:08.023 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:08.024 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:29:08.024 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:29:08.024 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:29:08.024 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:29:08.024 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:29:08.024 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:08.033 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:08.047 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:08.049 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:08.049 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:08.049 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:08.049 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:08.057 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:29:08.063 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:08.063+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:08.139 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:08.136+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:08.302 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:08.302 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:08.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:08.303 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:08.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.303 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:29:08.303 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:08.303 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.49216068300001, 2020-11-12T17:29:08.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:29:08.303 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.304 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:29:08.304 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.304 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.304 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.304 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:29:08.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.304 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:08.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:08.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:29:08.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.307 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:29:08.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:29:08.307 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.307 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:29:08.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:29:08.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:29:08.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:29:08.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:29:08.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:29:08.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:29:08.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:29:08.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:29:08.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:29:08.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:29:08.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:29:08.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:29:08.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:29:08.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:29:08.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:29:08.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:29:08.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:29:08.314 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.314 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.314 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.314 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.315 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:08.315 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.49175832200001, 2020-11-12T17:29:08.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:29:08.315 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.315 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.315 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.316 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:29:08.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.316 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:08.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.317 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:08.317 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:29:08.317 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.317 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.317 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:29:08.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:29:08.318 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.318 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.318 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.318 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:29:08.318 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:29:08.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.319 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:29:08.319 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:29:08.319 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.319 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.319 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:29:08.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:29:08.320 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.320 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.320 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.320 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:29:08.320 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:29:08.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:29:08.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:29:08.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:29:08.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:29:08.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:29:08.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:29:08.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:29:08.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:29:08.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:29:08.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:29:08.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:29:08.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:29:08.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:29:08.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:29:08.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:29:08.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:29:08.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:29:08.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:29:08.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.327 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.327 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:29:08.327 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:29:08.327 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.327 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.328 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.328 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.328 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.328 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:08.328 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.49143432900001, 2020-11-12T17:29:08.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:29:08.329 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.329 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.329 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.329 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.329 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.329 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:29:08.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.330 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:08.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:08.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:29:08.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:29:08.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:29:08.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:29:08.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:29:08.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:29:08.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:29:08.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:29:08.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:29:08.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:29:08.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:29:08.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:29:08.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:29:08.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:29:08.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:29:08.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:29:08.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:29:08.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:29:08.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:29:08.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.338 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.338 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:29:08.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:29:08.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:29:08.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:29:08.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.339 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.339 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:29:08.339 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:29:08.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:29:08.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:29:08.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:29:08.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:29:08.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:29:08.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:29:08.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.342 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.342 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.342 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.342 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:29:08.342 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.49119061800002, 2020-11-12T17:29:08.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:29:08.343 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.343 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.343 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.343 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:29:08.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.344 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:29:08.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:29:08.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:29:08.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:29:08.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:29:08.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.346 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.346 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:29:08.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:29:08.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:29:08.347 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:29:08.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.347 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.347 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.347 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:29:08.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:29:08.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:29:08.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:29:08.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:29:08.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:29:08.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:29:08.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:29:08.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:29:08.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:29:08.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:29:08.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:29:08.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:29:08.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:29:08.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:29:08.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:29:08.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:29:08.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:29:08.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:29:08.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:29:08.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:29:08.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:29:08.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:29:08.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:29:08.355 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.355 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.356 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.356 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.356 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:29:08.356 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.49095247100001, 2020-11-12T17:29:08.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:29:08.357 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.357 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.357 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.357 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.357 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.357 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:29:08.357 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.357 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:29:08.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:29:08.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:29:08.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:29:08.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:29:08.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:29:08.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:29:08.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:29:08.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:29:08.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:29:08.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:29:08.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:29:08.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:29:08.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:29:08.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:29:08.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:29:08.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:29:08.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:29:08.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:29:08.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:29:08.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:29:08.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:29:08.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:29:08.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:29:08.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:29:08.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:29:08.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:29:08.367 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.367 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.367 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:29:08.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:29:08.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:29:08.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:29:08.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:29:08.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:29:08.369 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.369 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.369 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.370 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.370 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:29:08.370 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.49075043099998, 2020-11-12T17:29:08.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:29:08.370 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.371 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.371 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.371 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.371 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.371 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:29:08.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.371 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:29:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:29:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:29:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:29:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:29:08.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:29:08.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:29:08.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:29:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:29:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:29:08.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:29:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:29:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:29:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:29:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:29:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:29:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:29:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:29:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:29:08.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:29:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:29:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:29:08.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:29:08.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.380 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:29:08.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:29:08.380 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:29:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:29:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.381 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:29:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:29:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.382 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:29:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:29:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:29:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:29:08.383 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:29:08.384 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.49054506099998, 2020-11-12T17:29:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:29:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.385 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:29:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:29:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:29:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:29:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:29:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:29:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:29:08.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:29:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:29:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:29:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:29:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:29:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:29:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:29:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:29:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:29:08.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:29:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:29:08.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:29:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:29:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:29:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:29:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:29:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:29:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.395 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:29:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:29:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:29:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:29:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:29:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:29:08.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:29:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:29:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:29:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:29:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:29:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.49035923399998, 2020-11-12T17:29:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:29:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.400 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:29:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.402 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:29:08.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.402 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:29:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:29:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:29:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:29:08.403 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:29:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:29:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:29:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:29:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:29:08.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:29:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:29:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:29:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:29:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:29:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:29:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:29:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:29:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:29:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:29:08.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:29:08.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:29:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:29:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:29:08.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:29:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:29:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:29:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:29:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:29:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:29:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:29:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:29:08.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:29:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.414 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:29:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.49016226999998, 2020-11-12T17:29:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:29:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.415 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:29:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.416 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:29:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:29:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:29:08.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:29:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:29:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:29:08.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:29:08.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:29:08.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:29:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:29:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:29:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:29:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:29:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:29:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:29:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:29:08.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:29:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:29:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:29:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:29:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:29:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:29:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:29:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:29:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:29:08.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:29:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:29:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.426 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:29:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:29:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:29:08.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:29:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:29:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:29:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.428 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:29:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.48996624, 2020-11-12T17:29:08.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:29:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:29:08.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:29:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:29:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:29:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:29:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:29:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:29:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:29:08.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:29:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:29:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:29:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:29:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:29:08.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:29:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:29:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:29:08.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:29:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:29:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:29:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:29:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:29:08.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:29:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:29:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:29:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:29:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:29:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:29:08.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:29:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:29:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:29:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:29:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:29:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:29:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:29:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.443 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:29:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.48978543999999, 2020-11-12T17:29:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:29:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.444 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:29:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:29:08.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:29:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:29:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:29:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:29:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:29:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:29:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:29:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:29:08.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:29:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:29:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:29:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:29:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:29:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:29:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:29:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:29:08.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:29:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:29:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:29:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:29:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:29:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:29:08.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:29:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:29:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:29:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:29:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:29:08.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:29:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:29:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:29:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:29:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:29:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:29:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.48958948699999, 2020-11-12T17:29:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:29:08.458 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:29:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.459 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:29:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:29:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:29:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:29:08.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:29:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:29:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:29:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:29:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:29:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:29:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:29:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:29:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:29:08.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:29:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:29:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:29:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:29:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:29:08.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:29:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:29:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:29:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:29:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:29:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:29:08.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:29:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:29:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:29:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:29:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:29:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:29:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:29:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:29:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:29:08.471 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:29:08.472 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.48939587900003, 2020-11-12T17:29:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:29:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.473 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:29:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:29:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:29:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:29:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:29:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:29:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:29:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:29:08.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:29:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:29:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:29:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:29:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:29:08.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:29:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:29:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:29:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:29:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:29:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:29:08.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:29:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:29:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:29:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:29:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:29:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:29:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:29:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:29:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:29:08.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:29:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:29:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:29:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:29:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:29:08.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:29:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.486 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:29:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.48908401599999, 2020-11-12T17:29:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:29:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.487 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:29:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:29:08.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:29:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:29:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:29:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:29:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:29:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:29:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:29:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:29:08.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:29:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:29:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:29:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:29:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:29:08.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:29:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:29:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:29:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:29:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:29:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:29:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:29:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:29:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:29:08.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:29:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:29:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:29:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:29:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:29:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:29:08.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:29:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:29:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:29:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:29:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:29:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.488796519, 2020-11-12T17:29:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:29:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.501 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:29:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:29:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:29:08.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:29:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:29:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:29:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:29:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:29:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:29:08.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:29:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:29:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:29:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:29:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:29:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:29:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:29:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:29:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:29:08.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:29:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:29:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:29:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:29:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:29:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:29:08.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:29:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:29:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:29:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:29:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:29:08.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:29:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:29:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:29:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:29:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:29:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:29:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 348.48857614799999, 2020-11-12T17:29:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:29:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.515 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:29:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:29:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:29:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:29:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:29:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:29:08.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:29:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:29:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.519 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:29:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:29:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:29:08.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:29:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:29:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:29:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:29:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:29:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:29:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:29:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:29:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:29:08.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:29:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:29:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:29:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:29:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:29:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:29:08.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:29:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:29:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:29:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:29:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:29:08.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:29:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:29:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:29:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.528 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:29:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:29:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 186.57899715799999, 2020-11-12T17:29:08.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:29:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:29:08.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:29:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:29:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:29:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:29:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:29:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:29:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:29:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:29:08.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:29:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:29:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:29:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:29:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:29:08.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:29:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:29:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:29:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:29:08.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:29:08.606 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.606 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.606 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.607 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:29:08.607 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:29:08.607 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 124.504621398, 2020-11-12T17:29:08.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:29:08.607 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.607 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.607 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.608 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:08.608 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:08.608 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:29:08.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.608 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:29:08.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:29:08.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:29:08.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:29:08.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:29:08.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:29:08.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:29:08.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:29:08.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:29:08.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:29:08.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:29:08.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:29:08.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:29:08.616 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.617 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.617 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:29:08.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:29:08.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:08.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:29:08.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:29:08.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:29:08.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:29:08.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:29:08.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:29:08.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:29:08.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:29:08.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.625 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.625 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:29:08.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:29:08.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.625 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.626 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:29:08.626 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:29:08.626 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 93.734195030999999, 2020-11-12T17:29:08.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:29:08.626 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.627 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:08.627 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:08.627 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:08.627 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:08.627 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:29:08.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.627 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:29:08.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:29:08.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:29:08.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:29:08.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:29:08.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:29:08.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:29:08.633 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.634 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:29:08.634 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:29:08.634 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.635 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.635 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.635 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:29:08.636 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:29:08.636 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.637 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.637 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.638 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:29:08.638 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:29:08.638 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.638 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.638 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.639 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:29:08.639 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:29:08.639 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:08.640 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:29:08.640 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:29:08.640 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.640 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.640 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:08.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:29:08.641 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:29:08.641 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.641 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.641 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:08.641 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:29:08.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:29:08.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.642 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.642 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:08.642 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:29:08.642 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:29:08.642 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.643 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.643 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.643 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:29:08.643 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:29:08.643 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.643 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.643 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.644 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.644 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.644 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:29:08.644 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:29:08.644 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 93.726097998, 2020-11-12T17:29:08.644 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:29:08.644 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:08.645 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:08.645 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:08.645 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.645 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:08.645 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:29:08.645 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:08.645 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.646 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:08.646 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:29:08.646 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:29:08.646 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.646 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.647 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:08.647 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:29:08.647 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:29:08.647 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.648 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.648 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:08.649 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:29:08.649 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:29:08.649 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.650 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.650 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:08.650 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:29:08.651 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:29:08.651 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.651 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.651 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:08.652 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:29:08.652 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:29:08.652 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.653 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:08.653 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:29:08.654 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:29:08.654 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.654 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:08.655 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:29:08.655 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:29:08.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:08.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:08.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:08.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:29:08.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:29:08.657 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.657 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.658 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:08.658 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:08.658 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:08.659 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:29:08.660 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:08.300+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:08.663 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 32 16 29904 29888 7.29623 0 - 0.0157766 2020-11-12T17:29:08.664 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:08.659+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:08.764 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:08.763+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:08.779 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:08.779 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:08.779 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:08.780 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:08.790 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:29:08.868 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:29:08.871 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:08.867+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:08.971 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:08.968+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:08.980 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:08.980 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:08.980 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:08.980 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:08.980 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:08.989 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:29:09.072 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:09.071+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:09.147 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:09.161 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:09.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:09.161 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:09.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.162 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:29:09.162 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:09.162 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 360.30337790499999, 2020-11-12T17:29:09.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:29:09.162 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.162 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:09.163 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:09.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:09.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:29:09.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:29:09.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:29:09.165 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:29:09.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:29:09.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:29:09.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:29:09.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:29:09.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:29:09.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:29:09.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:29:09.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:29:09.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:29:09.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:29:09.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:29:09.170 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.170 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.170 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.171 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:29:09.171 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:09.171 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.74318068299999, 2020-11-12T17:29:09.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:29:09.172 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.172 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.172 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:09.172 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:09.172 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:09.172 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:29:09.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.173 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:09.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:09.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:29:09.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:29:09.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:29:09.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:29:09.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:29:09.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:29:09.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:29:09.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:29:09.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:29:09.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:29:09.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:29:09.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:29:09.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:29:09.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:09.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:29:09.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:29:09.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:09.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:29:09.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:29:09.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:09.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:29:09.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:29:09.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:29:09.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:29:09.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:29:09.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:29:09.187 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.187 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.187 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.189 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:29:09.189 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:09.189 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.73728835999998, 2020-11-12T17:29:09.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:29:09.190 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.190 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:09.190 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:09.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:09.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:29:09.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:29:09.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:29:09.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:29:09.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:29:09.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:29:09.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:29:09.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:29:09.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:29:09.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:29:09.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:29:09.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:29:09.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:29:09.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:29:09.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:29:09.201 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.201 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.202 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.202 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:29:09.203 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:09.203 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 324.61129809200003, 2020-11-12T17:29:09.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:29:09.204 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.204 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.204 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:09.205 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:09.227 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:09.235 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:29:09.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.235 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:09.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:09.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:09.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:29:09.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:29:09.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:29:09.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:29:09.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:29:09.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:29:09.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:29:09.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:29:09.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:29:09.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:29:09.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:29:09.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:29:09.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:09.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:29:09.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:29:09.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:09.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:29:09.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:29:09.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:09.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:29:09.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:29:09.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:29:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:29:09.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:29:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:29:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.365 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:29:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:09.366 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 324.23041588000001, 2020-11-12T17:29:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:29:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:09.367 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:29:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.368 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.369 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:29:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:29:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:29:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:29:09.370 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:29:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:29:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:29:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:29:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:29:09.372 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:29:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:29:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:29:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:29:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:29:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:09.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:29:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:29:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:29:09.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:29:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:29:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:29:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:29:09.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:29:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.451 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:29:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 324.21886275999998, 2020-11-12T17:29:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:29:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.452 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:09.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:29:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:29:09.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:29:09.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:29:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:29:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:29:09.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:29:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:29:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:29:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:29:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:29:09.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:29:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:29:09.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:29:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:29:09.464 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 319.145742579, 2020-11-12T17:29:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:29:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:09.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:29:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:09.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:29:09.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:29:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:29:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:29:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:29:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:29:09.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:29:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:29:09.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:29:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:29:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:29:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:29:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:29:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:29:09.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:29:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:29:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:29:09.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:29:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:29:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:29:09.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:29:09.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:29:09.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:29:09.476 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.476 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.476 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.476 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:29:09.476 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:09.476 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 212.434918186, 2020-11-12T17:29:09.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:29:09.477 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.477 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.477 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:09.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:09.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:09.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:29:09.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:29:09.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:29:09.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:29:09.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:29:09.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:29:09.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:29:09.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:29:09.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:29:09.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:29:09.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:29:09.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:29:09.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:29:09.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:29:09.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:29:09.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:29:09.484 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.485 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.485 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.485 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:29:09.485 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:09.485 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 207.105975661, 2020-11-12T17:29:09.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:29:09.486 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.486 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.486 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:09.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:09.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:29:09.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:29:09.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:29:09.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:29:09.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:29:09.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:29:09.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:29:09.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:29:09.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:29:09.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:29:09.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:29:09.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:29:09.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:29:09.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:29:09.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:29:09.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:29:09.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:29:09.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.494 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.495 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:29:09.495 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:09.495 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 192.51146780299999, 2020-11-12T17:29:09.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:29:09.495 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.495 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.495 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:09.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:09.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:29:09.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:29:09.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:29:09.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:29:09.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:29:09.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:29:09.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:29:09.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:29:09.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:29:09.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:29:09.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:29:09.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:29:09.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:29:09.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:29:09.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:29:09.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:29:09.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:29:09.503 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.503 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.503 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.503 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.503 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:29:09.503 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:09.504 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 188.309392675, 2020-11-12T17:29:09.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:29:09.504 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.504 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.504 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:09.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:09.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:09.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:29:09.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:29:09.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:29:09.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:29:09.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:29:09.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:29:09.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:29:09.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:29:09.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.547 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:29:09.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:29:09.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:29:09.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:29:09.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:29:09.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:29:09.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:29:09.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:29:09.550 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.550 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.551 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.551 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:29:09.551 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:09.551 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 176.26735027399999, 2020-11-12T17:29:09.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:29:09.552 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.552 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.552 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:09.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:09.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:29:09.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:29:09.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:29:09.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:29:09.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:29:09.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:29:09.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:29:09.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:29:09.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:29:09.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:29:09.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:29:09.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:29:09.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:29:09.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:29:09.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:29:09.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:29:09.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:29:09.559 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.560 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.560 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.560 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:29:09.560 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:09.561 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 132.18554938899999, 2020-11-12T17:29:09.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:29:09.561 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.561 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.561 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:09.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:09.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:09.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:29:09.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:29:09.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:29:09.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:29:09.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:29:09.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:29:09.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:29:09.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:29:09.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:29:09.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:29:09.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:29:09.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:29:09.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:29:09.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:29:09.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:29:09.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:29:09.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.569 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.569 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.569 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:29:09.570 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:09.570 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 109.926479411, 2020-11-12T17:29:09.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:29:09.570 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.570 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.570 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:09.570 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:09.571 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:09.571 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:29:09.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.571 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:09.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:09.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:09.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:29:09.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:29:09.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:29:09.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:29:09.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:29:09.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:29:09.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:29:09.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:29:09.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:29:09.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:29:09.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:29:09.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:29:09.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:09.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:29:09.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:29:09.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:09.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:29:09.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:29:09.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:09.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:29:09.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:29:09.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:29:09.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:29:09.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.580 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.580 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:29:09.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:29:09.581 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.581 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.581 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.581 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:29:09.582 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:09.582 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 109.91665491000001, 2020-11-12T17:29:09.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:29:09.582 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.582 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:09.582 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:29:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:29:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:29:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:29:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:29:09.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:29:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:29:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:29:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:29:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:29:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:29:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:29:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:29:09.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:29:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:29:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.589 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:29:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 69.571399077999999, 2020-11-12T17:29:09.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:29:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:09.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:29:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:29:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:29:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:29:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:29:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:29:09.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:29:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:29:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:29:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:29:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:29:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:29:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:29:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:29:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:29:09.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:29:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:29:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.598 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:29:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 68.249722164999994, 2020-11-12T17:29:09.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:29:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:29:09.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:29:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:29:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.602 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:29:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:29:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.603 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:29:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:29:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:29:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:29:09.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:29:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:29:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:29:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:29:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:29:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:29:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:29:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:29:09.607 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:29:09.608 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 56.168200298999999, 2020-11-12T17:29:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:29:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:09.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:29:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:29:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:29:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:29:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:29:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:29:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:29:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:29:09.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:29:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:29:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:29:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:29:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:29:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:29:09.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:29:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:29:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3791 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'231, mlcod=192'223)", 2020-11-12T17:29:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.708358257, 2020-11-12T17:29:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001, 2020-11-12T17:29:09.617 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.618 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.619 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437443+0000", 2020-11-12T17:29:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1434999999999995e-05 2020-11-12T17:29:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437525+0000", 2020-11-12T17:29:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42555852399999999 2020-11-12T17:29:09.620 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863083+0000", 2020-11-12T17:29:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4397e-05 2020-11-12T17:29:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.621 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863098+0000", 2020-11-12T17:29:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019535099999999999 2020-11-12T17:29:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863293+0000", 2020-11-12T17:29:09.622 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4679999999999996e-05 2020-11-12T17:29:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863368+0000", 2020-11-12T17:29:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001951045 2020-11-12T17:29:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.623 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865319+0000", 2020-11-12T17:29:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016422 2020-11-12T17:29:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.624 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865483+0000", 2020-11-12T17:29:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001 2020-11-12T17:29:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3792 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'232, mlcod=192'225)", 2020-11-12T17:29:09.625 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 29.707861629, 2020-11-12T17:29:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498, 2020-11-12T17:29:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:09.626 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:09.627 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437930+0000", 2020-11-12T17:29:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108421 2020-11-12T17:29:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.628 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.438038+0000", 2020-11-12T17:29:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46508600999999999 2020-11-12T17:29:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:09.629 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903124+0000", 2020-11-12T17:29:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3366e-05 2020-11-12T17:29:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903138+0000", 2020-11-12T17:29:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9920000000000006e-05 2020-11-12T17:29:09.630 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903228+0000", 2020-11-12T17:29:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2246999999999997e-05 2020-11-12T17:29:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.631 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903270+0000", 2020-11-12T17:29:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017774449999999999 2020-11-12T17:29:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905047+0000", 2020-11-12T17:29:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4606999999999997e-05 2020-11-12T17:29:09.632 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905142+0000", 2020-11-12T17:29:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498 2020-11-12T17:29:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.633 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.634 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:09.634 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:09.634 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:09.635 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 33 16 29904 29888 7.07512 0 - 0.0157766 2020-11-12T17:29:09.642 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:29:09.643 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:09.632+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:09.737 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:09.735+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:09.779 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:09.779 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:09.779 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:29:09.780 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:09.790 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:29:09.791 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:09.787+0000 7f658835a700 -1 osd.0 207 handle_osd_map injecting map crc failure 2020-11-12T17:29:09.799 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:29:09.859 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:09.859+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:09.893 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:09.893 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:09.894 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:29:09.894 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:29:09.894 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:09.903 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:29:09.947 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:09.947+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:10.036 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:29:10.040 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:10.040+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:10.067 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:10.067 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:29:10.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:29:10.068 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:29:10.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.068 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79414 4.6 4:60cd86ce:::benchmark_data_smithi036_18856_object3025:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:29:10.068 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:29:10.068 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 159.276896919, 2020-11-12T17:29:10.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998, 2020-11-12T17:29:10.069 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.069 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:10.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:10.069 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:10.069 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79414 2020-11-12T17:29:10.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.070 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.398 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:29:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.400 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:29:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784303+0000", 2020-11-12T17:29:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4221999999999997e-05 2020-11-12T17:29:10.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784358+0000", 2020-11-12T17:29:10.403 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8389999999999996e-06 2020-11-12T17:29:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.404 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784366+0000", 2020-11-12T17:29:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2040000000000002e-06 2020-11-12T17:29:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784370+0000", 2020-11-12T17:29:10.406 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029216049999999999 2020-11-12T17:29:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.407 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787291+0000", 2020-11-12T17:29:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3842e-05 2020-11-12T17:29:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:29:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787385+0000", 2020-11-12T17:29:10.409 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15210379399999999 2020-11-12T17:29:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.410 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.939489+0000", 2020-11-12T17:29:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00095422699999999998 2020-11-12T17:29:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:29:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940443+0000", 2020-11-12T17:29:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092951600000000002 2020-11-12T17:29:10.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.949738+0000", 2020-11-12T17:29:10.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00060685800000000005 2020-11-12T17:29:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:29:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.950345+0000", 2020-11-12T17:29:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093005117999999998 2020-11-12T17:29:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.043350+0000", 2020-11-12T17:29:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001029147 2020-11-12T17:29:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.044379+0000", 2020-11-12T17:29:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001543397 2020-11-12T17:29:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045923+0000", 2020-11-12T17:29:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015442345999999999 2020-11-12T17:29:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061365+0000", 2020-11-12T17:29:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0095990889999999999 2020-11-12T17:29:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:10.419 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.070964+0000", 2020-11-12T17:29:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000446744 2020-11-12T17:29:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.071411+0000", 2020-11-12T17:29:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001655534 2020-11-12T17:29:10.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.073066+0000", 2020-11-12T17:29:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998 2020-11-12T17:29:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.421 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.422 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79425 4.6 4:6231d6c2:::benchmark_data_smithi036_18856_object3036:head [delete] snapc 0=[] ondisk+write+known_if_redirected e118)", 2020-11-12T17:29:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:29:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 159.276823423, 2020-11-12T17:29:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002, 2020-11-12T17:29:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:10.423 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79425 2020-11-12T17:29:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:29:10.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:29:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:29:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784379+0000", 2020-11-12T17:29:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6152000000000001e-05 2020-11-12T17:29:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784426+0000", 2020-11-12T17:29:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6860000000000003e-06 2020-11-12T17:29:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784431+0000", 2020-11-12T17:29:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6460000000000002e-06 2020-11-12T17:29:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784434+0000", 2020-11-12T17:29:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030643549999999999 2020-11-12T17:29:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.428 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787498+0000", 2020-11-12T17:29:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100717 2020-11-12T17:29:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:29:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787599+0000", 2020-11-12T17:29:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15298814699999999 2020-11-12T17:29:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940587+0000", 2020-11-12T17:29:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00097205100000000003 2020-11-12T17:29:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:29:10.430 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.941559+0000", 2020-11-12T17:29:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.019466477999999999 2020-11-12T17:29:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961026+0000", 2020-11-12T17:29:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058434100000000005 2020-11-12T17:29:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:29:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961610+0000", 2020-11-12T17:29:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13222599700000001 2020-11-12T17:29:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.432 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.093836+0000", 2020-11-12T17:29:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089939299999999996 2020-11-12T17:29:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.094735+0000", 2020-11-12T17:29:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001382973 2020-11-12T17:29:10.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.096118+0000", 2020-11-12T17:29:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046953350000000001 2020-11-12T17:29:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:10.434 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100814+0000", 2020-11-12T17:29:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9295000000000006e-05 2020-11-12T17:29:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100893+0000", 2020-11-12T17:29:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00035136400000000001 2020-11-12T17:29:10.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.101244+0000", 2020-11-12T17:29:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015508290000000001 2020-11-12T17:29:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.436 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.102795+0000", 2020-11-12T17:29:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002 2020-11-12T17:29:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.437 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79491 4.4 4:2feb571e:::benchmark_data_smithi036_18856_object3102:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:29:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:29:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 159.202811497, 2020-11-12T17:29:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458, 2020-11-12T17:29:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:10.438 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79491 2020-11-12T17:29:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:29:10.439 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:29:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.440 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858382+0000", 2020-11-12T17:29:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8493999999999998e-05 2020-11-12T17:29:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858450+0000", 2020-11-12T17:29:10.441 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:29:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858460+0000", 2020-11-12T17:29:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5260000000000004e-06 2020-11-12T17:29:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.442 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858465+0000", 2020-11-12T17:29:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002042622 2020-11-12T17:29:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860507+0000", 2020-11-12T17:29:10.443 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5987000000000003e-05 2020-11-12T17:29:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:29:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860583+0000", 2020-11-12T17:29:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.264296631 2020-11-12T17:29:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.444 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.124880+0000", 2020-11-12T17:29:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00260079 2020-11-12T17:29:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:29:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.127481+0000", 2020-11-12T17:29:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015473191000000001 2020-11-12T17:29:10.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.142954+0000", 2020-11-12T17:29:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068121100000000003 2020-11-12T17:29:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.446 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.143635+0000", 2020-11-12T17:29:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014373840000000001 2020-11-12T17:29:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.145073+0000", 2020-11-12T17:29:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020755122000000001 2020-11-12T17:29:10.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.165828+0000", 2020-11-12T17:29:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047732520000000004 2020-11-12T17:29:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:10.448 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.170601+0000", 2020-11-12T17:29:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00046765100000000003 2020-11-12T17:29:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.171069+0000", 2020-11-12T17:29:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018080010000000001 2020-11-12T17:29:10.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.172877+0000", 2020-11-12T17:29:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458 2020-11-12T17:29:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:14736 5.0 e137/135 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head v 137'896, mlcod=137'891)", 2020-11-12T17:29:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:29:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 128.00100892699999, 2020-11-12T17:29:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999, 2020-11-12T17:29:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.451 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:29:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.452 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:29:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:29:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.453 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060202+0000", 2020-11-12T17:29:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8984000000000003e-05 2020-11-12T17:29:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060261+0000", 2020-11-12T17:29:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56005787699999998 2020-11-12T17:29:10.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620318+0000", 2020-11-12T17:29:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8369999999999999e-06 2020-11-12T17:29:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620325+0000", 2020-11-12T17:29:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012664800000000001 2020-11-12T17:29:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620452+0000", 2020-11-12T17:29:10.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3432e-05 2020-11-12T17:29:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620495+0000", 2020-11-12T17:29:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002919905 2020-11-12T17:29:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623415+0000", 2020-11-12T17:29:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9338999999999995e-05 2020-11-12T17:29:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623485+0000", 2020-11-12T17:29:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999 2020-11-12T17:29:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26040 5.0 e144/135 5:0f4f1556:::benchmark_data_smithi036_24110_object3254:head v 144'1616, mlcod=144'1611)", 2020-11-12T17:29:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:29:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.385533991, 2020-11-12T17:29:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999, 2020-11-12T17:29:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.460 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:29:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:29:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:29:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675665+0000", 2020-11-12T17:29:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5723000000000006e-05 2020-11-12T17:29:10.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675751+0000", 2020-11-12T17:29:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28004843800000001 2020-11-12T17:29:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955800+0000", 2020-11-12T17:29:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4329999999999997e-06 2020-11-12T17:29:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955804+0000", 2020-11-12T17:29:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8045000000000003e-05 2020-11-12T17:29:10.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955872+0000", 2020-11-12T17:29:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9106999999999997e-05 2020-11-12T17:29:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955911+0000", 2020-11-12T17:29:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001589479 2020-11-12T17:29:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957501+0000", 2020-11-12T17:29:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7602999999999998e-05 2020-11-12T17:29:10.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957548+0000", 2020-11-12T17:29:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999 2020-11-12T17:29:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.467 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26152 5.7 e144/135 5:e84d984e:::benchmark_data_smithi036_24110_object3268:head v 144'1448, mlcod=144'1443)", 2020-11-12T17:29:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:29:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 116.27092864799999, 2020-11-12T17:29:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003, 2020-11-12T17:29:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.468 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:29:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:29:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:29:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790267+0000", 2020-11-12T17:29:10.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010217000000000001 2020-11-12T17:29:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790369+0000", 2020-11-12T17:29:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38220455399999997 2020-11-12T17:29:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172574+0000", 2020-11-12T17:29:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5129999999999998e-06 2020-11-12T17:29:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172578+0000", 2020-11-12T17:29:10.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8815999999999999e-05 2020-11-12T17:29:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172657+0000", 2020-11-12T17:29:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1084000000000003e-05 2020-11-12T17:29:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172688+0000", 2020-11-12T17:29:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013615529999999999 2020-11-12T17:29:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174050+0000", 2020-11-12T17:29:10.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4009000000000002e-05 2020-11-12T17:29:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174124+0000", 2020-11-12T17:29:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003 2020-11-12T17:29:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35656 5.0 e149/135 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head v 149'2136, mlcod=149'2128)", 2020-11-12T17:29:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:29:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.94017312, 2020-11-12T17:29:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999, 2020-11-12T17:29:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.476 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:29:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:29:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:29:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121021+0000", 2020-11-12T17:29:10.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5146e-05 2020-11-12T17:29:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121116+0000", 2020-11-12T17:29:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35999075400000002 2020-11-12T17:29:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481107+0000", 2020-11-12T17:29:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4069999999999998e-06 2020-11-12T17:29:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481113+0000", 2020-11-12T17:29:10.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1341999999999997e-05 2020-11-12T17:29:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481165+0000", 2020-11-12T17:29:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1209999999999999e-05 2020-11-12T17:29:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481186+0000", 2020-11-12T17:29:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018927709999999999 2020-11-12T17:29:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483079+0000", 2020-11-12T17:29:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:29:10.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483131+0000", 2020-11-12T17:29:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999 2020-11-12T17:29:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.483 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:36416 5.0 e149/135 5:05125f34:::benchmark_data_smithi036_24110_object4551:head v 149'2208, mlcod=149'2200)", 2020-11-12T17:29:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:29:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 105.08154911299999, 2020-11-12T17:29:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002, 2020-11-12T17:29:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.484 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:29:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:29:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:29:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979647+0000", 2020-11-12T17:29:10.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7427000000000001e-05 2020-11-12T17:29:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979744+0000", 2020-11-12T17:29:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35673495900000002 2020-11-12T17:29:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336479+0000", 2020-11-12T17:29:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7480000000000001e-06 2020-11-12T17:29:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336484+0000", 2020-11-12T17:29:10.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5201000000000003e-05 2020-11-12T17:29:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336529+0000", 2020-11-12T17:29:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6535999999999999e-05 2020-11-12T17:29:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336545+0000", 2020-11-12T17:29:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003854597 2020-11-12T17:29:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340400+0000", 2020-11-12T17:29:10.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5745000000000001e-05 2020-11-12T17:29:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340476+0000", 2020-11-12T17:29:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002 2020-11-12T17:29:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.491 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:48936 5.7 e157/135 5:ebe6a5f2:::benchmark_data_smithi036_24110_object6116:head v 157'2960, mlcod=157'2956)", 2020-11-12T17:29:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:29:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.106803088999996, 2020-11-12T17:29:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003, 2020-11-12T17:29:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.492 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:29:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:29:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954403+0000", 2020-11-12T17:29:10.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0948e-05 2020-11-12T17:29:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954464+0000", 2020-11-12T17:29:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32108862399999999 2020-11-12T17:29:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275553+0000", 2020-11-12T17:29:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2849999999999997e-06 2020-11-12T17:29:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275560+0000", 2020-11-12T17:29:10.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8199999999999999e-05 2020-11-12T17:29:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275608+0000", 2020-11-12T17:29:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6923999999999998e-05 2020-11-12T17:29:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275635+0000", 2020-11-12T17:29:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036371630000000001 2020-11-12T17:29:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279272+0000", 2020-11-12T17:29:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0575000000000002e-05 2020-11-12T17:29:10.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279333+0000", 2020-11-12T17:29:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003 2020-11-12T17:29:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.499 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:52816 5.8 e159/135 5:1b562a6a:::benchmark_data_smithi036_24110_object6601:head v 159'3312, mlcod=159'3307)", 2020-11-12T17:29:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:29:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 85.186795833999994, 2020-11-12T17:29:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002, 2020-11-12T17:29:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.500 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:29:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:29:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874411+0000", 2020-11-12T17:29:10.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5874000000000001e-05 2020-11-12T17:29:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874467+0000", 2020-11-12T17:29:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.369977422 2020-11-12T17:29:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244444+0000", 2020-11-12T17:29:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.797e-06 2020-11-12T17:29:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244449+0000", 2020-11-12T17:29:10.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9617999999999994e-05 2020-11-12T17:29:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244549+0000", 2020-11-12T17:29:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6636999999999999e-05 2020-11-12T17:29:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244575+0000", 2020-11-12T17:29:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002465971 2020-11-12T17:29:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247041+0000", 2020-11-12T17:29:10.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1267999999999995e-05 2020-11-12T17:29:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247123+0000", 2020-11-12T17:29:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002 2020-11-12T17:29:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59192 5.0 e168/135 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head v 168'3640, mlcod=168'3635)", 2020-11-12T17:29:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:29:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.247056741999998, 2020-11-12T17:29:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998, 2020-11-12T17:29:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.508 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:29:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:29:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814137+0000", 2020-11-12T17:29:10.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135962 2020-11-12T17:29:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814273+0000", 2020-11-12T17:29:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46601277200000002 2020-11-12T17:29:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280285+0000", 2020-11-12T17:29:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0178e-05 2020-11-12T17:29:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280295+0000", 2020-11-12T17:29:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4779999999999999e-05 2020-11-12T17:29:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280370+0000", 2020-11-12T17:29:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2793999999999998e-05 2020-11-12T17:29:10.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280403+0000", 2020-11-12T17:29:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002761753 2020-11-12T17:29:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283165+0000", 2020-11-12T17:29:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3588e-05 2020-11-12T17:29:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283248+0000", 2020-11-12T17:29:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998 2020-11-12T17:29:10.515 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:61880 5.7 e171/135 5:e7903c7f:::benchmark_data_smithi036_24110_object7734:head v 171'3720, mlcod=171'3715)", 2020-11-12T17:29:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:29:10.516 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 71.702644117999995, 2020-11-12T17:29:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002, 2020-11-12T17:29:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:29:10.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:29:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:29:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358563+0000", 2020-11-12T17:29:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8774000000000002e-05 2020-11-12T17:29:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358642+0000", 2020-11-12T17:29:10.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36108309599999999 2020-11-12T17:29:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719725+0000", 2020-11-12T17:29:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8320000000000002e-06 2020-11-12T17:29:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719731+0000", 2020-11-12T17:29:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5495999999999997e-05 2020-11-12T17:29:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719806+0000", 2020-11-12T17:29:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3250999999999997e-05 2020-11-12T17:29:10.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719840+0000", 2020-11-12T17:29:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030159739999999998 2020-11-12T17:29:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722856+0000", 2020-11-12T17:29:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7215e-05 2020-11-12T17:29:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722913+0000", 2020-11-12T17:29:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002 2020-11-12T17:29:10.523 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e173)", 2020-11-12T17:29:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:29:10.524 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.174176997000004, 2020-11-12T17:29:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003, 2020-11-12T17:29:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:29:10.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:29:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:29:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:29:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887020+0000", 2020-11-12T17:29:10.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1260999999999993e-05 2020-11-12T17:29:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887101+0000", 2020-11-12T17:29:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2444e-05 2020-11-12T17:29:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887113+0000", 2020-11-12T17:29:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7610000000000002e-06 2020-11-12T17:29:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887123+0000", 2020-11-12T17:29:10.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096366420000000008 2020-11-12T17:29:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896760+0000", 2020-11-12T17:29:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8652000000000005e-05 2020-11-12T17:29:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896838+0000", 2020-11-12T17:29:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108306 2020-11-12T17:29:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:10.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896947+0000", 2020-11-12T17:29:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001848639 2020-11-12T17:29:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.898795+0000", 2020-11-12T17:29:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50804395899999999 2020-11-12T17:29:10.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406839+0000", 2020-11-12T17:29:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3349000000000004e-05 2020-11-12T17:29:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406923+0000", 2020-11-12T17:29:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7622999999999998e-05 2020-11-12T17:29:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407010+0000", 2020-11-12T17:29:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003 2020-11-12T17:29:10.534 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63144 5.c e173/139 ondisk, result = 0)", 2020-11-12T17:29:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:29:10.535 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.160233577, 2020-11-12T17:29:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996, 2020-11-12T17:29:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:29:10.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:29:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900974+0000", 2020-11-12T17:29:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1072999999999998e-05 2020-11-12T17:29:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.538 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.901015+0000", 2020-11-12T17:29:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50574218299999996 2020-11-12T17:29:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406758+0000", 2020-11-12T17:29:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0649999999999999e-06 2020-11-12T17:29:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406766+0000", 2020-11-12T17:29:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1774999999999998e-05 2020-11-12T17:29:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406817+0000", 2020-11-12T17:29:10.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0681e-05 2020-11-12T17:29:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406828+0000", 2020-11-12T17:29:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000198078 2020-11-12T17:29:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407026+0000", 2020-11-12T17:29:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996 2020-11-12T17:29:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.543 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e173)", 2020-11-12T17:29:10.543 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:29:10.543 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.155506091999996, 2020-11-12T17:29:10.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013, 2020-11-12T17:29:10.543 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.543 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:29:10.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:10.543 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:10.544 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:10.544 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:29:10.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.544 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:29:10.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:29:10.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999471 2020-11-12T17:29:10.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905665+0000", 2020-11-12T17:29:10.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017430399999999999 2020-11-12T17:29:10.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905839+0000", 2020-11-12T17:29:10.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0282e-05 2020-11-12T17:29:10.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905859+0000", 2020-11-12T17:29:10.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4520000000000003e-06 2020-11-12T17:29:10.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905869+0000", 2020-11-12T17:29:10.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5303999999999999e-05 2020-11-12T17:29:10.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905914+0000", 2020-11-12T17:29:10.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6926999999999999e-05 2020-11-12T17:29:10.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:29:10.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905971+0000", 2020-11-12T17:29:10.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50097548000000003 2020-11-12T17:29:10.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406947+0000", 2020-11-12T17:29:10.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013 2020-11-12T17:29:10.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.550 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.551 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63511 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:29:10.551 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:29:10.551 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.583189841000006, 2020-11-12T17:29:10.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997, 2020-11-12T17:29:10.551 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.551 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.551 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:10.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:10.552 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:10.552 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63511 2020-11-12T17:29:10.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.552 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:29:10.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:29:10.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:29:10.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.477991+0000", 2020-11-12T17:29:10.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9875000000000003e-05 2020-11-12T17:29:10.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478081+0000", 2020-11-12T17:29:10.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3559999999999993e-06 2020-11-12T17:29:10.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478089+0000", 2020-11-12T17:29:10.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8300000000000003e-06 2020-11-12T17:29:10.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478094+0000", 2020-11-12T17:29:10.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055625520000000001 2020-11-12T17:29:10.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483657+0000", 2020-11-12T17:29:10.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118057 2020-11-12T17:29:10.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483775+0000", 2020-11-12T17:29:10.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019058000000000001 2020-11-12T17:29:10.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:10.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483965+0000", 2020-11-12T17:29:10.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052812179999999999 2020-11-12T17:29:10.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:10.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489246+0000", 2020-11-12T17:29:10.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32502241999999998 2020-11-12T17:29:10.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:10.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814269+0000", 2020-11-12T17:29:10.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1461000000000002e-05 2020-11-12T17:29:10.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814310+0000", 2020-11-12T17:29:10.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8736999999999999e-05 2020-11-12T17:29:10.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814339+0000", 2020-11-12T17:29:10.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997 2020-11-12T17:29:10.560 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.561 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.561 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.561 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63512 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:29:10.561 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:29:10.561 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.583100196999993, 2020-11-12T17:29:10.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002, 2020-11-12T17:29:10.562 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.562 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:10.562 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:10.562 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:10.562 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:10.562 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63512 2020-11-12T17:29:10.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.563 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:29:10.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:29:10.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:10.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478106+0000", 2020-11-12T17:29:10.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0413e-05 2020-11-12T17:29:10.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478156+0000", 2020-11-12T17:29:10.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9499999999999998e-06 2020-11-12T17:29:10.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478162+0000", 2020-11-12T17:29:10.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.225e-06 2020-11-12T17:29:10.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478165+0000", 2020-11-12T17:29:10.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080122779999999994 2020-11-12T17:29:10.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486178+0000", 2020-11-12T17:29:10.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001128 2020-11-12T17:29:10.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486291+0000", 2020-11-12T17:29:10.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024748499999999998 2020-11-12T17:29:10.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:10.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486538+0000", 2020-11-12T17:29:10.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034654350000000002 2020-11-12T17:29:10.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:10.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.490003+0000", 2020-11-12T17:29:10.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35059826799999999 2020-11-12T17:29:10.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:10.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840602+0000", 2020-11-12T17:29:10.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3192000000000003e-05 2020-11-12T17:29:10.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:10.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840645+0000", 2020-11-12T17:29:10.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2951999999999999e-05 2020-11-12T17:29:10.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840678+0000", 2020-11-12T17:29:10.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002 2020-11-12T17:29:10.571 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.571 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.571 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.572 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63511 5.c e174/139 ondisk, result = 0)", 2020-11-12T17:29:10.572 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:29:10.572 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 68.571566597, 2020-11-12T17:29:10.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002, 2020-11-12T17:29:10.572 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.572 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:10.572 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:29:10.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:29:10.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99998 2020-11-12T17:29:10.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.574 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.574 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489637+0000", 2020-11-12T17:29:10.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5010999999999999e-05 2020-11-12T17:29:10.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489692+0000", 2020-11-12T17:29:10.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32451660599999999 2020-11-12T17:29:10.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.575 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814209+0000", 2020-11-12T17:29:10.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3729999999999993e-06 2020-11-12T17:29:10.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814217+0000", 2020-11-12T17:29:10.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9755999999999997e-05 2020-11-12T17:29:10.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814257+0000", 2020-11-12T17:29:10.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2589999999999997e-06 2020-11-12T17:29:10.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814263+0000", 2020-11-12T17:29:10.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0548000000000002e-05 2020-11-12T17:29:10.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814344+0000", 2020-11-12T17:29:10.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002 2020-11-12T17:29:10.578 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.578 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.579 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.579 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "replica_scrub(pg: 5.0,from:0'0,to:164'3496,epoch:175/135,start:5:073087b9:::benchmark_data_smithi036_24110_object5847:0,end:5:07fd2517:::benchmark_data_smithi036_24110_object2426:0,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2020-11-12T17:29:10.579 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:29:10.579 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 63.729550811999999, 2020-11-12T17:29:10.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003, 2020-11-12T17:29:10.580 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.580 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:29:10.580 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:29:10.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:29:10.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:29:10.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331660+0000", 2020-11-12T17:29:10.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6072000000000003e-05 2020-11-12T17:29:10.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331696+0000", 2020-11-12T17:29:10.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73693106399999997 2020-11-12T17:29:10.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068627+0000", 2020-11-12T17:29:10.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6524999999999998e-05 2020-11-12T17:29:10.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068643+0000", 2020-11-12T17:29:10.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000180683 2020-11-12T17:29:10.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068824+0000", 2020-11-12T17:29:10.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101581 2020-11-12T17:29:10.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068926+0000", 2020-11-12T17:29:10.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003 2020-11-12T17:29:10.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.585 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.586 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:25432 6.e e203/190 ondisk, result = 0)", 2020-11-12T17:29:10.586 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:29:01.622580+0000", 2020-11-12T17:29:10.586 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 8.4386438080000001, 2020-11-12T17:29:10.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27816144100000001, 2020-11-12T17:29:10.586 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:10.586 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:10.587 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:10.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:10.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622580+0000", 2020-11-12T17:29:10.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:10.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:10.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622580+0000", 2020-11-12T17:29:10.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:10.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:10.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622557+0000", 2020-11-12T17:29:10.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2597999999999999e-05 2020-11-12T17:29:10.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:10.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622619+0000", 2020-11-12T17:29:10.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27631449699999999 2020-11-12T17:29:10.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:10.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.898934+0000", 2020-11-12T17:29:10.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4849999999999998e-06 2020-11-12T17:29:10.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:10.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.898943+0000", 2020-11-12T17:29:10.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001572763 2020-11-12T17:29:10.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:10.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.900516+0000", 2020-11-12T17:29:10.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0876999999999999e-05 2020-11-12T17:29:10.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:10.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.900527+0000", 2020-11-12T17:29:10.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021447799999999999 2020-11-12T17:29:10.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:10.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:10.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:10.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.900741+0000", 2020-11-12T17:29:10.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27816144100000001 2020-11-12T17:29:10.592 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.592 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:10.593 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:10.593 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:10.595 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:10.595 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:10.595 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:10.596 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:10.596 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:10.596 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:10.596 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:10.596 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:29:10.616 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:29:10.616 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:10.616 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:10.616 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:29:10.616 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:29:10.617 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:29:10.617 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:29:10.617 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:29:10.617 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:10.617 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:10.618 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 34 16 29904 29888 6.86701 0 - 0.0157766 2020-11-12T17:29:10.618 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:10.591+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:10.618 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:29:10.696 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:10.692+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:10.756 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:10.756 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:10.767 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:29:10.815 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:10.815+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:10.882 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:10.883 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:10.893 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:29:10.899 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:10.896+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:11.001 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:11.000+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:11.047 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:11.047 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:11.057 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:29:11.101 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:11.100+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:11.164 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:11.165 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:11.174 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:29:11.219 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:11.219+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:11.290 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:11.291 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:11.300 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:29:11.303 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:11.300+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:11.404 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:11.400+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:11.459 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:11.460 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:11.470 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:29:11.504 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:11.503+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:11.524 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 35 16 29904 29888 6.6708 0 - 0.0157766 2020-11-12T17:29:11.589 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:11.590 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:11.599 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:29:11.645 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:11.644+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:11.706 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:11.703+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:11.710 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:11.710 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:11.720 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:29:11.807 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:11.807+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:11.812 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:29:11.845 INFO:tasks.ceph.osd.2:Stopped 2020-11-12T17:29:11.847 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.2 2020-11-12T17:29:11.851 INFO:tasks.thrashosds.thrasher:remote for osd 2 is ubuntu@smithi036.front.sepia.ceph.com 2020-11-12T17:29:11.854 INFO:teuthology.orchestra.run.smithi036:> type ceph-objectstore-tool 2020-11-12T17:29:11.862 INFO:teuthology.orchestra.run.smithi036.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2020-11-12T17:29:11.863 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op list-pgs 2020-11-12T17:29:11.897 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:11.897 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:11.930 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:29:11.931 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:11.928+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:12.032 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:12.032+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:12.036 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:12.036 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:12.045 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:29:13.311 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:29:13.313 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 36 16 29904 29888 6.4855 0 - 0.0157766 2020-11-12T17:29:13.314 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:29:13.314 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:13.311+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:13.315 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:12.956+0000 7f7b4b297700 -1 osd.4 208 handle_osd_map injecting map crc failure 2020-11-12T17:29:13.414 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:13.412+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:13.426 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:13.427 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:13.438 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:29:13.504 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:13.514 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:13.511+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:13.524 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 37 16 29904 29888 6.31021 0 - 0.0157766 2020-11-12T17:29:13.528 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:13.561 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:13.588 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:13.590 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:13.590 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:13.600 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:29:13.615 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:13.615+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:13.619 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:13.648 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:13.677 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:13.678 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:29:13.678 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:29:13.678 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:29:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:29:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:29:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:29:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:29:13.681 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:13.681 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:13.710 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:13.711 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:13.711 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:13.712 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:13.715 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:13.712+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:13.719 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:29:13.817 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:13.814+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:13.869 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:13.869 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:13.870 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:13.870 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:13.870 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:13.877 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:29:13.924 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:13.924+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:13.988 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:13.989 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:13.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:13.989 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:13.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.989 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:29:13.990 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:13.990 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31444450700002, 2020-11-12T17:29:13.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:29:13.990 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:13.990 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:29:13.990 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:13.990 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:13.991 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:13.991 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:29:13.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.991 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:13.991 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.991 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:13.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:13.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:13.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:13.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:13.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:29:13.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:13.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:29:13.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:29:13.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:13.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:29:13.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:29:13.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:13.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:29:13.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:29:13.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.995 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:13.995 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:29:13.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:29:13.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:13.996 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:29:13.996 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:29:13.996 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.996 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.996 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:13.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:29:13.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:29:13.997 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.997 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.997 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:13.997 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:29:13.997 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:29:13.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.998 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:13.998 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:29:13.998 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:29:13.998 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.998 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:13.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:29:13.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:29:13.999 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:13.999 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:13.999 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:13.999 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:29:13.999 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:29:14.000 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.000 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.000 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.000 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.000 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.000 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.000 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:14.001 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31404214600002, 2020-11-12T17:29:14.001 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:29:14.001 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.001 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.001 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.001 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:29:14.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.002 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.002 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.002 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.002 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:14.002 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.002 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.003 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:14.003 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:29:14.003 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.003 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.003 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.004 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:29:14.004 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:29:14.004 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.004 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.004 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:29:14.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:29:14.005 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.005 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.005 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.005 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:29:14.005 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:29:14.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.006 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.006 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.006 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:29:14.006 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:29:14.006 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.007 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.007 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:29:14.007 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:29:14.007 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.007 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:29:14.008 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:29:14.008 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.008 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.008 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.008 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:29:14.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:29:14.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.009 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.009 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:29:14.009 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:29:14.009 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.009 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.010 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:29:14.010 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:29:14.010 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.010 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.010 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:29:14.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:29:14.011 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.011 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.011 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.011 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:29:14.011 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:29:14.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.012 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:29:14.012 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:29:14.012 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.012 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.012 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:29:14.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:29:14.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.013 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.013 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.013 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:29:14.013 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:29:14.013 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.014 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.014 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.014 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:29:14.014 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:29:14.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.014 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.014 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.015 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.015 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.015 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.015 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:14.015 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31371815300002, 2020-11-12T17:29:14.015 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:29:14.015 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.016 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.016 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.016 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.016 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.016 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:29:14.016 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.017 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.017 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.017 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.017 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:14.017 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.017 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.018 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:14.018 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:29:14.018 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.018 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.018 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:29:14.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:29:14.019 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.019 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.019 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.019 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:29:14.019 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:29:14.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.020 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.020 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:29:14.020 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:29:14.020 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.020 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:29:14.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:29:14.021 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.021 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.021 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.021 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:29:14.021 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:29:14.022 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.022 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.022 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.022 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:29:14.022 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:29:14.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.023 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.023 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:29:14.023 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:29:14.023 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.023 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:29:14.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:29:14.024 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.024 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.024 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.024 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:29:14.024 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:29:14.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.025 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.025 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.025 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:29:14.025 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:29:14.025 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.026 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.026 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:29:14.026 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:29:14.026 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.026 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:29:14.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:29:14.027 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.027 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.027 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.027 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:29:14.027 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:29:14.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.028 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.028 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:29:14.028 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:29:14.028 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.028 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.029 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.029 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:29:14.029 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:29:14.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.029 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.029 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.029 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.029 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.030 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.030 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:29:14.030 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31347444199997, 2020-11-12T17:29:14.030 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:29:14.030 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.030 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.030 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.031 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.031 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.031 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:29:14.031 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.031 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.031 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.031 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:29:14.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.032 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.032 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.032 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:29:14.032 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:29:14.032 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:29:14.033 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:29:14.033 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.033 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.033 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.033 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:29:14.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:29:14.034 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.034 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.034 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.034 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:29:14.034 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:29:14.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.035 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:29:14.035 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:29:14.035 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.035 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.035 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:29:14.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:29:14.036 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.036 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.036 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.036 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:29:14.036 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:29:14.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.037 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:29:14.037 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:29:14.037 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.037 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.037 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:29:14.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:29:14.038 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.038 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.038 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.038 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:29:14.038 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:29:14.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.039 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.039 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.039 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:29:14.039 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:29:14.039 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.040 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:29:14.040 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:29:14.040 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.040 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.040 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:29:14.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:29:14.041 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.041 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.041 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.041 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:29:14.041 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:29:14.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.042 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.042 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.042 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:29:14.042 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:29:14.042 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.043 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.043 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.043 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:29:14.043 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:29:14.043 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.043 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.043 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.043 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.044 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.044 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.044 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:29:14.044 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31323629500002, 2020-11-12T17:29:14.044 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:29:14.044 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.044 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.045 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.045 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.045 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.045 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:29:14.045 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.045 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.045 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:29:14.046 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.046 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.046 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.046 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.046 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:29:14.047 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:29:14.047 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.047 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.047 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.047 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:29:14.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:29:14.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.048 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.048 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.048 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:29:14.048 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:29:14.048 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.049 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.049 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:29:14.049 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:29:14.049 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.049 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:29:14.050 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:29:14.050 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.050 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.050 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.050 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:29:14.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:29:14.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.051 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.051 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.051 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:29:14.051 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:29:14.051 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.052 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.052 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:29:14.052 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:29:14.052 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.052 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:29:14.053 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:29:14.053 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.053 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.053 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.053 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:29:14.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:29:14.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.054 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.054 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.054 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:29:14.054 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:29:14.054 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.055 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:29:14.055 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:29:14.055 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.055 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.055 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:29:14.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:29:14.056 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.056 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.056 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.056 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:29:14.056 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:29:14.057 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.057 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.057 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.057 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:29:14.057 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:29:14.058 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.058 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.058 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.058 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:29:14.058 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:29:14.058 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.058 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.059 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.059 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.059 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.059 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.059 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:29:14.059 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31303425499999, 2020-11-12T17:29:14.060 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:29:14.060 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.060 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.060 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.060 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.060 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.060 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:29:14.061 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.061 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.061 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.061 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.061 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:29:14.061 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.062 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.062 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.062 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:29:14.062 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:29:14.062 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.063 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.063 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:29:14.063 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:29:14.063 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.063 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:29:14.064 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:29:14.064 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.064 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.064 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.064 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:29:14.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:29:14.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.065 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.065 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.065 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:29:14.065 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:29:14.065 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.066 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.066 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:29:14.066 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:29:14.066 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.066 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:29:14.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:29:14.067 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.067 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.067 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.067 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:29:14.067 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:29:14.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.068 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.068 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:29:14.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:29:14.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.068 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:29:14.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:29:14.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:29:14.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:29:14.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:29:14.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:29:14.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:29:14.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:29:14.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:29:14.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:29:14.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:29:14.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:29:14.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:29:14.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:29:14.074 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.074 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.074 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.074 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.075 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:29:14.075 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31282888499999, 2020-11-12T17:29:14.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:29:14.075 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.075 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.075 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.076 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.076 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:29:14.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.076 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:29:14.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.077 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.077 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:29:14.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:29:14.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.078 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.078 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:29:14.078 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:29:14.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.078 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:29:14.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:29:14.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:29:14.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:29:14.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:29:14.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:29:14.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:29:14.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:29:14.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:29:14.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:29:14.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:29:14.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:29:14.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:29:14.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:29:14.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:29:14.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:29:14.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:29:14.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:29:14.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:29:14.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:29:14.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:29:14.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:29:14.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:29:14.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:29:14.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:29:14.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:29:14.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:29:14.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:29:14.089 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.089 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.089 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.089 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.089 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:29:14.090 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31264305799999, 2020-11-12T17:29:14.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:29:14.090 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.090 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.090 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.090 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.090 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.091 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:29:14.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.091 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:29:14.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:29:14.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:29:14.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:29:14.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:29:14.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:29:14.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:29:14.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:29:14.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:29:14.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:29:14.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:29:14.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:29:14.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:29:14.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:29:14.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:29:14.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:29:14.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:29:14.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:29:14.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:29:14.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:29:14.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:29:14.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:29:14.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:29:14.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:29:14.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:29:14.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:29:14.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:29:14.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:29:14.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:29:14.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:29:14.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:29:14.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:29:14.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:29:14.103 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.103 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.104 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.104 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.104 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:29:14.104 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31244609399999, 2020-11-12T17:29:14.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:29:14.105 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.105 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.105 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.105 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.105 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.105 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:29:14.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.106 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.106 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.106 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:29:14.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.107 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.107 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.107 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:29:14.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:29:14.107 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:29:14.108 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:29:14.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:29:14.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:29:14.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:29:14.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:29:14.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:29:14.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:29:14.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:29:14.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:29:14.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:29:14.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:29:14.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:29:14.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:29:14.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:29:14.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:29:14.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:29:14.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:29:14.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:29:14.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:29:14.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:29:14.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:29:14.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:29:14.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:29:14.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:29:14.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:29:14.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:29:14.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:29:14.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:29:14.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:29:14.118 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.118 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.118 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.119 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.119 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:29:14.119 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31225006400001, 2020-11-12T17:29:14.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:29:14.119 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.119 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.120 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.120 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:29:14.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.120 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:29:14.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:29:14.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:29:14.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:29:14.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:29:14.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:29:14.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:29:14.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:29:14.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:29:14.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:29:14.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:29:14.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:29:14.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:29:14.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:29:14.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:29:14.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:29:14.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:29:14.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:29:14.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:29:14.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:29:14.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:29:14.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:29:14.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:29:14.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:29:14.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:29:14.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:29:14.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:29:14.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:29:14.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:29:14.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:29:14.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:29:14.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:29:14.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:29:14.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.134 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.135 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.135 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:29:14.135 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.312069264, 2020-11-12T17:29:14.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:29:14.135 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.135 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.135 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.135 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.136 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.136 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:29:14.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.136 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:29:14.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:29:14.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:29:14.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:29:14.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:29:14.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:29:14.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:29:14.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:29:14.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:29:14.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:29:14.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:29:14.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:29:14.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:29:14.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:29:14.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:29:14.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:29:14.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:29:14.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:29:14.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:29:14.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:29:14.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:29:14.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:29:14.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:29:14.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:29:14.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:29:14.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:29:14.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:29:14.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:29:14.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:29:14.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:29:14.147 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:29:14.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:29:14.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:29:14.148 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.148 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.148 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.149 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.149 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:29:14.149 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.311873311, 2020-11-12T17:29:14.149 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:29:14.149 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.150 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.150 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.150 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.150 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.150 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:29:14.150 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.150 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:29:14.151 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.151 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:29:14.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:29:14.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:29:14.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:29:14.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:29:14.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:29:14.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:29:14.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:29:14.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:29:14.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:29:14.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:29:14.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:29:14.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:29:14.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:29:14.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:29:14.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:29:14.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:29:14.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:29:14.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:29:14.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:29:14.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:29:14.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:29:14.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:29:14.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:29:14.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:29:14.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:29:14.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:29:14.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:29:14.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:29:14.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:29:14.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:29:14.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:29:14.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.164 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.164 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.164 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:29:14.164 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31167970299998, 2020-11-12T17:29:14.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:29:14.165 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.165 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.165 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.166 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.166 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.166 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:29:14.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.167 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:29:14.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:29:14.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:29:14.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:29:14.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:29:14.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:29:14.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:29:14.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:29:14.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:29:14.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:29:14.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:29:14.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:29:14.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:29:14.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:29:14.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:29:14.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:29:14.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:29:14.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:29:14.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:29:14.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:29:14.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:29:14.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:29:14.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:29:14.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:29:14.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:29:14.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:29:14.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:29:14.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:29:14.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:29:14.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:29:14.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:29:14.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:29:14.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:29:14.179 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.179 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.179 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.180 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.180 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:29:14.180 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31136784, 2020-11-12T17:29:14.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:29:14.180 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.180 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.180 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.181 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.181 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.181 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:29:14.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.181 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:29:14.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:29:14.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:29:14.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:29:14.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:29:14.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:29:14.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:29:14.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:29:14.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:29:14.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:29:14.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:29:14.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:29:14.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:29:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:29:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:29:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:29:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:29:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:29:14.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:29:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:29:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:29:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:29:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:29:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:29:14.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:29:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:29:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:29:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:29:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:29:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:29:14.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:29:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:29:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:29:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.193 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.194 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:29:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.31108034300001, 2020-11-12T17:29:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:29:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.195 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:29:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:29:14.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:29:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:29:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:29:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:29:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:29:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:29:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:29:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:29:14.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:29:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:29:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:29:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:29:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:29:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:29:14.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:29:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:29:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:29:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:29:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:29:14.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:29:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:29:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:29:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:29:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:29:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:29:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:29:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:29:14.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:29:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:29:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:29:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:29:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:29:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.208 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:29:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 354.310859972, 2020-11-12T17:29:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:29:14.209 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:29:14.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:29:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:29:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:29:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:29:14.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:29:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:29:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:29:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:29:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:29:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:29:14.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:29:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:29:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:29:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:29:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:29:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:29:14.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:29:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:29:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:29:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:29:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:29:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:29:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:29:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:29:14.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:29:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:29:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:29:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:29:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:29:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:29:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:29:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:29:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:29:14.222 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:29:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:29:14.223 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 192.401280982, 2020-11-12T17:29:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:29:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:29:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:29:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:29:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:29:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:29:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:29:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:29:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:29:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:29:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:29:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:29:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:29:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:29:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:29:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:29:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:29:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:29:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:29:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:29:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:29:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:29:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 130.32690522199999, 2020-11-12T17:29:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:29:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.232 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:29:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:29:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:29:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:29:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:29:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:29:14.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:29:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:29:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:29:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:29:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:29:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:29:14.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:29:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:29:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:29:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:29:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:29:14.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:29:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:29:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:29:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:29:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:29:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:29:14.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:29:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:29:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:29:14.242 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:29:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:29:14.243 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 99.556478854999995, 2020-11-12T17:29:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:29:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:14.244 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:29:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:29:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:29:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:29:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:29:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:29:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:29:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:29:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:29:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:29:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:29:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:29:14.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:29:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:29:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:29:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:29:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:14.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:29:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:29:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:29:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:29:14.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:29:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:29:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:29:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:29:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:29:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:29:14.254 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:29:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:29:14.255 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 99.548381821999996, 2020-11-12T17:29:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:29:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:29:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:29:14.258 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:29:14.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.258 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.258 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.258 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:29:14.259 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:29:14.259 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.260 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.260 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:29:14.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:29:14.260 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:29:14.261 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:29:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:29:14.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:29:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:29:14.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:29:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:29:14.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:29:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:29:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:29:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.265 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.266 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.266 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:14.268 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:29:14.268 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:14.266+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:14.368 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:14.368+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:14.421 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:14.421 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:14.421 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:14.421 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:14.430 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:29:14.473 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:14.472+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:14.531 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 38 16 29904 29888 6.14415 0 - 0.0157766 2020-11-12T17:29:14.571 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:14.570+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:14.589 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:14.589 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:14.590 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:14.590 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:14.590 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:14.600 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:29:14.672 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:14.672+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:14.714 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:14.714 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:14.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:14.715 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:14.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.715 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:29:14.715 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:14.715 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 365.86828301999998, 2020-11-12T17:29:14.715 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:29:14.716 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.716 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:14.716 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.716 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.716 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:14.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:14.717 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:29:14.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:29:14.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:29:14.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:29:14.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:29:14.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:29:14.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:29:14.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:29:14.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:29:14.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:29:14.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:29:14.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:29:14.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:29:14.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:29:14.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:29:14.722 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.722 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.722 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.723 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:29:14.723 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:14.723 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 360.30808579799998, 2020-11-12T17:29:14.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:29:14.724 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.724 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.724 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:29:14.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.725 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:14.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:14.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:29:14.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:29:14.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:29:14.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:29:14.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:29:14.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:29:14.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:29:14.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:29:14.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:29:14.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:29:14.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:29:14.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:29:14.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:29:14.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:14.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:29:14.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:29:14.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:29:14.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:29:14.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:29:14.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:29:14.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:29:14.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:29:14.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:29:14.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:29:14.734 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.734 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.734 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.735 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:29:14.735 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:14.735 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 360.30219347500002, 2020-11-12T17:29:14.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:29:14.736 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.736 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:14.736 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:14.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:14.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:29:14.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:29:14.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:29:14.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:29:14.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:29:14.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:29:14.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:29:14.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:29:14.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:29:14.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:29:14.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:29:14.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:29:14.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:29:14.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:29:14.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:29:14.743 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.743 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.743 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.743 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:29:14.743 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:14.744 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 330.17620320700001, 2020-11-12T17:29:14.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:29:14.744 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.744 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.744 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.744 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.744 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.744 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:29:14.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.745 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:14.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:14.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:14.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:29:14.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:29:14.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:29:14.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:29:14.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:29:14.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:29:14.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:29:14.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:29:14.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:29:14.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:29:14.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:29:14.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:29:14.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:14.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:29:14.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:29:14.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:29:14.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:29:14.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:29:14.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:29:14.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:29:14.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:29:14.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:29:14.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:29:14.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.755 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.755 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:29:14.755 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:14.756 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 329.795320995, 2020-11-12T17:29:14.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:29:14.756 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.756 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.756 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.757 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.757 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.757 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:29:14.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.757 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:14.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:14.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:14.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:29:14.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:29:14.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:29:14.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:29:14.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:29:14.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:29:14.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:29:14.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:29:14.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:29:14.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:29:14.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:29:14.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:29:14.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:14.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:29:14.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:29:14.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:29:14.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:29:14.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:29:14.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:29:14.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:29:14.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:29:14.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:29:14.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:29:14.766 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.766 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.767 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.767 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:29:14.767 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:14.767 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 329.78376787500002, 2020-11-12T17:29:14.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:29:14.767 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.768 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:14.768 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:14.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:14.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:14.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:29:14.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:29:14.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:29:14.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:29:14.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:29:14.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:29:14.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:29:14.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:29:14.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:29:14.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:29:14.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:29:14.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:29:14.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:29:14.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:29:14.774 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.774 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.774 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.775 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:29:14.775 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:14.775 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 324.71064769399999, 2020-11-12T17:29:14.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:29:14.775 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.775 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.775 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.775 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:14.776 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:14.776 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:29:14.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.776 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:14.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:14.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:29:14.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:29:14.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:29:14.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:29:14.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:29:14.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:29:14.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:29:14.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:29:14.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:29:14.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:29:14.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:29:14.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:29:14.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:29:14.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:14.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:29:14.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:29:14.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:29:14.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:29:14.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:29:14.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:29:14.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:29:14.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:29:14.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:29:14.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:29:14.786 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.786 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.787 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.787 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:29:14.788 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:14.788 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 217.99982330099999, 2020-11-12T17:29:14.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:29:14.788 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.788 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.788 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:14.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:14.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:14.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:29:14.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:29:14.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:29:14.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:29:14.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:29:14.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:29:14.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:29:14.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:29:14.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:29:14.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:29:14.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:29:14.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:29:14.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:29:14.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:29:14.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:29:14.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:29:14.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.797 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.798 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:29:14.798 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:14.798 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 212.67088077599999, 2020-11-12T17:29:14.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:29:14.799 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.799 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.799 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:14.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:14.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:29:14.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:29:14.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:29:14.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:29:14.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:29:14.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:29:14.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:29:14.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:29:14.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:29:14.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:29:14.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:29:14.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:29:14.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:29:14.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:29:14.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:29:14.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:29:14.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:29:14.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.806 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.806 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.806 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:29:14.807 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:14.807 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 198.076372918, 2020-11-12T17:29:14.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:29:14.807 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.807 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.807 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:14.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:14.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:29:14.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:29:14.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:29:14.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:29:14.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:29:14.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:29:14.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:29:14.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:29:14.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:29:14.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:29:14.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:29:14.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:29:14.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:29:14.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:29:14.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:29:14.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:29:14.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:29:14.823 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.824 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.824 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.824 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:29:14.824 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:14.825 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 193.87429779000001, 2020-11-12T17:29:14.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:29:14.825 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.825 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.825 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:14.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:14.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:14.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:29:14.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:29:14.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:29:14.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:29:14.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:29:14.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:29:14.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:29:14.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:29:14.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:29:14.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:29:14.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:29:14.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:29:14.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:29:14.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:29:14.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:29:14.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:29:14.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.832 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.832 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:29:14.832 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:14.833 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 181.83225538900001, 2020-11-12T17:29:14.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:29:14.833 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.833 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.833 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:14.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:14.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:29:14.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:29:14.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:29:14.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:29:14.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:29:14.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:29:14.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:29:14.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:29:14.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:29:14.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:29:14.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:29:14.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:29:14.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:29:14.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:29:14.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:29:14.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:29:14.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:29:14.840 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.840 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.840 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.840 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:29:14.841 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:14.841 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 137.750454504, 2020-11-12T17:29:14.841 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:29:14.841 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.841 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.841 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:14.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.842 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:14.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:14.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:29:14.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:29:14.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:29:14.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:29:14.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:29:14.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:29:14.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:29:14.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:29:14.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:29:14.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:29:14.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:29:14.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:29:14.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:29:14.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:29:14.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:29:14.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:29:14.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.848 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.848 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.848 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:29:14.849 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:14.849 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 115.491384526, 2020-11-12T17:29:14.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:29:14.849 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.849 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.849 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:14.849 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:14.850 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:14.850 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:29:14.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.850 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.850 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:14.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:14.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:14.851 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:29:14.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:29:14.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:29:14.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:29:14.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:29:14.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:29:14.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:29:14.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:29:14.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:29:14.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:29:14.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:29:14.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:29:14.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:14.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:29:14.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:29:14.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:14.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:29:14.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:29:14.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:14.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:29:14.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:29:14.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:29:14.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:29:14.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:29:14.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:29:14.858 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.859 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.859 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.859 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:29:14.859 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:14.859 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 115.48156002499999, 2020-11-12T17:29:14.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:29:14.860 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.860 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:14.860 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:14.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:14.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:29:14.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:29:14.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:29:14.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:29:14.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:29:14.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:29:14.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:29:14.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:29:14.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:29:14.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:29:14.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:29:14.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:29:14.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:29:14.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:29:14.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:29:14.866 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.866 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.866 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.866 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:29:14.867 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:14.867 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 75.136304193000001, 2020-11-12T17:29:14.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:29:14.867 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.867 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.867 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:14.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:14.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:29:14.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:29:14.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:29:14.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:29:14.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:29:14.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:29:14.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:29:14.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:29:14.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:29:14.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:29:14.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:29:14.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:29:14.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:29:14.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:29:14.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:29:14.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:29:14.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:29:14.874 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.874 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.874 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.875 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:29:14.875 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:14.875 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 73.814627279999996, 2020-11-12T17:29:14.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:29:14.875 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.875 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.875 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:14.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:14.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:29:14.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:29:14.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:29:14.877 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:29:14.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:29:14.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.878 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.878 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:29:14.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:29:14.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.879 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.879 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:29:14.879 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:29:14.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:29:14.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:29:14.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:29:14.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:29:14.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:29:14.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:29:14.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:29:14.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:29:14.882 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.882 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.882 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.883 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:29:14.883 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:14.883 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 61.733105414000001, 2020-11-12T17:29:14.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:29:14.883 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.883 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.883 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:14.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:14.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:14.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:29:14.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:29:14.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:29:14.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:29:14.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:29:14.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:29:14.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:29:14.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:29:14.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:29:14.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:29:14.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:29:14.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:29:14.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.889 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.889 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:29:14.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:29:14.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:29:14.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:29:14.890 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.890 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.890 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.890 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.891 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3791 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'231, mlcod=192'223)", 2020-11-12T17:29:14.891 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:14.891 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.273263372000002, 2020-11-12T17:29:14.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001, 2020-11-12T17:29:14.891 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.891 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.891 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:14.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:14.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:14.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437443+0000", 2020-11-12T17:29:14.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1434999999999995e-05 2020-11-12T17:29:14.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437525+0000", 2020-11-12T17:29:14.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42555852399999999 2020-11-12T17:29:14.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863083+0000", 2020-11-12T17:29:14.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4397e-05 2020-11-12T17:29:14.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863098+0000", 2020-11-12T17:29:14.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019535099999999999 2020-11-12T17:29:14.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863293+0000", 2020-11-12T17:29:14.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4679999999999996e-05 2020-11-12T17:29:14.896 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.896 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863368+0000", 2020-11-12T17:29:14.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001951045 2020-11-12T17:29:14.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.897 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.897 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865319+0000", 2020-11-12T17:29:14.897 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016422 2020-11-12T17:29:14.897 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.897 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.898 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.898 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865483+0000", 2020-11-12T17:29:14.898 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001 2020-11-12T17:29:14.898 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.898 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.898 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.898 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.899 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.899 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3792 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'232, mlcod=192'225)", 2020-11-12T17:29:14.899 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:14.899 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 35.272766744000002, 2020-11-12T17:29:14.899 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498, 2020-11-12T17:29:14.899 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:14.899 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:14.899 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:14.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:14.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:14.900 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:14.900 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.900 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.900 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:14.900 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:14.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:14.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.901 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.901 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:14.901 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437930+0000", 2020-11-12T17:29:14.901 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108421 2020-11-12T17:29:14.901 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:14.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.438038+0000", 2020-11-12T17:29:14.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46508600999999999 2020-11-12T17:29:14.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.902 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:14.902 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903124+0000", 2020-11-12T17:29:14.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3366e-05 2020-11-12T17:29:14.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:14.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903138+0000", 2020-11-12T17:29:14.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9920000000000006e-05 2020-11-12T17:29:14.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:14.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903228+0000", 2020-11-12T17:29:14.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2246999999999997e-05 2020-11-12T17:29:14.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:14.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903270+0000", 2020-11-12T17:29:14.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017774449999999999 2020-11-12T17:29:14.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:14.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905047+0000", 2020-11-12T17:29:14.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4606999999999997e-05 2020-11-12T17:29:14.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:14.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:14.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:14.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905142+0000", 2020-11-12T17:29:14.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498 2020-11-12T17:29:14.906 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.906 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.906 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.906 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:14.907 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:14.907 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:14.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2020-11-12T17:29:14.908 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:29:14.909 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:14.904+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:15.009 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:15.006+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:15.027 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:29:15.028 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:15.038 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:29:15.123 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:15.122+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:15.180 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:15.180 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:15.180 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:29:15.180 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:29:15.181 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:15.189 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:29:15.231 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:15.230+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:15.313 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:15.310+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:15.315 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:29:15.337 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:15.337 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:29:15.338 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:29:15.338 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:29:15.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.338 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79414 4.6 4:60cd86ce:::benchmark_data_smithi036_18856_object3025:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:29:15.339 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:29:15.339 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 164.54883329099999, 2020-11-12T17:29:15.339 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998, 2020-11-12T17:29:15.339 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:15.339 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:15.339 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:15.339 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:15.340 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:15.340 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79414 2020-11-12T17:29:15.340 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.340 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:15.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.340 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:15.340 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:29:15.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:15.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.341 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:15.341 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:29:15.341 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:15.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.342 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:15.342 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784303+0000", 2020-11-12T17:29:15.342 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4221999999999997e-05 2020-11-12T17:29:15.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.343 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:15.343 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784358+0000", 2020-11-12T17:29:15.343 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8389999999999996e-06 2020-11-12T17:29:15.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.344 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.344 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:15.344 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784366+0000", 2020-11-12T17:29:15.344 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2040000000000002e-06 2020-11-12T17:29:15.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:15.345 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784370+0000", 2020-11-12T17:29:15.345 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029216049999999999 2020-11-12T17:29:15.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.345 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:15.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787291+0000", 2020-11-12T17:29:15.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3842e-05 2020-11-12T17:29:15.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.346 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:29:15.346 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787385+0000", 2020-11-12T17:29:15.346 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15210379399999999 2020-11-12T17:29:15.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:15.347 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.939489+0000", 2020-11-12T17:29:15.347 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00095422699999999998 2020-11-12T17:29:15.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:15.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:15.347 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:29:15.348 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940443+0000", 2020-11-12T17:29:15.348 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092951600000000002 2020-11-12T17:29:15.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.949738+0000", 2020-11-12T17:29:16.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00060685800000000005 2020-11-12T17:29:16.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:29:16.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.950345+0000", 2020-11-12T17:29:16.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093005117999999998 2020-11-12T17:29:16.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.043350+0000", 2020-11-12T17:29:16.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001029147 2020-11-12T17:29:16.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.044379+0000", 2020-11-12T17:29:16.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001543397 2020-11-12T17:29:16.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:16.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045923+0000", 2020-11-12T17:29:16.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015442345999999999 2020-11-12T17:29:16.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:16.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061365+0000", 2020-11-12T17:29:16.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0095990889999999999 2020-11-12T17:29:16.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:16.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.070964+0000", 2020-11-12T17:29:16.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000446744 2020-11-12T17:29:16.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.071411+0000", 2020-11-12T17:29:16.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001655534 2020-11-12T17:29:16.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.463 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.463 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.073066+0000", 2020-11-12T17:29:16.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998 2020-11-12T17:29:16.463 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.463 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.464 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.465 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79425 4.6 4:6231d6c2:::benchmark_data_smithi036_18856_object3036:head [delete] snapc 0=[] ondisk+write+known_if_redirected e118)", 2020-11-12T17:29:16.465 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:29:16.465 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 164.548759795, 2020-11-12T17:29:16.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002, 2020-11-12T17:29:16.466 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.466 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:16.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:16.466 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:16.466 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79425 2020-11-12T17:29:16.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.467 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:29:16.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:29:16.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:29:16.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784379+0000", 2020-11-12T17:29:16.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6152000000000001e-05 2020-11-12T17:29:16.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784426+0000", 2020-11-12T17:29:16.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6860000000000003e-06 2020-11-12T17:29:16.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784431+0000", 2020-11-12T17:29:16.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6460000000000002e-06 2020-11-12T17:29:16.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784434+0000", 2020-11-12T17:29:16.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030643549999999999 2020-11-12T17:29:16.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787498+0000", 2020-11-12T17:29:16.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100717 2020-11-12T17:29:16.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:29:16.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787599+0000", 2020-11-12T17:29:16.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15298814699999999 2020-11-12T17:29:16.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.474 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940587+0000", 2020-11-12T17:29:16.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00097205100000000003 2020-11-12T17:29:16.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.474 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:29:16.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.941559+0000", 2020-11-12T17:29:16.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.019466477999999999 2020-11-12T17:29:16.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.475 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.475 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961026+0000", 2020-11-12T17:29:16.475 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058434100000000005 2020-11-12T17:29:16.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:29:16.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961610+0000", 2020-11-12T17:29:16.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13222599700000001 2020-11-12T17:29:16.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.093836+0000", 2020-11-12T17:29:16.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089939299999999996 2020-11-12T17:29:16.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.094735+0000", 2020-11-12T17:29:16.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001382973 2020-11-12T17:29:16.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:16.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.096118+0000", 2020-11-12T17:29:16.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046953350000000001 2020-11-12T17:29:16.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:16.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100814+0000", 2020-11-12T17:29:16.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9295000000000006e-05 2020-11-12T17:29:16.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:16.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100893+0000", 2020-11-12T17:29:16.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00035136400000000001 2020-11-12T17:29:16.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.101244+0000", 2020-11-12T17:29:16.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015508290000000001 2020-11-12T17:29:16.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.102795+0000", 2020-11-12T17:29:16.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002 2020-11-12T17:29:16.481 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.481 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.482 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79491 4.4 4:2feb571e:::benchmark_data_smithi036_18856_object3102:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:29:16.482 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:29:16.482 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 164.474747869, 2020-11-12T17:29:16.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458, 2020-11-12T17:29:16.483 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.483 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.483 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:16.483 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:16.483 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:16.483 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79491 2020-11-12T17:29:16.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.483 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:29:16.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:29:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858382+0000", 2020-11-12T17:29:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8493999999999998e-05 2020-11-12T17:29:16.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.486 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858450+0000", 2020-11-12T17:29:16.486 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:29:16.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.486 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858460+0000", 2020-11-12T17:29:16.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5260000000000004e-06 2020-11-12T17:29:16.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858465+0000", 2020-11-12T17:29:16.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002042622 2020-11-12T17:29:16.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860507+0000", 2020-11-12T17:29:16.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5987000000000003e-05 2020-11-12T17:29:16.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:29:16.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860583+0000", 2020-11-12T17:29:16.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.264296631 2020-11-12T17:29:16.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.124880+0000", 2020-11-12T17:29:16.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00260079 2020-11-12T17:29:16.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:29:16.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.127481+0000", 2020-11-12T17:29:16.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015473191000000001 2020-11-12T17:29:16.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.142954+0000", 2020-11-12T17:29:16.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068121100000000003 2020-11-12T17:29:16.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.143635+0000", 2020-11-12T17:29:16.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014373840000000001 2020-11-12T17:29:16.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:16.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.145073+0000", 2020-11-12T17:29:16.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020755122000000001 2020-11-12T17:29:16.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:16.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.165828+0000", 2020-11-12T17:29:16.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047732520000000004 2020-11-12T17:29:16.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:16.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.170601+0000", 2020-11-12T17:29:16.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00046765100000000003 2020-11-12T17:29:16.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.171069+0000", 2020-11-12T17:29:16.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018080010000000001 2020-11-12T17:29:16.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.172877+0000", 2020-11-12T17:29:16.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458 2020-11-12T17:29:16.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.495 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.496 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:14736 5.0 e137/135 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head v 137'896, mlcod=137'891)", 2020-11-12T17:29:16.496 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:29:16.496 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 133.27294529900001, 2020-11-12T17:29:16.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999, 2020-11-12T17:29:16.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.496 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.496 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.497 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:29:16.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.497 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:29:16.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:29:16.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060202+0000", 2020-11-12T17:29:16.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8984000000000003e-05 2020-11-12T17:29:16.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060261+0000", 2020-11-12T17:29:16.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56005787699999998 2020-11-12T17:29:16.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620318+0000", 2020-11-12T17:29:16.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8369999999999999e-06 2020-11-12T17:29:16.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620325+0000", 2020-11-12T17:29:16.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012664800000000001 2020-11-12T17:29:16.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620452+0000", 2020-11-12T17:29:16.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3432e-05 2020-11-12T17:29:16.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620495+0000", 2020-11-12T17:29:16.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002919905 2020-11-12T17:29:16.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623415+0000", 2020-11-12T17:29:16.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9338999999999995e-05 2020-11-12T17:29:16.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623485+0000", 2020-11-12T17:29:16.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999 2020-11-12T17:29:16.504 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.504 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.504 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.504 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26040 5.0 e144/135 5:0f4f1556:::benchmark_data_smithi036_24110_object3254:head v 144'1616, mlcod=144'1611)", 2020-11-12T17:29:16.505 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:29:16.505 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 121.657470363, 2020-11-12T17:29:16.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999, 2020-11-12T17:29:16.505 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.505 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.505 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:29:16.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:29:16.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:29:16.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.507 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675665+0000", 2020-11-12T17:29:16.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5723000000000006e-05 2020-11-12T17:29:16.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.508 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675751+0000", 2020-11-12T17:29:16.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28004843800000001 2020-11-12T17:29:16.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.508 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955800+0000", 2020-11-12T17:29:16.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4329999999999997e-06 2020-11-12T17:29:16.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955804+0000", 2020-11-12T17:29:16.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8045000000000003e-05 2020-11-12T17:29:16.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955872+0000", 2020-11-12T17:29:16.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9106999999999997e-05 2020-11-12T17:29:16.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955911+0000", 2020-11-12T17:29:16.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001589479 2020-11-12T17:29:16.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957501+0000", 2020-11-12T17:29:16.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7602999999999998e-05 2020-11-12T17:29:16.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957548+0000", 2020-11-12T17:29:16.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999 2020-11-12T17:29:16.512 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.512 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.512 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.513 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26152 5.7 e144/135 5:e84d984e:::benchmark_data_smithi036_24110_object3268:head v 144'1448, mlcod=144'1443)", 2020-11-12T17:29:16.513 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:29:16.513 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 121.54286501999999, 2020-11-12T17:29:16.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003, 2020-11-12T17:29:16.513 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.514 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.514 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:29:16.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:29:16.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:29:16.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790267+0000", 2020-11-12T17:29:16.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010217000000000001 2020-11-12T17:29:16.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790369+0000", 2020-11-12T17:29:16.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38220455399999997 2020-11-12T17:29:16.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172574+0000", 2020-11-12T17:29:16.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5129999999999998e-06 2020-11-12T17:29:16.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.518 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172578+0000", 2020-11-12T17:29:16.518 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8815999999999999e-05 2020-11-12T17:29:16.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.518 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172657+0000", 2020-11-12T17:29:16.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1084000000000003e-05 2020-11-12T17:29:16.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.519 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.519 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172688+0000", 2020-11-12T17:29:16.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013615529999999999 2020-11-12T17:29:16.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174050+0000", 2020-11-12T17:29:16.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4009000000000002e-05 2020-11-12T17:29:16.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174124+0000", 2020-11-12T17:29:16.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003 2020-11-12T17:29:16.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.521 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.521 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35656 5.0 e149/135 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head v 149'2136, mlcod=149'2128)", 2020-11-12T17:29:16.521 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:29:16.522 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 111.212109492, 2020-11-12T17:29:16.522 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999, 2020-11-12T17:29:16.522 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.522 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.522 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.522 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:29:16.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.523 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.523 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:29:16.523 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:29:16.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.524 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121021+0000", 2020-11-12T17:29:16.524 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5146e-05 2020-11-12T17:29:16.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.524 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121116+0000", 2020-11-12T17:29:16.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35999075400000002 2020-11-12T17:29:16.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.525 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.525 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481107+0000", 2020-11-12T17:29:16.525 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4069999999999998e-06 2020-11-12T17:29:16.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.526 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481113+0000", 2020-11-12T17:29:16.526 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1341999999999997e-05 2020-11-12T17:29:16.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.526 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481165+0000", 2020-11-12T17:29:16.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1209999999999999e-05 2020-11-12T17:29:16.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.527 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.527 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481186+0000", 2020-11-12T17:29:16.527 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018927709999999999 2020-11-12T17:29:16.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.528 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483079+0000", 2020-11-12T17:29:16.528 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:29:16.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.528 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.529 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483131+0000", 2020-11-12T17:29:16.529 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999 2020-11-12T17:29:16.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.529 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.529 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:36416 5.0 e149/135 5:05125f34:::benchmark_data_smithi036_24110_object4551:head v 149'2208, mlcod=149'2200)", 2020-11-12T17:29:16.530 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:29:16.530 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 110.35348548499999, 2020-11-12T17:29:16.530 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002, 2020-11-12T17:29:16.530 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.530 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.530 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.531 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:29:16.531 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.531 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:29:16.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:29:16.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.532 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.532 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979647+0000", 2020-11-12T17:29:16.532 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7427000000000001e-05 2020-11-12T17:29:16.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979744+0000", 2020-11-12T17:29:16.533 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35673495900000002 2020-11-12T17:29:16.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.533 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.533 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336479+0000", 2020-11-12T17:29:16.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7480000000000001e-06 2020-11-12T17:29:16.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.534 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.534 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336484+0000", 2020-11-12T17:29:16.534 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5201000000000003e-05 2020-11-12T17:29:16.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336529+0000", 2020-11-12T17:29:16.535 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6535999999999999e-05 2020-11-12T17:29:16.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.535 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.535 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336545+0000", 2020-11-12T17:29:16.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003854597 2020-11-12T17:29:16.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.536 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.536 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340400+0000", 2020-11-12T17:29:16.536 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5745000000000001e-05 2020-11-12T17:29:16.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.537 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.537 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340476+0000", 2020-11-12T17:29:16.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002 2020-11-12T17:29:16.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.537 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.538 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:48936 5.7 e157/135 5:ebe6a5f2:::benchmark_data_smithi036_24110_object6116:head v 157'2960, mlcod=157'2956)", 2020-11-12T17:29:16.538 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:29:16.538 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.378739460999995, 2020-11-12T17:29:16.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003, 2020-11-12T17:29:16.538 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.538 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.539 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:29:16.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:29:16.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:16.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954403+0000", 2020-11-12T17:29:16.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0948e-05 2020-11-12T17:29:16.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954464+0000", 2020-11-12T17:29:16.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32108862399999999 2020-11-12T17:29:16.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275553+0000", 2020-11-12T17:29:16.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2849999999999997e-06 2020-11-12T17:29:16.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275560+0000", 2020-11-12T17:29:16.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8199999999999999e-05 2020-11-12T17:29:16.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275608+0000", 2020-11-12T17:29:16.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6923999999999998e-05 2020-11-12T17:29:16.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275635+0000", 2020-11-12T17:29:16.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036371630000000001 2020-11-12T17:29:16.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279272+0000", 2020-11-12T17:29:16.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0575000000000002e-05 2020-11-12T17:29:16.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279333+0000", 2020-11-12T17:29:16.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003 2020-11-12T17:29:16.545 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.545 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.545 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.546 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:52816 5.8 e159/135 5:1b562a6a:::benchmark_data_smithi036_24110_object6601:head v 159'3312, mlcod=159'3307)", 2020-11-12T17:29:16.546 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:29:16.546 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 90.458732205999993, 2020-11-12T17:29:16.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002, 2020-11-12T17:29:16.546 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.546 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.547 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:29:16.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:29:16.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:16.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874411+0000", 2020-11-12T17:29:16.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5874000000000001e-05 2020-11-12T17:29:16.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874467+0000", 2020-11-12T17:29:16.549 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.369977422 2020-11-12T17:29:16.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244444+0000", 2020-11-12T17:29:16.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.797e-06 2020-11-12T17:29:16.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244449+0000", 2020-11-12T17:29:16.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9617999999999994e-05 2020-11-12T17:29:16.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244549+0000", 2020-11-12T17:29:16.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6636999999999999e-05 2020-11-12T17:29:16.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244575+0000", 2020-11-12T17:29:16.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002465971 2020-11-12T17:29:16.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247041+0000", 2020-11-12T17:29:16.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1267999999999995e-05 2020-11-12T17:29:16.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247123+0000", 2020-11-12T17:29:16.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002 2020-11-12T17:29:16.553 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.553 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.554 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.555 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59192 5.0 e168/135 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head v 168'3640, mlcod=168'3635)", 2020-11-12T17:29:16.555 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:29:16.555 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.518993113999997, 2020-11-12T17:29:16.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998, 2020-11-12T17:29:16.555 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.555 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.556 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:29:16.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:29:16.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:16.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814137+0000", 2020-11-12T17:29:16.558 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135962 2020-11-12T17:29:16.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814273+0000", 2020-11-12T17:29:16.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46601277200000002 2020-11-12T17:29:16.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280285+0000", 2020-11-12T17:29:16.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0178e-05 2020-11-12T17:29:16.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280295+0000", 2020-11-12T17:29:16.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4779999999999999e-05 2020-11-12T17:29:16.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280370+0000", 2020-11-12T17:29:16.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2793999999999998e-05 2020-11-12T17:29:16.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280403+0000", 2020-11-12T17:29:16.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002761753 2020-11-12T17:29:16.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283165+0000", 2020-11-12T17:29:16.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3588e-05 2020-11-12T17:29:16.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283248+0000", 2020-11-12T17:29:16.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998 2020-11-12T17:29:16.563 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.563 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.563 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.564 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:61880 5.7 e171/135 5:e7903c7f:::benchmark_data_smithi036_24110_object7734:head v 171'3720, mlcod=171'3715)", 2020-11-12T17:29:16.564 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:29:16.564 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 76.974580489999994, 2020-11-12T17:29:16.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002, 2020-11-12T17:29:16.564 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.564 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.564 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:29:16.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:29:16.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:29:16.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.566 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358563+0000", 2020-11-12T17:29:16.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8774000000000002e-05 2020-11-12T17:29:16.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358642+0000", 2020-11-12T17:29:16.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36108309599999999 2020-11-12T17:29:16.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719725+0000", 2020-11-12T17:29:16.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8320000000000002e-06 2020-11-12T17:29:16.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719731+0000", 2020-11-12T17:29:16.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5495999999999997e-05 2020-11-12T17:29:16.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719806+0000", 2020-11-12T17:29:16.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3250999999999997e-05 2020-11-12T17:29:16.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719840+0000", 2020-11-12T17:29:16.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030159739999999998 2020-11-12T17:29:16.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722856+0000", 2020-11-12T17:29:16.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7215e-05 2020-11-12T17:29:16.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722913+0000", 2020-11-12T17:29:16.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002 2020-11-12T17:29:16.573 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.573 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.574 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.574 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e173)", 2020-11-12T17:29:16.575 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:29:16.575 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.446113369000003, 2020-11-12T17:29:16.575 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003, 2020-11-12T17:29:16.575 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.575 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.575 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:16.576 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:16.576 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:16.576 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:29:16.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.576 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:29:16.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:29:16.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:29:16.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887020+0000", 2020-11-12T17:29:16.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1260999999999993e-05 2020-11-12T17:29:16.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887101+0000", 2020-11-12T17:29:16.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2444e-05 2020-11-12T17:29:16.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887113+0000", 2020-11-12T17:29:16.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7610000000000002e-06 2020-11-12T17:29:16.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887123+0000", 2020-11-12T17:29:16.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096366420000000008 2020-11-12T17:29:16.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896760+0000", 2020-11-12T17:29:16.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8652000000000005e-05 2020-11-12T17:29:16.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896838+0000", 2020-11-12T17:29:16.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108306 2020-11-12T17:29:16.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:16.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896947+0000", 2020-11-12T17:29:16.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001848639 2020-11-12T17:29:16.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:16.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.898795+0000", 2020-11-12T17:29:16.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50804395899999999 2020-11-12T17:29:16.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:16.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406839+0000", 2020-11-12T17:29:16.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3349000000000004e-05 2020-11-12T17:29:16.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406923+0000", 2020-11-12T17:29:16.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7622999999999998e-05 2020-11-12T17:29:16.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.585 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.585 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407010+0000", 2020-11-12T17:29:16.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003 2020-11-12T17:29:16.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.585 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.586 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.586 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63144 5.c e173/139 ondisk, result = 0)", 2020-11-12T17:29:16.586 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:29:16.586 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.432169948999999, 2020-11-12T17:29:16.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996, 2020-11-12T17:29:16.587 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.587 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:16.587 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:29:16.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:29:16.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:16.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900974+0000", 2020-11-12T17:29:16.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1072999999999998e-05 2020-11-12T17:29:16.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.901015+0000", 2020-11-12T17:29:16.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50574218299999996 2020-11-12T17:29:16.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406758+0000", 2020-11-12T17:29:16.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0649999999999999e-06 2020-11-12T17:29:16.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406766+0000", 2020-11-12T17:29:16.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1774999999999998e-05 2020-11-12T17:29:16.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406817+0000", 2020-11-12T17:29:16.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0681e-05 2020-11-12T17:29:16.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406828+0000", 2020-11-12T17:29:16.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000198078 2020-11-12T17:29:16.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.593 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.593 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407026+0000", 2020-11-12T17:29:16.593 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996 2020-11-12T17:29:16.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.593 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.594 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e173)", 2020-11-12T17:29:16.594 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:29:16.594 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 74.427442463999995, 2020-11-12T17:29:16.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013, 2020-11-12T17:29:16.594 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.594 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:29:16.594 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:16.595 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:16.595 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:16.595 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:29:16.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.595 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:29:16.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:29:16.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999471 2020-11-12T17:29:16.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905665+0000", 2020-11-12T17:29:16.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017430399999999999 2020-11-12T17:29:16.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905839+0000", 2020-11-12T17:29:16.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0282e-05 2020-11-12T17:29:16.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905859+0000", 2020-11-12T17:29:16.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4520000000000003e-06 2020-11-12T17:29:16.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905869+0000", 2020-11-12T17:29:16.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5303999999999999e-05 2020-11-12T17:29:16.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905914+0000", 2020-11-12T17:29:16.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6926999999999999e-05 2020-11-12T17:29:16.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:29:16.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905971+0000", 2020-11-12T17:29:16.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50097548000000003 2020-11-12T17:29:16.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406947+0000", 2020-11-12T17:29:16.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013 2020-11-12T17:29:16.601 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.601 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.602 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.602 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63511 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:29:16.602 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:29:16.602 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.855126213000005, 2020-11-12T17:29:16.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997, 2020-11-12T17:29:16.603 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.603 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.603 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:16.603 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:16.603 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:16.603 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63511 2020-11-12T17:29:16.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.604 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.604 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.604 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:29:16.604 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.605 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.605 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:29:16.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:29:16.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.477991+0000", 2020-11-12T17:29:16.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9875000000000003e-05 2020-11-12T17:29:16.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478081+0000", 2020-11-12T17:29:16.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3559999999999993e-06 2020-11-12T17:29:16.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478089+0000", 2020-11-12T17:29:16.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8300000000000003e-06 2020-11-12T17:29:16.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478094+0000", 2020-11-12T17:29:16.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055625520000000001 2020-11-12T17:29:16.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483657+0000", 2020-11-12T17:29:16.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118057 2020-11-12T17:29:16.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483775+0000", 2020-11-12T17:29:16.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019058000000000001 2020-11-12T17:29:16.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:16.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483965+0000", 2020-11-12T17:29:16.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052812179999999999 2020-11-12T17:29:16.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:16.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489246+0000", 2020-11-12T17:29:16.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32502241999999998 2020-11-12T17:29:16.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:16.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814269+0000", 2020-11-12T17:29:16.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1461000000000002e-05 2020-11-12T17:29:16.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814310+0000", 2020-11-12T17:29:16.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8736999999999999e-05 2020-11-12T17:29:16.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814339+0000", 2020-11-12T17:29:16.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997 2020-11-12T17:29:16.614 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.614 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.614 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.615 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63512 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:29:16.615 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:29:16.615 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.855036569000006, 2020-11-12T17:29:16.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002, 2020-11-12T17:29:16.615 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.615 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:16.615 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:16.616 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:16.616 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:16.616 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63512 2020-11-12T17:29:16.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.616 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:29:16.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:29:16.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:16.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478106+0000", 2020-11-12T17:29:16.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0413e-05 2020-11-12T17:29:16.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478156+0000", 2020-11-12T17:29:16.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9499999999999998e-06 2020-11-12T17:29:16.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478162+0000", 2020-11-12T17:29:16.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.225e-06 2020-11-12T17:29:16.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478165+0000", 2020-11-12T17:29:16.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080122779999999994 2020-11-12T17:29:16.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486178+0000", 2020-11-12T17:29:16.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001128 2020-11-12T17:29:16.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486291+0000", 2020-11-12T17:29:16.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024748499999999998 2020-11-12T17:29:16.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:16.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486538+0000", 2020-11-12T17:29:16.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034654350000000002 2020-11-12T17:29:16.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:16.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.490003+0000", 2020-11-12T17:29:16.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35059826799999999 2020-11-12T17:29:16.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:16.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840602+0000", 2020-11-12T17:29:16.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3192000000000003e-05 2020-11-12T17:29:16.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:16.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840645+0000", 2020-11-12T17:29:16.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2951999999999999e-05 2020-11-12T17:29:16.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.626 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.626 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840678+0000", 2020-11-12T17:29:16.626 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002 2020-11-12T17:29:16.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.626 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.627 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63511 5.c e174/139 ondisk, result = 0)", 2020-11-12T17:29:16.627 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:29:16.627 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.843502968999999, 2020-11-12T17:29:16.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002, 2020-11-12T17:29:16.627 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.628 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:16.628 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:29:16.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:29:16.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99998 2020-11-12T17:29:16.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489637+0000", 2020-11-12T17:29:16.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5010999999999999e-05 2020-11-12T17:29:16.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489692+0000", 2020-11-12T17:29:16.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32451660599999999 2020-11-12T17:29:16.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814209+0000", 2020-11-12T17:29:16.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3729999999999993e-06 2020-11-12T17:29:16.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814217+0000", 2020-11-12T17:29:16.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9755999999999997e-05 2020-11-12T17:29:16.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814257+0000", 2020-11-12T17:29:16.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2589999999999997e-06 2020-11-12T17:29:16.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814263+0000", 2020-11-12T17:29:16.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0548000000000002e-05 2020-11-12T17:29:16.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814344+0000", 2020-11-12T17:29:16.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002 2020-11-12T17:29:16.635 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.635 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.635 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.635 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "replica_scrub(pg: 5.0,from:0'0,to:164'3496,epoch:175/135,start:5:073087b9:::benchmark_data_smithi036_24110_object5847:0,end:5:07fd2517:::benchmark_data_smithi036_24110_object2426:0,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2020-11-12T17:29:16.635 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:29:16.636 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 69.001487183999998, 2020-11-12T17:29:16.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003, 2020-11-12T17:29:16.636 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.636 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:29:16.636 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:29:16.637 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.637 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.637 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:29:16.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:29:16.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.638 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.638 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.638 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331660+0000", 2020-11-12T17:29:16.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6072000000000003e-05 2020-11-12T17:29:16.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.639 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331696+0000", 2020-11-12T17:29:16.639 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73693106399999997 2020-11-12T17:29:16.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.639 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068627+0000", 2020-11-12T17:29:16.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6524999999999998e-05 2020-11-12T17:29:16.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068643+0000", 2020-11-12T17:29:16.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000180683 2020-11-12T17:29:16.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068824+0000", 2020-11-12T17:29:16.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101581 2020-11-12T17:29:16.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068926+0000", 2020-11-12T17:29:16.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003 2020-11-12T17:29:16.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.642 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.643 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:25432 6.e e203/190 ondisk, result = 0)", 2020-11-12T17:29:16.643 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:29:01.622580+0000", 2020-11-12T17:29:16.643 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 13.710580179999999, 2020-11-12T17:29:16.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27816144100000001, 2020-11-12T17:29:16.644 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:16.644 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:16.644 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:16.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:16.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622580+0000", 2020-11-12T17:29:16.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:16.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:16.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622580+0000", 2020-11-12T17:29:16.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:16.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:16.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622557+0000", 2020-11-12T17:29:16.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2597999999999999e-05 2020-11-12T17:29:16.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:16.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622619+0000", 2020-11-12T17:29:16.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27631449699999999 2020-11-12T17:29:16.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:16.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.898934+0000", 2020-11-12T17:29:16.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4849999999999998e-06 2020-11-12T17:29:16.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:16.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.898943+0000", 2020-11-12T17:29:16.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001572763 2020-11-12T17:29:16.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:16.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.900516+0000", 2020-11-12T17:29:16.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0876999999999999e-05 2020-11-12T17:29:16.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.649 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:16.649 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.900527+0000", 2020-11-12T17:29:16.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021447799999999999 2020-11-12T17:29:16.650 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:16.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:16.650 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:16.650 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.900741+0000", 2020-11-12T17:29:16.650 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27816144100000001 2020-11-12T17:29:16.650 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.650 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.651 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.651 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:16.651 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:16.651 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:16.652 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:29:16.654 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:16.628+0000 7f928515c700 -1 osd.7 209 handle_osd_map injecting map crc failure 2020-11-12T17:29:16.654 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 39 16 29904 29888 5.98661 0 - 0.0157766 2020-11-12T17:29:16.654 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:29:16.524983+0000 min lat: 0.00229077 max lat: 1.0374 avg lat: 0.0157766 2020-11-12T17:29:16.654 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:29:16.655 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 40 16 29904 29888 5.83694 0 - 0.0157766 2020-11-12T17:29:16.655 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:29:16.655 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:16.650+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:16.656 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:29:16.754 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:16.752+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:16.811 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:16.812 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:29:16.812 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:16.821 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:29:16.840 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:16.855 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:16.854+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:16.856 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:16.885 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:16.914 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:16.918 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:16.919 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:16.928 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:29:16.945 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:16.956 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:16.952+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:16.974 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:17.003 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:17.004 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:29:17.004 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:29:17.004 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:17.004 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:17.004 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:29:17.005 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:29:17.005 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:29:17.005 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:29:17.005 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:29:17.006 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:17.007 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:17.043 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:17.043 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:17.051 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:29:17.095 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:17.094+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:17.159 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:17.156+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:17.238 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:17.239 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:17.239 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:29:17.284 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:17.282+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:17.348 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:17.348 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:17.357 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:29:17.360 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:17.356+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:17.461 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:17.460+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:17.510 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:17.510 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:17.519 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:29:17.524 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 41 16 29904 29888 5.69457 0 - 0.0157766 2020-11-12T17:29:17.565 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:17.564+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:17.636 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:17.678 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:17.679 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:29:17.680 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:17.678+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:17.780 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:17.780+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:17.839 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:17.840 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:17.849 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:29:17.893 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:17.892+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:17.983 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:17.978+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:18.006 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:18.075 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:18.077 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:29:18.083 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:18.082+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:18.185 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:18.184+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:18.194 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:18.194 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:18.204 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:29:18.289 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:18.288+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:18.358 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:18.359 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:18.368 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:29:18.387 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:18.386+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:18.488 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:18.484+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:18.520 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:18.520 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:18.524 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 42 16 29904 29888 5.55899 0 - 0.0157766 2020-11-12T17:29:18.530 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:29:18.588 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:18.586+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:18.656 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:29:18.688 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:18.688 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:18.697 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:29:18.792 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:18.790+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:18.856 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:18.856 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:18.862 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:29:18.971 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:18.971 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:18.980 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:29:19.008 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:29:19.089 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:19.089 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:19.098 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:29:19.146 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:19.024+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:19.147 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:19.092+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:19.147 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:18.908+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:19.147 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:18.688+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:19.156 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:19.182 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:19.196 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:19.192+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:19.211 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:19.240 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:19.249 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:19.250 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:19.259 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:29:19.265 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:19.290 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:19.301 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:19.300+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:19.320 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:19.321 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:29:19.321 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:29:19.321 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:19.321 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:19.321 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:29:19.322 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:29:19.322 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:29:19.322 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:29:19.322 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:29:19.324 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:19.325 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:19.397 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:19.396+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:19.416 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:19.417 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:19.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:19.417 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:19.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.417 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:4448 3.f e24/20 ondisk, result = 0)", 2020-11-12T17:29:19.417 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:19.417 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 370.57109778400002, 2020-11-12T17:29:19.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003, 2020-11-12T17:29:19.418 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.418 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:19.418 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:19.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842447+0000", 2020-11-12T17:29:19.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:29:19.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842398+0000", 2020-11-12T17:29:19.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012291799999999999 2020-11-12T17:29:19.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:08.842521+0000", 2020-11-12T17:29:19.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57805849899999995 2020-11-12T17:29:19.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420579+0000", 2020-11-12T17:29:19.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6286e-05 2020-11-12T17:29:19.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420595+0000", 2020-11-12T17:29:19.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012769699999999999 2020-11-12T17:29:19.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420723+0000", 2020-11-12T17:29:19.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3651000000000001e-05 2020-11-12T17:29:19.423 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420747+0000", 2020-11-12T17:29:19.424 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00024626599999999998 2020-11-12T17:29:19.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.424 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.424 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:09.420993+0000", 2020-11-12T17:29:19.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854594800000003 2020-11-12T17:29:19.425 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.425 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.425 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.425 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.425 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.425 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:9880 3.d 3:b3637670:::benchmark_data_smithi036_14212_object1234:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:29:19.425 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:19.426 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 365.01090056200002, 2020-11-12T17:29:19.426 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995, 2020-11-12T17:29:19.426 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.426 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:19.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:19.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:19.427 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 9880 2020-11-12T17:29:19.427 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.427 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:19.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402644+0000", 2020-11-12T17:29:19.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:29:19.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402609+0000", 2020-11-12T17:29:19.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000106622 2020-11-12T17:29:19.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402715+0000", 2020-11-12T17:29:19.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6115000000000001e-05 2020-11-12T17:29:19.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402731+0000", 2020-11-12T17:29:19.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2799999999999992e-06 2020-11-12T17:29:19.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.402741+0000", 2020-11-12T17:29:19.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012349710000000001 2020-11-12T17:29:19.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.403976+0000", 2020-11-12T17:29:19.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9275000000000001e-05 2020-11-12T17:29:19.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404075+0000", 2020-11-12T17:29:19.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013852299999999999 2020-11-12T17:29:19.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:19.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.404213+0000", 2020-11-12T17:29:19.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043297020000000004 2020-11-12T17:29:19.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:19.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408543+0000", 2020-11-12T17:29:19.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83082766900000005 2020-11-12T17:29:19.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:19.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239371+0000", 2020-11-12T17:29:19.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9243999999999997e-05 2020-11-12T17:29:19.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239430+0000", 2020-11-12T17:29:19.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7218000000000006e-05 2020-11-12T17:29:19.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.435 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.435 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239497+0000", 2020-11-12T17:29:19.435 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83685306699999995 2020-11-12T17:29:19.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.436 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.436 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.436 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.436 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.436 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:9880 3.d e26/20 ondisk, result = 0)", 2020-11-12T17:29:19.436 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:19.437 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 365.00500823900001, 2020-11-12T17:29:19.437 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282, 2020-11-12T17:29:19.437 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.437 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:19.437 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.437 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.437 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.437 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:19.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408537+0000", 2020-11-12T17:29:19.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999881 2020-11-12T17:29:19.438 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408525+0000", 2020-11-12T17:29:19.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2384e-05 2020-11-12T17:29:19.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:14.408557+0000", 2020-11-12T17:29:19.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.83072090799999998 2020-11-12T17:29:19.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239278+0000", 2020-11-12T17:29:19.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9959999999999996e-06 2020-11-12T17:29:19.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239285+0000", 2020-11-12T17:29:19.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840999999999998e-05 2020-11-12T17:29:19.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239350+0000", 2020-11-12T17:29:19.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0755e-05 2020-11-12T17:29:19.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239360+0000", 2020-11-12T17:29:19.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000169364 2020-11-12T17:29:19.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:15.239530+0000", 2020-11-12T17:29:19.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.830993282 2020-11-12T17:29:19.443 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.443 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.444 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.444 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24584 3.d 3:b52196e3:::benchmark_data_smithi036_14212_object3072:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e45)", 2020-11-12T17:29:19.444 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:19.444 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 334.879017971, 2020-11-12T17:29:19.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001, 2020-11-12T17:29:19.445 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.445 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.445 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:19.445 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:19.445 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:19.445 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24584 2020-11-12T17:29:19.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.446 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:19.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534527+0000", 2020-11-12T17:29:19.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:19.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534511+0000", 2020-11-12T17:29:19.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5600999999999999e-05 2020-11-12T17:29:19.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.448 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.448 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534557+0000", 2020-11-12T17:29:19.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9839999999999998e-06 2020-11-12T17:29:19.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.449 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534563+0000", 2020-11-12T17:29:19.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.7999999999999999e-06 2020-11-12T17:29:19.449 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.449 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.449 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.534565+0000", 2020-11-12T17:29:19.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0055857329999999998 2020-11-12T17:29:19.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.450 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.450 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540151+0000", 2020-11-12T17:29:19.450 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011501 2020-11-12T17:29:19.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540266+0000", 2020-11-12T17:29:19.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012820900000000001 2020-11-12T17:29:19.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:19.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.540394+0000", 2020-11-12T17:29:19.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0011057440000000001 2020-11-12T17:29:19.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:19.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.541500+0000", 2020-11-12T17:29:19.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.37437928199999998 2020-11-12T17:29:19.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:19.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915879+0000", 2020-11-12T17:29:19.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9465000000000002e-05 2020-11-12T17:29:19.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915929+0000", 2020-11-12T17:29:19.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.1457e-05 2020-11-12T17:29:19.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915970+0000", 2020-11-12T17:29:19.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38144346800000001 2020-11-12T17:29:19.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.455 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.455 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.455 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:24984 3.d 3:b104785c:::benchmark_data_smithi036_14212_object3122:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e46)", 2020-11-12T17:29:19.455 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:19.456 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 334.49813575899998, 2020-11-12T17:29:19.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002, 2020-11-12T17:29:19.456 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.456 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.456 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:19.456 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:19.456 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:19.457 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 24984 2020-11-12T17:29:19.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.457 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:19.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915409+0000", 2020-11-12T17:29:19.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:19.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915380+0000", 2020-11-12T17:29:19.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2553999999999996e-05 2020-11-12T17:29:19.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915462+0000", 2020-11-12T17:29:19.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1401e-05 2020-11-12T17:29:19.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915474+0000", 2020-11-12T17:29:19.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7030000000000003e-06 2020-11-12T17:29:19.460 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.915479+0000", 2020-11-12T17:29:19.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063894889999999999 2020-11-12T17:29:19.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.461 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.461 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.921869+0000", 2020-11-12T17:29:19.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015201599999999999 2020-11-12T17:29:19.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.462 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.462 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.462 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922021+0000", 2020-11-12T17:29:19.462 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00022116400000000001 2020-11-12T17:29:19.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:19.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.922242+0000", 2020-11-12T17:29:19.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025681739999999999 2020-11-12T17:29:19.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:19.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.924810+0000", 2020-11-12T17:29:19.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.416715222 2020-11-12T17:29:19.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:19.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341526+0000", 2020-11-12T17:29:19.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1687000000000007e-05 2020-11-12T17:29:19.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341597+0000", 2020-11-12T17:29:19.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8717e-05 2020-11-12T17:29:19.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341656+0000", 2020-11-12T17:29:19.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42624689300000002 2020-11-12T17:29:19.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.466 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.466 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.467 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:24984 3.d e46/20 ondisk, result = 0)", 2020-11-12T17:29:19.467 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:19.467 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 334.48658263900001, 2020-11-12T17:29:19.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002, 2020-11-12T17:29:19.467 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.467 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:19.468 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:19.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926962+0000", 2020-11-12T17:29:19.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:19.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926932+0000", 2020-11-12T17:29:19.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4542999999999995e-05 2020-11-12T17:29:19.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:44.926996+0000", 2020-11-12T17:29:19.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41443695400000002 2020-11-12T17:29:19.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341433+0000", 2020-11-12T17:29:19.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2799999999999998e-06 2020-11-12T17:29:19.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341440+0000", 2020-11-12T17:29:19.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2062000000000003e-05 2020-11-12T17:29:19.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341502+0000", 2020-11-12T17:29:19.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1753000000000001e-05 2020-11-12T17:29:19.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341514+0000", 2020-11-12T17:29:19.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014893 2020-11-12T17:29:19.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:45.341663+0000", 2020-11-12T17:29:19.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41470093600000002 2020-11-12T17:29:19.474 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.474 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.474 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.475 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:29992 3.d 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:29:19.475 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:19.475 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 329.41346245800003, 2020-11-12T17:29:19.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002, 2020-11-12T17:29:19.475 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.475 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:19.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:19.476 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:19.476 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 29992 2020-11-12T17:29:19.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.476 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:19.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000082+0000", 2020-11-12T17:29:19.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999661 2020-11-12T17:29:19.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000048+0000", 2020-11-12T17:29:19.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010264699999999999 2020-11-12T17:29:19.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000151+0000", 2020-11-12T17:29:19.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7694999999999999e-05 2020-11-12T17:29:19.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000169+0000", 2020-11-12T17:29:19.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5649999999999998e-06 2020-11-12T17:29:19.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.000175+0000", 2020-11-12T17:29:19.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048657179999999998 2020-11-12T17:29:19.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005041+0000", 2020-11-12T17:29:19.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7581000000000001e-05 2020-11-12T17:29:19.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005119+0000", 2020-11-12T17:29:19.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015193100000000001 2020-11-12T17:29:19.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:19.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005271+0000", 2020-11-12T17:29:19.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013975700000000001 2020-11-12T17:29:19.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:19.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.006668+0000", 2020-11-12T17:29:19.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.455506627 2020-11-12T17:29:19.483 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:19.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462175+0000", 2020-11-12T17:29:19.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.781e-05 2020-11-12T17:29:19.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462273+0000", 2020-11-12T17:29:19.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8693e-05 2020-11-12T17:29:19.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.462351+0000", 2020-11-12T17:29:19.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46226894200000002 2020-11-12T17:29:19.485 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.485 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.485 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.486 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:44272 4.0 e91/69 4:04f83045:::benchmark_data_smithi036_18856_object5533:head v 91'2816, mlcod=91'2810)", 2020-11-12T17:29:19.486 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:19.486 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 222.702638065, 2020-11-12T17:29:19.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001, 2020-11-12T17:29:19.486 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.487 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.487 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:19.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710907+0000", 2020-11-12T17:29:19.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:19.488 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710878+0000", 2020-11-12T17:29:19.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100579 2020-11-12T17:29:19.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.489 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.489 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:36.710978+0000", 2020-11-12T17:29:19.489 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38201987300000001 2020-11-12T17:29:19.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.092998+0000", 2020-11-12T17:29:19.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5289999999999999e-06 2020-11-12T17:29:19.490 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.490 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.490 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.490 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093004+0000", 2020-11-12T17:29:19.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8542999999999999e-05 2020-11-12T17:29:19.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.491 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.491 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093052+0000", 2020-11-12T17:29:19.491 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2999000000000001e-05 2020-11-12T17:29:19.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.491 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.093075+0000", 2020-11-12T17:29:19.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019786259999999998 2020-11-12T17:29:19.492 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095054+0000", 2020-11-12T17:29:19.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1694999999999998e-05 2020-11-12T17:29:19.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:37.095115+0000", 2020-11-12T17:29:19.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38420865900000001 2020-11-12T17:29:19.493 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.493 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.494 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.494 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:48736 4.6 e94/69 4:68137e00:::benchmark_data_smithi036_18856_object6091:head v 94'2872, mlcod=94'2865)", 2020-11-12T17:29:19.494 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:19.494 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 217.37369554, 2020-11-12T17:29:19.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996, 2020-11-12T17:29:19.495 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.495 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.495 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:19.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039849+0000", 2020-11-12T17:29:19.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999681 2020-11-12T17:29:19.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039817+0000", 2020-11-12T17:29:19.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4356000000000003e-05 2020-11-12T17:29:19.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.039902+0000", 2020-11-12T17:29:19.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61026060699999995 2020-11-12T17:29:19.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650162+0000", 2020-11-12T17:29:19.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6060000000000002e-06 2020-11-12T17:29:19.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650168+0000", 2020-11-12T17:29:19.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2852999999999997e-05 2020-11-12T17:29:19.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650221+0000", 2020-11-12T17:29:19.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5854e-05 2020-11-12T17:29:19.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.650247+0000", 2020-11-12T17:29:19.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0024265329999999998 2020-11-12T17:29:19.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652673+0000", 2020-11-12T17:29:19.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4002999999999999e-05 2020-11-12T17:29:19.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:42.652717+0000", 2020-11-12T17:29:19.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61286795699999996 2020-11-12T17:29:19.502 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.502 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.502 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.503 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:60288 4.6 e102/69 4:6059676a:::benchmark_data_smithi036_18856_object7535:head v 102'3472, mlcod=102'3466)", 2020-11-12T17:29:19.503 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:19.503 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 202.77918768200001, 2020-11-12T17:29:19.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998, 2020-11-12T17:29:19.503 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.503 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.503 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:19.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.504 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.504 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.504 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634357+0000", 2020-11-12T17:29:19.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999862 2020-11-12T17:29:19.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.505 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.505 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.505 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634344+0000", 2020-11-12T17:29:19.505 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8226000000000002e-05 2020-11-12T17:29:19.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:56.634392+0000", 2020-11-12T17:29:19.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40425345099999999 2020-11-12T17:29:19.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038645+0000", 2020-11-12T17:29:19.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8679999999999999e-06 2020-11-12T17:29:19.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038653+0000", 2020-11-12T17:29:19.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3458000000000002e-05 2020-11-12T17:29:19.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038707+0000", 2020-11-12T17:29:19.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8493e-05 2020-11-12T17:29:19.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.038735+0000", 2020-11-12T17:29:19.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023806779999999998 2020-11-12T17:29:19.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041116+0000", 2020-11-12T17:29:19.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013606499999999999 2020-11-12T17:29:19.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:57.041252+0000", 2020-11-12T17:29:19.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40689462999999998 2020-11-12T17:29:19.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.510 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.510 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.511 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63288 4.0 e104/69 4:07b356c2:::benchmark_data_smithi036_18856_object7910:head v 104'3976, mlcod=104'3970)", 2020-11-12T17:29:19.511 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:19.511 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 198.577112554, 2020-11-12T17:29:19.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515, 2020-11-12T17:29:19.511 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.511 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.512 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:19.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836432+0000", 2020-11-12T17:29:19.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:19.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836415+0000", 2020-11-12T17:29:19.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9227000000000001e-05 2020-11-12T17:29:19.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:00.836474+0000", 2020-11-12T17:29:19.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.38325688299999999 2020-11-12T17:29:19.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219731+0000", 2020-11-12T17:29:19.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.9900000000000002e-06 2020-11-12T17:29:19.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219737+0000", 2020-11-12T17:29:19.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5667000000000002e-05 2020-11-12T17:29:19.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219783+0000", 2020-11-12T17:29:19.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6626999999999999e-05 2020-11-12T17:29:19.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.219800+0000", 2020-11-12T17:29:19.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0025126509999999999 2020-11-12T17:29:19.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222312+0000", 2020-11-12T17:29:19.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.5500999999999997e-05 2020-11-12T17:29:19.517 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.518 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.518 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.222358+0000", 2020-11-12T17:29:19.518 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.385925515 2020-11-12T17:29:19.518 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.518 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.518 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.519 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.519 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.519 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:70792 4.a e109/69 4:589cce14:::benchmark_data_smithi036_18856_object8848:head v 109'4400, mlcod=109'4392)", 2020-11-12T17:29:19.519 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:19.519 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 186.53507015299999, 2020-11-12T17:29:19.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001, 2020-11-12T17:29:19.519 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.520 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.520 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.520 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.520 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.520 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:19.520 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.520 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878475+0000", 2020-11-12T17:29:19.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999795 2020-11-12T17:29:19.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878454+0000", 2020-11-12T17:29:19.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6774999999999996e-05 2020-11-12T17:29:19.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:12.878531+0000", 2020-11-12T17:29:19.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.397338311 2020-11-12T17:29:19.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275869+0000", 2020-11-12T17:29:19.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5069999999999997e-06 2020-11-12T17:29:19.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275876+0000", 2020-11-12T17:29:19.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9323999999999997e-05 2020-11-12T17:29:19.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275925+0000", 2020-11-12T17:29:19.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9796000000000002e-05 2020-11-12T17:29:19.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.275945+0000", 2020-11-12T17:29:19.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0026010080000000001 2020-11-12T17:29:19.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278546+0000", 2020-11-12T17:29:19.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:29:19.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:13.278599+0000", 2020-11-12T17:29:19.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.40012414400000001 2020-11-12T17:29:19.527 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.527 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.527 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.528 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11902 5.d e133/127 5:bd7ffeaf:::benchmark_data_smithi036_24110_object1487:head v 133'862, mlcod=133'858)", 2020-11-12T17:29:19.528 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:19.528 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 142.45326926800001, 2020-11-12T17:29:19.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999, 2020-11-12T17:29:19.528 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.528 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.529 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:19.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960276+0000", 2020-11-12T17:29:19.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:19.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960259+0000", 2020-11-12T17:29:19.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1788e-05 2020-11-12T17:29:19.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.960311+0000", 2020-11-12T17:29:19.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42954743400000001 2020-11-12T17:29:19.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389858+0000", 2020-11-12T17:29:19.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9640000000000003e-06 2020-11-12T17:29:19.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.532 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.532 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389866+0000", 2020-11-12T17:29:19.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011277000000000001 2020-11-12T17:29:19.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.533 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.533 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389979+0000", 2020-11-12T17:29:19.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8322000000000001e-05 2020-11-12T17:29:19.533 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.534 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.390007+0000", 2020-11-12T17:29:19.534 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004079063 2020-11-12T17:29:19.534 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.534 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.534 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394086+0000", 2020-11-12T17:29:19.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5534000000000001e-05 2020-11-12T17:29:19.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.394142+0000", 2020-11-12T17:29:19.535 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43386634699999999 2020-11-12T17:29:19.535 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.536 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.536 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.536 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:31336 5.9 5:9690cfd0:::benchmark_data_smithi036_24110_object3916:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e146)", 2020-11-12T17:29:19.536 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:19.536 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 120.19419929, 2020-11-12T17:29:19.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341, 2020-11-12T17:29:19.537 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.537 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.537 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:19.537 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:19.537 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:19.537 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 31336 2020-11-12T17:29:19.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.538 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:19.538 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219346+0000", 2020-11-12T17:29:19.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:19.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219327+0000", 2020-11-12T17:29:19.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1297000000000005e-05 2020-11-12T17:29:19.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219398+0000", 2020-11-12T17:29:19.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8937000000000002e-05 2020-11-12T17:29:19.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219457+0000", 2020-11-12T17:29:19.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:29:19.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.219463+0000", 2020-11-12T17:29:19.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004657731 2020-11-12T17:29:19.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224121+0000", 2020-11-12T17:29:19.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2515000000000006e-05 2020-11-12T17:29:19.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224193+0000", 2020-11-12T17:29:19.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012471100000000001 2020-11-12T17:29:19.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:19.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.224318+0000", 2020-11-12T17:29:19.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0046443939999999996 2020-11-12T17:29:19.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:19.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.228962+0000", 2020-11-12T17:29:19.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41686097 2020-11-12T17:29:19.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:19.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645823+0000", 2020-11-12T17:29:19.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9300000000000002e-05 2020-11-12T17:29:19.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645912+0000", 2020-11-12T17:29:19.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6539999999999996e-05 2020-11-12T17:29:19.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645989+0000", 2020-11-12T17:29:19.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42664341 2020-11-12T17:29:19.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.546 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.546 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.547 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.547 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.547 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:31336 5.9 e146/127 ondisk, result = 0)", 2020-11-12T17:29:19.547 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:19.547 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 120.184374789, 2020-11-12T17:29:19.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001, 2020-11-12T17:29:19.547 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.547 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:19.548 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.548 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.548 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:19.548 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229170+0000", 2020-11-12T17:29:19.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:29:19.549 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.549 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229147+0000", 2020-11-12T17:29:19.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3491000000000006e-05 2020-11-12T17:29:19.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.229211+0000", 2020-11-12T17:29:19.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41382245299999998 2020-11-12T17:29:19.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643033+0000", 2020-11-12T17:29:19.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8760000000000002e-06 2020-11-12T17:29:19.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.643039+0000", 2020-11-12T17:29:19.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027664650000000001 2020-11-12T17:29:19.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645805+0000", 2020-11-12T17:29:19.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2199999999999998e-06 2020-11-12T17:29:19.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.645815+0000", 2020-11-12T17:29:19.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018868499999999999 2020-11-12T17:29:19.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:19.646003+0000", 2020-11-12T17:29:19.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41683336900000001 2020-11-12T17:29:19.554 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.554 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.554 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.555 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:62696 5.d e172/127 5:b48586d1:::benchmark_data_smithi036_24110_object7836:head v 172'3888, mlcod=172'3882)", 2020-11-12T17:29:19.555 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:19.555 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 79.839118956999997, 2020-11-12T17:29:19.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005, 2020-11-12T17:29:19.555 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.555 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.555 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:19.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574426+0000", 2020-11-12T17:29:19.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999504 2020-11-12T17:29:19.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.557 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574376+0000", 2020-11-12T17:29:19.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017051499999999999 2020-11-12T17:29:19.557 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.558 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.558 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.574547+0000", 2020-11-12T17:29:19.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70638505799999995 2020-11-12T17:29:19.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280932+0000", 2020-11-12T17:29:19.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1e-05 2020-11-12T17:29:19.559 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.280943+0000", 2020-11-12T17:29:19.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100991 2020-11-12T17:29:19.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281044+0000", 2020-11-12T17:29:19.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8789999999999999e-05 2020-11-12T17:29:19.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.281092+0000", 2020-11-12T17:29:19.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047981229999999996 2020-11-12T17:29:19.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.285891+0000", 2020-11-12T17:29:19.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011945 2020-11-12T17:29:19.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.286010+0000", 2020-11-12T17:29:19.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71158415500000005 2020-11-12T17:29:19.563 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.563 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.563 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.563 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:63136 5.d e173/127 5:b5ba4678:::benchmark_data_smithi036_24110_object7891:head v 173'3912, mlcod=173'3907)", 2020-11-12T17:29:19.564 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:19.564 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 78.517442044000006, 2020-11-12T17:29:19.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002, 2020-11-12T17:29:19.564 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.564 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.564 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:19.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896103+0000", 2020-11-12T17:29:19.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999969 2020-11-12T17:29:19.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896072+0000", 2020-11-12T17:29:19.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101572 2020-11-12T17:29:19.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.896173+0000", 2020-11-12T17:29:19.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57833769599999996 2020-11-12T17:29:19.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474511+0000", 2020-11-12T17:29:19.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3989999999999998e-06 2020-11-12T17:29:19.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.568 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.568 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.568 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474518+0000", 2020-11-12T17:29:19.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001036 2020-11-12T17:29:19.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.569 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474622+0000", 2020-11-12T17:29:19.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4888e-05 2020-11-12T17:29:19.569 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.569 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.474647+0000", 2020-11-12T17:29:19.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028874719999999999 2020-11-12T17:29:19.570 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477534+0000", 2020-11-12T17:29:19.570 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2294999999999999e-05 2020-11-12T17:29:19.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:01.477597+0000", 2020-11-12T17:29:19.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58149388000000002 2020-11-12T17:29:19.571 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.571 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.572 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.572 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:65600 5.9 e178/151 5:9717b049:::benchmark_data_smithi036_24110_object8199:head v 178'3864, mlcod=178'3859)", 2020-11-12T17:29:19.572 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:19.572 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 66.435920178000003, 2020-11-12T17:29:19.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998, 2020-11-12T17:29:19.573 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.573 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.573 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:19.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977625+0000", 2020-11-12T17:29:19.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:19.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977606+0000", 2020-11-12T17:29:19.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5215999999999994e-05 2020-11-12T17:29:19.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.977671+0000", 2020-11-12T17:29:19.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47547426999999998 2020-11-12T17:29:19.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453146+0000", 2020-11-12T17:29:19.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5554e-05 2020-11-12T17:29:19.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453161+0000", 2020-11-12T17:29:19.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.5624000000000001e-05 2020-11-12T17:29:19.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453217+0000", 2020-11-12T17:29:19.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7397999999999998e-05 2020-11-12T17:29:19.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.453234+0000", 2020-11-12T17:29:19.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030543279999999998 2020-11-12T17:29:19.578 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.578 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456289+0000", 2020-11-12T17:29:19.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6605000000000004e-05 2020-11-12T17:29:19.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.579 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.579 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:13.456355+0000", 2020-11-12T17:29:19.580 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47873059899999998 2020-11-12T17:29:19.580 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.580 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.580 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.580 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.580 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.580 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3791 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'231, mlcod=192'223)", 2020-11-12T17:29:19.580 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:19.581 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.976078135999998, 2020-11-12T17:29:19.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001, 2020-11-12T17:29:19.581 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.581 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.581 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:19.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437467+0000", 2020-11-12T17:29:19.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:19.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437443+0000", 2020-11-12T17:29:19.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1434999999999995e-05 2020-11-12T17:29:19.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437525+0000", 2020-11-12T17:29:19.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42555852399999999 2020-11-12T17:29:19.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863083+0000", 2020-11-12T17:29:19.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4397e-05 2020-11-12T17:29:19.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863098+0000", 2020-11-12T17:29:19.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019535099999999999 2020-11-12T17:29:19.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863293+0000", 2020-11-12T17:29:19.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4679999999999996e-05 2020-11-12T17:29:19.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.863368+0000", 2020-11-12T17:29:19.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001951045 2020-11-12T17:29:19.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865319+0000", 2020-11-12T17:29:19.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016422 2020-11-12T17:29:19.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.865483+0000", 2020-11-12T17:29:19.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42801620200000001 2020-11-12T17:29:19.588 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.588 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.589 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.589 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.6159.0:3792 6.5 e192/190 6:afa7bcb1:::benchmark_data_smithi036_29033_object473:head v 192'232, mlcod=192'225)", 2020-11-12T17:29:19.589 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:19.589 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 39.975581507999998, 2020-11-12T17:29:19.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498, 2020-11-12T17:29:19.590 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:19.590 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.590 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:19.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:19.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:19.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:19.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:19.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437963+0000", 2020-11-12T17:29:19.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:19.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:19.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.437930+0000", 2020-11-12T17:29:19.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000108421 2020-11-12T17:29:19.592 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.592 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:19.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.438038+0000", 2020-11-12T17:29:19.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46508600999999999 2020-11-12T17:29:19.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.593 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:19.593 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903124+0000", 2020-11-12T17:29:19.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3366e-05 2020-11-12T17:29:19.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.594 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903138+0000", 2020-11-12T17:29:19.594 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9920000000000006e-05 2020-11-12T17:29:19.594 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:19.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903228+0000", 2020-11-12T17:29:19.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2246999999999997e-05 2020-11-12T17:29:19.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:19.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.903270+0000", 2020-11-12T17:29:19.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017774449999999999 2020-11-12T17:29:19.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:19.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905047+0000", 2020-11-12T17:29:19.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4606999999999997e-05 2020-11-12T17:29:19.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:19.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:19.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:19.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:39.905142+0000", 2020-11-12T17:29:19.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.467178498 2020-11-12T17:29:19.597 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.597 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.597 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.597 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:19.597 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:19.598 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:19.599 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 43 16 29904 29888 5.42971 0 - 0.0157766 2020-11-12T17:29:19.599 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:29:19.600 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:19.596+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:19.700 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:19.696+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:19.704 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:19.705 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:19.705 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:29:19.705 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:19.713 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:29:19.802 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:19.800+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:19.810 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:19.811 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:19.811 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:29:19.811 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:29:19.811 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:19.820 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:29:19.849 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:29:19.903 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:19.900+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:19.917 INFO:teuthology.orchestra.run.smithi036.stdout:6.f 2020-11-12T17:29:19.917 INFO:teuthology.orchestra.run.smithi036.stdout:2.c 2020-11-12T17:29:19.918 INFO:teuthology.orchestra.run.smithi036.stdout:2.3 2020-11-12T17:29:19.918 INFO:teuthology.orchestra.run.smithi036.stdout:6.8 2020-11-12T17:29:19.918 INFO:teuthology.orchestra.run.smithi036.stdout:2.e 2020-11-12T17:29:19.918 INFO:teuthology.orchestra.run.smithi036.stdout:2.1 2020-11-12T17:29:19.919 INFO:teuthology.orchestra.run.smithi036.stdout:2.10 2020-11-12T17:29:19.934 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:19.934 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:29:19.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:29:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:29:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79414 4.6 4:60cd86ce:::benchmark_data_smithi036_18856_object3025:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e118)", 2020-11-12T17:29:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:29:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 169.144986026, 2020-11-12T17:29:19.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998, 2020-11-12T17:29:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79414 2020-11-12T17:29:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:29:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784327+0000", 2020-11-12T17:29:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784303+0000", 2020-11-12T17:29:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4221999999999997e-05 2020-11-12T17:29:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784358+0000", 2020-11-12T17:29:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8389999999999996e-06 2020-11-12T17:29:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784366+0000", 2020-11-12T17:29:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2040000000000002e-06 2020-11-12T17:29:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784370+0000", 2020-11-12T17:29:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029216049999999999 2020-11-12T17:29:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787291+0000", 2020-11-12T17:29:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.3842e-05 2020-11-12T17:29:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:29:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787385+0000", 2020-11-12T17:29:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15210379399999999 2020-11-12T17:29:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.939489+0000", 2020-11-12T17:29:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00095422699999999998 2020-11-12T17:29:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:29:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940443+0000", 2020-11-12T17:29:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0092951600000000002 2020-11-12T17:29:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.949738+0000", 2020-11-12T17:29:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00060685800000000005 2020-11-12T17:29:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:29:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.950345+0000", 2020-11-12T17:29:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.093005117999999998 2020-11-12T17:29:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.043350+0000", 2020-11-12T17:29:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001029147 2020-11-12T17:29:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.044379+0000", 2020-11-12T17:29:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001543397 2020-11-12T17:29:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.045923+0000", 2020-11-12T17:29:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015442345999999999 2020-11-12T17:29:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.061365+0000", 2020-11-12T17:29:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0095990889999999999 2020-11-12T17:29:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.070964+0000", 2020-11-12T17:29:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000446744 2020-11-12T17:29:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.071411+0000", 2020-11-12T17:29:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001655534 2020-11-12T17:29:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.073066+0000", 2020-11-12T17:29:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28873966499999998 2020-11-12T17:29:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79425 4.6 4:6231d6c2:::benchmark_data_smithi036_18856_object3036:head [delete] snapc 0=[] ondisk+write+known_if_redirected e118)", 2020-11-12T17:29:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:29:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 169.14491253, 2020-11-12T17:29:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002, 2020-11-12T17:29:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79425 2020-11-12T17:29:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:29:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:19.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784400+0000", 2020-11-12T17:29:19.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:29:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784379+0000", 2020-11-12T17:29:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6152000000000001e-05 2020-11-12T17:29:19.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:19.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784426+0000", 2020-11-12T17:29:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6860000000000003e-06 2020-11-12T17:29:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784431+0000", 2020-11-12T17:29:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6460000000000002e-06 2020-11-12T17:29:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.784434+0000", 2020-11-12T17:29:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030643549999999999 2020-11-12T17:29:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787498+0000", 2020-11-12T17:29:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000100717 2020-11-12T17:29:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:29:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.787599+0000", 2020-11-12T17:29:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15298814699999999 2020-11-12T17:29:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.940587+0000", 2020-11-12T17:29:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00097205100000000003 2020-11-12T17:29:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for missing object", 2020-11-12T17:29:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.941559+0000", 2020-11-12T17:29:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.019466477999999999 2020-11-12T17:29:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961026+0000", 2020-11-12T17:29:19.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00058434100000000005 2020-11-12T17:29:19.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:29:19.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.961610+0000", 2020-11-12T17:29:19.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.13222599700000001 2020-11-12T17:29:19.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.093836+0000", 2020-11-12T17:29:19.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00089939299999999996 2020-11-12T17:29:19.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:19.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.094735+0000", 2020-11-12T17:29:19.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001382973 2020-11-12T17:29:19.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:19.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.096118+0000", 2020-11-12T17:29:19.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0046953350000000001 2020-11-12T17:29:19.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.970 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:19.970 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100814+0000", 2020-11-12T17:29:19.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9295000000000006e-05 2020-11-12T17:29:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.100893+0000", 2020-11-12T17:29:19.971 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00035136400000000001 2020-11-12T17:29:19.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:19.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.101244+0000", 2020-11-12T17:29:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0015508290000000001 2020-11-12T17:29:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.102795+0000", 2020-11-12T17:29:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.31839487300000002 2020-11-12T17:29:19.974 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:79491 4.4 4:2feb571e:::benchmark_data_smithi036_18856_object3102:head [delete] snapc 0=[] ondisk+write+known_if_redirected e119)", 2020-11-12T17:29:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:29:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 169.070900604, 2020-11-12T17:29:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458, 2020-11-12T17:29:19.976 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:19.977 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:19.978 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 79491 2020-11-12T17:29:19.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.978 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:19.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:19.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:29:19.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:19.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:19.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858412+0000", 2020-11-12T17:29:19.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:19.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.981 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:19.981 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858382+0000", 2020-11-12T17:29:19.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8493999999999998e-05 2020-11-12T17:29:19.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:19.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858450+0000", 2020-11-12T17:29:19.982 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:29:19.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:19.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858460+0000", 2020-11-12T17:29:19.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5260000000000004e-06 2020-11-12T17:29:19.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:19.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.858465+0000", 2020-11-12T17:29:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002042622 2020-11-12T17:29:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860507+0000", 2020-11-12T17:29:19.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5987000000000003e-05 2020-11-12T17:29:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for peered", 2020-11-12T17:29:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:30.860583+0000", 2020-11-12T17:29:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.264296631 2020-11-12T17:29:19.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.124880+0000", 2020-11-12T17:29:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00260079 2020-11-12T17:29:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for degraded object", 2020-11-12T17:29:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.127481+0000", 2020-11-12T17:29:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.015473191000000001 2020-11-12T17:29:19.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.142954+0000", 2020-11-12T17:29:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068121100000000003 2020-11-12T17:29:19.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.143635+0000", 2020-11-12T17:29:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014373840000000001 2020-11-12T17:29:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.992 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.145073+0000", 2020-11-12T17:29:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.020755122000000001 2020-11-12T17:29:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.165828+0000", 2020-11-12T17:29:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0047732520000000004 2020-11-12T17:29:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:19.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.170601+0000", 2020-11-12T17:29:19.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00046765100000000003 2020-11-12T17:29:19.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:19.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.171069+0000", 2020-11-12T17:29:19.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018080010000000001 2020-11-12T17:29:19.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:19.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:31.172877+0000", 2020-11-12T17:29:19.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.314464458 2020-11-12T17:29:19.997 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:19.997 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:19.997 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:19.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.997 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:14736 5.0 e137/135 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head v 137'896, mlcod=137'891)", 2020-11-12T17:29:19.997 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:29:19.998 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 137.86909803399999, 2020-11-12T17:29:19.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999, 2020-11-12T17:29:19.998 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:19.998 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:19.999 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:19.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:19.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:19.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:29:19.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:19.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:19.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060215+0000", 2020-11-12T17:29:20.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:29:20.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060202+0000", 2020-11-12T17:29:20.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8984000000000003e-05 2020-11-12T17:29:20.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.002 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060261+0000", 2020-11-12T17:29:20.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56005787699999998 2020-11-12T17:29:20.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620318+0000", 2020-11-12T17:29:20.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8369999999999999e-06 2020-11-12T17:29:20.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620325+0000", 2020-11-12T17:29:20.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012664800000000001 2020-11-12T17:29:20.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620452+0000", 2020-11-12T17:29:20.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3432e-05 2020-11-12T17:29:20.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.620495+0000", 2020-11-12T17:29:20.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002919905 2020-11-12T17:29:20.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623415+0000", 2020-11-12T17:29:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.9338999999999995e-05 2020-11-12T17:29:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623485+0000", 2020-11-12T17:29:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56326978999999999 2020-11-12T17:29:20.007 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26040 5.0 e144/135 5:0f4f1556:::benchmark_data_smithi036_24110_object3254:head v 144'1616, mlcod=144'1611)", 2020-11-12T17:29:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:29:20.008 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.25362309800001, 2020-11-12T17:29:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999, 2020-11-12T17:29:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:29:20.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675690+0000", 2020-11-12T17:29:20.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:29:20.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675665+0000", 2020-11-12T17:29:20.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5723000000000006e-05 2020-11-12T17:29:20.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.675751+0000", 2020-11-12T17:29:20.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28004843800000001 2020-11-12T17:29:20.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955800+0000", 2020-11-12T17:29:20.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.4329999999999997e-06 2020-11-12T17:29:20.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955804+0000", 2020-11-12T17:29:20.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8045000000000003e-05 2020-11-12T17:29:20.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955872+0000", 2020-11-12T17:29:20.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9106999999999997e-05 2020-11-12T17:29:20.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.955911+0000", 2020-11-12T17:29:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001589479 2020-11-12T17:29:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957501+0000", 2020-11-12T17:29:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7602999999999998e-05 2020-11-12T17:29:20.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.957548+0000", 2020-11-12T17:29:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.28185843999999999 2020-11-12T17:29:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:26152 5.7 e144/135 5:e84d984e:::benchmark_data_smithi036_24110_object3268:head v 144'1448, mlcod=144'1443)", 2020-11-12T17:29:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:29:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 126.139017755, 2020-11-12T17:29:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003, 2020-11-12T17:29:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.017 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.018 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:29:20.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790295+0000", 2020-11-12T17:29:20.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:29:20.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790267+0000", 2020-11-12T17:29:20.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010217000000000001 2020-11-12T17:29:20.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:13.790369+0000", 2020-11-12T17:29:20.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38220455399999997 2020-11-12T17:29:20.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172574+0000", 2020-11-12T17:29:20.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5129999999999998e-06 2020-11-12T17:29:20.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172578+0000", 2020-11-12T17:29:20.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8815999999999999e-05 2020-11-12T17:29:20.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172657+0000", 2020-11-12T17:29:20.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1084000000000003e-05 2020-11-12T17:29:20.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.172688+0000", 2020-11-12T17:29:20.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0013615529999999999 2020-11-12T17:29:20.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174050+0000", 2020-11-12T17:29:20.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4009000000000002e-05 2020-11-12T17:29:20.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:14.174124+0000", 2020-11-12T17:29:20.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38382859000000003 2020-11-12T17:29:20.026 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.026 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.027 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.027 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:35656 5.0 e149/135 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head v 149'2136, mlcod=149'2128)", 2020-11-12T17:29:20.027 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:29:20.027 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.808262227, 2020-11-12T17:29:20.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999, 2020-11-12T17:29:20.028 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.028 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.028 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:29:20.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121051+0000", 2020-11-12T17:29:20.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999704 2020-11-12T17:29:20.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121021+0000", 2020-11-12T17:29:20.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.5146e-05 2020-11-12T17:29:20.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.121116+0000", 2020-11-12T17:29:20.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35999075400000002 2020-11-12T17:29:20.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481107+0000", 2020-11-12T17:29:20.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4069999999999998e-06 2020-11-12T17:29:20.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481113+0000", 2020-11-12T17:29:20.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1341999999999997e-05 2020-11-12T17:29:20.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481165+0000", 2020-11-12T17:29:20.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.1209999999999999e-05 2020-11-12T17:29:20.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.481186+0000", 2020-11-12T17:29:20.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018927709999999999 2020-11-12T17:29:20.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483079+0000", 2020-11-12T17:29:20.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.2918999999999999e-05 2020-11-12T17:29:20.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.483131+0000", 2020-11-12T17:29:20.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36208089399999999 2020-11-12T17:29:20.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.035 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.036 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.036 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:36416 5.0 e149/135 5:05125f34:::benchmark_data_smithi036_24110_object4551:head v 149'2208, mlcod=149'2200)", 2020-11-12T17:29:20.036 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:29:20.036 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 114.94963822, 2020-11-12T17:29:20.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002, 2020-11-12T17:29:20.037 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.037 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.037 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:29:20.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979675+0000", 2020-11-12T17:29:20.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999719 2020-11-12T17:29:20.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979647+0000", 2020-11-12T17:29:20.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7427000000000001e-05 2020-11-12T17:29:20.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.979744+0000", 2020-11-12T17:29:20.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35673495900000002 2020-11-12T17:29:20.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336479+0000", 2020-11-12T17:29:20.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7480000000000001e-06 2020-11-12T17:29:20.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336484+0000", 2020-11-12T17:29:20.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5201000000000003e-05 2020-11-12T17:29:20.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336529+0000", 2020-11-12T17:29:20.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6535999999999999e-05 2020-11-12T17:29:20.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.336545+0000", 2020-11-12T17:29:20.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.003854597 2020-11-12T17:29:20.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340400+0000", 2020-11-12T17:29:20.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5745000000000001e-05 2020-11-12T17:29:20.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:25.340476+0000", 2020-11-12T17:29:20.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36080113400000002 2020-11-12T17:29:20.045 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.045 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.045 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.045 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:48936 5.7 e157/135 5:ebe6a5f2:::benchmark_data_smithi036_24110_object6116:head v 157'2960, mlcod=157'2956)", 2020-11-12T17:29:20.045 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:29:20.046 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 99.974892195999999, 2020-11-12T17:29:20.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003, 2020-11-12T17:29:20.046 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.046 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.046 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:29:20.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954421+0000", 2020-11-12T17:29:20.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:20.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954403+0000", 2020-11-12T17:29:20.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0948e-05 2020-11-12T17:29:20.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:39.954464+0000", 2020-11-12T17:29:20.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32108862399999999 2020-11-12T17:29:20.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275553+0000", 2020-11-12T17:29:20.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2849999999999997e-06 2020-11-12T17:29:20.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275560+0000", 2020-11-12T17:29:20.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8199999999999999e-05 2020-11-12T17:29:20.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275608+0000", 2020-11-12T17:29:20.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6923999999999998e-05 2020-11-12T17:29:20.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.275635+0000", 2020-11-12T17:29:20.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036371630000000001 2020-11-12T17:29:20.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279272+0000", 2020-11-12T17:29:20.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0575000000000002e-05 2020-11-12T17:29:20.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:40.279333+0000", 2020-11-12T17:29:20.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32491206900000003 2020-11-12T17:29:20.053 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.053 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.053 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.054 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:52816 5.8 e159/135 5:1b562a6a:::benchmark_data_smithi036_24110_object6601:head v 159'3312, mlcod=159'3307)", 2020-11-12T17:29:20.054 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:29:20.054 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 95.054884940999997, 2020-11-12T17:29:20.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002, 2020-11-12T17:29:20.054 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.055 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.055 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:29:20.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874428+0000", 2020-11-12T17:29:20.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:20.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874411+0000", 2020-11-12T17:29:20.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5874000000000001e-05 2020-11-12T17:29:20.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:44.874467+0000", 2020-11-12T17:29:20.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.369977422 2020-11-12T17:29:20.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244444+0000", 2020-11-12T17:29:20.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.797e-06 2020-11-12T17:29:20.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244449+0000", 2020-11-12T17:29:20.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9617999999999994e-05 2020-11-12T17:29:20.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244549+0000", 2020-11-12T17:29:20.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.6636999999999999e-05 2020-11-12T17:29:20.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.244575+0000", 2020-11-12T17:29:20.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002465971 2020-11-12T17:29:20.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247041+0000", 2020-11-12T17:29:20.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1267999999999995e-05 2020-11-12T17:29:20.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:45.247123+0000", 2020-11-12T17:29:20.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37269475200000002 2020-11-12T17:29:20.062 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.062 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.062 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.063 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59192 5.0 e168/135 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head v 168'3640, mlcod=168'3635)", 2020-11-12T17:29:20.063 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:29:20.063 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.115145849000001, 2020-11-12T17:29:20.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998, 2020-11-12T17:29:20.063 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.064 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.064 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:29:20.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814167+0000", 2020-11-12T17:29:20.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:20.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814137+0000", 2020-11-12T17:29:20.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135962 2020-11-12T17:29:20.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.814273+0000", 2020-11-12T17:29:20.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46601277200000002 2020-11-12T17:29:20.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280285+0000", 2020-11-12T17:29:20.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0178e-05 2020-11-12T17:29:20.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280295+0000", 2020-11-12T17:29:20.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4779999999999999e-05 2020-11-12T17:29:20.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280370+0000", 2020-11-12T17:29:20.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2793999999999998e-05 2020-11-12T17:29:20.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.280403+0000", 2020-11-12T17:29:20.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002761753 2020-11-12T17:29:20.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283165+0000", 2020-11-12T17:29:20.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3588e-05 2020-11-12T17:29:20.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283248+0000", 2020-11-12T17:29:20.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46908140199999998 2020-11-12T17:29:20.071 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.071 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.071 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.071 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:61880 5.7 e171/135 5:e7903c7f:::benchmark_data_smithi036_24110_object7734:head v 171'3720, mlcod=171'3715)", 2020-11-12T17:29:20.072 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:29:20.072 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 81.570733224999998, 2020-11-12T17:29:20.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002, 2020-11-12T17:29:20.072 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.072 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.072 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:29:20.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358580+0000", 2020-11-12T17:29:20.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999838 2020-11-12T17:29:20.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358563+0000", 2020-11-12T17:29:20.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8774000000000002e-05 2020-11-12T17:29:20.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.358642+0000", 2020-11-12T17:29:20.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36108309599999999 2020-11-12T17:29:20.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719725+0000", 2020-11-12T17:29:20.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8320000000000002e-06 2020-11-12T17:29:20.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719731+0000", 2020-11-12T17:29:20.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5495999999999997e-05 2020-11-12T17:29:20.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719806+0000", 2020-11-12T17:29:20.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.3250999999999997e-05 2020-11-12T17:29:20.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.077 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.077 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.719840+0000", 2020-11-12T17:29:20.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030159739999999998 2020-11-12T17:29:20.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722856+0000", 2020-11-12T17:29:20.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7215e-05 2020-11-12T17:29:20.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:58.722913+0000", 2020-11-12T17:29:20.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36433331800000002 2020-11-12T17:29:20.079 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.079 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.080 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.080 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e173)", 2020-11-12T17:29:20.080 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:29:20.080 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.042266104000007, 2020-11-12T17:29:20.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003, 2020-11-12T17:29:20.080 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.081 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:20.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:20.081 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:20.081 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:29:20.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.081 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:29:20.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887047+0000", 2020-11-12T17:29:20.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:29:20.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887020+0000", 2020-11-12T17:29:20.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1260999999999993e-05 2020-11-12T17:29:20.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887101+0000", 2020-11-12T17:29:20.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2444e-05 2020-11-12T17:29:20.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887113+0000", 2020-11-12T17:29:20.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7610000000000002e-06 2020-11-12T17:29:20.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.887123+0000", 2020-11-12T17:29:20.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096366420000000008 2020-11-12T17:29:20.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896760+0000", 2020-11-12T17:29:20.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8652000000000005e-05 2020-11-12T17:29:20.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.087 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896838+0000", 2020-11-12T17:29:20.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108306 2020-11-12T17:29:20.087 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.087 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.087 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:20.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.896947+0000", 2020-11-12T17:29:20.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001848639 2020-11-12T17:29:20.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:20.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.898795+0000", 2020-11-12T17:29:20.088 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50804395899999999 2020-11-12T17:29:20.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:20.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406839+0000", 2020-11-12T17:29:20.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3349000000000004e-05 2020-11-12T17:29:20.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406923+0000", 2020-11-12T17:29:20.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7622999999999998e-05 2020-11-12T17:29:20.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407010+0000", 2020-11-12T17:29:20.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.51996343300000003 2020-11-12T17:29:20.090 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.091 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.091 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.091 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63144 5.c e173/139 ondisk, result = 0)", 2020-11-12T17:29:20.091 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:29:20.092 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.028322684000003, 2020-11-12T17:29:20.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996, 2020-11-12T17:29:20.092 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.092 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:20.092 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:29:20.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900990+0000", 2020-11-12T17:29:20.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:20.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.900974+0000", 2020-11-12T17:29:20.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1072999999999998e-05 2020-11-12T17:29:20.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.901015+0000", 2020-11-12T17:29:20.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50574218299999996 2020-11-12T17:29:20.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406758+0000", 2020-11-12T17:29:20.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0649999999999999e-06 2020-11-12T17:29:20.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406766+0000", 2020-11-12T17:29:20.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1774999999999998e-05 2020-11-12T17:29:20.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.097 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.097 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406817+0000", 2020-11-12T17:29:20.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0681e-05 2020-11-12T17:29:20.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406828+0000", 2020-11-12T17:29:20.098 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000198078 2020-11-12T17:29:20.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.098 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.098 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.098 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.407026+0000", 2020-11-12T17:29:20.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50603604599999996 2020-11-12T17:29:20.099 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.099 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.099 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.099 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63144 5.c 5:3a355e09:::benchmark_data_smithi036_24110_object7892:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e173)", 2020-11-12T17:29:20.099 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:29:20.100 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 79.023595198999999, 2020-11-12T17:29:20.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013, 2020-11-12T17:29:20.100 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.100 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "delayed", 2020-11-12T17:29:20.100 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:20.100 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:20.100 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:20.101 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63144 2020-11-12T17:29:20.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.101 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:29:20.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905718+0000", 2020-11-12T17:29:20.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999471 2020-11-12T17:29:20.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905665+0000", 2020-11-12T17:29:20.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017430399999999999 2020-11-12T17:29:20.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905839+0000", 2020-11-12T17:29:20.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.0282e-05 2020-11-12T17:29:20.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905859+0000", 2020-11-12T17:29:20.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4520000000000003e-06 2020-11-12T17:29:20.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905869+0000", 2020-11-12T17:29:20.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.5303999999999999e-05 2020-11-12T17:29:20.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905914+0000", 2020-11-12T17:29:20.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6926999999999999e-05 2020-11-12T17:29:20.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for ondisk", 2020-11-12T17:29:20.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:00.905971+0000", 2020-11-12T17:29:20.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.50097548000000003 2020-11-12T17:29:20.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.406947+0000", 2020-11-12T17:29:20.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.501229013 2020-11-12T17:29:20.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.108 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.108 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.108 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63511 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:29:20.108 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:29:20.109 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 78.451278947999995, 2020-11-12T17:29:20.109 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997, 2020-11-12T17:29:20.109 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.109 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:20.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:20.110 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:20.110 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63511 2020-11-12T17:29:20.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.110 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:29:20.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478034+0000", 2020-11-12T17:29:20.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999571 2020-11-12T17:29:20.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.477991+0000", 2020-11-12T17:29:20.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9875000000000003e-05 2020-11-12T17:29:20.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478081+0000", 2020-11-12T17:29:20.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3559999999999993e-06 2020-11-12T17:29:20.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478089+0000", 2020-11-12T17:29:20.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8300000000000003e-06 2020-11-12T17:29:20.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478094+0000", 2020-11-12T17:29:20.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055625520000000001 2020-11-12T17:29:20.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483657+0000", 2020-11-12T17:29:20.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000118057 2020-11-12T17:29:20.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483775+0000", 2020-11-12T17:29:20.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00019058000000000001 2020-11-12T17:29:20.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:20.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.483965+0000", 2020-11-12T17:29:20.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0052812179999999999 2020-11-12T17:29:20.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:20.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489246+0000", 2020-11-12T17:29:20.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32502241999999998 2020-11-12T17:29:20.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:20.118 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814269+0000", 2020-11-12T17:29:20.118 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1461000000000002e-05 2020-11-12T17:29:20.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.118 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814310+0000", 2020-11-12T17:29:20.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.8736999999999999e-05 2020-11-12T17:29:20.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.119 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.119 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814339+0000", 2020-11-12T17:29:20.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33630514299999997 2020-11-12T17:29:20.120 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.120 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.120 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.120 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:63512 5.c 5:3c644fee:::benchmark_data_smithi036_24110_object7938:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e174)", 2020-11-12T17:29:20.120 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:29:20.121 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 78.451189303999996, 2020-11-12T17:29:20.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002, 2020-11-12T17:29:20.121 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.121 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:20.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:20.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:20.121 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:20.121 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63512 2020-11-12T17:29:20.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.122 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:20.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:20.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:29:20.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:20.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:20.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478124+0000", 2020-11-12T17:29:20.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:20.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:20.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478106+0000", 2020-11-12T17:29:20.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0413e-05 2020-11-12T17:29:20.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:20.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478156+0000", 2020-11-12T17:29:20.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9499999999999998e-06 2020-11-12T17:29:20.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:20.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478162+0000", 2020-11-12T17:29:20.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.225e-06 2020-11-12T17:29:20.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:20.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.478165+0000", 2020-11-12T17:29:20.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0080122779999999994 2020-11-12T17:29:20.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:20.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486178+0000", 2020-11-12T17:29:20.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0001128 2020-11-12T17:29:20.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:20.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486291+0000", 2020-11-12T17:29:20.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024748499999999998 2020-11-12T17:29:20.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:20.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.486538+0000", 2020-11-12T17:29:20.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0034654350000000002 2020-11-12T17:29:20.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:20.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.490003+0000", 2020-11-12T17:29:20.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35059826799999999 2020-11-12T17:29:20.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.129 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:20.129 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840602+0000", 2020-11-12T17:29:20.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.3192000000000003e-05 2020-11-12T17:29:20.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:20.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840645+0000", 2020-11-12T17:29:20.130 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2951999999999999e-05 2020-11-12T17:29:20.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:20.130 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.840678+0000", 2020-11-12T17:29:20.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36255435400000002 2020-11-12T17:29:20.131 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.131 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:20.131 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:20.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:20.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:20.131 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.5552.0:63511 5.c e174/139 ondisk, result = 0)", 2020-11-12T17:29:20.132 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:29:20.132 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 78.439655704000003, 2020-11-12T17:29:20.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002, 2020-11-12T17:29:20.132 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:20.334 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:25.238 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:25.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.239 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:25.239 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:29:25.239 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:25.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:25.240 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489657+0000", 2020-11-12T17:29:25.240 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99998 2020-11-12T17:29:25.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.240 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:25.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489637+0000", 2020-11-12T17:29:25.241 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5010999999999999e-05 2020-11-12T17:29:25.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.241 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:25.241 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.489692+0000", 2020-11-12T17:29:25.242 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32451660599999999 2020-11-12T17:29:25.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.242 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:25.242 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814209+0000", 2020-11-12T17:29:25.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3729999999999993e-06 2020-11-12T17:29:25.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.243 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:25.243 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814217+0000", 2020-11-12T17:29:25.243 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.9755999999999997e-05 2020-11-12T17:29:25.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.244 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:25.244 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814257+0000", 2020-11-12T17:29:25.244 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2589999999999997e-06 2020-11-12T17:29:25.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.245 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:25.245 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814263+0000", 2020-11-12T17:29:25.245 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0548000000000002e-05 2020-11-12T17:29:25.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.246 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:25.246 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:01.814344+0000", 2020-11-12T17:29:25.246 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.32468639500000002 2020-11-12T17:29:25.246 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:25.247 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:25.247 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:25.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.247 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "replica_scrub(pg: 5.0,from:0'0,to:164'3496,epoch:175/135,start:5:073087b9:::benchmark_data_smithi036_24110_object5847:0,end:5:07fd2517:::benchmark_data_smithi036_24110_object2426:0,chunky:1,deep:0,version:9,allow_preemption:1,priority=5)", 2020-11-12T17:29:25.247 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:29:25.247 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 73.597639919000002, 2020-11-12T17:29:25.248 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003, 2020-11-12T17:29:25.248 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:25.248 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:29:25.248 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:25.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.248 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:25.248 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:29:25.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:25.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.249 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:25.249 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331673+0000", 2020-11-12T17:29:25.249 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999866 2020-11-12T17:29:25.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:25.250 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331660+0000", 2020-11-12T17:29:25.250 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6072000000000003e-05 2020-11-12T17:29:25.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.250 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:25.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:06.331696+0000", 2020-11-12T17:29:25.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73693106399999997 2020-11-12T17:29:25.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.251 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:25.251 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068627+0000", 2020-11-12T17:29:25.251 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.6524999999999998e-05 2020-11-12T17:29:25.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.252 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:25.252 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068643+0000", 2020-11-12T17:29:25.252 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000180683 2020-11-12T17:29:25.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:25.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068824+0000", 2020-11-12T17:29:25.253 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101581 2020-11-12T17:29:25.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.253 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:25.253 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:07.068926+0000", 2020-11-12T17:29:25.254 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.73725261600000003 2020-11-12T17:29:25.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:25.254 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:25.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:25.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.254 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:25432 6.e e203/190 ondisk, result = 0)", 2020-11-12T17:29:25.255 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:29:01.622580+0000", 2020-11-12T17:29:25.255 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 18.306732915000001, 2020-11-12T17:29:25.255 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27816144100000001, 2020-11-12T17:29:25.255 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:25.255 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:25.255 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:25.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.255 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:25.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622580+0000", 2020-11-12T17:29:25.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:25.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.256 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:25.256 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622580+0000", 2020-11-12T17:29:25.256 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999766 2020-11-12T17:29:25.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.257 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:25.257 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622557+0000", 2020-11-12T17:29:25.257 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2597999999999999e-05 2020-11-12T17:29:25.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:25.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.622619+0000", 2020-11-12T17:29:25.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27631449699999999 2020-11-12T17:29:25.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.258 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:25.258 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.898934+0000", 2020-11-12T17:29:25.258 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4849999999999998e-06 2020-11-12T17:29:25.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.259 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:25.259 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.898943+0000", 2020-11-12T17:29:25.259 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001572763 2020-11-12T17:29:25.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:25.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.900516+0000", 2020-11-12T17:29:25.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0876999999999999e-05 2020-11-12T17:29:25.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.260 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:25.260 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.900527+0000", 2020-11-12T17:29:25.260 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021447799999999999 2020-11-12T17:29:25.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:25.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:25.261 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:25.261 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:01.900741+0000", 2020-11-12T17:29:25.261 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.27816144100000001 2020-11-12T17:29:25.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:25.261 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:25.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:25.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:25.262 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:25.262 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:25.263 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:29:25.264 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:29:25.266 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 44 16 29904 29888 5.30631 0 - 0.0157766 2020-11-12T17:29:25.266 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 45 16 29904 29888 5.18838 0 - 0.0157766 2020-11-12T17:29:25.266 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 46 16 29904 29888 5.07558 0 - 0.0157766 2020-11-12T17:29:25.266 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 47 16 29904 29888 4.96759 0 - 0.0157766 2020-11-12T17:29:25.266 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 48 16 29904 29888 4.8641 0 - 0.0157766 2020-11-12T17:29:25.267 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:25.259+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:25.269 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op export --pgid 6.f --file /var/log/ceph/exp.6.f.2 2020-11-12T17:29:25.270 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:29:25.365 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:25.359+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:25.466 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:25.463+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:25.482 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:25.482 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:25.483 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:29:25.483 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:25.484 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:25.485 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:29:25.509 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:25.526 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 49 16 29904 29888 4.76483 0 - 0.0157766 2020-11-12T17:29:25.547 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:25.567 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:25.563+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:25.584 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:25.586 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:25.586 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:25.596 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:29:25.622 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:25.648 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:25.669 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:25.667+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:25.677 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:25.678 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:29:25.678 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:29:25.678 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:25.678 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:25.678 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:29:25.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:29:25.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:29:25.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:29:25.679 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:29:25.681 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:25.681 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:25.717 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:25.718 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:25.726 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:29:25.769 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:25.767+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:25.866 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:29:25.870 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:25.866+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:25.885 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:25.886 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:26.657 INFO:teuthology.orchestra.run.smithi036.stderr:Exporting 6.f info 6.f( v 205'2096 (0'0,205'2096] local-lis/les=190/191 n=262 ec=190/190 lis/c=190/190 les/c/f=191/191/0 sis=190) 2020-11-12T17:29:26.657 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f0014b8f:::benchmark_data_smithi036_29033_object2135:head# 2020-11-12T17:29:26.658 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f00664d9:::benchmark_data_smithi036_29033_object3471:head# 2020-11-12T17:29:26.658 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f00794ca:::benchmark_data_smithi036_29033_object1072:head# 2020-11-12T17:29:26.658 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f045446a:::benchmark_data_smithi036_29033_object509:head# 2020-11-12T17:29:26.658 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f058633a:::benchmark_data_smithi036_29033_object1351:head# 2020-11-12T17:29:26.658 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f074471e:::benchmark_data_smithi036_29033_object149:head# 2020-11-12T17:29:26.659 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f078a34e:::benchmark_data_smithi036_29033_object3196:head# 2020-11-12T17:29:26.659 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f07ca8f5:::benchmark_data_smithi036_29033_object2163:head# 2020-11-12T17:29:26.659 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f098d7c7:::benchmark_data_smithi036_29033_object878:head# 2020-11-12T17:29:26.659 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f0c7ec7f:::benchmark_data_smithi036_29033_object3161:head# 2020-11-12T17:29:26.659 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f0c94ff4:::benchmark_data_smithi036_29033_object786:head# 2020-11-12T17:29:26.659 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f0ce37c8:::benchmark_data_smithi036_29033_object2845:head# 2020-11-12T17:29:26.660 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f0d0b959:::benchmark_data_smithi036_29033_object2114:head# 2020-11-12T17:29:26.660 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f0d0e967:::benchmark_data_smithi036_29033_object2497:head# 2020-11-12T17:29:26.660 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f0d7f8d8:::benchmark_data_smithi036_29033_object767:head# 2020-11-12T17:29:26.660 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f0e8e903:::benchmark_data_smithi036_29033_object2383:head# 2020-11-12T17:29:26.660 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f0fa9397:::benchmark_data_smithi036_29033_object1344:head# 2020-11-12T17:29:26.660 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f1024639:::benchmark_data_smithi036_29033_object1910:head# 2020-11-12T17:29:26.660 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f10cf8c4:::benchmark_data_smithi036_29033_object377:head# 2020-11-12T17:29:26.661 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f11a4d6e:::benchmark_data_smithi036_29033_object298:head# 2020-11-12T17:29:26.661 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f11bea7b:::benchmark_data_smithi036_29033_object2613:head# 2020-11-12T17:29:26.661 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f11e6aae:::benchmark_data_smithi036_29033_object3190:head# 2020-11-12T17:29:26.661 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f12068a7:::benchmark_data_smithi036_29033_object1651:head# 2020-11-12T17:29:26.661 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f133b5f2:::benchmark_data_smithi036_29033_object1052:head# 2020-11-12T17:29:26.661 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f147bdb4:::benchmark_data_smithi036_29033_object2427:head# 2020-11-12T17:29:26.661 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f152a96b:::benchmark_data_smithi036_29033_object2243:head# 2020-11-12T17:29:26.662 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f1544905:::benchmark_data_smithi036_29033_object1534:head# 2020-11-12T17:29:26.662 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f163e80f:::benchmark_data_smithi036_29033_object1772:head# 2020-11-12T17:29:26.662 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f16a5d28:::benchmark_data_smithi036_29033_object409:head# 2020-11-12T17:29:26.662 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f189a3b1:::benchmark_data_smithi036_29033_object1274:head# 2020-11-12T17:29:26.662 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f192b765:::benchmark_data_smithi036_29033_object1289:head# 2020-11-12T17:29:26.662 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f19fa9b8:::benchmark_data_smithi036_29033_object712:head# 2020-11-12T17:29:26.662 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f1bcbc84:::benchmark_data_smithi036_29033_object472:head# 2020-11-12T17:29:26.663 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f1bcfdfe:::benchmark_data_smithi036_29033_object2779:head# 2020-11-12T17:29:26.663 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f1d1713c:::benchmark_data_smithi036_29033_object3499:head# 2020-11-12T17:29:26.663 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f1e213c7:::benchmark_data_smithi036_29033_object2332:head# 2020-11-12T17:29:26.663 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f1e5da52:::benchmark_data_smithi036_29033_object1758:head# 2020-11-12T17:29:26.663 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2057181:::benchmark_data_smithi036_29033_object2736:head# 2020-11-12T17:29:26.663 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f20d794d:::benchmark_data_smithi036_29033_object1020:head# 2020-11-12T17:29:26.663 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2161947:::benchmark_data_smithi036_29033_object2369:head# 2020-11-12T17:29:26.663 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f21a5084:::benchmark_data_smithi036_29033_object747:head# 2020-11-12T17:29:26.664 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2399da7:::benchmark_data_smithi036_29033_object3001:head# 2020-11-12T17:29:26.664 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2429cc0:::benchmark_data_smithi036_29033_object1005:head# 2020-11-12T17:29:26.664 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2491a05:::benchmark_data_smithi036_29033_object1110:head# 2020-11-12T17:29:26.664 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f26977c8:::benchmark_data_smithi036_29033_object1660:head# 2020-11-12T17:29:26.664 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f26ff52a:::benchmark_data_smithi036_29033_object1992:head# 2020-11-12T17:29:26.664 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2702c40:::benchmark_data_smithi036_29033_object3193:head# 2020-11-12T17:29:26.664 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f27cb130:::benchmark_data_smithi036_29033_object1725:head# 2020-11-12T17:29:26.665 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f293e2bd:::benchmark_data_smithi036_29033_object3555:head# 2020-11-12T17:29:26.665 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2ccaf10:::benchmark_data_smithi036_29033_object1248:head# 2020-11-12T17:29:26.665 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2ce897c:::benchmark_data_smithi036_29033_object3071:head# 2020-11-12T17:29:26.665 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2f54f1e:::benchmark_data_smithi036_29033_object516:head# 2020-11-12T17:29:26.665 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2f6753e:::benchmark_data_smithi036_29033_object3591:head# 2020-11-12T17:29:26.665 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f2f8e517:::benchmark_data_smithi036_29033_object393:head# 2020-11-12T17:29:26.665 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f3197ed0:::benchmark_data_smithi036_29033_object1538:head# 2020-11-12T17:29:26.666 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f31cd204:::benchmark_data_smithi036_29033_object202:head# 2020-11-12T17:29:26.666 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f3289ffc:::benchmark_data_smithi036_29033_object3123:head# 2020-11-12T17:29:26.666 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f349738b:::benchmark_data_smithi036_29033_object2471:head# 2020-11-12T17:29:26.666 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f34e5f73:::benchmark_data_smithi036_29033_object2791:head# 2020-11-12T17:29:26.666 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f35e35d2:::benchmark_data_smithi036_29033_object1941:head# 2020-11-12T17:29:26.666 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f36812fc:::benchmark_data_smithi036_29033_object1203:head# 2020-11-12T17:29:26.666 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f37a27d5:::benchmark_data_smithi036_29033_object3067:head# 2020-11-12T17:29:26.667 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f37b1472:::benchmark_data_smithi036_29033_object2244:head# 2020-11-12T17:29:26.667 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f37cf55f:::benchmark_data_smithi036_29033_object1659:head# 2020-11-12T17:29:26.667 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f3807b45:::benchmark_data_smithi036_29033_object2745:head# 2020-11-12T17:29:26.667 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f3bc61ab:::benchmark_data_smithi036_29033_object1737:head# 2020-11-12T17:29:26.667 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f3c6147c:::benchmark_data_smithi036_29033_object3037:head# 2020-11-12T17:29:26.667 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f3f48374:::benchmark_data_smithi036_29033_object1058:head# 2020-11-12T17:29:26.667 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f3fd9df4:::benchmark_data_smithi036_29033_object1700:head# 2020-11-12T17:29:26.667 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f3fee806:::benchmark_data_smithi036_29033_object677:head# 2020-11-12T17:29:26.668 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f40a7673:::benchmark_data_smithi036_29033_object3465:head# 2020-11-12T17:29:26.668 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f422a643:::benchmark_data_smithi036_29033_object2386:head# 2020-11-12T17:29:26.668 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f445ce66:::benchmark_data_smithi036_29033_object1194:head# 2020-11-12T17:29:26.668 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f44690f2:::benchmark_data_smithi036_29033_object547:head# 2020-11-12T17:29:26.668 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f4469105:::benchmark_data_smithi036_29033_object3491:head# 2020-11-12T17:29:26.668 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f465e469:::benchmark_data_smithi036_29033_object3430:head# 2020-11-12T17:29:26.668 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f4684f4e:::benchmark_data_smithi036_29033_object1542:head# 2020-11-12T17:29:26.669 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f47290a8:::benchmark_data_smithi036_29033_object3399:head# 2020-11-12T17:29:26.669 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f4848f33:::benchmark_data_smithi036_29033_object2474:head# 2020-11-12T17:29:26.669 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f48aa2ee:::benchmark_data_smithi036_29033_object1826:head# 2020-11-12T17:29:26.669 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f48eee4f:::benchmark_data_smithi036_29033_object2898:head# 2020-11-12T17:29:26.669 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f4c33998:::benchmark_data_smithi036_29033_object3407:head# 2020-11-12T17:29:26.670 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f4e69b3d:::benchmark_data_smithi036_29033_object1577:head# 2020-11-12T17:29:26.670 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f52b37a0:::benchmark_data_smithi036_29033_object3320:head# 2020-11-12T17:29:26.670 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f58418c7:::benchmark_data_smithi036_29033_object139:head# 2020-11-12T17:29:26.670 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f59f3b8c:::benchmark_data_smithi036_29033_object2108:head# 2020-11-12T17:29:26.671 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f5a5d3ce:::benchmark_data_smithi036_29033_object1835:head# 2020-11-12T17:29:26.671 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f5bdf73a:::benchmark_data_smithi036_29033_object3348:head# 2020-11-12T17:29:26.671 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f5e2ff30:::benchmark_data_smithi036_29033_object2230:head# 2020-11-12T17:29:26.671 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f5ed1d0b:::benchmark_data_smithi036_29033_object338:head# 2020-11-12T17:29:26.672 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f5f3d679:::benchmark_data_smithi036_29033_object2704:head# 2020-11-12T17:29:26.672 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f5f85d81:::benchmark_data_smithi036_29033_object1560:head# 2020-11-12T17:29:26.672 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f6291235:::benchmark_data_smithi036_29033_object706:head# 2020-11-12T17:29:26.672 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f63dc581:::benchmark_data_smithi036_29033_object2573:head# 2020-11-12T17:29:26.672 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f6418db3:::benchmark_data_smithi036_29033_object3388:head# 2020-11-12T17:29:26.673 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f64fc539:::benchmark_data_smithi036_29033_object1370:head# 2020-11-12T17:29:26.673 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f655eeab:::benchmark_data_smithi036_29033_object1467:head# 2020-11-12T17:29:26.673 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f6578419:::benchmark_data_smithi036_29033_object263:head# 2020-11-12T17:29:26.673 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f68f39ae:::benchmark_data_smithi036_29033_object3694:head# 2020-11-12T17:29:26.674 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f6ab204b:::benchmark_data_smithi036_29033_object125:head# 2020-11-12T17:29:26.674 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f6b5d510:::benchmark_data_smithi036_29033_object1781:head# 2020-11-12T17:29:26.674 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f6b79cd0:::benchmark_data_smithi036_29033_object653:head# 2020-11-12T17:29:26.674 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f6c76190:::benchmark_data_smithi036_29033_object1448:head# 2020-11-12T17:29:26.674 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7038760:::benchmark_data_smithi036_29033_object1596:head# 2020-11-12T17:29:26.675 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f70efefa:::benchmark_data_smithi036_29033_object206:head# 2020-11-12T17:29:26.675 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f71040fd:::benchmark_data_smithi036_29033_object1032:head# 2020-11-12T17:29:26.675 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f717f5a4:::benchmark_data_smithi036_29033_object3439:head# 2020-11-12T17:29:26.675 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f71bdce0:::benchmark_data_smithi036_29033_object1152:head# 2020-11-12T17:29:26.676 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7289f7f:::benchmark_data_smithi036_29033_object1073:head# 2020-11-12T17:29:26.676 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7314257:::benchmark_data_smithi036_29033_object416:head# 2020-11-12T17:29:26.676 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7572a8a:::benchmark_data_smithi036_29033_object2137:head# 2020-11-12T17:29:26.676 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f759d298:::benchmark_data_smithi036_29033_object1400:head# 2020-11-12T17:29:26.677 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f77b830a:::benchmark_data_smithi036_29033_object1613:head# 2020-11-12T17:29:26.677 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7959d11:::benchmark_data_smithi036_29033_object3366:head# 2020-11-12T17:29:26.677 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7a07028:::benchmark_data_smithi036_29033_object1788:head# 2020-11-12T17:29:26.677 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7a23f52:::benchmark_data_smithi036_29033_object1077:head# 2020-11-12T17:29:26.677 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7b35c9b:::benchmark_data_smithi036_29033_object1018:head# 2020-11-12T17:29:26.678 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7b7fc55:::benchmark_data_smithi036_29033_object1339:head# 2020-11-12T17:29:26.679 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7dcad23:::benchmark_data_smithi036_29033_object1513:head# 2020-11-12T17:29:26.679 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7e230a0:::benchmark_data_smithi036_29033_object1527:head# 2020-11-12T17:29:26.679 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7e306d3:::benchmark_data_smithi036_29033_object2810:head# 2020-11-12T17:29:26.680 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7ee31b8:::benchmark_data_smithi036_29033_object2664:head# 2020-11-12T17:29:26.680 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7eec199:::benchmark_data_smithi036_29033_object2188:head# 2020-11-12T17:29:26.680 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f7f49965:::benchmark_data_smithi036_29033_object687:head# 2020-11-12T17:29:26.680 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f80e783e:::benchmark_data_smithi036_29033_object1223:head# 2020-11-12T17:29:26.680 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8127ad7:::benchmark_data_smithi036_29033_object2134:head# 2020-11-12T17:29:26.681 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8143cf9:::benchmark_data_smithi036_29033_object2606:head# 2020-11-12T17:29:26.681 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f819f57e:::benchmark_data_smithi036_29033_object2502:head# 2020-11-12T17:29:26.681 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f825b8c6:::benchmark_data_smithi036_29033_object3400:head# 2020-11-12T17:29:26.681 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f82d70b7:::benchmark_data_smithi036_29033_object2685:head# 2020-11-12T17:29:26.681 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f830825c:::benchmark_data_smithi036_29033_object3122:head# 2020-11-12T17:29:26.681 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8480516:::benchmark_data_smithi036_29033_object2239:head# 2020-11-12T17:29:26.682 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f85dc749:::benchmark_data_smithi036_29033_object410:head# 2020-11-12T17:29:26.682 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f861bdd8:::benchmark_data_smithi036_29033_object1253:head# 2020-11-12T17:29:26.682 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f86c84ab:::benchmark_data_smithi036_29033_object2927:head# 2020-11-12T17:29:26.682 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8749693:::benchmark_data_smithi036_29033_object238:head# 2020-11-12T17:29:26.682 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8763da8:::benchmark_data_smithi036_29033_object610:head# 2020-11-12T17:29:26.683 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f88d0818:::benchmark_data_smithi036_29033_object3600:head# 2020-11-12T17:29:26.683 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8a120ae:::benchmark_data_smithi036_29033_object1050:head# 2020-11-12T17:29:26.683 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8af772e:::benchmark_data_smithi036_29033_object3165:head# 2020-11-12T17:29:26.683 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8b7f4df:::benchmark_data_smithi036_29033_object2892:head# 2020-11-12T17:29:26.683 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8eead36:::benchmark_data_smithi036_29033_object843:head# 2020-11-12T17:29:26.683 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8f4bad2:::benchmark_data_smithi036_29033_object2778:head# 2020-11-12T17:29:26.683 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f8f87c5d:::benchmark_data_smithi036_29033_object2069:head# 2020-11-12T17:29:26.684 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f911ac89:::benchmark_data_smithi036_29033_object34:head# 2020-11-12T17:29:26.684 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f92653ba:::benchmark_data_smithi036_29033_object3020:head# 2020-11-12T17:29:26.684 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f930a4b4:::benchmark_data_smithi036_29033_object952:head# 2020-11-12T17:29:26.684 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f93317d0:::benchmark_data_smithi036_29033_object3002:head# 2020-11-12T17:29:26.684 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f938cc9d:::benchmark_data_smithi036_29033_object426:head# 2020-11-12T17:29:26.684 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f93fc2c3:::benchmark_data_smithi036_29033_object1668:head# 2020-11-12T17:29:26.684 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f947acef:::benchmark_data_smithi036_29033_object1761:head# 2020-11-12T17:29:26.685 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f9699926:::benchmark_data_smithi036_29033_object2546:head# 2020-11-12T17:29:26.685 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f96eca3c:::benchmark_data_smithi036_29033_object779:head# 2020-11-12T17:29:26.685 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f971832c:::benchmark_data_smithi036_29033_object2944:head# 2020-11-12T17:29:26.685 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f97911b0:::benchmark_data_smithi036_29033_object1645:head# 2020-11-12T17:29:26.685 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f98bd1ea:::benchmark_data_smithi036_29033_object2424:head# 2020-11-12T17:29:26.685 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f9a0b7c9:::benchmark_data_smithi036_29033_object384:head# 2020-11-12T17:29:26.685 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f9b0b730:::benchmark_data_smithi036_29033_object1521:head# 2020-11-12T17:29:26.686 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f9caf954:::benchmark_data_smithi036_29033_object701:head# 2020-11-12T17:29:26.686 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f9d67cdb:::benchmark_data_smithi036_29033_object2224:head# 2020-11-12T17:29:26.686 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f9e7f8e2:::benchmark_data_smithi036_29033_object1913:head# 2020-11-12T17:29:26.686 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f9efe149:::benchmark_data_smithi036_29033_object2824:head# 2020-11-12T17:29:26.686 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:f9fcc2f6:::benchmark_data_smithi036_29033_object235:head# 2020-11-12T17:29:26.686 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa00f7dc:::benchmark_data_smithi036_29033_object1378:head# 2020-11-12T17:29:26.686 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa171163:::benchmark_data_smithi036_29033_object831:head# 2020-11-12T17:29:26.687 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa32f84f:::benchmark_data_smithi036_29033_object3463:head# 2020-11-12T17:29:26.687 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa3a12f9:::benchmark_data_smithi036_29033_object1079:head# 2020-11-12T17:29:26.687 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa3d941a:::benchmark_data_smithi036_29033_object3288:head# 2020-11-12T17:29:26.687 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa44f021:::benchmark_data_smithi036_29033_object1322:head# 2020-11-12T17:29:26.687 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa5e2f61:::benchmark_data_smithi036_29033_object3572:head# 2020-11-12T17:29:26.688 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa657939:::benchmark_data_smithi036_29033_object1047:head# 2020-11-12T17:29:26.688 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa83ca74:::benchmark_data_smithi036_29033_object3015:head# 2020-11-12T17:29:26.688 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa85e5fd:::benchmark_data_smithi036_29033_object3294:head# 2020-11-12T17:29:26.688 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa915a4b:::benchmark_data_smithi036_29033_object3162:head# 2020-11-12T17:29:26.689 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa926b1e:::benchmark_data_smithi036_29033_object1336:head# 2020-11-12T17:29:26.689 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 50 16 29904 29888 4.66953 0 - 0.0157766 2020-11-12T17:29:26.689 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:26.635+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:26.690 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:29:26.694 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fa997294:::benchmark_data_smithi036_29033_object2370:head# 2020-11-12T17:29:26.694 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:faa1d5d1:::benchmark_data_smithi036_29033_object679:head# 2020-11-12T17:29:26.694 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:faaf3272:::benchmark_data_smithi036_29033_object3184:head# 2020-11-12T17:29:26.694 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fac0348d:::benchmark_data_smithi036_29033_object2934:head# 2020-11-12T17:29:26.694 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fad703b3:::benchmark_data_smithi036_29033_object963:head# 2020-11-12T17:29:26.695 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fad93ed6:::benchmark_data_smithi036_29033_object1133:head# 2020-11-12T17:29:26.695 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:faffa96a:::benchmark_data_smithi036_29033_object2380:head# 2020-11-12T17:29:26.695 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fb027da7:::benchmark_data_smithi036_29033_object1685:head# 2020-11-12T17:29:26.695 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fb08a085:::benchmark_data_smithi036_29033_object1607:head# 2020-11-12T17:29:26.695 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fb262a8f:::benchmark_data_smithi036_29033_object1647:head# 2020-11-12T17:29:26.695 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fb275b45:::benchmark_data_smithi036_29033_object2515:head# 2020-11-12T17:29:26.696 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fb569310:::benchmark_data_smithi036_29033_object1589:head# 2020-11-12T17:29:26.696 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fb73b0d5:::benchmark_data_smithi036_29033_object2636:head# 2020-11-12T17:29:26.696 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fb788974:::benchmark_data_smithi036_29033_object1331:head# 2020-11-12T17:29:26.696 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fb7fee57:::benchmark_data_smithi036_29033_object1658:head# 2020-11-12T17:29:26.696 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fb90c5f7:::benchmark_data_smithi036_29033_object3336:head# 2020-11-12T17:29:26.696 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fbb739f6:::benchmark_data_smithi036_29033_object3526:head# 2020-11-12T17:29:26.696 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fbbc9c8f:::benchmark_data_smithi036_29033_object39:head# 2020-11-12T17:29:26.696 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fbdb0153:::benchmark_data_smithi036_29033_object815:head# 2020-11-12T17:29:26.697 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fbdcef58:::benchmark_data_smithi036_29033_object1575:head# 2020-11-12T17:29:26.697 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fbeda772:::benchmark_data_smithi036_29033_object1705:head# 2020-11-12T17:29:26.697 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fbffe9c3:::benchmark_data_smithi036_29033_object1694:head# 2020-11-12T17:29:26.697 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc0a329e:::benchmark_data_smithi036_29033_object2561:head# 2020-11-12T17:29:26.697 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc0f8532:::benchmark_data_smithi036_29033_object3060:head# 2020-11-12T17:29:26.697 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc1fdfc4:::benchmark_data_smithi036_29033_object1985:head# 2020-11-12T17:29:26.698 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc2905e4:::benchmark_data_smithi036_29033_object174:head# 2020-11-12T17:29:26.698 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc4ead24:::benchmark_data_smithi036_29033_object1894:head# 2020-11-12T17:29:26.698 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc510e19:::benchmark_data_smithi036_29033_object401:head# 2020-11-12T17:29:26.698 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc61626d:::benchmark_data_smithi036_29033_object55:head# 2020-11-12T17:29:26.698 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc655796:::benchmark_data_smithi036_29033_object3339:head# 2020-11-12T17:29:26.698 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc699a05:::benchmark_data_smithi036_29033_object481:head# 2020-11-12T17:29:26.699 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc77bb22:::benchmark_data_smithi036_29033_object257:head# 2020-11-12T17:29:26.699 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc7e1550:::benchmark_data_smithi036_29033_object25:head# 2020-11-12T17:29:26.699 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc8cc9d0:::benchmark_data_smithi036_29033_object2595:head# 2020-11-12T17:29:26.700 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fc915dc3:::benchmark_data_smithi036_29033_object3103:head# 2020-11-12T17:29:26.701 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fcbfd082:::benchmark_data_smithi036_29033_object978:head# 2020-11-12T17:29:26.701 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fcc3b4eb:::benchmark_data_smithi036_29033_object660:head# 2020-11-12T17:29:26.701 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fccac580:::benchmark_data_smithi036_29033_object452:head# 2020-11-12T17:29:26.701 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fccdb1a5:::benchmark_data_smithi036_29033_object2853:head# 2020-11-12T17:29:26.702 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fcce5841:::benchmark_data_smithi036_29033_object1676:head# 2020-11-12T17:29:26.702 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fcea30bc:::benchmark_data_smithi036_29033_object2483:head# 2020-11-12T17:29:26.703 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd003360:::benchmark_data_smithi036_29033_object3134:head# 2020-11-12T17:29:26.703 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd008dd2:::benchmark_data_smithi036_29033_object1717:head# 2020-11-12T17:29:26.703 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd1e218f:::benchmark_data_smithi036_29033_object1703:head# 2020-11-12T17:29:26.704 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd241188:::benchmark_data_smithi036_29033_object1477:head# 2020-11-12T17:29:26.705 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd2fd347:::benchmark_data_smithi036_29033_object1578:head# 2020-11-12T17:29:26.707 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd4030e9:::benchmark_data_smithi036_29033_object3468:head# 2020-11-12T17:29:26.708 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd4b6dc4:::benchmark_data_smithi036_29033_object1338:head# 2020-11-12T17:29:26.709 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd72b722:::benchmark_data_smithi036_29033_object3340:head# 2020-11-12T17:29:26.710 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd7f9319:::benchmark_data_smithi036_29033_object1191:head# 2020-11-12T17:29:26.712 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fd9a25ca:::benchmark_data_smithi036_29033_object1865:head# 2020-11-12T17:29:26.713 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fda01f34:::benchmark_data_smithi036_29033_object1285:head# 2020-11-12T17:29:26.714 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fda459c4:::benchmark_data_smithi036_29033_object845:head# 2020-11-12T17:29:26.715 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fda5b3fb:::benchmark_data_smithi036_29033_object2482:head# 2020-11-12T17:29:26.715 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fdaa9410:::benchmark_data_smithi036_29033_object3473:head# 2020-11-12T17:29:26.716 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fdbf2533:::benchmark_data_smithi036_29033_object810:head# 2020-11-12T17:29:26.717 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fddb820a:::benchmark_data_smithi036_29033_object817:head# 2020-11-12T17:29:26.718 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fdeda6d1:::benchmark_data_smithi036_29033_object625:head# 2020-11-12T17:29:26.719 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe071eff:::benchmark_data_smithi036_29033_object3324:head# 2020-11-12T17:29:26.720 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe0bf900:::benchmark_data_smithi036_29033_object2329:head# 2020-11-12T17:29:26.720 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe19eea7:::benchmark_data_smithi036_29033_object247:head# 2020-11-12T17:29:26.721 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe392337:::benchmark_data_smithi036_29033_object1125:head# 2020-11-12T17:29:26.722 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe534b76:::benchmark_data_smithi036_29033_object548:head# 2020-11-12T17:29:26.723 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe5db6d2:::benchmark_data_smithi036_29033_object3588:head# 2020-11-12T17:29:26.724 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe6905ae:::benchmark_data_smithi036_29033_object3179:head# 2020-11-12T17:29:26.725 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe863362:::benchmark_data_smithi036_29033_object2139:head# 2020-11-12T17:29:26.725 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe8b5808:::benchmark_data_smithi036_29033_object2420:head# 2020-11-12T17:29:26.726 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe8b9173:::benchmark_data_smithi036_29033_object1827:head# 2020-11-12T17:29:26.727 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe8d9db2:::benchmark_data_smithi036_29033_object1469:head# 2020-11-12T17:29:26.728 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fe9e60f5:::benchmark_data_smithi036_29033_object3325:head# 2020-11-12T17:29:26.729 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fea5acfb:::benchmark_data_smithi036_29033_object1497:head# 2020-11-12T17:29:26.730 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:feacab4b:::benchmark_data_smithi036_29033_object3299:head# 2020-11-12T17:29:26.730 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:feb81029:::benchmark_data_smithi036_29033_object110:head# 2020-11-12T17:29:26.731 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:febdd704:::benchmark_data_smithi036_29033_object1654:head# 2020-11-12T17:29:26.732 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fed04e8d:::benchmark_data_smithi036_29033_object2033:head# 2020-11-12T17:29:26.733 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fee00e8d:::benchmark_data_smithi036_29033_object258:head# 2020-11-12T17:29:26.734 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fef631b1:::benchmark_data_smithi036_29033_object1914:head# 2020-11-12T17:29:26.734 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:ff01d3ce:::benchmark_data_smithi036_29033_object131:head# 2020-11-12T17:29:26.735 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:ff0899d0:::benchmark_data_smithi036_29033_object1488:head# 2020-11-12T17:29:26.736 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:ff0a2595:::benchmark_data_smithi036_29033_object2090:head# 2020-11-12T17:29:26.737 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:ff770895:::benchmark_data_smithi036_29033_object1563:head# 2020-11-12T17:29:26.738 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:ff843c57:::benchmark_data_smithi036_29033_object2867:head# 2020-11-12T17:29:26.739 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:ff8f0dd1:::benchmark_data_smithi036_29033_object2392:head# 2020-11-12T17:29:26.740 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:26.735+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:26.740 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:ff9992a5:::benchmark_data_smithi036_29033_object2415:head# 2020-11-12T17:29:26.741 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:ff9dc5f0:::benchmark_data_smithi036_29033_object3605:head# 2020-11-12T17:29:26.742 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:ffc16a3d:::benchmark_data_smithi036_29033_object2968:head# 2020-11-12T17:29:26.743 INFO:teuthology.orchestra.run.smithi036.stderr:Read #6:fff70b25:::benchmark_data_smithi036_29033_object567:head# 2020-11-12T17:29:26.745 INFO:teuthology.orchestra.run.smithi036.stderr:Export successful 2020-11-12T17:29:26.815 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:26.816 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:26.825 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:29:26.841 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:26.839+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:26.942 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:26.938+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:26.979 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:26.979 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:26.988 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:29:27.044 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:27.042+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:27.106 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:27.106 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:27.117 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:29:27.161 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:27.159+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:27.166 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:27.162+0000 7fc2486d1700 -1 osd.3 212 handle_osd_map injecting map crc failure 2020-11-12T17:29:27.225 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:27.225 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:27.234 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:29:27.245 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:27.242+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:27.294 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --force --op remove --pgid 6.f 2020-11-12T17:29:27.346 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:27.343+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:27.386 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:27.386 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:27.396 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:29:27.446 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:27.442+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:27.526 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 51 16 29904 29888 4.57797 0 - 0.0157766 2020-11-12T17:29:27.544 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:27.544 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:27.547 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:27.543+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:27.553 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:29:27.649 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:27.646+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:27.683 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:29:27.703 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:27.703 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:27.712 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:29:27.757 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:27.755+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:27.820 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:27.820 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:27.829 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:29:27.845 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:27.850 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:27.846+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:27.875 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:27.886 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:29:27.912 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:27.940 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:27.951 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:27.946+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:27.971 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:27.981 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:27.981 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:27.990 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:29:27.998 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:28.027 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:28.027 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:29:28.027 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:29:28.028 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:28.028 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:28.028 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:29:28.028 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:29:28.028 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:29:28.028 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:29:28.029 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:29:28.030 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:28.030 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:28.052 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:28.047+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:28.100 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:28.100 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:28.101 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:28.101 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:28.109 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:29:28.153 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:28.151+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:28.254 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:28.250+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:28.269 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:28.269 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:28.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:28.270 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:28.270 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.270 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:29:28.270 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:28.270 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.593948727, 2020-11-12T17:29:28.271 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:29:28.271 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:28.271 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:29:28.271 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:28.272 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:28.272 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:28.272 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:29:28.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.272 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:28.273 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.274 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.274 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:28.274 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:28.274 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:29:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:29:28.275 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:29:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:29:28.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:29:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:28.277 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:29:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:29:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:28.278 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:29:28.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:29:28.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.279 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:29:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:29:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:29:28.280 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:29:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:29:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:29:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:29:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:29:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:28.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:29:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:29:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:29:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:29:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:28.283 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:28.284 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.593546366, 2020-11-12T17:29:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:29:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:28.285 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:29:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:28.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:29:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:28.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:29:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:29:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:29:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:29:28.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:29:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:29:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:28.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:29:28.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:29:28.290 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:28.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:29:28.291 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:29:28.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:28.291 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:29:28.902 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:29:28.902 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.902 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:29:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:29:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.903 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:28.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:29:28.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:29:28.904 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.904 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.904 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:28.904 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:29:28.904 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:29:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:29:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:29:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.905 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:29:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:29:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.906 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:29:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:29:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:29:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:29:28.907 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:29:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:29:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.908 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:29:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:29:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.909 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:28.910 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:28.910 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.593222373, 2020-11-12T17:29:28.910 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:29:28.910 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:28.910 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:28.910 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:28.910 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:28.911 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:28.911 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:29:28.911 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.911 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:28.911 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.912 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:28.912 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:28.912 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:28.912 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:29:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.913 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:29:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:29:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:28.914 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:29:28.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:29:28.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.915 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.915 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:28.915 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:29:28.915 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:29:28.915 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:28.916 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:29:28.916 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:29:28.916 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.916 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.916 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:28.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:29:28.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:29:28.917 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.917 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.917 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:28.917 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:29:28.917 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:29:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:29:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:29:28.918 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:29.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:29:29.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:29:29.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:29.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:29:29.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:29:29.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:29.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:29:29.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:29:29.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:29.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:29:29.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:29:29.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:29.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:29:29.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:29:29.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:29.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:29:29.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:29:29.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:29.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:29:29.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:29:29.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:29.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:29:29.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:29:29.464 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:29.464 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:29.464 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:29.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.464 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:29.465 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:29:29.465 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59297866200001, 2020-11-12T17:29:29.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:29:29.465 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:29.465 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:29.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:29.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:29.465 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:29.466 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:29:29.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.466 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:29.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:29.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:29:29.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:29.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:29.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:29:29.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:29:29.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:29.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:29:29.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:29:29.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:29.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:29:29.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:29:29.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:29.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:29:29.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:29:29.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:29.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:29:29.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:29:29.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:29.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:29:29.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:29:29.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:29.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:29:29.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:29:29.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:29.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:29:29.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:29:29.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:29.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:29:29.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:29:29.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.473 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:29.473 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:29:29.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:29:29.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:29.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:29:29.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:29:29.474 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.474 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.474 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:29.474 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:29:29.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:29:29.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.475 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:29.475 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:29:29.475 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:29:29.475 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.475 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:29.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:29:29.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:29:29.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:29.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:29:29.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:29:29.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:29.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:29.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:29.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:29:29.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:29:29.477 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:29.478 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:29.478 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:30.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.090 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:30.091 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:29:30.091 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.592740515, 2020-11-12T17:29:30.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:29:30.091 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:30.091 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:30.091 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:30.091 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:30.092 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:30.092 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:29:30.092 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.092 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:30.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.092 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:30.092 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:29:30.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:30.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:30.093 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:29:30.093 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:29:30.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:30.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:29:30.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:29:30.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:30.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:29:30.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:29:30.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:30.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:29:30.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:29:30.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:30.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:29:30.096 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:29:30.096 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:30.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:29:30.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:29:30.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:30.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:29:30.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:29:30.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:30.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:29:30.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:29:30.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:30.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:29:30.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:29:30.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:30.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:29:30.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:29:30.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:30.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:30.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:31.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:29:31.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:29:31.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:31.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:31.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:31.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:29:31.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:29:31.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:31.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:31.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:31.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:29:31.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:29:31.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:31.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:31.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:31.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:29:31.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:29:31.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:31.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:31.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:31.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:29:31.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:29:31.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:31.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:31.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:31.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:29:31.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:29:31.126 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:31.126 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:31.126 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:31.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:31.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:31.127 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:31.127 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:29:31.127 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59253847500003, 2020-11-12T17:29:33.382 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:29:33.382 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:33.383 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:33.383 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:33.383 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:33.383 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:33.383 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:29:33.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:33.384 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:33.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:33.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:33.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:29:33.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:33.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:33.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:33.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:33.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:29:33.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:29:33.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:33.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:33.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:33.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:29:33.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:29:33.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:33.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:33.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:33.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:29:33.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:29:33.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:33.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:33.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:33.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:29:33.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:29:33.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:33.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:33.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:33.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:29:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:29:35.068 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:29:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:29:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.069 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:29:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:29:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.070 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:29:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:29:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:29:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:29:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.071 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:29:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:29:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.072 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:29:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:29:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:29:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:29:35.073 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:29:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:29:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.074 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:29:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:29:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:29:35.075 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:29:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:29:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:29:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.076 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:29:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59233310500002, 2020-11-12T17:29:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:29:35.077 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:29:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.078 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:29:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.079 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:29:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:29:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:29:35.080 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:29:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:29:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:29:35.081 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:29:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:29:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.082 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:29:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:29:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.083 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:29:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:29:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.084 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:29:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:29:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:29:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:29:35.085 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:29:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:29:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.086 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:29:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:29:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:29:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:29:35.087 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:29:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:29:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.088 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:29:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:29:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.089 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:29:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:29:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:29:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:29:35.090 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:29:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:29:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.091 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:29:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59214727800003, 2020-11-12T17:29:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:29:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.092 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:29:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.093 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:29:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:29:35.094 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:29:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:29:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:29:35.095 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.096 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:29:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:29:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:29:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:29:35.097 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:29:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:29:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.098 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:29:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:29:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:29:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:29:35.099 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:29:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:29:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.100 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:29:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:29:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:29:35.101 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:29:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:29:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:29:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.102 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:29:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:29:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:29:35.103 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:29:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:29:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:29:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.104 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:29:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:29:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.105 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:29:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:29:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.106 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:29:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59195031399997, 2020-11-12T17:29:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:29:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.107 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:29:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.108 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:29:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:29:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:29:35.109 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:29:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:29:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.110 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:29:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:29:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:29:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:29:35.111 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:29:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:29:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.112 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:29:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:29:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:29:35.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:29:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:29:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:29:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:29:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:29:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:29:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:29:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:29:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:29:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:29:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:29:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:29:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:29:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:29:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:29:35.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:29:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:29:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:29:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:29:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.120 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:29:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59175428399999, 2020-11-12T17:29:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:29:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.121 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:29:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:29:35.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:29:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:29:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:29:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:29:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:29:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:29:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:29:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:29:35.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:29:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:29:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:29:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:29:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:29:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:29:35.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:29:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:29:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:29:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:29:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:29:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:29:35.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:29:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:29:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:29:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:29:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:29:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:29:35.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:29:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:29:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:29:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:29:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:29:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:29:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.133 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:29:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59157348399998, 2020-11-12T17:29:35.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:29:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:29:35.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:29:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.136 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:29:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:29:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:29:35.137 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:29:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:29:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:29:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:29:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:29:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:29:35.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:29:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:29:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:29:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:29:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:29:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:29:35.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:29:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:29:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:29:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:29:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:29:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:29:35.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:29:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:29:35.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:29:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:29:35.145 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:29:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:29:35.146 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:29:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.147 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:29:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:29:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:29:35.148 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:29:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.149 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:29:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59137753099998, 2020-11-12T17:29:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:29:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.150 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.151 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.151 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:29:35.151 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.151 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.151 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.151 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.152 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:29:35.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.152 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.152 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:29:35.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:29:35.153 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.153 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.153 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.153 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:29:35.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:29:35.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:29:35.154 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:29:35.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:29:35.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:29:35.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:29:35.156 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:29:35.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:29:35.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:29:35.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:29:35.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:29:35.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:29:35.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:29:35.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:29:35.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:29:35.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:29:35.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:29:35.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:29:35.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:29:35.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:29:35.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:29:35.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:29:35.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:29:35.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:29:35.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:29:35.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:29:35.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:29:35.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.164 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.164 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:29:35.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:29:35.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.164 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.165 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.165 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:29:35.165 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59118392300002, 2020-11-12T17:29:35.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:29:35.165 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.165 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.165 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.166 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.166 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.166 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:29:35.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.166 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:29:35.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:29:35.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:29:35.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:29:35.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:29:35.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:29:35.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:29:35.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:29:35.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:29:35.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:29:35.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:29:35.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:29:35.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:29:35.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:29:35.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:29:35.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.172 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:29:35.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:29:35.172 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.172 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:29:35.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:29:35.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.173 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:29:35.173 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:29:35.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:29:35.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:29:35.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:29:35.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:29:35.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:29:35.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:29:35.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:29:35.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:29:35.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:29:35.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:29:35.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:29:35.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:29:35.177 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.177 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.178 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.178 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.178 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:29:35.178 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59087205999998, 2020-11-12T17:29:35.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:29:35.179 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.179 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.179 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.179 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:29:35.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.179 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:29:35.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:29:35.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:29:35.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:29:35.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:29:35.181 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.182 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:29:35.182 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:29:35.182 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.182 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.182 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:29:35.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:29:35.183 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.183 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.183 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.183 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:29:35.183 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:29:35.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.184 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.184 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:29:35.184 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:29:35.184 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.184 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:29:35.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:29:35.185 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.185 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.185 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.185 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:29:35.185 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:29:35.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.186 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.186 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:29:35.186 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:29:35.186 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.186 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:29:35.187 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:29:35.187 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.187 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.187 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.187 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:29:35.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:29:35.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.188 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.188 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:29:35.188 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:29:35.188 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.188 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:29:35.189 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:29:35.189 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.189 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.189 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.189 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:29:35.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:29:35.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.190 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.190 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.190 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:29:35.190 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:29:35.190 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.191 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.191 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.191 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:29:35.191 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:29:35.191 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.191 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.191 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.191 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.192 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.192 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.192 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:29:35.192 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59058456299999, 2020-11-12T17:29:35.192 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:29:35.192 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.192 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.193 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.193 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.193 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.193 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:29:35.193 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.193 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.193 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.193 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:29:35.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.194 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.194 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.194 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.194 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:29:35.194 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:29:35.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.195 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:29:35.195 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:29:35.195 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.195 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.195 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:29:35.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:29:35.196 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.196 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.196 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.196 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:29:35.196 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:29:35.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.197 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:29:35.197 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:29:35.197 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.197 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.197 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:29:35.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:29:35.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:29:35.198 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:29:35.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:29:35.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:29:35.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.199 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:29:35.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:29:35.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.200 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.200 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:29:35.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:29:35.200 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:29:35.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:29:35.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:29:35.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:29:35.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:29:35.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:29:35.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:29:35.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:29:35.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:29:35.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:29:35.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:29:35.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:29:35.204 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.205 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.205 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.205 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:35.205 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:29:35.205 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 368.59036419199998, 2020-11-12T17:29:35.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:29:35.206 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.206 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.206 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.206 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:35.206 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:35.206 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:29:35.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.207 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:29:35.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:29:35.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:29:35.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:29:35.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:29:35.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:29:35.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:29:35.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:29:35.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:29:35.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:29:35.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:29:35.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:29:35.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:29:35.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:35.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:29:35.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:29:35.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:29:35.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:29:35.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:35.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:29:35.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:29:35.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:29:35.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:29:35.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:29:35.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:29:35.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:35.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:29:35.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:29:35.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:29:35.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:29:35.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:29:35.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:29:35.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:29:35.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:29:35.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:29:35.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:29:35.218 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.218 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.218 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.219 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:29:35.219 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:29:35.219 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 206.68078520200001, 2020-11-12T17:29:35.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:29:35.219 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.219 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.220 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:29:35.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:29:35.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:29:35.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:29:35.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:29:35.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:29:35.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:29:35.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:29:35.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:29:35.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:29:35.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:29:35.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:29:35.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:29:35.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:29:35.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:29:35.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:29:35.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:29:35.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:29:35.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:29:35.227 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.227 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.227 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.228 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:29:35.228 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:29:35.228 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 144.606409442, 2020-11-12T17:29:35.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:29:35.228 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.228 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.228 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.229 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:35.229 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:35.229 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:29:35.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.229 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:29:35.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:29:35.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:29:35.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:29:35.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:29:35.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:29:35.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:29:35.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:29:35.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:29:35.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:29:35.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:29:35.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:29:35.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:29:35.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:29:35.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:29:35.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:35.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:29:35.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:29:35.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:29:35.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:29:35.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.237 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:29:35.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:29:35.237 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.237 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.237 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:29:35.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:29:35.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.238 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:29:35.238 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:29:35.238 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.239 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.239 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.239 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:29:35.239 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:29:35.239 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 113.835983075, 2020-11-12T17:29:35.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:29:35.240 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.240 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:35.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:35.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:35.240 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:35.240 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:29:35.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.241 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:29:35.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:29:35.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:29:35.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:29:35.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:29:35.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:29:35.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:29:35.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:29:35.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:29:35.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:29:35.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:29:35.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:29:35.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:29:35.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:29:35.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:29:35.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:35.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:29:35.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:29:35.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:35.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:29:35.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:29:35.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:35.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:29:35.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:29:35.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:35.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:29:35.248 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:29:35.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:29:35.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:29:35.249 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.249 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.250 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.250 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:29:35.250 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:29:35.250 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 113.827886042, 2020-11-12T17:29:35.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:29:35.251 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:35.251 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:35.251 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:35.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:35.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:29:35.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:35.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:35.252 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:29:35.252 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:29:35.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:35.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:29:35.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:29:35.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.253 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:35.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:29:35.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:29:35.254 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.254 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:35.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:29:35.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:29:35.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:35.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:29:35.255 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:29:35.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:35.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:29:35.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:29:35.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.256 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:35.256 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:29:35.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:29:35.257 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:35.257 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:35.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:35.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:29:35.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:29:35.257 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.257 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.257 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.258 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:35.258 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:35.258 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:35.259 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:29:35.262 INFO:teuthology.orchestra.run.smithi036.stdout: marking collection for removal 2020-11-12T17:29:35.262 INFO:teuthology.orchestra.run.smithi036.stdout:setting '_remove' omap key 2020-11-12T17:29:35.262 INFO:teuthology.orchestra.run.smithi036.stdout:finish_remove_pgs 6.f_head removing 6.f 2020-11-12T17:29:35.262 INFO:teuthology.orchestra.run.smithi036.stdout:Remove successful 2020-11-12T17:29:35.263 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 52 16 29904 29888 4.48993 0 - 0.0157766 2020-11-12T17:29:35.263 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 53 16 29904 29888 4.40521 0 - 0.0157766 2020-11-12T17:29:35.263 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 54 16 29904 29888 4.32363 0 - 0.0157766 2020-11-12T17:29:35.263 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 55 16 29904 29888 4.24501 0 - 0.0157766 2020-11-12T17:29:35.263 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 56 16 29904 29888 4.1692 0 - 0.0157766 2020-11-12T17:29:35.263 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 57 16 29904 29888 4.09606 0 - 0.0157766 2020-11-12T17:29:35.263 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 58 16 29904 29888 4.02543 0 - 0.0157766 2020-11-12T17:29:35.264 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.6.f.2 2020-11-12T17:29:35.264 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:28.870+0000 7fc24d2e3700 -1 osd.3 214 handle_osd_map injecting map crc failure 2020-11-12T17:29:35.265 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:29:35.265 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:35.258+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:35.266 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:29:35.361 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:35.359+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:35.382 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:35.382 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:35.382 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:35.383 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:35.392 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:29:35.455 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:35.462 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:35.458+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:35.483 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:35.509 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:35.527 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 59 16 29904 29888 3.9572 0 - 0.0157766 2020-11-12T17:29:35.537 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:35.545 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:35.545 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:35.545 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:35.545 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:35.545 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:35.554 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:29:35.567 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:35.595 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:35.605 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:35.603+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:35.625 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:35.625 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:29:35.626 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:29:35.626 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:35.626 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:35.626 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:29:35.626 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:29:35.626 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:29:35.627 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:29:35.627 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:29:35.629 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:35.629 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:35.659 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:35.659 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:35.669 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:29:35.671 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:35.670+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:35.765 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:35.763+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:35.787 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:35.788 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:35.798 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:29:35.866 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:35.862+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:35.910 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:35.911 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:35.920 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:29:35.967 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:35.963+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:36.008 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:36.003+0000 7f7b4b297700 -1 osd.4 216 handle_osd_map injecting map crc failure 2020-11-12T17:29:36.067 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:36.068 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:36.068 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:36.066+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:36.077 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:29:36.168 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:36.163+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:36.238 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:36.238 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:36.247 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:29:36.294 INFO:teuthology.orchestra.run.smithi036.stdout:get_pg_num_history pg_num_history pg_num_history(e205 pg_nums {1={11=1},2={17=8,163=18},4={69=16},5={127=16},6={190=16}} deleted_pools 126,4,189,5) 2020-11-12T17:29:36.295 INFO:teuthology.orchestra.run.smithi036.stdout:Importing pgid 6.f 2020-11-12T17:29:36.295 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f0014b8f:::benchmark_data_smithi036_29033_object2135:head# 2020-11-12T17:29:36.295 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.295 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f00664d9:::benchmark_data_smithi036_29033_object3471:head# 2020-11-12T17:29:36.295 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.295 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f00794ca:::benchmark_data_smithi036_29033_object1072:head# 2020-11-12T17:29:36.296 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.296 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f045446a:::benchmark_data_smithi036_29033_object509:head# 2020-11-12T17:29:36.296 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.296 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f058633a:::benchmark_data_smithi036_29033_object1351:head# 2020-11-12T17:29:36.296 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.296 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f074471e:::benchmark_data_smithi036_29033_object149:head# 2020-11-12T17:29:36.297 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.297 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f078a34e:::benchmark_data_smithi036_29033_object3196:head# 2020-11-12T17:29:36.297 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.297 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f07ca8f5:::benchmark_data_smithi036_29033_object2163:head# 2020-11-12T17:29:36.297 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.297 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f098d7c7:::benchmark_data_smithi036_29033_object878:head# 2020-11-12T17:29:36.834 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.835 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f0c7ec7f:::benchmark_data_smithi036_29033_object3161:head# 2020-11-12T17:29:36.835 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.835 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f0c94ff4:::benchmark_data_smithi036_29033_object786:head# 2020-11-12T17:29:36.835 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.835 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f0ce37c8:::benchmark_data_smithi036_29033_object2845:head# 2020-11-12T17:29:36.836 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.836 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f0d0b959:::benchmark_data_smithi036_29033_object2114:head# 2020-11-12T17:29:36.836 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.836 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f0d0e967:::benchmark_data_smithi036_29033_object2497:head# 2020-11-12T17:29:36.836 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.836 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f0d7f8d8:::benchmark_data_smithi036_29033_object767:head# 2020-11-12T17:29:36.836 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.837 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f0e8e903:::benchmark_data_smithi036_29033_object2383:head# 2020-11-12T17:29:36.837 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.837 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f0fa9397:::benchmark_data_smithi036_29033_object1344:head# 2020-11-12T17:29:36.837 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.837 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f1024639:::benchmark_data_smithi036_29033_object1910:head# 2020-11-12T17:29:36.837 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.838 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f10cf8c4:::benchmark_data_smithi036_29033_object377:head# 2020-11-12T17:29:36.838 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.838 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f11a4d6e:::benchmark_data_smithi036_29033_object298:head# 2020-11-12T17:29:36.838 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.838 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:36.267+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:36.866 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f11bea7b:::benchmark_data_smithi036_29033_object2613:head# 2020-11-12T17:29:36.867 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.867 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f11e6aae:::benchmark_data_smithi036_29033_object3190:head# 2020-11-12T17:29:36.867 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.867 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f12068a7:::benchmark_data_smithi036_29033_object1651:head# 2020-11-12T17:29:36.867 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.868 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f133b5f2:::benchmark_data_smithi036_29033_object1052:head# 2020-11-12T17:29:36.868 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.868 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f147bdb4:::benchmark_data_smithi036_29033_object2427:head# 2020-11-12T17:29:36.868 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.868 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f152a96b:::benchmark_data_smithi036_29033_object2243:head# 2020-11-12T17:29:36.868 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.868 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f1544905:::benchmark_data_smithi036_29033_object1534:head# 2020-11-12T17:29:36.869 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.869 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f163e80f:::benchmark_data_smithi036_29033_object1772:head# 2020-11-12T17:29:36.869 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.869 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f16a5d28:::benchmark_data_smithi036_29033_object409:head# 2020-11-12T17:29:36.869 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.869 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f189a3b1:::benchmark_data_smithi036_29033_object1274:head# 2020-11-12T17:29:36.869 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.869 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f192b765:::benchmark_data_smithi036_29033_object1289:head# 2020-11-12T17:29:36.870 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.870 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f19fa9b8:::benchmark_data_smithi036_29033_object712:head# 2020-11-12T17:29:36.870 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.870 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f1bcbc84:::benchmark_data_smithi036_29033_object472:head# 2020-11-12T17:29:36.870 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.870 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f1bcfdfe:::benchmark_data_smithi036_29033_object2779:head# 2020-11-12T17:29:36.870 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.871 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f1d1713c:::benchmark_data_smithi036_29033_object3499:head# 2020-11-12T17:29:36.871 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.871 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f1e213c7:::benchmark_data_smithi036_29033_object2332:head# 2020-11-12T17:29:36.871 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.871 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f1e5da52:::benchmark_data_smithi036_29033_object1758:head# 2020-11-12T17:29:36.871 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.871 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2057181:::benchmark_data_smithi036_29033_object2736:head# 2020-11-12T17:29:36.871 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.872 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f20d794d:::benchmark_data_smithi036_29033_object1020:head# 2020-11-12T17:29:36.872 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.872 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2161947:::benchmark_data_smithi036_29033_object2369:head# 2020-11-12T17:29:36.872 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.872 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f21a5084:::benchmark_data_smithi036_29033_object747:head# 2020-11-12T17:29:36.872 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.872 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2399da7:::benchmark_data_smithi036_29033_object3001:head# 2020-11-12T17:29:36.873 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.873 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2429cc0:::benchmark_data_smithi036_29033_object1005:head# 2020-11-12T17:29:36.873 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.873 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2491a05:::benchmark_data_smithi036_29033_object1110:head# 2020-11-12T17:29:36.873 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.873 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f26977c8:::benchmark_data_smithi036_29033_object1660:head# 2020-11-12T17:29:36.873 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.873 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f26ff52a:::benchmark_data_smithi036_29033_object1992:head# 2020-11-12T17:29:36.874 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.874 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2702c40:::benchmark_data_smithi036_29033_object3193:head# 2020-11-12T17:29:36.874 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.874 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f27cb130:::benchmark_data_smithi036_29033_object1725:head# 2020-11-12T17:29:36.874 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.874 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f293e2bd:::benchmark_data_smithi036_29033_object3555:head# 2020-11-12T17:29:36.874 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.875 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2ccaf10:::benchmark_data_smithi036_29033_object1248:head# 2020-11-12T17:29:36.875 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.875 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2ce897c:::benchmark_data_smithi036_29033_object3071:head# 2020-11-12T17:29:36.875 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.875 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2f54f1e:::benchmark_data_smithi036_29033_object516:head# 2020-11-12T17:29:36.875 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.875 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2f6753e:::benchmark_data_smithi036_29033_object3591:head# 2020-11-12T17:29:36.875 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.876 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f2f8e517:::benchmark_data_smithi036_29033_object393:head# 2020-11-12T17:29:36.876 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.876 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f3197ed0:::benchmark_data_smithi036_29033_object1538:head# 2020-11-12T17:29:36.876 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.876 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f31cd204:::benchmark_data_smithi036_29033_object202:head# 2020-11-12T17:29:36.876 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.877 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f3289ffc:::benchmark_data_smithi036_29033_object3123:head# 2020-11-12T17:29:36.877 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.877 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f349738b:::benchmark_data_smithi036_29033_object2471:head# 2020-11-12T17:29:36.877 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.877 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f34e5f73:::benchmark_data_smithi036_29033_object2791:head# 2020-11-12T17:29:36.877 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.877 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f35e35d2:::benchmark_data_smithi036_29033_object1941:head# 2020-11-12T17:29:36.878 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.878 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f36812fc:::benchmark_data_smithi036_29033_object1203:head# 2020-11-12T17:29:36.878 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.878 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f37a27d5:::benchmark_data_smithi036_29033_object3067:head# 2020-11-12T17:29:36.878 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.878 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f37b1472:::benchmark_data_smithi036_29033_object2244:head# 2020-11-12T17:29:36.878 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.879 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f37cf55f:::benchmark_data_smithi036_29033_object1659:head# 2020-11-12T17:29:36.879 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.879 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f3807b45:::benchmark_data_smithi036_29033_object2745:head# 2020-11-12T17:29:36.879 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.879 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f3bc61ab:::benchmark_data_smithi036_29033_object1737:head# 2020-11-12T17:29:36.879 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.879 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f3c6147c:::benchmark_data_smithi036_29033_object3037:head# 2020-11-12T17:29:36.880 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.880 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f3f48374:::benchmark_data_smithi036_29033_object1058:head# 2020-11-12T17:29:36.880 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.880 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f3fd9df4:::benchmark_data_smithi036_29033_object1700:head# 2020-11-12T17:29:36.880 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.880 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f3fee806:::benchmark_data_smithi036_29033_object677:head# 2020-11-12T17:29:36.880 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.880 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f40a7673:::benchmark_data_smithi036_29033_object3465:head# 2020-11-12T17:29:36.881 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.881 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f422a643:::benchmark_data_smithi036_29033_object2386:head# 2020-11-12T17:29:36.881 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.881 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f445ce66:::benchmark_data_smithi036_29033_object1194:head# 2020-11-12T17:29:36.881 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.881 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f44690f2:::benchmark_data_smithi036_29033_object547:head# 2020-11-12T17:29:36.881 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.882 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f4469105:::benchmark_data_smithi036_29033_object3491:head# 2020-11-12T17:29:36.882 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.882 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f465e469:::benchmark_data_smithi036_29033_object3430:head# 2020-11-12T17:29:36.882 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.882 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f4684f4e:::benchmark_data_smithi036_29033_object1542:head# 2020-11-12T17:29:36.882 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.882 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f47290a8:::benchmark_data_smithi036_29033_object3399:head# 2020-11-12T17:29:36.882 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.883 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f4848f33:::benchmark_data_smithi036_29033_object2474:head# 2020-11-12T17:29:36.883 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.883 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f48aa2ee:::benchmark_data_smithi036_29033_object1826:head# 2020-11-12T17:29:36.883 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.883 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f48eee4f:::benchmark_data_smithi036_29033_object2898:head# 2020-11-12T17:29:36.883 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.883 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f4c33998:::benchmark_data_smithi036_29033_object3407:head# 2020-11-12T17:29:36.884 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.884 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f4e69b3d:::benchmark_data_smithi036_29033_object1577:head# 2020-11-12T17:29:36.884 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.884 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f52b37a0:::benchmark_data_smithi036_29033_object3320:head# 2020-11-12T17:29:36.884 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.884 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f58418c7:::benchmark_data_smithi036_29033_object139:head# 2020-11-12T17:29:36.884 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.884 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f59f3b8c:::benchmark_data_smithi036_29033_object2108:head# 2020-11-12T17:29:36.885 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.885 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f5a5d3ce:::benchmark_data_smithi036_29033_object1835:head# 2020-11-12T17:29:36.885 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.885 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f5bdf73a:::benchmark_data_smithi036_29033_object3348:head# 2020-11-12T17:29:36.885 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.885 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f5e2ff30:::benchmark_data_smithi036_29033_object2230:head# 2020-11-12T17:29:36.885 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.885 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f5ed1d0b:::benchmark_data_smithi036_29033_object338:head# 2020-11-12T17:29:36.886 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.886 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f5f3d679:::benchmark_data_smithi036_29033_object2704:head# 2020-11-12T17:29:36.886 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.886 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f5f85d81:::benchmark_data_smithi036_29033_object1560:head# 2020-11-12T17:29:36.886 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.886 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f6291235:::benchmark_data_smithi036_29033_object706:head# 2020-11-12T17:29:36.886 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.887 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f63dc581:::benchmark_data_smithi036_29033_object2573:head# 2020-11-12T17:29:36.887 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.887 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f6418db3:::benchmark_data_smithi036_29033_object3388:head# 2020-11-12T17:29:36.887 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.887 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f64fc539:::benchmark_data_smithi036_29033_object1370:head# 2020-11-12T17:29:36.887 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.897 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f655eeab:::benchmark_data_smithi036_29033_object1467:head# 2020-11-12T17:29:36.898 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.898 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f6578419:::benchmark_data_smithi036_29033_object263:head# 2020-11-12T17:29:36.898 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.898 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f68f39ae:::benchmark_data_smithi036_29033_object3694:head# 2020-11-12T17:29:36.898 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.898 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f6ab204b:::benchmark_data_smithi036_29033_object125:head# 2020-11-12T17:29:36.899 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.899 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f6b5d510:::benchmark_data_smithi036_29033_object1781:head# 2020-11-12T17:29:36.899 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.899 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f6b79cd0:::benchmark_data_smithi036_29033_object653:head# 2020-11-12T17:29:36.899 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.899 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f6c76190:::benchmark_data_smithi036_29033_object1448:head# 2020-11-12T17:29:36.899 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.900 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7038760:::benchmark_data_smithi036_29033_object1596:head# 2020-11-12T17:29:36.900 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.900 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f70efefa:::benchmark_data_smithi036_29033_object206:head# 2020-11-12T17:29:36.900 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.900 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f71040fd:::benchmark_data_smithi036_29033_object1032:head# 2020-11-12T17:29:36.900 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.900 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f717f5a4:::benchmark_data_smithi036_29033_object3439:head# 2020-11-12T17:29:36.900 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.901 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f71bdce0:::benchmark_data_smithi036_29033_object1152:head# 2020-11-12T17:29:36.901 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.901 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7289f7f:::benchmark_data_smithi036_29033_object1073:head# 2020-11-12T17:29:36.901 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.901 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7314257:::benchmark_data_smithi036_29033_object416:head# 2020-11-12T17:29:36.901 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.901 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7572a8a:::benchmark_data_smithi036_29033_object2137:head# 2020-11-12T17:29:36.902 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.902 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f759d298:::benchmark_data_smithi036_29033_object1400:head# 2020-11-12T17:29:36.902 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.902 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f77b830a:::benchmark_data_smithi036_29033_object1613:head# 2020-11-12T17:29:36.902 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.902 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7959d11:::benchmark_data_smithi036_29033_object3366:head# 2020-11-12T17:29:36.903 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.903 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7a07028:::benchmark_data_smithi036_29033_object1788:head# 2020-11-12T17:29:36.903 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.903 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7a23f52:::benchmark_data_smithi036_29033_object1077:head# 2020-11-12T17:29:36.903 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.903 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7b35c9b:::benchmark_data_smithi036_29033_object1018:head# 2020-11-12T17:29:36.903 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.904 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7b7fc55:::benchmark_data_smithi036_29033_object1339:head# 2020-11-12T17:29:36.904 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.904 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7dcad23:::benchmark_data_smithi036_29033_object1513:head# 2020-11-12T17:29:36.904 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.904 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7e230a0:::benchmark_data_smithi036_29033_object1527:head# 2020-11-12T17:29:36.904 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.904 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7e306d3:::benchmark_data_smithi036_29033_object2810:head# 2020-11-12T17:29:36.905 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.905 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7ee31b8:::benchmark_data_smithi036_29033_object2664:head# 2020-11-12T17:29:36.905 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.905 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7eec199:::benchmark_data_smithi036_29033_object2188:head# 2020-11-12T17:29:36.905 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.905 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f7f49965:::benchmark_data_smithi036_29033_object687:head# 2020-11-12T17:29:36.905 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.906 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f80e783e:::benchmark_data_smithi036_29033_object1223:head# 2020-11-12T17:29:36.906 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.906 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8127ad7:::benchmark_data_smithi036_29033_object2134:head# 2020-11-12T17:29:36.906 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.906 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8143cf9:::benchmark_data_smithi036_29033_object2606:head# 2020-11-12T17:29:36.906 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.906 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f819f57e:::benchmark_data_smithi036_29033_object2502:head# 2020-11-12T17:29:36.907 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.907 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f825b8c6:::benchmark_data_smithi036_29033_object3400:head# 2020-11-12T17:29:36.907 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.907 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f82d70b7:::benchmark_data_smithi036_29033_object2685:head# 2020-11-12T17:29:36.907 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.907 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f830825c:::benchmark_data_smithi036_29033_object3122:head# 2020-11-12T17:29:36.907 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.907 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8480516:::benchmark_data_smithi036_29033_object2239:head# 2020-11-12T17:29:36.908 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.908 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f85dc749:::benchmark_data_smithi036_29033_object410:head# 2020-11-12T17:29:36.908 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.908 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f861bdd8:::benchmark_data_smithi036_29033_object1253:head# 2020-11-12T17:29:36.908 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:36.908 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f86c84ab:::benchmark_data_smithi036_29033_object2927:head# 2020-11-12T17:29:37.110 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.110 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8749693:::benchmark_data_smithi036_29033_object238:head# 2020-11-12T17:29:37.110 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.111 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8763da8:::benchmark_data_smithi036_29033_object610:head# 2020-11-12T17:29:37.111 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.111 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f88d0818:::benchmark_data_smithi036_29033_object3600:head# 2020-11-12T17:29:37.111 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.111 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8a120ae:::benchmark_data_smithi036_29033_object1050:head# 2020-11-12T17:29:37.111 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.112 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8af772e:::benchmark_data_smithi036_29033_object3165:head# 2020-11-12T17:29:37.112 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.112 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8b7f4df:::benchmark_data_smithi036_29033_object2892:head# 2020-11-12T17:29:37.112 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.112 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8eead36:::benchmark_data_smithi036_29033_object843:head# 2020-11-12T17:29:37.112 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.113 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8f4bad2:::benchmark_data_smithi036_29033_object2778:head# 2020-11-12T17:29:37.113 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.113 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f8f87c5d:::benchmark_data_smithi036_29033_object2069:head# 2020-11-12T17:29:37.113 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.114 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f911ac89:::benchmark_data_smithi036_29033_object34:head# 2020-11-12T17:29:37.114 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.114 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f92653ba:::benchmark_data_smithi036_29033_object3020:head# 2020-11-12T17:29:37.114 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.114 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f930a4b4:::benchmark_data_smithi036_29033_object952:head# 2020-11-12T17:29:37.115 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.115 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f93317d0:::benchmark_data_smithi036_29033_object3002:head# 2020-11-12T17:29:37.115 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.115 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f938cc9d:::benchmark_data_smithi036_29033_object426:head# 2020-11-12T17:29:37.116 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.116 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f93fc2c3:::benchmark_data_smithi036_29033_object1668:head# 2020-11-12T17:29:37.116 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.116 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f947acef:::benchmark_data_smithi036_29033_object1761:head# 2020-11-12T17:29:37.116 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.117 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f9699926:::benchmark_data_smithi036_29033_object2546:head# 2020-11-12T17:29:37.117 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.117 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f96eca3c:::benchmark_data_smithi036_29033_object779:head# 2020-11-12T17:29:37.117 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.117 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f971832c:::benchmark_data_smithi036_29033_object2944:head# 2020-11-12T17:29:37.117 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.118 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f97911b0:::benchmark_data_smithi036_29033_object1645:head# 2020-11-12T17:29:37.118 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.118 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f98bd1ea:::benchmark_data_smithi036_29033_object2424:head# 2020-11-12T17:29:37.118 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.118 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f9a0b7c9:::benchmark_data_smithi036_29033_object384:head# 2020-11-12T17:29:37.118 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.118 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f9b0b730:::benchmark_data_smithi036_29033_object1521:head# 2020-11-12T17:29:37.118 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.119 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f9caf954:::benchmark_data_smithi036_29033_object701:head# 2020-11-12T17:29:37.119 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.119 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f9d67cdb:::benchmark_data_smithi036_29033_object2224:head# 2020-11-12T17:29:37.120 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.120 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f9e7f8e2:::benchmark_data_smithi036_29033_object1913:head# 2020-11-12T17:29:37.120 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.120 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f9efe149:::benchmark_data_smithi036_29033_object2824:head# 2020-11-12T17:29:37.120 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.120 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:f9fcc2f6:::benchmark_data_smithi036_29033_object235:head# 2020-11-12T17:29:37.120 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.121 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa00f7dc:::benchmark_data_smithi036_29033_object1378:head# 2020-11-12T17:29:37.121 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.121 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa171163:::benchmark_data_smithi036_29033_object831:head# 2020-11-12T17:29:37.121 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.121 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa32f84f:::benchmark_data_smithi036_29033_object3463:head# 2020-11-12T17:29:37.121 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.121 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa3a12f9:::benchmark_data_smithi036_29033_object1079:head# 2020-11-12T17:29:37.122 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.122 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa3d941a:::benchmark_data_smithi036_29033_object3288:head# 2020-11-12T17:29:37.122 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.122 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa44f021:::benchmark_data_smithi036_29033_object1322:head# 2020-11-12T17:29:37.122 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.123 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa5e2f61:::benchmark_data_smithi036_29033_object3572:head# 2020-11-12T17:29:37.123 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.123 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa657939:::benchmark_data_smithi036_29033_object1047:head# 2020-11-12T17:29:37.123 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.123 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa83ca74:::benchmark_data_smithi036_29033_object3015:head# 2020-11-12T17:29:37.123 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.123 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa85e5fd:::benchmark_data_smithi036_29033_object3294:head# 2020-11-12T17:29:37.123 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.124 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa915a4b:::benchmark_data_smithi036_29033_object3162:head# 2020-11-12T17:29:37.124 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.124 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa926b1e:::benchmark_data_smithi036_29033_object1336:head# 2020-11-12T17:29:37.124 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.124 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fa997294:::benchmark_data_smithi036_29033_object2370:head# 2020-11-12T17:29:37.124 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.124 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:faa1d5d1:::benchmark_data_smithi036_29033_object679:head# 2020-11-12T17:29:37.125 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.125 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:faaf3272:::benchmark_data_smithi036_29033_object3184:head# 2020-11-12T17:29:37.125 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.125 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fac0348d:::benchmark_data_smithi036_29033_object2934:head# 2020-11-12T17:29:37.125 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.125 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fad703b3:::benchmark_data_smithi036_29033_object963:head# 2020-11-12T17:29:37.125 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.126 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fad93ed6:::benchmark_data_smithi036_29033_object1133:head# 2020-11-12T17:29:37.126 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.126 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:faffa96a:::benchmark_data_smithi036_29033_object2380:head# 2020-11-12T17:29:37.126 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.126 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fb027da7:::benchmark_data_smithi036_29033_object1685:head# 2020-11-12T17:29:37.126 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.126 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fb08a085:::benchmark_data_smithi036_29033_object1607:head# 2020-11-12T17:29:37.127 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.127 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fb262a8f:::benchmark_data_smithi036_29033_object1647:head# 2020-11-12T17:29:37.127 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.127 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fb275b45:::benchmark_data_smithi036_29033_object2515:head# 2020-11-12T17:29:37.127 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.127 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fb569310:::benchmark_data_smithi036_29033_object1589:head# 2020-11-12T17:29:37.127 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.127 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fb73b0d5:::benchmark_data_smithi036_29033_object2636:head# 2020-11-12T17:29:37.128 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.128 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fb788974:::benchmark_data_smithi036_29033_object1331:head# 2020-11-12T17:29:37.128 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.330 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fb7fee57:::benchmark_data_smithi036_29033_object1658:head# 2020-11-12T17:29:37.330 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.330 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fb90c5f7:::benchmark_data_smithi036_29033_object3336:head# 2020-11-12T17:29:37.331 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.331 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fbb739f6:::benchmark_data_smithi036_29033_object3526:head# 2020-11-12T17:29:37.331 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.331 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fbbc9c8f:::benchmark_data_smithi036_29033_object39:head# 2020-11-12T17:29:37.331 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.331 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fbdb0153:::benchmark_data_smithi036_29033_object815:head# 2020-11-12T17:29:37.332 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.332 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fbdcef58:::benchmark_data_smithi036_29033_object1575:head# 2020-11-12T17:29:37.332 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.332 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fbeda772:::benchmark_data_smithi036_29033_object1705:head# 2020-11-12T17:29:37.332 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.332 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fbffe9c3:::benchmark_data_smithi036_29033_object1694:head# 2020-11-12T17:29:37.333 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.333 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc0a329e:::benchmark_data_smithi036_29033_object2561:head# 2020-11-12T17:29:37.333 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.333 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc0f8532:::benchmark_data_smithi036_29033_object3060:head# 2020-11-12T17:29:37.333 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.333 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc1fdfc4:::benchmark_data_smithi036_29033_object1985:head# 2020-11-12T17:29:37.333 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.333 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc2905e4:::benchmark_data_smithi036_29033_object174:head# 2020-11-12T17:29:37.334 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.334 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc4ead24:::benchmark_data_smithi036_29033_object1894:head# 2020-11-12T17:29:37.334 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.334 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc510e19:::benchmark_data_smithi036_29033_object401:head# 2020-11-12T17:29:37.334 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.334 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc61626d:::benchmark_data_smithi036_29033_object55:head# 2020-11-12T17:29:37.334 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.335 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc655796:::benchmark_data_smithi036_29033_object3339:head# 2020-11-12T17:29:37.335 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.335 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc699a05:::benchmark_data_smithi036_29033_object481:head# 2020-11-12T17:29:37.335 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.335 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc77bb22:::benchmark_data_smithi036_29033_object257:head# 2020-11-12T17:29:37.335 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.335 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc7e1550:::benchmark_data_smithi036_29033_object25:head# 2020-11-12T17:29:37.336 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.336 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc8cc9d0:::benchmark_data_smithi036_29033_object2595:head# 2020-11-12T17:29:37.336 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.336 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fc915dc3:::benchmark_data_smithi036_29033_object3103:head# 2020-11-12T17:29:37.336 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.336 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fcbfd082:::benchmark_data_smithi036_29033_object978:head# 2020-11-12T17:29:37.336 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.336 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fcc3b4eb:::benchmark_data_smithi036_29033_object660:head# 2020-11-12T17:29:37.337 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.337 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fccac580:::benchmark_data_smithi036_29033_object452:head# 2020-11-12T17:29:37.337 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.337 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fccdb1a5:::benchmark_data_smithi036_29033_object2853:head# 2020-11-12T17:29:37.337 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.337 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fcce5841:::benchmark_data_smithi036_29033_object1676:head# 2020-11-12T17:29:37.337 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.338 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fcea30bc:::benchmark_data_smithi036_29033_object2483:head# 2020-11-12T17:29:37.338 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.338 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd003360:::benchmark_data_smithi036_29033_object3134:head# 2020-11-12T17:29:37.338 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.338 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd008dd2:::benchmark_data_smithi036_29033_object1717:head# 2020-11-12T17:29:37.338 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.338 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd1e218f:::benchmark_data_smithi036_29033_object1703:head# 2020-11-12T17:29:37.338 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.339 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd241188:::benchmark_data_smithi036_29033_object1477:head# 2020-11-12T17:29:37.339 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.339 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd2fd347:::benchmark_data_smithi036_29033_object1578:head# 2020-11-12T17:29:37.339 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.339 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd4030e9:::benchmark_data_smithi036_29033_object3468:head# 2020-11-12T17:29:37.339 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.339 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd4b6dc4:::benchmark_data_smithi036_29033_object1338:head# 2020-11-12T17:29:37.340 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.340 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd72b722:::benchmark_data_smithi036_29033_object3340:head# 2020-11-12T17:29:37.340 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.340 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd7f9319:::benchmark_data_smithi036_29033_object1191:head# 2020-11-12T17:29:37.340 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.340 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fd9a25ca:::benchmark_data_smithi036_29033_object1865:head# 2020-11-12T17:29:37.546 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.607 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fda01f34:::benchmark_data_smithi036_29033_object1285:head# 2020-11-12T17:29:37.608 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.608 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fda459c4:::benchmark_data_smithi036_29033_object845:head# 2020-11-12T17:29:37.608 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.608 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fda5b3fb:::benchmark_data_smithi036_29033_object2482:head# 2020-11-12T17:29:37.608 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.609 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fdaa9410:::benchmark_data_smithi036_29033_object3473:head# 2020-11-12T17:29:37.609 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.609 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fdbf2533:::benchmark_data_smithi036_29033_object810:head# 2020-11-12T17:29:37.609 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.609 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fddb820a:::benchmark_data_smithi036_29033_object817:head# 2020-11-12T17:29:37.609 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.609 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fdeda6d1:::benchmark_data_smithi036_29033_object625:head# 2020-11-12T17:29:37.610 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.610 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe071eff:::benchmark_data_smithi036_29033_object3324:head# 2020-11-12T17:29:37.610 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.610 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe0bf900:::benchmark_data_smithi036_29033_object2329:head# 2020-11-12T17:29:37.610 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.610 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe19eea7:::benchmark_data_smithi036_29033_object247:head# 2020-11-12T17:29:37.611 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.611 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe392337:::benchmark_data_smithi036_29033_object1125:head# 2020-11-12T17:29:37.611 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.611 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe534b76:::benchmark_data_smithi036_29033_object548:head# 2020-11-12T17:29:37.611 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.611 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe5db6d2:::benchmark_data_smithi036_29033_object3588:head# 2020-11-12T17:29:37.612 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.612 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe6905ae:::benchmark_data_smithi036_29033_object3179:head# 2020-11-12T17:29:37.612 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.612 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe863362:::benchmark_data_smithi036_29033_object2139:head# 2020-11-12T17:29:37.612 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.612 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe8b5808:::benchmark_data_smithi036_29033_object2420:head# 2020-11-12T17:29:37.613 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.613 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe8b9173:::benchmark_data_smithi036_29033_object1827:head# 2020-11-12T17:29:37.613 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.613 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe8d9db2:::benchmark_data_smithi036_29033_object1469:head# 2020-11-12T17:29:37.613 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.613 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fe9e60f5:::benchmark_data_smithi036_29033_object3325:head# 2020-11-12T17:29:37.614 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.614 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fea5acfb:::benchmark_data_smithi036_29033_object1497:head# 2020-11-12T17:29:37.614 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.614 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:feacab4b:::benchmark_data_smithi036_29033_object3299:head# 2020-11-12T17:29:37.614 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.614 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:feb81029:::benchmark_data_smithi036_29033_object110:head# 2020-11-12T17:29:37.614 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.615 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:febdd704:::benchmark_data_smithi036_29033_object1654:head# 2020-11-12T17:29:37.615 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.618 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fed04e8d:::benchmark_data_smithi036_29033_object2033:head# 2020-11-12T17:29:37.619 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.619 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fee00e8d:::benchmark_data_smithi036_29033_object258:head# 2020-11-12T17:29:37.619 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.619 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fef631b1:::benchmark_data_smithi036_29033_object1914:head# 2020-11-12T17:29:37.619 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.619 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:ff01d3ce:::benchmark_data_smithi036_29033_object131:head# 2020-11-12T17:29:37.620 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.620 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:ff0899d0:::benchmark_data_smithi036_29033_object1488:head# 2020-11-12T17:29:37.620 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.620 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:ff0a2595:::benchmark_data_smithi036_29033_object2090:head# 2020-11-12T17:29:37.620 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.620 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:ff770895:::benchmark_data_smithi036_29033_object1563:head# 2020-11-12T17:29:37.621 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.621 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:ff843c57:::benchmark_data_smithi036_29033_object2867:head# 2020-11-12T17:29:37.621 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.621 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:ff8f0dd1:::benchmark_data_smithi036_29033_object2392:head# 2020-11-12T17:29:37.621 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.621 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:ff9992a5:::benchmark_data_smithi036_29033_object2415:head# 2020-11-12T17:29:37.622 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.622 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:ff9dc5f0:::benchmark_data_smithi036_29033_object3605:head# 2020-11-12T17:29:37.622 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.622 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:ffc16a3d:::benchmark_data_smithi036_29033_object2968:head# 2020-11-12T17:29:37.622 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.623 INFO:teuthology.orchestra.run.smithi036.stdout:Write #6:fff70b25:::benchmark_data_smithi036_29033_object567:head# 2020-11-12T17:29:37.623 INFO:teuthology.orchestra.run.smithi036.stdout:snapset 0=[]:{} 2020-11-12T17:29:37.623 INFO:teuthology.orchestra.run.smithi036.stdout:write_pg epoch 205 info 6.f( v 205'2096 (0'0,205'2096] local-lis/les=190/191 n=262 ec=190/190 lis/c=190/190 les/c/f=191/191/0 sis=190) 2020-11-12T17:29:37.623 INFO:teuthology.orchestra.run.smithi036.stdout:Import successful 2020-11-12T17:29:37.623 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:37.624 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:37.624 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:29:37.629 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:29:36.527613+0000 min lat: 0.00229077 max lat: 1.0374 avg lat: 0.0157766 2020-11-12T17:29:37.629 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:29:37.629 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 60 16 29904 29888 3.89125 0 - 0.0157766 2020-11-12T17:29:37.630 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:36.835+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:37.630 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:29:37.631 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:29:37.633 INFO:teuthology.orchestra.run.smithi036:> sudo rm -f /var/log/ceph/exp.6.f.2 2020-11-12T17:29:37.633 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 61 16 29904 29888 3.82746 0 - 0.0157766 2020-11-12T17:29:37.634 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:37.627+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:37.701 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-11-12T17:29:37.732 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:37.727+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:37.795 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:37.795 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:37.807 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:29:37.836 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:37.837 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:37.834+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:37.879 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:37.908 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:37.924 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:37.924 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:37.925 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:29:37.925 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:37.933 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:29:37.934 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:37.931+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:37.936 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:37.978 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:38.005 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:38.018 INFO:teuthology.orchestra.run.smithi036.stdout: 2020-11-12T17:29:38.019 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":218,"fsid":"8c8a6bcc-49d4-47d1-904f-e20798ef8e1f","created":"2020-11-12T17:22:37.581394+0000","modified":"2020-11-12T17:29:37.445378+0000","last_up_change":"2020-11-12T17:29:06.765591+0000","last_in_change":"2020-11-12T17:28:33.422645+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-12T17:22:41.596657+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-12T17:22:49.905816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":18,"pg_placement_num":18,"pg_placement_num_target":18,"pg_num_target":18,"pg_num_pending":18,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"163","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"unique_pool_3","create_time":"2020-11-12T17:28:33.923168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"bd1d5457-5d54-4074-b378-9da417f42976","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6801","nonce":12304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6802","nonce":12304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6806","nonce":12304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6804","nonce":12304}]},"public_addr":"172.21.15.36:6801/12304","cluster_addr":"172.21.15.36:6802/12304","heartbeat_back_addr":"172.21.15.36:6806/12304","heartbeat_front_addr":"172.21.15.36:6804/12304","state":["exists","up"]},{"osd":1,"uuid":"37152eee-a8d8-40f1-8e27-2899e7b94c98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":57,"up_from":88,"up_thru":206,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6812","nonce":20274}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6814","nonce":20274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6816","nonce":20274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6815","nonce":20274}]},"public_addr":"172.21.15.36:6812/20274","cluster_addr":"172.21.15.36:6814/20274","heartbeat_back_addr":"172.21.15.36:6816/20274","heartbeat_front_addr":"172.21.15.36:6815/20274","state":["exists","up"]},{"osd":2,"uuid":"d8ec2abb-38bf-4863-969a-482c4fa44f41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":93,"up_from":102,"up_thru":190,"down_at":206,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6803","nonce":21493}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6805","nonce":21493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6808","nonce":21493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6807","nonce":21493}]},"public_addr":"172.21.15.36:6803/21493","cluster_addr":"172.21.15.36:6805/21493","heartbeat_back_addr":"172.21.15.36:6808/21493","heartbeat_front_addr":"172.21.15.36:6807/21493","state":["exists"]},{"osd":3,"uuid":"799d3499-577c-4510-a00c-9b2e126fc449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6809","nonce":12305}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6810","nonce":12305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6813","nonce":12305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.36:6811","nonce":12305}]},"public_addr":"172.21.15.36:6809/12305","cluster_addr":"172.21.15.36:6810/12305","heartbeat_back_addr":"172.21.15.36:6813/12305","heartbeat_front_addr":"172.21.15.36:6811/12305","state":["exists","up"]},{"osd":4,"uuid":"c36e3100-aadc-4117-b495-24fb08a34148","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":193,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6804","nonce":12499}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6805","nonce":12499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6807","nonce":12499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6806","nonce":12499}]},"public_addr":"172.21.15.205:6804/12499","cluster_addr":"172.21.15.205:6805/12499","heartbeat_back_addr":"172.21.15.205:6807/12499","heartbeat_front_addr":"172.21.15.205:6806/12499","state":["exists","up"]},{"osd":5,"uuid":"b152141f-b530-448e-8dff-fe200559eff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6808","nonce":12525}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6810","nonce":12525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6814","nonce":12525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6812","nonce":12525}]},"public_addr":"172.21.15.205:6808/12525","cluster_addr":"172.21.15.205:6810/12525","heartbeat_back_addr":"172.21.15.205:6814/12525","heartbeat_front_addr":"172.21.15.205:6812/12525","state":["exists","up"]},{"osd":6,"uuid":"62a140ba-7f94-4bb6-8a62-fda077f81354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6809","nonce":12524}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6811","nonce":12524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6815","nonce":12524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6813","nonce":12524}]},"public_addr":"172.21.15.205:6809/12524","cluster_addr":"172.21.15.205:6811/12524","heartbeat_back_addr":"172.21.15.205:6815/12524","heartbeat_front_addr":"172.21.15.205:6813/12524","state":["exists","up"]},{"osd":7,"uuid":"32879bd7-780c-4da6-9838-5850b6277902","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6800","nonce":12522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6801","nonce":12522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6803","nonce":12522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.205:6802","nonce":12522}]},"public_addr":"172.21.15.205:6800/12522","cluster_addr":"172.21.15.205:6801/12522","heartbeat_back_addr":"172.21.15.205:6803/12522","heartbeat_front_addr":"172.21.15.205:6802/12522","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:28:44.632395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:29:35.063518+0000","dead_epoch":58},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:28:57.265332+0000","dead_epoch":206},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:28:47.244699+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:28:47.191567+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:28:47.979604+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:28:45.202785+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-11-12T17:28:47.010037+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-11-12T17:29:38.037 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-12T17:22:41.596657+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-12T17:22:49.905816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 18, 'pg_placement_num': 18, 'pg_placement_num_target': 18, 'pg_num_target': 18, 'pg_num_pending': 18, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '163', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'unique_pool_3', 'create_time': '2020-11-12T17:28:33.923168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}] 2020-11-12T17:29:38.039 INFO:teuthology.orchestra.run.smithi036:> CEPH_ARGS='--filestore-merge-threshold 1 --filestore-split-multiple 1' sudo -E ceph-objectstore-tool --no-mon-config --log-file=/var/log/ceph/objectstore_tool.$pid.log --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op apply-layout-settings --pool device_health_metrics 2020-11-12T17:29:38.040 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:38.041 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:38.041 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:29:38.041 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:29:38.041 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:38.041 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:29:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:29:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:29:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:29:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:29:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:29:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:29:38.043 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:38.043 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:38.044 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:38.038+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:38.047 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:29:38.141 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:38.139+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:38.197 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:38.300 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:29:38.301 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:29:38.301 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:29:38.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.302 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:29:38.302 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:38.302 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 383.77597542799998, 2020-11-12T17:29:38.302 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:29:38.303 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.303 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.303 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.304 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:38.304 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:38.304 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:29:38.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.305 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.306 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.307 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:38.307 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.308 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.308 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:38.308 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:29:38.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.309 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.309 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:29:38.310 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:29:38.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.311 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.311 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:29:38.311 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:29:38.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:29:38.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:29:38.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.314 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:29:38.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:29:38.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.315 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.315 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:29:38.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:29:38.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:29:38.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:29:38.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:38.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:29:38.371 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:29:38.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:29:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:29:38.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:29:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:29:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:29:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:29:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:29:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:29:38.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:29:38.376 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 383.76903136599998, 2020-11-12T17:29:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:29:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.377 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:38.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:29:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:29:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:29:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:29:38.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:29:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:29:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:29:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:29:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.382 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:29:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:29:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.383 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:29:38.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:29:38.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.384 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.384 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:29:38.384 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:29:38.385 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.385 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.385 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.385 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:29:38.385 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:38.385 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 347.59519358, 2020-11-12T17:29:38.386 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:29:38.386 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.386 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.386 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.386 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:38.386 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:38.386 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:29:38.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.387 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.387 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.387 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:38.387 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:38.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:29:38.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.388 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.388 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:29:38.388 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:29:38.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.389 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.389 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:29:38.389 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:29:38.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:29:38.390 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:29:38.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.390 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.390 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:29:38.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:29:38.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.391 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.391 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:29:38.391 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:29:38.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.392 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.392 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:29:38.392 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:29:38.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.393 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:29:38.393 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:29:38.393 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:29:38.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.394 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.394 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:29:38.394 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:29:38.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.395 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:29:38.395 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:29:38.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.395 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.396 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:29:38.396 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:29:38.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.397 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.397 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:29:38.397 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:29:38.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.397 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.398 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:29:38.398 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:38.398 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 331.331488487, 2020-11-12T17:29:38.399 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:29:38.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:38.399 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:38.400 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:29:38.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.400 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.400 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:38.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.401 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.401 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:38.401 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:38.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.406 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.406 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:29:38.407 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:29:38.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.408 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.408 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:29:38.408 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:29:38.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.409 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.410 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:29:38.410 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:29:38.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.411 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.411 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:29:38.411 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:29:38.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.413 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:29:38.413 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:29:38.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.413 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:29:38.414 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:29:38.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.414 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:38.414 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:29:38.415 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:29:38.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.416 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:29:38.416 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:29:38.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.416 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:29:38.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:29:38.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.417 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.417 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:29:38.417 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:29:38.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.418 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.418 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:29:38.418 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:29:38.418 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.418 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.418 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.419 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:29:38.419 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:38.419 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 316.246108161, 2020-11-12T17:29:38.419 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:29:38.419 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.420 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.420 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.420 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.420 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:38.420 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:38.421 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:29:38.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.421 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.421 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:29:38.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:29:38.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.422 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.422 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:29:38.422 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:29:38.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:29:38.423 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:29:38.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.423 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.423 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:29:38.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:29:38.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.424 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.424 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:29:38.424 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:29:38.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:29:38.425 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:29:38.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.425 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.425 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:29:38.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:29:38.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.426 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.426 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:29:38.426 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:29:38.427 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.427 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.427 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.427 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:29:38.427 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:38.427 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 314.55196988699998, 2020-11-12T17:29:38.428 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:29:38.428 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.428 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.428 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.428 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:38.428 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:38.428 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:29:38.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.429 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.429 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.429 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:38.429 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.454 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.454 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:38.454 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:29:38.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.455 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.455 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:29:38.455 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:29:38.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:29:38.456 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:29:38.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.456 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.456 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:29:38.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:29:38.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.457 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.457 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:29:38.457 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:29:38.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:29:38.458 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:29:38.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.458 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.458 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:29:38.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:29:38.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.459 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:38.459 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:29:38.459 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:29:38.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:29:38.460 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:29:38.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.460 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.460 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:29:38.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:29:38.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.461 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.461 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:29:38.461 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:29:38.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.462 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.462 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:29:38.462 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:29:38.462 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.462 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.462 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.463 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:29:38.463 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:38.463 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 246.28855833700001, 2020-11-12T17:29:38.463 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:29:38.463 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.463 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.463 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.464 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:38.464 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:38.464 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:29:38.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.464 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:38.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.465 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.465 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:38.465 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:38.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.466 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.466 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:29:38.466 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:29:38.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:29:38.467 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:29:38.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.467 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.467 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:29:38.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:29:38.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.468 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.468 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:29:38.468 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:29:38.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:29:38.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:29:38.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.469 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.469 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:29:38.469 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:29:38.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.470 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:38.470 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:29:38.470 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:29:38.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:29:38.471 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:29:38.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.471 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.471 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:29:38.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:29:38.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.472 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.472 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:29:38.472 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:29:38.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.473 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.473 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:29:38.473 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:29:38.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.473 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.474 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:29:38.474 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:38.474 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 241.48611943899999, 2020-11-12T17:29:38.474 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:29:38.475 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.475 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.475 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.475 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:38.475 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:38.475 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:29:38.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.476 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.476 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.476 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:38.476 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:38.477 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:29:38.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.477 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.477 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:29:38.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:29:38.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.478 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.478 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:29:38.478 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:29:38.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:29:38.479 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:29:38.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.479 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.479 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:29:38.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:29:38.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.480 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.480 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:29:38.480 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:29:38.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.481 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:29:38.481 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:29:38.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.481 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:38.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:29:38.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:29:38.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.482 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.482 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:29:38.482 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:29:38.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.483 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:29:38.483 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:29:38.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.483 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:29:38.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:29:38.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.484 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.484 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:29:38.484 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:29:38.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.485 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.485 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.485 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:29:38.485 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:38.485 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 241.40699712200001, 2020-11-12T17:29:38.485 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:29:38.486 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.486 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:38.486 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:38.486 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:29:38.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.487 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.487 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.487 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:38.487 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:38.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:29:38.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.488 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.488 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:29:38.488 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:29:38.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.489 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.489 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:29:38.489 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:29:38.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:29:38.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:29:38.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.490 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.490 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:29:38.490 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:29:38.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.491 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:29:38.491 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:29:38.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.491 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:29:38.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:29:38.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.492 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:38.492 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:29:38.492 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:29:38.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.493 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.493 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:29:38.493 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:29:38.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.494 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:29:38.494 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:29:38.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.494 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:29:38.495 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:29:38.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.495 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.495 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:29:38.496 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:29:38.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.496 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.496 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:29:38.496 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:38.497 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 216.62464615499999, 2020-11-12T17:29:38.497 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:29:38.497 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.497 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.497 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.497 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:38.497 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:38.498 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:29:38.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.498 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.498 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.498 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:38.498 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.499 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:38.499 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:29:38.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.499 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:29:38.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:29:38.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.500 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.500 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:29:38.500 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:29:38.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.501 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:29:38.501 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:29:38.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.501 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:29:38.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:29:38.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.502 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.502 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:29:38.502 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:29:38.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.503 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.503 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:29:38.503 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:29:38.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:38.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:29:38.504 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:29:38.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.504 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.504 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:29:38.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:29:38.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.505 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.505 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:29:38.505 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:29:38.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.506 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:29:38.506 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:29:38.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.506 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.507 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:29:38.507 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:29:38.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.507 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.507 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:29:38.508 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:38.508 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 156.13984465499999, 2020-11-12T17:29:38.508 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:29:38.508 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.508 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.508 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.508 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:38.508 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:38.509 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:29:38.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.509 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.509 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.509 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:38.509 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.510 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:38.510 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:38.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.510 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:29:38.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:29:38.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.511 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.511 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:29:38.511 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:29:38.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.512 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:29:38.512 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:29:38.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.512 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:29:38.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:29:38.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.513 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.513 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:29:38.513 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:29:38.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.514 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:29:38.514 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:29:38.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.514 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:38.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:29:38.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:29:38.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.515 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.515 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:29:38.515 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:29:38.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:29:38.516 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:29:38.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.516 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.516 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:29:38.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:29:38.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.517 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.517 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:29:38.517 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:29:38.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.518 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:29:38.518 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:38.518 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 134.07848498499999, 2020-11-12T17:29:38.519 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:29:38.519 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.519 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.519 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.519 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:38.519 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:38.519 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:29:38.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.520 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.520 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.520 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:38.520 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:38.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:29:38.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.521 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.521 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:29:38.521 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:29:38.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:29:38.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:29:38.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:29:38.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:29:38.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:29:38.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:29:38.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:29:38.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:29:38.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:29:38.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:29:38.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:38.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:29:38.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:29:38.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:29:38.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:29:38.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:29:38.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:29:38.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.546 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:29:38.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:29:38.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.547 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:29:38.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:29:38.547 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.547 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.547 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.548 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:59192 5.0 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e168)", 2020-11-12T17:29:38.548 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:38.548 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 104.391786193, 2020-11-12T17:29:38.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003, 2020-11-12T17:29:38.548 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.548 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.548 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.548 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:38.549 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:38.549 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 59192 2020-11-12T17:29:38.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.549 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:38.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.550 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.550 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:38.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:38.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802660+0000", 2020-11-12T17:29:38.551 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9094000000000001e-05 2020-11-12T17:29:38.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.551 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.551 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802709+0000", 2020-11-12T17:29:38.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9580000000000004e-06 2020-11-12T17:29:38.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.552 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.552 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802715+0000", 2020-11-12T17:29:38.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0690000000000002e-06 2020-11-12T17:29:38.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802719+0000", 2020-11-12T17:29:38.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010962786 2020-11-12T17:29:38.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813681+0000", 2020-11-12T17:29:38.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011702 2020-11-12T17:29:38.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813798+0000", 2020-11-12T17:29:38.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187436 2020-11-12T17:29:38.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:38.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813986+0000", 2020-11-12T17:29:38.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020009369999999999 2020-11-12T17:29:38.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.815987+0000", 2020-11-12T17:29:38.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46767350899999999 2020-11-12T17:29:38.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283660+0000", 2020-11-12T17:29:38.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3396e-05 2020-11-12T17:29:38.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283734+0000", 2020-11-12T17:29:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0195999999999998e-05 2020-11-12T17:29:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283784+0000", 2020-11-12T17:29:38.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003 2020-11-12T17:29:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59360 5.1 e169/127 5:8e053221:::benchmark_data_smithi036_24110_object7419:head v 169'3752, mlcod=169'3747)", 2020-11-12T17:29:38.558 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 103.49329892199999, 2020-11-12T17:29:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999, 2020-11-12T17:29:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.559 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:29:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701143+0000", 2020-11-12T17:29:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4913000000000006e-05 2020-11-12T17:29:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.561 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701218+0000", 2020-11-12T17:29:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45075755000000001 2020-11-12T17:29:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151975+0000", 2020-11-12T17:29:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7439999999999996e-06 2020-11-12T17:29:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151984+0000", 2020-11-12T17:29:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5661000000000001e-05 2020-11-12T17:29:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152040+0000", 2020-11-12T17:29:38.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0267e-05 2020-11-12T17:29:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152070+0000", 2020-11-12T17:29:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027662300000000002 2020-11-12T17:29:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154836+0000", 2020-11-12T17:29:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0707e-05 2020-11-12T17:29:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154897+0000", 2020-11-12T17:29:38.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999 2020-11-12T17:29:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:62424 5.1 e171/127 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head v 171'3992, mlcod=171'3984)", 2020-11-12T17:29:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:38.566 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 98.995538284999995, 2020-11-12T17:29:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437, 2020-11-12T17:29:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:38.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198896+0000", 2020-11-12T17:29:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9000999999999997e-05 2020-11-12T17:29:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198985+0000", 2020-11-12T17:29:38.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48058147200000001 2020-11-12T17:29:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679566+0000", 2020-11-12T17:29:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9140000000000003e-06 2020-11-12T17:29:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679576+0000", 2020-11-12T17:29:38.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1407000000000003e-05 2020-11-12T17:29:38.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679647+0000", 2020-11-12T17:29:38.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1270999999999999e-05 2020-11-12T17:29:38.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679679+0000", 2020-11-12T17:29:38.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002926648 2020-11-12T17:29:38.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682605+0000", 2020-11-12T17:29:38.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1626999999999998e-05 2020-11-12T17:29:38.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.573 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682667+0000", 2020-11-12T17:29:38.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437 2020-11-12T17:29:38.573 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.574 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.574 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.574 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:65088 5.1 e177/127 5:8edfd3fe:::benchmark_data_smithi036_24110_object8135:head v 177'4152, mlcod=177'4145)", 2020-11-12T17:29:38.574 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:38.574 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 86.012413496999997, 2020-11-12T17:29:38.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004, 2020-11-12T17:29:38.664 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.664 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.665 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:38.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:38.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:29:38.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182031+0000", 2020-11-12T17:29:38.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8371000000000001e-05 2020-11-12T17:29:38.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182090+0000", 2020-11-12T17:29:38.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64597910199999997 2020-11-12T17:29:38.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828069+0000", 2020-11-12T17:29:38.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6649999999999998e-06 2020-11-12T17:29:38.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828078+0000", 2020-11-12T17:29:38.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013253599999999999 2020-11-12T17:29:38.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828211+0000", 2020-11-12T17:29:38.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1916999999999999e-05 2020-11-12T17:29:38.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828253+0000", 2020-11-12T17:29:38.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00329598 2020-11-12T17:29:38.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:38.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831549+0000", 2020-11-12T17:29:38.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5890999999999996e-05 2020-11-12T17:29:38.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831615+0000", 2020-11-12T17:29:38.672 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004 2020-11-12T17:29:38.672 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.672 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.672 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.672 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:12064 6.0 e198/193 ondisk, result = 0)", 2020-11-12T17:29:38.672 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:38.673 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 50.323388651999998, 2020-11-12T17:29:38.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674, 2020-11-12T17:29:38.673 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.673 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:38.673 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.673 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:38.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.674 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.674 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:38.674 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:29:38.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871061+0000", 2020-11-12T17:29:38.675 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6056000000000002e-05 2020-11-12T17:29:38.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871097+0000", 2020-11-12T17:29:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59417804799999996 2020-11-12T17:29:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465275+0000", 2020-11-12T17:29:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1326e-05 2020-11-12T17:29:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465287+0000", 2020-11-12T17:29:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1495000000000001e-05 2020-11-12T17:29:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465338+0000", 2020-11-12T17:29:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4560000000000003e-06 2020-11-12T17:29:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465345+0000", 2020-11-12T17:29:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9233000000000004e-05 2020-11-12T17:29:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465435+0000", 2020-11-12T17:29:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674 2020-11-12T17:29:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.6159.0:15080 6.b 6:ded5ee56:::benchmark_data_smithi036_29033_object1884:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e199)", 2020-11-12T17:29:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.969630860000002, 2020-11-12T17:29:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999, 2020-11-12T17:29:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.6159", 2020-11-12T17:29:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:29:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 15080 2020-11-12T17:29:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:29:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224802+0000", 2020-11-12T17:29:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1513000000000003e-05 2020-11-12T17:29:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224893+0000", 2020-11-12T17:29:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7841000000000001e-05 2020-11-12T17:29:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224911+0000", 2020-11-12T17:29:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1224e-05 2020-11-12T17:29:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224922+0000", 2020-11-12T17:29:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9716000000000006e-05 2020-11-12T17:29:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225012+0000", 2020-11-12T17:29:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017505999999999999 2020-11-12T17:29:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225187+0000", 2020-11-12T17:29:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030063900000000001 2020-11-12T17:29:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225488+0000", 2020-11-12T17:29:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021279850000000002 2020-11-12T17:29:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.227616+0000", 2020-11-12T17:29:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60001606200000002 2020-11-12T17:29:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827632+0000", 2020-11-12T17:29:38.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3869000000000002e-05 2020-11-12T17:29:40.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.312 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:40.312 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827686+0000", 2020-11-12T17:29:40.313 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7774999999999997e-05 2020-11-12T17:29:40.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.313 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:40.313 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827724+0000", 2020-11-12T17:29:40.314 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999 2020-11-12T17:29:40.314 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:40.314 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:40.314 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:40.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.315 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:15080 6.b e199/190 ondisk, result = 0)", 2020-11-12T17:29:40.315 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:40.315 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.964684214000002, 2020-11-12T17:29:40.315 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005, 2020-11-12T17:29:40.315 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:40.315 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:40.315 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:40.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:40.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:40.316 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:40.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.316 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:40.316 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229750+0000", 2020-11-12T17:29:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7358000000000001e-05 2020-11-12T17:29:40.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229817+0000", 2020-11-12T17:29:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59622965400000005 2020-11-12T17:29:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.318 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826047+0000", 2020-11-12T17:29:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7509999999999997e-06 2020-11-12T17:29:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826052+0000", 2020-11-12T17:29:40.319 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001561729 2020-11-12T17:29:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827614+0000", 2020-11-12T17:29:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0472000000000001e-05 2020-11-12T17:29:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827625+0000", 2020-11-12T17:29:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106687 2020-11-12T17:29:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827731+0000", 2020-11-12T17:29:40.321 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005 2020-11-12T17:29:40.322 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:40.322 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:40.322 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:40.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.322 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.6159.0:15728 6.7 e199/190 6:e4c465ea:::benchmark_data_smithi036_29033_object1965:head v 199'1032, mlcod=199'1025)", 2020-11-12T17:29:40.322 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 46.255071481999998, 2020-11-12T17:29:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426, 2020-11-12T17:29:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.323 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:40.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:29:40.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.327 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:40.327 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939371+0000", 2020-11-12T17:29:40.327 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3385000000000002e-05 2020-11-12T17:29:40.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939455+0000", 2020-11-12T17:29:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40948674800000001 2020-11-12T17:29:40.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348941+0000", 2020-11-12T17:29:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3089999999999998e-06 2020-11-12T17:29:40.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348949+0000", 2020-11-12T17:29:40.330 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3567999999999998e-05 2020-11-12T17:29:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349022+0000", 2020-11-12T17:29:40.331 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2410999999999999e-05 2020-11-12T17:29:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349055+0000", 2020-11-12T17:29:40.332 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050284420000000002 2020-11-12T17:29:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354083+0000", 2020-11-12T17:29:40.333 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8516000000000005e-05 2020-11-12T17:29:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:40.334 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354162+0000", 2020-11-12T17:29:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426 2020-11-12T17:29:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:40.336 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:40.336 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:40.337 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:29:40.340 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:39.267+0000 7f2809aaf700 -1 osd.6 218 handle_osd_map injecting map crc failure 2020-11-12T17:29:40.340 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:39.267+0000 7f9a06aa2700 -1 osd.5 218 handle_osd_map injecting map crc failure 2020-11-12T17:29:40.341 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:29:40.341 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 62 16 29904 29888 3.76572 0 - 0.0157766 2020-11-12T17:29:40.341 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 63 16 29904 29888 3.70595 0 - 0.0157766 2020-11-12T17:29:40.342 INFO:teuthology.orchestra.run.smithi036.stderr:Nothing to do for non-filestore backend 2020-11-12T17:29:40.342 INFO:teuthology.orchestra.run.smithi036:> CEPH_ARGS='--filestore-merge-threshold 1 --filestore-split-multiple 1' sudo -E ceph-objectstore-tool --no-mon-config --log-file=/var/log/ceph/objectstore_tool.$pid.log --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op apply-layout-settings --pool rbd 2020-11-12T17:29:40.343 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:40.334+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:40.344 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:29:40.438 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:40.435+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:40.461 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:40.462 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:40.462 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:40.462 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:40.472 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:29:40.529 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 64 16 29904 29888 3.64804 0 - 0.0157766 2020-11-12T17:29:40.534 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:40.558 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:40.555+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:40.559 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:40.584 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:40.611 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:40.618 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:40.618 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:40.628 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:29:40.640 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:40.670 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:40.667+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:40.670 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:40.702 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:40.702 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:29:40.703 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:29:40.703 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:40.703 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:40.703 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:29:40.703 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:29:40.704 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:29:40.704 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:29:40.704 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:29:40.706 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:40.706 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:40.741 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:40.739+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:40.782 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:40.783 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:40.792 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:29:40.842 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:40.838+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:40.943 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:40.939+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:40.944 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:40.944 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:40.953 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:29:41.044 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:41.039+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:41.103 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:41.103 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:41.112 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:29:41.145 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:41.142+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:41.246 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:41.242+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:41.261 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:41.262 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:41.271 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:29:41.294 INFO:teuthology.orchestra.run.smithi036.stderr:Nothing to do for non-filestore backend 2020-11-12T17:29:41.347 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:41.346+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:41.377 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:41.378 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:41.392 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:29:41.448 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:41.443+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:41.500 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:41.501 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:41.510 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:29:41.528 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 65 16 29904 29888 3.59192 0 - 0.0157766 2020-11-12T17:29:41.553 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:41.551+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:41.649 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:41.643+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:41.663 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:41.664 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:41.673 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:29:41.761 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:41.759+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:41.827 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:41.827 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:41.837 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:29:41.840 INFO:teuthology.orchestra.run.smithi036:> CEPH_ARGS='--filestore-merge-threshold 1 --filestore-split-multiple 1' sudo -E ceph-objectstore-tool --no-mon-config --log-file=/var/log/ceph/objectstore_tool.$pid.log --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op apply-layout-settings --pool unique_pool_3 2020-11-12T17:29:41.883 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:41.882+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:41.951 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:41.947+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:41.990 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:41.991 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:42.000 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:29:42.051 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:42.050+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:42.148 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:42.149 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:42.152 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:42.147+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:42.158 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:29:42.253 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:42.251+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:42.270 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:42.271 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:42.280 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:29:42.345 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset noscrub 2020-11-12T17:29:42.386 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:42.386 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:42.387 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:42.382+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:42.396 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:29:42.454 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:42.451+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:42.528 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 66 16 29904 29888 3.5375 0 - 0.0157766 2020-11-12T17:29:42.555 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:42.551+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:42.556 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:42.556 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:42.565 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:29:42.656 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:42.651+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:42.663 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:42.664 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:42.673 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:29:42.708 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:29:42.757 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:42.755+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:42.779 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:42.779 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:42.792 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:29:42.832 INFO:teuthology.orchestra.run.smithi036.stderr:Nothing to do for non-filestore backend 2020-11-12T17:29:42.858 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:42.855+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:42.862 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:42.889 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:42.899 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:42.900 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:29:42.900 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:29:42.900 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:29:42.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.900 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:552 3.6 3:6d809f32:::benchmark_data_smithi036_14212_object68:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e22)", 2020-11-12T17:29:42.900 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:29:42.900 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 397.78747612799998, 2020-11-12T17:29:42.901 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999, 2020-11-12T17:29:42.901 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.901 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:42.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:42.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:42.901 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:42.901 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 552 2020-11-12T17:29:42.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.902 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.902 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.902 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:29:42.902 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.903 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108877+0000", 2020-11-12T17:29:42.903 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999762 2020-11-12T17:29:42.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.903 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108854+0000", 2020-11-12T17:29:42.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.4720000000000002e-05 2020-11-12T17:29:42.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.904 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.904 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108938+0000", 2020-11-12T17:29:42.904 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.3747000000000002e-05 2020-11-12T17:29:42.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.905 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108962+0000", 2020-11-12T17:29:42.905 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8400000000000002e-06 2020-11-12T17:29:42.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.905 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.108967+0000", 2020-11-12T17:29:42.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00117887 2020-11-12T17:29:42.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.906 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.906 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110146+0000", 2020-11-12T17:29:42.906 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7071999999999997e-05 2020-11-12T17:29:42.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.907 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110223+0000", 2020-11-12T17:29:42.907 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010219500000000001 2020-11-12T17:29:42.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.907 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:42.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.110325+0000", 2020-11-12T17:29:42.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0055310280000000003 2020-11-12T17:29:42.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.908 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:42.908 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115856+0000", 2020-11-12T17:29:42.908 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37920668800000001 2020-11-12T17:29:42.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:42.909 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495063+0000", 2020-11-12T17:29:42.909 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6315000000000005e-05 2020-11-12T17:29:42.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.909 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:42.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495129+0000", 2020-11-12T17:29:42.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4772999999999999e-05 2020-11-12T17:29:42.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.910 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.910 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495184+0000", 2020-11-12T17:29:42.910 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38630661799999999 2020-11-12T17:29:42.911 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.911 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.911 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.911 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:552 3.6 e22/20 ondisk, result = 0)", 2020-11-12T17:29:42.911 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:29:42.911 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 397.78038433199998, 2020-11-12T17:29:42.912 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999, 2020-11-12T17:29:42.912 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.912 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:42.912 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.912 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.912 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.912 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:29:42.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.913 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.913 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115969+0000", 2020-11-12T17:29:42.913 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:29:42.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.115944+0000", 2020-11-12T17:29:42.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3697999999999999e-05 2020-11-12T17:29:42.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.914 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.914 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.116008+0000", 2020-11-12T17:29:42.914 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37822918700000002 2020-11-12T17:29:42.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.915 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.915 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494237+0000", 2020-11-12T17:29:42.915 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1089999999999998e-06 2020-11-12T17:29:42.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.915 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.494245+0000", 2020-11-12T17:29:42.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00079903999999999999 2020-11-12T17:29:42.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.916 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.916 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495045+0000", 2020-11-12T17:29:42.916 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.098e-06 2020-11-12T17:29:42.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.917 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495054+0000", 2020-11-12T17:29:42.917 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013920299999999999 2020-11-12T17:29:42.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.917 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.918 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:05.495193+0000", 2020-11-12T17:29:42.918 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37922386299999999 2020-11-12T17:29:42.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.918 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.919 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:10000 3.1 3:8302de2c:::benchmark_data_smithi036_14212_object1249:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:29:42.919 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:29:42.919 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 388.34782483499998, 2020-11-12T17:29:42.919 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999, 2020-11-12T17:29:42.919 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.919 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:42.919 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:42.919 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:42.920 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:42.920 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 10000 2020-11-12T17:29:42.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.920 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.920 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.920 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:29:42.920 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.921 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.921 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548528+0000", 2020-11-12T17:29:42.921 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999633 2020-11-12T17:29:42.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548492+0000", 2020-11-12T17:29:42.922 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000103372 2020-11-12T17:29:42.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.922 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.922 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548595+0000", 2020-11-12T17:29:42.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2687000000000001e-05 2020-11-12T17:29:42.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.923 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.923 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548608+0000", 2020-11-12T17:29:42.923 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7429999999999996e-06 2020-11-12T17:29:42.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.548615+0000", 2020-11-12T17:29:42.924 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002777992 2020-11-12T17:29:42.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.924 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.924 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551393+0000", 2020-11-12T17:29:42.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.5389999999999994e-05 2020-11-12T17:29:42.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.925 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.925 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551478+0000", 2020-11-12T17:29:42.925 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013302799999999999 2020-11-12T17:29:42.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:42.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.551611+0000", 2020-11-12T17:29:42.926 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000928516 2020-11-12T17:29:42.926 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.926 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.926 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:42.926 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.552539+0000", 2020-11-12T17:29:42.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.42715050500000001 2020-11-12T17:29:42.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.927 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:42.927 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979690+0000", 2020-11-12T17:29:42.927 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013119600000000001 2020-11-12T17:29:42.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:42.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979821+0000", 2020-11-12T17:29:42.928 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000111667 2020-11-12T17:29:42.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.928 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.928 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.979933+0000", 2020-11-12T17:29:42.929 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.43140440499999999 2020-11-12T17:29:42.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.929 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.929 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.929 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:28400 3.6 e47/20 ondisk, result = 0)", 2020-11-12T17:29:42.930 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:29:42.930 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 354.39770474099998, 2020-11-12T17:29:42.930 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998, 2020-11-12T17:29:42.930 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.930 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:42.930 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.930 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:29:42.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.931 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.931 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498649+0000", 2020-11-12T17:29:42.931 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999752 2020-11-12T17:29:42.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.932 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.932 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498624+0000", 2020-11-12T17:29:42.932 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.4040000000000003e-05 2020-11-12T17:29:42.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.498688+0000", 2020-11-12T17:29:42.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36523572300000001 2020-11-12T17:29:42.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.933 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.933 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863923+0000", 2020-11-12T17:29:42.933 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1040000000000003e-06 2020-11-12T17:29:42.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.934 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.934 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.863929+0000", 2020-11-12T17:29:42.934 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020494380000000002 2020-11-12T17:29:42.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865979+0000", 2020-11-12T17:29:42.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9359999999999994e-06 2020-11-12T17:29:42.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.935 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.935 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.865989+0000", 2020-11-12T17:29:42.935 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012963199999999999 2020-11-12T17:29:42.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.936 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.936 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:48.866118+0000", 2020-11-12T17:29:42.936 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36746985999999998 2020-11-12T17:29:42.936 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.936 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.937 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:30520 3.b e48/20 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head v 48'1976, mlcod=48'1969)", 2020-11-12T17:29:42.937 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:29:42.937 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 352.292102849, 2020-11-12T17:29:42.937 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999, 2020-11-12T17:29:42.937 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.938 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:42.938 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.938 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.938 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:29:42.938 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604250+0000", 2020-11-12T17:29:42.939 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999681 2020-11-12T17:29:42.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.939 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.939 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604219+0000", 2020-11-12T17:29:42.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000104542 2020-11-12T17:29:42.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.940 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.940 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604323+0000", 2020-11-12T17:29:42.940 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36794898999999998 2020-11-12T17:29:42.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972272+0000", 2020-11-12T17:29:42.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:29:42.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.941 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.941 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972284+0000", 2020-11-12T17:29:42.941 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2496000000000003e-05 2020-11-12T17:29:42.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.942 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.942 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972376+0000", 2020-11-12T17:29:42.942 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.2843000000000003e-05 2020-11-12T17:29:42.942 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.972419+0000", 2020-11-12T17:29:42.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0029949529999999999 2020-11-12T17:29:42.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.943 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:42.943 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975414+0000", 2020-11-12T17:29:42.943 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3510000000000005e-05 2020-11-12T17:29:42.944 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.944 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.944 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.944 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975498+0000", 2020-11-12T17:29:42.944 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37124736899999999 2020-11-12T17:29:42.944 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.944 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.945 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.945 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:57808 3.6 3:61627120:::benchmark_data_smithi036_14212_object7225:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:29:42.945 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:29:42.945 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 320.94561951499998, 2020-11-12T17:29:42.945 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997, 2020-11-12T17:29:42.945 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.946 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:42.946 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:42.946 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:42.946 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:42.946 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 57808 2020-11-12T17:29:42.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.946 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.946 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:29:42.947 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.947 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.947 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950734+0000", 2020-11-12T17:29:42.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999623 2020-11-12T17:29:42.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.948 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.948 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950696+0000", 2020-11-12T17:29:42.948 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000108731 2020-11-12T17:29:42.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950805+0000", 2020-11-12T17:29:42.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.3103e-05 2020-11-12T17:29:42.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.949 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.949 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950818+0000", 2020-11-12T17:29:42.949 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2099999999999998e-06 2020-11-12T17:29:42.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.950 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.950 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.950824+0000", 2020-11-12T17:29:42.950 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.15058580999999999 2020-11-12T17:29:42.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101410+0000", 2020-11-12T17:29:42.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027337999999999999 2020-11-12T17:29:42.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.951 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.951 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.101684+0000", 2020-11-12T17:29:42.951 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00047463399999999998 2020-11-12T17:29:42.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.952 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:42.952 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.102158+0000", 2020-11-12T17:29:42.952 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054269460000000002 2020-11-12T17:29:42.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:42.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.107585+0000", 2020-11-12T17:29:42.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.44057389600000002 2020-11-12T17:29:42.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.953 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:42.953 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548159+0000", 2020-11-12T17:29:42.953 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0356000000000002e-05 2020-11-12T17:29:42.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.954 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:42.954 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548229+0000", 2020-11-12T17:29:42.954 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9864999999999997e-05 2020-11-12T17:29:42.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.955 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.955 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.548289+0000", 2020-11-12T17:29:42.955 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59755548999999997 2020-11-12T17:29:42.955 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.955 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.955 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.956 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(3.4 60/59 [PushOp(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head, version: 23'144, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2bf5d97b:::benchmark_data_smithi036_14212_object376:head@23'144, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:29:42.956 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:29:42.956 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 311.949777713, 2020-11-12T17:29:42.956 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001, 2020-11-12T17:29:42.956 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.956 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:42.956 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:29:42.957 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.957 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.957 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946576+0000", 2020-11-12T17:29:42.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999728 2020-11-12T17:29:42.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.958 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.958 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946549+0000", 2020-11-12T17:29:42.958 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017236199999999999 2020-11-12T17:29:42.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:30.946721+0000", 2020-11-12T17:29:42.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34485056400000003 2020-11-12T17:29:42.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.959 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.959 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291571+0000", 2020-11-12T17:29:42.959 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.9519e-05 2020-11-12T17:29:42.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.960 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291601+0000", 2020-11-12T17:29:42.960 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9777999999999993e-05 2020-11-12T17:29:42.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.960 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291691+0000", 2020-11-12T17:29:42.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.8117999999999998e-05 2020-11-12T17:29:42.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.961 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.961 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.291709+0000", 2020-11-12T17:29:42.961 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019937829999999998 2020-11-12T17:29:42.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.962 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.962 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:31.293703+0000", 2020-11-12T17:29:42.962 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34712713000000001 2020-11-12T17:29:42.962 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.962 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.963 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.963 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.963 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPushReply(3.6 62/59 [PushReplyOp(3:63f69d10:::benchmark_data_smithi036_14212_object3676:head)])", 2020-11-12T17:29:42.963 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:29:42.963 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 308.01467431399999, 2020-11-12T17:29:42.963 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998, 2020-11-12T17:29:42.963 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.964 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "reached pg", 2020-11-12T17:29:42.964 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.964 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.964 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:29:42.964 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881679+0000", 2020-11-12T17:29:42.965 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999714 2020-11-12T17:29:42.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.965 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.965 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881650+0000", 2020-11-12T17:29:42.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2860999999999993e-05 2020-11-12T17:29:42.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.966 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.966 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:34.881713+0000", 2020-11-12T17:29:42.966 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47077075299999999 2020-11-12T17:29:42.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352484+0000", 2020-11-12T17:29:42.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.0140000000000004e-06 2020-11-12T17:29:42.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.967 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.967 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352493+0000", 2020-11-12T17:29:42.967 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3038000000000001e-05 2020-11-12T17:29:42.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.968 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.968 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.352566+0000", 2020-11-12T17:29:42.968 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00054515599999999998 2020-11-12T17:29:42.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.969 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.969 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:35.353111+0000", 2020-11-12T17:29:42.969 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.47143217599999998 2020-11-12T17:29:42.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.970 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21487 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:29:42.970 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:29:42.970 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 270.99352513899998, 2020-11-12T17:29:42.970 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997, 2020-11-12T17:29:42.970 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.970 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:42.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:42.970 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:42.971 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:42.971 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21487 2020-11-12T17:29:42.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.971 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.971 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:29:42.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.972 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.972 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902828+0000", 2020-11-12T17:29:42.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999504 2020-11-12T17:29:42.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.973 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.973 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902779+0000", 2020-11-12T17:29:42.973 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011936 2020-11-12T17:29:42.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902898+0000", 2020-11-12T17:29:42.974 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0414999999999999e-05 2020-11-12T17:29:42.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.974 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.974 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902908+0000", 2020-11-12T17:29:42.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1732e-05 2020-11-12T17:29:42.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.975 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.975 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902920+0000", 2020-11-12T17:29:42.975 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0048791049999999999 2020-11-12T17:29:42.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907799+0000", 2020-11-12T17:29:42.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013446899999999999 2020-11-12T17:29:42.976 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.976 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.976 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.976 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.907934+0000", 2020-11-12T17:29:42.976 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000152867 2020-11-12T17:29:42.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:42.977 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908087+0000", 2020-11-12T17:29:42.977 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021574290000000002 2020-11-12T17:29:42.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.977 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.977 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:42.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910244+0000", 2020-11-12T17:29:42.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33882832699999998 2020-11-12T17:29:42.978 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.978 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:42.978 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249072+0000", 2020-11-12T17:29:42.978 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9358999999999995e-05 2020-11-12T17:29:42.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.979 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:42.979 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249172+0000", 2020-11-12T17:29:42.979 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2564999999999994e-05 2020-11-12T17:29:42.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.980 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.980 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.249244+0000", 2020-11-12T17:29:42.980 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34641620899999997 2020-11-12T17:29:42.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.980 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.980 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.981 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:21488 4.b 4:d408906b:::benchmark_data_smithi036_18856_object2685:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e78)", 2020-11-12T17:29:42.981 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:29:42.981 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 270.99336276899999, 2020-11-12T17:29:42.981 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974, 2020-11-12T17:29:42.981 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.981 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:42.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:42.981 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:42.982 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:42.982 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 21488 2020-11-12T17:29:42.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.982 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.982 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.982 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:29:42.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.983 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.983 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902991+0000", 2020-11-12T17:29:42.983 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:29:42.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.902944+0000", 2020-11-12T17:29:42.984 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012464900000000001 2020-11-12T17:29:42.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.984 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.984 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903068+0000", 2020-11-12T17:29:42.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.944e-06 2020-11-12T17:29:42.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.985 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.985 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903078+0000", 2020-11-12T17:29:42.985 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0200000000000002e-06 2020-11-12T17:29:42.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.903083+0000", 2020-11-12T17:29:42.986 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057602499999999997 2020-11-12T17:29:42.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.986 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.986 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.908844+0000", 2020-11-12T17:29:42.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000169164 2020-11-12T17:29:42.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.987 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.987 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909013+0000", 2020-11-12T17:29:42.987 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000246378 2020-11-12T17:29:42.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:42.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.909259+0000", 2020-11-12T17:29:42.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001406011 2020-11-12T17:29:42.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.988 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:42.988 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:11.910665+0000", 2020-11-12T17:29:42.988 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35802809099999999 2020-11-12T17:29:42.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:42.989 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268693+0000", 2020-11-12T17:29:42.989 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000153194 2020-11-12T17:29:42.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.989 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:42.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268846+0000", 2020-11-12T17:29:42.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011114 2020-11-12T17:29:42.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.990 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:42.990 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:12.268957+0000", 2020-11-12T17:29:42.990 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.365966974 2020-11-12T17:29:42.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.991 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:42.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:42.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.991 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:45264 4.6 4:665a4d65:::benchmark_data_smithi036_18856_object5657:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e92)", 2020-11-12T17:29:42.991 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:29:42.991 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 244.99473304599999, 2020-11-12T17:29:42.992 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001, 2020-11-12T17:29:42.992 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:42.992 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:42.992 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:42.992 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:42.992 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:42.992 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45264 2020-11-12T17:29:42.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.993 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:42.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.993 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:42.993 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:29:42.993 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:42.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:42.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901620+0000", 2020-11-12T17:29:42.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999533 2020-11-12T17:29:42.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.994 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:42.994 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901573+0000", 2020-11-12T17:29:42.994 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000129395 2020-11-12T17:29:42.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.995 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:42.995 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901703+0000", 2020-11-12T17:29:42.995 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7079999999999999e-05 2020-11-12T17:29:42.995 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:42.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901720+0000", 2020-11-12T17:29:42.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9949999999999994e-06 2020-11-12T17:29:42.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.996 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:42.996 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.901729+0000", 2020-11-12T17:29:42.996 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0030471539999999998 2020-11-12T17:29:42.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:42.997 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904776+0000", 2020-11-12T17:29:42.997 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000145647 2020-11-12T17:29:42.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.997 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:42.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.904922+0000", 2020-11-12T17:29:42.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000251439 2020-11-12T17:29:42.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.998 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:42.998 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.905173+0000", 2020-11-12T17:29:42.998 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0057545799999999996 2020-11-12T17:29:42.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:42.999 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.910928+0000", 2020-11-12T17:29:42.999 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.362496074 2020-11-12T17:29:42.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:42.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:42.999 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273424+0000", 2020-11-12T17:29:43.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9160000000000006e-05 2020-11-12T17:29:43.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.000 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.000 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273523+0000", 2020-11-12T17:29:43.000 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9492000000000004e-05 2020-11-12T17:29:43.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.001 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.001 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:38.273602+0000", 2020-11-12T17:29:43.001 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37198225600000001 2020-11-12T17:29:43.001 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.001 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.001 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.002 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:47808 4.b e94/69 ondisk, result = 0)", 2020-11-12T17:29:43.002 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:29:43.002 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 241.92141461400001, 2020-11-12T17:29:43.002 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002, 2020-11-12T17:29:43.002 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.002 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:43.003 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.003 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.003 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:29:43.003 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974939+0000", 2020-11-12T17:29:43.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:43.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.004 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.004 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974909+0000", 2020-11-12T17:29:43.004 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.9116999999999995e-05 2020-11-12T17:29:43.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.005 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:40.974988+0000", 2020-11-12T17:29:43.005 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.34901010700000001 2020-11-12T17:29:43.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.005 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.005 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.323998+0000", 2020-11-12T17:29:43.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.726e-06 2020-11-12T17:29:43.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.006 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.006 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.324002+0000", 2020-11-12T17:29:43.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0018751849999999999 2020-11-12T17:29:43.006 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.007 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325877+0000", 2020-11-12T17:29:43.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1073999999999999e-05 2020-11-12T17:29:43.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.007 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.325888+0000", 2020-11-12T17:29:43.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014331500000000001 2020-11-12T17:29:43.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.008 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.008 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:41.326031+0000", 2020-11-12T17:29:43.008 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35109240800000002 2020-11-12T17:29:43.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.009 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.009 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.009 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:48736 4.6 4:68137e00:::benchmark_data_smithi036_18856_object6091:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:29:43.009 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:29:43.009 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 240.86576963799999, 2020-11-12T17:29:43.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002, 2020-11-12T17:29:43.010 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.010 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.010 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.010 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:43.010 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:43.010 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 48736 2020-11-12T17:29:43.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.010 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:29:43.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030584+0000", 2020-11-12T17:29:43.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999949 2020-11-12T17:29:43.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030533+0000", 2020-11-12T17:29:43.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000139056 2020-11-12T17:29:43.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030672+0000", 2020-11-12T17:29:43.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.9301999999999999e-05 2020-11-12T17:29:43.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030691+0000", 2020-11-12T17:29:43.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.006e-05 2020-11-12T17:29:43.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.030701+0000", 2020-11-12T17:29:43.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.007335528 2020-11-12T17:29:43.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038036+0000", 2020-11-12T17:29:43.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8150000000000002e-05 2020-11-12T17:29:43.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038115+0000", 2020-11-12T17:29:43.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010198 2020-11-12T17:29:43.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:43.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.038217+0000", 2020-11-12T17:29:43.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017711459999999999 2020-11-12T17:29:43.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.039988+0000", 2020-11-12T17:29:43.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61194431199999999 2020-11-12T17:29:43.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.651932+0000", 2020-11-12T17:29:43.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00014841999999999999 2020-11-12T17:29:43.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.018 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.018 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652080+0000", 2020-11-12T17:29:43.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8911999999999993e-05 2020-11-12T17:29:43.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.652149+0000", 2020-11-12T17:29:43.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.62156575800000002 2020-11-12T17:29:43.019 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.019 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.019 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.020 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:49064 4.b 4:da5a313f:::benchmark_data_smithi036_18856_object6132:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e94)", 2020-11-12T17:29:43.020 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:29:43.020 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 240.47756526699999, 2020-11-12T17:29:43.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002, 2020-11-12T17:29:43.020 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.020 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.020 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.021 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:43.021 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:43.021 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 49064 2020-11-12T17:29:43.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.021 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:29:43.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418788+0000", 2020-11-12T17:29:43.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999795 2020-11-12T17:29:43.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418767+0000", 2020-11-12T17:29:43.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1138999999999999e-05 2020-11-12T17:29:43.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418828+0000", 2020-11-12T17:29:43.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9910000000000008e-06 2020-11-12T17:29:43.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418837+0000", 2020-11-12T17:29:43.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7729999999999999e-06 2020-11-12T17:29:43.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.418842+0000", 2020-11-12T17:29:43.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0096584029999999994 2020-11-12T17:29:43.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.025 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.025 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428501+0000", 2020-11-12T17:29:43.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1147e-05 2020-11-12T17:29:43.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.026 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.026 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428592+0000", 2020-11-12T17:29:43.026 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148982 2020-11-12T17:29:43.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:43.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.428741+0000", 2020-11-12T17:29:43.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002016487 2020-11-12T17:29:43.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.430757+0000", 2020-11-12T17:29:43.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.33841595299999999 2020-11-12T17:29:43.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769173+0000", 2020-11-12T17:29:43.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9359999999999998e-05 2020-11-12T17:29:43.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769263+0000", 2020-11-12T17:29:43.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0869999999999998e-05 2020-11-12T17:29:43.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:42.769323+0000", 2020-11-12T17:29:43.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35053540500000002 2020-11-12T17:29:43.030 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.030 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.030 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.030 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:60288 4.6 4:6059676a:::benchmark_data_smithi036_18856_object7535:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e102)", 2020-11-12T17:29:43.030 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:29:43.031 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 226.27110833500001, 2020-11-12T17:29:43.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199, 2020-11-12T17:29:43.031 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.031 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.031 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.031 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:43.031 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:43.032 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 60288 2020-11-12T17:29:43.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.032 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:29:43.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625245+0000", 2020-11-12T17:29:43.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:29:43.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625214+0000", 2020-11-12T17:29:43.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0363000000000003e-05 2020-11-12T17:29:43.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625294+0000", 2020-11-12T17:29:43.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1440000000000001e-05 2020-11-12T17:29:43.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625305+0000", 2020-11-12T17:29:43.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.8009999999999998e-06 2020-11-12T17:29:43.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.625312+0000", 2020-11-12T17:29:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0070302079999999996 2020-11-12T17:29:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632342+0000", 2020-11-12T17:29:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00015987099999999999 2020-11-12T17:29:43.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632502+0000", 2020-11-12T17:29:43.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00026390400000000003 2020-11-12T17:29:43.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.037 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:43.037 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.632766+0000", 2020-11-12T17:29:43.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0024448540000000002 2020-11-12T17:29:43.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:56.635211+0000", 2020-11-12T17:29:43.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40786508399999999 2020-11-12T17:29:43.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043076+0000", 2020-11-12T17:29:43.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.4347e-05 2020-11-12T17:29:43.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043130+0000", 2020-11-12T17:29:43.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6534999999999999e-05 2020-11-12T17:29:43.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.043197+0000", 2020-11-12T17:29:43.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.41795199 2020-11-12T17:29:43.040 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.040 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.041 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.041 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:61224 4.b 4:d2b0671d:::benchmark_data_smithi036_18856_object7652:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e103)", 2020-11-12T17:29:43.041 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:29:43.041 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 225.02190271800001, 2020-11-12T17:29:43.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998, 2020-11-12T17:29:43.041 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.042 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:43.042 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:43.042 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 61224 2020-11-12T17:29:43.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.042 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:29:43.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874451+0000", 2020-11-12T17:29:43.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:43.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874421+0000", 2020-11-12T17:29:43.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013170200000000001 2020-11-12T17:29:43.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874552+0000", 2020-11-12T17:29:43.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.2928999999999999e-05 2020-11-12T17:29:43.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874565+0000", 2020-11-12T17:29:43.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1929999999999998e-06 2020-11-12T17:29:43.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.874571+0000", 2020-11-12T17:29:43.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.011939073 2020-11-12T17:29:43.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886511+0000", 2020-11-12T17:29:43.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000119629 2020-11-12T17:29:43.047 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.047 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.047 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886630+0000", 2020-11-12T17:29:43.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00020486699999999999 2020-11-12T17:29:43.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:43.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.886835+0000", 2020-11-12T17:29:43.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028579230000000001 2020-11-12T17:29:43.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.889693+0000", 2020-11-12T17:29:43.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36643049700000002 2020-11-12T17:29:43.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256123+0000", 2020-11-12T17:29:43.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3271999999999999e-05 2020-11-12T17:29:43.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256197+0000", 2020-11-12T17:29:43.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.6106999999999997e-05 2020-11-12T17:29:43.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256253+0000", 2020-11-12T17:29:43.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38180230399999998 2020-11-12T17:29:43.051 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.051 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.051 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.052 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4971.0:61224 4.b e103/69 ondisk, result = 0)", 2020-11-12T17:29:43.052 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:29:43.052 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 225.00494326899999, 2020-11-12T17:29:43.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999, 2020-11-12T17:29:43.052 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.052 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:43.052 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:29:43.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891410+0000", 2020-11-12T17:29:43.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:43.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891392+0000", 2020-11-12T17:29:43.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0363e-05 2020-11-12T17:29:43.054 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:57.891433+0000", 2020-11-12T17:29:43.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36203556799999997 2020-11-12T17:29:43.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.055 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.055 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253468+0000", 2020-11-12T17:29:43.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6640000000000001e-06 2020-11-12T17:29:43.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.056 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.056 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.253475+0000", 2020-11-12T17:29:43.056 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026286439999999999 2020-11-12T17:29:43.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256104+0000", 2020-11-12T17:29:43.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0263e-05 2020-11-12T17:29:43.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256114+0000", 2020-11-12T17:29:43.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000148467 2020-11-12T17:29:43.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:58.256262+0000", 2020-11-12T17:29:43.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36485240699999999 2020-11-12T17:29:43.058 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.058 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.059 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.059 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "MOSDPGPush(5.2 168/167 [PushOp(5:41867905:::benchmark_data_smithi036_24110_object139:head, version: 130'104, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:41867905:::benchmark_data_smithi036_24110_object139:head@130'104, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:29:43.059 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.025380+0000", 2020-11-12T17:29:43.059 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.870973389, 2020-11-12T17:29:43.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36060000800000003, 2020-11-12T17:29:43.060 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.060 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:43.060 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025380+0000", 2020-11-12T17:29:43.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025380+0000", 2020-11-12T17:29:43.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999757 2020-11-12T17:29:43.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025355+0000", 2020-11-12T17:29:43.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8812000000000002e-05 2020-11-12T17:29:43.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.025454+0000", 2020-11-12T17:29:43.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.35809733300000002 2020-11-12T17:29:43.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383551+0000", 2020-11-12T17:29:43.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8809999999999996e-06 2020-11-12T17:29:43.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383559+0000", 2020-11-12T17:29:43.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1902000000000004e-05 2020-11-12T17:29:43.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383631+0000", 2020-11-12T17:29:43.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3990000000000004e-06 2020-11-12T17:29:43.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.065 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.383640+0000", 2020-11-12T17:29:43.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023402269999999998 2020-11-12T17:29:43.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.066 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.066 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.385980+0000", 2020-11-12T17:29:43.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36060000800000003 2020-11-12T17:29:43.066 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.066 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.066 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.066 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.067 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.6159.0:27656 6.9 6:91fd3d18:::benchmark_data_smithi036_29033_object3456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e204)", 2020-11-12T17:29:43.067 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:29:03.732686+0000", 2020-11-12T17:29:43.067 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.163667334000003, 2020-11-12T17:29:43.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54669025699999996, 2020-11-12T17:29:43.067 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.067 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.067 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.068 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.6159", 2020-11-12T17:29:43.068 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:29:43.068 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 27656 2020-11-12T17:29:43.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.068 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.732686+0000", 2020-11-12T17:29:43.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.732686+0000", 2020-11-12T17:29:43.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:29:43.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.732664+0000", 2020-11-12T17:29:43.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5053000000000002e-05 2020-11-12T17:29:43.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.732729+0000", 2020-11-12T17:29:43.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0309999999999998e-06 2020-11-12T17:29:43.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.732737+0000", 2020-11-12T17:29:43.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.8619999999999996e-06 2020-11-12T17:29:43.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.732741+0000", 2020-11-12T17:29:43.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010380087 2020-11-12T17:29:43.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.743121+0000", 2020-11-12T17:29:43.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.8350000000000006e-05 2020-11-12T17:29:43.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.743209+0000", 2020-11-12T17:29:43.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00025280700000000002 2020-11-12T17:29:43.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:43.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.743462+0000", 2020-11-12T17:29:43.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0019772330000000001 2020-11-12T17:29:43.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.745439+0000", 2020-11-12T17:29:43.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.53380291599999996 2020-11-12T17:29:43.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:04.279242+0000", 2020-11-12T17:29:43.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2430999999999998e-05 2020-11-12T17:29:43.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:04.279315+0000", 2020-11-12T17:29:43.076 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1476999999999994e-05 2020-11-12T17:29:43.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.076 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.076 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:04.279376+0000", 2020-11-12T17:29:43.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.54669025699999996 2020-11-12T17:29:43.077 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.077 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.077 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.077 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.077 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:27656 6.9 e204/190 ondisk, result = 0)", 2020-11-12T17:29:43.077 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:29:03.746008+0000", 2020-11-12T17:29:43.078 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 39.150345133000002, 2020-11-12T17:29:43.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.533374715, 2020-11-12T17:29:43.078 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.078 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:43.078 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.746008+0000", 2020-11-12T17:29:43.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.746008+0000", 2020-11-12T17:29:43.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:29:43.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.745994+0000", 2020-11-12T17:29:43.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.8928000000000003e-05 2020-11-12T17:29:43.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:03.746043+0000", 2020-11-12T17:29:43.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.53307079300000004 2020-11-12T17:29:43.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:04.279114+0000", 2020-11-12T17:29:43.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3119999999999994e-06 2020-11-12T17:29:43.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:04.279122+0000", 2020-11-12T17:29:43.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.8193e-05 2020-11-12T17:29:43.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:04.279221+0000", 2020-11-12T17:29:43.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1416e-05 2020-11-12T17:29:43.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:04.279232+0000", 2020-11-12T17:29:43.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000150755 2020-11-12T17:29:43.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:29:04.279383+0000", 2020-11-12T17:29:43.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.533374715 2020-11-12T17:29:43.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.084 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.084 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.085 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.085 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.085 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:43.087 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:43.087 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:43.087 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:43.087 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:43.087 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:43.088 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:29:43.088 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:29:43.088 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:43.088 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:43.088 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:29:43.088 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:29:43.088 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:29:43.089 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:29:43.089 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:29:43.089 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:43.089 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:43.089 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:43.083+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:43.090 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:29:43.188 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:43.187+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:43.244 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:43.245 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:29:43.245 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:43.255 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:29:43.288 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:43.283+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:43.365 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:43.365 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:29:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: "complaint_time": 30, 2020-11-12T17:29:43.366 INFO:teuthology.orchestra.run.smithi036.stdout: "num_blocked_ops": 0 2020-11-12T17:29:43.366 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:43.375 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:29:43.416 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:43.414+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:43.490 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:43.487+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:43.504 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is unset 2020-11-12T17:29:43.528 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 67 16 29904 29888 3.4847 0 - 0.0157766 2020-11-12T17:29:43.536 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:43.536 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:29:43.537 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:29:43.537 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:29:43.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.537 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:29:43.537 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:43.537 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 389.11440190000002, 2020-11-12T17:29:43.538 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:29:43.538 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.538 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.538 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.538 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:43.538 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:43.539 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:29:43.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.539 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.539 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.539 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:43.539 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.540 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:43.540 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:29:43.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.540 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:29:43.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:29:43.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.541 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.541 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:29:43.541 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:29:43.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.542 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.542 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:29:43.542 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:29:43.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:29:43.543 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:29:43.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.543 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.543 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:29:43.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:29:43.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.544 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.544 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:29:43.544 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:29:43.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:43.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:29:43.545 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:29:43.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.545 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.545 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:29:43.546 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:29:43.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.546 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.547 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:29:43.547 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:29:43.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.548 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.548 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:29:43.548 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:29:43.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.549 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.549 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:29:43.550 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:29:43.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.550 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.551 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:29:43.551 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:43.552 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 389.10745783800002, 2020-11-12T17:29:43.552 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:29:43.552 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.552 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:43.552 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.553 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:43.553 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.553 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:43.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:43.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.554 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.554 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:29:43.554 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:29:43.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.555 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:29:43.555 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:29:43.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.555 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:29:43.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:29:43.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.556 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.556 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:29:43.556 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:29:43.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.557 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.557 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:29:43.557 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:29:43.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.558 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.558 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:29:43.559 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:29:43.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.559 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.560 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:29:43.560 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:29:43.560 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.560 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.560 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.561 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:29:43.561 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:43.561 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 352.93362005199998, 2020-11-12T17:29:43.561 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:29:43.561 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.561 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.561 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.562 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:43.562 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:43.562 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:29:43.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.562 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.563 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.563 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:43.563 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.564 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.564 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:43.564 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:29:43.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.565 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:29:43.565 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:29:43.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.565 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.566 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:29:43.566 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:29:43.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.567 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:29:43.567 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:29:43.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.567 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:29:43.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:29:43.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.568 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.568 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:29:43.568 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:29:43.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.569 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:29:43.569 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:29:43.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.569 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:29:43.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:29:43.570 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:29:43.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.570 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.570 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:29:43.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:29:43.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.571 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.571 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:29:43.571 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:29:43.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.572 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:29:43.572 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:29:43.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.572 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.573 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:29:43.573 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:29:43.573 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.573 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.573 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.573 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:29:43.574 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:43.574 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 336.66991495899998, 2020-11-12T17:29:43.574 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:29:43.574 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.574 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.574 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.575 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:43.575 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:43.575 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:29:43.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.575 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.575 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:43.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.576 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.576 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:43.576 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:43.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.577 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.577 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:29:43.577 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:29:43.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.578 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:29:43.578 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:29:43.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.578 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:29:43.579 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:29:43.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.579 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.579 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:29:43.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:29:43.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.580 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.580 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:29:43.580 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:29:43.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:29:43.581 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:29:43.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.581 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:43.581 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:29:43.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:29:43.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.582 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.582 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:29:43.582 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:29:43.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:29:43.583 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:29:43.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.583 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.583 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.583 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:29:43.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:29:43.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.584 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.584 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:29:43.584 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:29:43.584 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.584 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:29:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 321.58453463299998, 2020-11-12T17:29:43.585 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:29:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:43.586 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:29:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.587 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:29:43.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:29:43.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.588 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.588 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:29:43.588 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:29:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:29:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:29:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.589 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:29:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:29:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:29:43.590 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:29:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:29:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:29:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.591 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:29:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:29:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:29:43.592 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:29:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:29:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:43.593 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 319.89039635900002, 2020-11-12T17:29:43.594 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:29:43.594 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.594 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.594 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.594 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:43.594 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:43.594 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:29:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:29:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.596 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:29:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:29:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:29:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:29:43.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:29:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:29:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.598 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:29:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:29:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:29:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:29:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:29:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:29:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:43.600 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:29:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:29:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:29:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:29:43.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:29:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:29:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.602 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:29:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:29:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:29:43.603 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:29:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.604 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:29:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 251.62698480899999, 2020-11-12T17:29:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:29:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:43.605 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:29:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:43.606 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.607 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:29:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:29:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:29:43.608 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:29:43.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.609 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.609 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:29:43.609 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:29:43.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:29:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:29:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:29:43.610 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:29:43.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.611 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.611 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:29:43.611 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:29:43.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:43.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:29:43.612 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:29:43.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.612 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.612 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:29:43.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:29:43.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.613 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.613 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:29:43.613 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:29:43.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:29:43.614 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:29:43.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.614 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.614 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:29:43.615 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:29:43.615 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.615 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.615 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.615 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:29:43.615 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:43.616 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 246.824545911, 2020-11-12T17:29:43.616 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:29:43.616 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.616 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.616 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.616 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:43.617 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:43.617 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:29:43.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.617 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.617 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.617 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:43.617 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.618 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:43.618 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:29:43.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.618 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:29:43.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:29:43.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.619 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.619 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:29:43.619 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:29:43.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.620 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:29:43.620 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:29:43.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.620 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:29:43.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:29:43.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.621 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.621 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:29:43.621 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:29:43.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.622 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:29:43.622 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:29:43.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.622 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:43.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:29:43.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:29:43.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.623 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.623 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:29:43.623 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:29:43.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.624 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.624 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:29:43.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:29:43.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:29:43.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:29:43.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.625 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.625 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:29:43.625 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:29:43.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.626 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.626 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:29:43.626 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:43.627 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 246.74542359399999, 2020-11-12T17:29:43.627 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:29:43.627 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.627 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.627 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.627 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:43.627 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:43.627 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:29:43.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.628 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.628 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.628 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:43.628 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:43.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:29:43.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.629 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.629 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:29:43.629 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:29:43.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.630 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.630 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:29:43.630 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:29:43.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:29:43.631 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:29:43.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.631 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.631 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:29:43.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:29:43.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.632 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.632 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:29:43.632 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:29:43.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.632 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:29:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:29:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:29:43.633 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:29:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:29:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:29:43.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:29:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:29:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.635 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:29:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:29:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:29:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:29:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.636 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.637 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:29:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 221.963072627, 2020-11-12T17:29:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:29:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.638 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:29:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:43.640 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:29:43.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.641 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.641 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:29:43.641 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:29:43.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:29:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:29:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.642 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:29:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:29:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:29:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:29:43.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:29:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:29:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.644 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:29:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:29:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:29:43.645 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:29:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:29:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:29:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:29:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:29:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.647 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:29:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:29:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:29:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:29:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.648 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:29:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 161.478271127, 2020-11-12T17:29:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:29:43.649 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:43.650 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:29:43.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.651 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.651 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:43.652 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.652 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.652 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:29:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:29:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:29:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:29:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.654 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:29:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:29:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:29:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:29:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:29:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:29:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.656 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:29:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:29:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:29:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:29:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:29:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:29:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:29:43.658 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:29:43.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.659 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:29:43.659 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:29:43.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.659 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.660 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:29:43.660 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:29:43.660 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.660 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.660 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:29:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 139.416911457, 2020-11-12T17:29:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:29:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.661 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:29:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.662 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:29:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:29:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:29:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.664 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:29:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:29:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:29:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:29:43.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:29:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:29:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.666 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:29:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:29:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:29:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:29:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:29:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:29:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.668 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:29:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:29:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:29:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:29:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.670 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.670 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:29:43.670 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:29:43.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.671 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.671 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.671 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:29:43.671 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:29:43.672 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.672 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.672 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.673 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:59192 5.0 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e168)", 2020-11-12T17:29:43.673 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:43.673 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 109.730212665, 2020-11-12T17:29:43.673 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003, 2020-11-12T17:29:43.674 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.674 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.674 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.674 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 59192 2020-11-12T17:29:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.675 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802660+0000", 2020-11-12T17:29:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9094000000000001e-05 2020-11-12T17:29:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.677 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802709+0000", 2020-11-12T17:29:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9580000000000004e-06 2020-11-12T17:29:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802715+0000", 2020-11-12T17:29:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0690000000000002e-06 2020-11-12T17:29:43.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.679 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.679 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802719+0000", 2020-11-12T17:29:43.679 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010962786 2020-11-12T17:29:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813681+0000", 2020-11-12T17:29:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011702 2020-11-12T17:29:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.680 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813798+0000", 2020-11-12T17:29:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187436 2020-11-12T17:29:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813986+0000", 2020-11-12T17:29:43.681 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020009369999999999 2020-11-12T17:29:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.815987+0000", 2020-11-12T17:29:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46767350899999999 2020-11-12T17:29:43.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283660+0000", 2020-11-12T17:29:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3396e-05 2020-11-12T17:29:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.683 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283734+0000", 2020-11-12T17:29:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0195999999999998e-05 2020-11-12T17:29:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283784+0000", 2020-11-12T17:29:43.684 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003 2020-11-12T17:29:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59360 5.1 e169/127 5:8e053221:::benchmark_data_smithi036_24110_object7419:head v 169'3752, mlcod=169'3747)", 2020-11-12T17:29:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 108.831725394, 2020-11-12T17:29:43.686 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999, 2020-11-12T17:29:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:43.687 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:29:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.688 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701143+0000", 2020-11-12T17:29:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4913000000000006e-05 2020-11-12T17:29:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701218+0000", 2020-11-12T17:29:43.689 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45075755000000001 2020-11-12T17:29:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151975+0000", 2020-11-12T17:29:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7439999999999996e-06 2020-11-12T17:29:43.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151984+0000", 2020-11-12T17:29:43.691 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5661000000000001e-05 2020-11-12T17:29:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.692 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152040+0000", 2020-11-12T17:29:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0267e-05 2020-11-12T17:29:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152070+0000", 2020-11-12T17:29:43.693 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027662300000000002 2020-11-12T17:29:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154836+0000", 2020-11-12T17:29:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0707e-05 2020-11-12T17:29:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154897+0000", 2020-11-12T17:29:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999 2020-11-12T17:29:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:62424 5.1 e171/127 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head v 171'3992, mlcod=171'3984)", 2020-11-12T17:29:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 104.333964757, 2020-11-12T17:29:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437, 2020-11-12T17:29:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.696 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.697 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.698 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198896+0000", 2020-11-12T17:29:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9000999999999997e-05 2020-11-12T17:29:43.699 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198985+0000", 2020-11-12T17:29:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48058147200000001 2020-11-12T17:29:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679566+0000", 2020-11-12T17:29:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9140000000000003e-06 2020-11-12T17:29:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.701 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679576+0000", 2020-11-12T17:29:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1407000000000003e-05 2020-11-12T17:29:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679647+0000", 2020-11-12T17:29:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1270999999999999e-05 2020-11-12T17:29:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679679+0000", 2020-11-12T17:29:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002926648 2020-11-12T17:29:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.703 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682605+0000", 2020-11-12T17:29:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1626999999999998e-05 2020-11-12T17:29:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682667+0000", 2020-11-12T17:29:43.704 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437 2020-11-12T17:29:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:65088 5.1 e177/127 5:8edfd3fe:::benchmark_data_smithi036_24110_object8135:head v 177'4152, mlcod=177'4145)", 2020-11-12T17:29:43.705 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 91.350839969000006, 2020-11-12T17:29:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004, 2020-11-12T17:29:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.706 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:43.707 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:29:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182031+0000", 2020-11-12T17:29:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8371000000000001e-05 2020-11-12T17:29:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.708 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182090+0000", 2020-11-12T17:29:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64597910199999997 2020-11-12T17:29:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.710 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.710 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828069+0000", 2020-11-12T17:29:43.710 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6649999999999998e-06 2020-11-12T17:29:43.710 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828078+0000", 2020-11-12T17:29:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013253599999999999 2020-11-12T17:29:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828211+0000", 2020-11-12T17:29:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1916999999999999e-05 2020-11-12T17:29:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828253+0000", 2020-11-12T17:29:43.712 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00329598 2020-11-12T17:29:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831549+0000", 2020-11-12T17:29:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5890999999999996e-05 2020-11-12T17:29:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.713 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831615+0000", 2020-11-12T17:29:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004 2020-11-12T17:29:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:12064 6.0 e198/193 ondisk, result = 0)", 2020-11-12T17:29:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 55.661815124, 2020-11-12T17:29:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674, 2020-11-12T17:29:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.716 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:29:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871061+0000", 2020-11-12T17:29:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6056000000000002e-05 2020-11-12T17:29:43.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871097+0000", 2020-11-12T17:29:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59417804799999996 2020-11-12T17:29:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.718 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465275+0000", 2020-11-12T17:29:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1326e-05 2020-11-12T17:29:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465287+0000", 2020-11-12T17:29:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1495000000000001e-05 2020-11-12T17:29:43.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465338+0000", 2020-11-12T17:29:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4560000000000003e-06 2020-11-12T17:29:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.720 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465345+0000", 2020-11-12T17:29:43.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9233000000000004e-05 2020-11-12T17:29:43.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.721 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.721 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465435+0000", 2020-11-12T17:29:43.721 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674 2020-11-12T17:29:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.722 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.6159.0:15080 6.b 6:ded5ee56:::benchmark_data_smithi036_29033_object1884:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e199)", 2020-11-12T17:29:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 52.308057331999997, 2020-11-12T17:29:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999, 2020-11-12T17:29:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.6159", 2020-11-12T17:29:43.723 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:29:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 15080 2020-11-12T17:29:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:29:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.725 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224802+0000", 2020-11-12T17:29:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1513000000000003e-05 2020-11-12T17:29:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224893+0000", 2020-11-12T17:29:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7841000000000001e-05 2020-11-12T17:29:43.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224911+0000", 2020-11-12T17:29:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1224e-05 2020-11-12T17:29:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.727 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224922+0000", 2020-11-12T17:29:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9716000000000006e-05 2020-11-12T17:29:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.728 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225012+0000", 2020-11-12T17:29:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017505999999999999 2020-11-12T17:29:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.729 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225187+0000", 2020-11-12T17:29:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030063900000000001 2020-11-12T17:29:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225488+0000", 2020-11-12T17:29:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021279850000000002 2020-11-12T17:29:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:43.731 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.227616+0000", 2020-11-12T17:29:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60001606200000002 2020-11-12T17:29:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827632+0000", 2020-11-12T17:29:43.732 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3869000000000002e-05 2020-11-12T17:29:43.733 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.733 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.733 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827686+0000", 2020-11-12T17:29:43.733 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7774999999999997e-05 2020-11-12T17:29:43.734 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.734 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.734 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827724+0000", 2020-11-12T17:29:43.734 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999 2020-11-12T17:29:43.734 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:15080 6.b e199/190 ondisk, result = 0)", 2020-11-12T17:29:43.735 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 52.303110685999997, 2020-11-12T17:29:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005, 2020-11-12T17:29:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.736 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:43.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.738 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.738 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229750+0000", 2020-11-12T17:29:43.738 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7358000000000001e-05 2020-11-12T17:29:43.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.739 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.739 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229817+0000", 2020-11-12T17:29:43.739 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59622965400000005 2020-11-12T17:29:43.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826047+0000", 2020-11-12T17:29:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7509999999999997e-06 2020-11-12T17:29:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.740 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.741 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826052+0000", 2020-11-12T17:29:43.741 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001561729 2020-11-12T17:29:43.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827614+0000", 2020-11-12T17:29:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0472000000000001e-05 2020-11-12T17:29:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.742 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827625+0000", 2020-11-12T17:29:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106687 2020-11-12T17:29:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827731+0000", 2020-11-12T17:29:43.743 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005 2020-11-12T17:29:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.6159.0:15728 6.7 e199/190 6:e4c465ea:::benchmark_data_smithi036_29033_object1965:head v 199'1032, mlcod=199'1025)", 2020-11-12T17:29:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:43.744 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 51.593497954, 2020-11-12T17:29:43.745 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426, 2020-11-12T17:29:43.745 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:43.745 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:43.745 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:43.745 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.745 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:43.745 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:43.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:43.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.746 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:43.746 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:43.746 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:29:43.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:43.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939371+0000", 2020-11-12T17:29:43.747 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3385000000000002e-05 2020-11-12T17:29:43.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.747 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:43.747 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939455+0000", 2020-11-12T17:29:43.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40948674800000001 2020-11-12T17:29:43.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.748 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:43.748 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348941+0000", 2020-11-12T17:29:43.748 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3089999999999998e-06 2020-11-12T17:29:43.748 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:43.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348949+0000", 2020-11-12T17:29:43.749 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3567999999999998e-05 2020-11-12T17:29:43.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.749 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:43.749 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349022+0000", 2020-11-12T17:29:43.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2410999999999999e-05 2020-11-12T17:29:43.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.750 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.750 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:43.750 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349055+0000", 2020-11-12T17:29:43.750 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050284420000000002 2020-11-12T17:29:43.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:43.751 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354083+0000", 2020-11-12T17:29:43.751 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8516000000000005e-05 2020-11-12T17:29:43.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:43.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:43.751 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:43.752 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354162+0000", 2020-11-12T17:29:43.752 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426 2020-11-12T17:29:43.752 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.752 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.752 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.752 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:43.752 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:43.753 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:43.754 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:29:43.755 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:43.750+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:43.855 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:43.851+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:43.869 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:43.870 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:43.870 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:43.879 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:29:43.958 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:43.954+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:44.035 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:44.035 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:44.035 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:44.044 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:29:44.089 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:44.087+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:44.151 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:44.152 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:44.152 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:44.152 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:44.152 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.152 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:29:44.153 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:29:44.153 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 393.46303227499999, 2020-11-12T17:29:44.153 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:29:44.153 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:44.153 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:44.153 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:44.153 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:44.154 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:44.154 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:29:44.154 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.154 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:44.154 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.154 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:44.154 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:29:44.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:44.155 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.155 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.155 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:44.155 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:29:44.155 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:29:44.156 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.156 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.156 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:44.156 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:29:44.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:29:44.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.157 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.157 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:44.157 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:29:44.157 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:29:44.157 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:44.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:29:44.158 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:29:44.158 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.158 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.158 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:44.158 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:29:44.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:29:44.159 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.159 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.159 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:44.159 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:29:44.159 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:29:44.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:44.160 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:29:44.160 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:29:44.160 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.160 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.160 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:44.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:29:44.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:29:44.161 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.161 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.161 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:44.161 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:29:44.161 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:29:44.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.162 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:44.162 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:29:44.162 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:29:44.162 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.162 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:44.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:29:44.163 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:29:44.163 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.163 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.163 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:44.163 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:29:44.164 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:29:44.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:44.164 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:44.164 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:44.164 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.164 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.164 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:29:44.164 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:29:44.165 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 393.457552206, 2020-11-12T17:29:44.165 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:29:44.165 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:44.165 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:44.165 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:44.165 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.165 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:44.165 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:29:44.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:44.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.166 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.166 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:44.166 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:29:44.166 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:44.166 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:44.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:29:44.167 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:29:44.167 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.167 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.167 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:44.167 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:29:44.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:29:44.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.168 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.168 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:44.168 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:29:44.168 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:29:44.168 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:44.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:29:44.169 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:29:44.169 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.169 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.169 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:44.169 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:29:44.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:29:44.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.170 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.170 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:44.170 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:29:44.170 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:29:44.170 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.171 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.171 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:44.171 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:29:44.171 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:29:44.171 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:44.171 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:44.171 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:44.171 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.172 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.172 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:29:44.172 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:29:44.172 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 385.267430606, 2020-11-12T17:29:44.172 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:29:44.172 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:44.172 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:44.173 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:44.173 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:44.173 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:44.173 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:29:44.173 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.173 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:44.173 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.173 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:44.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:29:44.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:44.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.174 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.174 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:44.174 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:29:44.174 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:29:44.174 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:44.175 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:29:44.175 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:29:44.175 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.175 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.175 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:44.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:29:44.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:29:44.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.176 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.176 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:44.176 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:29:44.176 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:29:44.176 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:44.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:29:44.177 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:29:44.177 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.177 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.177 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:44.177 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:29:44.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:29:44.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.178 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.178 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:44.178 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:29:44.178 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:29:44.178 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:44.179 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:29:44.179 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:29:44.179 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.179 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.179 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:44.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:29:44.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:29:44.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.180 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.180 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:44.180 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:29:44.180 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:29:44.180 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:44.181 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:44.181 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:44.181 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:29:44.181 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:29:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.198 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:29:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:29:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:29:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:29:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 385.26018689699998, 2020-11-12T17:29:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:29:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:45.200 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:29:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.201 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:29:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:29:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:45.202 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:29:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:29:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:29:45.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:29:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:29:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:29:45.204 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:29:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:29:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:45.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:29:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:29:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:29:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:29:45.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:29:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:29:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:45.207 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:29:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:29:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 309.26409752299998, 2020-11-12T17:29:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:29:45.208 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:29:45.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:29:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:29:45.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:29:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:29:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:29:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:29:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:45.212 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:29:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:29:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:45.213 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:29:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:29:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:29:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:29:45.214 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:29:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:29:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:29:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:29:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:45.216 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:29:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:29:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 243.13657501099999, 2020-11-12T17:29:45.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:29:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:29:45.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:29:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:45.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:29:45.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:29:45.220 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.220 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.220 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:45.220 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:29:45.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:29:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:29:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:29:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:29:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:29:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:29:45.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:29:45.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:45.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:29:45.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:29:45.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:29:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:29:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:29:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:29:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 236.08582756999999, 2020-11-12T17:29:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:29:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:45.225 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:29:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:45.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:29:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:29:45.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:29:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:29:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:29:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:29:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:29:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:29:45.229 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:29:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:29:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:29:45.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:29:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:29:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.231 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:29:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:29:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:29:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:29:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:45.233 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:29:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:29:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:29:45.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:29:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:29:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:29:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:29:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:29:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.236 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:29:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:29:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 236.085739375, 2020-11-12T17:29:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:29:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:45.237 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:29:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.238 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:29:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:29:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:45.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:29:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:29:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.240 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:29:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:29:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:29:45.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:29:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:29:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:29:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:29:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:29:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:29:45.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:29:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:29:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:29:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.244 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:29:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:29:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:29:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:29:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.246 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:29:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:29:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:29:45.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:29:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:29:45.248 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:29:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 236.06702634199999, 2020-11-12T17:29:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:29:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:45.249 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:29:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:29:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:45.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.214 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.214 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:29:46.215 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.216 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:29:46.217 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.218 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.219 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 203.31620389099999, 2020-11-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:46.220 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.221 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:29:46.222 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:29:46.223 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:29:46.223 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.223 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.223 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.223 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:29:46.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:29:46.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.224 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.224 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.224 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:29:46.224 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:29:46.224 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:29:46.225 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:29:46.225 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.225 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.225 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.225 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:29:46.226 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:29:46.226 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.226 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.226 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.226 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:29:46.227 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:29:46.227 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.227 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.228 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:46.228 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:29:46.228 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:29:46.228 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.229 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.229 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:46.229 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:29:46.230 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:29:46.230 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.230 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.231 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:46.231 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:29:46.231 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:29:46.231 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:29:46.232 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.233 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:29:46.234 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.235 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:29:46.236 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 202.229548403, 2020-11-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:46.237 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:46.238 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.239 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.240 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:29:46.241 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:29:46.242 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.242 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.242 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.243 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:29:46.243 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:29:46.243 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.243 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.244 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.244 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:29:46.244 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:29:46.245 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.245 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.245 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.245 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:29:46.246 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:29:46.246 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.246 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.247 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.247 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:29:46.247 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:29:46.247 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.248 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.248 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.248 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:29:46.249 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:29:46.249 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.249 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.249 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.250 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:29:46.250 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:29:46.250 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.251 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.251 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:46.251 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:29:46.251 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:29:46.252 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.252 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.252 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:46.253 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:29:46.253 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:29:46.253 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.253 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.254 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:46.254 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:29:46.254 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:29:46.255 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.255 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.255 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:46.255 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:29:46.256 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:29:46.256 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.256 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.257 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.257 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:29:46.257 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:29:46.257 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.258 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.258 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.258 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.259 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.259 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:29:46.259 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:29:46.259 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 202.216067176, 2020-11-12T17:29:46.260 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:29:46.260 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.260 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:46.260 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.261 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.261 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.261 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:29:46.262 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.262 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.262 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.263 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.263 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:29:46.263 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:29:46.263 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.264 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.264 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.264 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:29:46.264 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:29:46.265 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.265 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.265 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.266 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:29:46.266 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:29:46.266 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.267 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.267 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.267 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:29:46.267 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:29:46.268 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.268 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.268 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.268 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:29:46.269 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:29:46.269 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.269 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.270 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.270 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:29:46.270 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:29:46.271 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.271 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.271 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.271 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:29:46.272 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:29:46.272 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.272 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.273 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.273 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:29:46.273 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:29:46.273 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.274 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.274 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.274 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.275 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.275 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:29:46.275 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:29:46.275 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 167.21377897400001, 2020-11-12T17:29:46.276 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:29:46.276 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.276 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:46.277 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:46.277 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:46.277 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:46.277 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:29:46.278 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.278 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.278 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.279 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.279 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:29:46.279 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.279 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.280 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.280 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.280 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:29:46.281 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:29:46.281 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.281 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.281 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.282 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:29:46.282 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:29:46.282 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.283 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.283 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.283 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:29:46.283 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:29:46.284 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.284 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.284 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.284 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:29:46.285 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:29:46.285 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.285 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.286 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.286 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:29:46.286 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:29:46.286 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.287 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.287 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.287 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:29:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:29:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.288 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:29:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:29:46.289 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.290 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.290 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:46.290 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:29:46.290 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:29:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.291 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:29:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:29:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.292 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:29:46.293 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:29:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:29:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:29:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.294 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:29:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:29:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.295 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:29:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:29:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 167.20796239000001, 2020-11-12T17:29:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:29:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.296 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:29:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.297 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:29:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:29:46.298 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:29:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:29:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:29:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.299 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:29:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:29:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:29:46.300 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:29:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:29:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:29:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.301 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:29:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:29:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:29:46.302 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:29:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:29:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:29:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.303 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:29:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:29:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:29:46.304 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:29:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:29:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:29:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.305 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:29:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:29:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.306 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:29:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:29:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 167.18502887599999, 2020-11-12T17:29:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:29:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.307 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:29:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.308 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:29:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:29:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:29:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.309 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:29:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:29:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:29:46.310 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:29:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:29:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:29:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.311 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:29:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:29:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:29:46.312 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:29:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:29:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:29:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.313 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:29:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:29:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.314 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:29:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:29:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 160.65255084899999, 2020-11-12T17:29:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:29:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.315 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:29:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.316 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:29:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:29:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.321 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:29:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:29:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:29:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:29:46.322 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:29:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:29:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.323 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:29:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:29:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:29:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:29:46.324 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:29:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:29:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:46.325 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:29:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:29:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:29:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:29:46.326 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e169)", 2020-11-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:29:46.327 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 109.45784480899999, 2020-11-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002, 2020-11-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:29:46.328 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:29:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.329 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691863+0000", 2020-11-12T17:29:46.330 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103144 2020-11-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691966+0000", 2020-11-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8453000000000001e-05 2020-11-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.331 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691985+0000", 2020-11-12T17:29:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0385e-05 2020-11-12T17:29:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691995+0000", 2020-11-12T17:29:46.332 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0098187989999999996 2020-11-12T17:29:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701814+0000", 2020-11-12T17:29:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000135065 2020-11-12T17:29:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.333 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701949+0000", 2020-11-12T17:29:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025538399999999999 2020-11-12T17:29:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.702205+0000", 2020-11-12T17:29:46.334 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034246620000000002 2020-11-12T17:29:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.705629+0000", 2020-11-12T17:29:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.450897995 2020-11-12T17:29:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.335 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156527+0000", 2020-11-12T17:29:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2074000000000001e-05 2020-11-12T17:29:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156599+0000", 2020-11-12T17:29:46.336 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1148000000000002e-05 2020-11-12T17:29:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156690+0000", 2020-11-12T17:29:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002 2020-11-12T17:29:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.337 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e169)", 2020-11-12T17:29:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:29:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 109.436226195, 2020-11-12T17:29:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003, 2020-11-12T17:29:46.338 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:29:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:29:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.339 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:29:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.340 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:29:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713485+0000", 2020-11-12T17:29:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7021000000000005e-05 2020-11-12T17:29:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.341 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713582+0000", 2020-11-12T17:29:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2103000000000001e-05 2020-11-12T17:29:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.342 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713595+0000", 2020-11-12T17:29:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0129999999999999e-06 2020-11-12T17:29:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713601+0000", 2020-11-12T17:29:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001321727 2020-11-12T17:29:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.343 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.714922+0000", 2020-11-12T17:29:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011930300000000001 2020-11-12T17:29:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:29:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.715042+0000", 2020-11-12T17:29:46.344 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44158781200000002 2020-11-12T17:29:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156629+0000", 2020-11-12T17:29:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003 2020-11-12T17:29:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.345 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62424 5.1 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e171)", 2020-11-12T17:29:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:29:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 104.954294101, 2020-11-12T17:29:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456, 2020-11-12T17:29:46.346 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62424 2020-11-12T17:29:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.347 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:29:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.348 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:29:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999809 2020-11-12T17:29:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195432+0000", 2020-11-12T17:29:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1144999999999999e-05 2020-11-12T17:29:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.349 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195483+0000", 2020-11-12T17:29:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2553e-05 2020-11-12T17:29:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195496+0000", 2020-11-12T17:29:46.350 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0469999999999996e-06 2020-11-12T17:29:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195503+0000", 2020-11-12T17:29:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041025339999999997 2020-11-12T17:29:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.351 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199605+0000", 2020-11-12T17:29:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114968 2020-11-12T17:29:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199720+0000", 2020-11-12T17:29:46.352 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020953000000000001 2020-11-12T17:29:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199930+0000", 2020-11-12T17:29:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043700170000000003 2020-11-12T17:29:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.353 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.204300+0000", 2020-11-12T17:29:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.480176663 2020-11-12T17:29:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684477+0000", 2020-11-12T17:29:46.354 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017691000000000001 2020-11-12T17:29:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684653+0000", 2020-11-12T17:29:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107935 2020-11-12T17:29:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.355 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684761+0000", 2020-11-12T17:29:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456 2020-11-12T17:29:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.356 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:65088 5.1 5:8edfd3fe:::benchmark_data_smithi036_24110_object8135:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e177)", 2020-11-12T17:29:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:29:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 91.968893050999995, 2020-11-12T17:29:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.652361309, 2020-11-12T17:29:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:46.357 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 65088 2020-11-12T17:29:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:29:46.358 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:29:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:29:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.359 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180810+0000", 2020-11-12T17:29:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120461 2020-11-12T17:29:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180931+0000", 2020-11-12T17:29:46.360 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5746000000000001e-05 2020-11-12T17:29:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180947+0000", 2020-11-12T17:29:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8739999999999995e-06 2020-11-12T17:29:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.361 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180955+0000", 2020-11-12T17:29:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017552710000000001 2020-11-12T17:29:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.182710+0000", 2020-11-12T17:29:46.362 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013040999999999999 2020-11-12T17:29:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.182840+0000", 2020-11-12T17:29:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000212112 2020-11-12T17:29:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.363 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.183052+0000", 2020-11-12T17:29:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031255879999999999 2020-11-12T17:29:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.186178+0000", 2020-11-12T17:29:46.364 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.64690791400000003 2020-11-12T17:29:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833086+0000", 2020-11-12T17:29:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2926000000000001e-05 2020-11-12T17:29:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.365 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833139+0000", 2020-11-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4467000000000004e-05 2020-11-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833213+0000", 2020-11-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.652361309 2020-11-12T17:29:46.366 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:46.367 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:46.368 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:29:46.369 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd unset nodeep-scrub 2020-11-12T17:29:46.373 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 68 16 29904 29888 3.43345 0 - 0.0157766 2020-11-12T17:29:46.373 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 69 16 29904 29888 3.38369 0 - 0.0157766 2020-11-12T17:29:46.374 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:45.506+0000 7fc24d2e3700 -1 osd.3 221 handle_osd_map injecting map crc failure 2020-11-12T17:29:46.374 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:46.363+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:46.375 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:29:46.470 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:46.466+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:46.528 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 70 16 29904 29888 3.33535 0 - 0.0157766 2020-11-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:46.529 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:46.530 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:46.536 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:46.539 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:29:46.565 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:46.585 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:46.583+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:46.595 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:46.626 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:46.649 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:46.649 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:46.649 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:46.649 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:46.650 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:46.657 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:46.659 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:29:46.684 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:46.701 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:46.699+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:46.711 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:46.711 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:29:46.711 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:29:46.711 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:46.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:46.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:29:46.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:29:46.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:29:46.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:29:46.712 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:29:46.714 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:46.715 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:46.773 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:46.767+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:46.810 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:46.811 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:46.820 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:29:46.905 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:46.903+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:46.971 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:47.082 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:47.084 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:47.010+0000 7fc2486d1700 -1 osd.3 222 handle_osd_map injecting map crc failure 2020-11-12T17:29:47.084 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:47.010+0000 7fc2486d1700 -1 osd.3 222 handle_osd_map injecting map crc failure 2020-11-12T17:29:47.085 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:29:47.085 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:47.082+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:47.185 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:47.182+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:47.235 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:47.237 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:47.246 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:29:47.286 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:47.282+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:47.352 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:47.353 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:47.362 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:29:47.405 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:47.403+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:47.470 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:47.470 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:47.471 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is unset 2020-11-12T17:29:47.480 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:29:47.522 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:47.519+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:47.555 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 71 16 29904 29888 3.28838 0 - 0.0157766 2020-11-12T17:29:47.598 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:47.595+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:47.629 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:47.630 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:47.640 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:29:47.725 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:47.723+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:47.789 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:47.783+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:47.791 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:47.792 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:47.801 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:29:47.890 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:47.886+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:47.915 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:47.925 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:29:47.991 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:47.987+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:48.081 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:48.081 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:48.091 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:29:48.092 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:48.087+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:48.193 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:48.187+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:48.198 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:48.198 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:48.208 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:29:48.294 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:48.291+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:48.318 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:48.319 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:48.329 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:29:48.372 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 7, 6, 2, 0, 1] out_osds: [] dead_osds: [2] live_osds: [0, 3, 4, 5, 6, 7, 1] 2020-11-12T17:29:48.379 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2020-11-12T17:29:48.400 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-12T17:29:48.406 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-12T17:29:48.408 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:48.403+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:48.409 INFO:tasks.ceph.osd.2:Started 2020-11-12T17:29:48.410 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:29:48.436 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:48.436 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:48.446 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:29:48.507 INFO:teuthology.orchestra.run.smithi036.stderr:no valid command found; 10 closest matches: 2020-11-12T17:29:48.524 INFO:teuthology.orchestra.run.smithi036.stderr:0 2020-11-12T17:29:48.525 INFO:teuthology.orchestra.run.smithi036.stderr:1 2020-11-12T17:29:48.526 INFO:teuthology.orchestra.run.smithi036.stderr:2 2020-11-12T17:29:48.526 INFO:teuthology.orchestra.run.smithi036.stderr:abort 2020-11-12T17:29:48.526 INFO:teuthology.orchestra.run.smithi036.stderr:assert 2020-11-12T17:29:48.526 INFO:teuthology.orchestra.run.smithi036.stderr:config diff 2020-11-12T17:29:48.527 INFO:teuthology.orchestra.run.smithi036.stderr:config diff get 2020-11-12T17:29:48.527 INFO:teuthology.orchestra.run.smithi036.stderr:config get 2020-11-12T17:29:48.527 INFO:teuthology.orchestra.run.smithi036.stderr:config help [] 2020-11-12T17:29:48.527 INFO:teuthology.orchestra.run.smithi036.stderr:config set ... 2020-11-12T17:29:48.527 INFO:teuthology.orchestra.run.smithi036.stderr:admin_socket: invalid command 2020-11-12T17:29:48.528 DEBUG:teuthology.orchestra.run:got remote process result: 22 2020-11-12T17:29:48.531 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2020-11-12T17:29:48.532 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:48.523+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:48.533 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 72 16 29904 29888 3.24271 0 - 0.0157766 2020-11-12T17:29:48.613 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:48.614 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:48.625 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:29:48.630 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:48.627+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:48.716 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:29:48.726 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:48.726 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:48.731 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:48.727+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:48.736 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:29:48.831 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:48.827+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:48.871 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:29:48.894 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:29:48.895 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:29:48.898 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:29:48.904 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:29:48.928 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:29:48.931 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:48.927+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:48.956 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:29:48.991 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:29:49.006 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:29:49.006 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 20, 2020-11-12T17:29:49.006 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 600, 2020-11-12T17:29:49.006 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [ 2020-11-12T17:29:49.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.007 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:9896 3.7 3:e77b656a:::benchmark_data_smithi036_14212_object1236:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e26)", 2020-11-12T17:29:49.007 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:49.007 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 394.58339609500001, 2020-11-12T17:29:49.007 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002, 2020-11-12T17:29:49.007 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.007 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.008 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.008 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:49.008 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:49.008 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 9896 2020-11-12T17:29:49.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.008 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.008 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:49.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.009 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.009 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.009 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418488+0000", 2020-11-12T17:29:49.009 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999256 2020-11-12T17:29:49.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.010 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.010 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418414+0000", 2020-11-12T17:29:49.010 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021203800000000001 2020-11-12T17:29:49.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418626+0000", 2020-11-12T17:29:49.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1680999999999997e-05 2020-11-12T17:29:49.011 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.011 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.011 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418657+0000", 2020-11-12T17:29:49.011 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1718e-05 2020-11-12T17:29:49.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.012 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.012 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.418669+0000", 2020-11-12T17:29:49.012 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0017549760000000001 2020-11-12T17:29:49.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420424+0000", 2020-11-12T17:29:49.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016544300000000001 2020-11-12T17:29:49.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.013 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.013 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420590+0000", 2020-11-12T17:29:49.013 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000192585 2020-11-12T17:29:49.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.014 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:49.014 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.420782+0000", 2020-11-12T17:29:49.014 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001301633 2020-11-12T17:29:49.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.422084+0000", 2020-11-12T17:29:49.015 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56400493799999996 2020-11-12T17:29:49.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.015 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.015 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986089+0000", 2020-11-12T17:29:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.1848999999999995e-05 2020-11-12T17:29:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986171+0000", 2020-11-12T17:29:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010679399999999999 2020-11-12T17:29:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986277+0000", 2020-11-12T17:29:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56778905000000002 2020-11-12T17:29:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.4475.0:9896 3.7 e26/20 ondisk, result = 0)", 2020-11-12T17:29:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 394.57645203300001, 2020-11-12T17:29:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097, 2020-11-12T17:29:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425432+0000", 2020-11-12T17:29:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425415+0000", 2020-11-12T17:29:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3452000000000002e-05 2020-11-12T17:29:49.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.021 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.425479+0000", 2020-11-12T17:29:49.021 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56052262600000002 2020-11-12T17:29:49.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.021 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986001+0000", 2020-11-12T17:29:49.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0159999999999999e-06 2020-11-12T17:29:49.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.022 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.022 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986006+0000", 2020-11-12T17:29:49.022 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3866999999999998e-05 2020-11-12T17:29:49.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.023 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986060+0000", 2020-11-12T17:29:49.023 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5345e-05 2020-11-12T17:29:49.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.023 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986076+0000", 2020-11-12T17:29:49.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00021489 2020-11-12T17:29:49.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.024 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.024 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:14.986290+0000", 2020-11-12T17:29:49.024 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.560858097 2020-11-12T17:29:49.024 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.025 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.025 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.025 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.025 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:30520 3.b 3:d6ac5d6c:::benchmark_data_smithi036_14212_object3814:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e48)", 2020-11-12T17:29:49.025 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:49.025 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 358.40261424699997, 2020-11-12T17:29:49.025 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998, 2020-11-12T17:29:49.026 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.026 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.026 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.026 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:49.026 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:49.026 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 30520 2020-11-12T17:29:49.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.027 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.027 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:49.027 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.027 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599270+0000", 2020-11-12T17:29:49.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999685 2020-11-12T17:29:49.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.028 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.028 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599238+0000", 2020-11-12T17:29:49.028 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0674999999999997e-05 2020-11-12T17:29:49.028 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.029 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599309+0000", 2020-11-12T17:29:49.029 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.5769999999999996e-06 2020-11-12T17:29:49.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.029 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.029 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599317+0000", 2020-11-12T17:29:49.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0999999999999997e-06 2020-11-12T17:29:49.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.030 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.030 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.599321+0000", 2020-11-12T17:29:49.030 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044977319999999999 2020-11-12T17:29:49.030 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.031 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603819+0000", 2020-11-12T17:29:49.031 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4835999999999998e-05 2020-11-12T17:29:49.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.031 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.603913+0000", 2020-11-12T17:29:49.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000162542 2020-11-12T17:29:49.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.032 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.032 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 0", 2020-11-12T17:29:49.032 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.604076+0000", 2020-11-12T17:29:49.032 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0054636820000000001 2020-11-12T17:29:49.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.033 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.033 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.609540+0000", 2020-11-12T17:29:49.033 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36638189199999999 2020-11-12T17:29:49.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.034 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975921+0000", 2020-11-12T17:29:49.034 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1217999999999995e-05 2020-11-12T17:29:49.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.034 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.975993+0000", 2020-11-12T17:29:49.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101346 2020-11-12T17:29:49.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.035 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.035 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:23:50.976094+0000", 2020-11-12T17:29:49.035 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.37682391599999998 2020-11-12T17:29:49.036 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.036 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.036 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.036 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:45400 3.8 3:1d0a9e65:::benchmark_data_smithi036_14212_object5674:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e53)", 2020-11-12T17:29:49.036 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:49.036 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 342.13890915399998, 2020-11-12T17:29:49.037 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999, 2020-11-12T17:29:49.037 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.037 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.037 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.037 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:49.037 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:49.037 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 45400 2020-11-12T17:29:49.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.038 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.038 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:49.038 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.038 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.038 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.038 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862975+0000", 2020-11-12T17:29:49.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:49.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.039 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.039 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.862946+0000", 2020-11-12T17:29:49.039 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000113366 2020-11-12T17:29:49.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.040 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863059+0000", 2020-11-12T17:29:49.040 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.73e-05 2020-11-12T17:29:49.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.040 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863077+0000", 2020-11-12T17:29:49.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0499999999999992e-06 2020-11-12T17:29:49.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.041 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.041 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.863085+0000", 2020-11-12T17:29:49.041 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0086300649999999993 2020-11-12T17:29:49.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.042 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871715+0000", 2020-11-12T17:29:49.042 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.2553999999999995e-05 2020-11-12T17:29:49.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.042 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.042 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871807+0000", 2020-11-12T17:29:49.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000186861 2020-11-12T17:29:49.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.043 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.043 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:49.043 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.871994+0000", 2020-11-12T17:29:49.043 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0023640290000000001 2020-11-12T17:29:49.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:06.874358+0000", 2020-11-12T17:29:49.044 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38470539300000001 2020-11-12T17:29:49.044 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.044 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.044 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259064+0000", 2020-11-12T17:29:49.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6066000000000001e-05 2020-11-12T17:29:49.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.045 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.045 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.045 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259130+0000", 2020-11-12T17:29:49.045 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:29:49.045 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.046 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.046 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:07.259187+0000", 2020-11-12T17:29:49.046 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39621219899999999 2020-11-12T17:29:49.046 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.046 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.046 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.047 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.047 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.4475.0:57800 3.c e56/20 3:3642c236:::benchmark_data_smithi036_14212_object7224:head v 56'3872, mlcod=56'3860)", 2020-11-12T17:29:49.047 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:49.047 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 327.05352882800003, 2020-11-12T17:29:49.047 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996, 2020-11-12T17:29:49.047 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.047 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.048 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.048 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:49.048 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.048 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948356+0000", 2020-11-12T17:29:49.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999595 2020-11-12T17:29:49.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.049 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.049 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.049 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948315+0000", 2020-11-12T17:29:49.049 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000125504 2020-11-12T17:29:49.049 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.050 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:21.948440+0000", 2020-11-12T17:29:49.050 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61606842399999995 2020-11-12T17:29:49.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.050 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564509+0000", 2020-11-12T17:29:49.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.0299999999999996e-06 2020-11-12T17:29:49.051 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.051 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.051 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564516+0000", 2020-11-12T17:29:49.051 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9333000000000003e-05 2020-11-12T17:29:49.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.052 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564575+0000", 2020-11-12T17:29:49.052 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.2717000000000002e-05 2020-11-12T17:29:49.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.052 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.052 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.564648+0000", 2020-11-12T17:29:49.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0033885249999999999 2020-11-12T17:29:49.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.053 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.053 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568036+0000", 2020-11-12T17:29:49.053 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1530000000000003e-05 2020-11-12T17:29:49.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.054 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.054 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.054 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:22.568088+0000", 2020-11-12T17:29:49.054 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.61973246299999996 2020-11-12T17:29:49.054 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.054 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.054 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.055 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4475.0:58744 3.7 3:ee7fc292:::benchmark_data_smithi036_14212_object7342:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e57)", 2020-11-12T17:29:49.055 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:49.055 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 325.35939055400002, 2020-11-12T17:29:49.055 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997, 2020-11-12T17:29:49.055 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.056 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.056 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.056 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4475", 2020-11-12T17:29:49.056 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:49.056 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 58744 2020-11-12T17:29:49.056 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.056 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.056 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:49.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.057 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.057 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642494+0000", 2020-11-12T17:29:49.057 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999628 2020-11-12T17:29:49.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.058 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.058 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642457+0000", 2020-11-12T17:29:49.058 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010911 2020-11-12T17:29:49.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.058 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642566+0000", 2020-11-12T17:29:49.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.556e-05 2020-11-12T17:29:49.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.059 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.059 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642581+0000", 2020-11-12T17:29:49.059 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.2489999999999998e-06 2020-11-12T17:29:49.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.060 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.642588+0000", 2020-11-12T17:29:49.060 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.016536039999999998 2020-11-12T17:29:49.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.060 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.060 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659124+0000", 2020-11-12T17:29:49.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9188000000000001e-05 2020-11-12T17:29:49.061 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.061 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.061 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.061 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659213+0000", 2020-11-12T17:29:49.061 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000200254 2020-11-12T17:29:49.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:49.062 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.659413+0000", 2020-11-12T17:29:49.062 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036909930000000001 2020-11-12T17:29:49.062 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.062 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.062 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:23.663104+0000", 2020-11-12T17:29:49.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36450257400000002 2020-11-12T17:29:49.063 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.063 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.063 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.063 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027607+0000", 2020-11-12T17:29:49.063 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000138381 2020-11-12T17:29:49.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.064 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027745+0000", 2020-11-12T17:29:49.064 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.7683000000000006e-05 2020-11-12T17:29:49.064 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.064 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.065 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:24:24.027843+0000", 2020-11-12T17:29:49.065 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38534883199999997 2020-11-12T17:29:49.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.065 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.065 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.065 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.065 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.065 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:40120 4.4 4:2a48b34f:::benchmark_data_smithi036_18856_object5014:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2020-11-12T17:29:49.066 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:49.066 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 257.09597900400001, 2020-11-12T17:29:49.066 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004, 2020-11-12T17:29:49.066 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.066 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.066 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.066 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:49.066 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:49.067 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 40120 2020-11-12T17:29:49.067 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.067 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.067 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.067 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.067 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:49.067 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.068 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905905+0000", 2020-11-12T17:29:49.068 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:49.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.068 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.068 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905872+0000", 2020-11-12T17:29:49.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.4445999999999997e-05 2020-11-12T17:29:49.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.069 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.069 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.069 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905966+0000", 2020-11-12T17:29:49.069 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.4442e-05 2020-11-12T17:29:49.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905981+0000", 2020-11-12T17:29:49.070 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.2320000000000001e-06 2020-11-12T17:29:49.070 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.070 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.070 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.070 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.905989+0000", 2020-11-12T17:29:49.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.0961999999999998e-05 2020-11-12T17:29:49.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.071 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.071 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906030+0000", 2020-11-12T17:29:49.071 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5050999999999999e-05 2020-11-12T17:29:49.071 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.071 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906085+0000", 2020-11-12T17:29:49.072 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00016809099999999999 2020-11-12T17:29:49.072 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.072 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.072 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:49.072 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.906253+0000", 2020-11-12T17:29:49.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0014072310000000001 2020-11-12T17:29:49.073 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.073 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.073 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.073 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:31.907660+0000", 2020-11-12T17:29:49.073 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56758366900000001 2020-11-12T17:29:49.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.074 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475244+0000", 2020-11-12T17:29:49.074 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1218999999999995e-05 2020-11-12T17:29:49.074 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.074 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.074 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475335+0000", 2020-11-12T17:29:49.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7255999999999994e-05 2020-11-12T17:29:49.075 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.075 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.075 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.075 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:32.475403+0000", 2020-11-12T17:29:49.075 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56949725500000004 2020-11-12T17:29:49.075 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.076 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.076 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.076 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.076 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44272 4.0 4:04f83045:::benchmark_data_smithi036_18856_object5533:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:29:49.076 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:49.076 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 252.29354010599999, 2020-11-12T17:29:49.077 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999, 2020-11-12T17:29:49.077 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.077 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.077 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.077 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:49.077 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:49.077 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44272 2020-11-12T17:29:49.077 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.078 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.078 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:49.078 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.078 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.078 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.078 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708344+0000", 2020-11-12T17:29:49.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999619 2020-11-12T17:29:49.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.079 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.079 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.079 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708306+0000", 2020-11-12T17:29:49.079 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000107394 2020-11-12T17:29:49.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.080 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708414+0000", 2020-11-12T17:29:49.080 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5235000000000001e-05 2020-11-12T17:29:49.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.080 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708429+0000", 2020-11-12T17:29:49.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3690000000000001e-06 2020-11-12T17:29:49.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.081 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.081 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.081 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.708436+0000", 2020-11-12T17:29:49.081 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00068463599999999997 2020-11-12T17:29:49.081 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709121+0000", 2020-11-12T17:29:49.082 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.3433000000000001e-05 2020-11-12T17:29:49.082 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.082 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.082 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.082 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709184+0000", 2020-11-12T17:29:49.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000101489 2020-11-12T17:29:49.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.083 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.083 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:49.083 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.709286+0000", 2020-11-12T17:29:49.083 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0036588850000000002 2020-11-12T17:29:49.083 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.712945+0000", 2020-11-12T17:29:49.084 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.38624688400000001 2020-11-12T17:29:49.084 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.084 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.084 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.084 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099191+0000", 2020-11-12T17:29:49.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00012345300000000001 2020-11-12T17:29:49.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.085 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.085 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099315+0000", 2020-11-12T17:29:49.085 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8846999999999999e-05 2020-11-12T17:29:49.085 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.085 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.086 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.086 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.099394+0000", 2020-11-12T17:29:49.086 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.39104950799999999 2020-11-12T17:29:49.086 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.086 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.086 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.087 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:44328 4.4 4:28df349f:::benchmark_data_smithi036_18856_object5540:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e91)", 2020-11-12T17:29:49.087 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:49.087 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 252.21441778900001, 2020-11-12T17:29:49.087 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999, 2020-11-12T17:29:49.087 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.087 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.087 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.088 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:49.088 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:49.088 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 44328 2020-11-12T17:29:49.088 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.088 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.088 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.088 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.088 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:49.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.089 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.089 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787467+0000", 2020-11-12T17:29:49.089 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999776 2020-11-12T17:29:49.089 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.089 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787444+0000", 2020-11-12T17:29:49.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.6148000000000004e-05 2020-11-12T17:29:49.090 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.090 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.090 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.090 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787510+0000", 2020-11-12T17:29:49.090 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0297e-05 2020-11-12T17:29:49.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.091 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.091 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787521+0000", 2020-11-12T17:29:49.091 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.5319999999999999e-05 2020-11-12T17:29:49.091 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.787536+0000", 2020-11-12T17:29:49.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044951030000000003 2020-11-12T17:29:49.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.092 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.092 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792031+0000", 2020-11-12T17:29:49.092 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00024333699999999999 2020-11-12T17:29:49.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.093 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792274+0000", 2020-11-12T17:29:49.093 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00041956200000000001 2020-11-12T17:29:49.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.093 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.093 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:49.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.792694+0000", 2020-11-12T17:29:49.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0028668510000000001 2020-11-12T17:29:49.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.094 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.094 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.094 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:36.795561+0000", 2020-11-12T17:29:49.094 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48867333800000001 2020-11-12T17:29:49.094 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284234+0000", 2020-11-12T17:29:49.095 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000135661 2020-11-12T17:29:49.095 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.095 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.095 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.095 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284370+0000", 2020-11-12T17:29:49.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5921999999999998e-05 2020-11-12T17:29:49.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.096 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.096 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:25:37.284426+0000", 2020-11-12T17:29:49.096 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.49695903299999999 2020-11-12T17:29:49.096 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.097 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.097 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.097 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.097 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.097 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.4971.0:63880 4.4 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e104)", 2020-11-12T17:29:49.097 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:49.097 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 227.432066822, 2020-11-12T17:29:49.097 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998, 2020-11-12T17:29:49.098 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.098 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.098 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.098 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.4971", 2020-11-12T17:29:49.098 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:49.098 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 63880 2020-11-12T17:29:49.098 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.099 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.099 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:49.099 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.099 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.099 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569818+0000", 2020-11-12T17:29:49.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999099 2020-11-12T17:29:49.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.100 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.100 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.100 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569728+0000", 2020-11-12T17:29:49.100 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00018136199999999999 2020-11-12T17:29:49.100 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569909+0000", 2020-11-12T17:29:49.101 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7332000000000001e-05 2020-11-12T17:29:49.101 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.101 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.101 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.101 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569946+0000", 2020-11-12T17:29:49.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0128e-05 2020-11-12T17:29:49.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.102 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.102 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.569956+0000", 2020-11-12T17:29:49.102 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0088827100000000003 2020-11-12T17:29:49.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578839+0000", 2020-11-12T17:29:49.103 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00010060000000000001 2020-11-12T17:29:49.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.103 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.103 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.103 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.578940+0000", 2020-11-12T17:29:49.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0022045989999999998 2020-11-12T17:29:49.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.104 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:49.104 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.581144+0000", 2020-11-12T17:29:49.104 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0026088349999999999 2020-11-12T17:29:49.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:01.583753+0000", 2020-11-12T17:29:49.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.78789936400000005 2020-11-12T17:29:49.105 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.105 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.105 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.105 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371652+0000", 2020-11-12T17:29:49.105 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1107999999999997e-05 2020-11-12T17:29:49.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.106 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.106 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371724+0000", 2020-11-12T17:29:49.106 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.7456000000000001e-05 2020-11-12T17:29:49.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.106 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:26:02.371771+0000", 2020-11-12T17:29:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.80195344899999998 2020-11-12T17:29:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.107 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:14736 5.0 5:0e4a9294:::benchmark_data_smithi036_24110_object1841:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e137)", 2020-11-12T17:29:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 166.94726532199999, 2020-11-12T17:29:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005, 2020-11-12T17:29:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.108 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 14736 2020-11-12T17:29:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.109 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:49.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.110 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.110 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.110 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054619+0000", 2020-11-12T17:29:49.110 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999814 2020-11-12T17:29:49.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054601+0000", 2020-11-12T17:29:49.111 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0974999999999999e-05 2020-11-12T17:29:49.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.111 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.111 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054652+0000", 2020-11-12T17:29:49.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9290000000000003e-06 2020-11-12T17:29:49.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.112 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.112 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054657+0000", 2020-11-12T17:29:49.112 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 2.965e-06 2020-11-12T17:29:49.112 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.112 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.054660+0000", 2020-11-12T17:29:49.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0049661530000000001 2020-11-12T17:29:49.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.113 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.113 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059627+0000", 2020-11-12T17:29:49.113 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013416099999999999 2020-11-12T17:29:49.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.114 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.059761+0000", 2020-11-12T17:29:49.114 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00027510000000000002 2020-11-12T17:29:49.114 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.114 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.114 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:49.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.060036+0000", 2020-11-12T17:29:49.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001443602 2020-11-12T17:29:49.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.115 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.115 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.061479+0000", 2020-11-12T17:29:49.115 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56244717 2020-11-12T17:29:49.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.116 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.623927+0000", 2020-11-12T17:29:49.116 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.6292999999999995e-05 2020-11-12T17:29:49.116 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.116 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.116 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624013+0000", 2020-11-12T17:29:49.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1262999999999999e-05 2020-11-12T17:29:49.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.117 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.117 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:02.624074+0000", 2020-11-12T17:29:49.117 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.56945514100000005 2020-11-12T17:29:49.118 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.118 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.118 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.118 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.118 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:35656 5.0 5:0ea6ea35:::benchmark_data_smithi036_24110_object4456:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e149)", 2020-11-12T17:29:49.118 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:49.118 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 144.88590565199999, 2020-11-12T17:29:49.119 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001, 2020-11-12T17:29:49.119 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.119 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:49.119 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:49.119 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 35656 2020-11-12T17:29:49.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.120 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.120 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.120 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:49.120 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.120 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.120 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115979+0000", 2020-11-12T17:29:49.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999804 2020-11-12T17:29:49.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.121 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.121 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.115959+0000", 2020-11-12T17:29:49.121 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.7364e-05 2020-11-12T17:29:49.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.122 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116036+0000", 2020-11-12T17:29:49.122 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4029000000000002e-05 2020-11-12T17:29:49.122 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.122 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.122 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116070+0000", 2020-11-12T17:29:49.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.0450000000000001e-06 2020-11-12T17:29:49.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.123 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.123 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.116078+0000", 2020-11-12T17:29:49.123 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0044395390000000002 2020-11-12T17:29:49.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120518+0000", 2020-11-12T17:29:49.124 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013341500000000001 2020-11-12T17:29:49.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.124 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.124 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120651+0000", 2020-11-12T17:29:49.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000196331 2020-11-12T17:29:49.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.125 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:49.125 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.120848+0000", 2020-11-12T17:29:49.125 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001527074 2020-11-12T17:29:49.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.122375+0000", 2020-11-12T17:29:49.126 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36335244700000002 2020-11-12T17:29:49.126 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.126 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.126 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.126 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485727+0000", 2020-11-12T17:29:49.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.6461000000000001e-05 2020-11-12T17:29:49.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.127 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.127 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485774+0000", 2020-11-12T17:29:49.127 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.4727000000000001e-05 2020-11-12T17:29:49.127 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.127 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.128 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.128 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:24.485808+0000", 2020-11-12T17:29:49.128 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.36982974600000001 2020-11-12T17:29:49.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.128 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.129 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.5552.0:59192 5.0 5:0d930eac:::benchmark_data_smithi036_24110_object7398:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e168)", 2020-11-12T17:29:49.129 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:49.129 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 115.19920686, 2020-11-12T17:29:49.129 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003, 2020-11-12T17:29:49.129 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.129 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.129 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.5552", 2020-11-12T17:29:49.130 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:49.130 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 59192 2020-11-12T17:29:49.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.130 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.130 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:49.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.131 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.131 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.131 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802678+0000", 2020-11-12T17:29:49.131 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:49.131 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802660+0000", 2020-11-12T17:29:49.132 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.9094000000000001e-05 2020-11-12T17:29:49.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.132 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.132 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802709+0000", 2020-11-12T17:29:49.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.9580000000000004e-06 2020-11-12T17:29:49.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.133 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.133 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802715+0000", 2020-11-12T17:29:49.133 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0690000000000002e-06 2020-11-12T17:29:49.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.802719+0000", 2020-11-12T17:29:49.134 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.010962786 2020-11-12T17:29:49.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.134 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.134 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813681+0000", 2020-11-12T17:29:49.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00011702 2020-11-12T17:29:49.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.135 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.135 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813798+0000", 2020-11-12T17:29:49.135 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000187436 2020-11-12T17:29:49.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.135 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 1", 2020-11-12T17:29:49.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.813986+0000", 2020-11-12T17:29:49.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0020009369999999999 2020-11-12T17:29:49.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.136 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.136 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:53.815987+0000", 2020-11-12T17:29:49.136 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.46767350899999999 2020-11-12T17:29:49.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.137 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.137 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283660+0000", 2020-11-12T17:29:49.137 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3396e-05 2020-11-12T17:29:49.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283734+0000", 2020-11-12T17:29:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.0195999999999998e-05 2020-11-12T17:29:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.283784+0000", 2020-11-12T17:29:49.138 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48110627900000003 2020-11-12T17:29:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:59360 5.1 e169/127 5:8e053221:::benchmark_data_smithi036_24110_object7419:head v 169'3752, mlcod=169'3747)", 2020-11-12T17:29:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:49.139 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 114.300719589, 2020-11-12T17:29:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999, 2020-11-12T17:29:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:49.140 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701165+0000", 2020-11-12T17:29:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999781 2020-11-12T17:29:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.141 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701143+0000", 2020-11-12T17:29:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4913000000000006e-05 2020-11-12T17:29:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:54.701218+0000", 2020-11-12T17:29:49.142 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45075755000000001 2020-11-12T17:29:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151975+0000", 2020-11-12T17:29:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.7439999999999996e-06 2020-11-12T17:29:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.143 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.151984+0000", 2020-11-12T17:29:49.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.5661000000000001e-05 2020-11-12T17:29:49.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.144 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.144 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152040+0000", 2020-11-12T17:29:49.144 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.0267e-05 2020-11-12T17:29:49.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.145 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.152070+0000", 2020-11-12T17:29:49.145 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0027662300000000002 2020-11-12T17:29:49.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.145 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.145 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154836+0000", 2020-11-12T17:29:49.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.0707e-05 2020-11-12T17:29:49.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.146 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.146 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:55.154897+0000", 2020-11-12T17:29:49.146 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.45373201299999999 2020-11-12T17:29:49.146 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:62424 5.1 e171/127 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head v 171'3992, mlcod=171'3984)", 2020-11-12T17:29:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:49.147 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 109.802958952, 2020-11-12T17:29:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437, 2020-11-12T17:29:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:49.148 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198925+0000", 2020-11-12T17:29:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.149 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198896+0000", 2020-11-12T17:29:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9000999999999997e-05 2020-11-12T17:29:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.198985+0000", 2020-11-12T17:29:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.48058147200000001 2020-11-12T17:29:49.150 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679566+0000", 2020-11-12T17:29:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.9140000000000003e-06 2020-11-12T17:29:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.151 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679576+0000", 2020-11-12T17:29:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.1407000000000003e-05 2020-11-12T17:29:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679647+0000", 2020-11-12T17:29:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.1270999999999999e-05 2020-11-12T17:29:49.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.679679+0000", 2020-11-12T17:29:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.002926648 2020-11-12T17:29:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.153 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682605+0000", 2020-11-12T17:29:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.1626999999999998e-05 2020-11-12T17:29:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:27:59.682667+0000", 2020-11-12T17:29:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.483741437 2020-11-12T17:29:49.154 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.5552.0:65088 5.1 e177/127 5:8edfd3fe:::benchmark_data_smithi036_24110_object8135:head v 177'4152, mlcod=177'4145)", 2020-11-12T17:29:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 96.819834164, 2020-11-12T17:29:49.155 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004, 2020-11-12T17:29:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:49.156 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182050+0000", 2020-11-12T17:29:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999809 2020-11-12T17:29:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.157 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.158 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182031+0000", 2020-11-12T17:29:49.158 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.8371000000000001e-05 2020-11-12T17:29:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.182090+0000", 2020-11-12T17:29:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64597910199999997 2020-11-12T17:29:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828069+0000", 2020-11-12T17:29:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.6649999999999998e-06 2020-11-12T17:29:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828078+0000", 2020-11-12T17:29:49.161 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00013253599999999999 2020-11-12T17:29:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828211+0000", 2020-11-12T17:29:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4.1916999999999999e-05 2020-11-12T17:29:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.162 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.828253+0000", 2020-11-12T17:29:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00329598 2020-11-12T17:29:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831549+0000", 2020-11-12T17:29:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.5890999999999996e-05 2020-11-12T17:29:49.163 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:12.831615+0000", 2020-11-12T17:29:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.64956451400000004 2020-11-12T17:29:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.164 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:12064 6.0 e198/193 ondisk, result = 0)", 2020-11-12T17:29:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 61.130809319000001, 2020-11-12T17:29:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674, 2020-11-12T17:29:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.165 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871075+0000", 2020-11-12T17:29:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.9999862 2020-11-12T17:29:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871061+0000", 2020-11-12T17:29:49.167 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.6056000000000002e-05 2020-11-12T17:29:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:47.871097+0000", 2020-11-12T17:29:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59417804799999996 2020-11-12T17:29:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.168 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465275+0000", 2020-11-12T17:29:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1326e-05 2020-11-12T17:29:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465287+0000", 2020-11-12T17:29:49.169 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1495000000000001e-05 2020-11-12T17:29:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465338+0000", 2020-11-12T17:29:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.4560000000000003e-06 2020-11-12T17:29:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.170 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465345+0000", 2020-11-12T17:29:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9233000000000004e-05 2020-11-12T17:29:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:48.465435+0000", 2020-11-12T17:29:49.171 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.594359674 2020-11-12T17:29:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_op(client.6159.0:15080 6.b 6:ded5ee56:::benchmark_data_smithi036_29033_object1884:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e199)", 2020-11-12T17:29:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:49.172 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.777051526999998, 2020-11-12T17:29:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999, 2020-11-12T17:29:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "client_info": { 2020-11-12T17:29:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "client": "client.6159", 2020-11-12T17:29:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:29:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: "tid": 15080 2020-11-12T17:29:49.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224833+0000", 2020-11-12T17:29:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999969 2020-11-12T17:29:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.175 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224802+0000", 2020-11-12T17:29:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 9.1513000000000003e-05 2020-11-12T17:29:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224893+0000", 2020-11-12T17:29:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.7841000000000001e-05 2020-11-12T17:29:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224911+0000", 2020-11-12T17:29:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.1224e-05 2020-11-12T17:29:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.177 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.224922+0000", 2020-11-12T17:29:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.9716000000000006e-05 2020-11-12T17:29:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225012+0000", 2020-11-12T17:29:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00017505999999999999 2020-11-12T17:29:49.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225187+0000", 2020-11-12T17:29:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.00030063900000000001 2020-11-12T17:29:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:49.179 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.225488+0000", 2020-11-12T17:29:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0021279850000000002 2020-11-12T17:29:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "op_commit", 2020-11-12T17:29:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.227616+0000", 2020-11-12T17:29:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60001606200000002 2020-11-12T17:29:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827632+0000", 2020-11-12T17:29:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.3869000000000002e-05 2020-11-12T17:29:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827686+0000", 2020-11-12T17:29:49.181 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.7774999999999997e-05 2020-11-12T17:29:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827724+0000", 2020-11-12T17:29:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.60289066499999999 2020-11-12T17:29:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.182 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop_reply(client.6159.0:15080 6.b e199/190 ondisk, result = 0)", 2020-11-12T17:29:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.772104880999997, 2020-11-12T17:29:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005, 2020-11-12T17:29:49.183 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "started", 2020-11-12T17:29:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229779+0000", 2020-11-12T17:29:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.99997 2020-11-12T17:29:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229750+0000", 2020-11-12T17:29:49.185 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 6.7358000000000001e-05 2020-11-12T17:29:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.229817+0000", 2020-11-12T17:29:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59622965400000005 2020-11-12T17:29:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.186 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826047+0000", 2020-11-12T17:29:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.7509999999999997e-06 2020-11-12T17:29:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.187 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.826052+0000", 2020-11-12T17:29:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.001561729 2020-11-12T17:29:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827614+0000", 2020-11-12T17:29:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 1.0472000000000001e-05 2020-11-12T17:29:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827625+0000", 2020-11-12T17:29:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.000106687 2020-11-12T17:29:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.827731+0000", 2020-11-12T17:29:49.189 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.59795176400000005 2020-11-12T17:29:49.190 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.190 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.190 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.190 INFO:teuthology.orchestra.run.smithi036.stdout: "description": "osd_repop(client.6159.0:15728 6.7 e199/190 6:e4c465ea:::benchmark_data_smithi036_29033_object1965:head v 199'1032, mlcod=199'1025)", 2020-11-12T17:29:49.190 INFO:teuthology.orchestra.run.smithi036.stdout: "initiated_at": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:49.190 INFO:teuthology.orchestra.run.smithi036.stdout: "age": 57.062492149000001, 2020-11-12T17:29:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426, 2020-11-12T17:29:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: "type_data": { 2020-11-12T17:29:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: "events": [ 2020-11-12T17:29:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "initiated", 2020-11-12T17:29:49.191 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0 2020-11-12T17:29:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "throttled", 2020-11-12T17:29:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939392+0000", 2020-11-12T17:29:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 4294967295.999979 2020-11-12T17:29:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "header_read", 2020-11-12T17:29:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939371+0000", 2020-11-12T17:29:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 8.3385000000000002e-05 2020-11-12T17:29:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "all_read", 2020-11-12T17:29:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:51.939455+0000", 2020-11-12T17:29:49.193 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.40948674800000001 2020-11-12T17:29:49.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "dispatched", 2020-11-12T17:29:49.194 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348941+0000", 2020-11-12T17:29:49.194 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3089999999999998e-06 2020-11-12T17:29:49.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.194 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.348949+0000", 2020-11-12T17:29:49.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.3567999999999998e-05 2020-11-12T17:29:49.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.195 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "reached_pg", 2020-11-12T17:29:49.195 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349022+0000", 2020-11-12T17:29:49.195 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 3.2410999999999999e-05 2020-11-12T17:29:49.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "started", 2020-11-12T17:29:49.196 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.349055+0000", 2020-11-12T17:29:49.196 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.0050284420000000002 2020-11-12T17:29:49.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.196 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "commit_sent", 2020-11-12T17:29:49.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354083+0000", 2020-11-12T17:29:49.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 7.8516000000000005e-05 2020-11-12T17:29:49.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2020-11-12T17:29:49.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2020-11-12T17:29:49.197 INFO:teuthology.orchestra.run.smithi036.stdout: "event": "done", 2020-11-12T17:29:49.197 INFO:teuthology.orchestra.run.smithi036.stdout: "time": "2020-11-12T17:28:52.354162+0000", 2020-11-12T17:29:49.197 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 0.414769426 2020-11-12T17:29:49.197 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2020-11-12T17:29:49.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2020-11-12T17:29:49.198 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:29:49.200 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:29:49.201 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:29:49.018+0000 7fb24bf6bd80 -1 Falling back to public interface 2020-11-12T17:29:49.201 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:29:49.201 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:29:49.201 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:29:49.201 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:29:49.202 INFO:teuthology.orchestra.run.smithi036.stderr:Error ENXIO: problem getting command descriptions from osd.2 2020-11-12T17:29:49.202 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: problem getting command descriptions from osd.2 2020-11-12T17:29:49.202 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:29:49.202 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:29:49.202 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:29:49.202 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:29:49.202 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:29:49.203 DEBUG:teuthology.orchestra.run:got remote process result: 6 2020-11-12T17:29:49.203 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2020-11-12T17:29:49.203 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:49.198+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:29:49.301 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:49.295+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:49.322 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:49.322 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:49.322 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:49.323 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:49.332 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:29:49.417 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:49.415+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:49.483 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set noscrub 2020-11-12T17:29:49.485 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:49.485 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:49.485 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:49.485 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:49.486 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:49.494 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:29:49.529 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 73 16 29904 29888 3.19828 0 - 0.0157766 2020-11-12T17:29:49.537 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:49.535+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:49.603 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:49.598+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:29:49.652 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:49.652 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:49.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:49.653 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:49.653 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.653 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:29:49.653 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:29:49.653 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 398.96238590600001, 2020-11-12T17:29:49.653 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:29:49.654 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.654 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.654 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.654 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:49.654 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:49.655 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:29:49.655 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.655 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.655 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.655 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:29:49.656 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.656 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.656 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.656 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.656 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:29:49.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:29:49.657 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.657 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.657 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.657 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:29:49.657 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:29:49.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.658 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.658 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.658 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:29:49.658 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:29:49.658 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:29:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:29:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.659 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:29:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:29:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.660 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:29:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:29:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:29:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:29:49.661 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:29:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:29:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:29:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:29:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.663 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:29:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:29:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.664 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:29:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:29:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:29:49.665 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:29:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.666 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:29:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:29:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 398.95690583700002, 2020-11-12T17:29:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:29:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.667 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:29:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.668 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:29:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:29:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:29:49.669 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:29:49.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.670 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.670 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:29:49.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:29:49.670 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:29:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:29:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:29:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:29:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.672 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:29:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:29:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.673 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:29:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:29:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.674 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:29:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:29:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.675 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:29:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:29:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 390.76678423700002, 2020-11-12T17:29:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:29:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.676 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:29:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.677 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:29:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.678 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:29:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:29:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.679 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:29:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:29:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:29:49.680 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:29:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:29:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:29:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.681 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:29:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:29:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.682 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:29:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:29:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:29:49.683 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:29:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:29:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:29:49.684 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:29:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:29:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:29:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.685 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:29:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:29:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.686 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:29:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:29:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:29:49.687 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:29:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:29:49.688 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:29:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 390.759540528, 2020-11-12T17:29:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:29:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.690 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:29:49.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.690 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:29:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:29:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:29:49.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:29:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:29:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:29:49.692 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:29:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:29:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:29:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:29:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.694 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:29:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:29:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:29:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:29:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:29:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:29:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.697 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:29:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:29:49.698 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 314.76345115399999, 2020-11-12T17:29:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:29:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:29:49.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:29:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:29:49.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:29:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:29:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:29:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:29:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:29:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:29:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:29:49.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:29:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:29:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:29:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:29:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:29:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:29:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:29:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.707 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:29:49.707 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:29:49.707 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 248.63592864200001, 2020-11-12T17:29:49.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:29:49.707 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.707 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:49.707 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:29:49.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:29:49.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:49.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:29:49.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:29:49.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:29:49.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:29:49.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:29:49.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:29:49.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:29:49.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:29:49.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:29:49.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:29:49.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:29:49.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:29:49.714 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:29:49.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:29:49.714 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.715 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.715 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.715 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.715 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:29:49.715 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:29:49.715 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 241.58518120100001, 2020-11-12T17:29:49.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:29:49.716 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.716 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.716 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.716 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:49.716 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:49.717 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:29:49.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.717 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.717 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.717 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.717 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:29:49.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:29:49.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:29:49.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:29:49.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:29:49.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:29:49.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:29:49.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:29:49.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:29:49.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:29:49.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:29:49.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:29:49.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:29:49.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:29:49.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:29:49.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:49.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:29:49.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:29:49.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:29:49.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:29:49.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:29:49.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:29:49.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:29:49.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:29:49.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:29:49.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:29:49.727 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.727 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.727 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.727 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:29:49.727 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:29:49.728 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 241.58509300599999, 2020-11-12T17:29:49.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:29:49.728 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.728 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.728 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.728 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:49.729 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:49.729 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:29:49.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.729 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:29:49.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:29:49.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:49.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:29:49.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:29:49.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:29:49.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:29:49.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:29:49.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:29:49.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:29:49.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:29:49.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.734 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:29:49.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:29:49.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:29:49.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:29:49.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:49.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:29:49.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:29:49.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:29:49.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:29:49.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498017+0000", 2020-11-12T17:29:49.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.1226000000000002e-05 2020-11-12T17:29:49.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498048+0000", 2020-11-12T17:29:49.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0512999999999994e-05 2020-11-12T17:29:49.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498119+0000", 2020-11-12T17:29:49.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366 2020-11-12T17:29:49.739 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.739 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.739 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.740 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:53720 4.1 e98/69 ondisk, result = 0)", 2020-11-12T17:29:49.740 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:29:49.740 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 241.56637997300001, 2020-11-12T17:29:49.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293, 2020-11-12T17:29:49.740 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.740 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:49.741 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:29:49.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082719+0000", 2020-11-12T17:29:49.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999833 2020-11-12T17:29:49.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082702+0000", 2020-11-12T17:29:49.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2611000000000001e-05 2020-11-12T17:29:49.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.082764+0000", 2020-11-12T17:29:49.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41463199699999997 2020-11-12T17:29:49.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497396+0000", 2020-11-12T17:29:49.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6850000000000004e-06 2020-11-12T17:29:49.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.497403+0000", 2020-11-12T17:29:49.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00060387699999999995 2020-11-12T17:29:49.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498007+0000", 2020-11-12T17:29:49.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2870000000000004e-06 2020-11-12T17:29:49.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498012+0000", 2020-11-12T17:29:49.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000134657 2020-11-12T17:29:49.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.498147+0000", 2020-11-12T17:29:49.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.415428293 2020-11-12T17:29:49.748 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.748 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.748 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.749 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75889 4.b 4:deace336:::benchmark_data_smithi036_18856_object9486:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:49.749 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:29:49.749 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 208.81555752200001, 2020-11-12T17:29:49.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003, 2020-11-12T17:29:49.749 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.749 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:49.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:49.750 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75889 2020-11-12T17:29:49.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.750 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:29:49.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833541+0000", 2020-11-12T17:29:49.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999518 2020-11-12T17:29:49.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833493+0000", 2020-11-12T17:29:49.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014629700000000001 2020-11-12T17:29:49.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833639+0000", 2020-11-12T17:29:49.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2373000000000001e-05 2020-11-12T17:29:49.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833662+0000", 2020-11-12T17:29:49.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.237e-05 2020-11-12T17:29:49.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833674+0000", 2020-11-12T17:29:49.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010322799999999999 2020-11-12T17:29:49.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.833777+0000", 2020-11-12T17:29:49.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000322112 2020-11-12T17:29:49.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834099+0000", 2020-11-12T17:29:49.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025486900000000002 2020-11-12T17:29:49.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:49.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.834354+0000", 2020-11-12T17:29:49.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.478329913 2020-11-12T17:29:49.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312684+0000", 2020-11-12T17:29:49.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071752070000000003 2020-11-12T17:29:49.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319859+0000", 2020-11-12T17:29:49.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6382000000000002e-05 2020-11-12T17:29:49.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319926+0000", 2020-11-12T17:29:49.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3245999999999998e-05 2020-11-12T17:29:49.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319979+0000", 2020-11-12T17:29:49.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.48643791400000003 2020-11-12T17:29:49.761 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.761 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.761 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.762 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:76376 4.1 4:8f5d09ab:::benchmark_data_smithi036_18856_object9546:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:49.762 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:29:49.762 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 207.72890203399999, 2020-11-12T17:29:49.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996, 2020-11-12T17:29:49.762 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.762 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.763 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.763 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:49.763 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:49.763 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 76376 2020-11-12T17:29:49.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.763 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:29:49.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920197+0000", 2020-11-12T17:29:49.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:29:49.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920161+0000", 2020-11-12T17:29:49.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4077000000000002e-05 2020-11-12T17:29:49.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920245+0000", 2020-11-12T17:29:49.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9569999999999997e-06 2020-11-12T17:29:49.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920255+0000", 2020-11-12T17:29:49.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6590000000000004e-06 2020-11-12T17:29:49.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.920260+0000", 2020-11-12T17:29:49.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080440600000000004 2020-11-12T17:29:49.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928304+0000", 2020-11-12T17:29:49.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103423 2020-11-12T17:29:49.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928408+0000", 2020-11-12T17:29:49.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017387300000000001 2020-11-12T17:29:49.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:29:49.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.928582+0000", 2020-11-12T17:29:49.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0033587090000000001 2020-11-12T17:29:49.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.931940+0000", 2020-11-12T17:29:49.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57377425199999998 2020-11-12T17:29:49.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505715+0000", 2020-11-12T17:29:49.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1649000000000004e-05 2020-11-12T17:29:49.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505796+0000", 2020-11-12T17:29:49.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0205999999999999e-05 2020-11-12T17:29:49.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505856+0000", 2020-11-12T17:29:49.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.58565984299999996 2020-11-12T17:29:49.773 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.773 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.773 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.774 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:76376 4.1 e112/69 ondisk, result = 0)", 2020-11-12T17:29:49.774 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:29:49.774 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 207.71542080699999, 2020-11-12T17:29:49.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005, 2020-11-12T17:29:49.775 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.775 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:49.775 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:29:49.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933678+0000", 2020-11-12T17:29:49.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:29:49.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933653+0000", 2020-11-12T17:29:49.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4375000000000006e-05 2020-11-12T17:29:49.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.933717+0000", 2020-11-12T17:29:49.779 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57186908800000003 2020-11-12T17:29:49.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505586+0000", 2020-11-12T17:29:49.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2804e-05 2020-11-12T17:29:49.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505599+0000", 2020-11-12T17:29:49.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6131999999999995e-05 2020-11-12T17:29:49.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505685+0000", 2020-11-12T17:29:49.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7683999999999999e-05 2020-11-12T17:29:49.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505703+0000", 2020-11-12T17:29:49.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016320500000000001 2020-11-12T17:29:49.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:22.505866+0000", 2020-11-12T17:29:49.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57218800700000005 2020-11-12T17:29:49.783 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.784 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.784 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.784 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11880 5.1 5:8725f37b:::benchmark_data_smithi036_24110_object1484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:29:49.784 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:29:49.785 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 172.713132605, 2020-11-12T17:29:49.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002, 2020-11-12T17:29:49.785 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.785 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.785 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.786 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:49.786 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:49.786 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11880 2020-11-12T17:29:49.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.786 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:29:49.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935966+0000", 2020-11-12T17:29:49.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999671 2020-11-12T17:29:49.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.935933+0000", 2020-11-12T17:29:49.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7402000000000001e-05 2020-11-12T17:29:49.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936021+0000", 2020-11-12T17:29:49.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1900999999999999e-05 2020-11-12T17:29:49.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936043+0000", 2020-11-12T17:29:49.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6409999999999996e-06 2020-11-12T17:29:49.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.936049+0000", 2020-11-12T17:29:49.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.003346618 2020-11-12T17:29:49.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.791 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.791 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939396+0000", 2020-11-12T17:29:49.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013873800000000001 2020-11-12T17:29:49.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.792 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.792 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.792 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939535+0000", 2020-11-12T17:29:49.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00026069 2020-11-12T17:29:49.792 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:49.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.939795+0000", 2020-11-12T17:29:49.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002244397 2020-11-12T17:29:49.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.942040+0000", 2020-11-12T17:29:49.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44745206900000001 2020-11-12T17:29:49.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389492+0000", 2020-11-12T17:29:49.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9531999999999998e-05 2020-11-12T17:29:49.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389561+0000", 2020-11-12T17:29:49.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00028171099999999997 2020-11-12T17:29:49.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389843+0000", 2020-11-12T17:29:49.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45387691000000002 2020-11-12T17:29:49.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.797 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.797 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.798 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:11888 5.5 5:a09b1722:::benchmark_data_smithi036_24110_object1485:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e133)", 2020-11-12T17:29:49.798 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:29:49.798 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 172.707316021, 2020-11-12T17:29:49.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002, 2020-11-12T17:29:49.799 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.799 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:49.799 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:49.799 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 11888 2020-11-12T17:29:49.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.800 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:29:49.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941783+0000", 2020-11-12T17:29:49.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999685 2020-11-12T17:29:49.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941751+0000", 2020-11-12T17:29:49.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5177e-05 2020-11-12T17:29:49.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941846+0000", 2020-11-12T17:29:49.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3174e-05 2020-11-12T17:29:49.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941859+0000", 2020-11-12T17:29:49.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8680000000000001e-06 2020-11-12T17:29:49.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.941866+0000", 2020-11-12T17:29:49.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041296270000000003 2020-11-12T17:29:49.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.805 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.805 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.945996+0000", 2020-11-12T17:29:49.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131311 2020-11-12T17:29:49.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.806 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946127+0000", 2020-11-12T17:29:49.806 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016561599999999999 2020-11-12T17:29:49.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.806 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.806 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 6", 2020-11-12T17:29:49.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.946293+0000", 2020-11-12T17:29:49.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012867429999999999 2020-11-12T17:29:49.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.947580+0000", 2020-11-12T17:29:49.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45892515 2020-11-12T17:29:49.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406505+0000", 2020-11-12T17:29:49.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8430999999999996e-05 2020-11-12T17:29:49.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406573+0000", 2020-11-12T17:29:49.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0178999999999993e-05 2020-11-12T17:29:49.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.406643+0000", 2020-11-12T17:29:49.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46486068800000002 2020-11-12T17:29:49.810 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.810 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.810 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.811 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:11909 5.a e133/127 5:58aab7ca:::benchmark_data_smithi036_24110_object1488:head v 133'773, mlcod=133'770)", 2020-11-12T17:29:49.811 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:29:49.811 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 172.68438250700001, 2020-11-12T17:29:49.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999, 2020-11-12T17:29:49.811 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.811 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.812 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:29:49.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964716+0000", 2020-11-12T17:29:49.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:29:49.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964699+0000", 2020-11-12T17:29:49.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2498999999999999e-05 2020-11-12T17:29:49.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964761+0000", 2020-11-12T17:29:49.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7679000000000003e-05 2020-11-12T17:29:49.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964799+0000", 2020-11-12T17:29:49.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6849999999999998e-06 2020-11-12T17:29:49.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964805+0000", 2020-11-12T17:29:49.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.4965000000000002e-05 2020-11-12T17:29:49.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964839+0000", 2020-11-12T17:29:49.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4386000000000001e-05 2020-11-12T17:29:49.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:56.964854+0000", 2020-11-12T17:29:49.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42487080999999999 2020-11-12T17:29:49.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389725+0000", 2020-11-12T17:29:49.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2871000000000001e-05 2020-11-12T17:29:49.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.819 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.820 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:57.389798+0000", 2020-11-12T17:29:49.820 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42508141199999999 2020-11-12T17:29:49.820 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.820 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.820 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.820 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.821 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16064 5.a e139/127 5:578e2a1e:::benchmark_data_smithi036_24110_object2007:head v 139'1040, mlcod=139'1037)", 2020-11-12T17:29:49.821 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:29:49.821 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 166.15190448000001, 2020-11-12T17:29:49.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997, 2020-11-12T17:29:49.821 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.821 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.821 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:29:49.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497194+0000", 2020-11-12T17:29:49.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999771 2020-11-12T17:29:49.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497171+0000", 2020-11-12T17:29:49.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7113000000000005e-05 2020-11-12T17:29:49.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.497248+0000", 2020-11-12T17:29:49.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68821140400000003 2020-11-12T17:29:49.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185460+0000", 2020-11-12T17:29:49.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1453e-05 2020-11-12T17:29:49.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185471+0000", 2020-11-12T17:29:49.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9369000000000005e-05 2020-11-12T17:29:49.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185551+0000", 2020-11-12T17:29:49.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3383999999999997e-05 2020-11-12T17:29:49.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.185594+0000", 2020-11-12T17:29:49.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002297777 2020-11-12T17:29:49.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187892+0000", 2020-11-12T17:29:49.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.9575999999999997e-05 2020-11-12T17:29:49.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.187991+0000", 2020-11-12T17:29:49.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69079715399999997 2020-11-12T17:29:49.829 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.829 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.829 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.829 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e169)", 2020-11-12T17:29:49.829 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:29:49.830 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 114.95719844, 2020-11-12T17:29:49.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002, 2020-11-12T17:29:49.830 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.830 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.830 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.830 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:49.831 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:49.831 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:29:49.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.831 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:29:49.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.833 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691900+0000", 2020-11-12T17:29:49.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999633 2020-11-12T17:29:49.833 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.833 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691863+0000", 2020-11-12T17:29:49.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103144 2020-11-12T17:29:49.834 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.834 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.834 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.834 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691966+0000", 2020-11-12T17:29:49.834 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8453000000000001e-05 2020-11-12T17:29:49.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.835 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691985+0000", 2020-11-12T17:29:49.835 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0385e-05 2020-11-12T17:29:49.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.691995+0000", 2020-11-12T17:29:49.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0098187989999999996 2020-11-12T17:29:49.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.836 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701814+0000", 2020-11-12T17:29:49.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000135065 2020-11-12T17:29:49.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.701949+0000", 2020-11-12T17:29:49.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025538399999999999 2020-11-12T17:29:49.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.837 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:49.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.702205+0000", 2020-11-12T17:29:49.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0034246620000000002 2020-11-12T17:29:49.838 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.705629+0000", 2020-11-12T17:29:49.838 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.450897995 2020-11-12T17:29:49.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.839 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156527+0000", 2020-11-12T17:29:49.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2074000000000001e-05 2020-11-12T17:29:49.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156599+0000", 2020-11-12T17:29:49.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1148000000000002e-05 2020-11-12T17:29:49.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.840 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.840 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156690+0000", 2020-11-12T17:29:49.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.46479019100000002 2020-11-12T17:29:49.840 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.841 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.841 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.841 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.841 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:59360 5.1 5:8e053221:::benchmark_data_smithi036_24110_object7419:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e169)", 2020-11-12T17:29:49.841 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:29:49.842 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 114.93557982599999, 2020-11-12T17:29:49.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003, 2020-11-12T17:29:49.842 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.842 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:29:49.842 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.842 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:49.842 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:49.843 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 59360 2020-11-12T17:29:49.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.843 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.843 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:29:49.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713519+0000", 2020-11-12T17:29:49.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999666 2020-11-12T17:29:49.844 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.844 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713485+0000", 2020-11-12T17:29:49.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7021000000000005e-05 2020-11-12T17:29:49.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713582+0000", 2020-11-12T17:29:49.845 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2103000000000001e-05 2020-11-12T17:29:49.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.846 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.846 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713595+0000", 2020-11-12T17:29:49.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0129999999999999e-06 2020-11-12T17:29:49.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.713601+0000", 2020-11-12T17:29:49.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001321727 2020-11-12T17:29:49.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.847 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.714922+0000", 2020-11-12T17:29:49.848 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011930300000000001 2020-11-12T17:29:49.848 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:29:49.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:54.715042+0000", 2020-11-12T17:29:49.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44158781200000002 2020-11-12T17:29:49.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.849 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:55.156629+0000", 2020-11-12T17:29:49.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.44311064300000003 2020-11-12T17:29:49.849 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.850 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.850 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.850 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.850 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62424 5.1 5:83b60dcd:::benchmark_data_smithi036_24110_object7802:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e171)", 2020-11-12T17:29:49.850 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:29:49.850 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 110.45364773199999, 2020-11-12T17:29:49.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456, 2020-11-12T17:29:49.851 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.851 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.851 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.851 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:49.851 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:49.851 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62424 2020-11-12T17:29:49.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.852 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.852 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:29:49.852 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195451+0000", 2020-11-12T17:29:49.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999809 2020-11-12T17:29:49.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.853 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195432+0000", 2020-11-12T17:29:49.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1144999999999999e-05 2020-11-12T17:29:49.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.854 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195483+0000", 2020-11-12T17:29:49.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2553e-05 2020-11-12T17:29:49.854 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195496+0000", 2020-11-12T17:29:49.855 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0469999999999996e-06 2020-11-12T17:29:49.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.195503+0000", 2020-11-12T17:29:49.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041025339999999997 2020-11-12T17:29:49.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199605+0000", 2020-11-12T17:29:49.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114968 2020-11-12T17:29:49.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199720+0000", 2020-11-12T17:29:49.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020953000000000001 2020-11-12T17:29:49.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:49.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.199930+0000", 2020-11-12T17:29:49.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0043700170000000003 2020-11-12T17:29:49.858 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.858 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.858 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.204300+0000", 2020-11-12T17:29:49.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.480176663 2020-11-12T17:29:49.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684477+0000", 2020-11-12T17:29:49.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017691000000000001 2020-11-12T17:29:49.859 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684653+0000", 2020-11-12T17:29:49.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107935 2020-11-12T17:29:49.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.684761+0000", 2020-11-12T17:29:49.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.489310456 2020-11-12T17:29:49.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.861 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.861 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.861 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:65088 5.1 5:8edfd3fe:::benchmark_data_smithi036_24110_object8135:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e177)", 2020-11-12T17:29:49.862 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:29:49.862 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 97.468246682, 2020-11-12T17:29:49.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.652361309, 2020-11-12T17:29:49.862 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:49.862 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:49.862 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:49.862 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:49.863 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:49.863 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 65088 2020-11-12T17:29:49.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.863 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:49.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.863 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:49.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:29:49.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:49.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:49.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180852+0000", 2020-11-12T17:29:49.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:29:49.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:49.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180810+0000", 2020-11-12T17:29:49.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000120461 2020-11-12T17:29:49.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:49.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180931+0000", 2020-11-12T17:29:49.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5746000000000001e-05 2020-11-12T17:29:49.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:49.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180947+0000", 2020-11-12T17:29:49.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8739999999999995e-06 2020-11-12T17:29:49.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.866 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:49.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.180955+0000", 2020-11-12T17:29:49.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017552710000000001 2020-11-12T17:29:49.867 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.867 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:49.867 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.182710+0000", 2020-11-12T17:29:49.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013040999999999999 2020-11-12T17:29:49.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:49.868 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.182840+0000", 2020-11-12T17:29:49.868 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000212112 2020-11-12T17:29:49.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.868 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:49.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.183052+0000", 2020-11-12T17:29:49.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0031255879999999999 2020-11-12T17:29:49.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:49.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.186178+0000", 2020-11-12T17:29:49.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.64690791400000003 2020-11-12T17:29:49.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:49.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833086+0000", 2020-11-12T17:29:49.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2926000000000001e-05 2020-11-12T17:29:49.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:49.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833139+0000", 2020-11-12T17:29:49.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4467000000000004e-05 2020-11-12T17:29:49.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:49.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:49.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:49.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:12.833213+0000", 2020-11-12T17:29:49.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.652361309 2020-11-12T17:29:49.871 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.872 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.872 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.872 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:49.872 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:49.872 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:49.874 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2020-11-12T17:29:49.874 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:29:49.871+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:29:49.974 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:49.971+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:50.035 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:50.036 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:50.036 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:50.036 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:50.045 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2020-11-12T17:29:50.090 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:50.087+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:50.177 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:50.171+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:50.198 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:50.198 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:50.198 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:50.198 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:50.198 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:50.207 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2020-11-12T17:29:50.277 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:50.274+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:50.320 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:29:50.318+0000 7fb24bf6bd80 -1 osd.2 205 log_to_monitors {default=true} 2020-11-12T17:29:50.366 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:50.367 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4475.0:29992 3.d e48/20 3:b18dda56:::benchmark_data_smithi036_14212_object3748:head v 48'1680, mlcod=48'1674)", 2020-11-12T17:29:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:29:50.368 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 360.35520634699998, 2020-11-12T17:29:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997, 2020-11-12T17:29:50.369 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.370 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:29:50.371 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.372 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005528+0000", 2020-11-12T17:29:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999638 2020-11-12T17:29:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.373 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005492+0000", 2020-11-12T17:29:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000144735 2020-11-12T17:29:50.374 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.005636+0000", 2020-11-12T17:29:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45209399099999997 2020-11-12T17:29:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.375 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457730+0000", 2020-11-12T17:29:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7699999999999998e-06 2020-11-12T17:29:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.376 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457736+0000", 2020-11-12T17:29:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6124000000000001e-05 2020-11-12T17:29:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.377 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457782+0000", 2020-11-12T17:29:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9323000000000001e-05 2020-11-12T17:29:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.457801+0000", 2020-11-12T17:29:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040342199999999998 2020-11-12T17:29:50.378 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461836+0000", 2020-11-12T17:29:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3571000000000005e-05 2020-11-12T17:29:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.379 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:50.461899+0000", 2020-11-12T17:29:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.45637168099999997 2020-11-12T17:29:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.380 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:57800 3.c 3:3642c236:::benchmark_data_smithi036_14212_object7224:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e56)", 2020-11-12T17:29:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:29:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 328.41522100399999, 2020-11-12T17:29:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996, 2020-11-12T17:29:50.381 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:50.382 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 57800 2020-11-12T17:29:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:29:50.383 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945513+0000", 2020-11-12T17:29:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999557 2020-11-12T17:29:50.384 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945469+0000", 2020-11-12T17:29:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131984 2020-11-12T17:29:50.385 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945601+0000", 2020-11-12T17:29:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4819e-05 2020-11-12T17:29:50.386 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945616+0000", 2020-11-12T17:29:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0268999999999999e-05 2020-11-12T17:29:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.387 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.945626+0000", 2020-11-12T17:29:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035913270000000001 2020-11-12T17:29:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.388 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949217+0000", 2020-11-12T17:29:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3192e-05 2020-11-12T17:29:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.389 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949290+0000", 2020-11-12T17:29:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000159605 2020-11-12T17:29:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.949450+0000", 2020-11-12T17:29:50.390 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021199769999999999 2020-11-12T17:29:50.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.391 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.391 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.391 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:21.951570+0000", 2020-11-12T17:29:50.391 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.61904798100000002 2020-11-12T17:29:50.391 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570618+0000", 2020-11-12T17:29:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8876999999999996e-05 2020-11-12T17:29:50.392 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570707+0000", 2020-11-12T17:29:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3063000000000003e-05 2020-11-12T17:29:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.393 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:22.570770+0000", 2020-11-12T17:29:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.62525694099999996 2020-11-12T17:29:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.394 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPushReply(3.4 61/59 [PushReplyOp(3:24d82857:::benchmark_data_smithi036_14212_object3067:head)])", 2020-11-12T17:29:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:29:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 316.93811993000003, 2020-11-12T17:29:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002, 2020-11-12T17:29:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:29:50.395 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:29:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.396 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422614+0000", 2020-11-12T17:29:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999723 2020-11-12T17:29:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.397 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422587+0000", 2020-11-12T17:29:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1169999999999998e-05 2020-11-12T17:29:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.422658+0000", 2020-11-12T17:29:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42511124500000003 2020-11-12T17:29:50.398 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847769+0000", 2020-11-12T17:29:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.9700000000000002e-06 2020-11-12T17:29:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.399 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847776+0000", 2020-11-12T17:29:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1476e-05 2020-11-12T17:29:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.847827+0000", 2020-11-12T17:29:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00048186700000000003 2020-11-12T17:29:50.400 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:33.848309+0000", 2020-11-12T17:29:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42569526600000002 2020-11-12T17:29:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.401 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e61)", 2020-11-12T17:29:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:29:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 315.81910954300002, 2020-11-12T17:29:50.402 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998, 2020-11-12T17:29:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:50.403 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:29:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:29:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.404 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541624+0000", 2020-11-12T17:29:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:29:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.405 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541606+0000", 2020-11-12T17:29:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3130000000000001e-05 2020-11-12T17:29:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541659+0000", 2020-11-12T17:29:50.406 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.167e-05 2020-11-12T17:29:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541671+0000", 2020-11-12T17:29:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.635e-06 2020-11-12T17:29:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.407 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.541678+0000", 2020-11-12T17:29:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.011893469 2020-11-12T17:29:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.408 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553571+0000", 2020-11-12T17:29:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114214 2020-11-12T17:29:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.409 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553685+0000", 2020-11-12T17:29:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019210900000000001 2020-11-12T17:29:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:50.410 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.553878+0000", 2020-11-12T17:29:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071069999999999996 2020-11-12T17:29:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.560985+0000", 2020-11-12T17:29:50.411 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66205536600000003 2020-11-12T17:29:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223040+0000", 2020-11-12T17:29:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000141037 2020-11-12T17:29:50.412 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.413 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.413 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.413 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223181+0000", 2020-11-12T17:29:50.413 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017044599999999999 2020-11-12T17:29:50.413 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223351+0000", 2020-11-12T17:29:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.68172697599999998 2020-11-12T17:29:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.414 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:64904 3.c e61/20 ondisk, result = 0)", 2020-11-12T17:29:50.415 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:29:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 315.802971539, 2020-11-12T17:29:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002, 2020-11-12T17:29:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.416 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:29:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557762+0000", 2020-11-12T17:29:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999728 2020-11-12T17:29:50.417 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557735+0000", 2020-11-12T17:29:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0486000000000002e-05 2020-11-12T17:29:50.418 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.557806+0000", 2020-11-12T17:29:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.664972758 2020-11-12T17:29:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.419 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222778+0000", 2020-11-12T17:29:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0030000000000001e-05 2020-11-12T17:29:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.420 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222788+0000", 2020-11-12T17:29:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020100599999999999 2020-11-12T17:29:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.222989+0000", 2020-11-12T17:29:50.421 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8768999999999998e-05 2020-11-12T17:29:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223018+0000", 2020-11-12T17:29:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00035020899999999998 2020-11-12T17:29:50.422 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223368+0000", 2020-11-12T17:29:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66560596900000002 2020-11-12T17:29:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.423 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.424 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:64904 3.c 3:388cdb0c:::benchmark_data_smithi036_14212_object8112:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e61)", 2020-11-12T17:29:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:29:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 315.79824386000001, 2020-11-12T17:29:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001, 2020-11-12T17:29:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.425 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "delayed", 2020-11-12T17:29:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 64904 2020-11-12T17:29:50.426 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:29:50.427 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562490+0000", 2020-11-12T17:29:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999714 2020-11-12T17:29:50.428 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562461+0000", 2020-11-12T17:29:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4512999999999994e-05 2020-11-12T17:29:50.429 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562556+0000", 2020-11-12T17:29:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7486000000000002e-05 2020-11-12T17:29:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.430 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562573+0000", 2020-11-12T17:29:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030000000000004e-06 2020-11-12T17:29:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.431 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562579+0000", 2020-11-12T17:29:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3207999999999993e-05 2020-11-12T17:29:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.432 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562662+0000", 2020-11-12T17:29:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7954000000000005e-05 2020-11-12T17:29:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for ondisk", 2020-11-12T17:29:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.562750+0000", 2020-11-12T17:29:50.433 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66047067999999998 2020-11-12T17:29:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.223221+0000", 2020-11-12T17:29:50.434 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.66073063300000001 2020-11-12T17:29:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.435 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75876 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:29:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 209.75448196100001, 2020-11-12T17:29:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996, 2020-11-12T17:29:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.436 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75876 2020-11-12T17:29:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.437 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:29:50.438 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606252+0000", 2020-11-12T17:29:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:29:50.439 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606235+0000", 2020-11-12T17:29:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.0183999999999999e-05 2020-11-12T17:29:50.440 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606285+0000", 2020-11-12T17:29:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7549999999999997e-06 2020-11-12T17:29:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.441 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606292+0000", 2020-11-12T17:29:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5820000000000002e-06 2020-11-12T17:29:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.442 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.606295+0000", 2020-11-12T17:29:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054930990000000004 2020-11-12T17:29:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611788+0000", 2020-11-12T17:29:50.443 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6570000000000002e-05 2020-11-12T17:29:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611845+0000", 2020-11-12T17:29:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9118999999999998e-05 2020-11-12T17:29:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.444 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.611934+0000", 2020-11-12T17:29:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.005585507 2020-11-12T17:29:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617519+0000", 2020-11-12T17:29:50.445 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69573291000000004 2020-11-12T17:29:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313252+0000", 2020-11-12T17:29:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7564000000000006e-05 2020-11-12T17:29:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.446 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313320+0000", 2020-11-12T17:29:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4725000000000002e-05 2020-11-12T17:29:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.447 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313375+0000", 2020-11-12T17:29:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70712270899999996 2020-11-12T17:29:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.448 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75877 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:29:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 209.75258834799999, 2020-11-12T17:29:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001, 2020-11-12T17:29:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.449 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75877 2020-11-12T17:29:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:29:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608146+0000", 2020-11-12T17:29:50.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999595 2020-11-12T17:29:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608105+0000", 2020-11-12T17:29:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000115306 2020-11-12T17:29:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.452 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608220+0000", 2020-11-12T17:29:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9519000000000001e-05 2020-11-12T17:29:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.453 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608240+0000", 2020-11-12T17:29:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.3149999999999998e-06 2020-11-12T17:29:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608249+0000", 2020-11-12T17:29:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054878180000000002 2020-11-12T17:29:50.454 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613737+0000", 2020-11-12T17:29:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000112267 2020-11-12T17:29:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.455 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613849+0000", 2020-11-12T17:29:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014510200000000001 2020-11-12T17:29:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:50.456 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613994+0000", 2020-11-12T17:29:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69918312800000004 2020-11-12T17:29:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313178+0000", 2020-11-12T17:29:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0063546189999999997 2020-11-12T17:29:50.457 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319532+0000", 2020-11-12T17:29:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010984600000000001 2020-11-12T17:29:50.458 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319642+0000", 2020-11-12T17:29:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114688 2020-11-12T17:29:50.459 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319757+0000", 2020-11-12T17:29:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71161112900000001 2020-11-12T17:29:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.460 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75878 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:29:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 209.75183569999999, 2020-11-12T17:29:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995, 2020-11-12T17:29:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.461 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75878 2020-11-12T17:29:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.462 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:29:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.463 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608898+0000", 2020-11-12T17:29:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:29:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.464 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608864+0000", 2020-11-12T17:29:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000101368 2020-11-12T17:29:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608965+0000", 2020-11-12T17:29:50.465 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6784000000000001e-05 2020-11-12T17:29:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608982+0000", 2020-11-12T17:29:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0736e-05 2020-11-12T17:29:50.466 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.608993+0000", 2020-11-12T17:29:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068044020000000002 2020-11-12T17:29:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.467 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615797+0000", 2020-11-12T17:29:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4811e-05 2020-11-12T17:29:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.468 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615862+0000", 2020-11-12T17:29:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011270299999999999 2020-11-12T17:29:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615975+0000", 2020-11-12T17:29:50.469 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.697426086 2020-11-12T17:29:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313401+0000", 2020-11-12T17:29:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064309049999999998 2020-11-12T17:29:50.470 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319832+0000", 2020-11-12T17:29:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2063000000000004e-05 2020-11-12T17:29:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.471 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319914+0000", 2020-11-12T17:29:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3361e-05 2020-11-12T17:29:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.472 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319967+0000", 2020-11-12T17:29:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71106884299999995 2020-11-12T17:29:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.473 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75879 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:29:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 209.74867418299999, 2020-11-12T17:29:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999, 2020-11-12T17:29:50.474 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:50.475 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75879 2020-11-12T17:29:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:29:50.476 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612060+0000", 2020-11-12T17:29:50.477 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999785 2020-11-12T17:29:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612038+0000", 2020-11-12T17:29:50.478 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8514999999999998e-05 2020-11-12T17:29:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612097+0000", 2020-11-12T17:29:50.479 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3699999999999995e-06 2020-11-12T17:29:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612105+0000", 2020-11-12T17:29:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8930000000000004e-06 2020-11-12T17:29:50.480 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.612110+0000", 2020-11-12T17:29:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054545399999999999 2020-11-12T17:29:50.481 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617564+0000", 2020-11-12T17:29:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7373999999999994e-05 2020-11-12T17:29:50.482 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617652+0000", 2020-11-12T17:29:50.483 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014814900000000001 2020-11-12T17:29:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.617800+0000", 2020-11-12T17:29:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70221955899999999 2020-11-12T17:29:50.484 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320020+0000", 2020-11-12T17:29:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00052373899999999995 2020-11-12T17:29:50.485 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320543+0000", 2020-11-12T17:29:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6001000000000006e-05 2020-11-12T17:29:50.486 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320629+0000", 2020-11-12T17:29:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.0755999999999999e-05 2020-11-12T17:29:50.487 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320690+0000", 2020-11-12T17:29:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70863030199999999 2020-11-12T17:29:50.488 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.489 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75880 4.7 4:eeed9eee:::benchmark_data_smithi036_18856_object9484:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:29:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 209.747593016, 2020-11-12T17:29:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996, 2020-11-12T17:29:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.490 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75880 2020-11-12T17:29:50.491 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:29:50.492 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613141+0000", 2020-11-12T17:29:50.493 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999599 2020-11-12T17:29:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613101+0000", 2020-11-12T17:29:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011649100000000001 2020-11-12T17:29:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.494 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613218+0000", 2020-11-12T17:29:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8230999999999999e-05 2020-11-12T17:29:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.495 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613236+0000", 2020-11-12T17:29:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7240000000000004e-06 2020-11-12T17:29:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.496 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613246+0000", 2020-11-12T17:29:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064002369999999996 2020-11-12T17:29:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.497 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619646+0000", 2020-11-12T17:29:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7522999999999995e-05 2020-11-12T17:29:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.498 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619733+0000", 2020-11-12T17:29:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014462899999999999 2020-11-12T17:29:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619878+0000", 2020-11-12T17:29:50.499 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70065118699999995 2020-11-12T17:29:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320529+0000", 2020-11-12T17:29:50.500 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017012099999999999 2020-11-12T17:29:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320699+0000", 2020-11-12T17:29:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9060999999999998e-05 2020-11-12T17:29:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.501 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320738+0000", 2020-11-12T17:29:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.8819e-05 2020-11-12T17:29:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.502 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.320767+0000", 2020-11-12T17:29:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70762619699999996 2020-11-12T17:29:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.503 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75881 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:29:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 209.74742392300001, 2020-11-12T17:29:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002, 2020-11-12T17:29:50.504 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75881 2020-11-12T17:29:50.505 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:29:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.506 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613310+0000", 2020-11-12T17:29:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999657 2020-11-12T17:29:50.507 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613276+0000", 2020-11-12T17:29:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010070599999999999 2020-11-12T17:29:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.508 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613376+0000", 2020-11-12T17:29:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6107999999999999e-05 2020-11-12T17:29:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.509 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613392+0000", 2020-11-12T17:29:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4929999999999998e-06 2020-11-12T17:29:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613398+0000", 2020-11-12T17:29:50.510 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5324e-05 2020-11-12T17:29:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613463+0000", 2020-11-12T17:29:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014276600000000001 2020-11-12T17:29:50.511 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613606+0000", 2020-11-12T17:29:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000125146 2020-11-12T17:29:50.512 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.613731+0000", 2020-11-12T17:29:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70573818600000005 2020-11-12T17:29:50.513 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.514 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.514 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.514 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319469+0000", 2020-11-12T17:29:50.514 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2925999999999998e-05 2020-11-12T17:29:50.514 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319562+0000", 2020-11-12T17:29:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6728e-05 2020-11-12T17:29:50.515 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319649+0000", 2020-11-12T17:29:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8425999999999997e-05 2020-11-12T17:29:50.516 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.319737+0000", 2020-11-12T17:29:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70642733000000002 2020-11-12T17:29:50.517 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.518 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.518 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.518 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.518 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75882 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:29:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 209.74480527700001, 2020-11-12T17:29:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001, 2020-11-12T17:29:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.519 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:50.520 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75882 2020-11-12T17:29:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:29:50.521 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615929+0000", 2020-11-12T17:29:50.522 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999819 2020-11-12T17:29:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615910+0000", 2020-11-12T17:29:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.3628000000000002e-05 2020-11-12T17:29:50.523 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615964+0000", 2020-11-12T17:29:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4590000000000001e-06 2020-11-12T17:29:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.524 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615972+0000", 2020-11-12T17:29:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6959999999999996e-06 2020-11-12T17:29:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.525 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.615976+0000", 2020-11-12T17:29:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0022290190000000001 2020-11-12T17:29:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.526 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618205+0000", 2020-11-12T17:29:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5124000000000006e-05 2020-11-12T17:29:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618300+0000", 2020-11-12T17:29:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013369099999999999 2020-11-12T17:29:50.527 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.618434+0000", 2020-11-12T17:29:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70546610300000001 2020-11-12T17:29:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.528 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.323900+0000", 2020-11-12T17:29:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010061 2020-11-12T17:29:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.529 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324001+0000", 2020-11-12T17:29:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013170900000000001 2020-11-12T17:29:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.530 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324133+0000", 2020-11-12T17:29:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2787000000000001e-05 2020-11-12T17:29:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.531 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324185+0000", 2020-11-12T17:29:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.70825665900000001 2020-11-12T17:29:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.532 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:75883 4.8 4:1d09b59f:::benchmark_data_smithi036_18856_object9485:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192] snapc 0=[] ondisk+write+known_if_redirected e112)", 2020-11-12T17:29:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:29:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 209.744697194, 2020-11-12T17:29:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999, 2020-11-12T17:29:50.533 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:29:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:29:50.534 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 75883 2020-11-12T17:29:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.535 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:29:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616037+0000", 2020-11-12T17:29:50.536 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616021+0000", 2020-11-12T17:29:50.537 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1517000000000002e-05 2020-11-12T17:29:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.538 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616072+0000", 2020-11-12T17:29:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2729999999999997e-06 2020-11-12T17:29:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616080+0000", 2020-11-12T17:29:50.539 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9300000000000002e-06 2020-11-12T17:29:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.616085+0000", 2020-11-12T17:29:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.696728613 2020-11-12T17:29:50.540 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.312813+0000", 2020-11-12T17:29:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029955999999999998 2020-11-12T17:29:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.541 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313113+0000", 2020-11-12T17:29:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00065720100000000005 2020-11-12T17:29:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.542 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:29:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313770+0000", 2020-11-12T17:29:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.010429468000000001 2020-11-12T17:29:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.543 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.324199+0000", 2020-11-12T17:29:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0054814089999999996 2020-11-12T17:29:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.544 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329681+0000", 2020-11-12T17:29:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9994000000000003e-05 2020-11-12T17:29:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.545 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329731+0000", 2020-11-12T17:29:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000100247 2020-11-12T17:29:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.546 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.329831+0000", 2020-11-12T17:29:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.71379430399999999 2020-11-12T17:29:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.547 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:75876 4.7 e112/106 ondisk, result = 0)", 2020-11-12T17:29:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:29:50.548 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 209.74073451199999, 2020-11-12T17:29:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576, 2020-11-12T17:29:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.549 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:29:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619999+0000", 2020-11-12T17:29:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999871 2020-11-12T17:29:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.551 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.619986+0000", 2020-11-12T17:29:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9753000000000003e-05 2020-11-12T17:29:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.552 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620036+0000", 2020-11-12T17:29:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9278999999999999e-05 2020-11-12T17:29:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.553 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620065+0000", 2020-11-12T17:29:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.622e-06 2020-11-12T17:29:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:20.620070+0000", 2020-11-12T17:29:50.554 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.69315746 2020-11-12T17:29:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313228+0000", 2020-11-12T17:29:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2975e-05 2020-11-12T17:29:50.555 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313241+0000", 2020-11-12T17:29:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014249099999999999 2020-11-12T17:29:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.556 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:21.313383+0000", 2020-11-12T17:29:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.693383576 2020-11-12T17:29:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.557 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.5552.0:16136 5.2 e139/127 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head v 139'1048, mlcod=139'1044)", 2020-11-12T17:29:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:29:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 166.703004771, 2020-11-12T17:29:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996, 2020-11-12T17:29:50.558 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:29:50.559 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657729+0000", 2020-11-12T17:29:50.560 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999709 2020-11-12T17:29:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657700+0000", 2020-11-12T17:29:50.561 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000111539 2020-11-12T17:29:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657811+0000", 2020-11-12T17:29:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57474415300000004 2020-11-12T17:29:50.562 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232556+0000", 2020-11-12T17:29:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.2313000000000001e-05 2020-11-12T17:29:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.563 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232568+0000", 2020-11-12T17:29:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1899999999999998e-05 2020-11-12T17:29:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.564 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232660+0000", 2020-11-12T17:29:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.7936999999999999e-05 2020-11-12T17:29:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.565 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.566 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.232708+0000", 2020-11-12T17:29:50.566 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023256409999999998 2020-11-12T17:29:50.566 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.566 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.566 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235033+0000", 2020-11-12T17:29:50.567 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8335e-05 2020-11-12T17:29:50.567 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.567 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.567 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.567 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235132+0000", 2020-11-12T17:29:50.568 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57740249499999996 2020-11-12T17:29:50.568 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.568 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.568 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.568 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.569 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.569 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:61760 5.3 e171/168 ondisk, result = 0)", 2020-11-12T17:29:50.569 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:29:50.569 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 112.18960208599999, 2020-11-12T17:29:50.569 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003, 2020-11-12T17:29:50.570 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.570 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:50.570 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.570 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.570 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.570 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:29:50.571 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.571 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.571 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.571 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.571 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171132+0000", 2020-11-12T17:29:50.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999866 2020-11-12T17:29:50.572 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.572 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.572 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.572 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171118+0000", 2020-11-12T17:29:50.572 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5170999999999999e-05 2020-11-12T17:29:50.573 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.573 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.573 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.573 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.171154+0000", 2020-11-12T17:29:50.573 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65035422799999998 2020-11-12T17:29:50.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.574 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.574 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.574 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821508+0000", 2020-11-12T17:29:50.574 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.4469999999999995e-06 2020-11-12T17:29:50.574 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.575 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.575 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.575 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821517+0000", 2020-11-12T17:29:50.575 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5043999999999995e-05 2020-11-12T17:29:50.575 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.576 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.576 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821592+0000", 2020-11-12T17:29:50.576 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6324000000000002e-05 2020-11-12T17:29:50.576 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.576 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.577 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.577 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821609+0000", 2020-11-12T17:29:50.577 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00038230499999999999 2020-11-12T17:29:50.577 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.577 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.578 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.578 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:58.821991+0000", 2020-11-12T17:29:50.578 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.65085902900000003 2020-11-12T17:29:50.578 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.578 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.578 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.579 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.579 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.579 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:62656 5.f 5:f5ca467d:::benchmark_data_smithi036_24110_object7831:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e172)", 2020-11-12T17:29:50.579 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:29:50.579 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 110.853292201, 2020-11-12T17:29:50.579 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995, 2020-11-12T17:29:50.580 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.580 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.580 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.580 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:29:50.580 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:29:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 62656 2020-11-12T17:29:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:29:50.581 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507442+0000", 2020-11-12T17:29:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999704 2020-11-12T17:29:50.582 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.583 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.583 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507412+0000", 2020-11-12T17:29:50.583 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9779999999999998e-05 2020-11-12T17:29:50.583 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.583 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.584 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507502+0000", 2020-11-12T17:29:50.584 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3191e-05 2020-11-12T17:29:50.584 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.584 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.584 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507515+0000", 2020-11-12T17:29:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4880000000000001e-06 2020-11-12T17:29:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.585 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.507523+0000", 2020-11-12T17:29:50.586 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012795806999999999 2020-11-12T17:29:50.586 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.586 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.586 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.586 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520318+0000", 2020-11-12T17:29:50.587 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2253000000000001e-05 2020-11-12T17:29:50.587 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.587 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.587 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.587 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520391+0000", 2020-11-12T17:29:50.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011411199999999999 2020-11-12T17:29:50.588 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.588 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.588 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:50.588 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.520505+0000", 2020-11-12T17:29:50.588 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035311159999999999 2020-11-12T17:29:50.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.589 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.589 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.589 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.524036+0000", 2020-11-12T17:29:50.589 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95363639600000005 2020-11-12T17:29:50.589 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.590 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.590 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.590 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477672+0000", 2020-11-12T17:29:50.590 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012927500000000001 2020-11-12T17:29:50.590 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.591 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.591 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477801+0000", 2020-11-12T17:29:50.591 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9773999999999998e-05 2020-11-12T17:29:50.591 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.591 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.592 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.592 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477891+0000", 2020-11-12T17:29:50.592 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.97044953199999995 2020-11-12T17:29:50.592 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.592 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:62656 5.f e172/127 ondisk, result = 0)", 2020-11-12T17:29:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:29:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 110.835684075, 2020-11-12T17:29:50.593 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002, 2020-11-12T17:29:50.594 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.594 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:29:50.594 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.594 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.594 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:29:50.595 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.595 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.595 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.595 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.595 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525050+0000", 2020-11-12T17:29:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999843 2020-11-12T17:29:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525034+0000", 2020-11-12T17:29:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7698999999999999e-05 2020-11-12T17:29:50.596 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.597 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.597 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:59.525072+0000", 2020-11-12T17:29:50.597 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95237724599999996 2020-11-12T17:29:50.597 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.597 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.598 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477449+0000", 2020-11-12T17:29:50.598 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1454000000000001e-05 2020-11-12T17:29:50.598 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.598 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.598 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.599 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477461+0000", 2020-11-12T17:29:50.599 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170674 2020-11-12T17:29:50.599 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.599 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.599 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477631+0000", 2020-11-12T17:29:50.600 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8836000000000001e-05 2020-11-12T17:29:50.600 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.600 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.600 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.600 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477650+0000", 2020-11-12T17:29:50.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00025261100000000002 2020-11-12T17:29:50.601 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.601 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.601 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.601 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:00.477903+0000", 2020-11-12T17:29:50.601 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.95285296600000002 2020-11-12T17:29:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.602 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.6159.0:15728 6.7 6:e4c465ea:::benchmark_data_smithi036_29033_object1965:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e199)", 2020-11-12T17:29:50.603 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:28:51.936993+0000", 2020-11-12T17:29:50.603 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 58.42374049, 2020-11-12T17:29:50.603 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42862954800000003, 2020-11-12T17:29:50.603 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:50.603 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:50.603 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:50.604 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.6159", 2020-11-12T17:29:50.604 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/3770746757", 2020-11-12T17:29:50.604 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 15728 2020-11-12T17:29:50.604 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.604 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.936993+0000", 2020-11-12T17:29:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.605 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.606 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:50.606 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.936993+0000", 2020-11-12T17:29:50.606 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:29:50.606 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.606 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:50.607 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.936974+0000", 2020-11-12T17:29:50.607 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.728e-05 2020-11-12T17:29:50.607 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.607 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.607 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:50.608 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.937031+0000", 2020-11-12T17:29:50.608 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.0029999999999994e-06 2020-11-12T17:29:50.608 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.608 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.608 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:50.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.937039+0000", 2020-11-12T17:29:50.609 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.8280000000000002e-06 2020-11-12T17:29:50.609 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.609 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.609 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:50.609 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.937044+0000", 2020-11-12T17:29:50.610 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027712489999999999 2020-11-12T17:29:50.610 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.610 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.610 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:50.610 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.939815+0000", 2020-11-12T17:29:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000114197 2020-11-12T17:29:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.939929+0000", 2020-11-12T17:29:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020821500000000001 2020-11-12T17:29:50.611 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 3", 2020-11-12T17:29:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.940138+0000", 2020-11-12T17:29:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001754907 2020-11-12T17:29:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.612 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:51.941893+0000", 2020-11-12T17:29:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42363165000000003 2020-11-12T17:29:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:50.613 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:52.365524+0000", 2020-11-12T17:29:50.614 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6030999999999999e-05 2020-11-12T17:29:50.614 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.614 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.614 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:50.614 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:52.365580+0000", 2020-11-12T17:29:50.615 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.2740000000000001e-05 2020-11-12T17:29:50.615 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:50.615 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:50.615 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:50.615 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:28:52.365623+0000", 2020-11-12T17:29:50.616 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.42862954800000003 2020-11-12T17:29:50.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.616 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.616 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:50.617 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:50.617 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:50.619 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 74 16 29904 29888 3.15506 0 - 0.0157766 2020-11-12T17:29:50.619 INFO:teuthology.orchestra.run.smithi036.stderr:noscrub is set 2020-11-12T17:29:50.619 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:29:50.554+0000 7fb238d34700 -1 osd.2 205 handle_osd_map injecting map crc failure 2020-11-12T17:29:50.620 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2020-11-12T17:29:50.621 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:50.575+0000 7f2809aaf700 -1 osd.6 225 handle_osd_map injecting map crc failure 2020-11-12T17:29:50.621 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:50.615+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:50.719 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:29:50.715+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:29:50.770 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:50.771 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:50.771 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:29:50.771 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:50.780 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2020-11-12T17:29:50.822 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:50.819+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:29:50.921 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:29:50.919+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:29:50.942 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:50.942 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:29:50.942 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:29:50.943 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:29:50.943 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:29:50.952 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2020-11-12T17:29:51.022 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:51.018+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:29:51.108 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:29:51.109 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:29:51.109 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:29:51.109 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:29:51.110 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.110 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12232 3.a 3:592ab3b5:::benchmark_data_smithi036_14212_object1528:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e32)", 2020-11-12T17:29:51.110 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:51.111 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43460120200001, 2020-11-12T17:29:51.111 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957, 2020-11-12T17:29:51.111 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:51.111 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "reached pg", 2020-11-12T17:29:51.112 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:51.112 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:51.112 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:51.112 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12232 2020-11-12T17:29:51.112 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.112 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:51.112 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:51.113 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:51.113 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:51.113 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.113 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.113 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:51.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669636+0000", 2020-11-12T17:29:51.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999042 2020-11-12T17:29:51.114 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.114 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.114 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:51.114 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669541+0000", 2020-11-12T17:29:51.114 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027349299999999998 2020-11-12T17:29:51.115 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.115 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.115 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:51.115 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669814+0000", 2020-11-12T17:29:51.115 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7864000000000002e-05 2020-11-12T17:29:51.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:51.116 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669852+0000", 2020-11-12T17:29:51.116 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9020000000000001e-05 2020-11-12T17:29:51.116 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.116 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.116 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:51.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669871+0000", 2020-11-12T17:29:51.117 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014465699999999999 2020-11-12T17:29:51.117 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.117 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.117 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:51.117 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670016+0000", 2020-11-12T17:29:51.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9753000000000001e-05 2020-11-12T17:29:51.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.118 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.118 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:51.118 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670046+0000", 2020-11-12T17:29:51.118 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081511680000000003 2020-11-12T17:29:51.118 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:51.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678197+0000", 2020-11-12T17:29:51.119 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7954999999999998e-05 2020-11-12T17:29:51.119 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.119 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.119 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:51.119 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678235+0000", 2020-11-12T17:29:51.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173316503000001 2020-11-12T17:29:51.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.120 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.120 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:51.120 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851551+0000", 2020-11-12T17:29:51.120 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018822700000000001 2020-11-12T17:29:51.120 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.121 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.121 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:51.121 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851739+0000", 2020-11-12T17:29:51.121 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182102957 2020-11-12T17:29:51.121 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:51.121 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:51.121 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:51.121 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.122 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.122 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12689 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:51.122 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:51.122 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43419884100001, 2020-11-12T17:29:51.122 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308, 2020-11-12T17:29:51.122 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:51.122 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:51.123 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:51.123 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:51.123 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:51.123 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12689 2020-11-12T17:29:51.123 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.123 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:51.123 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.123 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:51.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:51.124 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:51.124 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.124 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.124 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:51.124 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670039+0000", 2020-11-12T17:29:51.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999161 2020-11-12T17:29:51.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.125 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:51.125 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.669955+0000", 2020-11-12T17:29:51.125 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00023318300000000001 2020-11-12T17:29:51.125 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.125 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:51.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670188+0000", 2020-11-12T17:29:51.126 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.5086999999999999e-05 2020-11-12T17:29:51.126 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.126 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.126 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:51.126 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670213+0000", 2020-11-12T17:29:51.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0273e-05 2020-11-12T17:29:51.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.127 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:51.127 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670224+0000", 2020-11-12T17:29:51.127 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107654 2020-11-12T17:29:51.127 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.127 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:51.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670331+0000", 2020-11-12T17:29:51.128 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.474e-05 2020-11-12T17:29:51.128 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.128 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.128 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:51.128 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670356+0000", 2020-11-12T17:29:51.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0084387650000000008 2020-11-12T17:29:51.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.129 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:51.129 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678795+0000", 2020-11-12T17:29:51.129 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.7452e-05 2020-11-12T17:29:51.129 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.129 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:51.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678832+0000", 2020-11-12T17:29:51.130 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.173042432000001 2020-11-12T17:29:51.130 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.130 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.130 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:51.130 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.851875+0000", 2020-11-12T17:29:51.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00032465 2020-11-12T17:29:51.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.131 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:51.131 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852199+0000", 2020-11-12T17:29:51.131 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00033244399999999999 2020-11-12T17:29:51.131 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.131 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:29:51.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.852532+0000", 2020-11-12T17:29:51.132 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068308880000000002 2020-11-12T17:29:51.132 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.132 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.132 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:29:51.132 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859363+0000", 2020-11-12T17:29:51.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0023332209999999999 2020-11-12T17:29:51.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.133 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.133 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:29:51.133 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861696+0000", 2020-11-12T17:29:51.133 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596000000000006e-05 2020-11-12T17:29:51.133 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:29:51.134 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861788+0000", 2020-11-12T17:29:51.134 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.5643000000000007e-05 2020-11-12T17:29:51.134 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.134 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.134 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:29:51.135 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861874+0000", 2020-11-12T17:29:51.135 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191835308 2020-11-12T17:29:51.135 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:51.135 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:29:51.135 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:29:51.135 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.136 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.136 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12690 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:29:51.136 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:51.136 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43387484800002, 2020-11-12T17:29:51.136 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403, 2020-11-12T17:29:51.137 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:29:51.137 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:29:51.137 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:29:51.137 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:29:51.137 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:29:51.137 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12690 2020-11-12T17:29:51.138 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.138 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:29:51.138 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.138 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:29:51.138 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:51.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:29:51.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.139 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.139 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:29:51.139 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670363+0000", 2020-11-12T17:29:51.139 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999123 2020-11-12T17:29:51.139 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.140 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:29:51.140 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670275+0000", 2020-11-12T17:29:51.140 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215317 2020-11-12T17:29:51.140 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.140 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:29:51.141 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670490+0000", 2020-11-12T17:29:51.141 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8627e-05 2020-11-12T17:29:51.141 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.141 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.141 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:29:51.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670509+0000", 2020-11-12T17:29:51.142 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9930000000000001e-06 2020-11-12T17:29:51.142 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.142 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.142 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:29:51.142 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670518+0000", 2020-11-12T17:29:51.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6683999999999999e-05 2020-11-12T17:29:51.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.143 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.143 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:51.143 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670605+0000", 2020-11-12T17:29:51.143 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4233e-05 2020-11-12T17:29:51.143 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.144 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:29:51.144 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670629+0000", 2020-11-12T17:29:51.144 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0082888449999999995 2020-11-12T17:29:51.144 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:51.144 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:51.550 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678918+0000", 2020-11-12T17:29:51.958 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.9165999999999997e-05 2020-11-12T17:29:51.959 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:56.450 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:56.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:29:56.451 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678957+0000", 2020-11-12T17:29:56.451 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.176254652000001 2020-11-12T17:29:56.451 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:56.451 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:56.451 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:29:56.452 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855212+0000", 2020-11-12T17:29:57.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00029198000000000001 2020-11-12T17:29:57.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:29:57.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:29:57.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:29:57.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855504+0000", 2020-11-12T17:29:57.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00049247799999999997 2020-11-12T17:30:15.659 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.660 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.661 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:15.661 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.855996+0000", 2020-11-12T17:30:15.661 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0058972570000000004 2020-11-12T17:30:15.662 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.662 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.662 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:15.663 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861893+0000", 2020-11-12T17:30:15.663 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002082043 2020-11-12T17:30:15.663 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.664 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.667 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:15.668 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.863975+0000", 2020-11-12T17:30:15.668 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015508199999999999 2020-11-12T17:30:15.668 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.669 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.669 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:15.670 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864131+0000", 2020-11-12T17:30:15.670 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010769599999999999 2020-11-12T17:30:15.671 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.671 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.671 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:15.671 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864238+0000", 2020-11-12T17:30:15.672 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.193875403 2020-11-12T17:30:15.672 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:15.672 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:15.673 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:15.673 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.673 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.674 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12691 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:15.674 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:30:15.674 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43363113700002, 2020-11-12T17:30:15.674 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001, 2020-11-12T17:30:15.675 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:15.675 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:15.675 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:15.676 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:15.676 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:15.676 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12691 2020-11-12T17:30:15.676 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.677 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:15.677 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.677 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:15.678 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:30:15.679 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:15.680 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.682 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.684 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:15.686 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670607+0000", 2020-11-12T17:30:15.688 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999509 2020-11-12T17:30:15.689 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.689 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.689 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:15.689 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670557+0000", 2020-11-12T17:30:15.690 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014320399999999999 2020-11-12T17:30:15.690 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.690 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.691 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:15.691 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670701+0000", 2020-11-12T17:30:15.691 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5293000000000001e-05 2020-11-12T17:30:15.691 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.692 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.692 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:15.692 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670716+0000", 2020-11-12T17:30:15.693 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1277000000000001e-05 2020-11-12T17:30:15.693 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.693 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.693 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:15.694 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670727+0000", 2020-11-12T17:30:15.694 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2596999999999995e-05 2020-11-12T17:30:15.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:15.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670820+0000", 2020-11-12T17:30:15.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2612999999999998e-05 2020-11-12T17:30:15.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:15.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670842+0000", 2020-11-12T17:30:15.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0081523959999999993 2020-11-12T17:30:15.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:15.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.678995+0000", 2020-11-12T17:30:15.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5871999999999998e-05 2020-11-12T17:30:15.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.699 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:15.700 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679031+0000", 2020-11-12T17:30:15.700 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.178593880999999 2020-11-12T17:30:15.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.700 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:15.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857625+0000", 2020-11-12T17:30:15.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000165666 2020-11-12T17:30:15.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.734 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:15.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.857790+0000", 2020-11-12T17:30:15.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00031409400000000001 2020-11-12T17:30:15.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:15.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.858104+0000", 2020-11-12T17:30:15.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.006242923 2020-11-12T17:30:15.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:15.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864347+0000", 2020-11-12T17:30:15.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002790748 2020-11-12T17:30:15.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:15.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867138+0000", 2020-11-12T17:30:15.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.3872999999999998e-05 2020-11-12T17:30:15.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:15.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867182+0000", 2020-11-12T17:30:15.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8198000000000001e-05 2020-11-12T17:30:15.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:15.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867240+0000", 2020-11-12T17:30:15.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196633608000001 2020-11-12T17:30:15.740 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:15.740 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:15.740 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:15.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.741 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12692 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:15.741 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:30:15.741 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43339299000002, 2020-11-12T17:30:15.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743, 2020-11-12T17:30:15.741 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:15.741 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:15.741 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:15.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:15.742 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:15.742 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12692 2020-11-12T17:30:15.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.742 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:15.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:15.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:30:15.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:15.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:15.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670845+0000", 2020-11-12T17:30:15.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999428 2020-11-12T17:30:15.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:15.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670787+0000", 2020-11-12T17:30:15.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000139056 2020-11-12T17:30:15.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:15.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670926+0000", 2020-11-12T17:30:15.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6484e-05 2020-11-12T17:30:15.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:15.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670943+0000", 2020-11-12T17:30:15.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3830000000000003e-06 2020-11-12T17:30:15.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:15.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670950+0000", 2020-11-12T17:30:15.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0523e-05 2020-11-12T17:30:15.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:15.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671041+0000", 2020-11-12T17:30:15.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.186e-05 2020-11-12T17:30:15.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:15.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671053+0000", 2020-11-12T17:30:15.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0080011879999999994 2020-11-12T17:30:15.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:15.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679054+0000", 2020-11-12T17:30:15.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0911000000000003e-05 2020-11-12T17:30:15.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:15.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679085+0000", 2020-11-12T17:30:15.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.180413025 2020-11-12T17:30:15.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:15.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859498+0000", 2020-11-12T17:30:15.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00027691400000000001 2020-11-12T17:30:15.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:15.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.859775+0000", 2020-11-12T17:30:15.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00055170399999999997 2020-11-12T17:30:15.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:15.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.860326+0000", 2020-11-12T17:30:15.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041211750000000004 2020-11-12T17:30:15.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:15.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864448+0000", 2020-11-12T17:30:15.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045708270000000004 2020-11-12T17:30:15.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:15.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869018+0000", 2020-11-12T17:30:15.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.6722000000000002e-05 2020-11-12T17:30:15.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:15.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869095+0000", 2020-11-12T17:30:15.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4224000000000001e-05 2020-11-12T17:30:15.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:15.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869149+0000", 2020-11-12T17:30:15.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198304743 2020-11-12T17:30:15.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:15.758 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:15.758 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:15.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.759 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12693 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:15.759 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:30:15.759 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43319094999998, 2020-11-12T17:30:15.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001, 2020-11-12T17:30:15.760 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:15.760 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:15.760 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:15.760 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:15.760 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:15.760 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12693 2020-11-12T17:30:15.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.761 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:15.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:15.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:30:15.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:15.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:15.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671047+0000", 2020-11-12T17:30:15.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:30:15.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:15.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.670990+0000", 2020-11-12T17:30:15.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015951 2020-11-12T17:30:15.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.763 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:15.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671150+0000", 2020-11-12T17:30:15.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6852999999999999e-05 2020-11-12T17:30:15.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:15.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671167+0000", 2020-11-12T17:30:15.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.1070000000000005e-06 2020-11-12T17:30:15.764 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:15.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671175+0000", 2020-11-12T17:30:15.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3010000000000007e-05 2020-11-12T17:30:15.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:15.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671258+0000", 2020-11-12T17:30:15.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.378e-05 2020-11-12T17:30:15.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:15.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671272+0000", 2020-11-12T17:30:15.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0078338839999999993 2020-11-12T17:30:15.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:15.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679106+0000", 2020-11-12T17:30:15.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.5621000000000003e-05 2020-11-12T17:30:15.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:15.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679141+0000", 2020-11-12T17:30:15.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.182844462 2020-11-12T17:30:15.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:15.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.861986+0000", 2020-11-12T17:30:15.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183535 2020-11-12T17:30:15.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:15.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:15.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:15.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862169+0000", 2020-11-12T17:30:15.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00042349100000000001 2020-11-12T17:30:16.694 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.695 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.695 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.862593+0000", 2020-11-12T17:30:16.695 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0047869200000000001 2020-11-12T17:30:16.695 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.695 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867380+0000", 2020-11-12T17:30:16.696 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001787748 2020-11-12T17:30:16.696 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.696 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.696 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.696 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869167+0000", 2020-11-12T17:30:16.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7423999999999998e-05 2020-11-12T17:30:16.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.697 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.697 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.697 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869225+0000", 2020-11-12T17:30:16.697 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1888999999999997e-05 2020-11-12T17:30:16.697 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.698 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.698 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.698 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869277+0000", 2020-11-12T17:30:16.698 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198229914000001 2020-11-12T17:30:16.698 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.698 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.699 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.699 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.699 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.699 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12694 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.699 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:30:16.699 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43298557999998, 2020-11-12T17:30:16.699 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664, 2020-11-12T17:30:16.700 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.700 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.700 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.700 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.700 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.700 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12694 2020-11-12T17:30:16.700 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.701 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.701 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.701 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.701 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:30:16.701 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.701 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.702 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671252+0000", 2020-11-12T17:30:16.702 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:30:16.702 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.702 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.702 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671209+0000", 2020-11-12T17:30:16.703 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012783599999999999 2020-11-12T17:30:16.703 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.703 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.703 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.703 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671337+0000", 2020-11-12T17:30:16.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4977000000000001e-05 2020-11-12T17:30:16.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.704 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.704 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.704 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671352+0000", 2020-11-12T17:30:16.704 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2700000000000001e-06 2020-11-12T17:30:16.704 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.705 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671358+0000", 2020-11-12T17:30:16.705 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.7624000000000001e-05 2020-11-12T17:30:16.705 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.705 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.705 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.706 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671436+0000", 2020-11-12T17:30:16.706 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.135e-05 2020-11-12T17:30:16.706 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.706 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.706 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671447+0000", 2020-11-12T17:30:16.707 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0077471989999999998 2020-11-12T17:30:16.707 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.707 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.707 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.707 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679195+0000", 2020-11-12T17:30:16.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8727999999999999e-05 2020-11-12T17:30:16.708 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.708 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.708 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.708 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679233+0000", 2020-11-12T17:30:16.708 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.185295712 2020-11-12T17:30:16.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.709 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.709 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864529+0000", 2020-11-12T17:30:16.709 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021727500000000001 2020-11-12T17:30:16.709 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.709 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.710 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.864746+0000", 2020-11-12T17:30:16.710 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00041416599999999999 2020-11-12T17:30:16.710 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.710 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.710 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.865160+0000", 2020-11-12T17:30:16.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0041342380000000001 2020-11-12T17:30:16.711 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.711 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.711 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.711 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869295+0000", 2020-11-12T17:30:16.711 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040148989999999997 2020-11-12T17:30:16.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.712 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.712 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.712 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873310+0000", 2020-11-12T17:30:16.712 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3792000000000001e-05 2020-11-12T17:30:16.712 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.713 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.713 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.713 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873383+0000", 2020-11-12T17:30:16.713 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5366999999999999e-05 2020-11-12T17:30:16.713 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.714 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.714 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.714 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873449+0000", 2020-11-12T17:30:16.714 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.20219664 2020-11-12T17:30:16.714 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.715 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.715 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.715 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.716 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.716 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12695 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.716 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:30:16.716 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43279975299998, 2020-11-12T17:30:16.716 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756, 2020-11-12T17:30:16.717 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.717 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.717 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.717 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.717 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.717 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12695 2020-11-12T17:30:16.717 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.718 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.718 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.718 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.718 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:30:16.718 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.718 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.719 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.719 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.719 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671438+0000", 2020-11-12T17:30:16.719 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999571 2020-11-12T17:30:16.719 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.720 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671395+0000", 2020-11-12T17:30:16.720 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013029400000000001 2020-11-12T17:30:16.720 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.720 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.720 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671525+0000", 2020-11-12T17:30:16.721 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4517e-05 2020-11-12T17:30:16.721 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.721 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.721 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.721 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671540+0000", 2020-11-12T17:30:16.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4330000000000001e-06 2020-11-12T17:30:16.722 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.722 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.722 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.722 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671546+0000", 2020-11-12T17:30:16.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.9530000000000006e-05 2020-11-12T17:30:16.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.723 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.723 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671626+0000", 2020-11-12T17:30:16.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1613999999999999e-05 2020-11-12T17:30:16.723 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.724 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671638+0000", 2020-11-12T17:30:16.724 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0076304279999999999 2020-11-12T17:30:16.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.724 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679268+0000", 2020-11-12T17:30:16.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0441999999999998e-05 2020-11-12T17:30:16.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679288+0000", 2020-11-12T17:30:16.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.187125941 2020-11-12T17:30:16.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866414+0000", 2020-11-12T17:30:16.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2759e-05 2020-11-12T17:30:16.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866477+0000", 2020-11-12T17:30:16.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110394 2020-11-12T17:30:16.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.866587+0000", 2020-11-12T17:30:16.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004123463 2020-11-12T17:30:16.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870711+0000", 2020-11-12T17:30:16.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.002818456 2020-11-12T17:30:16.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873529+0000", 2020-11-12T17:30:16.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6823999999999997e-05 2020-11-12T17:30:16.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873586+0000", 2020-11-12T17:30:16.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7428e-05 2020-11-12T17:30:16.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873644+0000", 2020-11-12T17:30:16.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202205756 2020-11-12T17:30:16.732 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.732 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.732 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.732 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12696 3.a 3:55950327:::benchmark_data_smithi036_14212_object1586:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.733 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:30:16.733 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43260278899999, 2020-11-12T17:30:16.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009, 2020-11-12T17:30:16.733 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.733 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.733 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.734 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.734 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.734 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12696 2020-11-12T17:30:16.734 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.734 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.735 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.735 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:30:16.735 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.735 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.735 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.736 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671635+0000", 2020-11-12T17:30:16.736 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999495 2020-11-12T17:30:16.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.736 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.737 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671584+0000", 2020-11-12T17:30:16.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000148157 2020-11-12T17:30:16.737 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.737 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671732+0000", 2020-11-12T17:30:16.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5987000000000001e-05 2020-11-12T17:30:16.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671748+0000", 2020-11-12T17:30:16.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.4359999999999996e-06 2020-11-12T17:30:16.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671756+0000", 2020-11-12T17:30:16.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010675699999999999 2020-11-12T17:30:16.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671863+0000", 2020-11-12T17:30:16.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.3703e-05 2020-11-12T17:30:16.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671886+0000", 2020-11-12T17:30:16.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0074369149999999997 2020-11-12T17:30:16.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679323+0000", 2020-11-12T17:30:16.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.0652999999999999e-05 2020-11-12T17:30:16.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679354+0000", 2020-11-12T17:30:16.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.188076153000001 2020-11-12T17:30:16.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867430+0000", 2020-11-12T17:30:16.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000103242 2020-11-12T17:30:16.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.744 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867533+0000", 2020-11-12T17:30:16.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00018295 2020-11-12T17:30:16.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.745 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.867716+0000", 2020-11-12T17:30:16.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0053500830000000003 2020-11-12T17:30:16.745 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.745 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.745 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873066+0000", 2020-11-12T17:30:16.746 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000669076 2020-11-12T17:30:16.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.746 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873735+0000", 2020-11-12T17:30:16.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.4104000000000007e-05 2020-11-12T17:30:16.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873820+0000", 2020-11-12T17:30:16.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6350000000000001e-05 2020-11-12T17:30:16.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873876+0000", 2020-11-12T17:30:16.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.202241009 2020-11-12T17:30:16.748 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.748 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.749 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.749 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12705 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 0~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.749 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:30:16.749 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.432406759, 2020-11-12T17:30:16.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999, 2020-11-12T17:30:16.750 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.750 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.750 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.750 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12705 2020-11-12T17:30:16.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.751 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:30:16.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671831+0000", 2020-11-12T17:30:16.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:30:16.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671789+0000", 2020-11-12T17:30:16.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012292999999999999 2020-11-12T17:30:16.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671912+0000", 2020-11-12T17:30:16.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4416999999999999e-05 2020-11-12T17:30:16.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671927+0000", 2020-11-12T17:30:16.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5930000000000002e-06 2020-11-12T17:30:16.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671933+0000", 2020-11-12T17:30:16.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010126 2020-11-12T17:30:16.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.755 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672035+0000", 2020-11-12T17:30:16.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.836e-05 2020-11-12T17:30:16.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.756 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.756 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672053+0000", 2020-11-12T17:30:16.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0073309910000000002 2020-11-12T17:30:16.756 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679384+0000", 2020-11-12T17:30:16.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9703000000000001e-05 2020-11-12T17:30:16.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679404+0000", 2020-11-12T17:30:16.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.189944390000001 2020-11-12T17:30:16.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869348+0000", 2020-11-12T17:30:16.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000172394 2020-11-12T17:30:16.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869520+0000", 2020-11-12T17:30:16.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016235699999999999 2020-11-12T17:30:16.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.869683+0000", 2020-11-12T17:30:16.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0035745239999999999 2020-11-12T17:30:16.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.873257+0000", 2020-11-12T17:30:16.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0017493840000000001 2020-11-12T17:30:16.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875007+0000", 2020-11-12T17:30:16.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.3406999999999996e-05 2020-11-12T17:30:16.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875090+0000", 2020-11-12T17:30:16.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.4076999999999997e-05 2020-11-12T17:30:16.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.763 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875144+0000", 2020-11-12T17:30:16.763 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.203313276999999 2020-11-12T17:30:16.763 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.763 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.763 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.764 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12706 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 8192~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.764 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:30:16.764 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43222595899999, 2020-11-12T17:30:16.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702, 2020-11-12T17:30:16.764 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.764 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.764 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.764 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.765 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.765 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12706 2020-11-12T17:30:16.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.765 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:30:16.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672012+0000", 2020-11-12T17:30:16.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999561 2020-11-12T17:30:16.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.671968+0000", 2020-11-12T17:30:16.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000131447 2020-11-12T17:30:16.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672099+0000", 2020-11-12T17:30:16.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8819999999999999e-05 2020-11-12T17:30:16.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672118+0000", 2020-11-12T17:30:16.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.1530000000000002e-06 2020-11-12T17:30:16.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672124+0000", 2020-11-12T17:30:16.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010529700000000001 2020-11-12T17:30:16.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672229+0000", 2020-11-12T17:30:16.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4803999999999998e-05 2020-11-12T17:30:16.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672254+0000", 2020-11-12T17:30:16.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0071809719999999999 2020-11-12T17:30:16.770 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679435+0000", 2020-11-12T17:30:16.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3631999999999999e-05 2020-11-12T17:30:16.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.771 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.771 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679469+0000", 2020-11-12T17:30:16.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.191283571 2020-11-12T17:30:16.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870752+0000", 2020-11-12T17:30:16.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010473500000000001 2020-11-12T17:30:16.772 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.870857+0000", 2020-11-12T17:30:16.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000183182 2020-11-12T17:30:16.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.871040+0000", 2020-11-12T17:30:16.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0050833019999999996 2020-11-12T17:30:16.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876124+0000", 2020-11-12T17:30:16.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001975844 2020-11-12T17:30:16.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878100+0000", 2020-11-12T17:30:16.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.2241000000000003e-05 2020-11-12T17:30:16.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878162+0000", 2020-11-12T17:30:16.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.6609e-05 2020-11-12T17:30:16.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878208+0000", 2020-11-12T17:30:16.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.206196702 2020-11-12T17:30:16.777 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.777 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.777 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.778 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12707 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 16384~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.778 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:30:16.778 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43203000599999, 2020-11-12T17:30:16.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999, 2020-11-12T17:30:16.778 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.778 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.778 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.779 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.779 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.779 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12707 2020-11-12T17:30:16.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.779 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.779 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.779 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:30:16.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.780 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.780 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672208+0000", 2020-11-12T17:30:16.780 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999585 2020-11-12T17:30:16.780 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.780 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672166+0000", 2020-11-12T17:30:16.781 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00013068300000000001 2020-11-12T17:30:16.781 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.781 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.781 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.781 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672297+0000", 2020-11-12T17:30:16.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.4687e-05 2020-11-12T17:30:16.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.782 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.782 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.782 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672311+0000", 2020-11-12T17:30:16.782 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.1780000000000001e-05 2020-11-12T17:30:16.782 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672323+0000", 2020-11-12T17:30:16.783 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.8794000000000003e-05 2020-11-12T17:30:16.783 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.783 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.783 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.783 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672422+0000", 2020-11-12T17:30:16.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.425e-05 2020-11-12T17:30:16.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.784 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.784 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672446+0000", 2020-11-12T17:30:16.784 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.007053396 2020-11-12T17:30:16.784 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.784 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679500+0000", 2020-11-12T17:30:16.785 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9556e-05 2020-11-12T17:30:16.785 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.785 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.785 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.785 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679519+0000", 2020-11-12T17:30:16.786 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.194483966 2020-11-12T17:30:16.786 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.786 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.786 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.786 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874003+0000", 2020-11-12T17:30:16.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.1821000000000002e-05 2020-11-12T17:30:16.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.787 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.787 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874075+0000", 2020-11-12T17:30:16.787 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017826499999999999 2020-11-12T17:30:16.787 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.787 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.874253+0000", 2020-11-12T17:30:16.788 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0027754049999999999 2020-11-12T17:30:16.788 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.788 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.788 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.788 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877029+0000", 2020-11-12T17:30:16.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0039434279999999997 2020-11-12T17:30:16.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.789 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.789 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.880972+0000", 2020-11-12T17:30:16.789 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6082999999999997e-05 2020-11-12T17:30:16.789 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.789 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881038+0000", 2020-11-12T17:30:16.790 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1223000000000001e-05 2020-11-12T17:30:16.790 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.790 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.790 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.790 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881089+0000", 2020-11-12T17:30:16.791 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208881660999999 2020-11-12T17:30:16.791 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.791 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.791 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.791 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.791 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.791 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12708 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 24576~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.792 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:30:16.792 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43183639799997, 2020-11-12T17:30:16.792 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001, 2020-11-12T17:30:16.792 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.792 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.792 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.792 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.793 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.793 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12708 2020-11-12T17:30:16.793 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.793 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.793 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.793 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.793 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:30:16.793 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.794 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.794 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672401+0000", 2020-11-12T17:30:16.794 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999576 2020-11-12T17:30:16.794 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.794 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672359+0000", 2020-11-12T17:30:16.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000184594 2020-11-12T17:30:16.795 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.795 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.795 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.795 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672543+0000", 2020-11-12T17:30:16.795 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2926e-05 2020-11-12T17:30:16.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.796 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.796 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672566+0000", 2020-11-12T17:30:16.796 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2899999999999997e-06 2020-11-12T17:30:16.796 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.796 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672574+0000", 2020-11-12T17:30:16.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011030400000000001 2020-11-12T17:30:16.797 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.797 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.797 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.797 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672684+0000", 2020-11-12T17:30:16.797 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2366000000000001e-05 2020-11-12T17:30:16.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.798 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.798 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672716+0000", 2020-11-12T17:30:16.798 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0068345180000000004 2020-11-12T17:30:16.798 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.798 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679551+0000", 2020-11-12T17:30:16.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9505999999999998e-05 2020-11-12T17:30:16.799 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.799 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.799 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.799 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679580+0000", 2020-11-12T17:30:16.799 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.195630724000001 2020-11-12T17:30:16.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.800 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.800 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875211+0000", 2020-11-12T17:30:16.800 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110373 2020-11-12T17:30:16.800 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.800 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875321+0000", 2020-11-12T17:30:16.801 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000185587 2020-11-12T17:30:16.801 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.801 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.801 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.801 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.875507+0000", 2020-11-12T17:30:16.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0056300059999999999 2020-11-12T17:30:16.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.802 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.802 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881137+0000", 2020-11-12T17:30:16.802 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017521799999999999 2020-11-12T17:30:16.802 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.802 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881312+0000", 2020-11-12T17:30:16.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.6025999999999994e-05 2020-11-12T17:30:16.803 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.803 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.803 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.803 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881378+0000", 2020-11-12T17:30:16.803 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8884e-05 2020-11-12T17:30:16.804 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.804 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.804 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.804 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881447+0000", 2020-11-12T17:30:16.804 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.209045785000001 2020-11-12T17:30:16.804 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.804 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.805 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.805 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.805 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.805 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12709 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 32768~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.805 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:30:16.805 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43152453499999, 2020-11-12T17:30:16.805 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999, 2020-11-12T17:30:16.805 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.806 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.806 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.806 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.806 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.806 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12709 2020-11-12T17:30:16.806 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.807 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.807 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.807 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:30:16.807 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.807 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.807 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672713+0000", 2020-11-12T17:30:16.808 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.999918 2020-11-12T17:30:16.808 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.808 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.808 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.808 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672631+0000", 2020-11-12T17:30:16.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000215047 2020-11-12T17:30:16.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.809 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.809 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.809 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672846+0000", 2020-11-12T17:30:16.809 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7773000000000001e-05 2020-11-12T17:30:16.809 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672864+0000", 2020-11-12T17:30:16.810 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8429999999999993e-06 2020-11-12T17:30:16.810 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.810 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.810 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.810 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672872+0000", 2020-11-12T17:30:16.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.7183999999999997e-05 2020-11-12T17:30:16.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.811 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.811 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.811 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672969+0000", 2020-11-12T17:30:16.811 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4056000000000001e-05 2020-11-12T17:30:16.811 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672993+0000", 2020-11-12T17:30:16.812 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0066158579999999996 2020-11-12T17:30:16.812 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.812 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.812 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.812 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679609+0000", 2020-11-12T17:30:16.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8848e-05 2020-11-12T17:30:16.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.813 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.813 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.813 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679628+0000", 2020-11-12T17:30:16.813 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.196540779999999 2020-11-12T17:30:16.813 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.814 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.814 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876168+0000", 2020-11-12T17:30:16.814 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7282999999999999e-05 2020-11-12T17:30:16.814 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.814 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876236+0000", 2020-11-12T17:30:16.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0001727 2020-11-12T17:30:16.815 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.815 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.815 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.815 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.876408+0000", 2020-11-12T17:30:16.815 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0048832939999999998 2020-11-12T17:30:16.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.816 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881292+0000", 2020-11-12T17:30:16.816 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000170951 2020-11-12T17:30:16.816 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.816 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.816 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881463+0000", 2020-11-12T17:30:16.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6958000000000003e-05 2020-11-12T17:30:16.817 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.817 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.817 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.817 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881549+0000", 2020-11-12T17:30:16.817 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2991999999999997e-05 2020-11-12T17:30:16.818 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.818 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.818 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.818 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881602+0000", 2020-11-12T17:30:16.818 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.208889363999999 2020-11-12T17:30:16.818 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.818 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.819 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.819 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.819 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.819 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12710 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 40960~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.819 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:30:16.819 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43123703800001, 2020-11-12T17:30:16.819 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999, 2020-11-12T17:30:16.820 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.820 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.820 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.820 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12710 2020-11-12T17:30:16.820 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.821 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.821 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:30:16.821 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.821 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.821 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.821 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673001+0000", 2020-11-12T17:30:16.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999213 2020-11-12T17:30:16.822 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.822 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.822 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.822 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.672922+0000", 2020-11-12T17:30:16.822 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016929299999999999 2020-11-12T17:30:16.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.823 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673091+0000", 2020-11-12T17:30:16.823 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.6263999999999999e-05 2020-11-12T17:30:16.823 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.823 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.823 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673107+0000", 2020-11-12T17:30:16.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2429999999999999e-06 2020-11-12T17:30:16.824 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.824 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.824 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.824 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673115+0000", 2020-11-12T17:30:16.824 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.5734000000000004e-05 2020-11-12T17:30:16.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.825 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673190+0000", 2020-11-12T17:30:16.825 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7200000000000001e-05 2020-11-12T17:30:16.825 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.825 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.825 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673207+0000", 2020-11-12T17:30:16.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0064524999999999999 2020-11-12T17:30:16.826 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.826 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.826 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.826 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679660+0000", 2020-11-12T17:30:16.826 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.9359000000000001e-05 2020-11-12T17:30:16.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.827 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.827 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679689+0000", 2020-11-12T17:30:16.827 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.1974412 2020-11-12T17:30:16.827 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.827 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877131+0000", 2020-11-12T17:30:16.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1367999999999997e-05 2020-11-12T17:30:16.828 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.828 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.828 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.828 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877222+0000", 2020-11-12T17:30:16.828 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00017074000000000001 2020-11-12T17:30:16.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.829 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.829 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.877393+0000", 2020-11-12T17:30:16.829 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.004222908 2020-11-12T17:30:16.829 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.829 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.881616+0000", 2020-11-12T17:30:16.830 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0019671020000000001 2020-11-12T17:30:16.830 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.830 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.830 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.830 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883583+0000", 2020-11-12T17:30:16.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.1589999999999999e-05 2020-11-12T17:30:16.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.831 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.831 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.831 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883634+0000", 2020-11-12T17:30:16.831 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.3281000000000006e-05 2020-11-12T17:30:16.831 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.832 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.832 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.832 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883698+0000", 2020-11-12T17:30:16.832 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210696928999999 2020-11-12T17:30:16.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.832 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.832 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.832 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.833 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.833 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12711 3.a 3:525a4686:::benchmark_data_smithi036_14212_object1588:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192 in=8192b] snapc 0=[] ondisk+write+known_if_redirected e32)", 2020-11-12T17:30:16.833 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:30:16.833 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 391.43101666699999, 2020-11-12T17:30:16.833 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559, 2020-11-12T17:30:16.833 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.833 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.834 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.834 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:16.834 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:16.834 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12711 2020-11-12T17:30:16.835 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.835 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.835 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.835 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.836 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:30:16.836 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.836 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.836 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.837 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.837 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673221+0000", 2020-11-12T17:30:16.837 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999442 2020-11-12T17:30:16.837 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.838 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.838 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.838 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673165+0000", 2020-11-12T17:30:16.839 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000137451 2020-11-12T17:30:16.839 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.839 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.839 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.840 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673302+0000", 2020-11-12T17:30:16.840 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.5327000000000001e-05 2020-11-12T17:30:16.840 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.841 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.841 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.841 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673318+0000", 2020-11-12T17:30:16.842 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.0099999999999998e-06 2020-11-12T17:30:16.842 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.842 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.842 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.843 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673325+0000", 2020-11-12T17:30:16.843 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000109033 2020-11-12T17:30:16.843 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.843 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.844 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.844 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673434+0000", 2020-11-12T17:30:16.844 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.4202999999999998e-05 2020-11-12T17:30:16.845 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.845 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.845 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for peered", 2020-11-12T17:30:16.845 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.673458+0000", 2020-11-12T17:30:16.846 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0062466049999999997 2020-11-12T17:30:16.846 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.846 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.847 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.847 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679705+0000", 2020-11-12T17:30:16.847 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8992e-05 2020-11-12T17:30:16.847 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.848 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.848 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for readable", 2020-11-12T17:30:16.848 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.679724+0000", 2020-11-12T17:30:16.849 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.198528382999999 2020-11-12T17:30:16.849 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.849 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.849 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.850 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878252+0000", 2020-11-12T17:30:16.850 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8296999999999998e-05 2020-11-12T17:30:16.850 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.851 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.851 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.851 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878340+0000", 2020-11-12T17:30:16.851 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000162399 2020-11-12T17:30:16.852 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.852 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.852 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 4", 2020-11-12T17:30:16.853 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.878503+0000", 2020-11-12T17:30:16.853 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0040185660000000003 2020-11-12T17:30:16.853 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.853 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.854 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.854 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.882521+0000", 2020-11-12T17:30:16.854 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0012578999999999999 2020-11-12T17:30:16.855 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.855 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.855 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.855 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883779+0000", 2020-11-12T17:30:16.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.8622999999999999e-05 2020-11-12T17:30:16.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.856 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.856 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.856 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883818+0000", 2020-11-12T17:30:16.856 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.0751000000000003e-05 2020-11-12T17:30:16.856 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.857 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.857 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.857 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:32.883859+0000", 2020-11-12T17:30:16.857 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 13.210637559 2020-11-12T17:30:16.857 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.857 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.857 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.857 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.858 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.858 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop(client.4971.0:63880 4.4 e104/69 4:250e5af5:::benchmark_data_smithi036_18856_object7984:head v 104'3936, mlcod=104'3932)", 2020-11-12T17:30:16.858 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:30:16.858 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 229.52143767699999, 2020-11-12T17:30:16.858 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237, 2020-11-12T17:30:16.858 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.859 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.859 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.859 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.859 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.859 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:30:16.859 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.860 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582800+0000", 2020-11-12T17:30:16.860 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999371 2020-11-12T17:30:16.860 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.860 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.860 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582737+0000", 2020-11-12T17:30:16.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020358600000000001 2020-11-12T17:30:16.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.861 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.861 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.861 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:01.582941+0000", 2020-11-12T17:30:16.861 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.78667453700000001 2020-11-12T17:30:16.861 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.862 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369615+0000", 2020-11-12T17:30:16.862 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.4840000000000001e-06 2020-11-12T17:30:16.862 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.862 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.862 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.863 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369622+0000", 2020-11-12T17:30:16.863 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3740999999999998e-05 2020-11-12T17:30:16.863 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.863 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369695+0000", 2020-11-12T17:30:16.864 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.7271000000000001e-05 2020-11-12T17:30:16.864 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.864 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.864 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.864 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.369713+0000", 2020-11-12T17:30:16.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0030161369999999999 2020-11-12T17:30:16.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.865 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.865 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372729+0000", 2020-11-12T17:30:16.865 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2312999999999999e-05 2020-11-12T17:30:16.865 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.865 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.866 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.866 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:26:02.372781+0000", 2020-11-12T17:30:16.866 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.789981237 2020-11-12T17:30:16.866 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.866 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.866 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.866 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.867 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.867 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:16136 5.2 5:49e2aabf:::benchmark_data_smithi036_24110_object2016:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e139)", 2020-11-12T17:30:16.867 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:30:16.867 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 167.44706191700001, 2020-11-12T17:30:16.867 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004, 2020-11-12T17:30:16.867 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.867 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.868 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.868 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:30:16.868 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:30:16.868 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 16136 2020-11-12T17:30:16.868 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.868 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.868 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:30:16.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.869 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.869 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.869 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.869 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657176+0000", 2020-11-12T17:30:16.869 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999619 2020-11-12T17:30:16.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.870 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657138+0000", 2020-11-12T17:30:16.870 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000110894 2020-11-12T17:30:16.870 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.870 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.870 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657249+0000", 2020-11-12T17:30:16.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.8162e-05 2020-11-12T17:30:16.871 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.871 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.871 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.871 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657267+0000", 2020-11-12T17:30:16.871 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0903999999999999e-05 2020-11-12T17:30:16.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.872 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657278+0000", 2020-11-12T17:30:16.872 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7813999999999999e-05 2020-11-12T17:30:16.872 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.872 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.872 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657336+0000", 2020-11-12T17:30:16.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.2522000000000006e-05 2020-11-12T17:30:16.873 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.873 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.873 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.873 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657428+0000", 2020-11-12T17:30:16.873 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000124597 2020-11-12T17:30:16.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:30:16.874 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.657553+0000", 2020-11-12T17:30:16.874 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0013857870000000001 2020-11-12T17:30:16.874 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.874 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.874 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:03.658938+0000", 2020-11-12T17:30:16.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57687202400000004 2020-11-12T17:30:16.875 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.875 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.875 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.875 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.235811+0000", 2020-11-12T17:30:16.875 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00019103800000000001 2020-11-12T17:30:16.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.876 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.876 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.876 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236002+0000", 2020-11-12T17:30:16.876 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015150600000000001 2020-11-12T17:30:16.876 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.877 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.877 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.877 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:04.236153+0000", 2020-11-12T17:30:16.877 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57897733900000004 2020-11-12T17:30:16.877 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.877 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.877 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.878 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.878 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.878 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.5552.0:44136 5.9 5:9386ed25:::benchmark_data_smithi036_24110_object5516:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e155)", 2020-11-12T17:30:16.878 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:30:16.878 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 136.67663554999999, 2020-11-12T17:30:16.878 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026, 2020-11-12T17:30:16.878 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.878 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:16.879 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:16.879 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.5552", 2020-11-12T17:30:16.879 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/1937579481", 2020-11-12T17:30:16.879 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 44136 2020-11-12T17:30:16.879 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.879 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.879 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:30:16.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.880 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.880 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.880 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.880 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427602+0000", 2020-11-12T17:30:16.880 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999604 2020-11-12T17:30:16.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.881 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.881 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427563+0000", 2020-11-12T17:30:16.881 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011006 2020-11-12T17:30:16.881 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.881 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427673+0000", 2020-11-12T17:30:16.882 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.313e-05 2020-11-12T17:30:16.882 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.882 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.882 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.882 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427686+0000", 2020-11-12T17:30:16.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.3939999999999998e-06 2020-11-12T17:30:16.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.883 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.883 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.883 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.427693+0000", 2020-11-12T17:30:16.883 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0052507070000000003 2020-11-12T17:30:16.883 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.432944+0000", 2020-11-12T17:30:16.884 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105253 2020-11-12T17:30:16.884 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.884 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.884 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.884 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433049+0000", 2020-11-12T17:30:16.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016014600000000001 2020-11-12T17:30:16.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.885 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.885 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 7", 2020-11-12T17:30:16.885 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.433209+0000", 2020-11-12T17:30:16.885 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.001900316 2020-11-12T17:30:16.885 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:16.886 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435110+0000", 2020-11-12T17:30:16.886 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57854296999999999 2020-11-12T17:30:16.886 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.886 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.886 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:16.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013653+0000", 2020-11-12T17:30:16.887 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000105754 2020-11-12T17:30:16.887 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.887 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.887 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:16.887 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013758+0000", 2020-11-12T17:30:16.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.2699000000000002e-05 2020-11-12T17:30:16.888 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.888 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.888 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.888 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013841+0000", 2020-11-12T17:30:16.888 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.586239026 2020-11-12T17:30:16.888 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.888 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.889 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.889 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.889 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.889 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.5552.0:44136 5.9 e155/151 ondisk, result = 0)", 2020-11-12T17:30:16.889 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:30:16.889 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 136.668538517, 2020-11-12T17:30:16.889 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997, 2020-11-12T17:30:16.890 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:16.890 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:30:16.890 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:16.890 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.890 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:16.890 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:30:16.890 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:16.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.891 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:16.891 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435699+0000", 2020-11-12T17:30:16.891 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999738 2020-11-12T17:30:16.891 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.891 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:16.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435673+0000", 2020-11-12T17:30:16.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.2855000000000006e-05 2020-11-12T17:30:16.892 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.892 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.892 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:16.892 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:34.435746+0000", 2020-11-12T17:30:16.892 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57770560599999998 2020-11-12T17:30:16.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.893 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:16.893 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013452+0000", 2020-11-12T17:30:16.893 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.0986e-05 2020-11-12T17:30:16.893 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.893 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:16.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013463+0000", 2020-11-12T17:30:16.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015783299999999999 2020-11-12T17:30:16.894 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.894 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.894 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:16.894 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013620+0000", 2020-11-12T17:30:16.894 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.0128000000000001e-05 2020-11-12T17:30:16.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.895 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:16.895 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013641+0000", 2020-11-12T17:30:16.895 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00021462200000000001 2020-11-12T17:30:16.895 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:16.895 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:16.896 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:16.896 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:27:35.013855+0000", 2020-11-12T17:30:16.896 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.57815600099999997 2020-11-12T17:30:16.896 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.896 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.896 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.896 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:16.897 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:16.897 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:30:16.898 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2020-11-12T17:30:16.899 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd set nodeep-scrub 2020-11-12T17:30:16.900 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:30:16.903 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 75 16 29904 29888 3.113 0 - 0.0157766 2020-11-12T17:30:16.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 76 16 30712 30696 3.15509 0.137228 0.00996727 0.0395839 2020-11-12T17:30:16.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 77 16 31784 31768 3.22287 8.375 0.0106833 0.0387785 2020-11-12T17:30:16.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 78 16 32682 32666 3.27148 7.01562 0.00842472 0.0381831 2020-11-12T17:30:16.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 79 16 33555 33539 3.3164 6.82031 0.0190339 0.0376574 2020-11-12T17:30:16.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:2020-11-12T17:29:56.529731+0000 min lat: 0.00229077 max lat: 45.8375 avg lat: 0.0371035 2020-11-12T17:30:16.904 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2020-11-12T17:30:16.905 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 80 16 34498 34482 3.36702 7.36719 0.0094593 0.0371035 2020-11-12T17:30:16.905 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 81 16 35385 35369 3.411 6.92969 0.018852 0.0366265 2020-11-12T17:30:16.905 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 82 16 36355 36339 3.46181 7.57812 0.00733146 0.0360854 2020-11-12T17:30:16.905 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 83 16 37314 37298 3.51036 7.49219 0.00599972 0.035595 2020-11-12T17:30:16.905 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 84 16 38248 38232 3.55543 7.29688 0.00839561 0.0351339 2020-11-12T17:30:16.905 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 85 16 39167 39151 3.59806 7.17969 0.00778957 0.0347294 2020-11-12T17:30:16.905 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 86 16 40056 40040 3.63697 6.94531 0.0174829 0.0343467 2020-11-12T17:30:16.906 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 87 16 41006 40990 3.68047 7.42188 0.00913693 0.033954 2020-11-12T17:30:16.906 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 88 16 41883 41867 3.71649 6.85156 0.0150565 0.0336154 2020-11-12T17:30:16.906 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 89 16 42687 42671 3.7453 6.28125 0.00759158 0.0333641 2020-11-12T17:30:16.906 INFO:tasks.radosbench.radosbench.0.smithi036.stdout: 90 10 43523 43513 3.77677 6.57812 0.0144026 0.0330854 2020-11-12T17:30:16.906 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Total time run: 90.4627 2020-11-12T17:30:16.906 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Total writes made: 43523 2020-11-12T17:30:16.906 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Write size: 8192 2020-11-12T17:30:16.907 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Object size: 65536 2020-11-12T17:30:16.907 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Bandwidth (MB/sec): 3.75871 2020-11-12T17:30:16.907 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev Bandwidth: 3.97677 2020-11-12T17:30:16.907 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max bandwidth (MB/sec): 10.3906 2020-11-12T17:30:16.907 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min bandwidth (MB/sec): 0 2020-11-12T17:30:16.907 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Average IOPS: 481 2020-11-12T17:30:16.907 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev IOPS: 509.032 2020-11-12T17:30:16.907 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max IOPS: 1330 2020-11-12T17:30:16.908 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min IOPS: 0 2020-11-12T17:30:16.908 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Average Latency(s): 0.0331152 2020-11-12T17:30:16.908 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Stddev Latency(s): 0.874697 2020-11-12T17:30:16.908 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Max latency(s): 45.8375 2020-11-12T17:30:16.908 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Min latency(s): 0.00229077 2020-11-12T17:30:16.908 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Cleaning up (deleting benchmark objects) 2020-11-12T17:30:16.908 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Removed 5441 objects 2020-11-12T17:30:16.909 INFO:tasks.radosbench.radosbench.0.smithi036.stdout:Clean up completed and total clean up time :4.6398 2020-11-12T17:30:16.909 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:51.570+0000 7fc2486d1700 -1 osd.3 226 handle_osd_map injecting map crc failure 2020-11-12T17:30:16.909 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:29:57.594+0000 7fc24d2e3700 -1 osd.3 228 handle_osd_map injecting map crc failure 2020-11-12T17:30:16.909 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:29:57.590+0000 7f4dea6fe700 -1 osd.1 228 handle_osd_map injecting map crc failure 2020-11-12T17:30:16.909 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:29:57.594+0000 7f658835a700 -1 osd.0 228 handle_osd_map injecting map crc failure 2020-11-12T17:30:16.910 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:30:16.894+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:30:16.911 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:29:51.571+0000 7f7b4b297700 -1 osd.4 226 handle_osd_map injecting map crc failure 2020-11-12T17:30:16.917 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2020-11-12T17:30:16.941 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2020-11-12T17:30:16.942 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2020-11-12T17:30:17.001 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:30:16.994+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:30:17.059 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:30:17.060 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:30:17.060 INFO:teuthology.orchestra.run.smithi205.stdout: "num_ops": 0 2020-11-12T17:30:17.060 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:30:17.070 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2020-11-12T17:30:17.083 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2020-11-12T17:30:17.084 INFO:teuthology.orchestra.run.smithi036.stdout: "ops": [], 2020-11-12T17:30:17.084 INFO:teuthology.orchestra.run.smithi036.stdout: "num_ops": 0 2020-11-12T17:30:17.084 INFO:teuthology.orchestra.run.smithi036.stdout:} 2020-11-12T17:30:17.097 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 3 1 2020-11-12T17:30:17.115 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:30:17.116 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:30:17.114+0000 7fb244437700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31701) UID: 0 2020-11-12T17:30:17.143 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:30:17.183 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:30:17.201 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:30:17.198+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:30:17.218 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:30:17.228 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:30:17.228 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [], 2020-11-12T17:30:17.229 INFO:teuthology.orchestra.run.smithi205.stdout: "complaint_time": 30, 2020-11-12T17:30:17.229 INFO:teuthology.orchestra.run.smithi205.stdout: "num_blocked_ops": 0 2020-11-12T17:30:17.229 INFO:teuthology.orchestra.run.smithi205.stdout:} 2020-11-12T17:30:17.238 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2020-11-12T17:30:17.264 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:30:17.290 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:30:17.302 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:30:17.298+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:30:17.319 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:30:17.348 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:17.349 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:17.349 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:30:17.350 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'false' 2020-11-12T17:30:17.350 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'false' 2020-11-12T17:30:17.351 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'false' 2020-11-12T17:30:17.351 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'false' 2020-11-12T17:30:17.351 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'false' 2020-11-12T17:30:17.351 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'false' 2020-11-12T17:30:17.351 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'false' 2020-11-12T17:30:17.351 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'false' 2020-11-12T17:30:17.358 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2020-11-12T17:30:17.403 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:30:17.402+0000 7fb244437700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31701) UID: 0 2020-11-12T17:30:17.466 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:17.467 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:17.476 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2020-11-12T17:30:17.520 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:30:17.518+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:30:17.605 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:30:17.598+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:30:17.627 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:17.627 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:17.637 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2020-11-12T17:30:17.706 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:30:17.702+0000 7f2819dc4700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 12502) UID: 0 2020-11-12T17:30:17.749 INFO:tasks.ceph.osd.6.smithi205.stderr:2020-11-12T17:30:17.742+0000 7f2809aaf700 -1 osd.6 229 handle_osd_map injecting map crc failure 2020-11-12T17:30:17.751 INFO:teuthology.orchestra.run.smithi036.stderr:reweighted osd.3 to 1 (10000) 2020-11-12T17:30:17.752 INFO:teuthology.orchestra.run.smithi036.stderr:nodeep-scrub is set 2020-11-12T17:30:17.752 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'unique_pool_3' removed 2020-11-12T17:30:17.754 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:17.755 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:17.768 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 4 1 2020-11-12T17:30:17.772 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2020-11-12T17:30:17.778 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2020-11-12T17:30:17.884 INFO:tasks.radosbench:Beginning radosbench... 2020-11-12T17:30:17.888 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2020-11-12T17:30:17.889 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create unique_pool_4 16 2020-11-12T17:30:17.894 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:30:17.890+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:30:17.992 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:30:17.986+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:30:18.045 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:18.046 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:18.057 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2020-11-12T17:30:18.103 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:30:18.102+0000 7fb244437700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31701) UID: 0 2020-11-12T17:30:18.179 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:18.179 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:18.188 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2020-11-12T17:30:18.232 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:30:18.230+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:30:18.295 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:30:18.294+0000 7fb244437700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31701) UID: 0 2020-11-12T17:30:18.340 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:18.340 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:18.349 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2020-11-12T17:30:18.396 INFO:tasks.ceph.osd.4.smithi205.stderr:2020-11-12T17:30:18.394+0000 7f7b5b5ac700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 12496) UID: 0 2020-11-12T17:30:18.497 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:30:18.494+0000 7fb244437700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31701) UID: 0 2020-11-12T17:30:18.504 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:18.505 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:18.514 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2020-11-12T17:30:18.599 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:30:18.598+0000 7fb244437700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31701) UID: 0 2020-11-12T17:30:18.667 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:18.668 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:18.677 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2020-11-12T17:30:18.699 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:30:18.694+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:30:18.761 INFO:teuthology.orchestra.run.smithi036.stderr:reweighted osd.4 to 1 (10000) 2020-11-12T17:30:18.767 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'unique_pool_4' created 2020-11-12T17:30:18.780 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd reweight 5 1 2020-11-12T17:30:18.784 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2020-11-12T17:30:18.800 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:30:18.794+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:30:18.842 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:18.842 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:18.852 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2020-11-12T17:30:18.943 INFO:tasks.ceph.osd.3.smithi036.stderr:2020-11-12T17:30:18.938+0000 7fc2589e6700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 12298) UID: 0 2020-11-12T17:30:19.002 INFO:tasks.ceph.osd.2.smithi036.stderr:2020-11-12T17:30:18.998+0000 7fb244437700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31701) UID: 0 2020-11-12T17:30:19.046 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:19.047 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:19.059 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2020-11-12T17:30:19.103 INFO:tasks.ceph.osd.5.smithi205.stderr:2020-11-12T17:30:19.098+0000 7f9a16db7700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 12504) UID: 0 2020-11-12T17:30:19.205 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:30:19.202+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:30:19.214 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:19.214 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:19.223 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2020-11-12T17:30:19.306 INFO:tasks.ceph.osd.7.smithi205.stderr:2020-11-12T17:30:19.298+0000 7f9295471700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 12505) UID: 0 2020-11-12T17:30:19.362 INFO:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2020-11-12T17:30:19.369 INFO:teuthology.orchestra.run.smithi036.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:19.370 INFO:teuthology.orchestra.run.smithi036.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:19.379 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2020-11-12T17:30:19.423 INFO:tasks.ceph.osd.0.smithi036.stderr:2020-11-12T17:30:19.422+0000 7f6593a5d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 12296) UID: 0 2020-11-12T17:30:19.485 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:19.485 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:19.495 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2020-11-12T17:30:19.508 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:30:19.506+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:30:19.513 INFO:teuthology.orchestra.run.smithi036.stdout:osd.0: {} 2020-11-12T17:30:19.543 INFO:teuthology.orchestra.run.smithi036.stdout:osd.1: {} 2020-11-12T17:30:19.569 INFO:teuthology.orchestra.run.smithi036.stdout:osd.2: {} 2020-11-12T17:30:19.597 INFO:teuthology.orchestra.run.smithi036.stdout:osd.3: {} 2020-11-12T17:30:19.601 INFO:teuthology.orchestra.run.smithi205.stdout:ERROR: (22) Invalid argument 2020-11-12T17:30:19.602 INFO:teuthology.orchestra.run.smithi205.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2020-11-12T17:30:19.609 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:30:19.606+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:30:19.611 INFO:teuthology.orchestra.run.smithi205:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2020-11-12T17:30:19.628 INFO:teuthology.orchestra.run.smithi036.stdout:osd.4: {} 2020-11-12T17:30:19.657 INFO:teuthology.orchestra.run.smithi036.stdout:osd.5: {} 2020-11-12T17:30:19.687 INFO:teuthology.orchestra.run.smithi036.stdout:osd.6: {} 2020-11-12T17:30:19.710 INFO:tasks.ceph.osd.1.smithi036.stderr:2020-11-12T17:30:19.706+0000 7f4df5e01700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 20269) UID: 0 2020-11-12T17:30:19.717 INFO:teuthology.orchestra.run.smithi036.stdout:osd.7: {} 2020-11-12T17:30:19.719 INFO:teuthology.orchestra.run.smithi036.stderr:osd.0: osd_enable_op_tracker = 'true' 2020-11-12T17:30:19.719 INFO:teuthology.orchestra.run.smithi036.stderr:osd.1: osd_enable_op_tracker = 'true' 2020-11-12T17:30:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:osd.2: osd_enable_op_tracker = 'true' 2020-11-12T17:30:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:osd.3: osd_enable_op_tracker = 'true' 2020-11-12T17:30:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:osd.4: osd_enable_op_tracker = 'true' 2020-11-12T17:30:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:osd.5: osd_enable_op_tracker = 'true' 2020-11-12T17:30:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:osd.6: osd_enable_op_tracker = 'true' 2020-11-12T17:30:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:osd.7: osd_enable_op_tracker = 'true' 2020-11-12T17:30:19.722 INFO:teuthology.orchestra.run.smithi205.stdout:{ 2020-11-12T17:30:19.722 INFO:teuthology.orchestra.run.smithi205.stdout: "size": 20, 2020-11-12T17:30:19.722 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 600, 2020-11-12T17:30:19.722 INFO:teuthology.orchestra.run.smithi205.stdout: "ops": [ 2020-11-12T17:30:19.723 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.723 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:5880 3.9 3:98430d0b:::benchmark_data_smithi036_14212_object734:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e25)", 2020-11-12T17:30:19.723 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:30:19.723 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 429.03012358299998, 2020-11-12T17:30:19.723 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998, 2020-11-12T17:30:19.723 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:19.723 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:19.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:19.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:19.724 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:19.724 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 5880 2020-11-12T17:30:19.724 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.724 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:19.724 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:19.725 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:30:19.725 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:19.725 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.725 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.725 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:19.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686713+0000", 2020-11-12T17:30:19.726 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999642 2020-11-12T17:30:19.726 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.726 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.726 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:19.726 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686677+0000", 2020-11-12T17:30:19.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00010411700000000001 2020-11-12T17:30:19.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.727 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.727 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:19.727 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686781+0000", 2020-11-12T17:30:19.727 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3606e-05 2020-11-12T17:30:19.727 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:19.728 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686795+0000", 2020-11-12T17:30:19.728 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.8969999999999996e-06 2020-11-12T17:30:19.728 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.728 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.728 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:19.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.686801+0000", 2020-11-12T17:30:19.729 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0032575260000000002 2020-11-12T17:30:19.729 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.729 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.729 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:19.729 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690058+0000", 2020-11-12T17:30:19.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000107716 2020-11-12T17:30:19.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.730 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.730 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:19.730 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690166+0000", 2020-11-12T17:30:19.730 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014657299999999999 2020-11-12T17:30:19.730 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:30:19.731 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.690312+0000", 2020-11-12T17:30:19.731 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0018093600000000001 2020-11-12T17:30:19.731 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.731 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.731 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:19.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692122+0000", 2020-11-12T17:30:19.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433600282 2020-11-12T17:30:19.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.732 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.732 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:19.732 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125722+0000", 2020-11-12T17:30:19.732 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.6119999999999995e-05 2020-11-12T17:30:19.732 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:19.733 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125808+0000", 2020-11-12T17:30:19.733 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.0180999999999996e-05 2020-11-12T17:30:19.733 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.733 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.733 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:19.734 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125898+0000", 2020-11-12T17:30:19.734 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43918571499999998 2020-11-12T17:30:19.734 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.734 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:19.736 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.736 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.736 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.736 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:5880 3.9 e25/20 ondisk, result = 0)", 2020-11-12T17:30:19.736 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:30:19.737 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 429.02464351399999, 2020-11-12T17:30:19.737 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999, 2020-11-12T17:30:19.737 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:19.737 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:30:19.737 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:19.737 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:19.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:30:19.738 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:19.738 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.738 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.738 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:19.738 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692193+0000", 2020-11-12T17:30:19.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999695 2020-11-12T17:30:19.739 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.739 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.739 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:19.739 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692163+0000", 2020-11-12T17:30:19.739 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8292000000000002e-05 2020-11-12T17:30:19.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.740 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:19.740 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:10.692241+0000", 2020-11-12T17:30:19.740 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.433367789 2020-11-12T17:30:19.740 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.740 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:19.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125609+0000", 2020-11-12T17:30:19.741 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.1302e-05 2020-11-12T17:30:19.741 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.741 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.741 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:19.741 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125630+0000", 2020-11-12T17:30:19.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.7824000000000007e-05 2020-11-12T17:30:19.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.742 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.742 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:19.742 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125698+0000", 2020-11-12T17:30:19.742 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.112e-05 2020-11-12T17:30:19.742 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:19.743 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125709+0000", 2020-11-12T17:30:19.743 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000198705 2020-11-12T17:30:19.743 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.743 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.743 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:19.744 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:11.125908+0000", 2020-11-12T17:30:19.744 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43371474199999999 2020-11-12T17:30:19.744 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.744 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:19.744 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.744 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.744 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.745 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4475.0:12600 3.9 3:94f120e6:::benchmark_data_smithi036_14212_object1574:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e31)", 2020-11-12T17:30:19.745 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:30:19.745 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 420.83452191399999, 2020-11-12T17:30:19.745 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002, 2020-11-12T17:30:19.745 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:19.745 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:19.745 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:19.746 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4475", 2020-11-12T17:30:19.746 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/902149570", 2020-11-12T17:30:19.746 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 12600 2020-11-12T17:30:19.746 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.746 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:19.746 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.746 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:19.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:30:19.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:19.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.747 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.747 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:19.747 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882314+0000", 2020-11-12T17:30:19.747 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999309 2020-11-12T17:30:19.747 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:19.748 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882245+0000", 2020-11-12T17:30:19.748 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00016308699999999999 2020-11-12T17:30:19.748 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.748 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.748 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:19.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882408+0000", 2020-11-12T17:30:19.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.3049999999999997e-05 2020-11-12T17:30:19.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.749 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.749 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:19.749 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882441+0000", 2020-11-12T17:30:19.749 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.7399999999999993e-06 2020-11-12T17:30:19.749 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:19.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.882450+0000", 2020-11-12T17:30:19.750 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0045189330000000002 2020-11-12T17:30:19.750 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.750 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.750 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:19.750 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.886969+0000", 2020-11-12T17:30:19.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015932199999999999 2020-11-12T17:30:19.751 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.751 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.751 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:19.751 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887128+0000", 2020-11-12T17:30:19.751 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030544200000000001 2020-11-12T17:30:19.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.752 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 2", 2020-11-12T17:30:19.752 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.887434+0000", 2020-11-12T17:30:19.752 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0020375359999999999 2020-11-12T17:30:19.752 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.752 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:19.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889471+0000", 2020-11-12T17:30:19.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54130353499999995 2020-11-12T17:30:19.753 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.753 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.753 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:19.753 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430775+0000", 2020-11-12T17:30:19.753 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011229 2020-11-12T17:30:19.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.754 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:19.754 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430887+0000", 2020-11-12T17:30:19.754 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00015734700000000001 2020-11-12T17:30:19.754 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.754 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.755 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:19.755 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431045+0000", 2020-11-12T17:30:19.755 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54873016200000002 2020-11-12T17:30:19.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.755 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:19.755 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.755 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.756 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.756 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4475.0:12600 3.9 e31/20 ondisk, result = 0)", 2020-11-12T17:30:19.756 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:30:19.756 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 420.82727820500003, 2020-11-12T17:30:19.756 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003, 2020-11-12T17:30:19.756 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:19.756 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:30:19.757 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:19.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.757 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:19.757 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:30:19.757 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:19.757 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.757 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:19.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889558+0000", 2020-11-12T17:30:19.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999747 2020-11-12T17:30:19.758 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.758 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.758 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:19.758 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889533+0000", 2020-11-12T17:30:19.758 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5351000000000005e-05 2020-11-12T17:30:19.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.759 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:19.759 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:18.889598+0000", 2020-11-12T17:30:19.759 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54103158100000004 2020-11-12T17:30:19.759 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.759 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:19.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430630+0000", 2020-11-12T17:30:19.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.3149999999999999e-05 2020-11-12T17:30:19.760 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.760 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.760 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:19.760 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430643+0000", 2020-11-12T17:30:19.760 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.5604000000000001e-05 2020-11-12T17:30:19.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:19.761 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430738+0000", 2020-11-12T17:30:19.761 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2187e-05 2020-11-12T17:30:19.761 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.761 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.761 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:19.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.430760+0000", 2020-11-12T17:30:19.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00030111999999999999 2020-11-12T17:30:19.762 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.762 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.762 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:19.762 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:23:19.431062+0000", 2020-11-12T17:30:19.762 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.54150349600000003 2020-11-12T17:30:19.763 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.763 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:19.763 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.763 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.763 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.763 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "MOSDPGPush(3.6 62/59 [PushOp(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head, version: 48'1864, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b6167ed:::benchmark_data_smithi036_14212_object3690:head@48'1864, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2020-11-12T17:30:19.763 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:30:19.763 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 344.83118883100002, 2020-11-12T17:30:19.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002, 2020-11-12T17:30:19.764 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:19.764 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:30:19.764 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:19.764 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.764 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:19.764 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:30:19.764 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:19.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.765 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:19.765 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885647+0000", 2020-11-12T17:30:19.765 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999437 2020-11-12T17:30:19.765 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.765 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:19.766 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885591+0000", 2020-11-12T17:30:19.766 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00020467700000000001 2020-11-12T17:30:19.766 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.766 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.766 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:19.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:34.885796+0000", 2020-11-12T17:30:19.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47108167099999998 2020-11-12T17:30:19.767 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.767 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.767 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:19.767 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356878+0000", 2020-11-12T17:30:19.767 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 1.9658999999999999e-05 2020-11-12T17:30:19.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:19.768 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.356897+0000", 2020-11-12T17:30:19.768 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00014254799999999999 2020-11-12T17:30:19.768 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.768 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.768 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:19.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357040+0000", 2020-11-12T17:30:19.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 2.2317999999999999e-05 2020-11-12T17:30:19.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.769 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.769 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:19.769 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.357062+0000", 2020-11-12T17:30:19.769 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0029779009999999998 2020-11-12T17:30:19.769 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.770 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.770 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:19.770 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:24:35.360040+0000", 2020-11-12T17:30:19.770 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.47439261900000002 2020-11-12T17:30:19.770 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.770 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:19.771 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.771 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.771 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.771 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_repop_reply(client.4971.0:47840 4.1 e94/69 ondisk, result = 0)", 2020-11-12T17:30:19.771 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:30:19.771 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 278.70366631899998, 2020-11-12T17:30:19.771 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687, 2020-11-12T17:30:19.772 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:19.772 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "started", 2020-11-12T17:30:19.772 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:19.772 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.772 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:19.772 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:30:19.772 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:19.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.773 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.773 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:19.773 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013170+0000", 2020-11-12T17:30:19.773 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999828 2020-11-12T17:30:19.773 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:19.774 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013153+0000", 2020-11-12T17:30:19.774 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.4431999999999997e-05 2020-11-12T17:30:19.774 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.774 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.774 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:19.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.013197+0000", 2020-11-12T17:30:19.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.52063924399999995 2020-11-12T17:30:19.775 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.775 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.775 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:19.775 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533836+0000", 2020-11-12T17:30:19.775 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.9900000000000003e-06 2020-11-12T17:30:19.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.776 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:19.776 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533845+0000", 2020-11-12T17:30:19.776 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.6857000000000001e-05 2020-11-12T17:30:19.776 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.776 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:19.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533902+0000", 2020-11-12T17:30:19.777 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.346e-06 2020-11-12T17:30:19.777 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.777 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.777 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:19.777 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.533912+0000", 2020-11-12T17:30:19.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00012700499999999999 2020-11-12T17:30:19.778 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.778 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.778 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:19.778 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:41.534039+0000", 2020-11-12T17:30:19.778 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.520868687 2020-11-12T17:30:19.778 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.779 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:19.779 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:19.779 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.779 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.779 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53719 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 49152~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:30:19.982 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:30:19.982 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 271.65291887799998, 2020-11-12T17:30:19.982 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998, 2020-11-12T17:30:19.983 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:19.983 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:19.984 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:19.984 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:30:19.984 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:30:19.984 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53719 2020-11-12T17:30:19.984 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.985 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:19.985 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.985 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:19.985 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:30:19.985 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:19.985 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.986 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:19.986 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063917+0000", 2020-11-12T17:30:19.986 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999804 2020-11-12T17:30:19.986 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.986 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:19.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063898+0000", 2020-11-12T17:30:19.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.7463999999999997e-05 2020-11-12T17:30:19.987 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.987 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.987 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:19.987 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063955+0000", 2020-11-12T17:30:19.987 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 8.8400000000000001e-06 2020-11-12T17:30:19.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.988 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.988 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:19.988 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063964+0000", 2020-11-12T17:30:19.988 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4.9609999999999996e-06 2020-11-12T17:30:19.988 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:19.989 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063969+0000", 2020-11-12T17:30:19.989 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.012786073 2020-11-12T17:30:19.989 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.989 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.989 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:19.990 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076755+0000", 2020-11-12T17:30:19.990 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 9.1323999999999995e-05 2020-11-12T17:30:19.990 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.990 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.990 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:19.991 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076846+0000", 2020-11-12T17:30:19.991 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.00011642999999999999 2020-11-12T17:30:19.991 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.992 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:30:19.992 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.076963+0000", 2020-11-12T17:30:19.992 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0028799099999999998 2020-11-12T17:30:19.992 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.992 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.993 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:19.993 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.079843+0000", 2020-11-12T17:30:19.993 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41458133000000003 2020-11-12T17:30:19.993 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.993 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec", 2020-11-12T17:30:19.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494424+0000", 2020-11-12T17:30:19.994 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.8100000000000002e-05 2020-11-12T17:30:19.994 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.994 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:19.994 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "commit_sent", 2020-11-12T17:30:19.994 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494492+0000", 2020-11-12T17:30:19.995 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 7.8075e-05 2020-11-12T17:30:19.995 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:19.995 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.198 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "done", 2020-11-12T17:30:20.198 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.494570+0000", 2020-11-12T17:30:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.43065274399999998 2020-11-12T17:30:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: ] 2020-11-12T17:30:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: } 2020-11-12T17:30:20.199 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: "description": "osd_op(client.4971.0:53720 4.1 4:83ecff60:::benchmark_data_smithi036_18856_object6714:head [set-alloc-hint object_size 65536 write_size 8192,write 57344~8192] snapc 0=[] ondisk+write+known_if_redirected e98)", 2020-11-12T17:30:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: "initiated_at": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:30:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: "age": 271.65283068299999, 2020-11-12T17:30:20.200 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.434113366, 2020-11-12T17:30:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: "type_data": { 2020-11-12T17:30:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: "flag_point": "commit sent; apply or cleanup", 2020-11-12T17:30:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: "client_info": { 2020-11-12T17:30:20.201 INFO:teuthology.orchestra.run.smithi205.stdout: "client": "client.4971", 2020-11-12T17:30:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: "client_addr": "v1:172.21.15.36:0/951054943", 2020-11-12T17:30:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: "tid": 53720 2020-11-12T17:30:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: "events": [ 2020-11-12T17:30:20.202 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "initiated", 2020-11-12T17:30:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:30:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0 2020-11-12T17:30:20.203 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.204 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.204 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "throttled", 2020-11-12T17:30:20.205 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064006+0000", 2020-11-12T17:30:20.205 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 4294967295.9999824 2020-11-12T17:30:20.205 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.205 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.205 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "header_read", 2020-11-12T17:30:20.206 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.063988+0000", 2020-11-12T17:30:20.206 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 5.2240000000000001e-05 2020-11-12T17:30:20.206 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.206 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.206 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "all_read", 2020-11-12T17:30:20.207 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064040+0000", 2020-11-12T17:30:20.207 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5400000000000001e-06 2020-11-12T17:30:20.207 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.207 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.207 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "dispatched", 2020-11-12T17:30:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064047+0000", 2020-11-12T17:30:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 3.2119999999999999e-06 2020-11-12T17:30:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "queued_for_pg", 2020-11-12T17:30:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.064050+0000", 2020-11-12T17:30:20.208 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.013980394 2020-11-12T17:30:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "reached_pg", 2020-11-12T17:30:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078030+0000", 2020-11-12T17:30:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 6.5950000000000004e-05 2020-11-12T17:30:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.209 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "started", 2020-11-12T17:30:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078096+0000", 2020-11-12T17:30:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.000136713 2020-11-12T17:30:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "waiting for subops from 5", 2020-11-12T17:30:20.210 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.078233+0000", 2020-11-12T17:30:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.0021056199999999999 2020-11-12T17:30:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "op_commit", 2020-11-12T17:30:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: "time": "2020-11-12T17:25:48.080339+0000", 2020-11-12T17:30:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: "duration": 0.41767869699999999 2020-11-12T17:30:20.211 INFO:teuthology.orchestra.run.smithi205.stdout: }, 2020-11-12T17:30:20.212 INFO:teuthology.orchestra.run.smithi205.stdout: { 2020-11-12T17:30:20.212 INFO:teuthology.orchestra.run.smithi205.stdout: "event": "sub_op_commit_rec",